2024-09-12T00:07:29.382 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:07:29.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:07:29.687 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7901846' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHOOdqaAGpaq26i2/iW8WtCTPzuQU8Hmt6CJOmDz1gNYirHvktN2xFpnM3cFJhiQL0gcEMBKkaF62YCM7PUB8tg= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDrbKIhNSV+DkXiLv3I2Xroogp+ei98K/cjGbsBuCw8MOv7LyaKS5iVQdSxDR3zz80eKzgXBhwMk281RWWUR1eo= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:07:29.687 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:07:29.688 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:07:29.688 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:07:29.690 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:07:29.713 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:07:29.713 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:07:29.713 INFO:teuthology.packaging:ref: None 2024-09-12T00:07:29.713 INFO:teuthology.packaging:tag: None 2024-09-12T00:07:29.713 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:07:29.713 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:07:29.713 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:07:29.868 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:07:29.869 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:07:29.875 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:07:29.876 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:07:29.891 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:07:29.913 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:07:29.929 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:07:29.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:01:49.370091', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG2K42v5TNprPkul+SiAPD/zLjPO9jwi9dxgvTFNY8ts'} 2024-09-12T00:07:29.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:01:49.371742', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBoZq2WuVYbY1Bhe1sKen0WB3pSWKGk2KAaqYGe+HYK5'} 2024-09-12T00:07:29.991 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:07:29.999 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:07:29.999 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:07:29.999 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:07:30.160 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f555b7f7490>, signals=[15]) 2024-09-12T00:07:30.161 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:07:30.183 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:07:30.183 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T00:07:30.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:07:30.274 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T00:07:30.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:07:30.364 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:07:30.383 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-09-12T00:07:30.388 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-09-12T00:07:30.388 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-09-12T00:07:30.435 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:07:30.435 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2024-09-12T00:07:30.435 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="22.04" 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=jammy 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:07:30.436 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:07:30.437 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-09-12T00:07:30.470 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-09-12T00:07:30.476 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-09-12T00:07:30.476 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu" 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04" 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:07:30.523 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:07:30.524 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-09-12T00:07:30.544 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:07:30.566 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:07:30.573 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:07:30.573 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:07:30.576 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:07:30.581 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:07:30.591 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:07:30.592 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:07:30.626 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:07:30.633 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:07:30.764 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:07:30.781 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:07:30.781 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:07:30.781 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:07:30.782 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:07:30.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:07:30.787 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-12T00:07:30.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:07:30.788 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-12T00:07:30.832 INFO:teuthology.orchestra.run.smithi137.stdout:5.15.0-56-generic 2024-09-12T00:07:30.833 INFO:teuthology.task.kernel:Running kernel on smithi137: 5.15.0-56-generic 2024-09-12T00:07:30.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get clean 2024-09-12T00:07:30.835 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-56-generic 2024-09-12T00:07:30.835 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.15.0-56-generic 2024-09-12T00:07:30.835 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2024-09-12T00:07:30.965 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-12T00:07:30.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-12T00:07:31.105 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:07:31.124 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:07:31.147 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:07:31.221 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:07:31.221 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:07:31.230 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:07:31.311 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:07:31.325 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:07:31.343 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:07:31.405 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:07:31.426 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:07:31.431 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:07:31.434 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:07:31.434 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:07:31.438 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:07:31.445 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:07:31.445 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:07:31.454 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:07:31.455 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:07:31.459 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:07:31.459 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:07:31.460 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:07:31.460 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:07:31.463 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:07:31.463 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:07:31.467 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:07:31.472 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:07:31.474 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:07:31.474 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:07:31.474 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:07:31.485 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:07:31.493 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:07:31.497 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:07:31.499 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:07:31.500 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:07:31.508 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:07:31.554 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:07:31.555 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:07:31.555 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:07:31.555 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:07:31.556 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:07:31.557 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:07:31.557 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:07:31.572 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:07:31.572 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:07:31.573 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:07:31.589 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:07:31.666 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:07:31.703 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:07:31.804 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:07:31.998 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:07:32.122 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:07:32.139 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:07:32.150 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:07:32.151 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:07:32.151 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:07:32.155 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:07:32.169 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:07:32.170 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:07:32.171 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:07:32.240 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:07:32.245 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:07:32.251 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:07:32.251 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:07:32.256 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:07:32.257 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:07:32.273 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:07:32.277 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:07:32.301 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:07:32.305 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:07:32.306 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:07:32.307 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:07:32.307 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:07:32.307 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:07:32.313 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:07:32.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:07:32.321 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:07:32.322 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:07:32.385 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:07:32.395 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:07:32.395 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:07:32.397 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:07:32.398 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:07:32.398 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:07:32.402 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:07:32.402 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:07:32.483 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:07:32.483 INFO:teuthology.orchestra.run.smithi137.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:07:37.744 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 15.8 MB in 2s (7,527 kB/s) 2024-09-12T00:07:37.846 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 15.8 MB in 2s (7,601 kB/s) 2024-09-12T00:07:39.290 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-12T00:07:39.304 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:07:39.355 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T00:07:39.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:07:39.423 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-12T00:07:39.444 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T00:07:39.633 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-12T00:07:39.634 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-12T00:07:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-12T00:07:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-12T00:07:39.809 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:07:39.809 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:07:39.809 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:07:39.811 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:07:39.811 INFO:teuthology.orchestra.run.smithi150.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:07:39.811 INFO:teuthology.orchestra.run.smithi150.stdout: python2.7-minimal 2024-09-12T00:07:39.811 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:07:39.811 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:07:39.811 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:07:39.812 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:07:39.812 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:07:39.812 INFO:teuthology.orchestra.run.smithi137.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:07:39.812 INFO:teuthology.orchestra.run.smithi137.stdout: python2.7-minimal 2024-09-12T00:07:39.812 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:07:39.813 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-09-12T00:07:39.813 INFO:teuthology.orchestra.run.smithi137.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:07:39.813 INFO:teuthology.orchestra.run.smithi137.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:07:39.813 INFO:teuthology.orchestra.run.smithi137.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:07:39.813 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-12T00:07:39.813 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:07:39.813 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:07:39.813 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:07:39.814 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-09-12T00:07:39.814 INFO:teuthology.orchestra.run.smithi137.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:07:39.814 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-09-12T00:07:39.814 INFO:teuthology.orchestra.run.smithi137.stdout: thermald 2024-09-12T00:07:39.814 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-12T00:07:39.814 INFO:teuthology.orchestra.run.smithi150.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:07:39.814 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2024-09-12T00:07:39.814 INFO:teuthology.orchestra.run.smithi150.stdout: thermald 2024-09-12T00:07:39.862 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-09-12T00:07:39.862 INFO:teuthology.orchestra.run.smithi137.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:07:39.862 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:07:39.863 INFO:teuthology.orchestra.run.smithi137.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:07:39.864 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2024-09-12T00:07:39.865 INFO:teuthology.orchestra.run.smithi137.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:07:39.872 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-12T00:07:39.872 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:07:39.872 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:07:39.872 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:07:39.874 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2024-09-12T00:07:39.874 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:07:39.924 INFO:teuthology.orchestra.run.smithi150.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:07:39.925 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 113 MB of archives. 2024-09-12T00:07:39.925 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:07:39.925 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:07:40.044 INFO:teuthology.orchestra.run.smithi137.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:07:40.044 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 113 MB of archives. 2024-09-12T00:07:40.044 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:07:40.044 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:07:40.372 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:07:40.476 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:07:41.323 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:07:41.324 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:07:41.324 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:07:41.427 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:07:41.450 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:07:41.523 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:07:41.774 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:07:41.908 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 113 MB in 2s (69.1 MB/s) 2024-09-12T00:07:42.252 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:07:43.975 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:07:43.975 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:07:43.975 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:07:44.259 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:07:44.263 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:07:44.313 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:07:44.325 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:07:44.394 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:07:44.801 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 113 MB in 5s (25.1 MB/s) 2024-09-12T00:07:44.979 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:07:46.418 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:07:46.439 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:07:46.527 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:07:46.988 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:07:47.009 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:07:47.046 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:07:47.103 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:07:47.107 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:07:47.234 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:07:49.478 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:07:49.499 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:07:49.586 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:07:50.047 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:07:50.068 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:07:50.097 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:07:53.597 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:07:53.807 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:07:54.131 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:07:54.261 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:07:54.555 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:07:54.566 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:07:54.597 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:07:56.896 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:07:57.023 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:07:57.323 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:07:57.443 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:07:57.755 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:07:57.777 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:07:57.821 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:08:00.318 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:08:00.355 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:08:00.393 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:03.050 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:08:03.172 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:08:03.506 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:08:03.597 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:08:03.627 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:03.634 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:08:03.712 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:03.753 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:08:03.882 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:05.193 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:08:05.194 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:08:05.194 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:08:05.194 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:08:05.333 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:06.340 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:08:06.465 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:08:07.368 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:07.723 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:08:07.845 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:07.988 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:08:08.125 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:08.753 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:08:08.879 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:08:09.005 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:09.075 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:08:09.075 INFO:teuthology.orchestra.run.smithi150.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:08:09.468 INFO:teuthology.orchestra.run.smithi137.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:08:09.468 INFO:teuthology.orchestra.run.smithi137.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:08:09.468 INFO:teuthology.orchestra.run.smithi137.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:08:09.469 INFO:teuthology.orchestra.run.smithi137.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:08:09.626 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:11.044 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:12.462 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:08:12.588 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:08:13.498 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:08:13.547 INFO:teuthology.orchestra.run.smithi137.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:08:13.547 INFO:teuthology.orchestra.run.smithi137.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:08:23.640 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:08:23.640 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:08:23.656 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:08:23.680 INFO:teuthology.orchestra.run.smithi150.stdout:Generating grub configuration file ... 2024-09-12T00:08:23.959 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:08:23.978 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:08:24.307 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:08:24.313 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:08:24.380 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:08:24.385 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:08:24.545 INFO:teuthology.orchestra.run.smithi150.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:08:24.545 INFO:teuthology.orchestra.run.smithi150.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:08:24.545 INFO:teuthology.orchestra.run.smithi150.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:08:24.599 INFO:teuthology.orchestra.run.smithi150.stdout:done 2024-09-12T00:08:25.061 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2024-09-12T00:08:25.082 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 21 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.119.119 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2024-09-12T00:08:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:08:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2024-09-12T00:08:25.084 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:08:25.084 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:08:25.084 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:08:25.084 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:08:25.084 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:08:25.084 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2024-09-12T00:08:25.233 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-12T00:08:25.473 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:08:25.473 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:08:25.545 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:08:25.626 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:08:26.928 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T00:08:26.946 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:08:27.008 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T00:08:27.218 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-12T00:08:27.220 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-12T00:08:27.394 INFO:teuthology.orchestra.run.smithi150.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:08:27.395 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:08:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:08:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:08:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:08:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:08:27.395 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:08:27.396 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:08:27.433 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:08:27.436 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2024-09-12T00:08:27.452 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2024-09-12T00:08:27.452 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2024-09-12T00:08:27.452 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2024-09-12T00:08:27.452 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2024-09-12T00:08:27.452 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 21 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.119.119 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:08:27.453 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2024-09-12T00:08:27.454 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-12T00:08:27.498 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.lxMfHqbzZi 2024-09-12T00:08:27.498 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lxMfHqbzZi 2024-09-12T00:08:27.554 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.lxMfHqbzZi 2024-09-12T00:08:27.663 INFO:teuthology.orchestra.run.smithi137.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:08:27.663 INFO:teuthology.orchestra.run.smithi137.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:08:27.677 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.lxMfHqbzZi is 10KB 2024-09-12T00:08:27.684 INFO:teuthology.orchestra.run.smithi137.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:08:27.690 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.lxMfHqbzZi 2024-09-12T00:08:27.695 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:08:27.703 INFO:teuthology.orchestra.run.smithi137.stdout:Generating grub configuration file ... 2024-09-12T00:08:27.750 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:08:27.750 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:08:27.750 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:08:27.817 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:08:27.817 DEBUG:teuthology.orchestra.run.smithi150:> sudo update-grub 2024-09-12T00:08:28.041 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:08:28.067 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:08:28.500 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:08:28.506 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:08:28.571 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:08:28.577 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:08:28.727 INFO:teuthology.orchestra.run.smithi137.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:08:28.727 INFO:teuthology.orchestra.run.smithi137.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:08:28.727 INFO:teuthology.orchestra.run.smithi137.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:08:28.776 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-09-12T00:08:29.043 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:08:29.043 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:08:29.046 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-09-12T00:08:29.235 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:08:29.241 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:08:29.274 DEBUG:teuthology.orchestra.run.smithi137:> dpkg -s linux-image-generic 2024-09-12T00:08:29.296 INFO:teuthology.orchestra.run.smithi137.stdout:Package: linux-image-generic 2024-09-12T00:08:29.296 INFO:teuthology.orchestra.run.smithi137.stdout:Status: install ok installed 2024-09-12T00:08:29.296 INFO:teuthology.orchestra.run.smithi137.stdout:Priority: optional 2024-09-12T00:08:29.296 INFO:teuthology.orchestra.run.smithi137.stdout:Section: kernel 2024-09-12T00:08:29.296 INFO:teuthology.orchestra.run.smithi137.stdout:Installed-Size: 21 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: amd64 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout:Source: linux-meta 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout:Version: 5.15.0.119.119 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout:Recommends: thermald 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout:Description: Generic Linux kernel image 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:08:29.297 INFO:teuthology.orchestra.run.smithi137.stdout: available. 2024-09-12T00:08:29.297 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:08:29.298 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:08:29.298 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:08:29.298 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:08:29.298 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:08:29.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get clean 2024-09-12T00:08:29.478 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:08:29.484 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:08:29.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-12T00:08:29.524 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:08:29.530 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:08:29.629 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:08:29.660 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:08:29.660 INFO:teuthology.orchestra.run.smithi150.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:08:29.660 INFO:teuthology.orchestra.run.smithi150.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:08:29.675 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-09-12T00:08:29.689 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-09-12T00:08:29.750 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:08:29.848 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:08:29.912 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:08:31.144 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-12T00:08:31.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:08:31.223 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-12T00:08:31.438 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-12T00:08:31.438 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-12T00:08:31.616 INFO:teuthology.orchestra.run.smithi137.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:08:31.616 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:08:31.617 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:08:31.617 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:08:31.617 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:08:31.617 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:08:31.618 INFO:teuthology.orchestra.run.smithi137.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:08:31.618 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:08:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:08:31.659 DEBUG:teuthology.orchestra.run.smithi137:> dpkg -s linux-image-generic 2024-09-12T00:08:31.674 INFO:teuthology.orchestra.run.smithi137.stdout:Package: linux-image-generic 2024-09-12T00:08:31.674 INFO:teuthology.orchestra.run.smithi137.stdout:Status: install ok installed 2024-09-12T00:08:31.674 INFO:teuthology.orchestra.run.smithi137.stdout:Priority: optional 2024-09-12T00:08:31.674 INFO:teuthology.orchestra.run.smithi137.stdout:Section: kernel 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Installed-Size: 21 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: amd64 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Source: linux-meta 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Version: 5.15.0.119.119 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Recommends: thermald 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout:Description: Generic Linux kernel image 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:08:31.675 INFO:teuthology.orchestra.run.smithi137.stdout: available. 2024-09-12T00:08:31.676 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-12T00:08:31.719 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.PLRdApOBLd 2024-09-12T00:08:31.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub/grub.cfg /tmp/tmp.PLRdApOBLd 2024-09-12T00:08:31.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.PLRdApOBLd 2024-09-12T00:08:31.900 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.PLRdApOBLd is 10KB 2024-09-12T00:08:31.913 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.PLRdApOBLd 2024-09-12T00:08:31.918 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:08:31.971 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:08:31.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:08:31.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:08:32.039 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:08:32.040 DEBUG:teuthology.orchestra.run.smithi137:> sudo update-grub 2024-09-12T00:08:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:08:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:08:33.349 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-09-12T00:08:33.601 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:08:33.607 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:08:33.926 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:08:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:08:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:08:33.981 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:08:34.124 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-09-12T00:08:34.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-09-12T00:08:59.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:08:59.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T00:08:59.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:09:04.143 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:09:04.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T00:09:04.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:09:34.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-12T00:09:38.621 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T00:09:43.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:09:47.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T00:09:48.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:10:01.661 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-12T00:10:13.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T00:10:13.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:10:15.496 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-12T00:10:19.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-12T00:10:30.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T00:10:30.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:10:30.829 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-12T00:10:31.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T00:10:31.423 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T00:10:31.423 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-12T00:10:31.470 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-119-generic 2024-09-12T00:10:31.470 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:10:31.470 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:10:31.470 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:10:31.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T00:10:31.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:10:32.155 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-12T00:10:32.471 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:10:32.471 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:10:32.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T00:10:32.755 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T00:10:32.755 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-12T00:10:32.801 INFO:teuthology.orchestra.run.smithi137.stdout:5.15.0-119-generic 2024-09-12T00:10:32.802 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:10:32.802 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:10:32.802 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:10:32.810 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2024-09-12T00:10:32.831 DEBUG:teuthology.parallel:result is None 2024-09-12T00:10:33.803 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:10:33.803 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:10:34.167 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-09-12T00:10:34.191 DEBUG:teuthology.parallel:result is None 2024-09-12T00:10:34.191 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:10:34.198 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:10:34.198 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:10:34.201 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:10:34.207 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:10:34.292 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:10:34.298 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:10:34.299 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:10:34.301 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:10:34.488 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:10:34.497 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:10:34.498 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:10:34.501 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:10:34.522 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:10:34.523 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:10:34.530 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:10:34.531 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:10:34.533 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:10:34.540 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:10:34.540 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:10:34.582 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:10:34.595 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:10:34.605 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:10:34.605 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:10:34.639 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:10:34.645 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:10:34.689 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:10:34.737 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:10:34.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:10:34.797 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:10:34.803 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:10:34.850 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:10:34.850 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:10:34.923 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-09-12T00:10:34.925 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-09-12T00:10:34.998 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:10:35.006 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:10:35.006 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:10:35.022 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:10:35.031 DEBUG:teuthology.task.selinux:Excluding smithi137: OS 'ubuntu' does not support SELinux 2024-09-12T00:10:35.031 DEBUG:teuthology.task.selinux:Excluding smithi150: OS 'ubuntu' does not support SELinux 2024-09-12T00:10:35.031 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:10:35.031 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T00:10:35.031 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:10:35.031 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:10:35.120 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T00:10:35.123 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T00:10:35.242 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:10:35.253 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:10:35.254 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi137.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:18:08.725 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2024-09-12T00:18:08.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T00:18:08.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:18:08.855 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-12T00:18:08.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T00:18:08.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T00:18:08.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:18:09.026 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-12T00:18:09.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T00:18:09.105 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:18:09.122 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:18:09.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:18:09.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:18:09.126 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:18:09.126 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:18:09.152 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:18:09.152 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Command line: ntpd -gq 2024-09-12T00:18:09.152 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: ---------------------------------------------------- 2024-09-12T00:18:09.152 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:18:09.152 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:18:09.153 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: corporation. Support and training for ntp-4 are 2024-09-12T00:18:09.153 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: available at https://www.nwtime.org/support 2024-09-12T00:18:09.153 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: ---------------------------------------------------- 2024-09-12T00:18:09.153 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: proto: precision = 0.043 usec (-24) 2024-09-12T00:18:09.153 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: basedate set to 2022-02-04 2024-09-12T00:18:09.153 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:18:09.154 INFO:teuthology.orchestra.run.smithi137.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:18:09.155 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:18:09.155 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:18:09.155 INFO:teuthology.orchestra.run.smithi137.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:18:09.156 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:18:09.156 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:18:09.156 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:18:09.157 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Listen normally on 3 enp3s0f1 172.21.15.137:123 2024-09-12T00:18:09.157 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Listen normally on 4 lo [::1]:123 2024-09-12T00:18:09.157 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8137%5]:123 2024-09-12T00:18:09.157 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:09 ntpd[18499]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:18:09.173 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:18:09.173 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Command line: ntpd -gq 2024-09-12T00:18:09.173 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: ---------------------------------------------------- 2024-09-12T00:18:09.173 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:18:09.173 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:18:09.174 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: corporation. Support and training for ntp-4 are 2024-09-12T00:18:09.174 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: available at https://www.nwtime.org/support 2024-09-12T00:18:09.174 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: ---------------------------------------------------- 2024-09-12T00:18:09.174 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: proto: precision = 0.056 usec (-24) 2024-09-12T00:18:09.175 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: basedate set to 2022-02-04 2024-09-12T00:18:09.175 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:18:09.175 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:18:09.175 INFO:teuthology.orchestra.run.smithi150.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:18:09.175 INFO:teuthology.orchestra.run.smithi150.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:18:09.176 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:18:09.176 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:18:09.176 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:18:09.176 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:18:09.177 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Listen normally on 3 enp3s0f1 172.21.15.150:123 2024-09-12T00:18:09.177 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Listen normally on 4 lo [::1]:123 2024-09-12T00:18:09.177 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e35%5]:123 2024-09-12T00:18:09.177 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:09 ntpd[18472]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:18:10.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:10.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:10.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:10.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:10.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:10.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:10.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:10.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:10.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:10.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:10.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:10.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:10 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:10 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:10 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:10.174 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:10 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:12.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:12.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:12 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:12.174 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:12.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:12.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:12 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:13.173 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:13 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:13.174 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:13 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:14 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:14.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:14.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:14.177 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:14.177 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:14 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:16.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.154 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:16.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:16.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:16.155 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:16.155 INFO:teuthology.orchestra.run.smithi137.stdout:12 Sep 00:18:16 ntpd[18499]: ntpd: time slew +0.000600 s 2024-09-12T00:18:16.155 INFO:teuthology.orchestra.run.smithi137.stdout:ntpd: time slew +0.000600s 2024-09-12T00:18:16.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:18:16.156 INFO:teuthology.orchestra.run.smithi137.stderr:12 Sep 00:18:16 ntpd[18499]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:18:16.175 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:18:16.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:18:16.176 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 00:18:16 ntpd[18472]: ntpd: time slew +0.000523 s 2024-09-12T00:18:16.176 INFO:teuthology.orchestra.run.smithi150.stdout:ntpd: time slew +0.000523s 2024-09-12T00:18:16.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:18:16.176 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 00:18:16 ntpd[18472]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:18:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:18:16.214 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-09-12T00:18:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:18:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:18:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:18:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:18:16.217 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:18:16.217 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2024-09-12T00:18:16.217 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:18:16.217 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:18:16.218 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:18:16.218 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:18:16.218 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:18:16.227 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:18:16.228 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:18:16.228 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:18:16.228 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:18:16.233 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:18:16.233 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:18:16.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-key list | grep Ceph 2024-09-12T00:18:16.234 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-key list | grep Ceph 2024-09-12T00:18:16.308 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:18:16.311 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:18:16.336 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:18:16.336 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:18:16.337 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:18:16.337 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:18:16.337 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:18:16.351 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:18:16.351 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:18:16.351 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:18:16.351 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:18:16.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:18:16.499 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:18:16.499 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:18:16.510 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:18:16.511 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:18:16.627 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:18:16.627 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:18:16.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-12T00:18:16.649 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:18:16.650 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:18:16.664 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-12T00:18:16.807 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:18:16.817 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:18:16.819 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:18:16.834 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:18:16.835 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:18:16.835 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:18:16.846 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:18:16.861 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:18:16.863 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:18:16.882 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:18:16.890 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:18:16.906 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:18:16.914 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:18:16.928 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:18:16.935 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:18:16.956 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:18:16.956 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:18:16.983 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:18:17.174 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 29.2 kB in 0s (83.6 kB/s) 2024-09-12T00:18:17.207 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 29.2 kB in 0s (83.1 kB/s) 2024-09-12T00:18:18.197 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-12T00:18:18.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:18:18.252 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T00:18:18.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:18:18.277 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-12T00:18:18.332 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T00:18:18.487 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-12T00:18:18.487 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-12T00:18:18.541 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-12T00:18:18.541 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-12T00:18:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:18:18.679 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:18:18.679 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:18:18.679 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:18:18.680 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:18:18.680 INFO:teuthology.orchestra.run.smithi137.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:18:18.680 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:18:18.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:18:18.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet zip 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:18:18.684 INFO:teuthology.orchestra.run.smithi137.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:18:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-09-12T00:18:18.685 INFO:teuthology.orchestra.run.smithi137.stdout: btrfs-tools 2024-09-12T00:18:18.732 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:18:18.733 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:18:18.733 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:18:18.733 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:18:18.733 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:18:18.734 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:18:18.734 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:18:18.734 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-12T00:18:18.734 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:18:18.734 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:18:18.735 INFO:teuthology.orchestra.run.smithi150.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:18:18.735 INFO:teuthology.orchestra.run.smithi150.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:18:18.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet zip 2024-09-12T00:18:18.737 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2024-09-12T00:18:18.738 INFO:teuthology.orchestra.run.smithi150.stdout: btrfs-tools 2024-09-12T00:18:18.786 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-09-12T00:18:18.787 INFO:teuthology.orchestra.run.smithi137.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:18:18.787 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:18:18.787 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:18:18.787 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:18:18.787 INFO:teuthology.orchestra.run.smithi137.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:18:18.787 INFO:teuthology.orchestra.run.smithi137.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:18:18.788 INFO:teuthology.orchestra.run.smithi137.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:18:18.788 INFO:teuthology.orchestra.run.smithi137.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:18:18.788 INFO:teuthology.orchestra.run.smithi137.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:18:18.788 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:18:18.788 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:18:18.788 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:18:18.789 INFO:teuthology.orchestra.run.smithi137.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:18:18.840 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-12T00:18:18.840 INFO:teuthology.orchestra.run.smithi150.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:18:18.840 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:18:18.841 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:18:18.841 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:18:18.841 INFO:teuthology.orchestra.run.smithi150.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:18:18.841 INFO:teuthology.orchestra.run.smithi150.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:18:18.842 INFO:teuthology.orchestra.run.smithi150.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:18:18.842 INFO:teuthology.orchestra.run.smithi150.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:18:18.842 INFO:teuthology.orchestra.run.smithi150.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:18:18.842 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:18:18.842 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:18:18.842 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:18:18.842 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:18:18.843 INFO:teuthology.orchestra.run.smithi150.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:18:18.847 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:18:18.847 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 251 MB of archives. 2024-09-12T00:18:18.847 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:18:18.847 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:18:18.905 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:18:18.905 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 251 MB of archives. 2024-09-12T00:18:18.905 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:18:18.905 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:18:18.928 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:18:18.934 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:18:18.936 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:18:18.953 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:18:18.981 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:18:18.994 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:18:18.997 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:18:19.012 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:18:19.014 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:18:19.017 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:18:19.029 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:18:19.033 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:18:19.034 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:18:19.034 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:18:19.043 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:18:19.045 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:18:19.047 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:18:19.049 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:18:19.049 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:18:19.052 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:18:19.066 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:18:19.069 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:18:19.069 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:18:19.069 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:18:19.070 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:18:19.071 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:18:19.073 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:18:19.078 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:18:19.083 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:18:19.084 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:18:19.084 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:18:19.084 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:18:19.091 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:18:19.095 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:18:19.096 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:18:19.096 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:18:19.100 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:18:19.103 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:18:19.103 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:18:19.104 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:18:19.104 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:18:19.105 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:18:19.105 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:18:19.107 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:18:19.109 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:18:19.110 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:18:19.111 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:18:19.113 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:18:19.114 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:18:19.117 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:18:19.118 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:18:19.119 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:18:19.119 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:18:19.128 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:18:19.130 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:18:19.130 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:18:19.131 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:18:19.132 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:18:19.133 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:18:19.134 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:18:19.139 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:18:19.140 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:18:19.140 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:18:19.141 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:18:19.142 INFO:teuthology.orchestra.run.smithi137.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:18:19.144 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:18:19.145 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:18:19.145 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:18:19.146 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:18:19.151 INFO:teuthology.orchestra.run.smithi137.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:18:19.152 INFO:teuthology.orchestra.run.smithi137.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:18:19.153 INFO:teuthology.orchestra.run.smithi137.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:18:19.154 INFO:teuthology.orchestra.run.smithi137.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:18:19.161 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:18:19.164 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:18:19.165 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:18:19.165 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:18:19.166 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:18:19.166 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:18:19.170 INFO:teuthology.orchestra.run.smithi137.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:18:19.170 INFO:teuthology.orchestra.run.smithi137.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:18:19.170 INFO:teuthology.orchestra.run.smithi137.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:18:19.172 INFO:teuthology.orchestra.run.smithi137.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:18:19.178 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:18:19.179 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:18:19.180 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:18:19.180 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:18:19.182 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:18:19.195 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:18:19.200 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:18:19.201 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:18:19.201 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:18:19.202 INFO:teuthology.orchestra.run.smithi137.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:18:19.202 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:18:19.203 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:18:19.211 INFO:teuthology.orchestra.run.smithi150.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:18:19.212 INFO:teuthology.orchestra.run.smithi150.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:18:19.213 INFO:teuthology.orchestra.run.smithi150.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:18:19.214 INFO:teuthology.orchestra.run.smithi150.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:18:19.222 INFO:teuthology.orchestra.run.smithi137.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:18:19.226 INFO:teuthology.orchestra.run.smithi137.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:18:19.227 INFO:teuthology.orchestra.run.smithi137.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:18:19.228 INFO:teuthology.orchestra.run.smithi137.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:18:19.228 INFO:teuthology.orchestra.run.smithi137.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:18:19.228 INFO:teuthology.orchestra.run.smithi150.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:18:19.229 INFO:teuthology.orchestra.run.smithi150.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:18:19.229 INFO:teuthology.orchestra.run.smithi137.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:18:19.229 INFO:teuthology.orchestra.run.smithi137.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:18:19.230 INFO:teuthology.orchestra.run.smithi137.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:18:19.230 INFO:teuthology.orchestra.run.smithi150.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:18:19.232 INFO:teuthology.orchestra.run.smithi150.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:18:19.233 INFO:teuthology.orchestra.run.smithi137.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:18:19.234 INFO:teuthology.orchestra.run.smithi137.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:18:19.246 INFO:teuthology.orchestra.run.smithi137.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:18:19.248 INFO:teuthology.orchestra.run.smithi137.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:18:19.268 INFO:teuthology.orchestra.run.smithi137.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:18:19.268 INFO:teuthology.orchestra.run.smithi137.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:18:19.283 INFO:teuthology.orchestra.run.smithi137.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:18:19.283 INFO:teuthology.orchestra.run.smithi137.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:18:19.283 INFO:teuthology.orchestra.run.smithi137.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:18:19.284 INFO:teuthology.orchestra.run.smithi137.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:18:19.284 INFO:teuthology.orchestra.run.smithi137.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:18:19.285 INFO:teuthology.orchestra.run.smithi150.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:18:19.285 INFO:teuthology.orchestra.run.smithi137.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:18:19.285 INFO:teuthology.orchestra.run.smithi137.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:18:19.285 INFO:teuthology.orchestra.run.smithi150.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:18:19.286 INFO:teuthology.orchestra.run.smithi150.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:18:19.287 INFO:teuthology.orchestra.run.smithi150.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:18:19.288 INFO:teuthology.orchestra.run.smithi150.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:18:19.295 INFO:teuthology.orchestra.run.smithi137.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:18:19.298 INFO:teuthology.orchestra.run.smithi137.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:18:19.312 INFO:teuthology.orchestra.run.smithi137.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:18:19.313 INFO:teuthology.orchestra.run.smithi137.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:18:19.314 INFO:teuthology.orchestra.run.smithi137.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:18:19.315 INFO:teuthology.orchestra.run.smithi150.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:18:19.316 INFO:teuthology.orchestra.run.smithi150.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:18:19.317 INFO:teuthology.orchestra.run.smithi150.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:18:19.317 INFO:teuthology.orchestra.run.smithi137.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:18:19.318 INFO:teuthology.orchestra.run.smithi150.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:18:19.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:18:19.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:18:19.321 INFO:teuthology.orchestra.run.smithi137.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:18:19.325 INFO:teuthology.orchestra.run.smithi137.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:18:19.329 INFO:teuthology.orchestra.run.smithi137.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:18:19.330 INFO:teuthology.orchestra.run.smithi150.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:18:19.332 INFO:teuthology.orchestra.run.smithi137.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:18:19.332 INFO:teuthology.orchestra.run.smithi150.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:18:19.332 INFO:teuthology.orchestra.run.smithi150.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:18:19.333 INFO:teuthology.orchestra.run.smithi150.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:18:19.333 INFO:teuthology.orchestra.run.smithi150.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:18:19.333 INFO:teuthology.orchestra.run.smithi150.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:18:19.334 INFO:teuthology.orchestra.run.smithi150.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:18:19.337 INFO:teuthology.orchestra.run.smithi150.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:18:19.337 INFO:teuthology.orchestra.run.smithi150.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:18:19.338 INFO:teuthology.orchestra.run.smithi150.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:18:19.340 INFO:teuthology.orchestra.run.smithi150.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:18:19.340 INFO:teuthology.orchestra.run.smithi150.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:18:19.344 INFO:teuthology.orchestra.run.smithi150.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:18:19.346 INFO:teuthology.orchestra.run.smithi137.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:18:19.346 INFO:teuthology.orchestra.run.smithi150.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:18:19.346 INFO:teuthology.orchestra.run.smithi137.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:18:19.347 INFO:teuthology.orchestra.run.smithi137.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:18:19.348 INFO:teuthology.orchestra.run.smithi137.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:18:19.349 INFO:teuthology.orchestra.run.smithi137.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:18:19.354 INFO:teuthology.orchestra.run.smithi150.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:18:19.355 INFO:teuthology.orchestra.run.smithi150.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:18:19.356 INFO:teuthology.orchestra.run.smithi150.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:18:19.356 INFO:teuthology.orchestra.run.smithi137.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:18:19.356 INFO:teuthology.orchestra.run.smithi137.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:18:19.356 INFO:teuthology.orchestra.run.smithi137.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:18:19.357 INFO:teuthology.orchestra.run.smithi150.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:18:19.358 INFO:teuthology.orchestra.run.smithi150.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:18:19.361 INFO:teuthology.orchestra.run.smithi150.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:18:19.361 INFO:teuthology.orchestra.run.smithi150.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:18:19.362 INFO:teuthology.orchestra.run.smithi150.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:18:19.363 INFO:teuthology.orchestra.run.smithi137.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:18:19.363 INFO:teuthology.orchestra.run.smithi137.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:18:19.370 INFO:teuthology.orchestra.run.smithi150.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:18:19.371 INFO:teuthology.orchestra.run.smithi150.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:18:19.373 INFO:teuthology.orchestra.run.smithi150.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:18:19.387 INFO:teuthology.orchestra.run.smithi150.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:18:19.388 INFO:teuthology.orchestra.run.smithi150.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:18:19.388 INFO:teuthology.orchestra.run.smithi150.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:18:19.389 INFO:teuthology.orchestra.run.smithi150.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:18:19.390 INFO:teuthology.orchestra.run.smithi150.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:18:19.396 INFO:teuthology.orchestra.run.smithi150.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:18:19.396 INFO:teuthology.orchestra.run.smithi150.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:18:19.405 INFO:teuthology.orchestra.run.smithi150.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:18:19.407 INFO:teuthology.orchestra.run.smithi150.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:18:19.407 INFO:teuthology.orchestra.run.smithi150.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:18:19.511 INFO:teuthology.orchestra.run.smithi137.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:18:19.514 INFO:teuthology.orchestra.run.smithi137.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:18:19.523 INFO:teuthology.orchestra.run.smithi137.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:18:19.678 INFO:teuthology.orchestra.run.smithi150.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:18:19.681 INFO:teuthology.orchestra.run.smithi150.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:18:19.703 INFO:teuthology.orchestra.run.smithi150.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:18:20.299 INFO:teuthology.orchestra.run.smithi137.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:18:20.377 INFO:teuthology.orchestra.run.smithi137.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:18:20.379 INFO:teuthology.orchestra.run.smithi137.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:18:20.381 INFO:teuthology.orchestra.run.smithi137.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:18:20.421 INFO:teuthology.orchestra.run.smithi137.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:18:20.570 INFO:teuthology.orchestra.run.smithi137.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:18:21.172 INFO:teuthology.orchestra.run.smithi150.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:18:21.207 INFO:teuthology.orchestra.run.smithi137.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:18:21.208 INFO:teuthology.orchestra.run.smithi137.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:18:21.224 INFO:teuthology.orchestra.run.smithi137.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:18:21.262 INFO:teuthology.orchestra.run.smithi137.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:18:21.270 INFO:teuthology.orchestra.run.smithi150.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:18:21.272 INFO:teuthology.orchestra.run.smithi137.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:18:21.273 INFO:teuthology.orchestra.run.smithi137.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:18:21.275 INFO:teuthology.orchestra.run.smithi150.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:18:21.279 INFO:teuthology.orchestra.run.smithi150.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:18:21.362 INFO:teuthology.orchestra.run.smithi150.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:18:21.671 INFO:teuthology.orchestra.run.smithi150.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:18:22.918 INFO:teuthology.orchestra.run.smithi150.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:18:22.918 INFO:teuthology.orchestra.run.smithi150.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:18:22.936 INFO:teuthology.orchestra.run.smithi150.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:18:22.979 INFO:teuthology.orchestra.run.smithi150.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:18:22.989 INFO:teuthology.orchestra.run.smithi150.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:18:22.991 INFO:teuthology.orchestra.run.smithi150.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:18:23.031 INFO:teuthology.orchestra.run.smithi137.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:18:23.195 INFO:teuthology.orchestra.run.smithi137.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:18:23.195 INFO:teuthology.orchestra.run.smithi137.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:18:24.849 INFO:teuthology.orchestra.run.smithi137.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:18:24.852 INFO:teuthology.orchestra.run.smithi137.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:18:24.853 INFO:teuthology.orchestra.run.smithi137.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:18:25.279 INFO:teuthology.orchestra.run.smithi137.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:18:25.805 INFO:teuthology.orchestra.run.smithi150.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:18:25.853 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 251 MB in 6s (38.7 MB/s) 2024-09-12T00:18:25.915 INFO:teuthology.orchestra.run.smithi150.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:18:25.916 INFO:teuthology.orchestra.run.smithi150.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:18:26.041 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:18:26.141 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:18:26.146 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:18:26.231 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:18:26.568 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:18:26.593 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:18:26.634 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:18:26.954 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:18:26.980 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:18:27.020 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:18:27.124 INFO:teuthology.orchestra.run.smithi150.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:18:27.127 INFO:teuthology.orchestra.run.smithi150.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:18:27.128 INFO:teuthology.orchestra.run.smithi150.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:18:27.366 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:18:27.392 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:18:27.435 INFO:teuthology.orchestra.run.smithi150.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:18:27.440 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:18:27.860 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:18:27.887 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:18:27.927 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:18:27.984 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 251 MB in 9s (29.2 MB/s) 2024-09-12T00:18:28.141 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:18:28.241 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:18:28.247 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:18:28.255 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:18:28.281 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:18:28.321 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:18:28.348 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:18:28.608 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:18:28.634 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:18:28.674 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:18:28.693 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:18:28.720 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:18:28.760 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:18:28.996 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librados2. 2024-09-12T00:18:29.020 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:29.063 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:18:29.069 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:29.089 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:18:29.129 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:18:29.522 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:18:29.525 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:18:29.547 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:29.551 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:18:29.588 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:29.600 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:18:29.986 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:18:29.999 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:18:30.012 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:18:30.026 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:30.053 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:18:30.057 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:30.318 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:18:30.333 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:30.376 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:30.380 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:18:30.407 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:18:30.447 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:18:30.704 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:18:30.731 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:18:30.771 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:30.775 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:18:30.802 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:18:30.842 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:18:31.032 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:18:31.047 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:31.090 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:31.161 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librados2. 2024-09-12T00:18:31.187 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:31.228 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:31.351 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:18:31.366 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:18:31.401 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:31.689 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:18:31.715 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:31.721 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:18:31.747 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:18:31.755 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:31.787 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:18:32.208 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:18:32.235 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:32.266 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:32.321 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:18:32.347 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:18:32.390 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:18:32.552 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:18:32.567 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:32.610 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:32.642 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:18:32.657 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:32.701 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:32.938 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:18:32.964 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:18:33.005 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:33.045 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:18:33.071 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:18:33.112 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:18:33.265 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:18:33.292 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:33.332 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:33.356 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:18:33.371 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:18:33.406 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:18:33.618 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:18:33.645 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:18:33.685 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:33.692 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:18:33.718 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:18:33.759 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:18:33.988 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:18:34.014 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:18:34.046 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:18:34.112 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:18:34.138 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:18:34.179 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:18:34.349 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:18:34.375 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:18:34.415 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:18:34.490 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:18:34.505 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:18:34.540 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:18:34.685 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:18:34.700 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:34.743 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:34.751 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package zip. 2024-09-12T00:18:34.777 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:18:34.817 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:18:35.096 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:18:35.120 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package unzip. 2024-09-12T00:18:35.122 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:18:35.148 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:18:35.162 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:18:35.187 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:18:35.415 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:18:35.431 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:18:35.465 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:18:35.574 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:18:35.600 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:18:35.641 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:18:35.785 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:18:35.811 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:18:35.851 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:18:36.032 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:18:36.058 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:36.098 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:36.146 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:18:36.173 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:18:36.213 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:18:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:18:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:18:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:18:36.701 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:18:36.716 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:36.750 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:36.885 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package zip. 2024-09-12T00:18:36.911 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:18:36.951 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:18:37.054 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:18:37.080 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:18:37.120 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:18:37.415 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:18:37.441 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:37.489 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:37.524 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package unzip. 2024-09-12T00:18:37.551 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:18:37.588 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:18:37.943 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:18:37.969 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:37.984 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:18:38.009 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:38.010 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:18:38.050 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:18:38.425 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:18:38.451 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:38.491 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:39.110 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:18:39.125 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:39.160 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:39.438 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:18:39.448 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:18:39.464 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:18:39.474 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:39.505 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:18:39.524 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:39.824 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:18:39.850 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:39.891 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:40.077 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:18:40.103 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:18:40.144 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:18:40.336 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:18:40.362 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:40.402 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:40.405 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:18:40.431 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:18:40.465 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:18:40.699 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:18:40.725 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:18:40.757 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:18:41.085 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:18:41.112 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:18:41.152 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:18:41.421 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:18:41.437 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:18:41.471 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:18:41.757 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:18:41.784 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:18:41.824 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:18:41.841 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:18:41.867 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:41.908 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:42.110 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:18:42.136 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:18:42.176 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:18:42.455 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:18:42.478 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:18:42.481 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:18:42.505 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:18:42.521 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:18:42.545 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:18:42.831 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:18:42.857 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:18:42.897 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:18:43.007 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:18:43.034 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:18:43.066 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:18:43.217 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:18:43.243 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:18:43.284 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:18:43.419 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:18:43.446 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:18:43.486 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:18:43.545 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:18:43.571 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:18:43.603 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:18:43.772 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:18:43.799 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:18:43.839 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:18:43.889 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:18:43.916 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:18:43.956 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:18:44.083 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:18:44.110 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:18:44.141 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:18:44.259 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:18:44.285 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:18:44.334 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:18:44.477 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:18:44.504 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:18:44.544 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:18:44.637 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:18:44.663 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:18:44.703 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:18:44.874 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:18:44.901 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:18:44.941 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:18:44.947 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:18:44.963 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:18:45.006 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:18:45.210 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:18:45.226 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:18:45.260 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:18:45.309 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:18:45.335 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:18:45.384 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:18:45.546 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:18:45.573 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:18:45.612 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:18:45.729 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:18:45.755 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:18:45.787 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:18:45.957 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:18:45.984 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:18:46.027 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:18:46.073 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:18:46.100 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:18:46.141 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:18:46.335 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:18:46.361 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:18:46.402 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:18:46.451 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:18:46.478 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:18:46.518 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:18:46.713 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:18:46.739 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:18:46.779 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:18:46.821 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:18:46.847 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:18:46.887 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:18:47.107 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:18:47.123 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:18:47.166 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:18:47.207 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:18:47.222 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:18:47.265 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:18:47.452 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:18:47.478 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:18:47.510 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:18:47.518 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:18:47.534 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:18:47.568 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:18:47.813 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:18:47.839 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:18:47.879 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:18:48.054 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:18:48.081 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:18:48.121 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:18:48.208 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:18:48.234 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:18:48.274 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:18:48.473 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:18:48.500 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:18:48.543 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:18:48.612 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:18:48.638 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:18:48.679 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:18:48.885 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:18:48.912 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:18:48.951 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:18:49.015 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:18:49.041 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:18:49.082 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:18:49.204 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:18:49.221 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:18:49.254 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:18:49.342 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:18:49.358 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:18:49.392 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:18:49.582 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:18:49.609 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:18:49.649 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:18:49.654 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:18:49.681 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:18:49.720 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:18:49.918 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:18:49.933 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:18:49.968 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:18:50.040 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:18:50.067 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:18:50.107 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:18:50.238 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:18:50.264 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:18:50.321 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:18:50.443 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:18:50.470 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:18:50.510 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:50.574 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:18:50.600 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:18:50.641 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:18:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:18:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:18:51.047 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:18:51.087 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:18:51.234 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:18:51.260 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:18:51.300 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:18:51.398 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:18:51.413 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:18:51.448 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:18:51.603 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:18:51.630 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:18:51.669 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:18:51.709 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:18:51.737 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:18:51.776 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:18:52.006 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:18:52.032 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:52.054 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:18:52.081 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:18:52.448 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:52.495 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:18:53.249 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:18:53.276 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:18:53.315 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:18:53.326 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:18:53.353 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:53.392 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:53.585 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:18:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:18:53.652 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:53.929 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:18:53.956 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:53.996 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:54.031 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:18:54.059 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:54.098 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:54.392 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:18:54.419 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:18:54.459 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:18:54.695 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:18:54.711 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:18:54.753 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:18:55.049 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph. 2024-09-12T00:18:55.076 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:55.098 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:18:55.115 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:55.125 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:55.164 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:55.435 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:18:55.461 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:55.501 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:55.568 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:18:55.595 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:55.634 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:55.788 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:18:55.814 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:55.846 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:56.196 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:18:56.223 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:56.241 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:18:56.263 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:56.267 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:56.307 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:56.618 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:18:56.645 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:18:56.684 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:18:56.987 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:18:57.002 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:18:57.045 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:18:57.399 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph. 2024-09-12T00:18:57.415 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:57.449 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:57.727 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:18:57.754 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:57.793 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:58.117 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:18:58.145 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:18:58.180 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:18:58.183 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:18:58.207 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:58.246 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:58.528 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:18:58.555 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:18:58.595 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:18:58.650 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:18:58.676 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:18:58.716 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:58.931 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:18:58.958 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:18:58.998 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:18:59.044 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:18:59.071 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:18:59.110 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:18:59.334 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:18:59.361 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:18:59.401 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:18:59.430 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:18:59.457 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:18:59.496 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:18:59.679 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:18:59.706 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:18:59.737 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:19:00.048 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:19:00.076 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:00.106 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:00.510 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:19:00.537 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:19:00.576 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:19:00.872 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:19:00.888 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:19:00.922 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:19:01.267 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:19:01.282 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:01.317 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:01.653 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:19:01.680 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:19:01.729 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:19:01.973 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:19:02.000 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:19:02.031 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:19:02.359 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:19:02.386 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:02.417 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:02.836 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:19:02.853 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:19:02.886 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:19:03.331 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:19:03.397 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:19:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:19:03.911 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:19:03.942 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:19:04.203 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:19:04.231 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:19:04.987 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:19:05.008 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:05.122 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:05.355 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:19:05.372 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:19:05.414 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:19:05.892 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:19:05.958 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:19:06.051 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:19:06.078 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:19:06.339 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:19:06.378 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:19:06.403 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:19:06.430 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:19:06.470 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:19:06.648 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:19:06.675 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:19:06.706 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:19:06.798 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:19:06.826 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:19:06.865 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:19:07.159 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:19:07.187 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:19:07.226 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:19:07.415 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:19:07.443 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:07.504 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:19:07.532 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:19:07.571 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:19:07.575 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:07.916 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:19:07.943 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:19:07.982 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:19:08.294 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:19:08.322 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:19:08.556 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:19:08.595 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:19:08.638 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:19:08.666 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:19:08.898 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:19:08.926 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:19:08.964 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:19:09.310 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:19:09.337 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:19:09.376 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:19:09.427 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:19:09.455 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:09.494 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:09.671 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:19:09.698 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:19:09.737 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:19:09.796 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:19:09.824 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:19:09.863 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:19:10.023 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:19:10.057 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:19:10.208 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:19:10.236 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:19:10.274 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:19:10.327 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:19:10.355 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:19:10.385 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:19:10.519 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package jq. 2024-09-12T00:19:10.546 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:19:10.585 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:19:10.716 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:19:10.755 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:19:10.829 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package socat. 2024-09-12T00:19:10.845 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:19:10.879 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:19:11.066 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:19:11.094 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:19:11.133 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:19:11.207 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:19:11.235 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:19:11.266 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:19:11.603 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:19:11.631 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:19:11.661 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:11.830 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:19:11.859 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:11.897 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:19:12.194 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:19:12.224 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:19:12.561 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:19:12.588 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:19:12.627 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:19:12.897 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package jq. 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:19:12.963 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:19:13.207 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package socat. 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:19:13.257 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:19:13.620 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:19:13.648 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:19:13.735 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:19:14.098 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:19:14.126 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:19:14.164 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:14.366 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:19:14.394 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:14.432 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:14.736 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:19:14.752 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:19:14.794 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:15.055 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:19:15.083 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:19:15.121 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:19:15.418 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:19:15.446 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:19:15.484 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:19:15.847 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:19:15.874 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:19:15.913 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:19:16.335 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:19:16.363 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:19:16.401 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:19:16.627 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:19:16.629 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:19:16.646 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:19:16.655 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:19:16.679 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:19:16.685 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:16.964 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:19:16.992 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:19:17.022 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:17.099 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:19:17.127 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:19:17.157 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:19:17.325 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:19:17.353 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:19:17.391 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:19:17.443 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:19:17.471 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:19:17.510 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:19:17.763 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:19:17.791 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:19:17.829 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:19:17.871 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:19:17.899 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:19:17.938 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:19:18.158 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:19:18.187 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:19:18.216 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:19:18.241 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:19:18.269 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:19:18.307 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:19:18.597 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:19:18.625 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:19:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:19:18.654 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:19:18.680 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:19:18.718 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:19:19.038 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:19:19.066 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:19:19.104 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:19:19.275 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:19:19.303 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:19:19.341 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:19:19.559 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:19:19.587 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:19:19.625 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:19:19.736 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:19:19.764 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:19:19.794 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:19:19.886 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:19:19.914 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:19:19.952 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:19:20.064 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:19:20.091 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:19:20.129 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:19:20.255 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:19:20.283 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:19:20.322 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:19:20.450 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:19:20.467 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:19:20.507 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:19:20.626 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:19:20.654 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:19:20.684 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:19:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:19:20.847 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:19:20.886 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:19:20.919 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:19:20.936 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:19:21.011 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:19:21.180 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:19:21.208 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:19:21.247 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:19:21.575 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:19:21.603 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:19:21.641 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:19:21.740 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:19:21.768 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:19:21.806 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:22.095 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:19:22.124 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:19:22.162 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:19:22.456 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:19:22.473 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:19:22.506 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:19:22.701 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:19:22.729 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:19:22.759 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:19:22.767 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:22.775 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:19:22.810 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:19:23.055 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:19:23.129 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:19:23.157 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:19:23.196 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:19:23.306 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:19:23.440 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:19:23.465 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:19:23.481 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:19:23.523 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:19:23.685 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:19:24.041 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:19:24.260 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:19:24.288 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:19:24.318 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:24.416 INFO:teuthology.orchestra.run.smithi137.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:19:24.484 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:24.949 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user cephadm....done 2024-09-12T00:19:25.092 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:19:25.213 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:19:25.241 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:19:25.271 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:25.368 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:19:25.584 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:19:25.603 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:19:25.729 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:19:25.851 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:19:25.977 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:19:25.980 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:19:26.227 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:19:26.247 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:19:26.374 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:19:26.536 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:19:26.676 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:19:26.948 INFO:teuthology.orchestra.run.smithi150.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:19:27.012 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:27.027 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:19:27.262 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:19:27.537 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user cephadm....done 2024-09-12T00:19:27.538 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:19:27.693 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:19:27.781 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:19:27.961 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:19:28.049 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:19:28.204 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:19:28.308 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:19:28.313 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:19:28.565 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:19:28.576 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:28.808 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:19:28.826 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:19:28.934 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:19:29.070 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:19:29.212 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:19:29.235 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:19:29.346 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:19:29.604 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:19:29.605 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:19:29.847 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:19:29.979 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:19:30.003 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:19:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:19:30.132 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:19:30.185 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:19:30.416 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:19:30.528 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:19:30.654 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:19:30.676 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:19:30.913 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:19:30.935 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:19:31.186 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:19:31.445 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:19:31.524 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:19:31.650 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:19:31.697 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:19:31.814 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:19:32.200 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:19:32.310 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:19:32.561 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:19:32.578 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:19:32.615 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:19:32.670 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:19:32.677 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:19:32.796 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:19:32.803 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:19:33.114 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:19:33.163 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:19:33.272 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:19:33.498 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:19:33.540 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:19:33.741 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:19:33.816 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:19:34.117 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:19:34.118 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:19:34.244 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:19:34.402 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:19:34.720 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:19:34.963 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:19:35.037 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:19:35.106 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:35.321 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:19:35.399 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:19:35.448 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:19:35.549 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:19:35.734 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:19:35.816 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:19:36.201 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:19:36.452 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:19:36.837 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:19:36.905 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:19:37.130 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:19:37.149 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:19:37.283 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:19:37.481 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:19:37.543 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:19:37.669 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:19:37.732 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:19:37.770 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:19:37.841 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:38.054 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:19:38.176 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:19:38.305 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:19:38.493 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:19:38.539 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:19:38.674 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:19:38.976 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:19:39.226 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:19:39.469 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:19:39.710 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:19:39.712 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:19:39.963 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:19:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:19:40.185 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:19:40.205 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:19:40.332 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:19:40.453 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:19:40.554 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:19:40.616 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:19:40.655 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:19:40.742 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:19:40.940 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:19:41.043 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:19:41.183 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:19:41.369 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:19:41.425 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:19:41.551 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:19:41.629 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:19:41.755 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:19:41.853 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:19:41.889 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:19:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:19:42.087 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:19:42.207 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:19:42.338 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:19:42.342 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:19:42.589 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:19:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:19:42.824 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:19:42.961 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:19:43.066 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:19:43.095 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:19:43.184 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:19:43.346 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:19:43.447 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:19:43.460 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:19:43.586 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:19:43.765 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:19:43.870 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:19:44.058 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:19:44.165 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:19:44.334 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:19:44.423 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:19:44.460 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:19:44.549 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:19:44.675 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:19:44.744 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:19:44.764 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:19:44.995 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:19:45.018 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:19:45.144 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:19:45.332 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:19:45.529 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:19:45.700 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:19:45.788 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:19:45.923 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:19:45.985 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:19:46.174 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:19:46.283 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:19:46.321 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:19:46.447 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:46.567 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:19:46.573 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:46.699 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:19:46.844 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:19:47.043 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:47.095 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:19:47.170 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:47.221 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:19:47.295 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:19:47.489 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:19:47.564 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:47.690 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:47.758 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:19:47.799 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:48.018 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:19:48.018 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:19:48.095 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:19:48.471 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:19:48.509 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:48.635 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:48.748 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:19:48.760 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:48.886 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:19:49.084 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:19:49.210 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:49.336 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:19:49.798 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:49.908 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.034 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:19:50.140 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.266 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.302 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.401 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.420 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.510 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.546 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.611 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:50.758 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:19:50.758 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:19:51.154 INFO:teuthology.orchestra.run.smithi137.stdout:Adding group ceph....done 2024-09-12T00:19:51.230 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:51.373 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:51.491 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:51.516 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user ceph....done 2024-09-12T00:19:51.600 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:19:51.674 INFO:teuthology.orchestra.run.smithi137.stdout:Setting system user ceph properties....done 2024-09-12T00:19:51.691 INFO:teuthology.orchestra.run.smithi137.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:19:51.831 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:19:52.181 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:19:52.604 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:52.730 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:52.829 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:52.955 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:53.081 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:53.174 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:19:53.174 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:19:53.207 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:53.341 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:53.640 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:53.835 INFO:teuthology.orchestra.run.smithi150.stdout:Adding group ceph....done 2024-09-12T00:19:53.993 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:19:54.177 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user ceph....done 2024-09-12T00:19:54.380 INFO:teuthology.orchestra.run.smithi150.stdout:Setting system user ceph properties....done 2024-09-12T00:19:54.400 INFO:teuthology.orchestra.run.smithi150.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:19:54.433 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:54.534 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:19:54.666 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:19:54.666 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:19:54.885 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:19:55.134 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:55.326 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:19:55.326 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:19:55.368 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:55.493 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:55.778 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:55.937 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:19:55.937 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:19:56.044 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:19:56.045 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:19:56.404 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:56.751 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:19:57.230 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:57.464 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:19:57.465 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:57.902 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:57.940 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:58.173 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:19:58.173 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:19:58.281 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:19:58.373 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:19:58.500 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:19:58.642 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:58.911 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:19:58.911 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:19:59.385 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:59.511 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:59.642 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:19:59.662 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:19:59.873 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:19:59.873 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:20:00.322 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:20:00.338 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:20:00.341 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:20:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-12T00:20:00.473 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:20:00.583 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:20:00.606 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-12T00:20:00.607 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-12T00:20:00.717 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:20:00.795 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:20:00.795 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:20:00.795 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:20:00.795 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:20:00.796 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:20:00.796 INFO:teuthology.orchestra.run.smithi137.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:20:00.796 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:20:00.797 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-09-12T00:20:00.797 INFO:teuthology.orchestra.run.smithi137.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:20:00.797 INFO:teuthology.orchestra.run.smithi137.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:20:00.798 INFO:teuthology.orchestra.run.smithi137.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:20:00.799 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-09-12T00:20:00.799 INFO:teuthology.orchestra.run.smithi137.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:20:00.799 INFO:teuthology.orchestra.run.smithi137.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:20:00.799 INFO:teuthology.orchestra.run.smithi137.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:20:00.799 INFO:teuthology.orchestra.run.smithi137.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:20:00.799 INFO:teuthology.orchestra.run.smithi137.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:20:00.836 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:20:00.837 INFO:teuthology.orchestra.run.smithi137.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:20:00.838 INFO:teuthology.orchestra.run.smithi137.stdout: s3cmd 2024-09-12T00:20:00.893 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:20:00.893 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:20:00.893 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:20:00.893 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:20:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:20:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:20:00.914 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:20:00.949 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:20:00.964 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:20:00.965 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:20:00.995 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:20:01.017 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:20:01.018 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:20:01.019 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:20:01.065 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:20:01.065 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:20:01.070 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:20:01.083 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:20:01.083 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:20:01.084 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:20:01.085 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:20:01.085 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:20:01.088 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:20:01.089 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:20:01.094 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:20:01.102 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:20:01.102 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:20:01.103 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:20:01.103 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:20:01.119 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:20:01.120 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:20:01.124 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:20:01.125 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:20:01.126 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:20:01.141 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:20:01.141 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:20:01.158 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:20:01.158 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:20:01.158 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:20:01.179 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:20:01.465 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:20:01.601 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 10.4 MB in 0s (33.1 MB/s) 2024-09-12T00:20:01.681 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:20:01.746 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:20:01.752 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:20:01.788 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:20:02.050 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:20:02.078 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:20:02.116 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:20:02.369 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:20:02.385 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:20:02.427 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:20:02.524 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:20:02.671 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:20:02.687 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:20:02.721 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:20:02.940 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:20:02.957 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:20:02.998 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:20:03.167 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:20:03.171 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:20:03.225 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T00:20:03.251 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:20:03.267 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:20:03.310 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:20:03.434 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-12T00:20:03.435 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-12T00:20:03.561 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:20:03.589 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:20:03.628 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:20:03.634 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:20:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:20:03.634 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:20:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:20:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:20:03.635 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:20:03.635 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:20:03.637 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-12T00:20:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:20:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:20:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:20:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:20:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:20:03.637 INFO:teuthology.orchestra.run.smithi150.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:20:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:20:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:20:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:20:03.638 INFO:teuthology.orchestra.run.smithi150.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:20:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:20:03.639 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-12T00:20:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:20:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:20:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:20:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:20:03.639 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:20:03.679 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-12T00:20:03.679 INFO:teuthology.orchestra.run.smithi150.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:20:03.679 INFO:teuthology.orchestra.run.smithi150.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:20:03.679 INFO:teuthology.orchestra.run.smithi150.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:20:03.680 INFO:teuthology.orchestra.run.smithi150.stdout: s3cmd 2024-09-12T00:20:03.733 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:20:03.733 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:20:03.734 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:20:03.734 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:20:03.752 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:20:03.752 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:20:03.755 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:20:03.792 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:20:03.808 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:20:03.809 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:20:03.840 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:20:03.862 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:20:03.863 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:20:03.864 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:20:03.881 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:20:03.897 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:20:03.914 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:20:03.914 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:20:03.930 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:20:03.933 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:20:03.933 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:20:03.933 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:20:03.937 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:20:03.937 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:20:03.940 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:20:03.941 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:20:03.947 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:20:03.954 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:20:03.954 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:20:03.955 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:20:03.955 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:20:03.971 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:20:03.972 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:20:03.974 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:20:03.978 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:20:03.980 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:20:03.997 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:20:03.997 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:20:04.017 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:20:04.017 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:20:04.017 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:20:04.192 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:20:04.205 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:20:04.266 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:20:04.460 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 10.4 MB in 0s (31.5 MB/s) 2024-09-12T00:20:04.519 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:20:04.545 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:20:04.546 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:20:04.585 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:20:04.605 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:20:04.610 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:20:04.655 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:20:04.838 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:20:04.851 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:20:04.888 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:20:04.914 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:20:04.931 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:20:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:20:05.233 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:20:05.250 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:20:05.317 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:20:05.333 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:20:05.367 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:20:05.375 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:20:05.595 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:20:05.624 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:20:05.653 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:20:05.662 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:20:05.681 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:20:05.719 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:20:05.906 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:20:05.922 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:20:05.964 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:20:06.090 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:20:06.106 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:20:06.148 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:20:06.217 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:20:06.233 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:20:06.275 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:20:06.409 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:20:06.426 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:20:06.467 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:20:06.511 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:20:06.527 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:20:06.592 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:20:06.703 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:20:06.720 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:20:06.753 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:20:06.863 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:20:06.891 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:20:06.930 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:20:06.939 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:20:06.955 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:20:06.989 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:20:07.232 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:20:07.241 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:20:07.248 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:20:07.270 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:20:07.290 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:20:07.308 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:20:07.518 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:20:07.535 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:20:07.568 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:20:07.594 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:20:07.622 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:20:07.788 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:20:07.804 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:20:07.846 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:20:07.888 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:20:07.905 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:20:08.225 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:20:08.242 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:20:08.282 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:20:08.284 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:20:08.298 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:20:08.340 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:20:08.544 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:20:08.561 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:20:08.601 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:20:08.603 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:20:08.659 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:20:08.855 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:20:08.872 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:20:08.914 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:20:09.046 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:20:09.063 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:20:09.096 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:20:09.107 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:20:09.121 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:20:09.157 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:20:09.332 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:20:09.348 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:20:09.377 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:20:09.390 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:20:09.393 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:20:09.435 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:20:09.651 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:20:09.679 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:20:09.696 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:20:09.713 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:20:09.718 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:20:09.754 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:20:09.970 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:20:09.987 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:20:09.998 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:20:10.027 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:20:10.029 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:20:10.065 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:20:10.272 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:20:10.289 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:20:10.322 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:20:10.429 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:20:10.445 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:20:10.487 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:20:10.765 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:20:10.793 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:20:10.831 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:20:11.110 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:20:11.127 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:20:11.151 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:20:11.167 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:20:11.169 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:20:11.217 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:20:11.421 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:20:11.438 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:20:11.480 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:20:11.596 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:20:11.613 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:20:11.655 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:20:11.784 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:20:11.813 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:20:11.851 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:20:11.882 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:20:11.899 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:20:11.940 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:20:12.153 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:20:12.182 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:20:12.228 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:20:12.385 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package maven. 2024-09-12T00:20:12.414 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:20:12.451 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:20:12.531 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:20:12.547 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:20:12.597 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:20:12.763 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:20:12.791 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:20:12.829 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:20:12.866 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:20:12.895 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:20:12.933 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:20:13.082 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:20:13.111 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:20:13.140 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:20:13.169 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:20:13.188 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:20:13.236 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:20:13.497 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:20:13.580 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:20:13.606 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:20:13.609 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:20:13.655 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:20:13.707 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:20:13.807 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:20:13.933 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:20:13.957 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:20:13.986 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:20:14.032 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:20:14.059 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:20:14.194 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:20:14.311 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:20:14.337 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:20:14.340 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:20:14.378 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:20:14.462 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:20:14.588 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:20:14.689 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:20:14.689 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:20:14.717 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:20:14.780 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:20:14.790 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:20:14.891 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:20:15.017 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:20:15.066 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:20:15.091 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:20:15.133 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:20:15.143 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:20:15.320 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:20:15.529 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:20:15.545 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:20:15.587 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:20:15.588 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:20:15.714 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:20:15.840 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:20:15.840 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:20:15.868 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:20:15.906 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:20:15.966 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:20:16.117 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:20:16.243 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:20:16.369 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:20:16.402 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package maven. 2024-09-12T00:20:16.430 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:20:16.460 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:20:16.763 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:20:16.787 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:20:16.791 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:20:16.829 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:20:16.913 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:20:17.039 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:20:17.132 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:20:17.160 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:20:17.165 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:20:17.199 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:20:17.292 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:20:17.417 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:20:17.568 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:20:17.578 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:20:17.694 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:20:17.704 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:20:17.803 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:20:17.822 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:20:17.904 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:20:17.940 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:20:18.013 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:20:18.041 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:20:18.139 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:20:18.166 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:20:18.293 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:20:18.396 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:20:18.419 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:20:18.460 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:20:18.545 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:20:18.670 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:20:18.796 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:20:18.931 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:20:19.048 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:20:19.149 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:20:19.275 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:20:19.402 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:20:19.661 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:20:19.770 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:20:19.823 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:20:19.831 DEBUG:teuthology.parallel:result is None 2024-09-12T00:20:19.897 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:20:20.022 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:20:20.148 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:20:20.274 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:20:20.400 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:20:20.735 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:20:20.861 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:20:20.987 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:20:21.113 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:20:21.282 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:20:21.383 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:20:21.517 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:20:21.643 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:20:21.803 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:20:21.929 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:20:22.046 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:20:22.147 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:20:22.404 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:20:22.468 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:20:23.835 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:20:23.839 DEBUG:teuthology.parallel:result is None 2024-09-12T00:20:23.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:20:23.996 DEBUG:teuthology.orchestra.run.smithi137:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:20:24.016 INFO:teuthology.orchestra.run.smithi137.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:20:24.017 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:20:24.017 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:20:24.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:20:24.166 DEBUG:teuthology.orchestra.run.smithi150:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:20:24.185 INFO:teuthology.orchestra.run.smithi150.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:20:24.186 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:20:24.186 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:20:24.187 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:20:24.188 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:24.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:20:24.202 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:24.202 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:20:24.243 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:20:24.243 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:24.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:20:24.257 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:20:24.313 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:24.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:20:24.326 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:20:24.381 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:20:24.382 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:24.382 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:20:24.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:20:24.449 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:24.449 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:20:24.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:20:24.518 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:20:24.518 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:24.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:20:24.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:20:24.587 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:24.587 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:20:24.600 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:20:24.654 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:20:24.739 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:20:24.739 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-09-12T00:20:24.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-09-12T00:20:24.755 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:20:24.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:20:24.795 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:20:24.809 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:20:24.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:20:24.847 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:20:24.895 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:20:24.895 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:20:24.895 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7901846', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHOOdqaAGpaq26i2/iW8WtCTPzuQU8Hmt6CJOmDz1gNYirHvktN2xFpnM3cFJhiQL0gcEMBKkaF62YCM7PUB8tg=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDrbKIhNSV+DkXiLv3I2Xroogp+ei98K/cjGbsBuCw8MOv7LyaKS5iVQdSxDR3zz80eKzgXBhwMk281RWWUR1eo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:20:24.896 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:20:24.907 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:20:24.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:20:24.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:20:24.969 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:24.969 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:20:25.014 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:20:25.015 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-09-12T00:20:25.062 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:20:25.063 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:20:25.063 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-12T00:20:25.063 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:20:25.063 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-12 00:14:36.098029449 +0000 2024-09-12T00:20:25.063 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-12 00:14:35.826031879 +0000 2024-09-12T00:20:25.063 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-12 00:14:35.826031879 +0000 2024-09-12T00:20:25.063 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-12T00:20:25.063 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:20:25.117 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-12T00:20:25.117 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-12T00:20:25.117 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000423027 s, 1.2 MB/s 2024-09-12T00:20:25.118 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:20:25.169 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-09-12T00:20:25.218 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:20:25.218 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:20:25.218 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-09-12T00:20:25.219 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:20:25.219 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-12 00:14:36.610024876 +0000 2024-09-12T00:20:25.219 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-12 00:14:36.334027341 +0000 2024-09-12T00:20:25.219 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-12 00:14:36.334027341 +0000 2024-09-12T00:20:25.219 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-12T00:20:25.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:20:25.272 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-12T00:20:25.273 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-12T00:20:25.273 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000357964 s, 1.4 MB/s 2024-09-12T00:20:25.274 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:20:25.325 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-09-12T00:20:25.371 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:20:25.371 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:20:25.371 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-12T00:20:25.371 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:20:25.371 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-12 00:14:37.062020839 +0000 2024-09-12T00:20:25.371 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-12 00:14:36.830022911 +0000 2024-09-12T00:20:25.371 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-12 00:14:36.830022911 +0000 2024-09-12T00:20:25.371 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-12T00:20:25.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:20:25.424 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-12T00:20:25.424 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-12T00:20:25.424 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000329432 s, 1.6 MB/s 2024-09-12T00:20:25.426 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:20:25.475 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-09-12T00:20:25.523 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:20:25.523 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:20:25.523 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-12T00:20:25.523 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:20:25.523 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-12 00:14:37.542016551 +0000 2024-09-12T00:20:25.523 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-12 00:14:37.290018803 +0000 2024-09-12T00:20:25.523 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-12 00:14:37.290018803 +0000 2024-09-12T00:20:25.523 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-12T00:20:25.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:20:25.576 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-12T00:20:25.576 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-12T00:20:25.576 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000297876 s, 1.7 MB/s 2024-09-12T00:20:25.577 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:20:25.628 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:25.628 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:25.628 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:20:25.634 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:20:25.634 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-09-12T00:20:25.683 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:20:25.683 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:20:25.683 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-09-12T00:20:25.683 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:20:25.683 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-12 00:14:37.681055304 +0000 2024-09-12T00:20:25.683 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-12 00:14:37.433057519 +0000 2024-09-12T00:20:25.683 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-12 00:14:37.433057519 +0000 2024-09-12T00:20:25.683 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-12T00:20:25.684 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:20:25.737 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-12T00:20:25.737 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-12T00:20:25.738 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000403076 s, 1.3 MB/s 2024-09-12T00:20:25.739 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:20:25.791 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-09-12T00:20:25.839 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:20:25.839 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:20:25.839 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-12T00:20:25.839 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:20:25.839 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-12 00:14:38.157051052 +0000 2024-09-12T00:20:25.839 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-12 00:14:37.893053410 +0000 2024-09-12T00:20:25.839 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-12 00:14:37.893053410 +0000 2024-09-12T00:20:25.839 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-12T00:20:25.839 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:20:25.893 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-12T00:20:25.893 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-12T00:20:25.893 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000352923 s, 1.5 MB/s 2024-09-12T00:20:25.894 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:20:25.943 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-09-12T00:20:25.990 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:20:25.990 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:20:25.991 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-09-12T00:20:25.991 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:20:25.991 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-12 00:14:38.625046872 +0000 2024-09-12T00:20:25.991 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-12 00:14:38.385049016 +0000 2024-09-12T00:20:25.991 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-12 00:14:38.385049016 +0000 2024-09-12T00:20:25.991 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-12T00:20:25.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:20:26.045 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-12T00:20:26.045 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-12T00:20:26.045 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000339809 s, 1.5 MB/s 2024-09-12T00:20:26.046 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:20:26.099 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-09-12T00:20:26.146 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:20:26.146 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:20:26.147 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-12T00:20:26.147 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:20:26.147 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-12 00:14:39.089042728 +0000 2024-09-12T00:20:26.147 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-12 00:14:38.857044800 +0000 2024-09-12T00:20:26.147 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-12 00:14:38.857044800 +0000 2024-09-12T00:20:26.147 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-12T00:20:26.147 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:20:26.200 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-12T00:20:26.200 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-12T00:20:26.200 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000339931 s, 1.5 MB/s 2024-09-12T00:20:26.201 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:20:26.255 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:26.255 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:20:26.256 INFO:tasks.ceph:Generating config... 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:20:26.257 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:20:26.258 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:20:26.258 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:20:26.258 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:20:26.258 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:20:26.258 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:20:26.258 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:20:26.258 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:20:26.258 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:20:26.258 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T00:20:26.258 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:20:26.258 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:20:26.258 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:20:26.258 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:20:26.259 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:20:26.259 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:20:26.259 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T00:20:26.260 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:20:26.260 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:20:26.260 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:20:26.260 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:20:26.260 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:20:26.260 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:20:26.260 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:20:26.260 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:20:26.295 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:20:26.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:20:26.397 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:20:26.449 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.137'), ('mon.c', '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]'), ('mon.b', '172.21.15.150')] 2024-09-12T00:20:26.450 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790],172.21.15.150', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:20:26.451 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:26.451 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:20:26.499 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.137 --addv c '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]' --add b 172.21.15.150 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:26.585 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:26.586 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:26.586 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:26.586 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: generated fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:20:26.586 INFO:teuthology.orchestra.run.smithi137.stdout:setting min_mon_release = quincy 2024-09-12T00:20:26.586 INFO:teuthology.orchestra.run.smithi137.stdout:epoch 0 2024-09-12T00:20:26.586 INFO:teuthology.orchestra.run.smithi137.stdout:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:20:26.586 INFO:teuthology.orchestra.run.smithi137.stdout:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:20:26.586 INFO:teuthology.orchestra.run.smithi137.stdout:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:20:26.587 INFO:teuthology.orchestra.run.smithi137.stdout:min_mon_release 17 (quincy) 2024-09-12T00:20:26.587 INFO:teuthology.orchestra.run.smithi137.stdout:election_strategy: 1 2024-09-12T00:20:26.587 INFO:teuthology.orchestra.run.smithi137.stdout:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:20:26.587 INFO:teuthology.orchestra.run.smithi137.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:20:26.587 INFO:teuthology.orchestra.run.smithi137.stdout:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:20:26.587 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:20:26.588 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:20:26.634 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4e4db2d6-4863-4874-a7a6-6f11f6db62a8... 2024-09-12T00:20:26.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:20:26.680 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:20:26.708 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-09-12T00:20:26.709 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-09-12T00:20:26.709 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:20:26.709 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-09-12T00:20:26.709 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.709 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-09-12T00:20:26.709 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.709 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-09-12T00:20:26.712 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.712 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-09-12T00:20:26.712 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-09-12T00:20:26.712 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.712 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-09-12T00:20:26.712 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-09-12T00:20:26.712 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.712 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-09-12T00:20:26.713 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-09-12T00:20:26.714 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790],172.21.15.150" 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: mon client directed command retry = 5 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject socket failures = 5000 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: rgw override bucket index max shards = 1 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:20:26.715 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-09-12T00:20:26.716 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.717 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: debug objclass = 20 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: lockdep = True 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:20:26.718 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: osd shutdown pgref assert = True 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.719 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:20:26.720 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: lockdep = True 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-09-12T00:20:26.721 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: debug rgw = 20 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: debug rgw notification = 20 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw bucket counters cache = True 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw crypt require ssl = False 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw s3 auth use sts = True 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw torrent flag = True 2024-09-12T00:20:26.722 INFO:teuthology.orchestra.run.smithi137.stdout: rgw user counters cache = True 2024-09-12T00:20:26.723 INFO:teuthology.orchestra.run.smithi137.stdout: setgroup = ceph 2024-09-12T00:20:26.723 INFO:teuthology.orchestra.run.smithi137.stdout: setuser = ceph 2024-09-12T00:20:26.723 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-09-12T00:20:26.723 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-09-12T00:20:26.723 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-09-12T00:20:26.724 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-09-12T00:20:26.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:20:26.726 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-09-12T00:20:26.727 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790],172.21.15.150" 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: mon client directed command retry = 5 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject socket failures = 5000 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: rgw override bucket index max shards = 1 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.728 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug trim objects = true 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-09-12T00:20:26.729 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: bdev async discard = True 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: bdev enable discard = True 2024-09-12T00:20:26.730 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore allocator = bitmap 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 1/20 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 1/20 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: debug objclass = 20 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 4/10 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: lockdep = True 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2024-09-12T00:20:26.731 INFO:teuthology.orchestra.run.smithi150.stdout: osd shutdown pgref assert = True 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-12T00:20:26.732 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:20:26.733 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: lockdep = True 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:20:26.734 INFO:teuthology.orchestra.run.smithi150.stdout: debug rgw = 20 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: debug rgw notification = 20 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw bucket counters cache = True 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw crypt require ssl = False 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw s3 auth use sts = True 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw torrent flag = True 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: rgw user counters cache = True 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: setgroup = ceph 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout: setuser = ceph 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2024-09-12T00:20:26.735 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2024-09-12T00:20:26.736 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:20:26.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:20:26.815 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:20:26.815 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:26.815 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:20:26.820 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:26.820 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:20:26.866 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T00:20:26.866 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:26.866 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:20:26.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:20:26.933 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:26.933 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:26.983 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T00:20:26.983 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:26.983 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:20:26.983 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:20:27.005 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:27.006 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:27.059 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:20:27.059 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:20:27.059 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:20:27.103 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:20:27.106 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:20:27.151 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:20:27.170 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:20:27.170 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:20:27.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:20:27.206 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:20:27.217 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:20:27.253 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:20:27.265 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:20:27.265 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:20:27.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:20:27.278 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:27.278 INFO:tasks.ceph:role: osd.0 2024-09-12T00:20:27.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T00:20:27.278 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:20:27.342 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:20:27.342 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:20:27.342 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:20:27.342 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:20:27.342 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:20:27.343 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:20:27.343 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:20:27.343 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:20:27.343 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:20:27.343 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:20:27.802 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-12T00:20:27.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-12T00:20:27.804 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:20:27.915 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:20:27.926 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:20:27.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:27.927 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:20:27.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:27.982 INFO:tasks.ceph:role: osd.1 2024-09-12T00:20:27.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T00:20:27.982 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:20:28.047 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:20:28.511 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-12T00:20:28.513 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-12T00:20:28.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:20:28.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:20:28.687 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:20:28.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:28.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:20:28.742 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:28.743 INFO:tasks.ceph:role: osd.2 2024-09-12T00:20:28.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T00:20:28.743 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:20:28.807 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:20:28.807 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:20:28.807 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:20:28.807 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:20:28.807 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:20:28.808 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:20:28.808 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:20:28.808 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:20:28.808 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:20:28.808 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:20:29.275 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-12T00:20:29.278 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-12T00:20:29.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:20:29.422 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:20:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:20:29.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:29.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:20:29.490 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:29.491 INFO:tasks.ceph:role: osd.3 2024-09-12T00:20:29.491 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T00:20:29.491 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:20:29.553 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:20:29.553 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:20:29.553 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:20:29.553 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:20:29.553 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:20:29.554 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:20:29.554 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:20:29.554 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:20:29.554 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:20:29.554 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:20:29.976 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-12T00:20:29.978 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-12T00:20:29.978 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:20:30.071 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:20:30.081 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:20:30.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:30.082 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:30.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:30.196+0000 7f6053e857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:20:30.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:30.196+0000 7f6053e857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:20:30.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:30.196+0000 7f6053e857c0 -1 bdev(0x55c4d5c49800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:20:30.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:30.200+0000 7f6053e857c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:20:33.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:20:33.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:33.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:33.420+0000 7fdcdc3ed7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:20:33.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:33.420+0000 7fdcdc3ed7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:20:33.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:33.420+0000 7fdcdc3ed7c0 -1 bdev(0x560ea2c5f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:20:33.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:33.420+0000 7fdcdc3ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:20:36.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:20:36.611 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:36.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:36.696+0000 7f35382f97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:20:36.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:36.700+0000 7f35382f97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:20:36.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:36.700+0000 7f35382f97c0 -1 bdev(0x5602cb7e7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:20:36.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:36.700+0000 7f35382f97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:20:39.828 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:20:39.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:39.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:39.964+0000 7fd1e362f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:20:39.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:39.964+0000 7fd1e362f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:20:39.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:39.968+0000 7fd1e362f7c0 -1 bdev(0x5585a7017800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:20:39.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:20:39.968+0000 7fd1e362f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:20:43.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:20:43.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:20:43.169 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:43.169 INFO:tasks.ceph:role: osd.4 2024-09-12T00:20:43.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T00:20:43.169 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:20:43.239 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:20:43.239 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:20:43.239 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:20:43.239 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:20:43.239 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:20:43.240 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:20:43.240 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:20:43.240 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:20:43.240 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:20:43.240 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:20:43.694 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-12T00:20:43.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-12T00:20:43.697 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:20:43.793 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:20:43.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:43.804 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:20:43.804 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:20:43.856 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:43.857 INFO:tasks.ceph:role: osd.5 2024-09-12T00:20:43.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T00:20:43.857 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:20:43.920 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:20:43.920 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:20:43.920 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:20:43.921 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:20:43.921 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:20:43.921 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:20:43.921 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:20:43.921 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:20:43.921 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:20:43.921 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:20:44.393 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-12T00:20:44.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-12T00:20:44.395 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:20:44.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:20:44.578 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:20:44.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:44.579 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:20:44.633 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:44.634 INFO:tasks.ceph:role: osd.6 2024-09-12T00:20:44.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T00:20:44.634 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:20:44.698 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:20:45.165 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-12T00:20:45.167 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-12T00:20:45.167 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:20:45.308 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:20:45.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:45.320 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:20:45.320 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:20:45.376 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:20:45.376 INFO:tasks.ceph:role: osd.7 2024-09-12T00:20:45.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T00:20:45.377 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:20:45.442 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:20:45.871 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-12T00:20:45.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-12T00:20:45.874 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:20:45.977 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:20:45.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:45.987 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:20:45.987 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:46.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:46.102+0000 7fdd9a09f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:20:46.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:46.106+0000 7fdd9a09f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:20:46.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:46.106+0000 7fdd9a09f7c0 -1 bdev(0x55e598223800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:20:46.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:46.106+0000 7fdd9a09f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:20:49.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:20:49.282 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:49.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:49.362+0000 7f74084747c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:20:49.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:49.362+0000 7f74084747c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:20:49.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:49.362+0000 7f74084747c0 -1 bdev(0x55947e371800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:20:49.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:49.362+0000 7f74084747c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:20:52.532 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:20:52.586 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:52.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:52.674+0000 7fe5c4f357c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:20:52.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:52.674+0000 7fe5c4f357c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:20:52.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:52.674+0000 7fe5c4f357c0 -1 bdev(0x555c671ef800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:20:52.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:52.674+0000 7fe5c4f357c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:20:55.817 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:20:55.875 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:20:55.955 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:55.958+0000 7f18a438d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:20:55.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:55.958+0000 7f18a438d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:20:55.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:55.958+0000 7f18a438d7c0 -1 bdev(0x55729ba19800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:20:55.956 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T00:20:55.958+0000 7f18a438d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:20:59.089 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:20:59.142 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:20:59.142 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:59.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:20:59.157 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:59.157 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:20:59.213 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:59.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:20:59.269 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:59.269 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:20:59.326 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:59.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:20:59.382 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:59.382 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:20:59.396 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:59.396 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:20:59.449 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:59.449 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:20:59.506 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:59.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:20:59.560 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:59.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:20:59.614 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:20:59.614 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:20:59.619 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:20:59.620 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:20:59.662 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:20:59.663 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:20:59.665 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:20:59.708 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-09-12T00:20:59.708 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDLM+JmJNh2BhAAj07G/IUUfkvV58LU1qfztg== 2024-09-12T00:20:59.708 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-09-12T00:20:59.708 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDOM+JmPsLsCxAAPG5sZPVJRH0HR1NvmI53vg== 2024-09-12T00:20:59.708 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-09-12T00:20:59.708 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDRM+JmAvxGGRAAyRHsUmDs7X7xlGd6MQYvrA== 2024-09-12T00:20:59.708 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDUM+Jmt1zZKRAAFy5Qj4XukrYP+O3TnMf8hA== 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDXM+JmV7vPORAAlGdum8MxD7ij8MkhlejBwQ== 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDLM+JmHIhNCRAAd2cQ3sEoH0P8F6jAqnmxAw== 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDeM+JmF2mKBhAAugJf4XcuXkJqcib7kITouA== 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDhM+JmBhP/FRAA0hEbd/VSTU2RKsOH132cCg== 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDkM+JmTlpjKBAANWQAcsSyXULujXj6HrUJsg== 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-09-12T00:20:59.710 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDnM+Jmu1ZIORAAwQufD14H6pq+1+5V02zjIQ== 2024-09-12T00:20:59.710 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-09-12T00:20:59.710 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDLM+JmJcWZDBAAddcGjR/r4JbKnnsKPjqLVQ== 2024-09-12T00:20:59.710 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-09-12T00:20:59.710 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDLM+JmkvZvDxAAXSWQSYnkNi2T2kPqUNDNwA== 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDLM+JmJNh2BhAAj07G/IUUfkvV58LU1qfztg== 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDOM+JmPsLsCxAAPG5sZPVJRH0HR1NvmI53vg== 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDRM+JmAvxGGRAAyRHsUmDs7X7xlGd6MQYvrA== 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDUM+Jmt1zZKRAAFy5Qj4XukrYP+O3TnMf8hA== 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDXM+JmV7vPORAAlGdum8MxD7ij8MkhlejBwQ== 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDLM+JmHIhNCRAAd2cQ3sEoH0P8F6jAqnmxAw== 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDeM+JmF2mKBhAAugJf4XcuXkJqcib7kITouA== 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDhM+JmBhP/FRAA0hEbd/VSTU2RKsOH132cCg== 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDkM+JmTlpjKBAANWQAcsSyXULujXj6HrUJsg== 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDnM+Jmu1ZIORAAwQufD14H6pq+1+5V02zjIQ== 2024-09-12T00:20:59.717 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-12T00:20:59.718 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDLM+JmJcWZDBAAddcGjR/r4JbKnnsKPjqLVQ== 2024-09-12T00:20:59.718 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2024-09-12T00:20:59.718 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDLM+JmkvZvDxAAXSWQSYnkNi2T2kPqUNDNwA== 2024-09-12T00:20:59.719 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:20:59.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:20:59.806 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:20:59.843 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:20:59.884 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:20:59.927 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:20:59.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.015 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.094 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.143 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:21:00.175 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:21:00.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.312 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.397 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.427 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.482 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.509 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:21:00.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:21:00.591 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:21:00.662 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:21:00.664 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:21:00.707 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:21:00.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:21:00.718 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:21:00.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:21:00.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:21:00.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:21:01.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:21:01.014 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:21:01.027 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:21:01.123 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:21:01.135 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:21:01.138 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:21:01.182 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:21:01.182 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:21:01.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:21:01.185 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:21:01.185 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:21:01.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:21:01.187 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:21:01.187 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:21:01.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:21:01.227 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:21:01.227 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:21:01.227 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:21:01.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:21:01.230 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:21:01.230 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:21:01.230 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:21:01.233 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:21:01.233 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:21:01.233 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:21:01.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:21:06.681 INFO:teuthology.orchestra.run.smithi137.stderr:adjusted tunables profile to default 2024-09-12T00:21:06.700 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:21:06.700 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:21:06.701 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:21:06.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:21:06.711 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:21:06.712 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:21:06.767 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:21:06.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:21:06.821 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:21:06.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:21:06.877 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:21:06.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:21:06.890 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:21:06.890 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:21:06.944 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:21:06.944 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:21:06.996 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T00:21:06.997 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:21:07.053 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new ff6f8b2b-beff-4b5d-bcb3-4e4528352ac8 0 2024-09-12T00:21:07.320 INFO:teuthology.orchestra.run.smithi150.stdout:0 2024-09-12T00:21:07.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 1ae64a6c-1299-4d36-81b0-34fe50bcf159 1 2024-09-12T00:21:07.540 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T00:21:07.556 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new dd2171e0-3214-4952-921e-e023b694b0ec 2 2024-09-12T00:21:07.763 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-12T00:21:07.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 8d0ffcdf-c3c5-4498-b7b1-a72e6f1f95c8 3 2024-09-12T00:21:07.989 INFO:teuthology.orchestra.run.smithi150.stdout:3 2024-09-12T00:21:08.006 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 31a3f465-82dc-43c4-a892-8ec5c08caff3 4 2024-09-12T00:21:08.217 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-12T00:21:08.233 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new e0acf37e-89cc-45d2-a440-e370c76f6ba7 5 2024-09-12T00:21:08.434 INFO:teuthology.orchestra.run.smithi150.stdout:5 2024-09-12T00:21:08.451 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 550dac1d-c031-4a10-92e2-93fbb3f7ec8b 6 2024-09-12T00:21:08.663 INFO:teuthology.orchestra.run.smithi150.stdout:6 2024-09-12T00:21:08.679 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 231842bc-28cf-4aec-9025-00c0b9179c9e 7 2024-09-12T00:21:08.867 INFO:teuthology.orchestra.run.smithi150.stdout:7 2024-09-12T00:21:08.884 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:21:08.884 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:21:08.887 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:21:08.887 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:21:08.887 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:21:08.890 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:21:08.890 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:21:08.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:21:08.892 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:21:08.893 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:21:08.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:21:08.895 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:21:08.895 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:21:08.895 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:21:08.897 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:21:08.897 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:21:08.897 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:21:08.899 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:21:08.900 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:21:08.900 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:21:08.902 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:21:08.902 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:21:08.902 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:21:08.904 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:21:08.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:21:09.103 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:09.104 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":10,"fsid":"4e4db2d6-4863-4874-a7a6-6f11f6db62a8","created":"2024-09-12T00:21:06.555575+0000","modified":"2024-09-12T00:21:08.868628+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:21:08.868628+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ff6f8b2b-beff-4b5d-bcb3-4e4528352ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1ae64a6c-1299-4d36-81b0-34fe50bcf159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd2171e0-3214-4952-921e-e023b694b0ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8d0ffcdf-c3c5-4498-b7b1-a72e6f1f95c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"31a3f465-82dc-43c4-a892-8ec5c08caff3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e0acf37e-89cc-45d2-a440-e370c76f6ba7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"550dac1d-c031-4a10-92e2-93fbb3f7ec8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"231842bc-28cf-4aec-9025-00c0b9179c9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:21:09.130 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:21:09.130 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:21:09.399 INFO:tasks.ceph.mgr.x.smithi150.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:21:09.400 INFO:tasks.ceph.mgr.x.smithi150.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:21:09.400 INFO:tasks.ceph.mgr.x.smithi150.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:21:09.423 INFO:tasks.ceph.mgr.y.smithi137.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:21:09.423 INFO:tasks.ceph.mgr.y.smithi137.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:21:09.423 INFO:tasks.ceph.mgr.y.smithi137.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:21:09.936 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:21:10.122 INFO:teuthology.misc.health.smithi137.stdout: 2024-09-12T00:21:10.122 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":10,"fsid":"4e4db2d6-4863-4874-a7a6-6f11f6db62a8","created":"2024-09-12T00:21:06.555575+0000","modified":"2024-09-12T00:21:08.868628+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:21:08.868628+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ff6f8b2b-beff-4b5d-bcb3-4e4528352ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1ae64a6c-1299-4d36-81b0-34fe50bcf159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd2171e0-3214-4952-921e-e023b694b0ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8d0ffcdf-c3c5-4498-b7b1-a72e6f1f95c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"31a3f465-82dc-43c4-a892-8ec5c08caff3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e0acf37e-89cc-45d2-a440-e370c76f6ba7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"550dac1d-c031-4a10-92e2-93fbb3f7ec8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"231842bc-28cf-4aec-9025-00c0b9179c9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:21:10.137 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:21:10.298 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-12T00:21:10.300+0000 7ff814ead7c0 -1 Falling back to public interface 2024-09-12T00:21:10.327 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-12T00:21:10.330+0000 7f2d46d5f7c0 -1 Falling back to public interface 2024-09-12T00:21:10.338 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-09-12T00:21:10.340+0000 7ff8dee657c0 -1 Falling back to public interface 2024-09-12T00:21:10.358 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-12T00:21:10.362+0000 7fcfade177c0 -1 Falling back to public interface 2024-09-12T00:21:10.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-12T00:21:10.368+0000 7fd6ce59d7c0 -1 Falling back to public interface 2024-09-12T00:21:10.467 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-12T00:21:10.470+0000 7f66027f67c0 -1 Falling back to public interface 2024-09-12T00:21:10.611 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-09-12T00:21:10.612+0000 7f6d727ed7c0 -1 Falling back to public interface 2024-09-12T00:21:10.782 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-12T00:21:10.786+0000 7f543b1617c0 -1 Falling back to public interface 2024-09-12T00:21:12.384 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-09-12T00:21:12.384+0000 7f5cfc050640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:21:12.384 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-09-12T00:21:12.384+0000 7f5cfc050640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:21:14.294 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-12T00:21:14.298+0000 7f2d46d5f7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T00:21:14.407 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-12T00:21:14.410+0000 7fcfade177c0 -1 osd.6 0 log_to_monitors true 2024-09-12T00:21:14.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-12T00:21:14.644+0000 7ff814ead7c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:21:14.734 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-12T00:21:14.738+0000 7f66027f67c0 -1 osd.4 0 log_to_monitors true 2024-09-12T00:21:14.748 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-09-12T00:21:14.748+0000 7f6d727ed7c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:21:14.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-12T00:21:14.848+0000 7fd6ce59d7c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:21:14.977 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-09-12T00:21:14.980+0000 7ff8dee657c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:21:15.043 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-12T00:21:15.046+0000 7f543b1617c0 -1 osd.5 0 log_to_monitors true 2024-09-12T00:21:16.391 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-12T00:21:16.394+0000 7f2d42d08640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:21:16.450 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-12T00:21:16.454+0000 7f2d3ab3a640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:21:16.945 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:21:17.305 INFO:teuthology.misc.health.smithi137.stdout: 2024-09-12T00:21:17.305 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":13,"fsid":"4e4db2d6-4863-4874-a7a6-6f11f6db62a8","created":"2024-09-12T00:21:06.555575+0000","modified":"2024-09-12T00:21:16.388317+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:21:08.868628+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ff6f8b2b-beff-4b5d-bcb3-4e4528352ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1ae64a6c-1299-4d36-81b0-34fe50bcf159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd2171e0-3214-4952-921e-e023b694b0ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8d0ffcdf-c3c5-4498-b7b1-a72e6f1f95c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"31a3f465-82dc-43c4-a892-8ec5c08caff3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e0acf37e-89cc-45d2-a440-e370c76f6ba7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"550dac1d-c031-4a10-92e2-93fbb3f7ec8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"231842bc-28cf-4aec-9025-00c0b9179c9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:21:17.324 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:21:18.122 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-12T00:21:18.126+0000 7f543710a640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:21:18.146 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-12T00:21:18.150+0000 7f542ef3c640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:21:18.150 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-12T00:21:18.154+0000 7f65fefb1640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:21:18.158 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-12T00:21:18.162+0000 7fcfaa5d2640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:21:18.190 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-12T00:21:18.194+0000 7f65f65d1640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:21:18.210 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-12T00:21:18.214+0000 7fcfa1bf2640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:21:18.529 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-09-12T00:21:18.528+0000 7ff8dae0e640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:21:18.537 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-09-12T00:21:18.540+0000 7f6d6efa8640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:21:18.554 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-09-12T00:21:18.556+0000 7ff8d2c40640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:21:18.566 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-09-12T00:21:18.568+0000 7f6d665c8640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:21:18.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-12T00:21:18.572+0000 7ff811668640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:21:18.581 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-12T00:21:18.584+0000 7fd6ca546640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:21:18.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-12T00:21:18.608+0000 7ff808c88640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:21:18.606 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-12T00:21:18.608+0000 7fd6c2378640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:21:24.132 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:21:24.444 INFO:teuthology.misc.health.smithi137.stdout: 2024-09-12T00:21:24.445 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":18,"fsid":"4e4db2d6-4863-4874-a7a6-6f11f6db62a8","created":"2024-09-12T00:21:06.555575+0000","modified":"2024-09-12T00:21:22.184161+0000","last_up_change":"2024-09-12T00:21:19.170181+0000","last_in_change":"2024-09-12T00:21:08.868628+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:21:19.418763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff6f8b2b-beff-4b5d-bcb3-4e4528352ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6801","nonce":775942033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6803","nonce":775942033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6807","nonce":775942033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6805","nonce":775942033}]},"public_addr":"172.21.15.137:6801/775942033","cluster_addr":"172.21.15.137:6803/775942033","heartbeat_back_addr":"172.21.15.137:6807/775942033","heartbeat_front_addr":"172.21.15.137:6805/775942033","state":["exists","up"]},{"osd":1,"uuid":"1ae64a6c-1299-4d36-81b0-34fe50bcf159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6817","nonce":2821877990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6819","nonce":2821877990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6823","nonce":2821877990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6821","nonce":2821877990}]},"public_addr":"172.21.15.137:6817/2821877990","cluster_addr":"172.21.15.137:6819/2821877990","heartbeat_back_addr":"172.21.15.137:6823/2821877990","heartbeat_front_addr":"172.21.15.137:6821/2821877990","state":["exists","up"]},{"osd":2,"uuid":"dd2171e0-3214-4952-921e-e023b694b0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6809","nonce":3452645018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6811","nonce":3452645018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6815","nonce":3452645018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6813","nonce":3452645018}]},"public_addr":"172.21.15.137:6809/3452645018","cluster_addr":"172.21.15.137:6811/3452645018","heartbeat_back_addr":"172.21.15.137:6815/3452645018","heartbeat_front_addr":"172.21.15.137:6813/3452645018","state":["exists","up"]},{"osd":3,"uuid":"8d0ffcdf-c3c5-4498-b7b1-a72e6f1f95c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6825","nonce":2424472815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6827","nonce":2424472815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6831","nonce":2424472815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6829","nonce":2424472815}]},"public_addr":"172.21.15.137:6825/2424472815","cluster_addr":"172.21.15.137:6827/2424472815","heartbeat_back_addr":"172.21.15.137:6831/2424472815","heartbeat_front_addr":"172.21.15.137:6829/2424472815","state":["exists","up"]},{"osd":4,"uuid":"31a3f465-82dc-43c4-a892-8ec5c08caff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6817","nonce":3675960294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6819","nonce":3675960294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6823","nonce":3675960294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6821","nonce":3675960294}]},"public_addr":"172.21.15.150:6817/3675960294","cluster_addr":"172.21.15.150:6819/3675960294","heartbeat_back_addr":"172.21.15.150:6823/3675960294","heartbeat_front_addr":"172.21.15.150:6821/3675960294","state":["exists","up"]},{"osd":5,"uuid":"e0acf37e-89cc-45d2-a440-e370c76f6ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6825","nonce":868007963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6827","nonce":868007963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6831","nonce":868007963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6829","nonce":868007963}]},"public_addr":"172.21.15.150:6825/868007963","cluster_addr":"172.21.15.150:6827/868007963","heartbeat_back_addr":"172.21.15.150:6831/868007963","heartbeat_front_addr":"172.21.15.150:6829/868007963","state":["exists","up"]},{"osd":6,"uuid":"550dac1d-c031-4a10-92e2-93fbb3f7ec8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6809","nonce":2067574013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6811","nonce":2067574013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6815","nonce":2067574013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6813","nonce":2067574013}]},"public_addr":"172.21.15.150:6809/2067574013","cluster_addr":"172.21.15.150:6811/2067574013","heartbeat_back_addr":"172.21.15.150:6815/2067574013","heartbeat_front_addr":"172.21.15.150:6813/2067574013","state":["exists","up"]},{"osd":7,"uuid":"231842bc-28cf-4aec-9025-00c0b9179c9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6801","nonce":1704738992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6803","nonce":1704738992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6807","nonce":1704738992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6805","nonce":1704738992}]},"public_addr":"172.21.15.150:6801/1704738992","cluster_addr":"172.21.15.150:6803/1704738992","heartbeat_back_addr":"172.21.15.150:6807/1704738992","heartbeat_front_addr":"172.21.15.150:6805/1704738992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.635907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.831525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.937124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.793632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.760113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:16.006577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.423577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.282953+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:21:24.462 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:21:24.462 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:21:24.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:21:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'rbd' created 2024-09-12T00:21:25.229 DEBUG:teuthology.orchestra.run.smithi137:> rbd --cluster ceph pool init rbd 2024-09-12T00:21:25.271 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:25.271 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:28.298 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:21:28.299 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:21:28.299 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:21:28.661 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:28.679 INFO:teuthology.orchestra.run.smithi137.stdout:[{"version":9,"timestamp":"2024-09-12T00:21:18.587119+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"4949.130372"}]}] 2024-09-12T00:21:28.680 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:21:28.680 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:21:28.680 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:21:28.680 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:21:29.035 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:29.052 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1678349958},{"type":"v1","addr":"172.21.15.137:6833","nonce":1678349958}]},"active_addr":"172.21.15.137:6833/1678349958","active_change":"2024-09-12T00:21:11.361120+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1837066290}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1651229313}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3288192225}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3048300275}]}]} 2024-09-12T00:21:29.056 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:21:29.056 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:21:29.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:21:29.350 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:29.350 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"4e4db2d6-4863-4874-a7a6-6f11f6db62a8","created":"2024-09-12T00:21:06.555575+0000","modified":"2024-09-12T00:21:28.240772+0000","last_up_change":"2024-09-12T00:21:19.170181+0000","last_in_change":"2024-09-12T00:21:08.868628+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:21:19.418763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:21:24.767867+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff6f8b2b-beff-4b5d-bcb3-4e4528352ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6801","nonce":775942033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6803","nonce":775942033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6807","nonce":775942033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6805","nonce":775942033}]},"public_addr":"172.21.15.137:6801/775942033","cluster_addr":"172.21.15.137:6803/775942033","heartbeat_back_addr":"172.21.15.137:6807/775942033","heartbeat_front_addr":"172.21.15.137:6805/775942033","state":["exists","up"]},{"osd":1,"uuid":"1ae64a6c-1299-4d36-81b0-34fe50bcf159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6817","nonce":2821877990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6819","nonce":2821877990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6823","nonce":2821877990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6821","nonce":2821877990}]},"public_addr":"172.21.15.137:6817/2821877990","cluster_addr":"172.21.15.137:6819/2821877990","heartbeat_back_addr":"172.21.15.137:6823/2821877990","heartbeat_front_addr":"172.21.15.137:6821/2821877990","state":["exists","up"]},{"osd":2,"uuid":"dd2171e0-3214-4952-921e-e023b694b0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6809","nonce":3452645018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6811","nonce":3452645018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6815","nonce":3452645018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6813","nonce":3452645018}]},"public_addr":"172.21.15.137:6809/3452645018","cluster_addr":"172.21.15.137:6811/3452645018","heartbeat_back_addr":"172.21.15.137:6815/3452645018","heartbeat_front_addr":"172.21.15.137:6813/3452645018","state":["exists","up"]},{"osd":3,"uuid":"8d0ffcdf-c3c5-4498-b7b1-a72e6f1f95c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6825","nonce":2424472815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6827","nonce":2424472815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6831","nonce":2424472815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6829","nonce":2424472815}]},"public_addr":"172.21.15.137:6825/2424472815","cluster_addr":"172.21.15.137:6827/2424472815","heartbeat_back_addr":"172.21.15.137:6831/2424472815","heartbeat_front_addr":"172.21.15.137:6829/2424472815","state":["exists","up"]},{"osd":4,"uuid":"31a3f465-82dc-43c4-a892-8ec5c08caff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6817","nonce":3675960294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6819","nonce":3675960294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6823","nonce":3675960294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6821","nonce":3675960294}]},"public_addr":"172.21.15.150:6817/3675960294","cluster_addr":"172.21.15.150:6819/3675960294","heartbeat_back_addr":"172.21.15.150:6823/3675960294","heartbeat_front_addr":"172.21.15.150:6821/3675960294","state":["exists","up"]},{"osd":5,"uuid":"e0acf37e-89cc-45d2-a440-e370c76f6ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6825","nonce":868007963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6827","nonce":868007963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6831","nonce":868007963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6829","nonce":868007963}]},"public_addr":"172.21.15.150:6825/868007963","cluster_addr":"172.21.15.150:6827/868007963","heartbeat_back_addr":"172.21.15.150:6831/868007963","heartbeat_front_addr":"172.21.15.150:6829/868007963","state":["exists","up"]},{"osd":6,"uuid":"550dac1d-c031-4a10-92e2-93fbb3f7ec8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6809","nonce":2067574013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6811","nonce":2067574013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6815","nonce":2067574013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6813","nonce":2067574013}]},"public_addr":"172.21.15.150:6809/2067574013","cluster_addr":"172.21.15.150:6811/2067574013","heartbeat_back_addr":"172.21.15.150:6815/2067574013","heartbeat_front_addr":"172.21.15.150:6813/2067574013","state":["exists","up"]},{"osd":7,"uuid":"231842bc-28cf-4aec-9025-00c0b9179c9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6801","nonce":1704738992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6803","nonce":1704738992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6807","nonce":1704738992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6805","nonce":1704738992}]},"public_addr":"172.21.15.150:6801/1704738992","cluster_addr":"172.21.15.150:6803/1704738992","heartbeat_back_addr":"172.21.15.150:6807/1704738992","heartbeat_front_addr":"172.21.15.150:6805/1704738992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.635907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.831525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.937124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.793632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.760113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:16.006577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.423577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.282953+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:21:29.369 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:21:29.369 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:21:29.670 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:29.671 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"4e4db2d6-4863-4874-a7a6-6f11f6db62a8","created":"2024-09-12T00:21:06.555575+0000","modified":"2024-09-12T00:21:28.240772+0000","last_up_change":"2024-09-12T00:21:19.170181+0000","last_in_change":"2024-09-12T00:21:08.868628+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:21:19.418763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:21:24.767867+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff6f8b2b-beff-4b5d-bcb3-4e4528352ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6801","nonce":775942033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6803","nonce":775942033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6807","nonce":775942033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6805","nonce":775942033}]},"public_addr":"172.21.15.137:6801/775942033","cluster_addr":"172.21.15.137:6803/775942033","heartbeat_back_addr":"172.21.15.137:6807/775942033","heartbeat_front_addr":"172.21.15.137:6805/775942033","state":["exists","up"]},{"osd":1,"uuid":"1ae64a6c-1299-4d36-81b0-34fe50bcf159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6817","nonce":2821877990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6819","nonce":2821877990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6823","nonce":2821877990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6821","nonce":2821877990}]},"public_addr":"172.21.15.137:6817/2821877990","cluster_addr":"172.21.15.137:6819/2821877990","heartbeat_back_addr":"172.21.15.137:6823/2821877990","heartbeat_front_addr":"172.21.15.137:6821/2821877990","state":["exists","up"]},{"osd":2,"uuid":"dd2171e0-3214-4952-921e-e023b694b0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6809","nonce":3452645018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6811","nonce":3452645018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6815","nonce":3452645018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6813","nonce":3452645018}]},"public_addr":"172.21.15.137:6809/3452645018","cluster_addr":"172.21.15.137:6811/3452645018","heartbeat_back_addr":"172.21.15.137:6815/3452645018","heartbeat_front_addr":"172.21.15.137:6813/3452645018","state":["exists","up"]},{"osd":3,"uuid":"8d0ffcdf-c3c5-4498-b7b1-a72e6f1f95c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6825","nonce":2424472815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6827","nonce":2424472815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6831","nonce":2424472815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6829","nonce":2424472815}]},"public_addr":"172.21.15.137:6825/2424472815","cluster_addr":"172.21.15.137:6827/2424472815","heartbeat_back_addr":"172.21.15.137:6831/2424472815","heartbeat_front_addr":"172.21.15.137:6829/2424472815","state":["exists","up"]},{"osd":4,"uuid":"31a3f465-82dc-43c4-a892-8ec5c08caff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6817","nonce":3675960294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6819","nonce":3675960294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6823","nonce":3675960294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6821","nonce":3675960294}]},"public_addr":"172.21.15.150:6817/3675960294","cluster_addr":"172.21.15.150:6819/3675960294","heartbeat_back_addr":"172.21.15.150:6823/3675960294","heartbeat_front_addr":"172.21.15.150:6821/3675960294","state":["exists","up"]},{"osd":5,"uuid":"e0acf37e-89cc-45d2-a440-e370c76f6ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6825","nonce":868007963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6827","nonce":868007963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6831","nonce":868007963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6829","nonce":868007963}]},"public_addr":"172.21.15.150:6825/868007963","cluster_addr":"172.21.15.150:6827/868007963","heartbeat_back_addr":"172.21.15.150:6831/868007963","heartbeat_front_addr":"172.21.15.150:6829/868007963","state":["exists","up"]},{"osd":6,"uuid":"550dac1d-c031-4a10-92e2-93fbb3f7ec8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6809","nonce":2067574013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6811","nonce":2067574013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6815","nonce":2067574013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6813","nonce":2067574013}]},"public_addr":"172.21.15.150:6809/2067574013","cluster_addr":"172.21.15.150:6811/2067574013","heartbeat_back_addr":"172.21.15.150:6815/2067574013","heartbeat_front_addr":"172.21.15.150:6813/2067574013","state":["exists","up"]},{"osd":7,"uuid":"231842bc-28cf-4aec-9025-00c0b9179c9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6801","nonce":1704738992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6803","nonce":1704738992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6807","nonce":1704738992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6805","nonce":1704738992}]},"public_addr":"172.21.15.150:6801/1704738992","cluster_addr":"172.21.15.150:6803/1704738992","heartbeat_back_addr":"172.21.15.150:6807/1704738992","heartbeat_front_addr":"172.21.15.150:6805/1704738992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.635907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.831525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.937124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.793632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.760113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:16.006577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.423577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.282953+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:21:29.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:21:29.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:21:29.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:21:29.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:21:29.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:21:29.693 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:21:29.693 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:21:29.694 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:21:29.955 INFO:teuthology.orchestra.run.smithi137.stdout:60129542151 2024-09-12T00:21:29.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:21:29.958 INFO:teuthology.orchestra.run.smithi137.stdout:64424509447 2024-09-12T00:21:29.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:21:29.965 INFO:teuthology.orchestra.run.smithi137.stdout:64424509446 2024-09-12T00:21:29.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:21:29.966 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:29.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:21:29.971 INFO:teuthology.orchestra.run.smithi137.stdout:64424509446 2024-09-12T00:21:29.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:21:29.974 INFO:teuthology.orchestra.run.smithi137.stdout:64424509447 2024-09-12T00:21:29.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:21:29.975 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:29.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:21:29.978 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:29.979 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:21:30.479 INFO:teuthology.orchestra.run.smithi137.stdout:60129542150 2024-09-12T00:21:30.487 INFO:teuthology.orchestra.run.smithi137.stdout:64424509444 2024-09-12T00:21:30.493 INFO:teuthology.orchestra.run.smithi137.stdout:64424509443 2024-09-12T00:21:30.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-09-12T00:21:30.511 INFO:teuthology.orchestra.run.smithi137.stdout:64424509444 2024-09-12T00:21:30.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-12T00:21:30.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T00:21:30.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-12T00:21:30.532 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:30.533 INFO:teuthology.orchestra.run.smithi137.stdout:64424509443 2024-09-12T00:21:30.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.4 2024-09-12T00:21:30.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-12T00:21:30.575 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:30.583 INFO:teuthology.orchestra.run.smithi137.stdout:64424509443 2024-09-12T00:21:30.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.2 2024-09-12T00:21:30.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-12T00:21:31.511 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:21:31.512 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:21:31.526 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:21:31.533 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:21:31.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:21:31.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:21:31.595 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:21:31.602 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:21:32.029 INFO:teuthology.orchestra.run.smithi137.stdout:60129542150 2024-09-12T00:21:32.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-09-12T00:21:32.068 INFO:teuthology.orchestra.run.smithi137.stdout:64424509444 2024-09-12T00:21:32.089 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:32.090 INFO:teuthology.orchestra.run.smithi137.stdout:64424509444 2024-09-12T00:21:32.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-12T00:21:32.099 INFO:teuthology.orchestra.run.smithi137.stdout:64424509443 2024-09-12T00:21:32.109 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:32.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.4 2024-09-12T00:21:32.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-12T00:21:32.128 INFO:teuthology.orchestra.run.smithi137.stdout:64424509443 2024-09-12T00:21:32.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.2 2024-09-12T00:21:32.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-12T00:21:32.141 INFO:teuthology.orchestra.run.smithi137.stdout:64424509443 2024-09-12T00:21:32.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T00:21:32.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-12T00:21:33.054 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:21:33.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:21:33.113 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:21:33.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:21:33.131 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:21:33.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:21:33.147 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:21:33.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:21:33.577 INFO:teuthology.orchestra.run.smithi137.stdout:60129542151 2024-09-12T00:21:33.584 INFO:teuthology.orchestra.run.smithi137.stdout:64424509446 2024-09-12T00:21:33.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-12T00:21:33.606 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:33.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T00:21:33.611 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:33.633 INFO:teuthology.orchestra.run.smithi137.stdout:64424509446 2024-09-12T00:21:33.648 INFO:teuthology.orchestra.run.smithi137.stdout:64424509447 2024-09-12T00:21:33.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-12T00:21:33.653 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:33.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-12T00:21:33.666 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:33.698 INFO:teuthology.orchestra.run.smithi137.stdout:64424509447 2024-09-12T00:21:33.708 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:33.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-09-12T00:21:33.724 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:33.733 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:33.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-09-12T00:21:33.734 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:33.737 INFO:teuthology.orchestra.run.smithi137.stdout:64424509445 2024-09-12T00:21:33.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-12T00:21:33.753 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:33.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-12T00:21:33.756 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:33.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:21:33.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:21:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:34.076 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T00:21:34.092 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T00:21:33.376829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":2965504,"data_stored":1774678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.155685"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.255394+0000","last_change":"2024-09-12T00:21:28.255394+0000","last_active":"2024-09-12T00:21:28.255394+0000","last_peered":"2024-09-12T00:21:28.255394+0000","last_clean":"2024-09-12T00:21:28.255394+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T00:21:28.255394+0000","last_undegraded":"2024-09-12T00:21:28.255394+0000","last_fullsized":"2024-09-12T00:21:28.255394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:59.294638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.670456+0000","last_change":"2024-09-12T00:21:28.670456+0000","last_active":"2024-09-12T00:21:28.670456+0000","last_peered":"2024-09-12T00:21:28.670456+0000","last_clean":"2024-09-12T00:21:28.670456+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T00:21:28.670456+0000","last_undegraded":"2024-09-12T00:21:28.670456+0000","last_fullsized":"2024-09-12T00:21:28.670456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:30.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.256092+0000","last_change":"2024-09-12T00:21:28.256092+0000","last_active":"2024-09-12T00:21:28.256092+0000","last_peered":"2024-09-12T00:21:28.256092+0000","last_clean":"2024-09-12T00:21:28.256092+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T00:21:28.256092+0000","last_undegraded":"2024-09-12T00:21:28.256092+0000","last_fullsized":"2024-09-12T00:21:28.256092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:41.836946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.750763+0000","last_change":"2024-09-12T00:21:28.750763+0000","last_active":"2024-09-12T00:21:28.750763+0000","last_peered":"2024-09-12T00:21:28.750763+0000","last_clean":"2024-09-12T00:21:28.750763+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T00:21:28.750763+0000","last_undegraded":"2024-09-12T00:21:28.750763+0000","last_fullsized":"2024-09-12T00:21:28.750763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:40.130897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.260380+0000","last_change":"2024-09-12T00:21:28.255515+0000","last_active":"2024-09-12T00:21:28.260380+0000","last_peered":"2024-09-12T00:21:28.260380+0000","last_clean":"2024-09-12T00:21:28.260380+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T00:21:28.260380+0000","last_undegraded":"2024-09-12T00:21:28.260380+0000","last_fullsized":"2024-09-12T00:21:28.260380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:43.203836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.255269+0000","last_change":"2024-09-12T00:21:28.255269+0000","last_active":"2024-09-12T00:21:28.255269+0000","last_peered":"2024-09-12T00:21:28.255269+0000","last_clean":"2024-09-12T00:21:28.255269+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T00:21:28.255269+0000","last_undegraded":"2024-09-12T00:21:28.255269+0000","last_fullsized":"2024-09-12T00:21:28.255269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:37.489457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.254653+0000","last_change":"2024-09-12T00:21:28.254653+0000","last_active":"2024-09-12T00:21:28.254653+0000","last_peered":"2024-09-12T00:21:28.254653+0000","last_clean":"2024-09-12T00:21:28.254653+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T00:21:28.254653+0000","last_undegraded":"2024-09-12T00:21:28.254653+0000","last_fullsized":"2024-09-12T00:21:28.254653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:52.457807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.254766+0000","last_change":"2024-09-12T00:21:28.254766+0000","last_active":"2024-09-12T00:21:28.254766+0000","last_peered":"2024-09-12T00:21:28.254766+0000","last_clean":"2024-09-12T00:21:28.254766+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T00:21:28.254766+0000","last_undegraded":"2024-09-12T00:21:28.254766+0000","last_fullsized":"2024-09-12T00:21:28.254766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:37.352626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.252530+0000","last_change":"2024-09-12T00:21:22.027534+0000","last_active":"2024-09-12T00:21:28.252530+0000","last_peered":"2024-09-12T00:21:28.252530+0000","last_clean":"2024-09-12T00:21:28.252530+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T00:21:28.252530+0000","last_undegraded":"2024-09-12T00:21:28.252530+0000","last_fullsized":"2024-09-12T00:21:28.252530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_clean_scrub_stamp":"2024-09-12T00:21:20.173671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:18.049959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:21:34.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:21:34.378 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:34.378 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T00:21:34.395 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T00:21:33.376829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":2965504,"data_stored":1774678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.155685"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.255394+0000","last_change":"2024-09-12T00:21:28.255394+0000","last_active":"2024-09-12T00:21:28.255394+0000","last_peered":"2024-09-12T00:21:28.255394+0000","last_clean":"2024-09-12T00:21:28.255394+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T00:21:28.255394+0000","last_undegraded":"2024-09-12T00:21:28.255394+0000","last_fullsized":"2024-09-12T00:21:28.255394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:59.294638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.670456+0000","last_change":"2024-09-12T00:21:28.670456+0000","last_active":"2024-09-12T00:21:28.670456+0000","last_peered":"2024-09-12T00:21:28.670456+0000","last_clean":"2024-09-12T00:21:28.670456+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T00:21:28.670456+0000","last_undegraded":"2024-09-12T00:21:28.670456+0000","last_fullsized":"2024-09-12T00:21:28.670456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:30.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.256092+0000","last_change":"2024-09-12T00:21:28.256092+0000","last_active":"2024-09-12T00:21:28.256092+0000","last_peered":"2024-09-12T00:21:28.256092+0000","last_clean":"2024-09-12T00:21:28.256092+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T00:21:28.256092+0000","last_undegraded":"2024-09-12T00:21:28.256092+0000","last_fullsized":"2024-09-12T00:21:28.256092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:41.836946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.750763+0000","last_change":"2024-09-12T00:21:28.750763+0000","last_active":"2024-09-12T00:21:28.750763+0000","last_peered":"2024-09-12T00:21:28.750763+0000","last_clean":"2024-09-12T00:21:28.750763+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T00:21:28.750763+0000","last_undegraded":"2024-09-12T00:21:28.750763+0000","last_fullsized":"2024-09-12T00:21:28.750763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:40.130897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.260380+0000","last_change":"2024-09-12T00:21:28.255515+0000","last_active":"2024-09-12T00:21:28.260380+0000","last_peered":"2024-09-12T00:21:28.260380+0000","last_clean":"2024-09-12T00:21:28.260380+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T00:21:28.260380+0000","last_undegraded":"2024-09-12T00:21:28.260380+0000","last_fullsized":"2024-09-12T00:21:28.260380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:43.203836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.255269+0000","last_change":"2024-09-12T00:21:28.255269+0000","last_active":"2024-09-12T00:21:28.255269+0000","last_peered":"2024-09-12T00:21:28.255269+0000","last_clean":"2024-09-12T00:21:28.255269+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T00:21:28.255269+0000","last_undegraded":"2024-09-12T00:21:28.255269+0000","last_fullsized":"2024-09-12T00:21:28.255269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:37.489457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.254653+0000","last_change":"2024-09-12T00:21:28.254653+0000","last_active":"2024-09-12T00:21:28.254653+0000","last_peered":"2024-09-12T00:21:28.254653+0000","last_clean":"2024-09-12T00:21:28.254653+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T00:21:28.254653+0000","last_undegraded":"2024-09-12T00:21:28.254653+0000","last_fullsized":"2024-09-12T00:21:28.254653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:52.457807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.254766+0000","last_change":"2024-09-12T00:21:28.254766+0000","last_active":"2024-09-12T00:21:28.254766+0000","last_peered":"2024-09-12T00:21:28.254766+0000","last_clean":"2024-09-12T00:21:28.254766+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T00:21:28.254766+0000","last_undegraded":"2024-09-12T00:21:28.254766+0000","last_fullsized":"2024-09-12T00:21:28.254766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:37.352626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:21:28.252530+0000","last_change":"2024-09-12T00:21:22.027534+0000","last_active":"2024-09-12T00:21:28.252530+0000","last_peered":"2024-09-12T00:21:28.252530+0000","last_clean":"2024-09-12T00:21:28.252530+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T00:21:28.252530+0000","last_undegraded":"2024-09-12T00:21:28.252530+0000","last_fullsized":"2024-09-12T00:21:28.252530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_clean_scrub_stamp":"2024-09-12T00:21:20.173671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:18.049959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:21:34.396 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:21:34.396 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:21:34.397 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:21:34.397 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:21:34.713 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:34.713 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:21:34.731 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:21:34.732 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:21:34.749 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:21:34.750 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:21:34.755 DEBUG:teuthology.orchestra.run.smithi137:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:21:35.304 INFO:teuthology.orchestra.run.smithi137.stderr:.....+..+.+..............+.+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+......+.+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+......+....+...+............+......+.........+......+..+.......+...........+....+...............+...+...............+..+.+..+...............+....+.....+.+............+..+......+...............+.......+.....................+....................+....+..+.........+....+..+.+........+....+...+..+..........+..................+..+.+..+.......+...........................+.....+.+.....+.........+...................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:21:35.556 INFO:teuthology.orchestra.run.smithi137.stderr:.+.....+...+...+.......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.......+...........+...+................+...+..+......+....+...+...+..+.+....................+.......+........+.+.....+...............+....+............+........................+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:21:35.571 INFO:teuthology.orchestra.run.smithi137.stderr:----- 2024-09-12T00:21:35.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-12T00:21:35.647 DEBUG:teuthology.orchestra.run.smithi137:> sudo update-ca-certificates 2024-09-12T00:21:35.712 INFO:teuthology.orchestra.run.smithi137.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T00:21:36.374 INFO:teuthology.orchestra.run.smithi137.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-12T00:21:36.394 INFO:teuthology.orchestra.run.smithi137.stdout:1 added, 0 removed; done. 2024-09-12T00:21:36.398 INFO:teuthology.orchestra.run.smithi137.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T00:21:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:21:37.947 INFO:teuthology.orchestra.run.smithi137.stdout:Adding debian:root.pem 2024-09-12T00:21:37.974 INFO:teuthology.orchestra.run.smithi137.stdout:done. 2024-09-12T00:21:37.974 INFO:teuthology.orchestra.run.smithi137.stdout:done. 2024-09-12T00:21:37.978 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:21:38.025 DEBUG:teuthology.orchestra.run.smithi137:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi137.front.sepia.ceph.com 2024-09-12T00:21:38.259 INFO:teuthology.orchestra.run.smithi137.stderr:..+......+........+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...........+....+..+.........+......+..........+.........+..+....+.........+..+...+..........+............+..+............+.+.........+...+...+...+..+.........+...+...+.............+..............+...+.......+.....+.+............+..+...............+......+.+.....+.+...+............+...+..+....+.....+...+.+.....+....+...+..+..........+.....+............+.+.....+....+...........+...+.+.....+.........................+.....+...+......+.......+..+.+..+.......+...+.........+...........+...+......+.+.....+...+..........+.....+......+....+..............+...+....+...+...+...+......+.....+...+.+.................+...+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:21:38.272 INFO:teuthology.orchestra.run.smithi137.stderr:....+.+.....+...+.+...+...............+...+..+.+.........+..+...+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.+............+..+......+.+........+...+...+.+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.........+.........+...........+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:21:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:----- 2024-09-12T00:21:38.278 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:21:38.278 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:21:38.326 DEBUG:teuthology.orchestra.run.smithi137:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:21:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:Certificate request self-signature ok 2024-09-12T00:21:38.377 INFO:teuthology.orchestra.run.smithi137.stderr:subject=CN = smithi137.front.sepia.ceph.com 2024-09-12T00:21:38.389 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:21:38.438 DEBUG:teuthology.orchestra.run.smithi137:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:21:38.491 INFO:teuthology.orchestra.run.smithi137.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:21:38.491 DEBUG:teuthology.orchestra.run.smithi137:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:21:38.539 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:21:38.555 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-12T00:21:38.555 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:21:38.555 INFO:tasks.rgw:Creating data pools 2024-09-12T00:21:38.555 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:21:38.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T00:21:39.472 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:21:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:21:41.499 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:21:42.456 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:21:42.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:21:43.472 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:21:43.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:21:44.463 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:21:44.502 DEBUG:tasks.rgw:Pools created 2024-09-12T00:21:44.502 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:21:44.503 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:21:44.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:21:44.503 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:21:44.555 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:44.555 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:46.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.551+0000 7fe3ac20d640 0 -- 172.21.15.137:0/4066458372 >> [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] conn(0x7fe2800709f0 msgr2=0x7fe280072eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.559+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.559+0000 7fe3ab20b640 0 -- 172.21.15.137:0/3945908072 >> [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] conn(0x7fe270070ae0 msgr2=0x7fe270072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:21:46.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.559+0000 7fe3adf069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.559+0000 7fe3adf069c0 20 realm 2024-09-12T00:21:46.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.559+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.559+0000 7fe3adf069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.559+0000 7fe3adf069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:46.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.559+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.563+0000 7fe3adf069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.563+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.563+0000 7fe3adf069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.563+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.563+0000 7fe3adf069c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:21:46.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.563+0000 7fe3adf069c0 20 searching for the correct realm 2024-09-12T00:21:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.583+0000 7fe3adf069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.583+0000 7fe3adf069c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:21:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.583+0000 7fe3adf069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.583+0000 7fe3adf069c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:21:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.583+0000 7fe3adf069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.583+0000 7fe3adf069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.583+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:21:46.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 zone default found 2024-09-12T00:21:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 4 Realm: () 2024-09-12T00:21:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:21:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:21:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 zonegroup default 2024-09-12T00:21:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:46.587+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:48.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:48.539+0000 7fe3adf069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:48.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:48.539+0000 7fe3adf069c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:48.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:48.539+0000 7fe3adf069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:48.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:48.539+0000 7fe3adf069c0 20 started sync module instance, tier type = 2024-09-12T00:21:48.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:48.539+0000 7fe3adf069c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:21:50.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 20 add_watcher() i=0 2024-09-12T00:21:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 20 add_watcher() i=1 2024-09-12T00:21:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 20 add_watcher() i=2 2024-09-12T00:21:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 20 add_watcher() i=3 2024-09-12T00:21:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 20 add_watcher() i=4 2024-09-12T00:21:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 20 add_watcher() i=5 2024-09-12T00:21:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 20 add_watcher() i=6 2024-09-12T00:21:50.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 20 add_watcher() i=7 2024-09-12T00:21:50.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.583+0000 7fe3adf069c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:50.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:21:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:21:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:21:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:21:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:21:50.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:21:50.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:21:50.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:21:50.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:21:50.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:21:50.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:21:50.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:21:50.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.587+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:21:50.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:21:50.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:21:50.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:21:50.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:21:50.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:21:50.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:21:50.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:21:50.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:21:50.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:21:50.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:21:50.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:21:50.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:21:50.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:21:50.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.591+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:21:50.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:21:50.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:21:50.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:21:50.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:21:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:21:50.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:21:50.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:21:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:21:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:21:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:21:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:21:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:21:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.595+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:21:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:21:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:21:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:21:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:21:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:21:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:21:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:21:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:21:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:21:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.599+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:21:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:21:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:21:50.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:21:50.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:21:50.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:21:50.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:21:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:21:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:21:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:21:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:21:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:21:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:21:50.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:21:50.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.603+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:21:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:21:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:21:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:21:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:21:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:21:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:21:50.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:21:50.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:21:50.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:21:50.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:21:50.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:21:50.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.607+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:21:50.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:21:50.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:21:50.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:21:50.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:21:50.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:21:50.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:21:50.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:21:50.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:21:50.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:21:50.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:21:50.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:21:50.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:21:50.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.611+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:21:50.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:21:50.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:21:50.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:21:50.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:21:50.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:21:50.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:21:50.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:21:50.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:21:50.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:21:50.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:21:50.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:21:50.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.615+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:21:50.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:21:50.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:21:50.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:21:50.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:21:50.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:21:50.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:21:50.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:21:50.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:21:50.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:21:50.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:21:50.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:21:50.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.619+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:21:50.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:21:50.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:21:50.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:21:50.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:21:50.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:21:50.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:21:50.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:21:50.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:21:50.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:21:50.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:21:50.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:21:50.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.623+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:21:50.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:21:50.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:21:50.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:21:50.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:21:50.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:21:50.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:21:50.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:21:50.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:21:50.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:21:50.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.627+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:21:50.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:21:50.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:21:50.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:21:50.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:21:50.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:21:50.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:21:50.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:21:50.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:21:50.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:21:50.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:21:50.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:21:50.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.631+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:21:50.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:21:50.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:21:50.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:21:50.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:21:50.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:21:50.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:21:50.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:21:50.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:21:50.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:21:50.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:21:50.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:21:50.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:21:50.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:21:50.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.635+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:21:50.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:21:50.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:21:50.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:21:50.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:21:50.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:21:50.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:21:50.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:21:50.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:21:50.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:21:50.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:21:50.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:21:50.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.639+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:21:50.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:21:50.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:21:50.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:21:50.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:21:50.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:21:50.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:21:50.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:21:50.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:21:50.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:21:50.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:21:50.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:21:50.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.643+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:21:50.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:21:50.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:21:50.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:21:50.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:21:50.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:21:50.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:21:50.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:21:50.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:21:50.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:21:50.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:21:50.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:21:50.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.647+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:21:50.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:21:50.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:21:50.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:21:50.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:21:50.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:21:50.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:21:50.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:21:50.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:21:50.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:21:50.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:21:50.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:21:50.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.651+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:21:50.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:21:50.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:21:50.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:21:50.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:21:50.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:21:50.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:21:50.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:21:50.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:21:50.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:21:50.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.655+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:21:50.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:21:50.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:21:50.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:21:50.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:21:50.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:21:50.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:21:50.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:21:50.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:21:50.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:21:50.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:21:50.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:21:50.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.659+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:21:50.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:21:50.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:21:50.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:21:50.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:21:50.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:21:50.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:21:50.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:21:50.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:21:50.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:21:50.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:21:50.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.663+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:21:50.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.667+0000 7fe3adf069c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:21:50.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.675+0000 7fe25e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:50.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.675+0000 7fe3adf069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:50.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:50.675+0000 7fe3adf069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:53.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.526+0000 7fe3adf069c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:21:53.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.526+0000 7fe3adf069c0 5 note: GC not initialized 2024-09-12T00:21:53.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.542+0000 7fe25d7e2640 20 reqs_thread_entry: start 2024-09-12T00:21:53.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.542+0000 7fe3adf069c0 20 init_complete bucket index max shards: 1 2024-09-12T00:21:53.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.542+0000 7fe3adf069c0 20 Filter name: none 2024-09-12T00:21:53.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.542+0000 7fe2567fc640 20 reqs_thread_entry: start 2024-09-12T00:21:53.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.594+0000 7fe25e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:53.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.602+0000 7fe3adf069c0 20 remove_watcher() i=0 2024-09-12T00:21:53.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.602+0000 7fe3adf069c0 2 removed watcher, disabling cache 2024-09-12T00:21:53.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.602+0000 7fe3adf069c0 20 remove_watcher() i=1 2024-09-12T00:21:53.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.606+0000 7fe3adf069c0 20 remove_watcher() i=2 2024-09-12T00:21:53.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.610+0000 7fe3adf069c0 20 remove_watcher() i=3 2024-09-12T00:21:53.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.610+0000 7fe3adf069c0 20 remove_watcher() i=4 2024-09-12T00:21:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.614+0000 7fe3adf069c0 20 remove_watcher() i=5 2024-09-12T00:21:53.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.618+0000 7fe3adf069c0 20 remove_watcher() i=6 2024-09-12T00:21:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.622+0000 7fe3adf069c0 20 remove_watcher() i=7 2024-09-12T00:21:53.642 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-09-12T00:21:53.643 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:21:53.643 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:21:53.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:21:53.643 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:21:53.685 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:53.685 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:53.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.714+0000 7f682de7f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:53.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.714+0000 7f682de7f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:53.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.718+0000 7f6671ffb640 20 reqs_thread_entry: start 2024-09-12T00:21:53.739 INFO:teuthology.orchestra.run.smithi137.stdout:{"id":"68f093c2-d97a-4f4c-96cb-d3cbe2b155a4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:21:53.739 DEBUG:tasks.util.rgw: json result: {'id': '68f093c2-d97a-4f4c-96cb-d3cbe2b155a4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:21:53.739 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:21:53.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:21:53.739 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:21:53.814 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:53.815 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:53.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.850+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:53.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 realm 2024-09-12T00:21:53.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:53.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:53.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:53.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:53.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:21:53.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.854+0000 7f360222c9c0 20 searching for the correct realm 2024-09-12T00:21:53.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.862+0000 7f3600533640 0 -- 172.21.15.137:0/769560490 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f35e804c030 msgr2=0x7f35e8073040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:53.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.866+0000 7f35ffd32640 0 -- 172.21.15.137:0/769560490 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f35f8034920 msgr2=0x7f35f8025400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:53.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:53.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:21:53.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:53.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:21:53.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:53.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:53.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:53.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.874+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:53.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 zone default found 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 4 Realm: () 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 zonegroup default 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:53.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:53.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:53.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:53.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 started sync module instance, tier type = 2024-09-12T00:21:53.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.878+0000 7f360222c9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:21:53.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 20 add_watcher() i=0 2024-09-12T00:21:53.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 20 add_watcher() i=1 2024-09-12T00:21:53.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 20 add_watcher() i=2 2024-09-12T00:21:53.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 20 add_watcher() i=3 2024-09-12T00:21:53.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 20 add_watcher() i=4 2024-09-12T00:21:53.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 20 add_watcher() i=5 2024-09-12T00:21:53.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 20 add_watcher() i=6 2024-09-12T00:21:53.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 20 add_watcher() i=7 2024-09-12T00:21:53.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.898+0000 7f360222c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:53.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.902+0000 7f34b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:53.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.902+0000 7f360222c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:53.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.902+0000 7f360222c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:53.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.902+0000 7f360222c9c0 5 note: GC not initialized 2024-09-12T00:21:53.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.902+0000 7f34b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:53.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.902+0000 7f360222c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:21:53.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.902+0000 7f360222c9c0 20 Filter name: none 2024-09-12T00:21:53.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.906+0000 7f342e7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:53.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.922+0000 7f34b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:53.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.926+0000 7f360222c9c0 20 remove_watcher() i=0 2024-09-12T00:21:53.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.926+0000 7f360222c9c0 2 removed watcher, disabling cache 2024-09-12T00:21:53.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.926+0000 7f360222c9c0 20 remove_watcher() i=1 2024-09-12T00:21:53.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.930+0000 7f360222c9c0 20 remove_watcher() i=2 2024-09-12T00:21:53.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.930+0000 7f360222c9c0 20 remove_watcher() i=3 2024-09-12T00:21:53.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.934+0000 7f360222c9c0 20 remove_watcher() i=4 2024-09-12T00:21:53.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.938+0000 7f360222c9c0 20 remove_watcher() i=5 2024-09-12T00:21:53.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.938+0000 7f360222c9c0 20 remove_watcher() i=6 2024-09-12T00:21:53.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:53.942+0000 7f360222c9c0 20 remove_watcher() i=7 2024-09-12T00:21:53.957 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-09-12T00:21:53.958 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:21:53.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:21:53.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:21:53.958 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:21:54.043 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:54.043 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:54.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.070+0000 7f3ab3ff79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:54.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.070+0000 7f3ab3ff79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:54.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.074+0000 7f38e7fff640 20 reqs_thread_entry: start 2024-09-12T00:21:54.099 INFO:teuthology.orchestra.run.smithi137.stdout:{"id":"68f093c2-d97a-4f4c-96cb-d3cbe2b155a4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:21:54.099 DEBUG:tasks.util.rgw: json result: {'id': '68f093c2-d97a-4f4c-96cb-d3cbe2b155a4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:21:54.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:21:54.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:21:54.100 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:21:54.172 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:54.172 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:54.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.210+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.210+0000 7f35cfe329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:54.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.210+0000 7f35cfe329c0 20 realm 2024-09-12T00:21:54.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.210+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:54.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:54.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:21:54.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.214+0000 7f35cfe329c0 20 searching for the correct realm 2024-09-12T00:21:54.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.218+0000 7f35cd137640 0 -- 172.21.15.137:0/3744153418 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f35b807e2f0 msgr2=0x7f35b806f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:54.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.226+0000 7f35ce139640 0 -- 172.21.15.137:0/3744153418 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5610530be760 msgr2=0x5610530c0bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:21:54.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:54.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:21:54.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:54.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:21:54.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:54.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:54.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:54.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:54.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:21:54.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 zone default found 2024-09-12T00:21:54.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 4 Realm: () 2024-09-12T00:21:54.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:21:54.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:21:54.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:54.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 zonegroup default 2024-09-12T00:21:54.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.234+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.238+0000 7f35cfe329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:54.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.238+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.238+0000 7f35cfe329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:54.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.238+0000 7f35cfe329c0 20 rados->read ofs=0 len=0 2024-09-12T00:21:54.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.238+0000 7f35cfe329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:54.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.238+0000 7f35cfe329c0 20 started sync module instance, tier type = 2024-09-12T00:21:54.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.238+0000 7f35cfe329c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:21:54.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 20 add_watcher() i=0 2024-09-12T00:21:54.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 20 add_watcher() i=1 2024-09-12T00:21:54.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 20 add_watcher() i=2 2024-09-12T00:21:54.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 20 add_watcher() i=3 2024-09-12T00:21:54.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 20 add_watcher() i=4 2024-09-12T00:21:54.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 20 add_watcher() i=5 2024-09-12T00:21:54.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 20 add_watcher() i=6 2024-09-12T00:21:54.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 20 add_watcher() i=7 2024-09-12T00:21:54.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.258+0000 7f35cfe329c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:54.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.262+0000 7f347f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:54.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.262+0000 7f35cfe329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:54.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.262+0000 7f35cfe329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:54.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.262+0000 7f35cfe329c0 5 note: GC not initialized 2024-09-12T00:21:54.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.262+0000 7f347e7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:54.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.262+0000 7f35cfe329c0 20 init_complete bucket index max shards: 1 2024-09-12T00:21:54.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.262+0000 7f35cfe329c0 20 Filter name: none 2024-09-12T00:21:54.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.262+0000 7f33effff640 20 reqs_thread_entry: start 2024-09-12T00:21:54.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.282+0000 7f347f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:54.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.286+0000 7f35cfe329c0 20 remove_watcher() i=0 2024-09-12T00:21:54.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.286+0000 7f35cfe329c0 2 removed watcher, disabling cache 2024-09-12T00:21:54.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.286+0000 7f35cfe329c0 20 remove_watcher() i=1 2024-09-12T00:21:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.290+0000 7f35cfe329c0 20 remove_watcher() i=2 2024-09-12T00:21:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.290+0000 7f35cfe329c0 20 remove_watcher() i=3 2024-09-12T00:21:54.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.294+0000 7f35cfe329c0 20 remove_watcher() i=4 2024-09-12T00:21:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.298+0000 7f35cfe329c0 20 remove_watcher() i=5 2024-09-12T00:21:54.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.298+0000 7f35cfe329c0 20 remove_watcher() i=6 2024-09-12T00:21:54.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.302+0000 7f35cfe329c0 20 remove_watcher() i=7 2024-09-12T00:21:54.318 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-09-12T00:21:54.318 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:21:54.318 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:21:54.319 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:21:54.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:21:54.319 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:21:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:54.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.430+0000 7f263eebc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:54.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.430+0000 7f263eebc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:54.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.434+0000 7f2482ffd640 20 reqs_thread_entry: start 2024-09-12T00:21:54.455 INFO:teuthology.orchestra.run.smithi137.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:21:54.456 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:21:54.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:21:54.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:21:54.456 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:21:54.536 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:54.536 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.566+0000 7fd0ab1259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.566+0000 7fd0ab1259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:54.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.570+0000 7fceeeffd640 20 reqs_thread_entry: start 2024-09-12T00:21:54.593 INFO:teuthology.orchestra.run.smithi137.stdout:{"id":"68f093c2-d97a-4f4c-96cb-d3cbe2b155a4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:21:54.593 DEBUG:tasks.util.rgw: json result: {'id': '68f093c2-d97a-4f4c-96cb-d3cbe2b155a4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:21:54.594 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:21:54.594 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:21:54.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:21:54.594 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:21:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:54.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.706+0000 7fe2fb2139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:54.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.706+0000 7fe2fb2139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:54.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.710+0000 7fe13effd640 20 reqs_thread_entry: start 2024-09-12T00:21:54.732 INFO:teuthology.orchestra.run.smithi137.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:21:54.732 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:21:54.732 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:21:54.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:21:54.733 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:21:54.816 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:54.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.842+0000 7f8c177af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:54.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.842+0000 7f8c177af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:54.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:21:54.846+0000 7f8ad37fe640 20 reqs_thread_entry: start 2024-09-12T00:21:54.865 INFO:teuthology.orchestra.run.smithi137.stdout:{"id":"68f093c2-d97a-4f4c-96cb-d3cbe2b155a4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:21:54.866 DEBUG:tasks.util.rgw: json result: {'id': '68f093c2-d97a-4f4c-96cb-d3cbe2b155a4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:21:54.866 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:21:54.866 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-12T00:21:54.866 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:21:54.866 DEBUG:teuthology.orchestra.run.smithi137:> sudo echo -n https://smithi137.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:21:54.921 INFO:teuthology.orchestra.run.smithi137.stdout:https://smithi137.front.sepia.ceph.com:443 2024-09-12T00:21:54.921 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:21:54.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo keytool -import -alias smithi137.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:21:55.289 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:21:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:Certificate was added to keystore 2024-09-12T00:21:55.715 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:21:55.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:21:55.718 INFO:tasks.rgw.client.0:Started 2024-09-12T00:21:55.718 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi137.front.sepia.ceph.com:443/ 2024-09-12T00:21:55.718 DEBUG:teuthology.orchestra.run.smithi137:> curl https://smithi137.front.sepia.ceph.com:443/ 2024-09-12T00:21:55.751 INFO:teuthology.orchestra.run.smithi137.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:21:55.751 INFO:teuthology.orchestra.run.smithi137.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:21:55.751 INFO:teuthology.orchestra.run.smithi137.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:21:55.751 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:21:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:curl: (7) Failed to connect to smithi137.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:21:56.271 INFO:tasks.rgw.client.0.smithi137.stdout:2024-09-12T00:21:56.270+0000 7f5bc4e4ba40 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:21:56.753 DEBUG:teuthology.orchestra.run.smithi137:> curl https://smithi137.front.sepia.ceph.com:443/ 2024-09-12T00:21:56.764 INFO:teuthology.orchestra.run.smithi137.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:21:56.764 INFO:teuthology.orchestra.run.smithi137.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:21:56.878 INFO:teuthology.orchestra.run.smithi137.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 1642 0 --:--:-- --:--:-- --:--:-- 1640 2024-09-12T00:21:56.881 INFO:teuthology.orchestra.run.smithi137.stdout:anonymous 2024-09-12T00:21:56.881 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:21:56.892 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:21:56.893 DEBUG:teuthology.orchestra.run.smithi137:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:21:59.826 DEBUG:teuthology.orchestra.run.smithi137:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:22:00.509 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting tox==3.15.0 2024-09-12T00:22:00.615 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:22:00.670 INFO:teuthology.orchestra.run.smithi137.stdout: ---------------------------------------- 82.1/82.1 KB 1.4 MB/s eta 0:00:00 2024-09-12T00:22:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:22:00.802 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:22:00.951 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:22:00.966 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:22:01.093 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting packaging>=14 2024-09-12T00:22:01.109 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:22:01.148 INFO:teuthology.orchestra.run.smithi137.stdout: ---------------------------------------- 54.0/54.0 KB 1.3 MB/s eta 0:00:00 2024-09-12T00:22:01.210 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting toml>=0.9.4 2024-09-12T00:22:01.227 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:22:01.343 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:22:01.362 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:22:01.658 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:22:01.676 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:22:02.204 INFO:teuthology.orchestra.run.smithi137.stdout: ---------------------------------------- 6.0/6.0 MB 11.5 MB/s eta 0:00:00 2024-09-12T00:22:02.352 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:22:02.369 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:22:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: ---------------------------------------- 98.7/98.7 KB 3.1 MB/s eta 0:00:00 2024-09-12T00:22:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:22:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:22:02.629 INFO:teuthology.orchestra.run.smithi137.stdout: --------------------------------------- 468.9/468.9 KB 9.1 MB/s eta 0:00:00 2024-09-12T00:22:02.744 INFO:teuthology.orchestra.run.smithi137.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:22:02.760 INFO:teuthology.orchestra.run.smithi137.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:22:02.940 INFO:teuthology.orchestra.run.smithi137.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T00:22:04.037 INFO:teuthology.orchestra.run.smithi137.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:22:04.113 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:22:04.127 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:22:04.127 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:22:04.128 DEBUG:teuthology.orchestra.run.smithi137:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:22:04.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:22:04.133 INFO:teuthology.orchestra.run.smithi137.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:22:04.134 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:22:04.182 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:22:04.183 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:22:04.230 INFO:tasks.workunit:timeout=3h 2024-09-12T00:22:04.230 INFO:tasks.workunit:cleanup=True 2024-09-12T00:22:04.231 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:22:04.280 INFO:tasks.workunit.client.0.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:22:46.662 INFO:tasks.workunit.client.0.smithi137.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:22:46.662 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:22:46.662 INFO:tasks.workunit.client.0.smithi137.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr: git switch -c 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr:Or undo this operation with: 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr: git switch - 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:22:46.663 INFO:tasks.workunit.client.0.smithi137.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:22:46.664 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:22:46.664 INFO:tasks.workunit.client.0.smithi137.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:22:46.668 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:22:46.715 INFO:tasks.workunit.client.0.smithi137.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:22:46.719 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:22:46.719 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:22:47.559 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:22:47.650 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:22:47.703 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:22:47.704 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:22:47.704 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:22:47.753 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:22:47.757 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:22:47.757 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:22:47.803 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:22:47.804 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:22:47.804 DEBUG:teuthology.orchestra.run.smithi137:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:22:47.856 INFO:tasks.workunit.client.0.smithi137.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:22:47.857 INFO:tasks.workunit.client.0.smithi137.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:22:47.857 INFO:tasks.workunit.client.0.smithi137.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:22:50.821 INFO:tasks.workunit.client.0.smithi137.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ deactivate nondestructive 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ hash -r 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:22:50.822 INFO:tasks.workunit.client.0.smithi137.stderr:++ export VIRTUAL_ENV 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ export PATH 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -z '' ']' 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ PS1='(rgw) ' 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ export PS1 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:++ hash -r 2024-09-12T00:22:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:+ pip install pip --upgrade 2024-09-12T00:22:51.184 INFO:tasks.workunit.client.0.smithi137.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:22:51.422 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting pip 2024-09-12T00:22:51.523 INFO:tasks.workunit.client.0.smithi137.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:22:51.744 INFO:tasks.workunit.client.0.smithi137.stdout: ---------------------------------------- 1.8/1.8 MB 8.5 MB/s eta 0:00:00 2024-09-12T00:22:51.817 INFO:tasks.workunit.client.0.smithi137.stdout:Installing collected packages: pip 2024-09-12T00:22:51.817 INFO:tasks.workunit.client.0.smithi137.stdout: Attempting uninstall: pip 2024-09-12T00:22:51.818 INFO:tasks.workunit.client.0.smithi137.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:22:52.107 INFO:tasks.workunit.client.0.smithi137.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:22:52.113 INFO:tasks.workunit.client.0.smithi137.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:22:53.142 INFO:tasks.workunit.client.0.smithi137.stdout:Successfully installed pip-24.2 2024-09-12T00:22:53.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ pip install boto3 2024-09-12T00:22:54.340 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting boto3 2024-09-12T00:22:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:22:55.071 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:22:55.085 INFO:tasks.workunit.client.0.smithi137.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:22:55.214 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:22:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:22:55.377 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:22:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:22:55.550 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:22:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:22:55.759 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:22:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:22:56.071 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:22:56.086 INFO:tasks.workunit.client.0.smithi137.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:22:56.161 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:22:56.257 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:22:56.526 INFO:tasks.workunit.client.0.smithi137.stdout: ---------------------------------------- 12.5/12.5 MB 48.6 MB/s eta 0:00:00 2024-09-12T00:22:56.544 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:22:56.616 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:22:56.689 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:22:56.759 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:22:56.834 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:22:57.011 INFO:tasks.workunit.client.0.smithi137.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:22:58.122 INFO:tasks.workunit.client.0.smithi137.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:22:58.569 INFO:tasks.workunit.client.0.smithi137.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:22:58.720 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:22:58.759 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:58.759 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:58.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.800+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.803 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 realm 2024-09-12T00:22:58.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:58.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:58.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:58.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.804+0000 7f36a8d579c0 20 searching for the correct realm 2024-09-12T00:22:58.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.812+0000 7f36a685d640 0 -- 172.21.15.137:0/3955378131 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f36980bc040 msgr2=0x7f3698100090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:58.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.816+0000 7f36a685d640 0 -- 172.21.15.137:0/3955378131 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f36a00664b0 msgr2=0x7f36a005c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:58.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:58.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:22:58.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:58.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:22:58.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:58.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:58.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:58.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:58.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 zone default found 2024-09-12T00:22:58.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 4 Realm: () 2024-09-12T00:22:58.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:22:58.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:22:58.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:58.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 zonegroup default 2024-09-12T00:22:58.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.824+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.828+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.828+0000 7f36a8d579c0 20 started sync module instance, tier type = 2024-09-12T00:22:58.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.828+0000 7f36a8d579c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:22:58.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.848+0000 7f36a8d579c0 20 add_watcher() i=0 2024-09-12T00:22:58.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.848+0000 7f36a8d579c0 20 add_watcher() i=1 2024-09-12T00:22:58.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.848+0000 7f36a8d579c0 20 add_watcher() i=2 2024-09-12T00:22:58.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.848+0000 7f36a8d579c0 20 add_watcher() i=3 2024-09-12T00:22:58.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.848+0000 7f36a8d579c0 20 add_watcher() i=4 2024-09-12T00:22:58.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.848+0000 7f36a8d579c0 20 add_watcher() i=5 2024-09-12T00:22:58.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.848+0000 7f36a8d579c0 20 add_watcher() i=6 2024-09-12T00:22:58.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.852+0000 7f36a8d579c0 20 add_watcher() i=7 2024-09-12T00:22:58.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.852+0000 7f36a8d579c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:58.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f355d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:58.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:58.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:58.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 5 note: GC not initialized 2024-09-12T00:22:58.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f34d7fff640 20 reqs_thread_entry: start 2024-09-12T00:22:58.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 20 init_complete bucket index max shards: 1 2024-09-12T00:22:58.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 20 Filter name: none 2024-09-12T00:22:58.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f34d5ffb640 20 reqs_thread_entry: start 2024-09-12T00:22:58.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:22:58.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:22:58.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:22:58.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:22:58.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:58.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:58.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:22:58.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:22:58.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:22:58.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.856+0000 7f36a8d579c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:22:58.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.860+0000 7f36a8d579c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:22:58.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.860+0000 7f36a8d579c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:22:58.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.860+0000 7f36a8d579c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:22:58.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.860+0000 7f358a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94805880050320 notifier 4674 bl.length()=593 2024-09-12T00:22:58.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.860+0000 7f358a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:22:58.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.860+0000 7f358a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:22:58.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.864+0000 7f36a8d579c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:22:58.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.864+0000 7f36a8d579c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:22:58.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.864+0000 7f36a8d579c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:22:58.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.864+0000 7f358a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94805880045184 notifier 4674 bl.length()=186 2024-09-12T00:22:58.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.864+0000 7f358a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:22:58.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.864+0000 7f358a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:22:58.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.864+0000 7f355d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:58.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.872+0000 7f36a8d579c0 20 remove_watcher() i=0 2024-09-12T00:22:58.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.872+0000 7f36a8d579c0 2 removed watcher, disabling cache 2024-09-12T00:22:58.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.872+0000 7f36a8d579c0 20 remove_watcher() i=1 2024-09-12T00:22:58.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.876+0000 7f36a8d579c0 20 remove_watcher() i=2 2024-09-12T00:22:58.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.876+0000 7f36a8d579c0 20 remove_watcher() i=3 2024-09-12T00:22:58.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.880+0000 7f36a8d579c0 20 remove_watcher() i=4 2024-09-12T00:22:58.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.880+0000 7f36a8d579c0 20 remove_watcher() i=5 2024-09-12T00:22:58.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.884+0000 7f36a8d579c0 20 remove_watcher() i=6 2024-09-12T00:22:58.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:58.888+0000 7f36a8d579c0 20 remove_watcher() i=7 2024-09-12T00:22:59.062 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.063 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.107 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.108 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.157 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.158 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.182 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.182 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.204 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.205 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.212 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.212 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.231 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.232 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.241 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.241 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.252 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.252 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.292 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.292 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.301 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.302 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.343 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.344 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.352 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.352 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.392 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.392 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.401 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.401 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.441 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:22:59.441 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:22:59.446 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:22:59.446 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:22:59.447 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:22:59.481 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:59.481 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:59.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.528+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.528+0000 7ff3af9ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:59.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.528+0000 7ff3af9ce9c0 20 realm 2024-09-12T00:22:59.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.528+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:59.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:59.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:59.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:59.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:59.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.532+0000 7ff3af9ce9c0 20 searching for the correct realm 2024-09-12T00:22:59.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.536+0000 7ff3ad4d4640 0 -- 172.21.15.137:0/230472559 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7ff3a8028040 msgr2=0x7ff3a8010950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:59.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.748+0000 7ff3adcd5640 0 -- 172.21.15.137:0/230472559 >> [v2:172.21.15.150:6800/1704738992,v1:172.21.15.150:6801/1704738992] conn(0x7ff3a8062040 msgr2=0x7ff3a8029a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:59.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:59.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:22:59.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:59.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:22:59.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:59.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:59.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:59.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:59.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.968+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:59.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 zone default found 2024-09-12T00:22:59.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 4 Realm: () 2024-09-12T00:22:59.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:22:59.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:22:59.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:59.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 zonegroup default 2024-09-12T00:22:59.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:59.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:59.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:59.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:59.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 started sync module instance, tier type = 2024-09-12T00:22:59.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:22:59.972+0000 7ff3af9ce9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:00.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.000+0000 7ff3af9ce9c0 20 add_watcher() i=0 2024-09-12T00:23:00.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.000+0000 7ff3af9ce9c0 20 add_watcher() i=1 2024-09-12T00:23:00.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.000+0000 7ff3af9ce9c0 20 add_watcher() i=2 2024-09-12T00:23:00.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.000+0000 7ff3af9ce9c0 20 add_watcher() i=3 2024-09-12T00:23:00.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.000+0000 7ff3af9ce9c0 20 add_watcher() i=4 2024-09-12T00:23:00.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.000+0000 7ff3af9ce9c0 20 add_watcher() i=5 2024-09-12T00:23:00.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.000+0000 7ff3af9ce9c0 20 add_watcher() i=6 2024-09-12T00:23:00.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.004+0000 7ff3af9ce9c0 20 add_watcher() i=7 2024-09-12T00:23:00.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.004+0000 7ff3af9ce9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:00.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.008+0000 7ff2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:00.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.008+0000 7ff3af9ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:00.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.008+0000 7ff3af9ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:00.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.008+0000 7ff3af9ce9c0 5 note: GC not initialized 2024-09-12T00:23:00.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.008+0000 7ff2627e4640 20 reqs_thread_entry: start 2024-09-12T00:23:00.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:00.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 20 Filter name: none 2024-09-12T00:23:00.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff1d3fff640 20 reqs_thread_entry: start 2024-09-12T00:23:00.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:00.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:00.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:00.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:00.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:00.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:00.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:00.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:00.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:00.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:00.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:00.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.012+0000 7ff3af9ce9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:00.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.020+0000 7ff2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:00.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.028+0000 7ff3af9ce9c0 20 remove_watcher() i=0 2024-09-12T00:23:00.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.028+0000 7ff3af9ce9c0 2 removed watcher, disabling cache 2024-09-12T00:23:00.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.028+0000 7ff3af9ce9c0 20 remove_watcher() i=1 2024-09-12T00:23:00.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.032+0000 7ff3af9ce9c0 20 remove_watcher() i=2 2024-09-12T00:23:00.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.032+0000 7ff3af9ce9c0 20 remove_watcher() i=3 2024-09-12T00:23:00.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.036+0000 7ff3af9ce9c0 20 remove_watcher() i=4 2024-09-12T00:23:00.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.036+0000 7ff3af9ce9c0 20 remove_watcher() i=5 2024-09-12T00:23:00.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.040+0000 7ff3af9ce9c0 20 remove_watcher() i=6 2024-09-12T00:23:00.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.044+0000 7ff3af9ce9c0 20 remove_watcher() i=7 2024-09-12T00:23:00.061 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:23:00.089 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:00.089 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:00.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.132+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.136+0000 7f295f50c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.136+0000 7f295f50c9c0 20 realm 2024-09-12T00:23:00.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.136+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.136+0000 7f295f50c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.136+0000 7f295f50c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:00.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.136+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.136+0000 7f295f50c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.136+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.140+0000 7f295f50c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:00.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.140+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.140+0000 7f295f50c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:00.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.140+0000 7f295f50c9c0 20 searching for the correct realm 2024-09-12T00:23:00.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.144+0000 7f295d012640 0 -- 172.21.15.137:0/136870695 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f295004e040 msgr2=0x7f295004f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:00.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.356+0000 7f295d012640 0 -- 172.21.15.137:0/136870695 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f2958035020 msgr2=0x7f295805fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:00.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:00.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:00.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:00.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:00.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:00.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:00.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:00.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 zone default found 2024-09-12T00:23:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 4 Realm: () 2024-09-12T00:23:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 zonegroup default 2024-09-12T00:23:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.572+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.576+0000 7f295f50c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.576+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.576+0000 7f295f50c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.576+0000 7f295f50c9c0 20 started sync module instance, tier type = 2024-09-12T00:23:00.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.576+0000 7f295f50c9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:00.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.600+0000 7f295f50c9c0 20 add_watcher() i=0 2024-09-12T00:23:00.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.600+0000 7f295f50c9c0 20 add_watcher() i=1 2024-09-12T00:23:00.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.600+0000 7f295f50c9c0 20 add_watcher() i=2 2024-09-12T00:23:00.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.600+0000 7f295f50c9c0 20 add_watcher() i=3 2024-09-12T00:23:00.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.600+0000 7f295f50c9c0 20 add_watcher() i=4 2024-09-12T00:23:00.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.600+0000 7f295f50c9c0 20 add_watcher() i=5 2024-09-12T00:23:00.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.600+0000 7f295f50c9c0 20 add_watcher() i=6 2024-09-12T00:23:00.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.604+0000 7f295f50c9c0 20 add_watcher() i=7 2024-09-12T00:23:00.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.604+0000 7f295f50c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:00.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.608+0000 7f2813fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:00.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.608+0000 7f295f50c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:00.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.608+0000 7f295f50c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:00.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 5 note: GC not initialized 2024-09-12T00:23:00.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f2812fe5640 20 reqs_thread_entry: start 2024-09-12T00:23:00.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:00.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 Filter name: none 2024-09-12T00:23:00.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f2810fe1640 20 reqs_thread_entry: start 2024-09-12T00:23:00.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:00.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:00.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:00.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:00.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.612+0000 7f295f50c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.616+0000 7f295f50c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:00.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.616+0000 7f295f50c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:00.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.616+0000 7f2813fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:00.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.624+0000 7f295f50c9c0 20 remove_watcher() i=0 2024-09-12T00:23:00.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.624+0000 7f295f50c9c0 2 removed watcher, disabling cache 2024-09-12T00:23:00.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.624+0000 7f295f50c9c0 20 remove_watcher() i=1 2024-09-12T00:23:00.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.628+0000 7f295f50c9c0 20 remove_watcher() i=2 2024-09-12T00:23:00.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.628+0000 7f295f50c9c0 20 remove_watcher() i=3 2024-09-12T00:23:00.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.632+0000 7f295f50c9c0 20 remove_watcher() i=4 2024-09-12T00:23:00.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.632+0000 7f295f50c9c0 20 remove_watcher() i=5 2024-09-12T00:23:00.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.636+0000 7f295f50c9c0 20 remove_watcher() i=6 2024-09-12T00:23:00.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.640+0000 7f295f50c9c0 20 remove_watcher() i=7 2024-09-12T00:23:00.654 INFO:tasks.workunit.client.0.smithi137.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 96, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:23:00.655 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:23:00.655 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:00.655 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:23:00.690 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:00.690 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:00.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.732+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 realm 2024-09-12T00:23:00.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:00.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:00.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:00.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.736+0000 7efe8b4439c0 20 searching for the correct realm 2024-09-12T00:23:00.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.744+0000 7efe88f49640 0 -- 172.21.15.137:0/3799103515 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7efe780d9030 msgr2=0x7efe780ce970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:00.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.748+0000 7efe88f49640 0 -- 172.21.15.137:0/3799103515 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5613f45d7c40 msgr2=0x5613f45da030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:00.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:00.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:00.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:00.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:00.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:00.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:00.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:00.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 zone default found 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 4 Realm: () 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 zonegroup default 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.756+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.760+0000 7efe8b4439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:00.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.760+0000 7efe8b4439c0 20 started sync module instance, tier type = 2024-09-12T00:23:00.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.760+0000 7efe8b4439c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 20 add_watcher() i=0 2024-09-12T00:23:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 20 add_watcher() i=1 2024-09-12T00:23:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 20 add_watcher() i=2 2024-09-12T00:23:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 20 add_watcher() i=3 2024-09-12T00:23:00.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 20 add_watcher() i=4 2024-09-12T00:23:00.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 20 add_watcher() i=5 2024-09-12T00:23:00.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 20 add_watcher() i=6 2024-09-12T00:23:00.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 20 add_watcher() i=7 2024-09-12T00:23:00.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.780+0000 7efe8b4439c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:00.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.784+0000 7efd3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 5 note: GC not initialized 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efd3dfe3640 20 reqs_thread_entry: start 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 Filter name: none 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efcaf7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:00.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:00.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:00.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:00.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:00.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:00.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:00.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:00.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:00.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:00.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.788+0000 7efe8b4439c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:00.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.792+0000 7efe8b4439c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:23:00.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.792+0000 7efe8b4439c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:23:00.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.792+0000 7efd3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:00.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.796+0000 7efe8b4439c0 20 remove_watcher() i=0 2024-09-12T00:23:00.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.796+0000 7efe8b4439c0 2 removed watcher, disabling cache 2024-09-12T00:23:00.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.796+0000 7efe8b4439c0 20 remove_watcher() i=1 2024-09-12T00:23:00.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.800+0000 7efe8b4439c0 20 remove_watcher() i=2 2024-09-12T00:23:00.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.800+0000 7efe8b4439c0 20 remove_watcher() i=3 2024-09-12T00:23:00.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.804+0000 7efe8b4439c0 20 remove_watcher() i=4 2024-09-12T00:23:00.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.804+0000 7efe8b4439c0 20 remove_watcher() i=5 2024-09-12T00:23:00.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.808+0000 7efe8b4439c0 20 remove_watcher() i=6 2024-09-12T00:23:00.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:00.812+0000 7efe8b4439c0 20 remove_watcher() i=7 2024-09-12T00:23:00.826 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:23:01.258 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:23:02.686 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:02.686 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:02.756 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:23:02.756 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:23:02.792 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:02.792 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:02.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.832+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:02.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 realm 2024-09-12T00:23:02.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:02.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:02.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:02.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:02.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.836+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.840+0000 7f7f62b9f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:02.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.840+0000 7f7f62b9f9c0 20 searching for the correct realm 2024-09-12T00:23:02.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.844+0000 7f7f60ea6640 0 -- 172.21.15.137:0/2274961417 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f7f5401e030 msgr2=0x7f7f5401e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:02.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.848+0000 7f7f606a5640 0 -- 172.21.15.137:0/2274961417 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f7f58065fa0 msgr2=0x7f7f5805be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:02.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:02.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:02.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:02.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:02.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:02.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:02.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:02.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:02.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.856+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:02.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 zone default found 2024-09-12T00:23:02.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 4 Realm: () 2024-09-12T00:23:02.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:02.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:02.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:02.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 zonegroup default 2024-09-12T00:23:02.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:02.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:02.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:02.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 started sync module instance, tier type = 2024-09-12T00:23:02.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.860+0000 7f7f62b9f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.880+0000 7f7f62b9f9c0 20 add_watcher() i=0 2024-09-12T00:23:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.880+0000 7f7f62b9f9c0 20 add_watcher() i=1 2024-09-12T00:23:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.880+0000 7f7f62b9f9c0 20 add_watcher() i=2 2024-09-12T00:23:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.880+0000 7f7f62b9f9c0 20 add_watcher() i=3 2024-09-12T00:23:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.880+0000 7f7f62b9f9c0 20 add_watcher() i=4 2024-09-12T00:23:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.880+0000 7f7f62b9f9c0 20 add_watcher() i=5 2024-09-12T00:23:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.880+0000 7f7f62b9f9c0 20 add_watcher() i=6 2024-09-12T00:23:02.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.884+0000 7f7f62b9f9c0 20 add_watcher() i=7 2024-09-12T00:23:02.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.884+0000 7f7f62b9f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:02.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7e167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:02.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:02.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:02.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 5 note: GC not initialized 2024-09-12T00:23:02.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7e157e2640 20 reqs_thread_entry: start 2024-09-12T00:23:02.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:02.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 Filter name: none 2024-09-12T00:23:02.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7d8effd640 20 reqs_thread_entry: start 2024-09-12T00:23:02.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:02.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:02.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:02.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:02.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:02.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 INFO: main: starting shard=0 2024-09-12T00:23:02.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.888+0000 7f7f62b9f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:02.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.892+0000 7f7f62b9f9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:23:02.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.892+0000 7f7f62b9f9c0 20 INFO: main: done 2024-09-12T00:23:02.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.892+0000 7f7e167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:02.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.896+0000 7f7f62b9f9c0 20 remove_watcher() i=0 2024-09-12T00:23:02.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.896+0000 7f7f62b9f9c0 2 removed watcher, disabling cache 2024-09-12T00:23:02.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.900+0000 7f7f62b9f9c0 20 remove_watcher() i=1 2024-09-12T00:23:02.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.900+0000 7f7f62b9f9c0 20 remove_watcher() i=2 2024-09-12T00:23:02.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.904+0000 7f7f62b9f9c0 20 remove_watcher() i=3 2024-09-12T00:23:02.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.904+0000 7f7f62b9f9c0 20 remove_watcher() i=4 2024-09-12T00:23:02.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.908+0000 7f7f62b9f9c0 20 remove_watcher() i=5 2024-09-12T00:23:02.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.912+0000 7f7f62b9f9c0 20 remove_watcher() i=6 2024-09-12T00:23:02.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:02.912+0000 7f7f62b9f9c0 20 remove_watcher() i=7 2024-09-12T00:23:02.929 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:02.929 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:02.933 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:02.933 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:02.936 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:02.936 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:02.996 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:23:02.996 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:23:03.031 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:03.031 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:03.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.076+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.076+0000 7f18c94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.076+0000 7f18c94c09c0 20 realm 2024-09-12T00:23:03.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.076+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:03.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:03.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:03.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.080+0000 7f18c94c09c0 20 searching for the correct realm 2024-09-12T00:23:03.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.088+0000 7f18c67c5640 0 -- 172.21.15.137:0/2940593683 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f18b0037910 msgr2=0x7f18b0019400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:03.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.092+0000 7f18c77c7640 0 -- 172.21.15.137:0/2940593683 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55fec2761c50 msgr2=0x55fec27640e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:03.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:03.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:03.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:03.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:03.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:03.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:03.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:03.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:03.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 zone default found 2024-09-12T00:23:03.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 4 Realm: () 2024-09-12T00:23:03.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:03.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:03.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:03.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 zonegroup default 2024-09-12T00:23:03.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.100+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.104+0000 7f18c94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.104+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.104+0000 7f18c94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.104+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.104+0000 7f18c94c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.104+0000 7f18c94c09c0 20 started sync module instance, tier type = 2024-09-12T00:23:03.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.104+0000 7f18c94c09c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:03.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.124+0000 7f18c94c09c0 20 add_watcher() i=0 2024-09-12T00:23:03.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.124+0000 7f18c94c09c0 20 add_watcher() i=1 2024-09-12T00:23:03.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.124+0000 7f18c94c09c0 20 add_watcher() i=2 2024-09-12T00:23:03.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.124+0000 7f18c94c09c0 20 add_watcher() i=3 2024-09-12T00:23:03.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.124+0000 7f18c94c09c0 20 add_watcher() i=4 2024-09-12T00:23:03.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.124+0000 7f18c94c09c0 20 add_watcher() i=5 2024-09-12T00:23:03.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.124+0000 7f18c94c09c0 20 add_watcher() i=6 2024-09-12T00:23:03.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.128+0000 7f18c94c09c0 20 add_watcher() i=7 2024-09-12T00:23:03.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.128+0000 7f18c94c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:03.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.128+0000 7f177d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:03.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.128+0000 7f18c94c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:03.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.128+0000 7f18c94c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:03.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.128+0000 7f18c94c09c0 5 note: GC not initialized 2024-09-12T00:23:03.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f16f7fff640 20 reqs_thread_entry: start 2024-09-12T00:23:03.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:03.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 Filter name: none 2024-09-12T00:23:03.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f16f5ffb640 20 reqs_thread_entry: start 2024-09-12T00:23:03.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:03.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:03.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:03.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:03.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 INFO: main: starting shard=0 2024-09-12T00:23:03.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:03.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:23:03.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.132+0000 7f18c94c09c0 20 INFO: main: done 2024-09-12T00:23:03.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.136+0000 7f177d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:03.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.140+0000 7f18c94c09c0 20 remove_watcher() i=0 2024-09-12T00:23:03.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.140+0000 7f18c94c09c0 2 removed watcher, disabling cache 2024-09-12T00:23:03.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.140+0000 7f18c94c09c0 20 remove_watcher() i=1 2024-09-12T00:23:03.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.144+0000 7f18c94c09c0 20 remove_watcher() i=2 2024-09-12T00:23:03.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.148+0000 7f18c94c09c0 20 remove_watcher() i=3 2024-09-12T00:23:03.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.148+0000 7f18c94c09c0 20 remove_watcher() i=4 2024-09-12T00:23:03.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.152+0000 7f18c94c09c0 20 remove_watcher() i=5 2024-09-12T00:23:03.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.156+0000 7f18c94c09c0 20 remove_watcher() i=6 2024-09-12T00:23:03.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.156+0000 7f18c94c09c0 20 remove_watcher() i=7 2024-09-12T00:23:03.175 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:03.175 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:03.179 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:03.179 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:03.248 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:23:03.248 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:23:03.278 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:03.278 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:03.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.320+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.324+0000 7f3a7d85c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.324+0000 7f3a7d85c9c0 20 realm 2024-09-12T00:23:03.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.324+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.324+0000 7f3a7d85c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.324+0000 7f3a7d85c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:03.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.324+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.324+0000 7f3a7d85c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.324+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.328+0000 7f3a7d85c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:03.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.328+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.328+0000 7f3a7d85c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:03.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.328+0000 7f3a7d85c9c0 20 searching for the correct realm 2024-09-12T00:23:03.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.332+0000 7f3a7b362640 0 -- 172.21.15.137:0/2507928375 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f3a640023a0 msgr2=0x7f3a6c07f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:03.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.548+0000 7f3a7b362640 0 -- 172.21.15.137:0/2507928375 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f3a64003cc0 msgr2=0x7f3a74060f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:03.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.764+0000 7f3a7d85c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:03.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.764+0000 7f3a7d85c9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:03.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.764+0000 7f3a7d85c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:03.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.764+0000 7f3a7d85c9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:03.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.764+0000 7f3a7d85c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:03.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.764+0000 7f3a7d85c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:03.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:03.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:03.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 zone default found 2024-09-12T00:23:03.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 4 Realm: () 2024-09-12T00:23:03.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:03.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:03.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:03.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 zonegroup default 2024-09-12T00:23:03.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.768+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.772+0000 7f3a7d85c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:03.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.772+0000 7f3a7d85c9c0 20 started sync module instance, tier type = 2024-09-12T00:23:03.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.772+0000 7f3a7d85c9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:03.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.796+0000 7f3a7d85c9c0 20 add_watcher() i=0 2024-09-12T00:23:03.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.796+0000 7f3a7d85c9c0 20 add_watcher() i=1 2024-09-12T00:23:03.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.796+0000 7f3a7d85c9c0 20 add_watcher() i=2 2024-09-12T00:23:03.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.796+0000 7f3a7d85c9c0 20 add_watcher() i=3 2024-09-12T00:23:03.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.796+0000 7f3a7d85c9c0 20 add_watcher() i=4 2024-09-12T00:23:03.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.796+0000 7f3a7d85c9c0 20 add_watcher() i=5 2024-09-12T00:23:03.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.796+0000 7f3a7d85c9c0 20 add_watcher() i=6 2024-09-12T00:23:03.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.800+0000 7f3a7d85c9c0 20 add_watcher() i=7 2024-09-12T00:23:03.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.800+0000 7f3a7d85c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:03.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:03.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3a7d85c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:03.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3a7d85c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:03.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3a7d85c9c0 5 note: GC not initialized 2024-09-12T00:23:03.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3930fe1640 20 reqs_thread_entry: start 2024-09-12T00:23:03.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3a7d85c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:03.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3a7d85c9c0 20 Filter name: none 2024-09-12T00:23:03.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f38aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:23:03.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3a7d85c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:03.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.804+0000 7f3a7d85c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:03.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.808+0000 7f3a7d85c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:03.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.808+0000 7f3a7d85c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:03.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.808+0000 7f3a7d85c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:03.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.808+0000 7f3a7d85c9c0 20 INFO: main: starting shard=0 2024-09-12T00:23:03.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.808+0000 7f3a7d85c9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:03.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.808+0000 7f3a7d85c9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:23:03.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.808+0000 7f3a7d85c9c0 20 INFO: main: done 2024-09-12T00:23:03.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.808+0000 7f3931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:03.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.812+0000 7f3a7d85c9c0 20 remove_watcher() i=0 2024-09-12T00:23:03.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.812+0000 7f3a7d85c9c0 2 removed watcher, disabling cache 2024-09-12T00:23:03.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.816+0000 7f3a7d85c9c0 20 remove_watcher() i=1 2024-09-12T00:23:03.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.816+0000 7f3a7d85c9c0 20 remove_watcher() i=2 2024-09-12T00:23:03.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.820+0000 7f3a7d85c9c0 20 remove_watcher() i=3 2024-09-12T00:23:03.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.824+0000 7f3a7d85c9c0 20 remove_watcher() i=4 2024-09-12T00:23:03.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.824+0000 7f3a7d85c9c0 20 remove_watcher() i=5 2024-09-12T00:23:03.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.828+0000 7f3a7d85c9c0 20 remove_watcher() i=6 2024-09-12T00:23:03.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:03.832+0000 7f3a7d85c9c0 20 remove_watcher() i=7 2024-09-12T00:23:03.850 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:03.850 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:03.854 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:03.854 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:03.920 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:23:03.920 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:23:03.956 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:03.956 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:04.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.000+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:04.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 realm 2024-09-12T00:23:04.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:04.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:04.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:04.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:04.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:04.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.004+0000 7ffb7c90d9c0 20 searching for the correct realm 2024-09-12T00:23:04.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.008+0000 7ffb79c12640 0 -- 172.21.15.137:0/1049704350 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7ffb6c025920 msgr2=0x7ffb6c019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:04.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.220+0000 7ffb79c12640 0 -- 172.21.15.137:0/1049704350 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5611a4648e50 msgr2=0x5611a464b240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:04.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:04.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:04.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:04.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:04.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:04.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:04.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:04.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:04.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.232+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:04.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 zone default found 2024-09-12T00:23:04.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 4 Realm: () 2024-09-12T00:23:04.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:04.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:04.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:04.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 zonegroup default 2024-09-12T00:23:04.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:04.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:04.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:04.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 started sync module instance, tier type = 2024-09-12T00:23:04.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.236+0000 7ffb7c90d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:04.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 20 add_watcher() i=0 2024-09-12T00:23:04.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 20 add_watcher() i=1 2024-09-12T00:23:04.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 20 add_watcher() i=2 2024-09-12T00:23:04.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 20 add_watcher() i=3 2024-09-12T00:23:04.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 20 add_watcher() i=4 2024-09-12T00:23:04.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 20 add_watcher() i=5 2024-09-12T00:23:04.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 20 add_watcher() i=6 2024-09-12T00:23:04.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 20 add_watcher() i=7 2024-09-12T00:23:04.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.260+0000 7ffb7c90d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:04.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffa30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:04.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:04.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:04.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 5 note: GC not initialized 2024-09-12T00:23:04.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ff9ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:04.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:04.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 20 Filter name: none 2024-09-12T00:23:04.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ff9a97fa640 20 reqs_thread_entry: start 2024-09-12T00:23:04.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:04.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:04.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.268+0000 7ffb7c90d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:04.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.272+0000 7ffb7c90d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:04.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.272+0000 7ffb7c90d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:04.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.272+0000 7ffb7c90d9c0 20 INFO: main: starting shard=0 2024-09-12T00:23:04.272 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.272+0000 7ffb7c90d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:04.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.272+0000 7ffb7c90d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:23:04.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.272+0000 7ffb7c90d9c0 20 INFO: main: done 2024-09-12T00:23:04.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.272+0000 7ffa30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:04.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.280+0000 7ffb7c90d9c0 20 remove_watcher() i=0 2024-09-12T00:23:04.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.280+0000 7ffb7c90d9c0 2 removed watcher, disabling cache 2024-09-12T00:23:04.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.280+0000 7ffb7c90d9c0 20 remove_watcher() i=1 2024-09-12T00:23:04.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.284+0000 7ffb7c90d9c0 20 remove_watcher() i=2 2024-09-12T00:23:04.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.284+0000 7ffb7c90d9c0 20 remove_watcher() i=3 2024-09-12T00:23:04.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.288+0000 7ffb7c90d9c0 20 remove_watcher() i=4 2024-09-12T00:23:04.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.288+0000 7ffb7c90d9c0 20 remove_watcher() i=5 2024-09-12T00:23:04.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.292+0000 7ffb7c90d9c0 20 remove_watcher() i=6 2024-09-12T00:23:04.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:04.296+0000 7ffb7c90d9c0 20 remove_watcher() i=7 2024-09-12T00:23:04.319 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:04.319 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:04.323 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:23:04.767 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:23:05.198 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:23:05.198 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:05.198 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:23:05.232 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:05.232 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:05.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.272+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 realm 2024-09-12T00:23:05.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:05.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:05.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:05.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.276+0000 7fd76b4739c0 20 searching for the correct realm 2024-09-12T00:23:05.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.284+0000 7fd768778640 0 -- 172.21.15.137:0/3330050708 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x56323b6d1c70 msgr2=0x56323b6d40c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:05.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.292+0000 7fd768778640 0 -- 172.21.15.137:0/3330050708 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x56323b6db250 msgr2=0x56323b6dd640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:05.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:05.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:05.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:05.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:05.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:05.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:05.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:05.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:05.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 zone default found 2024-09-12T00:23:05.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 4 Realm: () 2024-09-12T00:23:05.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:05.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:05.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:05.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 zonegroup default 2024-09-12T00:23:05.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.296+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.300+0000 7fd76b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.300+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.300+0000 7fd76b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.300+0000 7fd76b4739c0 20 started sync module instance, tier type = 2024-09-12T00:23:05.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.300+0000 7fd76b4739c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:05.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 20 add_watcher() i=0 2024-09-12T00:23:05.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 20 add_watcher() i=1 2024-09-12T00:23:05.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 20 add_watcher() i=2 2024-09-12T00:23:05.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 20 add_watcher() i=3 2024-09-12T00:23:05.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 20 add_watcher() i=4 2024-09-12T00:23:05.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 20 add_watcher() i=5 2024-09-12T00:23:05.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 20 add_watcher() i=6 2024-09-12T00:23:05.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 20 add_watcher() i=7 2024-09-12T00:23:05.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.320+0000 7fd76b4739c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:05.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.324+0000 7fd61efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:05.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.324+0000 7fd76b4739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:05.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.324+0000 7fd76b4739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:05.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.324+0000 7fd76b4739c0 5 note: GC not initialized 2024-09-12T00:23:05.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.324+0000 7fd61dfe3640 20 reqs_thread_entry: start 2024-09-12T00:23:05.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.324+0000 7fd76b4739c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:05.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.324+0000 7fd76b4739c0 20 Filter name: none 2024-09-12T00:23:05.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd58f7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:05.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:05.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:05.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:05.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.328+0000 7fd76b4739c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.336+0000 7fd76b4739c0 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T00:23:05.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.336+0000 7fd76b4739c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:23:05.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.336+0000 7fd61efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:05.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.340+0000 7fd76b4739c0 20 remove_watcher() i=0 2024-09-12T00:23:05.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.340+0000 7fd76b4739c0 2 removed watcher, disabling cache 2024-09-12T00:23:05.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.340+0000 7fd76b4739c0 20 remove_watcher() i=1 2024-09-12T00:23:05.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.344+0000 7fd76b4739c0 20 remove_watcher() i=2 2024-09-12T00:23:05.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.344+0000 7fd76b4739c0 20 remove_watcher() i=3 2024-09-12T00:23:05.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.348+0000 7fd76b4739c0 20 remove_watcher() i=4 2024-09-12T00:23:05.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.352+0000 7fd76b4739c0 20 remove_watcher() i=5 2024-09-12T00:23:05.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.352+0000 7fd76b4739c0 20 remove_watcher() i=6 2024-09-12T00:23:05.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.356+0000 7fd76b4739c0 20 remove_watcher() i=7 2024-09-12T00:23:05.370 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: unlinked entries are not listable 2024-09-12T00:23:05.370 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:05.372 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.372 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.377 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:23:05.377 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:05.379 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.379 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.425 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.425 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.474 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:23:05.474 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:05.474 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:23:05.510 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:05.510 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:05.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.548+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 realm 2024-09-12T00:23:05.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:05.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:05.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.552+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.556+0000 7fdc402e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:05.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.556+0000 7fdc402e19c0 20 searching for the correct realm 2024-09-12T00:23:05.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.560+0000 7fdc3e5e8640 0 -- 172.21.15.137:0/2076478850 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x558cdfade3e0 msgr2=0x558cdfae0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:05.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.568+0000 7fdc3dde7640 0 -- 172.21.15.137:0/2076478850 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x558cdfae25d0 msgr2=0x558cdfae4a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:05.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:05.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:05.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:05.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:05.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:05.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:05.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:05.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.572+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:05.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 zone default found 2024-09-12T00:23:05.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 4 Realm: () 2024-09-12T00:23:05.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:05.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:05.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:05.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 zonegroup default 2024-09-12T00:23:05.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 started sync module instance, tier type = 2024-09-12T00:23:05.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.576+0000 7fdc402e19c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:05.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.596+0000 7fdc402e19c0 20 add_watcher() i=0 2024-09-12T00:23:05.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.596+0000 7fdc402e19c0 20 add_watcher() i=1 2024-09-12T00:23:05.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.596+0000 7fdc402e19c0 20 add_watcher() i=2 2024-09-12T00:23:05.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.596+0000 7fdc402e19c0 20 add_watcher() i=3 2024-09-12T00:23:05.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.596+0000 7fdc402e19c0 20 add_watcher() i=4 2024-09-12T00:23:05.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.596+0000 7fdc402e19c0 20 add_watcher() i=5 2024-09-12T00:23:05.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.596+0000 7fdc402e19c0 20 add_watcher() i=6 2024-09-12T00:23:05.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.600+0000 7fdc402e19c0 20 add_watcher() i=7 2024-09-12T00:23:05.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.600+0000 7fdc402e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:05.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.600+0000 7fdaef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:05.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.600+0000 7fdc402e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:05.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.600+0000 7fdc402e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.600+0000 7fdc402e19c0 5 note: GC not initialized 2024-09-12T00:23:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdaee7fc640 20 reqs_thread_entry: start 2024-09-12T00:23:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 20 Filter name: none 2024-09-12T00:23:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fda5ffff640 20 reqs_thread_entry: start 2024-09-12T00:23:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:05.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.604+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.608+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.608+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:c state=0x558cdfb1ad48 s->prefetch_data=0 2024-09-12T00:23:05.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.608+0000 7fdc402e19c0 20 get_obj_state: setting s->obj_tag to 44e2obp2xqtki088c4243g8641wx93h7 2024-09-12T00:23:05.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.608+0000 7fdc402e19c0 20 get_obj_state_impl: setting s->olh_tag to 1tz17tmlu5gextub2q2veeyucytfb15w 2024-09-12T00:23:05.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.608+0000 7fdc402e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1tz17tmlu5gextub2q2veeyucytfb15w 2024-09-12T00:23:05.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.616+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.620+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.620+0000 7fdc402e19c0 20 olh_log_entry: epoch=3 op=3 key=c[d5Fn7LZ4WZmFhXR3l4PD-eqM.X2CSC9] 2024-09-12T00:23:05.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.620+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:_:d5Fn7LZ4WZmFhXR3l4PD-eqM.X2CSC9_c state=0x558cdfb155c8 s->prefetch_data=0 2024-09-12T00:23:05.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.620+0000 7fdc402e19c0 10 manifest: total_size = 9 2024-09-12T00:23:05.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.620+0000 7fdc402e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7479010507134856320 2024-09-12T00:23:05.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.620+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:_:d5Fn7LZ4WZmFhXR3l4PD-eqM.X2CSC9_c state=0x558cdfb155c8 s->prefetch_data=0 2024-09-12T00:23:05.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.620+0000 7fdc402e19c0 20 prepare_atomic_modification: state is not atomic. state=0x558cdfb155c8 2024-09-12T00:23:05.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.620+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.628+0000 7fdc402e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:05.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.628+0000 7fdc402e19c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:23:05.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.628+0000 7fdc402e19c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:23:05.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.628+0000 7fdc402e19c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1__shadow:d5Fn7LZ4WZmFhXR3l4PD-eqM.X2CSC9_.jwcOagriRhOxrP3_zgw_ZEOnr0h5BSv_0 2024-09-12T00:23:05.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.632+0000 7fdc402e19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:23:05.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.636+0000 7fdb20ff9640 20 handle_completion(): completion ok for obj=c[d5Fn7LZ4WZmFhXR3l4PD-eqM.X2CSC9] 2024-09-12T00:23:05.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.636+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.636+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.640+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.644+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.644+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:d state=0x558cdfb1ad18 s->prefetch_data=0 2024-09-12T00:23:05.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.644+0000 7fdc402e19c0 20 get_obj_state: setting s->obj_tag to 59c367rk1mwa89kwuy2yqa2zpdocbc6z 2024-09-12T00:23:05.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.644+0000 7fdc402e19c0 20 get_obj_state_impl: setting s->olh_tag to 6nrt393gh2bu6s6tpgkxfb34zac4e8bj 2024-09-12T00:23:05.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.644+0000 7fdc402e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6nrt393gh2bu6s6tpgkxfb34zac4e8bj 2024-09-12T00:23:05.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.648+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.648+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.652+0000 7fdc402e19c0 20 olh_log_entry: epoch=3 op=3 key=d[05dakUXdHRI6bOp8VWlZfBH1Rhf1oXw] 2024-09-12T00:23:05.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.652+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:_:05dakUXdHRI6bOp8VWlZfBH1Rhf1oXw_d state=0x558cdfb155c8 s->prefetch_data=0 2024-09-12T00:23:05.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.652+0000 7fdc402e19c0 10 manifest: total_size = 22 2024-09-12T00:23:05.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.652+0000 7fdc402e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5884213549158564819 2024-09-12T00:23:05.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.652+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:_:05dakUXdHRI6bOp8VWlZfBH1Rhf1oXw_d state=0x558cdfb155c8 s->prefetch_data=0 2024-09-12T00:23:05.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.652+0000 7fdc402e19c0 20 prepare_atomic_modification: state is not atomic. state=0x558cdfb155c8 2024-09-12T00:23:05.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.652+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.656+0000 7fdc402e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:05.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.656+0000 7fdc402e19c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:23:05.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.656+0000 7fdc402e19c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:23:05.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.656+0000 7fdc402e19c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1__shadow:05dakUXdHRI6bOp8VWlZfBH1Rhf1oXw_.QJIjNU8zLxwaDKgshNhU3es25xoXlB8_0 2024-09-12T00:23:05.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.660+0000 7fdc402e19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:23:05.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.664+0000 7fdb20ff9640 20 handle_completion(): completion ok for obj=d[05dakUXdHRI6bOp8VWlZfBH1Rhf1oXw] 2024-09-12T00:23:05.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.664+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.664+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.668+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.668+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.668+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:e state=0x558cdfb1ac68 s->prefetch_data=0 2024-09-12T00:23:05.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.668+0000 7fdc402e19c0 20 get_obj_state: setting s->obj_tag to 6lrj67h1uvge2jq6br42cucldz14mqt8 2024-09-12T00:23:05.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.668+0000 7fdc402e19c0 20 get_obj_state_impl: setting s->olh_tag to ie3ffo3jk2ii60y4q7lxjl4pri7josww 2024-09-12T00:23:05.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.668+0000 7fdc402e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ie3ffo3jk2ii60y4q7lxjl4pri7josww 2024-09-12T00:23:05.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.672+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:23:05.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 20 olh_log_entry: epoch=2 op=3 key=e[rZRT4Hyuy75uYg4Gmo77JQOv2fugi63] 2024-09-12T00:23:05.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:_:rZRT4Hyuy75uYg4Gmo77JQOv2fugi63_e state=0x558cdfb155c8 s->prefetch_data=0 2024-09-12T00:23:05.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 10 manifest: total_size = 12 2024-09-12T00:23:05.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5684281214022020991 2024-09-12T00:23:05.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:_:rZRT4Hyuy75uYg4Gmo77JQOv2fugi63_e state=0x558cdfb155c8 s->prefetch_data=0 2024-09-12T00:23:05.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 20 prepare_atomic_modification: state is not atomic. state=0x558cdfb155c8 2024-09-12T00:23:05.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.676+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.684+0000 7fdc402e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:05.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.684+0000 7fdc402e19c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:23:05.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.684+0000 7fdc402e19c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:23:05.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.684+0000 7fdc402e19c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1__shadow:rZRT4Hyuy75uYg4Gmo77JQOv2fugi63_.TCtBTqGrqvEudctp_ijw50Ta5SHIECv_0 2024-09-12T00:23:05.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.684+0000 7fdc402e19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:23:05.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.684+0000 7fdb20ff9640 20 handle_completion(): completion ok for obj=e[rZRT4Hyuy75uYg4Gmo77JQOv2fugi63] 2024-09-12T00:23:05.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.688+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:e state=0x558cdfb1ac68 s->prefetch_data=0 2024-09-12T00:23:05.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.688+0000 7fdc402e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ie3ffo3jk2ii60y4q7lxjl4pri7josww 2024-09-12T00:23:05.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.696+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.700+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.700+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.700+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:f state=0x558cdfb1ac68 s->prefetch_data=0 2024-09-12T00:23:05.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.700+0000 7fdc402e19c0 20 get_obj_state: setting s->obj_tag to 93dd50qf0bl0jj0zj7dw3mgznjobtkh8 2024-09-12T00:23:05.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.700+0000 7fdc402e19c0 20 get_obj_state_impl: setting s->olh_tag to rct3jbpyyfecyafk95473z6x5hg3lmt3 2024-09-12T00:23:05.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.700+0000 7fdc402e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rct3jbpyyfecyafk95473z6x5hg3lmt3 2024-09-12T00:23:05.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.704+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:23:05.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 20 olh_log_entry: epoch=2 op=3 key=f[Upj0HCwu5EfvUvGfl39HL6FvIzR6vyE] 2024-09-12T00:23:05.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:_:Upj0HCwu5EfvUvGfl39HL6FvIzR6vyE_f state=0x558cdfb155c8 s->prefetch_data=0 2024-09-12T00:23:05.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 10 manifest: total_size = 9 2024-09-12T00:23:05.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12322102625192472319 2024-09-12T00:23:05.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:_:Upj0HCwu5EfvUvGfl39HL6FvIzR6vyE_f state=0x558cdfb155c8 s->prefetch_data=0 2024-09-12T00:23:05.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 20 prepare_atomic_modification: state is not atomic. state=0x558cdfb155c8 2024-09-12T00:23:05.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.708+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.716+0000 7fdc402e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:05.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.716+0000 7fdc402e19c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:23:05.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.716+0000 7fdc402e19c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:23:05.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.716+0000 7fdc402e19c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1__shadow:Upj0HCwu5EfvUvGfl39HL6FvIzR6vyE_.i2FvYpFu7FT3k3rus-MsL8jFhG9sxXe_0 2024-09-12T00:23:05.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.720+0000 7fdc402e19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:23:05.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.720+0000 7fdb20ff9640 20 handle_completion(): completion ok for obj=f[Upj0HCwu5EfvUvGfl39HL6FvIzR6vyE] 2024-09-12T00:23:05.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.724+0000 7fdc402e19c0 20 get_obj_state: octx=0x558cdf870740 obj=check-bucket:f state=0x558cdfb1ac68 s->prefetch_data=0 2024-09-12T00:23:05.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.724+0000 7fdc402e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rct3jbpyyfecyafk95473z6x5hg3lmt3 2024-09-12T00:23:05.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.732+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.732+0000 7fdc402e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:05.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.732+0000 7fdc402e19c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:23:05.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.732+0000 7fdc402e19c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:23:05.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.736+0000 7fdaef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:05.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.740+0000 7fdc402e19c0 20 remove_watcher() i=0 2024-09-12T00:23:05.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.740+0000 7fdc402e19c0 2 removed watcher, disabling cache 2024-09-12T00:23:05.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.744+0000 7fdc402e19c0 20 remove_watcher() i=1 2024-09-12T00:23:05.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.744+0000 7fdc402e19c0 20 remove_watcher() i=2 2024-09-12T00:23:05.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.748+0000 7fdc402e19c0 20 remove_watcher() i=3 2024-09-12T00:23:05.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.748+0000 7fdc402e19c0 20 remove_watcher() i=4 2024-09-12T00:23:05.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.752+0000 7fdc402e19c0 20 remove_watcher() i=5 2024-09-12T00:23:05.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.756+0000 7fdc402e19c0 20 remove_watcher() i=6 2024-09-12T00:23:05.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.756+0000 7fdc402e19c0 20 remove_watcher() i=7 2024-09-12T00:23:05.779 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.779 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.783 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.783 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.787 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.787 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.792 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.792 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.794 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:23:05.794 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:05.796 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.796 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.847 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.847 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.853 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.853 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.861 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.861 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.867 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:05.867 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:05.872 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:23:05.872 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:05.872 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:23:05.911 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:05.911 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:05.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.952+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 realm 2024-09-12T00:23:05.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:05.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:05.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.956+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.960+0000 7f73801469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:05.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.960+0000 7f73801469c0 20 searching for the correct realm 2024-09-12T00:23:05.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:05.960+0000 7f737dc4c640 0 -- 172.21.15.137:0/1089118977 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f7368002380 msgr2=0x7f7370063a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:06.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.172+0000 7f737dc4c640 0 -- 172.21.15.137:0/1089118977 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f737801d040 msgr2=0x7f737801c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:06.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.388+0000 7f73801469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:06.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.388+0000 7f73801469c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:06.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.388+0000 7f73801469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:06.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.388+0000 7f73801469c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.388+0000 7f73801469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.388+0000 7f73801469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 zone default found 2024-09-12T00:23:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 4 Realm: () 2024-09-12T00:23:06.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:06.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:06.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:06.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 zonegroup default 2024-09-12T00:23:06.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.392+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.396+0000 7f73801469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.396+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.396+0000 7f73801469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.396+0000 7f73801469c0 20 started sync module instance, tier type = 2024-09-12T00:23:06.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.396+0000 7f73801469c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 20 add_watcher() i=0 2024-09-12T00:23:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 20 add_watcher() i=1 2024-09-12T00:23:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 20 add_watcher() i=2 2024-09-12T00:23:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 20 add_watcher() i=3 2024-09-12T00:23:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 20 add_watcher() i=4 2024-09-12T00:23:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 20 add_watcher() i=5 2024-09-12T00:23:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 20 add_watcher() i=6 2024-09-12T00:23:06.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 20 add_watcher() i=7 2024-09-12T00:23:06.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.420+0000 7f73801469c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:06.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.424+0000 7f7233fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:06.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:06.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:06.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 5 note: GC not initialized 2024-09-12T00:23:06.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f7232fe5640 20 reqs_thread_entry: start 2024-09-12T00:23:06.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:06.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 Filter name: none 2024-09-12T00:23:06.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f7230fe1640 20 reqs_thread_entry: start 2024-09-12T00:23:06.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:06.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:06.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:06.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:06.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:06.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:06.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:06.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:06.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:06.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:06.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.428+0000 7f73801469c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:06.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.432+0000 7f73801469c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:23:06.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.432+0000 7f73801469c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:23:06.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.432+0000 7f7233fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:06.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.436+0000 7f73801469c0 20 remove_watcher() i=0 2024-09-12T00:23:06.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.436+0000 7f73801469c0 2 removed watcher, disabling cache 2024-09-12T00:23:06.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.440+0000 7f73801469c0 20 remove_watcher() i=1 2024-09-12T00:23:06.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.440+0000 7f73801469c0 20 remove_watcher() i=2 2024-09-12T00:23:06.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.444+0000 7f73801469c0 20 remove_watcher() i=3 2024-09-12T00:23:06.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.444+0000 7f73801469c0 20 remove_watcher() i=4 2024-09-12T00:23:06.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.448+0000 7f73801469c0 20 remove_watcher() i=5 2024-09-12T00:23:06.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.448+0000 7f73801469c0 20 remove_watcher() i=6 2024-09-12T00:23:06.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.452+0000 7f73801469c0 20 remove_watcher() i=7 2024-09-12T00:23:06.474 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:06.474 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:06.508 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:06.508 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:06.539 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:23:06.574 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:06.574 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:06.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.620+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.620+0000 7ff2fa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.620+0000 7ff2fa1349c0 20 realm 2024-09-12T00:23:06.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.620+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.620+0000 7ff2fa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.620+0000 7ff2fa1349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:06.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.620+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.624+0000 7ff2fa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.624+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.624+0000 7ff2fa1349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:06.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.624+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.624+0000 7ff2fa1349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:06.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.624+0000 7ff2fa1349c0 20 searching for the correct realm 2024-09-12T00:23:06.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.632+0000 7ff2f843b640 0 -- 172.21.15.137:0/79028052 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7ff2e001a040 msgr2=0x7ff2e0044420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:06.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.636+0000 7ff2f7c3a640 0 -- 172.21.15.137:0/79028052 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7ff2e80d1900 msgr2=0x7ff2e80c5400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:06.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:06.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:06.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:06.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:06.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:06.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:06.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:06.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:06.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 zone default found 2024-09-12T00:23:06.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 4 Realm: () 2024-09-12T00:23:06.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:06.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:06.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:06.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 zonegroup default 2024-09-12T00:23:06.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.644+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.648+0000 7ff2fa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.648+0000 7ff2fa1349c0 20 started sync module instance, tier type = 2024-09-12T00:23:06.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.648+0000 7ff2fa1349c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:06.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.664+0000 7ff2fa1349c0 20 add_watcher() i=0 2024-09-12T00:23:06.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.664+0000 7ff2fa1349c0 20 add_watcher() i=1 2024-09-12T00:23:06.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.664+0000 7ff2fa1349c0 20 add_watcher() i=2 2024-09-12T00:23:06.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.664+0000 7ff2fa1349c0 20 add_watcher() i=3 2024-09-12T00:23:06.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.664+0000 7ff2fa1349c0 20 add_watcher() i=4 2024-09-12T00:23:06.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.664+0000 7ff2fa1349c0 20 add_watcher() i=5 2024-09-12T00:23:06.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.664+0000 7ff2fa1349c0 20 add_watcher() i=6 2024-09-12T00:23:06.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.668+0000 7ff2fa1349c0 20 add_watcher() i=7 2024-09-12T00:23:06.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.668+0000 7ff2fa1349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:06.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff1adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:06.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff2fa1349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:06.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff2fa1349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:06.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff2fa1349c0 5 note: GC not initialized 2024-09-12T00:23:06.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff1acfe1640 20 reqs_thread_entry: start 2024-09-12T00:23:06.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff2fa1349c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:06.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff2fa1349c0 20 Filter name: none 2024-09-12T00:23:06.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff1267fc640 20 reqs_thread_entry: start 2024-09-12T00:23:06.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff2fa1349c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:06.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.672+0000 7ff2fa1349c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.676+0000 7ff2fa1349c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:06.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.676+0000 7ff2fa1349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:06.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.676+0000 7ff2fa1349c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:06.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.676+0000 7ff2fa1349c0 20 INFO: main: starting shard=0 2024-09-12T00:23:06.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.676+0000 7ff2fa1349c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:06.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.676+0000 7ff2fa1349c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:23:06.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.676+0000 7ff2fa1349c0 20 INFO: main: done 2024-09-12T00:23:06.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.676+0000 7ff1adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:06.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.680+0000 7ff2fa1349c0 20 remove_watcher() i=0 2024-09-12T00:23:06.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.680+0000 7ff2fa1349c0 2 removed watcher, disabling cache 2024-09-12T00:23:06.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.684+0000 7ff2fa1349c0 20 remove_watcher() i=1 2024-09-12T00:23:06.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.684+0000 7ff2fa1349c0 20 remove_watcher() i=2 2024-09-12T00:23:06.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.688+0000 7ff2fa1349c0 20 remove_watcher() i=3 2024-09-12T00:23:06.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.688+0000 7ff2fa1349c0 20 remove_watcher() i=4 2024-09-12T00:23:06.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.692+0000 7ff2fa1349c0 20 remove_watcher() i=5 2024-09-12T00:23:06.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.692+0000 7ff2fa1349c0 20 remove_watcher() i=6 2024-09-12T00:23:06.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.696+0000 7ff2fa1349c0 20 remove_watcher() i=7 2024-09-12T00:23:06.714 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:23:06.744 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:06.744 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:06.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.784+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 realm 2024-09-12T00:23:06.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:06.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:06.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:06.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.788+0000 7fc12cef19c0 20 searching for the correct realm 2024-09-12T00:23:06.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:06.796+0000 7fc12a1f6640 0 -- 172.21.15.137:0/2474614094 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fc12006e640 msgr2=0x7fc120086210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:07.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.008+0000 7fc12b1f8640 0 -- 172.21.15.137:0/2474614094 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x564b71ba9640 msgr2=0x564b71baba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:07.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.020+0000 7fc12cef19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:07.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.020+0000 7fc12cef19c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:07.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.020+0000 7fc12cef19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:07.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.020+0000 7fc12cef19c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:07.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.020+0000 7fc12cef19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:07.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.020+0000 7fc12cef19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:07.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.020+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:07.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:07.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 zone default found 2024-09-12T00:23:07.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 4 Realm: () 2024-09-12T00:23:07.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:07.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:07.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:07.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 zonegroup default 2024-09-12T00:23:07.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 started sync module instance, tier type = 2024-09-12T00:23:07.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.024+0000 7fc12cef19c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:07.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 20 add_watcher() i=0 2024-09-12T00:23:07.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 20 add_watcher() i=1 2024-09-12T00:23:07.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 20 add_watcher() i=2 2024-09-12T00:23:07.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 20 add_watcher() i=3 2024-09-12T00:23:07.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 20 add_watcher() i=4 2024-09-12T00:23:07.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 20 add_watcher() i=5 2024-09-12T00:23:07.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 20 add_watcher() i=6 2024-09-12T00:23:07.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 20 add_watcher() i=7 2024-09-12T00:23:07.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.048+0000 7fc12cef19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:07.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fbfe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:07.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:07.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:07.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 5 note: GC not initialized 2024-09-12T00:23:07.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fbf5bfff640 20 reqs_thread_entry: start 2024-09-12T00:23:07.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:07.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 Filter name: none 2024-09-12T00:23:07.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fbf59ffb640 20 reqs_thread_entry: start 2024-09-12T00:23:07.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:07.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:07.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:07.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:07.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 INFO: main: starting shard=0 2024-09-12T00:23:07.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.056+0000 7fc12cef19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:07.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.060+0000 7fc12cef19c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:23:07.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.060+0000 7fc12cef19c0 20 INFO: main: done 2024-09-12T00:23:07.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.060+0000 7fbfe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:07.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.064+0000 7fc12cef19c0 20 remove_watcher() i=0 2024-09-12T00:23:07.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.064+0000 7fc12cef19c0 2 removed watcher, disabling cache 2024-09-12T00:23:07.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.068+0000 7fc12cef19c0 20 remove_watcher() i=1 2024-09-12T00:23:07.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.068+0000 7fc12cef19c0 20 remove_watcher() i=2 2024-09-12T00:23:07.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.072+0000 7fc12cef19c0 20 remove_watcher() i=3 2024-09-12T00:23:07.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.072+0000 7fc12cef19c0 20 remove_watcher() i=4 2024-09-12T00:23:07.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.076+0000 7fc12cef19c0 20 remove_watcher() i=5 2024-09-12T00:23:07.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.080+0000 7fc12cef19c0 20 remove_watcher() i=6 2024-09-12T00:23:07.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.080+0000 7fc12cef19c0 20 remove_watcher() i=7 2024-09-12T00:23:07.098 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:23:07.098 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:07.098 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:23:07.131 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:07.131 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:07.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.172+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 realm 2024-09-12T00:23:07.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:07.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:07.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:07.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.176+0000 7f4f5ca7e9c0 20 searching for the correct realm 2024-09-12T00:23:07.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.184+0000 7f4f5ad85640 0 -- 172.21.15.137:0/2593749600 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55b1e2a3cb30 msgr2=0x55b1e2a3ef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:07.191 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.192+0000 7f4f59d83640 0 -- 172.21.15.137:0/2593749600 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x55b1e2a45ca0 msgr2=0x55b1e2a48160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:07.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:07.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:07.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:07.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:07.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:07.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:07.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:07.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.196+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:07.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 zone default found 2024-09-12T00:23:07.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 4 Realm: () 2024-09-12T00:23:07.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:07.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:07.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:07.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 zonegroup default 2024-09-12T00:23:07.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 started sync module instance, tier type = 2024-09-12T00:23:07.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.200+0000 7f4f5ca7e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:07.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.216+0000 7f4f5ca7e9c0 20 add_watcher() i=0 2024-09-12T00:23:07.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.216+0000 7f4f5ca7e9c0 20 add_watcher() i=1 2024-09-12T00:23:07.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.216+0000 7f4f5ca7e9c0 20 add_watcher() i=2 2024-09-12T00:23:07.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.216+0000 7f4f5ca7e9c0 20 add_watcher() i=3 2024-09-12T00:23:07.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.216+0000 7f4f5ca7e9c0 20 add_watcher() i=4 2024-09-12T00:23:07.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.216+0000 7f4f5ca7e9c0 20 add_watcher() i=5 2024-09-12T00:23:07.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.216+0000 7f4f5ca7e9c0 20 add_watcher() i=6 2024-09-12T00:23:07.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.220+0000 7f4f5ca7e9c0 20 add_watcher() i=7 2024-09-12T00:23:07.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.220+0000 7f4f5ca7e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:07.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4e10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:07.224 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:07.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:07.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 5 note: GC not initialized 2024-09-12T00:23:07.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4d8b7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:07.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:07.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 Filter name: none 2024-09-12T00:23:07.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4d897fa640 20 reqs_thread_entry: start 2024-09-12T00:23:07.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:07.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:07.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:07.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.224+0000 7f4f5ca7e9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:07.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.228+0000 7f4f5ca7e9c0 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T00:23:07.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.228+0000 7f4f5ca7e9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:23:07.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.228+0000 7f4e10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:07.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.232+0000 7f4f5ca7e9c0 20 remove_watcher() i=0 2024-09-12T00:23:07.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.232+0000 7f4f5ca7e9c0 2 removed watcher, disabling cache 2024-09-12T00:23:07.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.232+0000 7f4f5ca7e9c0 20 remove_watcher() i=1 2024-09-12T00:23:07.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.236+0000 7f4f5ca7e9c0 20 remove_watcher() i=2 2024-09-12T00:23:07.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.236+0000 7f4f5ca7e9c0 20 remove_watcher() i=3 2024-09-12T00:23:07.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.240+0000 7f4f5ca7e9c0 20 remove_watcher() i=4 2024-09-12T00:23:07.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.240+0000 7f4f5ca7e9c0 20 remove_watcher() i=5 2024-09-12T00:23:07.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.244+0000 7f4f5ca7e9c0 20 remove_watcher() i=6 2024-09-12T00:23:07.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.248+0000 7f4f5ca7e9c0 20 remove_watcher() i=7 2024-09-12T00:23:07.262 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:23:07.262 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:07.262 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:23:07.293 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:07.293 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:07.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.336+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.336+0000 7f71a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.336+0000 7f71a13f89c0 20 realm 2024-09-12T00:23:07.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.336+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.336+0000 7f71a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.336+0000 7f71a13f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:07.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.336+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.340+0000 7f71a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.340+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.340+0000 7f71a13f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:07.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.340+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.340+0000 7f71a13f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:07.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.340+0000 7f71a13f89c0 20 searching for the correct realm 2024-09-12T00:23:07.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.348+0000 7f719eefe640 0 -- 172.21.15.137:0/3437766961 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f7190068c20 msgr2=0x7f7190066670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:07.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.352+0000 7f719eefe640 0 -- 172.21.15.137:0/3437766961 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f71980d9040 msgr2=0x7f71980cd930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:07.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.356+0000 7f71a13f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:07.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.356+0000 7f71a13f89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:07.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.356+0000 7f71a13f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:07.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.356+0000 7f71a13f89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:07.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.356+0000 7f71a13f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:07.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.356+0000 7f71a13f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:07.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:07.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:07.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 zone default found 2024-09-12T00:23:07.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 4 Realm: () 2024-09-12T00:23:07.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:07.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:07.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:07.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 zonegroup default 2024-09-12T00:23:07.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 started sync module instance, tier type = 2024-09-12T00:23:07.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.360+0000 7f71a13f89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:07.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.380+0000 7f71a13f89c0 20 add_watcher() i=0 2024-09-12T00:23:07.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.380+0000 7f71a13f89c0 20 add_watcher() i=1 2024-09-12T00:23:07.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.380+0000 7f71a13f89c0 20 add_watcher() i=2 2024-09-12T00:23:07.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.380+0000 7f71a13f89c0 20 add_watcher() i=3 2024-09-12T00:23:07.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.380+0000 7f71a13f89c0 20 add_watcher() i=4 2024-09-12T00:23:07.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.380+0000 7f71a13f89c0 20 add_watcher() i=5 2024-09-12T00:23:07.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.380+0000 7f71a13f89c0 20 add_watcher() i=6 2024-09-12T00:23:07.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.384+0000 7f71a13f89c0 20 add_watcher() i=7 2024-09-12T00:23:07.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.384+0000 7f71a13f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:07.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f7055fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:07.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:07.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:07.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 5 note: GC not initialized 2024-09-12T00:23:07.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f7054fe1640 20 reqs_thread_entry: start 2024-09-12T00:23:07.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:07.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 Filter name: none 2024-09-12T00:23:07.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f704e7fc640 20 reqs_thread_entry: start 2024-09-12T00:23:07.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:07.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:07.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:07.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.388+0000 7f71a13f89c0 20 get_obj_state: octx=0x560e78ca5730 obj=check-bucket:c state=0x560e78f54558 s->prefetch_data=0 2024-09-12T00:23:07.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.392+0000 7f71a13f89c0 20 get_obj_state: setting s->obj_tag to 44e2obp2xqtki088c4243g8641wx93h7 2024-09-12T00:23:07.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.392+0000 7f71a13f89c0 20 get_obj_state_impl: setting s->olh_tag to 1tz17tmlu5gextub2q2veeyucytfb15w 2024-09-12T00:23:07.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.392+0000 7f71a13f89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:07.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.392+0000 7f71a13f89c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:23:07.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.392+0000 7f71a13f89c0 20 olh_log_entry: epoch=4 op=3 key=c[-b.YnHpsEkV-INjhaMicuYaRJUDMtJU] 2024-09-12T00:23:07.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.392+0000 7f71a13f89c0 20 get_obj_state: octx=0x560e78f7d3a0 obj=check-bucket:_:-b.YnHpsEkV-INjhaMicuYaRJUDMtJU_c state=0x560e78f4e678 s->prefetch_data=0 2024-09-12T00:23:07.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.396+0000 7f71a13f89c0 20 get_obj_state: octx=0x560e78f7d3a0 obj=check-bucket:c state=0x560e78f4f608 s->prefetch_data=0 2024-09-12T00:23:07.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.396+0000 7f71a13f89c0 20 get_obj_state: setting s->obj_tag to 44e2obp2xqtki088c4243g8641wx93h7 2024-09-12T00:23:07.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.396+0000 7f71a13f89c0 20 get_obj_state_impl: setting s->olh_tag to 1tz17tmlu5gextub2q2veeyucytfb15w 2024-09-12T00:23:07.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.396+0000 7f71a13f89c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1tz17tmlu5gextub2q2veeyucytfb15w 2024-09-12T00:23:07.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.404+0000 7f71a13f89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:07.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.408+0000 7f71a13f89c0 20 get_obj_state: octx=0x560e78ca5730 obj=check-bucket:d state=0x560e78f54048 s->prefetch_data=0 2024-09-12T00:23:07.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.408+0000 7f71a13f89c0 20 get_obj_state: setting s->obj_tag to 59c367rk1mwa89kwuy2yqa2zpdocbc6z 2024-09-12T00:23:07.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.408+0000 7f71a13f89c0 20 get_obj_state_impl: setting s->olh_tag to 6nrt393gh2bu6s6tpgkxfb34zac4e8bj 2024-09-12T00:23:07.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.408+0000 7f71a13f89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:07.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.408+0000 7f71a13f89c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:23:07.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.408+0000 7f71a13f89c0 20 olh_log_entry: epoch=4 op=3 key=d[vkBXn2CfVD2tBkV8BcZ0Oz99dHgeupu] 2024-09-12T00:23:07.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.408+0000 7f71a13f89c0 20 get_obj_state: octx=0x560e78f7d3a0 obj=check-bucket:_:vkBXn2CfVD2tBkV8BcZ0Oz99dHgeupu_d state=0x560e78f7ed88 s->prefetch_data=0 2024-09-12T00:23:07.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.412+0000 7f71a13f89c0 20 get_obj_state: octx=0x560e78f7d3a0 obj=check-bucket:d state=0x560e78f7dd78 s->prefetch_data=0 2024-09-12T00:23:07.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.412+0000 7f71a13f89c0 20 get_obj_state: setting s->obj_tag to 59c367rk1mwa89kwuy2yqa2zpdocbc6z 2024-09-12T00:23:07.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.412+0000 7f71a13f89c0 20 get_obj_state_impl: setting s->olh_tag to 6nrt393gh2bu6s6tpgkxfb34zac4e8bj 2024-09-12T00:23:07.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.412+0000 7f71a13f89c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6nrt393gh2bu6s6tpgkxfb34zac4e8bj 2024-09-12T00:23:07.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.416+0000 7f71a13f89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:07.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.420+0000 7f71a13f89c0 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T00:23:07.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.420+0000 7f71a13f89c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:23:07.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.420+0000 7f7055fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:07.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.424+0000 7f71a13f89c0 20 remove_watcher() i=0 2024-09-12T00:23:07.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.424+0000 7f71a13f89c0 2 removed watcher, disabling cache 2024-09-12T00:23:07.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.428+0000 7f71a13f89c0 20 remove_watcher() i=1 2024-09-12T00:23:07.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.428+0000 7f71a13f89c0 20 remove_watcher() i=2 2024-09-12T00:23:07.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.432+0000 7f71a13f89c0 20 remove_watcher() i=3 2024-09-12T00:23:07.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.432+0000 7f71a13f89c0 20 remove_watcher() i=4 2024-09-12T00:23:07.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.436+0000 7f71a13f89c0 20 remove_watcher() i=5 2024-09-12T00:23:07.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.440+0000 7f71a13f89c0 20 remove_watcher() i=6 2024-09-12T00:23:07.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.440+0000 7f71a13f89c0 20 remove_watcher() i=7 2024-09-12T00:23:07.458 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:23:07.489 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:07.489 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:07.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.532+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 realm 2024-09-12T00:23:07.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:07.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:07.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:07.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.536+0000 7f211dd169c0 20 searching for the correct realm 2024-09-12T00:23:07.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.748+0000 7f2113fff640 0 -- 172.21.15.137:0/1348359309 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f2104041910 msgr2=0x7f210402c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:07.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.960+0000 7f211c01d640 0 -- 172.21.15.137:0/1348359309 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55c2f2b326e0 msgr2=0x55c2f2b34b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:07.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:07.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:07.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:07.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:07.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:07.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:07.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.972+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:07.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:07.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 zone default found 2024-09-12T00:23:07.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 4 Realm: () 2024-09-12T00:23:07.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:07.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:07.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:07.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 zonegroup default 2024-09-12T00:23:07.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:07.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:07.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 started sync module instance, tier type = 2024-09-12T00:23:07.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:07.976+0000 7f211dd169c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:08.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.000+0000 7f211dd169c0 20 add_watcher() i=0 2024-09-12T00:23:08.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.000+0000 7f211dd169c0 20 add_watcher() i=1 2024-09-12T00:23:08.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.000+0000 7f211dd169c0 20 add_watcher() i=2 2024-09-12T00:23:08.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.000+0000 7f211dd169c0 20 add_watcher() i=3 2024-09-12T00:23:08.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.000+0000 7f211dd169c0 20 add_watcher() i=4 2024-09-12T00:23:08.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.000+0000 7f211dd169c0 20 add_watcher() i=5 2024-09-12T00:23:08.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.000+0000 7f211dd169c0 20 add_watcher() i=6 2024-09-12T00:23:08.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.004+0000 7f211dd169c0 20 add_watcher() i=7 2024-09-12T00:23:08.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.004+0000 7f211dd169c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:08.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f1fd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:08.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f211dd169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:08.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f211dd169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:08.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f211dd169c0 5 note: GC not initialized 2024-09-12T00:23:08.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f1fd0fe1640 20 reqs_thread_entry: start 2024-09-12T00:23:08.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f211dd169c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:08.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f211dd169c0 20 Filter name: none 2024-09-12T00:23:08.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f1f4a7fc640 20 reqs_thread_entry: start 2024-09-12T00:23:08.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.008+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:08.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:08.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:08.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:08.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 INFO: main: starting shard=0 2024-09-12T00:23:08.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:08.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:23:08.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f211dd169c0 20 INFO: main: done 2024-09-12T00:23:08.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.012+0000 7f1fd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:08.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.016+0000 7f211dd169c0 20 remove_watcher() i=0 2024-09-12T00:23:08.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.016+0000 7f211dd169c0 2 removed watcher, disabling cache 2024-09-12T00:23:08.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.020+0000 7f211dd169c0 20 remove_watcher() i=1 2024-09-12T00:23:08.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.020+0000 7f211dd169c0 20 remove_watcher() i=2 2024-09-12T00:23:08.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.024+0000 7f211dd169c0 20 remove_watcher() i=3 2024-09-12T00:23:08.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.024+0000 7f211dd169c0 20 remove_watcher() i=4 2024-09-12T00:23:08.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.028+0000 7f211dd169c0 20 remove_watcher() i=5 2024-09-12T00:23:08.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.032+0000 7f211dd169c0 20 remove_watcher() i=6 2024-09-12T00:23:08.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.032+0000 7f211dd169c0 20 remove_watcher() i=7 2024-09-12T00:23:08.052 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:23:08.081 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:08.082 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:08.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.124+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 realm 2024-09-12T00:23:08.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:08.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:08.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:08.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.128+0000 7f961f8699c0 20 searching for the correct realm 2024-09-12T00:23:08.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.136+0000 7f961db70640 0 -- 172.21.15.137:0/277322289 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f96140038e0 msgr2=0x7f9614136a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:08.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.140+0000 7f961d36f640 0 -- 172.21.15.137:0/277322289 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f9618089040 msgr2=0x7f961805bd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:08.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:08.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:08.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:08.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:08.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:08.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:08.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:08.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:08.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 zone default found 2024-09-12T00:23:08.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 4 Realm: () 2024-09-12T00:23:08.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:08.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:08.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:08.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 zonegroup default 2024-09-12T00:23:08.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.148+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.152+0000 7f961f8699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.152+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.152+0000 7f961f8699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.152+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.152+0000 7f961f8699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.152+0000 7f961f8699c0 20 started sync module instance, tier type = 2024-09-12T00:23:08.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.152+0000 7f961f8699c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:08.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.168+0000 7f961f8699c0 20 add_watcher() i=0 2024-09-12T00:23:08.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.168+0000 7f961f8699c0 20 add_watcher() i=1 2024-09-12T00:23:08.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.168+0000 7f961f8699c0 20 add_watcher() i=2 2024-09-12T00:23:08.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.168+0000 7f961f8699c0 20 add_watcher() i=3 2024-09-12T00:23:08.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.168+0000 7f961f8699c0 20 add_watcher() i=4 2024-09-12T00:23:08.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.168+0000 7f961f8699c0 20 add_watcher() i=5 2024-09-12T00:23:08.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.168+0000 7f961f8699c0 20 add_watcher() i=6 2024-09-12T00:23:08.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.172+0000 7f961f8699c0 20 add_watcher() i=7 2024-09-12T00:23:08.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.172+0000 7f961f8699c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:08.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f94d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:08.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f961f8699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:08.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f961f8699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:08.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f961f8699c0 5 note: GC not initialized 2024-09-12T00:23:08.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f94d27e4640 20 reqs_thread_entry: start 2024-09-12T00:23:08.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f961f8699c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:08.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f961f8699c0 20 Filter name: none 2024-09-12T00:23:08.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f9443fff640 20 reqs_thread_entry: start 2024-09-12T00:23:08.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f961f8699c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:08.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.176+0000 7f961f8699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.180+0000 7f961f8699c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:08.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.180+0000 7f961f8699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:08.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.180+0000 7f961f8699c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:08.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.180+0000 7f961f8699c0 20 INFO: main: starting shard=0 2024-09-12T00:23:08.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.180+0000 7f961f8699c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:08.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.180+0000 7f961f8699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:23:08.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.180+0000 7f961f8699c0 20 INFO: main: done 2024-09-12T00:23:08.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.180+0000 7f94d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:08.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.184+0000 7f961f8699c0 20 remove_watcher() i=0 2024-09-12T00:23:08.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.184+0000 7f961f8699c0 2 removed watcher, disabling cache 2024-09-12T00:23:08.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.188+0000 7f961f8699c0 20 remove_watcher() i=1 2024-09-12T00:23:08.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.188+0000 7f961f8699c0 20 remove_watcher() i=2 2024-09-12T00:23:08.191 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.192+0000 7f961f8699c0 20 remove_watcher() i=3 2024-09-12T00:23:08.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.192+0000 7f961f8699c0 20 remove_watcher() i=4 2024-09-12T00:23:08.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.196+0000 7f961f8699c0 20 remove_watcher() i=5 2024-09-12T00:23:08.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.196+0000 7f961f8699c0 20 remove_watcher() i=6 2024-09-12T00:23:08.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.200+0000 7f961f8699c0 20 remove_watcher() i=7 2024-09-12T00:23:08.214 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:23:08.214 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:08.215 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:23:08.243 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:08.243 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:08.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.284+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 realm 2024-09-12T00:23:08.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:08.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:08.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:08.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.288+0000 7f02f6e699c0 20 searching for the correct realm 2024-09-12T00:23:08.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.292+0000 7f02f416e640 0 -- 172.21.15.137:0/2837669154 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f02dc0ce920 msgr2=0x7f02dc0aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:08.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.300+0000 7f02f496f640 0 -- 172.21.15.137:0/2837669154 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f02e402b060 msgr2=0x7f02e4049680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:08.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:08.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:08.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:08.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:08.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:08.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:08.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:08.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:08.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 zone default found 2024-09-12T00:23:08.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 4 Realm: () 2024-09-12T00:23:08.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:08.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:08.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:08.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 zonegroup default 2024-09-12T00:23:08.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:08.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 started sync module instance, tier type = 2024-09-12T00:23:08.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.308+0000 7f02f6e699c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:08.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.328+0000 7f02f6e699c0 20 add_watcher() i=0 2024-09-12T00:23:08.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.328+0000 7f02f6e699c0 20 add_watcher() i=1 2024-09-12T00:23:08.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.328+0000 7f02f6e699c0 20 add_watcher() i=2 2024-09-12T00:23:08.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.328+0000 7f02f6e699c0 20 add_watcher() i=3 2024-09-12T00:23:08.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.328+0000 7f02f6e699c0 20 add_watcher() i=4 2024-09-12T00:23:08.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.328+0000 7f02f6e699c0 20 add_watcher() i=5 2024-09-12T00:23:08.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.328+0000 7f02f6e699c0 20 add_watcher() i=6 2024-09-12T00:23:08.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f02f6e699c0 20 add_watcher() i=7 2024-09-12T00:23:08.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f02f6e699c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:08.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f01aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:08.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f02f6e699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:08.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f02f6e699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:08.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f02f6e699c0 5 note: GC not initialized 2024-09-12T00:23:08.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f01a9fe3640 20 reqs_thread_entry: start 2024-09-12T00:23:08.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f02f6e699c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:08.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.332+0000 7f02f6e699c0 20 Filter name: none 2024-09-12T00:23:08.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f011b7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:08.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:08.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:08.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:08.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:08.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:08.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:08.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:08.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:08.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:08.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:08.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:08.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:08.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:08.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:23:08.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f02f6e699c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:23:08.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.336+0000 7f01aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:08.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.340+0000 7f02f6e699c0 20 remove_watcher() i=0 2024-09-12T00:23:08.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.340+0000 7f02f6e699c0 2 removed watcher, disabling cache 2024-09-12T00:23:08.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.344+0000 7f02f6e699c0 20 remove_watcher() i=1 2024-09-12T00:23:08.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.344+0000 7f02f6e699c0 20 remove_watcher() i=2 2024-09-12T00:23:08.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.348+0000 7f02f6e699c0 20 remove_watcher() i=3 2024-09-12T00:23:08.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.348+0000 7f02f6e699c0 20 remove_watcher() i=4 2024-09-12T00:23:08.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.352+0000 7f02f6e699c0 20 remove_watcher() i=5 2024-09-12T00:23:08.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.352+0000 7f02f6e699c0 20 remove_watcher() i=6 2024-09-12T00:23:08.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:08.356+0000 7f02f6e699c0 20 remove_watcher() i=7 2024-09-12T00:23:08.368 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:23:08.369 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:08.370 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.370 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.373 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.374 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.376 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.376 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.421 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:23:08.421 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:08.421 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.421 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.474 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.474 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.551 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.551 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.585 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.585 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.592 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.593 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.628 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.628 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.635 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.635 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.673 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.673 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.680 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.680 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.718 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.719 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.727 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.727 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.763 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.763 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.770 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.771 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.808 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:08.808 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:08.814 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:23:09.248 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:23:10.682 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:10.683 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:10.752 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:23:10.753 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:23:10.788 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:10.789 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:10.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.832+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.832+0000 7f79528619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:10.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.832+0000 7f79528619c0 20 realm 2024-09-12T00:23:10.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.832+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:10.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:10.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:10.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:10.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:10.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.836+0000 7f79528619c0 20 searching for the correct realm 2024-09-12T00:23:10.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.844+0000 7f794fb66640 0 -- 172.21.15.137:0/3639572219 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55831df30d80 msgr2=0x55831df33240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:10.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.848+0000 7f7950367640 0 -- 172.21.15.137:0/3639572219 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55831df35000 msgr2=0x55831df37410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:10.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:10.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:10.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:10.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:10.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:10.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:10.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:10.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:10.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:10.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 zone default found 2024-09-12T00:23:10.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 4 Realm: () 2024-09-12T00:23:10.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:10.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:10.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:10.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 zonegroup default 2024-09-12T00:23:10.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:10.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:10.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:10.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 started sync module instance, tier type = 2024-09-12T00:23:10.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.856+0000 7f79528619c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:10.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.876+0000 7f79528619c0 20 add_watcher() i=0 2024-09-12T00:23:10.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.876+0000 7f79528619c0 20 add_watcher() i=1 2024-09-12T00:23:10.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.876+0000 7f79528619c0 20 add_watcher() i=2 2024-09-12T00:23:10.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.876+0000 7f79528619c0 20 add_watcher() i=3 2024-09-12T00:23:10.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.876+0000 7f79528619c0 20 add_watcher() i=4 2024-09-12T00:23:10.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.876+0000 7f79528619c0 20 add_watcher() i=5 2024-09-12T00:23:10.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.876+0000 7f79528619c0 20 add_watcher() i=6 2024-09-12T00:23:10.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.880+0000 7f79528619c0 20 add_watcher() i=7 2024-09-12T00:23:10.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.880+0000 7f79528619c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:10.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.880+0000 7f7806fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:10.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:10.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:10.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 5 note: GC not initialized 2024-09-12T00:23:10.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f7805fdb640 20 reqs_thread_entry: start 2024-09-12T00:23:10.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:10.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 Filter name: none 2024-09-12T00:23:10.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f77777fe640 20 reqs_thread_entry: start 2024-09-12T00:23:10.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:10.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:10.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:10.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:10.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:10.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 INFO: main: starting shard=0 2024-09-12T00:23:10.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:10.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:23:10.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.884+0000 7f79528619c0 20 INFO: main: done 2024-09-12T00:23:10.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.888+0000 7f7806fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:10.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.888+0000 7f79528619c0 20 remove_watcher() i=0 2024-09-12T00:23:10.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.888+0000 7f79528619c0 2 removed watcher, disabling cache 2024-09-12T00:23:10.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.892+0000 7f79528619c0 20 remove_watcher() i=1 2024-09-12T00:23:10.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.892+0000 7f79528619c0 20 remove_watcher() i=2 2024-09-12T00:23:10.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.896+0000 7f79528619c0 20 remove_watcher() i=3 2024-09-12T00:23:10.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.896+0000 7f79528619c0 20 remove_watcher() i=4 2024-09-12T00:23:10.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.900+0000 7f79528619c0 20 remove_watcher() i=5 2024-09-12T00:23:10.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.904+0000 7f79528619c0 20 remove_watcher() i=6 2024-09-12T00:23:10.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:10.904+0000 7f79528619c0 20 remove_watcher() i=7 2024-09-12T00:23:10.920 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:10.921 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:10.923 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:10.924 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:10.983 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:23:10.984 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:23:11.017 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:11.017 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:11.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 20 realm 2024-09-12T00:23:11.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:11.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.056+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.060+0000 7f86218889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:11.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.060+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.060+0000 7f86218889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:11.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.060+0000 7f86218889c0 20 searching for the correct realm 2024-09-12T00:23:11.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.064+0000 7f861eb8d640 0 -- 172.21.15.137:0/2734585190 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f8614027040 msgr2=0x7f861406c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:11.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.068+0000 7f861fb8f640 0 -- 172.21.15.137:0/2734585190 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x56346d615d00 msgr2=0x56346d618150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:11.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:11.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:11.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:11.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:11.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:11.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:11.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 zone default found 2024-09-12T00:23:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 4 Realm: () 2024-09-12T00:23:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:11.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:11.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 zonegroup default 2024-09-12T00:23:11.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.076+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.080+0000 7f86218889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.080+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.080+0000 7f86218889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.080+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.080+0000 7f86218889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.080+0000 7f86218889c0 20 started sync module instance, tier type = 2024-09-12T00:23:11.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.080+0000 7f86218889c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.096+0000 7f86218889c0 20 add_watcher() i=0 2024-09-12T00:23:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.096+0000 7f86218889c0 20 add_watcher() i=1 2024-09-12T00:23:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.096+0000 7f86218889c0 20 add_watcher() i=2 2024-09-12T00:23:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.096+0000 7f86218889c0 20 add_watcher() i=3 2024-09-12T00:23:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.096+0000 7f86218889c0 20 add_watcher() i=4 2024-09-12T00:23:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.096+0000 7f86218889c0 20 add_watcher() i=5 2024-09-12T00:23:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.096+0000 7f86218889c0 20 add_watcher() i=6 2024-09-12T00:23:11.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.100+0000 7f86218889c0 20 add_watcher() i=7 2024-09-12T00:23:11.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.100+0000 7f86218889c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:11.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f84d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:11.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:11.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:11.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 5 note: GC not initialized 2024-09-12T00:23:11.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f84d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:23:11.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:11.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 Filter name: none 2024-09-12T00:23:11.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f844e7fc640 20 reqs_thread_entry: start 2024-09-12T00:23:11.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:11.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:11.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:11.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:11.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 INFO: main: starting shard=0 2024-09-12T00:23:11.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.104+0000 7f86218889c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:11.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.108+0000 7f86218889c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:23:11.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.108+0000 7f86218889c0 20 INFO: main: done 2024-09-12T00:23:11.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.108+0000 7f84d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:11.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.112+0000 7f86218889c0 20 remove_watcher() i=0 2024-09-12T00:23:11.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.112+0000 7f86218889c0 2 removed watcher, disabling cache 2024-09-12T00:23:11.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.112+0000 7f86218889c0 20 remove_watcher() i=1 2024-09-12T00:23:11.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.116+0000 7f86218889c0 20 remove_watcher() i=2 2024-09-12T00:23:11.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.116+0000 7f86218889c0 20 remove_watcher() i=3 2024-09-12T00:23:11.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.120+0000 7f86218889c0 20 remove_watcher() i=4 2024-09-12T00:23:11.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.120+0000 7f86218889c0 20 remove_watcher() i=5 2024-09-12T00:23:11.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.124+0000 7f86218889c0 20 remove_watcher() i=6 2024-09-12T00:23:11.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.128+0000 7f86218889c0 20 remove_watcher() i=7 2024-09-12T00:23:11.139 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:11.140 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:11.143 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:11.143 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:11.146 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:11.146 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:11.208 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:23:11.208 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:23:11.240 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:11.240 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:11.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 20 realm 2024-09-12T00:23:11.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:11.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.280+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.284+0000 7efd1fbf69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:11.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.284+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.284+0000 7efd1fbf69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:11.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.284+0000 7efd1fbf69c0 20 searching for the correct realm 2024-09-12T00:23:11.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.288+0000 7efd1cefb640 0 -- 172.21.15.137:0/3267738050 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7efd140817f0 msgr2=0x7efd1407cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:11.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.500+0000 7efd1cefb640 0 -- 172.21.15.137:0/3267738050 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55fb29659620 msgr2=0x55fb2965ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:11.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:11.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:11.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:11.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:11.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:11.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:11.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.512+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:11.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:11.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 zone default found 2024-09-12T00:23:11.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 4 Realm: () 2024-09-12T00:23:11.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:11.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:11.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:11.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 zonegroup default 2024-09-12T00:23:11.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 started sync module instance, tier type = 2024-09-12T00:23:11.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.516+0000 7efd1fbf69c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:11.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.540+0000 7efd1fbf69c0 20 add_watcher() i=0 2024-09-12T00:23:11.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.540+0000 7efd1fbf69c0 20 add_watcher() i=1 2024-09-12T00:23:11.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.540+0000 7efd1fbf69c0 20 add_watcher() i=2 2024-09-12T00:23:11.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.540+0000 7efd1fbf69c0 20 add_watcher() i=3 2024-09-12T00:23:11.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.540+0000 7efd1fbf69c0 20 add_watcher() i=4 2024-09-12T00:23:11.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.540+0000 7efd1fbf69c0 20 add_watcher() i=5 2024-09-12T00:23:11.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.540+0000 7efd1fbf69c0 20 add_watcher() i=6 2024-09-12T00:23:11.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.544+0000 7efd1fbf69c0 20 add_watcher() i=7 2024-09-12T00:23:11.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.544+0000 7efd1fbf69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:11.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.548+0000 7efbd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:11.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.548+0000 7efd1fbf69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:11.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.548+0000 7efd1fbf69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:11.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.548+0000 7efd1fbf69c0 5 note: GC not initialized 2024-09-12T00:23:11.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.548+0000 7efbd27e4640 20 reqs_thread_entry: start 2024-09-12T00:23:11.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.548+0000 7efd1fbf69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:11.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 Filter name: none 2024-09-12T00:23:11.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efb43fff640 20 reqs_thread_entry: start 2024-09-12T00:23:11.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:11.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:11.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:11.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:11.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 INFO: main: starting shard=0 2024-09-12T00:23:11.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:11.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:23:11.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.552+0000 7efd1fbf69c0 20 INFO: main: done 2024-09-12T00:23:11.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.556+0000 7efbd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:11.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.560+0000 7efd1fbf69c0 20 remove_watcher() i=0 2024-09-12T00:23:11.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.560+0000 7efd1fbf69c0 2 removed watcher, disabling cache 2024-09-12T00:23:11.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.560+0000 7efd1fbf69c0 20 remove_watcher() i=1 2024-09-12T00:23:11.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.564+0000 7efd1fbf69c0 20 remove_watcher() i=2 2024-09-12T00:23:11.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.564+0000 7efd1fbf69c0 20 remove_watcher() i=3 2024-09-12T00:23:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.568+0000 7efd1fbf69c0 20 remove_watcher() i=4 2024-09-12T00:23:11.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.572+0000 7efd1fbf69c0 20 remove_watcher() i=5 2024-09-12T00:23:11.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.572+0000 7efd1fbf69c0 20 remove_watcher() i=6 2024-09-12T00:23:11.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.576+0000 7efd1fbf69c0 20 remove_watcher() i=7 2024-09-12T00:23:11.603 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:11.603 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:11.607 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:11.607 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:11.672 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:23:11.672 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:23:11.709 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:11.709 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:11.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.752+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.756+0000 7fa6f45f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.756+0000 7fa6f45f89c0 20 realm 2024-09-12T00:23:11.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.756+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.756+0000 7fa6f45f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.756+0000 7fa6f45f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:11.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.756+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.756+0000 7fa6f45f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.756+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.760+0000 7fa6f45f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:11.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.760+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.760+0000 7fa6f45f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:11.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.760+0000 7fa6f45f89c0 20 searching for the correct realm 2024-09-12T00:23:11.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.764+0000 7fa6f28ff640 0 -- 172.21.15.137:0/1543358214 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fa6dc019040 msgr2=0x7fa6dc034460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:11.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.772+0000 7fa6f20fe640 0 -- 172.21.15.137:0/1543358214 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fa6ec086b70 msgr2=0x7fa6ec0855e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:11.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:11.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:11.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:11.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:11.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:11.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:11.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.776+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:11.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 zone default found 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 4 Realm: () 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 zonegroup default 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:11.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 started sync module instance, tier type = 2024-09-12T00:23:11.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.780+0000 7fa6f45f89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:11.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 20 add_watcher() i=0 2024-09-12T00:23:11.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 20 add_watcher() i=1 2024-09-12T00:23:11.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 20 add_watcher() i=2 2024-09-12T00:23:11.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 20 add_watcher() i=3 2024-09-12T00:23:11.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 20 add_watcher() i=4 2024-09-12T00:23:11.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 20 add_watcher() i=5 2024-09-12T00:23:11.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 20 add_watcher() i=6 2024-09-12T00:23:11.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 20 add_watcher() i=7 2024-09-12T00:23:11.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.800+0000 7fa6f45f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:11.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa5a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:11.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa6f45f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:11.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa6f45f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:11.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa6f45f89c0 5 note: GC not initialized 2024-09-12T00:23:11.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa5237fe640 20 reqs_thread_entry: start 2024-09-12T00:23:11.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa6f45f89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:11.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa6f45f89c0 20 Filter name: none 2024-09-12T00:23:11.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa5217fa640 20 reqs_thread_entry: start 2024-09-12T00:23:11.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.804+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:11.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:11.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:11.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:11.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:23:11.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 INFO: main: starting shard=0 2024-09-12T00:23:11.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:11.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:23:11.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa6f45f89c0 20 INFO: main: done 2024-09-12T00:23:11.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.808+0000 7fa5a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:11.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.816+0000 7fa6f45f89c0 20 remove_watcher() i=0 2024-09-12T00:23:11.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.816+0000 7fa6f45f89c0 2 removed watcher, disabling cache 2024-09-12T00:23:11.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.816+0000 7fa6f45f89c0 20 remove_watcher() i=1 2024-09-12T00:23:11.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.816+0000 7fa6f45f89c0 20 remove_watcher() i=2 2024-09-12T00:23:11.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.820+0000 7fa6f45f89c0 20 remove_watcher() i=3 2024-09-12T00:23:11.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.820+0000 7fa6f45f89c0 20 remove_watcher() i=4 2024-09-12T00:23:11.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.824+0000 7fa6f45f89c0 20 remove_watcher() i=5 2024-09-12T00:23:11.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.828+0000 7fa6f45f89c0 20 remove_watcher() i=6 2024-09-12T00:23:11.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:11.832+0000 7fa6f45f89c0 20 remove_watcher() i=7 2024-09-12T00:23:11.848 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:11.848 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:11.852 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:23:12.279 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:23:12.703 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:23:12.732 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:12.733 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:12.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.768+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 realm 2024-09-12T00:23:12.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:12.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:12.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:12.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.772+0000 7fe5d11489c0 20 searching for the correct realm 2024-09-12T00:23:12.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.780+0000 7fe5cec4e640 0 -- 172.21.15.137:0/1844437525 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fe5c00c1070 msgr2=0x7fe5c012c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:12.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.784+0000 7fe5cec4e640 0 -- 172.21.15.137:0/1844437525 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5625fee55f50 msgr2=0x5625fee58380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:12.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:12.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:12.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:12.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:12.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:12.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:12.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:12.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:12.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 zone default found 2024-09-12T00:23:12.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 4 Realm: () 2024-09-12T00:23:12.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:12.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:12.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:12.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 zonegroup default 2024-09-12T00:23:12.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.792+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.796+0000 7fe5d11489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.796+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.796+0000 7fe5d11489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.796+0000 7fe5d11489c0 20 started sync module instance, tier type = 2024-09-12T00:23:12.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.796+0000 7fe5d11489c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:12.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.812+0000 7fe5d11489c0 20 add_watcher() i=0 2024-09-12T00:23:12.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.812+0000 7fe5d11489c0 20 add_watcher() i=1 2024-09-12T00:23:12.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.812+0000 7fe5d11489c0 20 add_watcher() i=2 2024-09-12T00:23:12.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.812+0000 7fe5d11489c0 20 add_watcher() i=3 2024-09-12T00:23:12.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.812+0000 7fe5d11489c0 20 add_watcher() i=4 2024-09-12T00:23:12.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.812+0000 7fe5d11489c0 20 add_watcher() i=5 2024-09-12T00:23:12.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.812+0000 7fe5d11489c0 20 add_watcher() i=6 2024-09-12T00:23:12.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.816+0000 7fe5d11489c0 20 add_watcher() i=7 2024-09-12T00:23:12.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.816+0000 7fe5d11489c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:12.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe4857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:12.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:12.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:12.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 5 note: GC not initialized 2024-09-12T00:23:12.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe3fffff640 20 reqs_thread_entry: start 2024-09-12T00:23:12.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:12.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 Filter name: none 2024-09-12T00:23:12.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe3fdffb640 20 reqs_thread_entry: start 2024-09-12T00:23:12.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:12.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:12.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.820+0000 7fe5d11489c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:12.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.828+0000 7fe4857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:12.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.832+0000 7fe5d11489c0 20 remove_watcher() i=0 2024-09-12T00:23:12.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.832+0000 7fe5d11489c0 2 removed watcher, disabling cache 2024-09-12T00:23:12.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.836+0000 7fe5d11489c0 20 remove_watcher() i=1 2024-09-12T00:23:12.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.836+0000 7fe5d11489c0 20 remove_watcher() i=2 2024-09-12T00:23:12.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.840+0000 7fe5d11489c0 20 remove_watcher() i=3 2024-09-12T00:23:12.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.840+0000 7fe5d11489c0 20 remove_watcher() i=4 2024-09-12T00:23:12.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.844+0000 7fe5d11489c0 20 remove_watcher() i=5 2024-09-12T00:23:12.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.844+0000 7fe5d11489c0 20 remove_watcher() i=6 2024-09-12T00:23:12.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.848+0000 7fe5d11489c0 20 remove_watcher() i=7 2024-09-12T00:23:12.859 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:23:12.889 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:12.889 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:12.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 20 realm 2024-09-12T00:23:12.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:12.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.928+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.932+0000 7f7ffb8839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:12.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.932+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.932+0000 7f7ffb8839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:12.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.932+0000 7f7ffb8839c0 20 searching for the correct realm 2024-09-12T00:23:12.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.936+0000 7f7ff0b88640 0 -- 172.21.15.137:0/2260871986 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f7fe4089230 msgr2=0x7f7fe407d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:12.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.940+0000 7f7ff9b8a640 0 -- 172.21.15.137:0/2260871986 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55c1ffd96280 msgr2=0x55c1ffd98720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:12.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:12.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:12.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:12.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:12.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:12.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:12.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:12.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:12.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 zone default found 2024-09-12T00:23:12.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 4 Realm: () 2024-09-12T00:23:12.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:12.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:12.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:12.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 zonegroup default 2024-09-12T00:23:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.948+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.952+0000 7f7ffb8839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.952+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.952+0000 7f7ffb8839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.952+0000 7f7ffb8839c0 20 started sync module instance, tier type = 2024-09-12T00:23:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.952+0000 7f7ffb8839c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:12.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.968+0000 7f7ffb8839c0 20 add_watcher() i=0 2024-09-12T00:23:12.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.968+0000 7f7ffb8839c0 20 add_watcher() i=1 2024-09-12T00:23:12.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.968+0000 7f7ffb8839c0 20 add_watcher() i=2 2024-09-12T00:23:12.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.968+0000 7f7ffb8839c0 20 add_watcher() i=3 2024-09-12T00:23:12.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.968+0000 7f7ffb8839c0 20 add_watcher() i=4 2024-09-12T00:23:12.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.968+0000 7f7ffb8839c0 20 add_watcher() i=5 2024-09-12T00:23:12.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.968+0000 7f7ffb8839c0 20 add_watcher() i=6 2024-09-12T00:23:12.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.972+0000 7f7ffb8839c0 20 add_watcher() i=7 2024-09-12T00:23:12.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.972+0000 7f7ffb8839c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:12.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7eaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:12.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:12.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:12.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 5 note: GC not initialized 2024-09-12T00:23:12.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7eae7e4640 20 reqs_thread_entry: start 2024-09-12T00:23:12.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:12.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 Filter name: none 2024-09-12T00:23:12.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7e1ffff640 20 reqs_thread_entry: start 2024-09-12T00:23:12.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:23:12.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:12.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:23:12.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:23:12.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 : miss 2024-09-12T00:23:12.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:12.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:12.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 info.flags=0x17 2024-09-12T00:23:12.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 to cache LRU end 2024-09-12T00:23:12.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:12.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:23:12.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1 2024-09-12T00:23:12.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.976+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:12.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.980+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:12.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.980+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:c state=0x55c1ffdd4c48 s->prefetch_data=0 2024-09-12T00:23:12.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.980+0000 7f7ffb8839c0 20 get_obj_state: setting s->obj_tag to we1fb16byqjrjeydvv21uesp7dz03v6h 2024-09-12T00:23:12.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.980+0000 7f7ffb8839c0 20 get_obj_state_impl: setting s->olh_tag to g0jeyd030qqgya6s715td9p266lqd7i0 2024-09-12T00:23:12.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.980+0000 7f7ffb8839c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g0jeyd030qqgya6s715td9p266lqd7i0 2024-09-12T00:23:12.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.984+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:12.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.988+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:12.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.988+0000 7f7ffb8839c0 20 olh_log_entry: epoch=3 op=3 key=c[SFr5dNPYG7hUsRuzH2XuSeOCxzqvZ3m] 2024-09-12T00:23:12.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.988+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:_:SFr5dNPYG7hUsRuzH2XuSeOCxzqvZ3m_c state=0x55c1ffdcfbc8 s->prefetch_data=0 2024-09-12T00:23:12.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.988+0000 7f7ffb8839c0 10 manifest: total_size = 22 2024-09-12T00:23:12.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.988+0000 7f7ffb8839c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14061935441531940563 2024-09-12T00:23:12.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.988+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:_:SFr5dNPYG7hUsRuzH2XuSeOCxzqvZ3m_c state=0x55c1ffdcfbc8 s->prefetch_data=0 2024-09-12T00:23:12.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.988+0000 7f7ffb8839c0 20 prepare_atomic_modification: state is not atomic. state=0x55c1ffdcfbc8 2024-09-12T00:23:12.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.988+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:12.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.992+0000 7f7ffb8839c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:12.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.992+0000 7f7ffb8839c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:23:12.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.992+0000 7f7ffb8839c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:23:12.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.992+0000 7f7ffb8839c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1__shadow:SFr5dNPYG7hUsRuzH2XuSeOCxzqvZ3m_.22kBmXuEzlHxcpkw7Yw3mTwIzMvgfxF_0 2024-09-12T00:23:12.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:12.996+0000 7f7ffb8839c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:23:13.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.000+0000 7f7ecbfff640 20 handle_completion(): completion ok for obj=c[SFr5dNPYG7hUsRuzH2XuSeOCxzqvZ3m] 2024-09-12T00:23:13.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.000+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.000+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.004+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.004+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.004+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:d state=0x55c1ffdd1fe8 s->prefetch_data=0 2024-09-12T00:23:13.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.008+0000 7f7ffb8839c0 20 get_obj_state: setting s->obj_tag to aauexmhpz7bntxpxawjelw5ie3a1lexo 2024-09-12T00:23:13.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.008+0000 7f7ffb8839c0 20 get_obj_state_impl: setting s->olh_tag to y8lgdry9cyc5i97wq2c9ofk4zhq7o8t6 2024-09-12T00:23:13.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.008+0000 7f7ffb8839c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y8lgdry9cyc5i97wq2c9ofk4zhq7o8t6 2024-09-12T00:23:13.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.008+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.012+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.012+0000 7f7ffb8839c0 20 olh_log_entry: epoch=3 op=3 key=d[x1l76hO8elS9yUeLncupgfa7BZCB2m3] 2024-09-12T00:23:13.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.012+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:_:x1l76hO8elS9yUeLncupgfa7BZCB2m3_d state=0x55c1ffdd5c58 s->prefetch_data=0 2024-09-12T00:23:13.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.016+0000 7f7ffb8839c0 10 manifest: total_size = 22 2024-09-12T00:23:13.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.016+0000 7f7ffb8839c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9121706468425544132 2024-09-12T00:23:13.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.016+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:_:x1l76hO8elS9yUeLncupgfa7BZCB2m3_d state=0x55c1ffdd5c58 s->prefetch_data=0 2024-09-12T00:23:13.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.016+0000 7f7ffb8839c0 20 prepare_atomic_modification: state is not atomic. state=0x55c1ffdd5c58 2024-09-12T00:23:13.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.016+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.020+0000 7f7ffb8839c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:13.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.020+0000 7f7ffb8839c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:23:13.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.020+0000 7f7ffb8839c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:23:13.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.020+0000 7f7ffb8839c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1__shadow:x1l76hO8elS9yUeLncupgfa7BZCB2m3_.kc7B4i6W3Fty3Twp4UKNCjH2wt133e0_0 2024-09-12T00:23:13.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.024+0000 7f7edcff9640 20 handle_completion(): completion ok for obj=d[x1l76hO8elS9yUeLncupgfa7BZCB2m3] 2024-09-12T00:23:13.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.024+0000 7f7ffb8839c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:23:13.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.028+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.028+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.032+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.036+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.036+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:e state=0x55c1ffdd1f18 s->prefetch_data=0 2024-09-12T00:23:13.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.036+0000 7f7ffb8839c0 20 get_obj_state: setting s->obj_tag to rzwzykat89evpzi31vdeed6a4wxsc6ej 2024-09-12T00:23:13.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.036+0000 7f7ffb8839c0 20 get_obj_state_impl: setting s->olh_tag to o4ddrgqft9r06kbdtb537oaf4wkbqrim 2024-09-12T00:23:13.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.036+0000 7f7ffb8839c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o4ddrgqft9r06kbdtb537oaf4wkbqrim 2024-09-12T00:23:13.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.040+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:23:13.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 20 olh_log_entry: epoch=2 op=3 key=e[hCc7z3.t4sGKa8TI1y46d-U.3Q-Udva] 2024-09-12T00:23:13.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:_:hCc7z3.t4sGKa8TI1y46d-U.3Q-Udva_e state=0x55c1ffdd5c58 s->prefetch_data=0 2024-09-12T00:23:13.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 10 manifest: total_size = 9 2024-09-12T00:23:13.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9669984409679485069 2024-09-12T00:23:13.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:_:hCc7z3.t4sGKa8TI1y46d-U.3Q-Udva_e state=0x55c1ffdd5c58 s->prefetch_data=0 2024-09-12T00:23:13.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 20 prepare_atomic_modification: state is not atomic. state=0x55c1ffdd5c58 2024-09-12T00:23:13.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.044+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.052+0000 7f7ffb8839c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.052+0000 7f7ffb8839c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:23:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.052+0000 7f7ffb8839c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:23:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.052+0000 7f7ffb8839c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1__shadow:hCc7z3.t4sGKa8TI1y46d-U.3Q-Udva_.ihIz9Djs1au5GJyifTp4Jf5FfEfL_kn_0 2024-09-12T00:23:13.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.052+0000 7f7ffb8839c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:23:13.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.056+0000 7f7ecbfff640 20 handle_completion(): completion ok for obj=e[hCc7z3.t4sGKa8TI1y46d-U.3Q-Udva] 2024-09-12T00:23:13.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.056+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:e state=0x55c1ffdd1f18 s->prefetch_data=0 2024-09-12T00:23:13.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.056+0000 7f7ffb8839c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o4ddrgqft9r06kbdtb537oaf4wkbqrim 2024-09-12T00:23:13.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.064+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.068+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.068+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.072+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:f state=0x55c1ffdd1f18 s->prefetch_data=0 2024-09-12T00:23:13.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.072+0000 7f7ffb8839c0 20 get_obj_state: setting s->obj_tag to oefppeajqpr18gkqcst6x727azan6gyf 2024-09-12T00:23:13.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.072+0000 7f7ffb8839c0 20 get_obj_state_impl: setting s->olh_tag to a8gxa3390s0ujo6meqzlmbgneqdcgnvm 2024-09-12T00:23:13.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.072+0000 7f7ffb8839c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=a8gxa3390s0ujo6meqzlmbgneqdcgnvm 2024-09-12T00:23:13.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.076+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:23:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 20 olh_log_entry: epoch=2 op=3 key=f[VjLopzVZu4XtK8uhVsNFy9NFZs90BXO] 2024-09-12T00:23:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:_:VjLopzVZu4XtK8uhVsNFy9NFZs90BXO_f state=0x55c1ffdd5c58 s->prefetch_data=0 2024-09-12T00:23:13.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 10 manifest: total_size = 12 2024-09-12T00:23:13.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14714870449411451024 2024-09-12T00:23:13.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:_:VjLopzVZu4XtK8uhVsNFy9NFZs90BXO_f state=0x55c1ffdd5c58 s->prefetch_data=0 2024-09-12T00:23:13.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 20 prepare_atomic_modification: state is not atomic. state=0x55c1ffdd5c58 2024-09-12T00:23:13.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.080+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.088+0000 7f7ffb8839c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:13.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.088+0000 7f7ffb8839c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:23:13.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.088+0000 7f7ffb8839c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:23:13.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.088+0000 7f7ffb8839c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1__shadow:VjLopzVZu4XtK8uhVsNFy9NFZs90BXO_.w0gZ2N480wX4Fr5lfd3T5vU4uGfUl5n_0 2024-09-12T00:23:13.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.092+0000 7f7ffb8839c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:23:13.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.092+0000 7f7ecbfff640 20 handle_completion(): completion ok for obj=f[VjLopzVZu4XtK8uhVsNFy9NFZs90BXO] 2024-09-12T00:23:13.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.092+0000 7f7ffb8839c0 20 get_obj_state: octx=0x55c1ffb29740 obj=check-bucket:f state=0x55c1ffdd1f18 s->prefetch_data=0 2024-09-12T00:23:13.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.092+0000 7f7ffb8839c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=a8gxa3390s0ujo6meqzlmbgneqdcgnvm 2024-09-12T00:23:13.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.104+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.104+0000 7f7ffb8839c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1.0 2024-09-12T00:23:13.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.104+0000 7f7ffb8839c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:23:13.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.104+0000 7f7ffb8839c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:23:13.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.108+0000 7f7eaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:13.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.112+0000 7f7ffb8839c0 20 remove_watcher() i=0 2024-09-12T00:23:13.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.112+0000 7f7ffb8839c0 2 removed watcher, disabling cache 2024-09-12T00:23:13.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.116+0000 7f7ffb8839c0 20 remove_watcher() i=1 2024-09-12T00:23:13.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.116+0000 7f7ffb8839c0 20 remove_watcher() i=2 2024-09-12T00:23:13.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.120+0000 7f7ffb8839c0 20 remove_watcher() i=3 2024-09-12T00:23:13.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.124+0000 7f7ffb8839c0 20 remove_watcher() i=4 2024-09-12T00:23:13.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.124+0000 7f7ffb8839c0 20 remove_watcher() i=5 2024-09-12T00:23:13.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.128+0000 7f7ffb8839c0 20 remove_watcher() i=6 2024-09-12T00:23:13.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.132+0000 7f7ffb8839c0 20 remove_watcher() i=7 2024-09-12T00:23:13.154 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:13.155 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:13.162 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:13.162 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:13.253 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:23:13.286 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:13.286 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:13.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.532+0000 7ffa90cfc640 0 --2- 172.21.15.137:0/3957560521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55ae89cf0860 0x55ae89d2e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:23:13.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.536+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.536+0000 7ffa931f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:13.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.536+0000 7ffa931f69c0 20 realm 2024-09-12T00:23:13.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.536+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:13.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:13.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:13.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:13.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:13.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.540+0000 7ffa931f69c0 20 searching for the correct realm 2024-09-12T00:23:13.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.544+0000 7ffa90cfc640 0 -- 172.21.15.137:0/3957560521 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7ffa80038030 msgr2=0x7ffa80045440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:13.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.756+0000 7ffa90cfc640 0 -- 172.21.15.137:0/3957560521 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7ffa88020040 msgr2=0x7ffa8802e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:13.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:13.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:23:13.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:13.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:23:13.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:13.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:13.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:13.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:13.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.976+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:13.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 zone default found 2024-09-12T00:23:13.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 4 Realm: () 2024-09-12T00:23:13.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:23:13.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:23:13.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:13.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 zonegroup default 2024-09-12T00:23:13.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:13.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:13.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:13.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:13.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 started sync module instance, tier type = 2024-09-12T00:23:13.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:13.980+0000 7ffa931f69c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:23:14.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.004+0000 7ffa931f69c0 20 add_watcher() i=0 2024-09-12T00:23:14.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.004+0000 7ffa931f69c0 20 add_watcher() i=1 2024-09-12T00:23:14.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.004+0000 7ffa931f69c0 20 add_watcher() i=2 2024-09-12T00:23:14.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.004+0000 7ffa931f69c0 20 add_watcher() i=3 2024-09-12T00:23:14.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.004+0000 7ffa931f69c0 20 add_watcher() i=4 2024-09-12T00:23:14.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.004+0000 7ffa931f69c0 20 add_watcher() i=5 2024-09-12T00:23:14.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.004+0000 7ffa931f69c0 20 add_watcher() i=6 2024-09-12T00:23:14.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.008+0000 7ffa931f69c0 20 add_watcher() i=7 2024-09-12T00:23:14.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.008+0000 7ffa931f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:14.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ff9477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:14.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ffa931f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:14.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ffa931f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:14.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ffa931f69c0 5 note: GC not initialized 2024-09-12T00:23:14.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ff9467e4640 20 reqs_thread_entry: start 2024-09-12T00:23:14.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ffa931f69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:23:14.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ffa931f69c0 20 Filter name: none 2024-09-12T00:23:14.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ff93f7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:14.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.012+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:14.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.016+0000 7ffa931f69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:14.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.016+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:14.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.016+0000 7ffa931f69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:14.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.016+0000 7ffa931f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:14.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.016+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:14.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.016+0000 7ffa931f69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:23:14.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.016+0000 7ffa931f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:23:14.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.020+0000 7ffa931f69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:23:14.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.020+0000 7ffa931f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:14.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.020+0000 7ff9477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:14.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.024+0000 7ffa931f69c0 20 remove_watcher() i=0 2024-09-12T00:23:14.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.024+0000 7ffa931f69c0 2 removed watcher, disabling cache 2024-09-12T00:23:14.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.028+0000 7ffa931f69c0 20 remove_watcher() i=1 2024-09-12T00:23:14.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.028+0000 7ffa931f69c0 20 remove_watcher() i=2 2024-09-12T00:23:14.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.032+0000 7ffa931f69c0 20 remove_watcher() i=3 2024-09-12T00:23:14.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.032+0000 7ffa931f69c0 20 remove_watcher() i=4 2024-09-12T00:23:14.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.036+0000 7ffa931f69c0 20 remove_watcher() i=5 2024-09-12T00:23:14.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.040+0000 7ffa931f69c0 20 remove_watcher() i=6 2024-09-12T00:23:14.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:23:14.040+0000 7ffa931f69c0 20 remove_watcher() i=7 2024-09-12T00:23:14.057 INFO:tasks.workunit.client.0.smithi137.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:23:14.057 INFO:tasks.workunit.client.0.smithi137.stderr:Deleting bucket check-bucket 2024-09-12T00:23:14.059 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:14.059 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:14.063 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:23:14.064 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:23:14.092 INFO:tasks.workunit.client.0.smithi137.stderr:Completed bucket check tests 2024-09-12T00:23:14.092 INFO:tasks.workunit.client.0.smithi137.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:23:14.093 INFO:tasks.workunit.client.0.smithi137.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:23:14.093 INFO:tasks.workunit.client.0.smithi137.stdout:connected to https://localhost:443 2024-09-12T00:23:14.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ deactivate 2024-09-12T00:23:14.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:23:14.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:23:14.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ export PATH 2024-09-12T00:23:14.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:23:14.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n '' ']' 2024-09-12T00:23:14.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:23:14.177 INFO:tasks.workunit.client.0.smithi137.stderr:+ hash -r 2024-09-12T00:23:14.177 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n '' ']' 2024-09-12T00:23:14.177 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:23:14.177 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:23:14.177 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:23:14.177 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset -f deactivate 2024-09-12T00:23:14.177 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo OK. 2024-09-12T00:23:14.179 INFO:tasks.workunit.client.0.smithi137.stdout:OK. 2024-09-12T00:23:14.179 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:23:14.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:23:14.236 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:23:14.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:23:14.639 DEBUG:teuthology.parallel:result is None 2024-09-12T00:23:14.640 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:23:14.652 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:23:14.652 DEBUG:teuthology.orchestra.run.smithi137:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:23:14.808 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:23:14.809 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:23:14.818 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:23:14.818 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:23:14.818 DEBUG:teuthology.orchestra.run.smithi137:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:23:14.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:23:14.824 INFO:teuthology.orchestra.run.smithi137.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:23:14.825 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:23:14.872 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:23:14.872 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:23:14.920 INFO:tasks.workunit:timeout=3h 2024-09-12T00:23:14.920 INFO:tasks.workunit:cleanup=True 2024-09-12T00:23:14.921 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:23:14.970 INFO:tasks.workunit.client.0.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:23:57.411 INFO:tasks.workunit.client.0.smithi137.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi137.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi137.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi137.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi137.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi137.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi137.stderr: git switch -c 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi137.stderr:Or undo this operation with: 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi137.stderr: git switch - 2024-09-12T00:23:57.414 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:57.414 INFO:tasks.workunit.client.0.smithi137.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:23:57.414 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:23:57.414 INFO:tasks.workunit.client.0.smithi137.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:23:57.418 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:23:57.464 INFO:tasks.workunit.client.0.smithi137.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:23:57.468 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:23:57.468 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:23:57.519 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:23:57.575 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:23:57.617 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:23:57.618 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:23:57.618 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:23:57.666 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:23:57.669 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:23:57.669 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:23:57.722 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:23:57.725 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:23:57.726 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:23:57.784 INFO:tasks.workunit.client.0.smithi137.stdout:Running main() from gmock_main.cc 2024-09-12T00:23:57.784 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:23:57.784 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:23:57.784 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:23:57.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:23:59.625 INFO:tasks.workunit.client.0.smithi137.stdout:lock: mylock 2024-09-12T00:23:59.625 INFO:tasks.workunit.client.0.smithi137.stdout: lock_type: exclusive 2024-09-12T00:23:59.625 INFO:tasks.workunit.client.0.smithi137.stdout: tag: 2024-09-12T00:23:59.626 INFO:tasks.workunit.client.0.smithi137.stdout: lockers: 2024-09-12T00:23:59.626 INFO:tasks.workunit.client.0.smithi137.stdout: client.5033 expiration=2024-09-12T00:25:59.620326+0000 addr=v1:172.21.15.137:0/860858384 cookie= 2024-09-12T00:23:59.632 INFO:tasks.workunit.client.0.smithi137.stdout:lock: mylock 2024-09-12T00:23:59.632 INFO:tasks.workunit.client.0.smithi137.stdout: lock_type: shared 2024-09-12T00:23:59.632 INFO:tasks.workunit.client.0.smithi137.stdout: tag: 2024-09-12T00:23:59.633 INFO:tasks.workunit.client.0.smithi137.stdout: lockers: 2024-09-12T00:23:59.633 INFO:tasks.workunit.client.0.smithi137.stdout: client.5033 expiration=2024-09-12T00:25:59.632839+0000 addr=v1:172.21.15.137:0/860858384 cookie= 2024-09-12T00:23:59.633 INFO:tasks.workunit.client.0.smithi137.stdout: client.5039 expiration=0.000000 addr=v1:172.21.15.137:0/3537930345 cookie= 2024-09-12T00:23:59.634 INFO:tasks.workunit.client.0.smithi137.stdout:lock: mylock 2024-09-12T00:23:59.634 INFO:tasks.workunit.client.0.smithi137.stdout: lock_type: shared 2024-09-12T00:23:59.635 INFO:tasks.workunit.client.0.smithi137.stdout: tag: 2024-09-12T00:23:59.635 INFO:tasks.workunit.client.0.smithi137.stdout: lockers: 2024-09-12T00:23:59.635 INFO:tasks.workunit.client.0.smithi137.stdout: client.5039 expiration=0.000000 addr=v1:172.21.15.137:0/3537930345 cookie= 2024-09-12T00:24:00.573 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestMultiLocking (2789 ms) 2024-09-12T00:24:00.573 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:24:02.882 INFO:tasks.workunit.client.0.smithi137.stdout:lock: mylock 2024-09-12T00:24:02.882 INFO:tasks.workunit.client.0.smithi137.stdout: lock_type: shared 2024-09-12T00:24:02.883 INFO:tasks.workunit.client.0.smithi137.stdout: tag: 2024-09-12T00:24:02.883 INFO:tasks.workunit.client.0.smithi137.stdout: lockers: 2024-09-12T00:24:02.883 INFO:tasks.workunit.client.0.smithi137.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.137:0/2743700931 cookie= 2024-09-12T00:24:02.887 INFO:tasks.workunit.client.0.smithi137.stdout:lock: mylock 2024-09-12T00:24:02.887 INFO:tasks.workunit.client.0.smithi137.stdout: lock_type: exclusive 2024-09-12T00:24:02.887 INFO:tasks.workunit.client.0.smithi137.stdout: tag: new_tag 2024-09-12T00:24:02.887 INFO:tasks.workunit.client.0.smithi137.stdout: lockers: 2024-09-12T00:24:02.887 INFO:tasks.workunit.client.0.smithi137.stdout: client.5193 expiration=0.000000 addr=v1:172.21.15.137:0/3972619352 cookie= 2024-09-12T00:24:03.619 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestMeta (3044 ms) 2024-09-12T00:24:03.620 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:24:05.650 INFO:tasks.workunit.client.0.smithi137.stdout:lock: mylock 2024-09-12T00:24:05.650 INFO:tasks.workunit.client.0.smithi137.stdout: lock_type: exclusive 2024-09-12T00:24:05.650 INFO:tasks.workunit.client.0.smithi137.stdout: tag: 2024-09-12T00:24:05.651 INFO:tasks.workunit.client.0.smithi137.stdout: lockers: 2024-09-12T00:24:05.654 INFO:tasks.workunit.client.0.smithi137.stdout:lock: mylock 2024-09-12T00:24:05.655 INFO:tasks.workunit.client.0.smithi137.stdout: lock_type: shared 2024-09-12T00:24:05.655 INFO:tasks.workunit.client.0.smithi137.stdout: tag: 2024-09-12T00:24:05.655 INFO:tasks.workunit.client.0.smithi137.stdout: lockers: 2024-09-12T00:24:05.655 INFO:tasks.workunit.client.0.smithi137.stdout: client.5054 expiration=0.000000 addr=v1:172.21.15.137:0/2555059074 cookie= 2024-09-12T00:24:05.655 INFO:tasks.workunit.client.0.smithi137.stdout: client.5054 expiration=0.000000 addr=v1:172.21.15.137:0/2555059074 cookie=new cookie 2024-09-12T00:24:06.649 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestCookie (3031 ms) 2024-09-12T00:24:06.649 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:24:09.671 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestMultipleLocks (3023 ms) 2024-09-12T00:24:09.672 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:24:16.861 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestLockDuration (7186 ms) 2024-09-12T00:24:16.861 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:24:19.911 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestAssertLocked (3053 ms) 2024-09-12T00:24:19.911 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:24:22.905 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestSetCookie (2994 ms) 2024-09-12T00:24:22.905 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:24:43.564 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestRenew (20656 ms) 2024-09-12T00:24:43.565 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:24:50.547 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6987 ms) 2024-09-12T00:24:50.547 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:24:58.571 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8024 ms) 2024-09-12T00:24:58.571 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:25:06.643 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8071 ms) 2024-09-12T00:25:06.643 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 11 tests from ClsLock (68859 ms total) 2024-09-12T00:25:06.643 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:25:06.643 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:06.643 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 11 tests from 1 test suite ran. (68859 ms total) 2024-09-12T00:25:06.643 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 11 tests. 2024-09-12T00:25:06.648 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:25:06.648 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:25:06.705 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:25:06.706 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:25:06.706 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:25:06.770 INFO:tasks.workunit.client.0.smithi137.stdout:Running main() from gmock_main.cc 2024-09-12T00:25:06.770 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:25:06.770 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:06.770 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 4 tests from cls_log 2024-09-12T00:25:06.770 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:25:09.680 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_log.test_log_add_same_time (2910 ms) 2024-09-12T00:25:09.680 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:25:12.683 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_log.test_log_add_different_time (3003 ms) 2024-09-12T00:25:12.683 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:25:15.749 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_log.trim_by_time (3066 ms) 2024-09-12T00:25:15.749 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:25:18.759 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_log.trim_by_marker (3010 ms) 2024-09-12T00:25:18.759 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 4 tests from cls_log (11989 ms total) 2024-09-12T00:25:18.759 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:25:18.759 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:18.759 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 4 tests from 1 test suite ran. (11989 ms total) 2024-09-12T00:25:18.759 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 4 tests. 2024-09-12T00:25:18.765 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:25:18.765 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:25:18.821 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:25:18.822 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:25:18.822 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:25:18.886 INFO:tasks.workunit.client.0.smithi137.stdout:Running main() from gmock_main.cc 2024-09-12T00:25:18.886 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:25:18.886 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:18.887 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:25:18.887 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:25:21.809 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.test_implicit (2923 ms) 2024-09-12T00:25:21.810 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:25:24.867 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3058 ms) 2024-09-12T00:25:24.868 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:25:33.948 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.test_put_snap (9080 ms) 2024-09-12T00:25:33.952 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:25:36.995 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.test_explicit (3044 ms) 2024-09-12T00:25:36.995 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:25:40.034 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.set (3043 ms) 2024-09-12T00:25:40.034 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:25:47.091 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.test_implicit_ec (7053 ms) 2024-09-12T00:25:47.091 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:25:54.146 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7059 ms) 2024-09-12T00:25:54.146 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:26:06.231 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.test_put_snap_ec (12085 ms) 2024-09-12T00:26:06.231 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:26:13.298 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.test_explicit_ec (7067 ms) 2024-09-12T00:26:13.299 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:26:20.362 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_refcount.set_ec (7064 ms) 2024-09-12T00:26:20.362 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 10 tests from cls_refcount (61476 ms total) 2024-09-12T00:26:20.362 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:26:20.362 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:20.362 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 10 tests from 1 test suite ran. (61476 ms total) 2024-09-12T00:26:20.362 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 10 tests. 2024-09-12T00:26:20.368 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:26:20.368 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:26:20.424 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:26:20.426 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:26:20.426 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:26:20.490 INFO:tasks.workunit.client.0.smithi137.stdout:Running main() from gmock_main.cc 2024-09-12T00:26:20.491 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:26:20.491 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:20.491 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:26:22.368 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:26:22.471 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.index_basic (104 ms) 2024-09-12T00:26:22.471 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:26:22.549 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (78 ms) 2024-09-12T00:26:22.550 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:26:22.643 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.index_remove_object (94 ms) 2024-09-12T00:26:22.644 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:26:25.086 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.index_suggest (2443 ms) 2024-09-12T00:26:25.087 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:26:25.103 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.index_suggest_complete (17 ms) 2024-09-12T00:26:25.104 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:26:25.177 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.index_list (73 ms) 2024-09-12T00:26:25.177 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:27:23.323 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.index_list_delimited (58145 ms) 2024-09-12T00:27:23.323 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:27:23.557 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.bi_list (236 ms) 2024-09-12T00:27:23.557 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:27:23.588 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.gc_set (30 ms) 2024-09-12T00:27:23.588 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:27:23.618 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.gc_list (30 ms) 2024-09-12T00:27:23.619 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:27:31.686 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.gc_defer (8067 ms) 2024-09-12T00:27:31.686 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:27:31.871 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.usage_basic (186 ms) 2024-09-12T00:27:31.871 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:27:31.873 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-12T00:27:31.874 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:27:32.087 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.usage_clear (212 ms) 2024-09-12T00:27:32.087 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:27:32.220 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.bi_log_trim (134 ms) 2024-09-12T00:27:32.220 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:27:32.258 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.index_racing_removes (38 ms) 2024-09-12T00:27:32.259 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:27:32.297 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.reshardlog_list (39 ms) 2024-09-12T00:27:32.297 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:27:32.323 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.reshardlog_num (26 ms) 2024-09-12T00:27:32.324 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:27:32.378 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw.bi_put_entries (55 ms) 2024-09-12T00:27:32.707 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 19 tests from cls_rgw (70011 ms total) 2024-09-12T00:27:32.707 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:27:32.707 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:27:32.707 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 19 tests from 1 test suite ran. (72216 ms total) 2024-09-12T00:27:32.707 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 19 tests. 2024-09-12T00:27:32.715 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:27:32.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:27:32.771 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:27:32.773 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:27:32.773 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:27:32.840 INFO:tasks.workunit.client.0.smithi137.stdout:Running main() from gmock_main.cc 2024-09-12T00:27:32.840 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:27:32.840 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:27:32.840 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:27:32.840 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:27:34.718 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.init (1878 ms) 2024-09-12T00:27:34.718 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:27:34.774 INFO:tasks.workunit.client.0.smithi137.stderr:[ ] list info tag = chain-0 2024-09-12T00:27:34.774 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (56 ms) 2024-09-12T00:27:34.774 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:27:34.789 INFO:tasks.workunit.client.0.smithi137.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:27:34.790 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (16 ms) 2024-09-12T00:27:34.790 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:27:34.807 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (17 ms) 2024-09-12T00:27:34.807 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:27:34.824 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (17 ms) 2024-09-12T00:27:34.824 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:27:34.841 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (17 ms) 2024-09-12T00:27:34.841 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:27:34.859 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-12T00:27:34.859 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:27:34.877 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (18 ms) 2024-09-12T00:27:34.877 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:27:35.754 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_gc.finalize (877 ms) 2024-09-12T00:27:35.755 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 9 tests from cls_rgw_gc (2914 ms total) 2024-09-12T00:27:35.755 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:27:35.755 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:27:35.755 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 9 tests from 1 test suite ran. (2914 ms total) 2024-09-12T00:27:35.755 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 9 tests. 2024-09-12T00:27:35.761 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:27:35.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:27:35.816 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:27:35.818 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:27:35.818 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:27:35.892 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:35.892 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:35.892 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:27:35.892 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:27:37.757 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:27:37.758 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:27:37.803 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.804+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~M62YV3P415EF.0 size=1048576 2024-09-12T00:27:37.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.808+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~M62YV3P415EF.1 size=1048576 2024-09-12T00:27:37.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.812+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~M62YV3P415EF.2 size=905195 2024-09-12T00:27:37.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.812+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=M62YV3P415EF tag=9KSV27ETHVGD type=write size=4050923 2024-09-12T00:27:37.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.816+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=R4FBYVK7HQ9T type=del size=2349436 2024-09-12T00:27:37.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.816+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=1IN9ARWL7K0Q type=del size=1828177 2024-09-12T00:27:37.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.824+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~3CZFZTCKF2FF.0 size=1048576 2024-09-12T00:27:37.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.824+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~3CZFZTCKF2FF.1 size=839352 2024-09-12T00:27:37.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.824+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=3CZFZTCKF2FF tag=ZO7C8W3ALHVF type=write size=2936504 2024-09-12T00:27:37.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.828+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=D9E02XI9WQKX type=write size=640081 2024-09-12T00:27:37.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.832+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=3ATBEO3K2U0Y type=write size=32299 2024-09-12T00:27:37.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.836+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~CERJFLWLZK69.0 size=590196 2024-09-12T00:27:37.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.836+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=CERJFLWLZK69 tag=DFOK2VTJIHZ2 type=write size=1638772 2024-09-12T00:27:37.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.844+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~6RQEQBA4ONU6.0 size=1016902 2024-09-12T00:27:37.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.844+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=6RQEQBA4ONU6 tag=ZF6HP12CQ1TT type=write size=2065478 2024-09-12T00:27:37.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.848+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=222IKTEFAE5X type=del size=3075177 2024-09-12T00:27:37.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.848+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=BQWE6QZW86VE type=del size=1094740 2024-09-12T00:27:37.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.856+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~UK1L3WR872I6.0 size=439293 2024-09-12T00:27:37.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.856+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=UK1L3WR872I6 tag=JCIZCNBPX6JO type=write size=1487869 2024-09-12T00:27:37.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.860+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~4TVWHT6WV17W.0 size=1048576 2024-09-12T00:27:37.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.864+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~4TVWHT6WV17W.1 size=1048576 2024-09-12T00:27:37.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.864+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~4TVWHT6WV17W.2 size=305931 2024-09-12T00:27:37.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.864+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=4TVWHT6WV17W tag=ZXHBBW62ZTFZ type=write size=3451659 2024-09-12T00:27:37.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.868+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=LA06UI6HTN14 type=del size=3517780 2024-09-12T00:27:37.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.872+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=RJ47L27XPO1F type=del size=826223 2024-09-12T00:27:37.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.876+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=B3D3UB9X43V1 type=del size=3662829 2024-09-12T00:27:37.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.884+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~91NBGUS9K2X5.0 size=1048576 2024-09-12T00:27:37.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.884+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~91NBGUS9K2X5.1 size=1048576 2024-09-12T00:27:37.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.888+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~91NBGUS9K2X5.2 size=333541 2024-09-12T00:27:37.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.888+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=91NBGUS9K2X5 tag=X3UCVPTSAYIL type=write size=3479269 2024-09-12T00:27:37.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.892+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~M62YV3P415EF.0 size=1048576 2024-09-12T00:27:37.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.892+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~M62YV3P415EF.1 size=1048576 2024-09-12T00:27:37.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.896+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~M62YV3P415EF.2 size=905195 2024-09-12T00:27:37.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.904+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=M62YV3P415EF tag=9KSV27ETHVGD type=write size=4050923 2024-09-12T00:27:37.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.908+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~6W8GWH50CAJ3.0 size=1048576 2024-09-12T00:27:37.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.912+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~6W8GWH50CAJ3.1 size=886604 2024-09-12T00:27:37.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.912+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=6W8GWH50CAJ3 tag=OW7VLS0MOW85 type=write size=2983756 2024-09-12T00:27:37.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.916+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=R4FBYVK7HQ9T type=del 2024-09-12T00:27:37.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.920+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=BHEBKHEBL7QG type=del size=2990951 2024-09-12T00:27:37.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.924+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=1IN9ARWL7K0Q type=del 2024-09-12T00:27:37.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.928+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=VU3Y99J1IPYG type=del size=4157190 2024-09-12T00:27:37.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.932+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~3CZFZTCKF2FF.0 size=1048576 2024-09-12T00:27:37.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.932+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~3CZFZTCKF2FF.1 size=839352 2024-09-12T00:27:37.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.940+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=3CZFZTCKF2FF tag=ZO7C8W3ALHVF type=write size=2936504 2024-09-12T00:27:37.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.944+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=R9C5XJU7GRQT type=write size=50865 2024-09-12T00:27:37.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.948+0000 7f712938c8c0 1 < completed write operation key=F7T79C7MZX35 tag=D9E02XI9WQKX type=write size=640081 2024-09-12T00:27:37.954 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.952+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~YTA0WHCTZ2AB.0 size=1048576 2024-09-12T00:27:37.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.956+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~YTA0WHCTZ2AB.1 size=251288 2024-09-12T00:27:37.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.956+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=YTA0WHCTZ2AB tag=06LFRWKEX4ZO type=write size=2348440 2024-09-12T00:27:37.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.960+0000 7f712938c8c0 1 < canceled operation key=KEMQ3H8LAUI9 tag=3ATBEO3K2U0Y type=write size=32299 2024-09-12T00:27:37.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.964+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=HEJ8W0A83XRF type=del size=2991806 2024-09-12T00:27:37.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.964+0000 7f712938c8c0 1 < canceled part key=_multipart_0QZKHZTVP3RQ.2~CERJFLWLZK69.0 size=590196 2024-09-12T00:27:37.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.972+0000 7f712938c8c0 1 < canceled multipart upload key=0QZKHZTVP3RQ upload=CERJFLWLZK69 tag=DFOK2VTJIHZ2 type=write size=1638772 2024-09-12T00:27:37.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.972+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=I9ZE9WV190HQ type=del size=95416 2024-09-12T00:27:37.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.976+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~6RQEQBA4ONU6.0 size=1016902 2024-09-12T00:27:37.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.984+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=6RQEQBA4ONU6 tag=ZF6HP12CQ1TT type=write size=2065478 2024-09-12T00:27:37.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.988+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~YDG1SB9GZ1NO.0 size=158867 2024-09-12T00:27:37.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.988+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=YDG1SB9GZ1NO tag=U2JX88DVS9M1 type=write size=1207443 2024-09-12T00:27:37.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.992+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=222IKTEFAE5X type=del 2024-09-12T00:27:37.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:37.996+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=FGO29325DAUX type=del size=516108 2024-09-12T00:27:38.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.000+0000 7f712938c8c0 1 < canceled operation key=VAFU5FXA2KLC tag=BQWE6QZW86VE type=del size=1094740 2024-09-12T00:27:38.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.004+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=YOZ55J3PFXYT type=del size=1812821 2024-09-12T00:27:38.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.008+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~UK1L3WR872I6.0 size=439293 2024-09-12T00:27:38.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.016+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=UK1L3WR872I6 tag=JCIZCNBPX6JO type=write size=1487869 2024-09-12T00:27:38.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.020+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~TSID3EISZ51U.0 size=1028626 2024-09-12T00:27:38.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.020+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=TSID3EISZ51U tag=PXJOPDUNOEP9 type=write size=2077202 2024-09-12T00:27:38.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.024+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~4TVWHT6WV17W.0 size=1048576 2024-09-12T00:27:38.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.028+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~4TVWHT6WV17W.1 size=1048576 2024-09-12T00:27:38.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.028+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~4TVWHT6WV17W.2 size=305931 2024-09-12T00:27:38.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.036+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=4TVWHT6WV17W tag=ZXHBBW62ZTFZ type=write size=3451659 2024-09-12T00:27:38.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.044+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~CS9G27O70KKH.0 size=1048576 2024-09-12T00:27:38.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.044+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~CS9G27O70KKH.1 size=571497 2024-09-12T00:27:38.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.044+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=CS9G27O70KKH tag=UOPOWKGS53GW type=write size=2668649 2024-09-12T00:27:38.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.052+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=LA06UI6HTN14 type=del 2024-09-12T00:27:38.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.056+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=YG9V09QJZFB5 type=write size=396618 2024-09-12T00:27:38.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.064+0000 7f712938c8c0 1 < suggested update operation key=L2SR6IAW0D38 tag=RJ47L27XPO1F type=del size=826223 2024-09-12T00:27:38.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.068+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~SYQ25P9F9S0O.0 size=1048576 2024-09-12T00:27:38.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.072+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~SYQ25P9F9S0O.1 size=1048576 2024-09-12T00:27:38.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.076+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~SYQ25P9F9S0O.2 size=302430 2024-09-12T00:27:38.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.076+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=SYQ25P9F9S0O tag=TYJ1293J0PL3 type=write size=3448158 2024-09-12T00:27:38.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.084+0000 7f712938c8c0 1 < suggested update operation key=ZP88X00LMVSS tag=B3D3UB9X43V1 type=del size=3662829 2024-09-12T00:27:38.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.092+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~CZO0V973D76X.0 size=1048576 2024-09-12T00:27:38.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.092+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~CZO0V973D76X.1 size=229652 2024-09-12T00:27:38.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.092+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=CZO0V973D76X tag=ZWUKD69I9ZCX type=write size=2326804 2024-09-12T00:27:38.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.096+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~91NBGUS9K2X5.0 size=1048576 2024-09-12T00:27:38.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.100+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~91NBGUS9K2X5.1 size=1048576 2024-09-12T00:27:38.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.104+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~91NBGUS9K2X5.2 size=333541 2024-09-12T00:27:38.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.108+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=91NBGUS9K2X5 tag=X3UCVPTSAYIL type=write size=3479269 2024-09-12T00:27:38.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.112+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=122QGHUMWIGS type=write size=577838 2024-09-12T00:27:38.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.116+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~6W8GWH50CAJ3.0 size=1048576 2024-09-12T00:27:38.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.120+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~6W8GWH50CAJ3.1 size=886604 2024-09-12T00:27:38.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.124+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=6W8GWH50CAJ3 tag=OW7VLS0MOW85 type=write size=2983756 2024-09-12T00:27:38.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.128+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=8V41Z2M6HPJJ type=del size=2157952 2024-09-12T00:27:38.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.136+0000 7f712938c8c0 1 < suggested remove operation key=N69XPNN6Y6HZ tag=BHEBKHEBL7QG type=del 2024-09-12T00:27:38.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.144+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~PKZS66Q5GOFJ.0 size=216614 2024-09-12T00:27:38.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.144+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=PKZS66Q5GOFJ tag=WKZ0CZ6ZYI5R type=write size=1265190 2024-09-12T00:27:38.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.148+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=VU3Y99J1IPYG type=del 2024-09-12T00:27:38.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.152+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=EGLMB5LERC5U type=del size=1830744 2024-09-12T00:27:38.157 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.156+0000 7f712938c8c0 1 < completed write operation key=W01PFMFNYLED tag=R9C5XJU7GRQT type=write size=50865 2024-09-12T00:27:38.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.164+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=DUP425XRZZCA type=del size=2931471 2024-09-12T00:27:38.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.168+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~YTA0WHCTZ2AB.0 size=1048576 2024-09-12T00:27:38.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.172+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~YTA0WHCTZ2AB.1 size=251288 2024-09-12T00:27:38.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.176+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=YTA0WHCTZ2AB tag=06LFRWKEX4ZO type=write size=2348440 2024-09-12T00:27:38.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.184+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~O9JQQCH0QUKH.0 size=1048576 2024-09-12T00:27:38.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.184+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~O9JQQCH0QUKH.1 size=281556 2024-09-12T00:27:38.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.184+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=O9JQQCH0QUKH tag=ZYIV57IPWKH6 type=write size=2378708 2024-09-12T00:27:38.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.192+0000 7f712938c8c0 1 < suggested update operation key=0QZKHZTVP3RQ tag=HEJ8W0A83XRF type=del size=2991806 2024-09-12T00:27:38.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.196+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=JJCTAEA1L15D type=write size=763401 2024-09-12T00:27:38.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.200+0000 7f712938c8c0 1 < canceled operation key=QG0W04PRTQNP tag=I9ZE9WV190HQ type=del size=95416 2024-09-12T00:27:38.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.208+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~NHKRJHPMYIW6.0 size=1021036 2024-09-12T00:27:38.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.208+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=NHKRJHPMYIW6 tag=725V0LP9P3TQ type=write size=2069612 2024-09-12T00:27:38.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.212+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~YDG1SB9GZ1NO.0 size=158867 2024-09-12T00:27:38.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.216+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=YDG1SB9GZ1NO tag=U2JX88DVS9M1 type=write size=1207443 2024-09-12T00:27:38.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.220+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=GTIJ6RQ6FOUM type=del size=96481 2024-09-12T00:27:38.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.224+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=FGO29325DAUX type=del 2024-09-12T00:27:38.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.232+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~JK4ITPFGO6PY.0 size=1048576 2024-09-12T00:27:38.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.236+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~JK4ITPFGO6PY.1 size=39832 2024-09-12T00:27:38.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.236+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=JK4ITPFGO6PY tag=3BZTSJXOXK66 type=write size=2136984 2024-09-12T00:27:38.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.240+0000 7f712938c8c0 -1 < failed to complete operation key=0QZKHZTVP3RQ tag=YOZ55J3PFXYT type=del size=1812821: (22) Invalid argument 2024-09-12T00:27:38.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.248+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~37GFG51XPDN5.0 size=765571 2024-09-12T00:27:38.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.248+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=37GFG51XPDN5 tag=5QMQJE1OI4EK type=write size=1814147 2024-09-12T00:27:38.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.248+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~TSID3EISZ51U.0 size=1028626 2024-09-12T00:27:38.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.256+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=TSID3EISZ51U tag=PXJOPDUNOEP9 type=write size=2077202 2024-09-12T00:27:38.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.264+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~ZQR3BVG3WFNZ.0 size=1048576 2024-09-12T00:27:38.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.268+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~ZQR3BVG3WFNZ.1 size=1048576 2024-09-12T00:27:38.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.272+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~ZQR3BVG3WFNZ.2 size=916946 2024-09-12T00:27:38.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.272+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=ZQR3BVG3WFNZ tag=16BK9ODA7VJD type=write size=4062674 2024-09-12T00:27:38.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.276+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~CS9G27O70KKH.0 size=1048576 2024-09-12T00:27:38.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.276+0000 7f712938c8c0 1 < canceled part key=_multipart_BH2YHXHVEZCH.2~CS9G27O70KKH.1 size=571497 2024-09-12T00:27:38.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.280+0000 7f712938c8c0 1 < canceled multipart upload key=BH2YHXHVEZCH upload=CS9G27O70KKH tag=UOPOWKGS53GW type=write size=2668649 2024-09-12T00:27:38.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.288+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~ZS3J94HW1AGD.0 size=59580 2024-09-12T00:27:38.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.288+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=ZS3J94HW1AGD tag=GLFSPF22QZT7 type=write size=1108156 2024-09-12T00:27:38.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.292+0000 7f712938c8c0 1 < completed write operation key=A8L061CQ0M0J tag=YG9V09QJZFB5 type=write size=396618 2024-09-12T00:27:38.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.300+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~QNEUFRIDAKZ4.0 size=1048576 2024-09-12T00:27:38.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.304+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~QNEUFRIDAKZ4.1 size=1048576 2024-09-12T00:27:38.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.308+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~QNEUFRIDAKZ4.2 size=204162 2024-09-12T00:27:38.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.308+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=QNEUFRIDAKZ4 tag=OB0V4NASH2VJ type=write size=3349890 2024-09-12T00:27:38.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.312+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~SYQ25P9F9S0O.0 size=1048576 2024-09-12T00:27:38.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.316+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~SYQ25P9F9S0O.1 size=1048576 2024-09-12T00:27:38.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.320+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~SYQ25P9F9S0O.2 size=302430 2024-09-12T00:27:38.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.324+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=SYQ25P9F9S0O tag=TYJ1293J0PL3 type=write size=3448158 2024-09-12T00:27:38.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.328+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=LWSZ2NM0NKXG type=del size=1797215 2024-09-12T00:27:38.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.332+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~CZO0V973D76X.0 size=1048576 2024-09-12T00:27:38.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.336+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~CZO0V973D76X.1 size=229652 2024-09-12T00:27:38.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.340+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=CZO0V973D76X tag=ZWUKD69I9ZCX type=write size=2326804 2024-09-12T00:27:38.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.344+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=O8B1CDQJ7O4M type=del size=335724 2024-09-12T00:27:38.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.348+0000 7f712938c8c0 1 < completed write operation key=T1H3O6A6HBQH tag=122QGHUMWIGS type=write size=577838 2024-09-12T00:27:38.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.352+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=RHH7JZFVOX5R type=del size=3781138 2024-09-12T00:27:38.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.356+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=8V41Z2M6HPJJ type=del 2024-09-12T00:27:38.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.364+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~EAYBFBXHV0PA.0 size=494610 2024-09-12T00:27:38.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.364+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=EAYBFBXHV0PA tag=LS8QJ8PRQNIO type=write size=1543186 2024-09-12T00:27:38.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.368+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~PKZS66Q5GOFJ.0 size=216614 2024-09-12T00:27:38.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.372+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=PKZS66Q5GOFJ tag=WKZ0CZ6ZYI5R type=write size=1265190 2024-09-12T00:27:38.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.376+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=16N7IF2Z8FJM type=del size=2639043 2024-09-12T00:27:38.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.384+0000 7f712938c8c0 1 < suggested remove operation key=T0C4ZDQB13X0 tag=EGLMB5LERC5U type=del 2024-09-12T00:27:38.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.388+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=YQXJ6VPACL0N type=del size=417093 2024-09-12T00:27:38.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.392+0000 7f712938c8c0 1 < canceled operation key=N69XPNN6Y6HZ tag=DUP425XRZZCA type=del size=2931471 2024-09-12T00:27:38.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.396+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=0KO353FJ7IVM type=del size=1672509 2024-09-12T00:27:38.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.404+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~O9JQQCH0QUKH.0 size=1048576 2024-09-12T00:27:38.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.404+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~O9JQQCH0QUKH.1 size=281556 2024-09-12T00:27:38.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.412+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=O9JQQCH0QUKH tag=ZYIV57IPWKH6 type=write size=2378708 2024-09-12T00:27:38.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.416+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=AEOER3VY14NI type=write size=212742 2024-09-12T00:27:38.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.420+0000 7f712938c8c0 1 < completed write operation key=BH2YHXHVEZCH tag=JJCTAEA1L15D type=write size=763401 2024-09-12T00:27:38.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.424+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=E3U40X2WP4A9 type=del size=2692920 2024-09-12T00:27:38.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.428+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~NHKRJHPMYIW6.0 size=1021036 2024-09-12T00:27:38.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.436+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=NHKRJHPMYIW6 tag=725V0LP9P3TQ type=write size=2069612 2024-09-12T00:27:38.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.440+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~KPYNP7QAV97R.0 size=449586 2024-09-12T00:27:38.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.440+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=KPYNP7QAV97R tag=BK8XBHQUAAHB type=write size=1498162 2024-09-12T00:27:38.446 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.444+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=GTIJ6RQ6FOUM type=del 2024-09-12T00:27:38.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.448+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=3QAGS3RKQKT3 type=write size=207912 2024-09-12T00:27:38.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.452+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~JK4ITPFGO6PY.0 size=1048576 2024-09-12T00:27:38.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.456+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~JK4ITPFGO6PY.1 size=39832 2024-09-12T00:27:38.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.464+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=JK4ITPFGO6PY tag=3BZTSJXOXK66 type=write size=2136984 2024-09-12T00:27:38.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.472+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~LPUUKI4D670B.0 size=73146 2024-09-12T00:27:38.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.472+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=LPUUKI4D670B tag=K7L69RVUIL7N type=write size=1121722 2024-09-12T00:27:38.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.472+0000 7f712938c8c0 1 < canceled part key=_multipart_N69XPNN6Y6HZ.2~37GFG51XPDN5.0 size=765571 2024-09-12T00:27:38.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.476+0000 7f712938c8c0 1 < canceled multipart upload key=N69XPNN6Y6HZ upload=37GFG51XPDN5 tag=5QMQJE1OI4EK type=write size=1814147 2024-09-12T00:27:38.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.480+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=OICUUHO5A32F type=write size=36742 2024-09-12T00:27:38.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.488+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~ZQR3BVG3WFNZ.0 size=1048576 2024-09-12T00:27:38.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.488+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~ZQR3BVG3WFNZ.1 size=1048576 2024-09-12T00:27:38.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.492+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~ZQR3BVG3WFNZ.2 size=916946 2024-09-12T00:27:38.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.496+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=ZQR3BVG3WFNZ tag=16BK9ODA7VJD type=write size=4062674 2024-09-12T00:27:38.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.500+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=UW0PYCUCC65H type=del size=4178599 2024-09-12T00:27:38.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.508+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~ZS3J94HW1AGD.0 size=59580 2024-09-12T00:27:38.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.512+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=ZS3J94HW1AGD tag=GLFSPF22QZT7 type=write size=1108156 2024-09-12T00:27:38.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.516+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=ZRA6B01KA1G5 type=del size=1350424 2024-09-12T00:27:38.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.520+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~QNEUFRIDAKZ4.0 size=1048576 2024-09-12T00:27:38.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.524+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~QNEUFRIDAKZ4.1 size=1048576 2024-09-12T00:27:38.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.528+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~QNEUFRIDAKZ4.2 size=204162 2024-09-12T00:27:38.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.532+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=QNEUFRIDAKZ4 tag=OB0V4NASH2VJ type=write size=3349890 2024-09-12T00:27:38.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.536+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=XWCCC10PLEI3 type=del size=733583 2024-09-12T00:27:38.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.540+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=LWSZ2NM0NKXG type=del 2024-09-12T00:27:38.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.544+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~25X1L6A82J1K.0 size=1048576 2024-09-12T00:27:38.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.548+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~25X1L6A82J1K.1 size=988086 2024-09-12T00:27:38.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.548+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=25X1L6A82J1K tag=9B2S03A51KST type=write size=3085238 2024-09-12T00:27:38.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.552+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=O8B1CDQJ7O4M type=del 2024-09-12T00:27:38.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.556+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=E0QGLMDGNCSS type=del size=2509432 2024-09-12T00:27:38.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.560+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=RHH7JZFVOX5R type=del 2024-09-12T00:27:38.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.564+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~DJ1VNPPIHFLY.0 size=948172 2024-09-12T00:27:38.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.564+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=DJ1VNPPIHFLY tag=52K8J1A2FVKR type=write size=1996748 2024-09-12T00:27:38.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.568+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~EAYBFBXHV0PA.0 size=494610 2024-09-12T00:27:38.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.576+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=EAYBFBXHV0PA tag=LS8QJ8PRQNIO type=write size=1543186 2024-09-12T00:27:38.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.580+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=ZC8UDFM8N0W7 type=del size=3561170 2024-09-12T00:27:38.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.580+0000 7f712938c8c0 1 < canceled operation key=F7T79C7MZX35 tag=16N7IF2Z8FJM type=del size=2639043 2024-09-12T00:27:38.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.588+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~NO5Z32R7KS80.0 size=1048576 2024-09-12T00:27:38.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.592+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~NO5Z32R7KS80.1 size=55017 2024-09-12T00:27:38.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.592+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=NO5Z32R7KS80 tag=EYHRB21O4162 type=write size=2152169 2024-09-12T00:27:38.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.600+0000 7f712938c8c0 1 < suggested update operation key=W9YW6AS1RL48 tag=YQXJ6VPACL0N type=del size=417093 2024-09-12T00:27:38.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.604+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~DSF2I1SL7QSQ.0 size=1048576 2024-09-12T00:27:38.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.608+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~DSF2I1SL7QSQ.1 size=597830 2024-09-12T00:27:38.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.608+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=DSF2I1SL7QSQ tag=Z3H61JW7OP2C type=write size=2694982 2024-09-12T00:27:38.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.612+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=0KO353FJ7IVM type=del 2024-09-12T00:27:38.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.616+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=ZUAN1IGCII22 type=del size=3729256 2024-09-12T00:27:38.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.620+0000 7f712938c8c0 1 < completed write operation key=ZP88X00LMVSS tag=AEOER3VY14NI type=write size=212742 2024-09-12T00:27:38.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.624+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=QS8Q0Q13UF8S type=del size=4153569 2024-09-12T00:27:38.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.632+0000 7f712938c8c0 1 < suggested remove operation key=T1H3O6A6HBQH tag=E3U40X2WP4A9 type=del 2024-09-12T00:27:38.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.636+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=VI7Q30RP6HW4 type=del size=2013451 2024-09-12T00:27:38.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.640+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~KPYNP7QAV97R.0 size=449586 2024-09-12T00:27:38.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.644+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=KPYNP7QAV97R tag=BK8XBHQUAAHB type=write size=1498162 2024-09-12T00:27:38.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.652+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~KRRHDC9OTP5U.0 size=1048576 2024-09-12T00:27:38.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.656+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~KRRHDC9OTP5U.1 size=125758 2024-09-12T00:27:38.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.656+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=KRRHDC9OTP5U tag=W8CWDF233UCY type=write size=2222910 2024-09-12T00:27:38.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.660+0000 7f712938c8c0 1 < canceled operation key=0QZKHZTVP3RQ tag=3QAGS3RKQKT3 type=write size=207912 2024-09-12T00:27:38.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.664+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=XR1LWU2LIDLD type=del size=1185336 2024-09-12T00:27:38.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.668+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~LPUUKI4D670B.0 size=73146 2024-09-12T00:27:38.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.672+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=LPUUKI4D670B tag=K7L69RVUIL7N type=write size=1121722 2024-09-12T00:27:38.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.680+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~QN3G3162H6BH.0 size=1048576 2024-09-12T00:27:38.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.684+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~QN3G3162H6BH.1 size=1048576 2024-09-12T00:27:38.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.688+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~QN3G3162H6BH.2 size=374738 2024-09-12T00:27:38.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.688+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=QN3G3162H6BH tag=P26HGOLTW1H3 type=write size=3520466 2024-09-12T00:27:38.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.692+0000 7f712938c8c0 1 < completed write operation key=F7T79C7MZX35 tag=OICUUHO5A32F type=write size=36742 2024-09-12T00:27:38.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.700+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DN76PV3MWRPV.0 size=1048576 2024-09-12T00:27:38.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.704+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DN76PV3MWRPV.1 size=657436 2024-09-12T00:27:38.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.704+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=DN76PV3MWRPV tag=5UT8XWS15K93 type=write size=2754588 2024-09-12T00:27:38.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.708+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=UW0PYCUCC65H type=del 2024-09-12T00:27:38.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.712+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=WVDADDXM0C8Y type=write size=25811 2024-09-12T00:27:38.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.720+0000 7f712938c8c0 1 < suggested remove operation key=9N3U208FGM79 tag=ZRA6B01KA1G5 type=del 2024-09-12T00:27:38.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.724+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~3OU0N4FFZGTE.0 size=1048576 2024-09-12T00:27:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.728+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~3OU0N4FFZGTE.1 size=447941 2024-09-12T00:27:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.728+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=3OU0N4FFZGTE tag=88FCO3FS8MRU type=write size=2545093 2024-09-12T00:27:38.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.732+0000 7f712938c8c0 -1 < failed to complete operation key=T1H3O6A6HBQH tag=XWCCC10PLEI3 type=del size=733583: (22) Invalid argument 2024-09-12T00:27:38.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.736+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=CVNYJ39AI3YQ type=del size=2627789 2024-09-12T00:27:38.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.740+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~25X1L6A82J1K.0 size=1048576 2024-09-12T00:27:38.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.744+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~25X1L6A82J1K.1 size=988086 2024-09-12T00:27:38.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.748+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=25X1L6A82J1K tag=9B2S03A51KST type=write size=3085238 2024-09-12T00:27:38.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.752+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=E5X9QNATU0DM type=del size=1490227 2024-09-12T00:27:38.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.756+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=E0QGLMDGNCSS type=del 2024-09-12T00:27:38.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.760+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=MUU2FP7SSQU4 type=del size=2961230 2024-09-12T00:27:38.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.764+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~DJ1VNPPIHFLY.0 size=948172 2024-09-12T00:27:38.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.772+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=DJ1VNPPIHFLY tag=52K8J1A2FVKR type=write size=1996748 2024-09-12T00:27:38.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.780+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=T4L1WNG287OY type=write size=344965 2024-09-12T00:27:38.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.788+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=ZC8UDFM8N0W7 type=del 2024-09-12T00:27:38.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.796+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~KJ1BSEREM32F.0 size=107640 2024-09-12T00:27:38.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.796+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=KJ1BSEREM32F tag=8F68LCP6I4FF type=write size=1156216 2024-09-12T00:27:38.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.800+0000 7f712938c8c0 1 < canceled part key=_multipart_W01PFMFNYLED.2~NO5Z32R7KS80.0 size=1048576 2024-09-12T00:27:38.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.800+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~NO5Z32R7KS80.1 size=55017 2024-09-12T00:27:38.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.808+0000 7f712938c8c0 1 < canceled multipart upload key=W01PFMFNYLED upload=NO5Z32R7KS80 tag=EYHRB21O4162 type=write size=2152169 2024-09-12T00:27:38.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.812+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=5ZYRPZ3C5YSE type=del size=2797308 2024-09-12T00:27:38.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.816+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~DSF2I1SL7QSQ.0 size=1048576 2024-09-12T00:27:38.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.816+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~DSF2I1SL7QSQ.1 size=597830 2024-09-12T00:27:38.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.824+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=DSF2I1SL7QSQ tag=Z3H61JW7OP2C type=write size=2694982 2024-09-12T00:27:38.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.828+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=UMRMQOYHKRHJ type=write size=868313 2024-09-12T00:27:38.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.832+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=ZUAN1IGCII22 type=del 2024-09-12T00:27:38.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.832+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=J1CA7J0V5RAA type=del size=1914561 2024-09-12T00:27:38.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.836+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=QS8Q0Q13UF8S type=del 2024-09-12T00:27:38.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.840+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=NJ1TKLM696HO type=del size=3476997 2024-09-12T00:27:38.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.844+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=VI7Q30RP6HW4 type=del 2024-09-12T00:27:38.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.852+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~NTPOUW3PGY71.0 size=1048576 2024-09-12T00:27:38.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.852+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~NTPOUW3PGY71.1 size=520686 2024-09-12T00:27:38.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.852+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=NTPOUW3PGY71 tag=0CQD17FCXJOQ type=write size=2617838 2024-09-12T00:27:38.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.856+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~KRRHDC9OTP5U.0 size=1048576 2024-09-12T00:27:38.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.860+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~KRRHDC9OTP5U.1 size=125758 2024-09-12T00:27:38.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.868+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=KRRHDC9OTP5U tag=W8CWDF233UCY type=write size=2222910 2024-09-12T00:27:38.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.876+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~2BWV9WFLRHO3.0 size=1048576 2024-09-12T00:27:38.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.880+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~2BWV9WFLRHO3.1 size=920656 2024-09-12T00:27:38.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.880+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=2BWV9WFLRHO3 tag=1G2U3KA6DSQA type=write size=3017808 2024-09-12T00:27:38.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.884+0000 7f712938c8c0 -1 < failed to complete operation key=9N3U208FGM79 tag=XR1LWU2LIDLD type=del size=1185336: (22) Invalid argument 2024-09-12T00:27:38.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.888+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=F1NQA8GWU6VK type=del size=2538667 2024-09-12T00:27:38.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.892+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~QN3G3162H6BH.0 size=1048576 2024-09-12T00:27:38.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.896+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~QN3G3162H6BH.1 size=1048576 2024-09-12T00:27:38.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.896+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~QN3G3162H6BH.2 size=374738 2024-09-12T00:27:38.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.904+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=QN3G3162H6BH tag=P26HGOLTW1H3 type=write size=3520466 2024-09-12T00:27:38.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.912+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~0JSZPSVW3RZU.0 size=1048576 2024-09-12T00:27:38.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.912+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~0JSZPSVW3RZU.1 size=1048576 2024-09-12T00:27:38.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.916+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~0JSZPSVW3RZU.2 size=121404 2024-09-12T00:27:38.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.916+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=0JSZPSVW3RZU tag=MQFUKV1RG9M1 type=write size=3267132 2024-09-12T00:27:38.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.924+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~DN76PV3MWRPV.0 size=1048576 2024-09-12T00:27:38.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.928+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~DN76PV3MWRPV.1 size=657436 2024-09-12T00:27:38.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.932+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=DN76PV3MWRPV tag=5UT8XWS15K93 type=write size=2754588 2024-09-12T00:27:38.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.936+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=E01PI4ZDOQ1E type=del size=327453 2024-09-12T00:27:38.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.940+0000 7f712938c8c0 1 < completed write operation key=T0C4ZDQB13X0 tag=WVDADDXM0C8Y type=write size=25811 2024-09-12T00:27:38.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.944+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=0G56GG8UIO8K type=del size=2106212 2024-09-12T00:27:38.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.948+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~3OU0N4FFZGTE.0 size=1048576 2024-09-12T00:27:38.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.948+0000 7f712938c8c0 1 < canceled part key=_multipart_W9YW6AS1RL48.2~3OU0N4FFZGTE.1 size=447941 2024-09-12T00:27:38.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.956+0000 7f712938c8c0 1 < canceled multipart upload key=W9YW6AS1RL48 upload=3OU0N4FFZGTE tag=88FCO3FS8MRU type=write size=2545093 2024-09-12T00:27:38.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.960+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=OJ4NUMFSDO30 type=write size=210021 2024-09-12T00:27:38.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.964+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=CVNYJ39AI3YQ type=del 2024-09-12T00:27:38.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.968+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=OX669WGM7BCX type=write size=731935 2024-09-12T00:27:38.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.976+0000 7f712938c8c0 1 < suggested remove operation key=HPM9GFRASWIV tag=E5X9QNATU0DM type=del 2024-09-12T00:27:38.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.980+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=5CUPRKZJGM8F type=del size=2428334 2024-09-12T00:27:38.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.984+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=MUU2FP7SSQU4 type=del 2024-09-12T00:27:38.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.988+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=N96VAEQ54BSL type=write size=618080 2024-09-12T00:27:38.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.992+0000 7f712938c8c0 1 < completed write operation key=7X45VJAQO7PF tag=T4L1WNG287OY type=write size=344965 2024-09-12T00:27:38.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:38.996+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=HTGSPOBP6VCR type=write size=313467 2024-09-12T00:27:39.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.000+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~KJ1BSEREM32F.0 size=107640 2024-09-12T00:27:39.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.004+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=KJ1BSEREM32F tag=8F68LCP6I4FF type=write size=1156216 2024-09-12T00:27:39.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.012+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~W9DUH3XQ6E2I.0 size=1048576 2024-09-12T00:27:39.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.016+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~W9DUH3XQ6E2I.1 size=1048576 2024-09-12T00:27:39.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.016+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~W9DUH3XQ6E2I.2 size=716190 2024-09-12T00:27:39.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.016+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=W9DUH3XQ6E2I tag=UQBUSWBYGZZM type=write size=3861918 2024-09-12T00:27:39.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.024+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=5ZYRPZ3C5YSE type=del 2024-09-12T00:27:39.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.028+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~M7861C6C7BIB.0 size=1048576 2024-09-12T00:27:39.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.032+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~M7861C6C7BIB.1 size=1048576 2024-09-12T00:27:39.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.036+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~M7861C6C7BIB.2 size=95457 2024-09-12T00:27:39.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.036+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=M7861C6C7BIB tag=KMS6GAL908AX type=write size=3241185 2024-09-12T00:27:39.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.040+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=UMRMQOYHKRHJ type=write size=868313 2024-09-12T00:27:39.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.044+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=32QE7W77150D type=del size=1531678 2024-09-12T00:27:39.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.048+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=J1CA7J0V5RAA type=del 2024-09-12T00:27:39.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.052+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~1XL98BXG8YWN.0 size=1048576 2024-09-12T00:27:39.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.056+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~1XL98BXG8YWN.1 size=1048576 2024-09-12T00:27:39.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.060+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~1XL98BXG8YWN.2 size=843418 2024-09-12T00:27:39.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.060+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=1XL98BXG8YWN tag=GSU3WR4U5X6S type=write size=3989146 2024-09-12T00:27:39.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.064+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=NJ1TKLM696HO type=del 2024-09-12T00:27:39.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.068+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=5IMSMSGKHG3J type=del size=898602 2024-09-12T00:27:39.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.072+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~NTPOUW3PGY71.0 size=1048576 2024-09-12T00:27:39.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.076+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~NTPOUW3PGY71.1 size=520686 2024-09-12T00:27:39.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.084+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=NTPOUW3PGY71 tag=0CQD17FCXJOQ type=write size=2617838 2024-09-12T00:27:39.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.088+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=XIE5XRQM4QUF type=del size=3247899 2024-09-12T00:27:39.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.092+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~2BWV9WFLRHO3.0 size=1048576 2024-09-12T00:27:39.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.096+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~2BWV9WFLRHO3.1 size=920656 2024-09-12T00:27:39.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.100+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=2BWV9WFLRHO3 tag=1G2U3KA6DSQA type=write size=3017808 2024-09-12T00:27:39.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.108+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~A8HNJBHQJZML.0 size=1048576 2024-09-12T00:27:39.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.112+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~A8HNJBHQJZML.1 size=1048576 2024-09-12T00:27:39.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.116+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~A8HNJBHQJZML.2 size=138188 2024-09-12T00:27:39.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.116+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=A8HNJBHQJZML tag=DOMFJQEO9OXR type=write size=3283916 2024-09-12T00:27:39.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.124+0000 7f712938c8c0 1 < suggested remove operation key=A8L061CQ0M0J tag=F1NQA8GWU6VK type=del 2024-09-12T00:27:39.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.128+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=5MD3NV8C3ZBS type=write size=368378 2024-09-12T00:27:39.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.132+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~0JSZPSVW3RZU.0 size=1048576 2024-09-12T00:27:39.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.132+0000 7f712938c8c0 1 < canceled part key=_multipart_F7T79C7MZX35.2~0JSZPSVW3RZU.1 size=1048576 2024-09-12T00:27:39.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.136+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~0JSZPSVW3RZU.2 size=121404 2024-09-12T00:27:39.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.144+0000 7f712938c8c0 1 < canceled multipart upload key=F7T79C7MZX35 upload=0JSZPSVW3RZU tag=MQFUKV1RG9M1 type=write size=3267132 2024-09-12T00:27:39.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.148+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=CDHZTUV5006F type=write size=133853 2024-09-12T00:27:39.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.152+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=E01PI4ZDOQ1E type=del 2024-09-12T00:27:39.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.156+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=2BEZVEOB0V2Z type=del size=2729978 2024-09-12T00:27:39.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.160+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=0G56GG8UIO8K type=del 2024-09-12T00:27:39.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.164+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=4ONDSYQQHMTS type=del size=1772889 2024-09-12T00:27:39.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.172+0000 7f712938c8c0 1 < suggested remove operation key=QG0W04PRTQNP tag=OJ4NUMFSDO30 type=write 2024-09-12T00:27:39.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.180+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~L2X7H8RUKXIO.0 size=1048576 2024-09-12T00:27:39.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.180+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~L2X7H8RUKXIO.1 size=1048576 2024-09-12T00:27:39.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.184+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~L2X7H8RUKXIO.2 size=84584 2024-09-12T00:27:39.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.184+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=L2X7H8RUKXIO tag=YO26LELJ287S type=write size=3230312 2024-09-12T00:27:39.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.188+0000 7f712938c8c0 1 < completed write operation key=9HX9GER6OKVI tag=OX669WGM7BCX type=write size=731935 2024-09-12T00:27:39.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.192+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=GKL1R8XSEDKM type=del size=3976924 2024-09-12T00:27:39.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.196+0000 7f712938c8c0 -1 < failed to complete operation key=QG0W04PRTQNP tag=5CUPRKZJGM8F type=del size=2428334: (22) Invalid argument 2024-09-12T00:27:39.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.200+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=RZ5KKNZEKYHF type=del size=3234865 2024-09-12T00:27:39.202 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.204+0000 7f712938c8c0 -1 < no bi entry to suggest for operation key=A8L061CQ0M0J tag=N96VAEQ54BSL type=write size=618080: (2) No such file or directory 2024-09-12T00:27:39.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.208+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=XZQNS79OMVJU type=del size=3370011 2024-09-12T00:27:39.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.212+0000 7f712938c8c0 1 < completed write operation key=9YZP0TIRWWRF tag=HTGSPOBP6VCR type=write size=313467 2024-09-12T00:27:39.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.216+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=8NY39C0UHM7Q type=del size=415528 2024-09-12T00:27:39.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.220+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~W9DUH3XQ6E2I.0 size=1048576 2024-09-12T00:27:39.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.224+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~W9DUH3XQ6E2I.1 size=1048576 2024-09-12T00:27:39.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.224+0000 7f712938c8c0 1 < canceled part key=_multipart_9YZP0TIRWWRF.2~W9DUH3XQ6E2I.2 size=716190 2024-09-12T00:27:39.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.228+0000 7f712938c8c0 1 < canceled multipart upload key=9YZP0TIRWWRF upload=W9DUH3XQ6E2I tag=UQBUSWBYGZZM type=write size=3861918 2024-09-12T00:27:39.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.236+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~AKGXQ3OH7YIX.0 size=1048576 2024-09-12T00:27:39.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.240+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~AKGXQ3OH7YIX.1 size=1048576 2024-09-12T00:27:39.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.240+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~AKGXQ3OH7YIX.2 size=976914 2024-09-12T00:27:39.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.240+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=AKGXQ3OH7YIX tag=97ZK9E129O1R type=write size=4122642 2024-09-12T00:27:39.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.244+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~M7861C6C7BIB.0 size=1048576 2024-09-12T00:27:39.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.244+0000 7f712938c8c0 1 < canceled part key=_multipart_5KVIIZS50CNT.2~M7861C6C7BIB.1 size=1048576 2024-09-12T00:27:39.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.252+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~M7861C6C7BIB.2 size=95457 2024-09-12T00:27:39.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.256+0000 7f712938c8c0 1 < canceled multipart upload key=5KVIIZS50CNT upload=M7861C6C7BIB tag=KMS6GAL908AX type=write size=3241185 2024-09-12T00:27:39.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.268+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~YMPQ05EGZ53A.0 size=1048576 2024-09-12T00:27:39.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.268+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~YMPQ05EGZ53A.1 size=715281 2024-09-12T00:27:39.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.268+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=YMPQ05EGZ53A tag=95LO2ALOET00 type=write size=2812433 2024-09-12T00:27:39.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.272+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=32QE7W77150D type=del 2024-09-12T00:27:39.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.280+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DGC790PDUPJG.0 size=1048576 2024-09-12T00:27:39.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.284+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DGC790PDUPJG.1 size=329631 2024-09-12T00:27:39.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.284+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=DGC790PDUPJG tag=K7S38NIT84ZR type=write size=2426783 2024-09-12T00:27:39.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.288+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~1XL98BXG8YWN.0 size=1048576 2024-09-12T00:27:39.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.292+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~1XL98BXG8YWN.1 size=1048576 2024-09-12T00:27:39.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.296+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~1XL98BXG8YWN.2 size=843418 2024-09-12T00:27:39.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.300+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=1XL98BXG8YWN tag=GSU3WR4U5X6S type=write size=3989146 2024-09-12T00:27:39.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.308+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PKL4YRRGMY2X.0 size=1048576 2024-09-12T00:27:39.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.312+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PKL4YRRGMY2X.1 size=1048576 2024-09-12T00:27:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.312+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PKL4YRRGMY2X.2 size=210275 2024-09-12T00:27:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.312+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=PKL4YRRGMY2X tag=HP0BXP225DRH type=write size=3356003 2024-09-12T00:27:39.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.316+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=5IMSMSGKHG3J type=del 2024-09-12T00:27:39.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.320+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=TS1CTHXEJ9VJ type=del size=3775871 2024-09-12T00:27:39.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.324+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=XIE5XRQM4QUF type=del 2024-09-12T00:27:39.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.328+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=MC480D9MXH2D type=del size=805184 2024-09-12T00:27:39.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.332+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~A8HNJBHQJZML.0 size=1048576 2024-09-12T00:27:39.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.336+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~A8HNJBHQJZML.1 size=1048576 2024-09-12T00:27:39.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.340+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~A8HNJBHQJZML.2 size=138188 2024-09-12T00:27:39.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.344+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=A8HNJBHQJZML tag=DOMFJQEO9OXR type=write size=3283916 2024-09-12T00:27:39.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.352+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~YFUZBLBRIMK3.0 size=1048576 2024-09-12T00:27:39.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.356+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~YFUZBLBRIMK3.1 size=838756 2024-09-12T00:27:39.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.356+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=YFUZBLBRIMK3 tag=2ZIH193316V2 type=write size=2935908 2024-09-12T00:27:39.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.360+0000 7f712938c8c0 1 < completed write operation key=04RL082VPLIM tag=5MD3NV8C3ZBS type=write size=368378 2024-09-12T00:27:39.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.364+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=G1RLK3U6ZHLQ type=write size=443323 2024-09-12T00:27:39.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.368+0000 7f712938c8c0 1 < completed write operation key=7X45VJAQO7PF tag=CDHZTUV5006F type=write size=133853 2024-09-12T00:27:39.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.372+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=QBQH3HE9FEPT type=del size=3785621 2024-09-12T00:27:39.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.380+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=2BEZVEOB0V2Z type=del 2024-09-12T00:27:39.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.384+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~H1VPD09D7OA4.0 size=1048576 2024-09-12T00:27:39.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.388+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~H1VPD09D7OA4.1 size=1048576 2024-09-12T00:27:39.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.392+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~H1VPD09D7OA4.2 size=739427 2024-09-12T00:27:39.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.392+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=H1VPD09D7OA4 tag=0YR7SD5C3P4K type=write size=3885155 2024-09-12T00:27:39.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.396+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=4ONDSYQQHMTS type=del 2024-09-12T00:27:39.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.400+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~UDZSFY6FP483.0 size=1048576 2024-09-12T00:27:39.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.404+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~UDZSFY6FP483.1 size=1048576 2024-09-12T00:27:39.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.408+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~UDZSFY6FP483.2 size=745109 2024-09-12T00:27:39.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.408+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=UDZSFY6FP483 tag=HLI5M12QNJRU type=write size=3890837 2024-09-12T00:27:39.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.412+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~L2X7H8RUKXIO.0 size=1048576 2024-09-12T00:27:39.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.412+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~L2X7H8RUKXIO.1 size=1048576 2024-09-12T00:27:39.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.416+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~L2X7H8RUKXIO.2 size=84584 2024-09-12T00:27:39.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.424+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=L2X7H8RUKXIO tag=YO26LELJ287S type=write size=3230312 2024-09-12T00:27:39.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.432+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~1IMVTDS0VGVA.0 size=14424 2024-09-12T00:27:39.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.432+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=1IMVTDS0VGVA tag=EVLLF0M1D071 type=write size=1063000 2024-09-12T00:27:39.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.440+0000 7f712938c8c0 1 < suggested remove operation key=W01PFMFNYLED tag=GKL1R8XSEDKM type=del 2024-09-12T00:27:39.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.444+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=ZHF6GMUV87BE type=del size=3835547 2024-09-12T00:27:39.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.448+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=RZ5KKNZEKYHF type=del 2024-09-12T00:27:39.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.456+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~FFSHWS5QAMHZ.0 size=1048576 2024-09-12T00:27:39.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.460+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~FFSHWS5QAMHZ.1 size=1048576 2024-09-12T00:27:39.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.460+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~FFSHWS5QAMHZ.2 size=330913 2024-09-12T00:27:39.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.460+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=FFSHWS5QAMHZ tag=SH73I6Y1N99Q type=write size=3476641 2024-09-12T00:27:39.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.464+0000 7f712938c8c0 1 < canceled operation key=KEMQ3H8LAUI9 tag=XZQNS79OMVJU type=del size=3370011 2024-09-12T00:27:39.470 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.468+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=JFKT9LJPGG8F type=del size=1509836 2024-09-12T00:27:39.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.476+0000 7f712938c8c0 1 < suggested remove operation key=VAFU5FXA2KLC tag=8NY39C0UHM7Q type=del 2024-09-12T00:27:39.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.480+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=ITTBVGPW9SS4 type=del size=149240 2024-09-12T00:27:39.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.484+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~AKGXQ3OH7YIX.0 size=1048576 2024-09-12T00:27:39.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.484+0000 7f712938c8c0 1 < canceled part key=_multipart_ULE6S9Y6DS62.2~AKGXQ3OH7YIX.1 size=1048576 2024-09-12T00:27:39.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.488+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~AKGXQ3OH7YIX.2 size=976914 2024-09-12T00:27:39.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.492+0000 7f712938c8c0 1 < canceled multipart upload key=ULE6S9Y6DS62 upload=AKGXQ3OH7YIX tag=97ZK9E129O1R type=write size=4122642 2024-09-12T00:27:39.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.496+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=KKUKIYF9SS46 type=del size=3109158 2024-09-12T00:27:39.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.500+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~YMPQ05EGZ53A.0 size=1048576 2024-09-12T00:27:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.500+0000 7f712938c8c0 1 < canceled part key=_multipart_F7T79C7MZX35.2~YMPQ05EGZ53A.1 size=715281 2024-09-12T00:27:39.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.504+0000 7f712938c8c0 1 < canceled multipart upload key=F7T79C7MZX35 upload=YMPQ05EGZ53A tag=95LO2ALOET00 type=write size=2812433 2024-09-12T00:27:39.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.508+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=LGMXU53KNYWL type=del size=3154026 2024-09-12T00:27:39.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.512+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~DGC790PDUPJG.0 size=1048576 2024-09-12T00:27:39.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.516+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~DGC790PDUPJG.1 size=329631 2024-09-12T00:27:39.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.520+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=DGC790PDUPJG tag=K7S38NIT84ZR type=write size=2426783 2024-09-12T00:27:39.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.524+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=B9TBNFJX4M4D type=del size=2234186 2024-09-12T00:27:39.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.528+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PKL4YRRGMY2X.0 size=1048576 2024-09-12T00:27:39.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.532+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PKL4YRRGMY2X.1 size=1048576 2024-09-12T00:27:39.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.536+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PKL4YRRGMY2X.2 size=210275 2024-09-12T00:27:39.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.540+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=PKL4YRRGMY2X tag=HP0BXP225DRH type=write size=3356003 2024-09-12T00:27:39.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.544+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=FMK8I41TL950 type=del size=2932773 2024-09-12T00:27:39.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.548+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=TS1CTHXEJ9VJ type=del 2024-09-12T00:27:39.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.552+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=GJZPG1G3HHTF type=write size=787206 2024-09-12T00:27:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.560+0000 7f712938c8c0 1 < suggested remove operation key=T0C4ZDQB13X0 tag=MC480D9MXH2D type=del 2024-09-12T00:27:39.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.564+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=34CVT7N4PNFT type=write size=536922 2024-09-12T00:27:39.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.568+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~YFUZBLBRIMK3.0 size=1048576 2024-09-12T00:27:39.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.572+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~YFUZBLBRIMK3.1 size=838756 2024-09-12T00:27:39.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.576+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=YFUZBLBRIMK3 tag=2ZIH193316V2 type=write size=2935908 2024-09-12T00:27:39.585 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.584+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~IPAY370LYBUX.0 size=1048576 2024-09-12T00:27:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.588+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~IPAY370LYBUX.1 size=130018 2024-09-12T00:27:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.588+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=IPAY370LYBUX tag=89VMS7ZPQUZN type=write size=2227170 2024-09-12T00:27:39.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.592+0000 7f712938c8c0 1 < canceled operation key=KNGB14TWW6XC tag=G1RLK3U6ZHLQ type=write size=443323 2024-09-12T00:27:39.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.600+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~9LYXS78NI722.0 size=1048576 2024-09-12T00:27:39.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.604+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~9LYXS78NI722.1 size=25974 2024-09-12T00:27:39.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.604+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=9LYXS78NI722 tag=4FKNN0RHMAXB type=write size=2123126 2024-09-12T00:27:39.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.608+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=QBQH3HE9FEPT type=del 2024-09-12T00:27:39.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.612+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=E6ELDJJ80VK7 type=del size=3929472 2024-09-12T00:27:39.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.612+0000 7f712938c8c0 1 < canceled part key=_multipart_9YZP0TIRWWRF.2~H1VPD09D7OA4.0 size=1048576 2024-09-12T00:27:39.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.612+0000 7f712938c8c0 1 < canceled part key=_multipart_9YZP0TIRWWRF.2~H1VPD09D7OA4.1 size=1048576 2024-09-12T00:27:39.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.612+0000 7f712938c8c0 1 < canceled part key=_multipart_9YZP0TIRWWRF.2~H1VPD09D7OA4.2 size=739427 2024-09-12T00:27:39.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.620+0000 7f712938c8c0 1 < canceled multipart upload key=9YZP0TIRWWRF upload=H1VPD09D7OA4 tag=0YR7SD5C3P4K type=write size=3885155 2024-09-12T00:27:39.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.620+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=GWD34M1PBU4R type=del size=1311464 2024-09-12T00:27:39.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.624+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~UDZSFY6FP483.0 size=1048576 2024-09-12T00:27:39.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.628+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~UDZSFY6FP483.1 size=1048576 2024-09-12T00:27:39.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.632+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~UDZSFY6FP483.2 size=745109 2024-09-12T00:27:39.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.636+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=UDZSFY6FP483 tag=HLI5M12QNJRU type=write size=3890837 2024-09-12T00:27:39.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.640+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=WM2AZGPEZ8GK type=write size=392871 2024-09-12T00:27:39.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.644+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~1IMVTDS0VGVA.0 size=14424 2024-09-12T00:27:39.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.648+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=1IMVTDS0VGVA tag=EVLLF0M1D071 type=write size=1063000 2024-09-12T00:27:39.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.656+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~M0PU2JL0W3GL.0 size=1048576 2024-09-12T00:27:39.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.660+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~M0PU2JL0W3GL.1 size=1048576 2024-09-12T00:27:39.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.664+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~M0PU2JL0W3GL.2 size=708709 2024-09-12T00:27:39.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.664+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=M0PU2JL0W3GL tag=AJB5RB11IELX type=write size=3854437 2024-09-12T00:27:39.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.668+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=ZHF6GMUV87BE type=del 2024-09-12T00:27:39.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.668+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=83VSWFB15517 type=del size=3007595 2024-09-12T00:27:39.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.676+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~FFSHWS5QAMHZ.0 size=1048576 2024-09-12T00:27:39.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.676+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~FFSHWS5QAMHZ.1 size=1048576 2024-09-12T00:27:39.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.680+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~FFSHWS5QAMHZ.2 size=330913 2024-09-12T00:27:39.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.688+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=FFSHWS5QAMHZ tag=SH73I6Y1N99Q type=write size=3476641 2024-09-12T00:27:39.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.696+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~I11U7YFJETIB.0 size=1048576 2024-09-12T00:27:39.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.696+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~I11U7YFJETIB.1 size=1048576 2024-09-12T00:27:39.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.700+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~I11U7YFJETIB.2 size=764404 2024-09-12T00:27:39.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.700+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=I11U7YFJETIB tag=6DXZIC8WORVQ type=write size=3910132 2024-09-12T00:27:39.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.704+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=JFKT9LJPGG8F type=del 2024-09-12T00:27:39.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.708+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~K0XZGJCCTVQR.0 size=1048576 2024-09-12T00:27:39.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.712+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~K0XZGJCCTVQR.1 size=1048576 2024-09-12T00:27:39.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.716+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~K0XZGJCCTVQR.2 size=759771 2024-09-12T00:27:39.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.716+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=K0XZGJCCTVQR tag=MA1139JORVFS type=write size=3905499 2024-09-12T00:27:39.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.720+0000 7f712938c8c0 1 < suggested update operation key=ULE6S9Y6DS62 tag=ITTBVGPW9SS4 type=del size=149240 2024-09-12T00:27:39.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.724+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=XP19FQKPEGCR type=del size=1162742 2024-09-12T00:27:39.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.732+0000 7f712938c8c0 1 < suggested update operation key=W9YW6AS1RL48 tag=KKUKIYF9SS46 type=del size=3109158 2024-09-12T00:27:39.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.736+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~WR424MEPEXQS.0 size=1048576 2024-09-12T00:27:39.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.740+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~WR424MEPEXQS.1 size=701254 2024-09-12T00:27:39.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.740+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=WR424MEPEXQS tag=QPPWSIQ2YZX9 type=write size=2798406 2024-09-12T00:27:39.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.744+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=LGMXU53KNYWL type=del 2024-09-12T00:27:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.752+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~HQJSEP4A1HWX.0 size=1048576 2024-09-12T00:27:39.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.752+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~HQJSEP4A1HWX.1 size=358644 2024-09-12T00:27:39.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.752+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=HQJSEP4A1HWX tag=RPCWS1AVWYWG type=write size=2455796 2024-09-12T00:27:39.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.756+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=B9TBNFJX4M4D type=del 2024-09-12T00:27:39.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.760+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=E4MI9XW29FHD type=del size=144522 2024-09-12T00:27:39.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.764+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=FMK8I41TL950 type=del 2024-09-12T00:27:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.768+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=YXR8EJ0U06BT type=del size=613749 2024-09-12T00:27:39.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.768+0000 7f712938c8c0 1 < completed write operation key=0QZKHZTVP3RQ tag=GJZPG1G3HHTF type=write size=787206 2024-09-12T00:27:39.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.772+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=YHSB44GXBMS2 type=del size=4118338 2024-09-12T00:27:39.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.776+0000 7f712938c8c0 1 < completed write operation key=0QZKHZTVP3RQ tag=34CVT7N4PNFT type=write size=536922 2024-09-12T00:27:39.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.780+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=Y1R63QOMH9BO type=del size=1812114 2024-09-12T00:27:39.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.784+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~IPAY370LYBUX.0 size=1048576 2024-09-12T00:27:39.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.788+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~IPAY370LYBUX.1 size=130018 2024-09-12T00:27:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.792+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=IPAY370LYBUX tag=89VMS7ZPQUZN type=write size=2227170 2024-09-12T00:27:39.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.800+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~Z3BMRZII79NK.0 size=1048576 2024-09-12T00:27:39.803 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.804+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~Z3BMRZII79NK.1 size=1048576 2024-09-12T00:27:39.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.804+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~Z3BMRZII79NK.2 size=761923 2024-09-12T00:27:39.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.804+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=Z3BMRZII79NK tag=7YQBI1JCBMW0 type=write size=3907651 2024-09-12T00:27:39.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.808+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~9LYXS78NI722.0 size=1048576 2024-09-12T00:27:39.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.812+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~9LYXS78NI722.1 size=25974 2024-09-12T00:27:39.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.820+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=9LYXS78NI722 tag=4FKNN0RHMAXB type=write size=2123126 2024-09-12T00:27:39.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.824+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=YBTGWLXJG7HT type=del size=1002678 2024-09-12T00:27:39.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.824+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=E6ELDJJ80VK7 type=del 2024-09-12T00:27:39.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.828+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=F68H5GVORE7A type=del size=969088 2024-09-12T00:27:39.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.832+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=GWD34M1PBU4R type=del 2024-09-12T00:27:39.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.840+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~GXHXPKU6H4CT.0 size=1048576 2024-09-12T00:27:39.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.840+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~GXHXPKU6H4CT.1 size=1048576 2024-09-12T00:27:39.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.844+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~GXHXPKU6H4CT.2 size=720642 2024-09-12T00:27:39.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.844+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=GXHXPKU6H4CT tag=EM5Q972M6XTU type=write size=3866370 2024-09-12T00:27:39.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.848+0000 7f712938c8c0 1 < completed write operation key=F7T79C7MZX35 tag=WM2AZGPEZ8GK type=write size=392871 2024-09-12T00:27:39.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.852+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=TFLX2DY4G54E type=write size=387824 2024-09-12T00:27:39.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.852+0000 7f712938c8c0 1 < canceled part key=_multipart_ZP88X00LMVSS.2~M0PU2JL0W3GL.0 size=1048576 2024-09-12T00:27:39.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.856+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~M0PU2JL0W3GL.1 size=1048576 2024-09-12T00:27:39.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.860+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~M0PU2JL0W3GL.2 size=708709 2024-09-12T00:27:39.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.864+0000 7f712938c8c0 1 < canceled multipart upload key=ZP88X00LMVSS upload=M0PU2JL0W3GL tag=AJB5RB11IELX type=write size=3854437 2024-09-12T00:27:39.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.868+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=0HABGMT7X68Z type=del size=3352085 2024-09-12T00:27:39.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.872+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=83VSWFB15517 type=del 2024-09-12T00:27:39.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.876+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=WSMPFJ7GQWL7 type=del size=1463199 2024-09-12T00:27:39.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.880+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~I11U7YFJETIB.0 size=1048576 2024-09-12T00:27:39.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.884+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~I11U7YFJETIB.1 size=1048576 2024-09-12T00:27:39.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.884+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~I11U7YFJETIB.2 size=764404 2024-09-12T00:27:39.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.892+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=I11U7YFJETIB tag=6DXZIC8WORVQ type=write size=3910132 2024-09-12T00:27:39.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.900+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~8QCHLY8CNHLY.0 size=466679 2024-09-12T00:27:39.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.900+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=8QCHLY8CNHLY tag=2RVT0O168YTX type=write size=1515255 2024-09-12T00:27:39.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.904+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~K0XZGJCCTVQR.0 size=1048576 2024-09-12T00:27:39.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.904+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~K0XZGJCCTVQR.1 size=1048576 2024-09-12T00:27:39.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.908+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~K0XZGJCCTVQR.2 size=759771 2024-09-12T00:27:39.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.916+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=K0XZGJCCTVQR tag=MA1139JORVFS type=write size=3905499 2024-09-12T00:27:39.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.920+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=AZQ6Z3I69HVR type=del size=2217772 2024-09-12T00:27:39.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.924+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=XP19FQKPEGCR type=del 2024-09-12T00:27:39.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.928+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~T73A3LNDFOVL.0 size=1048576 2024-09-12T00:27:39.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.936+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~T73A3LNDFOVL.1 size=1048576 2024-09-12T00:27:39.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.936+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~T73A3LNDFOVL.2 size=924813 2024-09-12T00:27:39.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.936+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=T73A3LNDFOVL tag=2J0FWA176V3T type=write size=4070541 2024-09-12T00:27:39.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.940+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~WR424MEPEXQS.0 size=1048576 2024-09-12T00:27:39.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.944+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~WR424MEPEXQS.1 size=701254 2024-09-12T00:27:39.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.952+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=WR424MEPEXQS tag=QPPWSIQ2YZX9 type=write size=2798406 2024-09-12T00:27:39.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.956+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~FEMTGU2ANEGH.0 size=32260 2024-09-12T00:27:39.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.956+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=FEMTGU2ANEGH tag=0HLKO4BMQUHW type=write size=1080836 2024-09-12T00:27:39.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.960+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~HQJSEP4A1HWX.0 size=1048576 2024-09-12T00:27:39.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.964+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~HQJSEP4A1HWX.1 size=358644 2024-09-12T00:27:39.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.972+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=HQJSEP4A1HWX tag=RPCWS1AVWYWG type=write size=2455796 2024-09-12T00:27:39.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.976+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=D68KP035KK1P type=write size=999607 2024-09-12T00:27:39.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.980+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=E4MI9XW29FHD type=del 2024-09-12T00:27:39.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.984+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=RHEFT5VH1AUJ type=del size=2807016 2024-09-12T00:27:39.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.988+0000 7f712938c8c0 1 < canceled operation key=A8L061CQ0M0J tag=YXR8EJ0U06BT type=del size=613749 2024-09-12T00:27:39.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.988+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=YDK20WBEJ2H1 type=del size=3684938 2024-09-12T00:27:39.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.992+0000 7f712938c8c0 1 < canceled operation key=V9K2307BGOKP tag=YHSB44GXBMS2 type=del size=4118338 2024-09-12T00:27:39.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:39.996+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=L0VK2BIJJ09J type=del size=1017020 2024-09-12T00:27:40.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.000+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=Y1R63QOMH9BO type=del 2024-09-12T00:27:40.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.008+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~7B1GHQMDINOO.0 size=1048576 2024-09-12T00:27:40.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.012+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~7B1GHQMDINOO.1 size=593154 2024-09-12T00:27:40.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.012+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=7B1GHQMDINOO tag=BMMV7WSC8AVU type=write size=2690306 2024-09-12T00:27:40.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.016+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~Z3BMRZII79NK.0 size=1048576 2024-09-12T00:27:40.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.020+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~Z3BMRZII79NK.1 size=1048576 2024-09-12T00:27:40.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.020+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~Z3BMRZII79NK.2 size=761923 2024-09-12T00:27:40.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.028+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=Z3BMRZII79NK tag=7YQBI1JCBMW0 type=write size=3907651 2024-09-12T00:27:40.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.032+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~Z3KTI8Z7FVE2.0 size=456441 2024-09-12T00:27:40.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.032+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=Z3KTI8Z7FVE2 tag=OXH2KWYW08S8 type=write size=1505017 2024-09-12T00:27:40.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.036+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=YBTGWLXJG7HT type=del 2024-09-12T00:27:40.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.040+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=OJQKZ1MF0SMF type=del size=3553737 2024-09-12T00:27:40.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.044+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=F68H5GVORE7A type=del 2024-09-12T00:27:40.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.048+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=H7LV09QXVQ9Y type=del size=4179574 2024-09-12T00:27:40.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.052+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~GXHXPKU6H4CT.0 size=1048576 2024-09-12T00:27:40.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.056+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~GXHXPKU6H4CT.1 size=1048576 2024-09-12T00:27:40.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.056+0000 7f712938c8c0 1 < canceled part key=_multipart_V9K2307BGOKP.2~GXHXPKU6H4CT.2 size=720642 2024-09-12T00:27:40.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.060+0000 7f712938c8c0 1 < canceled multipart upload key=V9K2307BGOKP upload=GXHXPKU6H4CT tag=EM5Q972M6XTU type=write size=3866370 2024-09-12T00:27:40.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.064+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=MCA27ZL2QXWQ type=del size=2413985 2024-09-12T00:27:40.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.072+0000 7f712938c8c0 1 < suggested update operation key=ZP88X00LMVSS tag=TFLX2DY4G54E type=write size=387824 2024-09-12T00:27:40.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.080+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~T3S94K5JOX4K.0 size=1048576 2024-09-12T00:27:40.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.080+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~T3S94K5JOX4K.1 size=1048576 2024-09-12T00:27:40.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.084+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~T3S94K5JOX4K.2 size=26439 2024-09-12T00:27:40.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.084+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=T3S94K5JOX4K tag=75FQ9LSZC1PM type=write size=3172167 2024-09-12T00:27:40.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.088+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=0HABGMT7X68Z type=del 2024-09-12T00:27:40.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.092+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=HLX9LR7BOUJ7 type=del size=1803262 2024-09-12T00:27:40.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.096+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=WSMPFJ7GQWL7 type=del 2024-09-12T00:27:40.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.100+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=8PZ1D41QA6B8 type=del size=1985462 2024-09-12T00:27:40.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.104+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~8QCHLY8CNHLY.0 size=466679 2024-09-12T00:27:40.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.108+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=8QCHLY8CNHLY tag=2RVT0O168YTX type=write size=1515255 2024-09-12T00:27:40.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.116+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~P1BFJEHUNXBZ.0 size=1048576 2024-09-12T00:27:40.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.120+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~P1BFJEHUNXBZ.1 size=603236 2024-09-12T00:27:40.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.120+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=P1BFJEHUNXBZ tag=ILW2C9SPRN75 type=write size=2700388 2024-09-12T00:27:40.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.124+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=AZQ6Z3I69HVR type=del 2024-09-12T00:27:40.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.128+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=MGR1LH6BRSAP type=del size=2099040 2024-09-12T00:27:40.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.132+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~T73A3LNDFOVL.0 size=1048576 2024-09-12T00:27:40.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.136+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~T73A3LNDFOVL.1 size=1048576 2024-09-12T00:27:40.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.136+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~T73A3LNDFOVL.2 size=924813 2024-09-12T00:27:40.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.144+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=T73A3LNDFOVL tag=2J0FWA176V3T type=write size=4070541 2024-09-12T00:27:40.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.148+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=G8HM3F8RLGDX type=del size=569158 2024-09-12T00:27:40.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.152+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~FEMTGU2ANEGH.0 size=32260 2024-09-12T00:27:40.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.156+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=FEMTGU2ANEGH tag=0HLKO4BMQUHW type=write size=1080836 2024-09-12T00:27:40.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.160+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=KJPBRJEMRJGZ type=write size=57175 2024-09-12T00:27:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.164+0000 7f712938c8c0 1 < completed write operation key=HPM9GFRASWIV tag=D68KP035KK1P type=write size=999607 2024-09-12T00:27:40.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.172+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~31LTCIW06O5T.0 size=1048576 2024-09-12T00:27:40.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.176+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~31LTCIW06O5T.1 size=1048576 2024-09-12T00:27:40.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.176+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~31LTCIW06O5T.2 size=803028 2024-09-12T00:27:40.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.176+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=31LTCIW06O5T tag=OXIUDZ82PWOY type=write size=3948756 2024-09-12T00:27:40.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.184+0000 7f712938c8c0 1 < suggested update operation key=KNGB14TWW6XC tag=RHEFT5VH1AUJ type=del size=2807016 2024-09-12T00:27:40.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.192+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=A0U9QLNHU2AG type=del size=682756 2024-09-12T00:27:40.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.192+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=YDK20WBEJ2H1 type=del 2024-09-12T00:27:40.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.200+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~Y1Y13J88F3EK.0 size=1048576 2024-09-12T00:27:40.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.204+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~Y1Y13J88F3EK.1 size=1048576 2024-09-12T00:27:40.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.208+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~Y1Y13J88F3EK.2 size=966049 2024-09-12T00:27:40.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.208+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=Y1Y13J88F3EK tag=GFGQDC5V1X1J type=write size=4111777 2024-09-12T00:27:40.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.216+0000 7f712938c8c0 1 < suggested update operation key=T1H3O6A6HBQH tag=L0VK2BIJJ09J type=del size=1017020 2024-09-12T00:27:40.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.220+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~5UGJE5HDKAME.0 size=682617 2024-09-12T00:27:40.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.220+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=5UGJE5HDKAME tag=QBDOGI9T3TQU type=write size=1731193 2024-09-12T00:27:40.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.228+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~7B1GHQMDINOO.0 size=1048576 2024-09-12T00:27:40.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.228+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~7B1GHQMDINOO.1 size=593154 2024-09-12T00:27:40.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.236+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=7B1GHQMDINOO tag=BMMV7WSC8AVU type=write size=2690306 2024-09-12T00:27:40.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.244+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~KQHE52SHO7O5.0 size=1048576 2024-09-12T00:27:40.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.244+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~KQHE52SHO7O5.1 size=677528 2024-09-12T00:27:40.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.244+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=KQHE52SHO7O5 tag=N45OY19NFYBV type=write size=2774680 2024-09-12T00:27:40.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.248+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~Z3KTI8Z7FVE2.0 size=456441 2024-09-12T00:27:40.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.256+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=Z3KTI8Z7FVE2 tag=OXH2KWYW08S8 type=write size=1505017 2024-09-12T00:27:40.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.264+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~4E6SM09ABG9N.0 size=375392 2024-09-12T00:27:40.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.264+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=4E6SM09ABG9N tag=6LGO1QBUHG9L type=write size=1423968 2024-09-12T00:27:40.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.268+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=OJQKZ1MF0SMF type=del 2024-09-12T00:27:40.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.272+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=HVZZEJFGC9JT type=del size=678921 2024-09-12T00:27:40.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.276+0000 7f712938c8c0 1 < suggested update operation key=9YZP0TIRWWRF tag=H7LV09QXVQ9Y type=del size=4179574 2024-09-12T00:27:40.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.284+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=9Q6ZI6Q22T9I type=write size=726011 2024-09-12T00:27:40.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.288+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=MCA27ZL2QXWQ type=del 2024-09-12T00:27:40.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.292+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=740OLNBPALKA type=del size=458164 2024-09-12T00:27:40.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.296+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~T3S94K5JOX4K.0 size=1048576 2024-09-12T00:27:40.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.300+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~T3S94K5JOX4K.1 size=1048576 2024-09-12T00:27:40.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.300+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~T3S94K5JOX4K.2 size=26439 2024-09-12T00:27:40.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.308+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=T3S94K5JOX4K tag=75FQ9LSZC1PM type=write size=3172167 2024-09-12T00:27:40.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.312+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=S2T9O8Q7WJQ4 type=del size=4058400 2024-09-12T00:27:40.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.316+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=HLX9LR7BOUJ7 type=del 2024-09-12T00:27:40.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.324+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~1CK8T1XMSABN.0 size=255997 2024-09-12T00:27:40.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.324+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=1CK8T1XMSABN tag=GJ1I2MKNG26I type=write size=1304573 2024-09-12T00:27:40.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.324+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=8PZ1D41QA6B8 type=del 2024-09-12T00:27:40.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.328+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=3KDR5GMMFFAY type=write size=1015954 2024-09-12T00:27:40.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.332+0000 7f712938c8c0 1 < canceled part key=_multipart_HPM9GFRASWIV.2~P1BFJEHUNXBZ.0 size=1048576 2024-09-12T00:27:40.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.332+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~P1BFJEHUNXBZ.1 size=603236 2024-09-12T00:27:40.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.340+0000 7f712938c8c0 1 < canceled multipart upload key=HPM9GFRASWIV upload=P1BFJEHUNXBZ tag=ILW2C9SPRN75 type=write size=2700388 2024-09-12T00:27:40.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.344+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~EZ35G5J3388N.0 size=1048576 2024-09-12T00:27:40.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.348+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~EZ35G5J3388N.1 size=1048576 2024-09-12T00:27:40.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.352+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~EZ35G5J3388N.2 size=983901 2024-09-12T00:27:40.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.352+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=EZ35G5J3388N tag=DJ102GY8OQGI type=write size=4129629 2024-09-12T00:27:40.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.356+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=MGR1LH6BRSAP type=del 2024-09-12T00:27:40.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.360+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=CCRPYPMXO2YM type=del size=3762694 2024-09-12T00:27:40.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.364+0000 7f712938c8c0 1 < canceled operation key=KEMQ3H8LAUI9 tag=G8HM3F8RLGDX type=del size=569158 2024-09-12T00:27:40.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.368+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=WQ6WY1LQGUKQ type=write size=578266 2024-09-12T00:27:40.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.372+0000 7f712938c8c0 1 < completed write operation key=GZON46MODQZO tag=KJPBRJEMRJGZ type=write size=57175 2024-09-12T00:27:40.376 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.376+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=955GAJC2O74O type=del size=1986988 2024-09-12T00:27:40.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.380+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~31LTCIW06O5T.0 size=1048576 2024-09-12T00:27:40.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.380+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~31LTCIW06O5T.1 size=1048576 2024-09-12T00:27:40.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.384+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~31LTCIW06O5T.2 size=803028 2024-09-12T00:27:40.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.392+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=31LTCIW06O5T tag=OXIUDZ82PWOY type=write size=3948756 2024-09-12T00:27:40.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.396+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~EAY5R7UM34JW.0 size=1048576 2024-09-12T00:27:40.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.400+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~EAY5R7UM34JW.1 size=567940 2024-09-12T00:27:40.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.400+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=EAY5R7UM34JW tag=5VJ2AL1RIKOH type=write size=2665092 2024-09-12T00:27:40.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.404+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=A0U9QLNHU2AG type=del 2024-09-12T00:27:40.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.412+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~BVBRFJ6KBNMO.0 size=1048576 2024-09-12T00:27:40.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.412+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~BVBRFJ6KBNMO.1 size=1048576 2024-09-12T00:27:40.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.416+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~BVBRFJ6KBNMO.2 size=196101 2024-09-12T00:27:40.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.416+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=BVBRFJ6KBNMO tag=E5VDIF8Z3P9B type=write size=3341829 2024-09-12T00:27:40.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.420+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~Y1Y13J88F3EK.0 size=1048576 2024-09-12T00:27:40.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.420+0000 7f712938c8c0 1 < canceled part key=_multipart_BH2YHXHVEZCH.2~Y1Y13J88F3EK.1 size=1048576 2024-09-12T00:27:40.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.424+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~Y1Y13J88F3EK.2 size=966049 2024-09-12T00:27:40.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.428+0000 7f712938c8c0 1 < canceled multipart upload key=BH2YHXHVEZCH upload=Y1Y13J88F3EK tag=GFGQDC5V1X1J type=write size=4111777 2024-09-12T00:27:40.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.432+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=ENH2DPWEF230 type=del size=3203276 2024-09-12T00:27:40.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.436+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~5UGJE5HDKAME.0 size=682617 2024-09-12T00:27:40.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.444+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=5UGJE5HDKAME tag=QBDOGI9T3TQU type=write size=1731193 2024-09-12T00:27:40.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.452+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~7NZZP1GJYKHS.0 size=1048576 2024-09-12T00:27:40.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.452+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~7NZZP1GJYKHS.1 size=127056 2024-09-12T00:27:40.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.452+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=7NZZP1GJYKHS tag=IPM075U1QIJS type=write size=2224208 2024-09-12T00:27:40.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.456+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~KQHE52SHO7O5.0 size=1048576 2024-09-12T00:27:40.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.460+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~KQHE52SHO7O5.1 size=677528 2024-09-12T00:27:40.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.468+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=KQHE52SHO7O5 tag=N45OY19NFYBV type=write size=2774680 2024-09-12T00:27:40.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.476+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~22JEJK186CLN.0 size=1048576 2024-09-12T00:27:40.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.476+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~22JEJK186CLN.1 size=60679 2024-09-12T00:27:40.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.476+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=22JEJK186CLN tag=C98SP0CZ092V type=write size=2157831 2024-09-12T00:27:40.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.480+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~4E6SM09ABG9N.0 size=375392 2024-09-12T00:27:40.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.488+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=4E6SM09ABG9N tag=6LGO1QBUHG9L type=write size=1423968 2024-09-12T00:27:40.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.492+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=BD9MBVDI8AZS type=del size=2027320 2024-09-12T00:27:40.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.496+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=HVZZEJFGC9JT type=del 2024-09-12T00:27:40.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.496+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=NYDHJRF9E26S type=del size=4043110 2024-09-12T00:27:40.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.500+0000 7f712938c8c0 1 < completed write operation key=QL3FL4J9TKY4 tag=9Q6ZI6Q22T9I type=write size=726011 2024-09-12T00:27:40.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.504+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=CFS9OORZTZDW type=del size=1463522 2024-09-12T00:27:40.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.508+0000 7f712938c8c0 1 < canceled operation key=UAJEZUYXN2R0 tag=740OLNBPALKA type=del size=458164 2024-09-12T00:27:40.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.516+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~REZU5Z4CX0FE.0 size=1048576 2024-09-12T00:27:40.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.520+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~REZU5Z4CX0FE.1 size=641762 2024-09-12T00:27:40.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.520+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=REZU5Z4CX0FE tag=4YVEWWVG9I7O type=write size=2738914 2024-09-12T00:27:40.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.524+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=S2T9O8Q7WJQ4 type=del 2024-09-12T00:27:40.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.532+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~6ENIRB97BFHR.0 size=154911 2024-09-12T00:27:40.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.532+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=6ENIRB97BFHR tag=9LKPSJPYD423 type=write size=1203487 2024-09-12T00:27:40.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.532+0000 7f712938c8c0 1 < canceled part key=_multipart_VAFU5FXA2KLC.2~1CK8T1XMSABN.0 size=255997 2024-09-12T00:27:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.536+0000 7f712938c8c0 1 < canceled multipart upload key=VAFU5FXA2KLC upload=1CK8T1XMSABN tag=GJ1I2MKNG26I type=write size=1304573 2024-09-12T00:27:40.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.544+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~6ILY7YJ8WZ2M.0 size=565158 2024-09-12T00:27:40.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.544+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=6ILY7YJ8WZ2M tag=BG1FU5W8IOX7 type=write size=1613734 2024-09-12T00:27:40.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.548+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=3KDR5GMMFFAY type=write size=1015954 2024-09-12T00:27:40.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.552+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=9S83C26AEXFW type=del size=4095679 2024-09-12T00:27:40.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.556+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~EZ35G5J3388N.0 size=1048576 2024-09-12T00:27:40.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.560+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~EZ35G5J3388N.1 size=1048576 2024-09-12T00:27:40.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.560+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~EZ35G5J3388N.2 size=983901 2024-09-12T00:27:40.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.568+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=EZ35G5J3388N tag=DJ102GY8OQGI type=write size=4129629 2024-09-12T00:27:40.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.572+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=R3KC314FKXWH type=del size=2108964 2024-09-12T00:27:40.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.572+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=CCRPYPMXO2YM type=del 2024-09-12T00:27:40.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.580+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~PVTYAT0BVOW9.0 size=1048576 2024-09-12T00:27:40.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.584+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~PVTYAT0BVOW9.1 size=1048576 2024-09-12T00:27:40.585 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.584+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~PVTYAT0BVOW9.2 size=200512 2024-09-12T00:27:40.585 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.584+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=PVTYAT0BVOW9 tag=8SM6LCU4GG6O type=write size=3346240 2024-09-12T00:27:40.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.588+0000 7f712938c8c0 1 < completed write operation key=UAJEZUYXN2R0 tag=WQ6WY1LQGUKQ type=write size=578266 2024-09-12T00:27:40.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.592+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~IHI62N0ISIXF.0 size=1048576 2024-09-12T00:27:40.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.596+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~IHI62N0ISIXF.1 size=491892 2024-09-12T00:27:40.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.596+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=IHI62N0ISIXF tag=AJVB6FUOM46L type=write size=2589044 2024-09-12T00:27:40.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.604+0000 7f712938c8c0 1 < suggested remove operation key=F7T79C7MZX35 tag=955GAJC2O74O type=del 2024-09-12T00:27:40.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.604+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=PVW159G09ST7 type=del size=1919284 2024-09-12T00:27:40.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.608+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~EAY5R7UM34JW.0 size=1048576 2024-09-12T00:27:40.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.612+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~EAY5R7UM34JW.1 size=567940 2024-09-12T00:27:40.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.620+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=EAY5R7UM34JW tag=5VJ2AL1RIKOH type=write size=2665092 2024-09-12T00:27:40.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.624+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=Z1952Q33MQWT type=del size=3129403 2024-09-12T00:27:40.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.628+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~BVBRFJ6KBNMO.0 size=1048576 2024-09-12T00:27:40.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.628+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~BVBRFJ6KBNMO.1 size=1048576 2024-09-12T00:27:40.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.632+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~BVBRFJ6KBNMO.2 size=196101 2024-09-12T00:27:40.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.640+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=BVBRFJ6KBNMO tag=E5VDIF8Z3P9B type=write size=3341829 2024-09-12T00:27:40.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.644+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~QA8X60BLS6WW.0 size=526546 2024-09-12T00:27:40.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.644+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=QA8X60BLS6WW tag=UH00ABEES10A type=write size=1575122 2024-09-12T00:27:40.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.648+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=ENH2DPWEF230 type=del 2024-09-12T00:27:40.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.652+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=TV3VVYFSFZ80 type=del size=2766820 2024-09-12T00:27:40.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.656+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~7NZZP1GJYKHS.0 size=1048576 2024-09-12T00:27:40.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.656+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~7NZZP1GJYKHS.1 size=127056 2024-09-12T00:27:40.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.664+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=7NZZP1GJYKHS tag=IPM075U1QIJS type=write size=2224208 2024-09-12T00:27:40.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.668+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~ZPAQPB0NQOKW.0 size=1048576 2024-09-12T00:27:40.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.672+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~ZPAQPB0NQOKW.1 size=1048576 2024-09-12T00:27:40.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.676+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~ZPAQPB0NQOKW.2 size=494992 2024-09-12T00:27:40.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.676+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=ZPAQPB0NQOKW tag=Q7VAB60AKHI9 type=write size=3640720 2024-09-12T00:27:40.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.680+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~22JEJK186CLN.0 size=1048576 2024-09-12T00:27:40.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.680+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~22JEJK186CLN.1 size=60679 2024-09-12T00:27:40.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.688+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=22JEJK186CLN tag=C98SP0CZ092V type=write size=2157831 2024-09-12T00:27:40.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.688+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=V5FIASR3IYLO type=write size=945531 2024-09-12T00:27:40.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.692+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=BD9MBVDI8AZS type=del 2024-09-12T00:27:40.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.696+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=G5IDJ4Y6N3SC type=del size=861871 2024-09-12T00:27:40.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.700+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=NYDHJRF9E26S type=del 2024-09-12T00:27:40.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.708+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~U61QA0QPAOOP.0 size=1048576 2024-09-12T00:27:40.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.708+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~U61QA0QPAOOP.1 size=1048576 2024-09-12T00:27:40.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.712+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~U61QA0QPAOOP.2 size=1013890 2024-09-12T00:27:40.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.712+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=U61QA0QPAOOP tag=XYQJL5JF2CUB type=write size=4159618 2024-09-12T00:27:40.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.716+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=CFS9OORZTZDW type=del 2024-09-12T00:27:40.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.724+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~T1G2QU5ZGTIQ.0 size=1048576 2024-09-12T00:27:40.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.724+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~T1G2QU5ZGTIQ.1 size=866240 2024-09-12T00:27:40.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.724+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=T1G2QU5ZGTIQ tag=1AE8TQFJP4JN type=write size=2963392 2024-09-12T00:27:40.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.728+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~REZU5Z4CX0FE.0 size=1048576 2024-09-12T00:27:40.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.732+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~REZU5Z4CX0FE.1 size=641762 2024-09-12T00:27:40.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.736+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=REZU5Z4CX0FE tag=4YVEWWVG9I7O type=write size=2738914 2024-09-12T00:27:40.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.744+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~A6C7U3U2RM1Q.0 size=1048576 2024-09-12T00:27:40.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.748+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~A6C7U3U2RM1Q.1 size=1048576 2024-09-12T00:27:40.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.748+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~A6C7U3U2RM1Q.2 size=883099 2024-09-12T00:27:40.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.748+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=A6C7U3U2RM1Q tag=GW38D103Y9FN type=write size=4028827 2024-09-12T00:27:40.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.752+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~6ENIRB97BFHR.0 size=154911 2024-09-12T00:27:40.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.760+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=6ENIRB97BFHR tag=9LKPSJPYD423 type=write size=1203487 2024-09-12T00:27:40.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.764+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~JHXLL2SHAYZW.0 size=1048576 2024-09-12T00:27:40.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.768+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~JHXLL2SHAYZW.1 size=1048576 2024-09-12T00:27:40.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.772+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~JHXLL2SHAYZW.2 size=957542 2024-09-12T00:27:40.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.772+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=JHXLL2SHAYZW tag=1VFT6YTAHFNE type=write size=4103270 2024-09-12T00:27:40.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.776+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~6ILY7YJ8WZ2M.0 size=565158 2024-09-12T00:27:40.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.780+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=6ILY7YJ8WZ2M tag=BG1FU5W8IOX7 type=write size=1613734 2024-09-12T00:27:40.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.788+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~2DEJXIMHSMAS.0 size=1048576 2024-09-12T00:27:40.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.788+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~2DEJXIMHSMAS.1 size=1048576 2024-09-12T00:27:40.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.792+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~2DEJXIMHSMAS.2 size=625247 2024-09-12T00:27:40.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.792+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=2DEJXIMHSMAS tag=VM7JSM7UG53B type=write size=3770975 2024-09-12T00:27:40.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.800+0000 7f712938c8c0 1 < suggested update operation key=9751RNPPQJBO tag=9S83C26AEXFW type=del size=4095679 2024-09-12T00:27:40.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.804+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=F6D7ZTPWVKYI type=del size=3312486 2024-09-12T00:27:40.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.808+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=R3KC314FKXWH type=del 2024-09-12T00:27:40.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.812+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~HL1DMZVV0WQU.0 size=1048576 2024-09-12T00:27:40.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.816+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~HL1DMZVV0WQU.1 size=1048576 2024-09-12T00:27:40.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.816+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~HL1DMZVV0WQU.2 size=94010 2024-09-12T00:27:40.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.816+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=HL1DMZVV0WQU tag=9X20INY2VMP8 type=write size=3239738 2024-09-12T00:27:40.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.820+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~PVTYAT0BVOW9.0 size=1048576 2024-09-12T00:27:40.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.824+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~PVTYAT0BVOW9.1 size=1048576 2024-09-12T00:27:40.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.828+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~PVTYAT0BVOW9.2 size=200512 2024-09-12T00:27:40.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.832+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=PVTYAT0BVOW9 tag=8SM6LCU4GG6O type=write size=3346240 2024-09-12T00:27:40.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.836+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=7RJ8JXY6MON9 type=del size=3288877 2024-09-12T00:27:40.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.840+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~IHI62N0ISIXF.0 size=1048576 2024-09-12T00:27:40.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.840+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~IHI62N0ISIXF.1 size=491892 2024-09-12T00:27:40.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.848+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=IHI62N0ISIXF tag=AJVB6FUOM46L type=write size=2589044 2024-09-12T00:27:40.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.852+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=7KCI23A58DOG type=del size=3589388 2024-09-12T00:27:40.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.856+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=PVW159G09ST7 type=del 2024-09-12T00:27:40.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.860+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~GW7E7UGZG25M.0 size=209944 2024-09-12T00:27:40.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.860+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=GW7E7UGZG25M tag=OZIMJI0H8SBJ type=write size=1258520 2024-09-12T00:27:40.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.868+0000 7f712938c8c0 1 < suggested update operation key=W01PFMFNYLED tag=Z1952Q33MQWT type=del size=3129403 2024-09-12T00:27:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.876+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~8SEZSD9V1VFU.0 size=1048576 2024-09-12T00:27:40.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.876+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~8SEZSD9V1VFU.1 size=1048576 2024-09-12T00:27:40.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.880+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~8SEZSD9V1VFU.2 size=591176 2024-09-12T00:27:40.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.880+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=8SEZSD9V1VFU tag=UQTQZ2GMUQNL type=write size=3736904 2024-09-12T00:27:40.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.884+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~QA8X60BLS6WW.0 size=526546 2024-09-12T00:27:40.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.888+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=QA8X60BLS6WW tag=UH00ABEES10A type=write size=1575122 2024-09-12T00:27:40.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.896+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~GGAF7Q8TIQ9I.0 size=1048576 2024-09-12T00:27:40.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.896+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~GGAF7Q8TIQ9I.1 size=1048576 2024-09-12T00:27:40.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.900+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~GGAF7Q8TIQ9I.2 size=291752 2024-09-12T00:27:40.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.900+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=GGAF7Q8TIQ9I tag=LTYJ77ZOSXU0 type=write size=3437480 2024-09-12T00:27:40.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.904+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=TV3VVYFSFZ80 type=del 2024-09-12T00:27:40.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.908+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=0LGQWWIKNUR2 type=write size=772951 2024-09-12T00:27:40.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.912+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~ZPAQPB0NQOKW.0 size=1048576 2024-09-12T00:27:40.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.916+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~ZPAQPB0NQOKW.1 size=1048576 2024-09-12T00:27:40.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.920+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~ZPAQPB0NQOKW.2 size=494992 2024-09-12T00:27:40.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.924+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=ZPAQPB0NQOKW tag=Q7VAB60AKHI9 type=write size=3640720 2024-09-12T00:27:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.928+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=EN6IWHGX8JW2 type=del size=205006 2024-09-12T00:27:40.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.932+0000 7f712938c8c0 1 < completed write operation key=Z2RYL03II71Z tag=V5FIASR3IYLO type=write size=945531 2024-09-12T00:27:40.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.940+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=PWRGQUD3B8AD type=del size=3825372 2024-09-12T00:27:40.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.948+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=G5IDJ4Y6N3SC type=del 2024-09-12T00:27:40.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.952+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=GVU0QCPR6RKE type=del size=226000 2024-09-12T00:27:40.954 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.956+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~U61QA0QPAOOP.0 size=1048576 2024-09-12T00:27:40.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.956+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~U61QA0QPAOOP.1 size=1048576 2024-09-12T00:27:40.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.960+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~U61QA0QPAOOP.2 size=1013890 2024-09-12T00:27:40.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.964+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=U61QA0QPAOOP tag=XYQJL5JF2CUB type=write size=4159618 2024-09-12T00:27:40.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.972+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~RWKYV5CKW50E.0 size=1048576 2024-09-12T00:27:40.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.976+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~RWKYV5CKW50E.1 size=935516 2024-09-12T00:27:40.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.976+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=RWKYV5CKW50E tag=3BJ7J5B04VI5 type=write size=3032668 2024-09-12T00:27:40.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.980+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~T1G2QU5ZGTIQ.0 size=1048576 2024-09-12T00:27:40.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.984+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~T1G2QU5ZGTIQ.1 size=866240 2024-09-12T00:27:40.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.988+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=T1G2QU5ZGTIQ tag=1AE8TQFJP4JN type=write size=2963392 2024-09-12T00:27:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.992+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=SWW9MVBY5RPZ type=del size=1291921 2024-09-12T00:27:40.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:40.996+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~A6C7U3U2RM1Q.0 size=1048576 2024-09-12T00:27:40.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.000+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~A6C7U3U2RM1Q.1 size=1048576 2024-09-12T00:27:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.004+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~A6C7U3U2RM1Q.2 size=883099 2024-09-12T00:27:41.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.008+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=A6C7U3U2RM1Q tag=GW38D103Y9FN type=write size=4028827 2024-09-12T00:27:41.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.012+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=3O4MS63H8OTQ type=write size=798543 2024-09-12T00:27:41.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.016+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~JHXLL2SHAYZW.0 size=1048576 2024-09-12T00:27:41.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.020+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~JHXLL2SHAYZW.1 size=1048576 2024-09-12T00:27:41.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.020+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~JHXLL2SHAYZW.2 size=957542 2024-09-12T00:27:41.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.024+0000 7f712938c8c0 1 < canceled multipart upload key=9751RNPPQJBO upload=JHXLL2SHAYZW tag=1VFT6YTAHFNE type=write size=4103270 2024-09-12T00:27:41.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.032+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=3TNH7M11F8I5 type=del size=3536234 2024-09-12T00:27:41.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.036+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~2DEJXIMHSMAS.0 size=1048576 2024-09-12T00:27:41.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.036+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~2DEJXIMHSMAS.1 size=1048576 2024-09-12T00:27:41.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.040+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~2DEJXIMHSMAS.2 size=625247 2024-09-12T00:27:41.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.048+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=2DEJXIMHSMAS tag=VM7JSM7UG53B type=write size=3770975 2024-09-12T00:27:41.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.052+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=AMW5T6BPPSKH type=write size=325574 2024-09-12T00:27:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.056+0000 7f712938c8c0 -1 < failed to complete operation key=W01PFMFNYLED tag=F6D7ZTPWVKYI type=del size=3312486: (22) Invalid argument 2024-09-12T00:27:41.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.060+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=YEEJPLJ439C5 type=del size=1951513 2024-09-12T00:27:41.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.064+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~HL1DMZVV0WQU.0 size=1048576 2024-09-12T00:27:41.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.068+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~HL1DMZVV0WQU.1 size=1048576 2024-09-12T00:27:41.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.072+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~HL1DMZVV0WQU.2 size=94010 2024-09-12T00:27:41.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.076+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=HL1DMZVV0WQU tag=9X20INY2VMP8 type=write size=3239738 2024-09-12T00:27:41.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.084+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~7OAUMKF29CRY.0 size=1048576 2024-09-12T00:27:41.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.088+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~7OAUMKF29CRY.1 size=1048576 2024-09-12T00:27:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.092+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~7OAUMKF29CRY.2 size=1045823 2024-09-12T00:27:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.092+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=7OAUMKF29CRY tag=L82ZLPHC6DHA type=write size=4191551 2024-09-12T00:27:41.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.100+0000 7f712938c8c0 1 < suggested update operation key=V9K2307BGOKP tag=7RJ8JXY6MON9 type=del size=3288877 2024-09-12T00:27:41.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.104+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=FQW8GWIVTJ1J type=write size=606742 2024-09-12T00:27:41.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.108+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=7KCI23A58DOG type=del 2024-09-12T00:27:41.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.112+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=TWESSHMTG3Y2 type=del size=1933977 2024-09-12T00:27:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.116+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~GW7E7UGZG25M.0 size=209944 2024-09-12T00:27:41.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.124+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=GW7E7UGZG25M tag=OZIMJI0H8SBJ type=write size=1258520 2024-09-12T00:27:41.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.128+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~UAZKP1BH1N2F.0 size=1048576 2024-09-12T00:27:41.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.132+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~UAZKP1BH1N2F.1 size=1048576 2024-09-12T00:27:41.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.136+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~UAZKP1BH1N2F.2 size=351858 2024-09-12T00:27:41.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.136+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=UAZKP1BH1N2F tag=0KVA3T14SDBO type=write size=3497586 2024-09-12T00:27:41.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.140+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~8SEZSD9V1VFU.0 size=1048576 2024-09-12T00:27:41.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.140+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~8SEZSD9V1VFU.1 size=1048576 2024-09-12T00:27:41.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.144+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~8SEZSD9V1VFU.2 size=591176 2024-09-12T00:27:41.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.152+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=8SEZSD9V1VFU tag=UQTQZ2GMUQNL type=write size=3736904 2024-09-12T00:27:41.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.156+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=FY1JKUH2JU2P type=write size=1020026 2024-09-12T00:27:41.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.160+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~GGAF7Q8TIQ9I.0 size=1048576 2024-09-12T00:27:41.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.160+0000 7f712938c8c0 1 < canceled part key=_multipart_W01PFMFNYLED.2~GGAF7Q8TIQ9I.1 size=1048576 2024-09-12T00:27:41.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.160+0000 7f712938c8c0 1 < canceled part key=_multipart_W01PFMFNYLED.2~GGAF7Q8TIQ9I.2 size=291752 2024-09-12T00:27:41.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.164+0000 7f712938c8c0 1 < canceled multipart upload key=W01PFMFNYLED upload=GGAF7Q8TIQ9I tag=LTYJ77ZOSXU0 type=write size=3437480 2024-09-12T00:27:41.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.168+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=MD90FYND4E84 type=del size=773529 2024-09-12T00:27:41.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.176+0000 7f712938c8c0 1 < completed write operation key=A8L061CQ0M0J tag=0LGQWWIKNUR2 type=write size=772951 2024-09-12T00:27:41.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.180+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~8Q1U0O2GO180.0 size=1048576 2024-09-12T00:27:41.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.184+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~8Q1U0O2GO180.1 size=310754 2024-09-12T00:27:41.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.184+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=8Q1U0O2GO180 tag=8ZXBCYDXSZZF type=write size=2407906 2024-09-12T00:27:41.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.188+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=EN6IWHGX8JW2 type=del 2024-09-12T00:27:41.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.196+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~95CJHG1FEGIQ.0 size=432522 2024-09-12T00:27:41.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.196+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=95CJHG1FEGIQ tag=9VG8OSM0UNK7 type=write size=1481098 2024-09-12T00:27:41.202 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.200+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=PWRGQUD3B8AD type=del 2024-09-12T00:27:41.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.208+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=6NZU9CHG7NQU type=write size=1002038 2024-09-12T00:27:41.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.212+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=GVU0QCPR6RKE type=del 2024-09-12T00:27:41.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.220+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~VZVTQESN1U1E.0 size=555758 2024-09-12T00:27:41.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.220+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=VZVTQESN1U1E tag=J598OVQ9PS0B type=write size=1604334 2024-09-12T00:27:41.224 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.224+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~RWKYV5CKW50E.0 size=1048576 2024-09-12T00:27:41.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.228+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~RWKYV5CKW50E.1 size=935516 2024-09-12T00:27:41.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.232+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=RWKYV5CKW50E tag=3BJ7J5B04VI5 type=write size=3032668 2024-09-12T00:27:41.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.236+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=VOPNXAIFHUYF type=del size=2197370 2024-09-12T00:27:41.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.240+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=SWW9MVBY5RPZ type=del 2024-09-12T00:27:41.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.244+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=Q2QDAMHSSY3C type=del size=1630487 2024-09-12T00:27:41.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.248+0000 7f712938c8c0 1 < completed write operation key=QL3FL4J9TKY4 tag=3O4MS63H8OTQ type=write size=798543 2024-09-12T00:27:41.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.252+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=M4ZM3IOM249C type=del size=3482220 2024-09-12T00:27:41.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.256+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=3TNH7M11F8I5 type=del 2024-09-12T00:27:41.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.260+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=JZDK5EWT25DV type=del size=1126282 2024-09-12T00:27:41.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.268+0000 7f712938c8c0 1 < completed write operation key=9N3U208FGM79 tag=AMW5T6BPPSKH type=write size=325574 2024-09-12T00:27:41.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.272+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=X0AZHLH0R485 type=del size=397711 2024-09-12T00:27:41.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.276+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=YEEJPLJ439C5 type=del 2024-09-12T00:27:41.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.280+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~AT1O5H7PBAEC.0 size=1048576 2024-09-12T00:27:41.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.284+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~AT1O5H7PBAEC.1 size=597222 2024-09-12T00:27:41.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.284+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=AT1O5H7PBAEC tag=8OZRPRULVE11 type=write size=2694374 2024-09-12T00:27:41.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.288+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~7OAUMKF29CRY.0 size=1048576 2024-09-12T00:27:41.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.292+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~7OAUMKF29CRY.1 size=1048576 2024-09-12T00:27:41.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.296+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~7OAUMKF29CRY.2 size=1045823 2024-09-12T00:27:41.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.304+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=7OAUMKF29CRY tag=L82ZLPHC6DHA type=write size=4191551 2024-09-12T00:27:41.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.308+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=DR3UWN4QS8TX type=del size=1892627 2024-09-12T00:27:41.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.312+0000 7f712938c8c0 1 < suggested update operation key=A8L061CQ0M0J tag=FQW8GWIVTJ1J type=write size=606742 2024-09-12T00:27:41.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.316+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=YK4827XB6BKW type=write size=621251 2024-09-12T00:27:41.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.320+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=TWESSHMTG3Y2 type=del 2024-09-12T00:27:41.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.324+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=TIJS4WMM0D1Y type=del size=1253388 2024-09-12T00:27:41.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.328+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~UAZKP1BH1N2F.0 size=1048576 2024-09-12T00:27:41.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.332+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~UAZKP1BH1N2F.1 size=1048576 2024-09-12T00:27:41.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.336+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~UAZKP1BH1N2F.2 size=351858 2024-09-12T00:27:41.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.340+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=UAZKP1BH1N2F tag=0KVA3T14SDBO type=write size=3497586 2024-09-12T00:27:41.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.348+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~GN124SQMPHH5.0 size=1048576 2024-09-12T00:27:41.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.348+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~GN124SQMPHH5.1 size=558792 2024-09-12T00:27:41.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.348+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=GN124SQMPHH5 tag=0XQ1VPZWGHTS type=write size=2655944 2024-09-12T00:27:41.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.352+0000 7f712938c8c0 1 < completed write operation key=QL3FL4J9TKY4 tag=FY1JKUH2JU2P type=write size=1020026 2024-09-12T00:27:41.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.356+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=QCAXB0FX61AV type=del size=2124045 2024-09-12T00:27:41.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.360+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=MD90FYND4E84 type=del 2024-09-12T00:27:41.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.364+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=BF62JOKW0MY0 type=write size=568828 2024-09-12T00:27:41.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.368+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~8Q1U0O2GO180.0 size=1048576 2024-09-12T00:27:41.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.372+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~8Q1U0O2GO180.1 size=310754 2024-09-12T00:27:41.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.380+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=8Q1U0O2GO180 tag=8ZXBCYDXSZZF type=write size=2407906 2024-09-12T00:27:41.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.384+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~R1RMQ0KAN077.0 size=1048576 2024-09-12T00:27:41.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.388+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~R1RMQ0KAN077.1 size=1048576 2024-09-12T00:27:41.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.392+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~R1RMQ0KAN077.2 size=845598 2024-09-12T00:27:41.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.392+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=R1RMQ0KAN077 tag=7OR30YAX2CIY type=write size=3991326 2024-09-12T00:27:41.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.396+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~95CJHG1FEGIQ.0 size=432522 2024-09-12T00:27:41.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.400+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=95CJHG1FEGIQ tag=9VG8OSM0UNK7 type=write size=1481098 2024-09-12T00:27:41.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.404+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=61XBN4DLXFOA type=del size=3732209 2024-09-12T00:27:41.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.412+0000 7f712938c8c0 1 < suggested update operation key=9YZP0TIRWWRF tag=6NZU9CHG7NQU type=write size=1002038 2024-09-12T00:27:41.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.416+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=G0IGE9PXN8YY type=write size=349000 2024-09-12T00:27:41.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.420+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~VZVTQESN1U1E.0 size=555758 2024-09-12T00:27:41.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.424+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=VZVTQESN1U1E tag=J598OVQ9PS0B type=write size=1604334 2024-09-12T00:27:41.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.428+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=XM3EA6QLQ1R8 type=del size=392431 2024-09-12T00:27:41.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.432+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=VOPNXAIFHUYF type=del 2024-09-12T00:27:41.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.440+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~8TJLBF19VRX2.0 size=1048576 2024-09-12T00:27:41.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.444+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~8TJLBF19VRX2.1 size=551927 2024-09-12T00:27:41.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.444+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=8TJLBF19VRX2 tag=ERNW9XLEN1D3 type=write size=2649079 2024-09-12T00:27:41.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.448+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=Q2QDAMHSSY3C type=del 2024-09-12T00:27:41.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.452+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=4A354IVGCJGF type=del size=633002 2024-09-12T00:27:41.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.456+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=M4ZM3IOM249C type=del 2024-09-12T00:27:41.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.460+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=1AA4NZL0QDLD type=del size=1678495 2024-09-12T00:27:41.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.464+0000 7f712938c8c0 -1 < failed to complete operation key=A8L061CQ0M0J tag=JZDK5EWT25DV type=del size=1126282: (22) Invalid argument 2024-09-12T00:27:41.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.468+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=57GEMMAAFWEI type=del size=1297995 2024-09-12T00:27:41.470 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.472+0000 7f712938c8c0 -1 < failed to complete operation key=9YZP0TIRWWRF tag=X0AZHLH0R485 type=del size=397711: (22) Invalid argument 2024-09-12T00:27:41.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.476+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~LYEO3SCQ7MVT.0 size=1048576 2024-09-12T00:27:41.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.480+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~LYEO3SCQ7MVT.1 size=1048576 2024-09-12T00:27:41.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.484+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~LYEO3SCQ7MVT.2 size=571736 2024-09-12T00:27:41.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.484+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=LYEO3SCQ7MVT tag=IKEP37DGFL3R type=write size=3717464 2024-09-12T00:27:41.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.488+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~AT1O5H7PBAEC.0 size=1048576 2024-09-12T00:27:41.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.492+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~AT1O5H7PBAEC.1 size=597222 2024-09-12T00:27:41.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.496+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=AT1O5H7PBAEC tag=8OZRPRULVE11 type=write size=2694374 2024-09-12T00:27:41.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.504+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~YZAUHJ1O0ZMT.0 size=1048576 2024-09-12T00:27:41.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.508+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~YZAUHJ1O0ZMT.1 size=1048576 2024-09-12T00:27:41.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.512+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~YZAUHJ1O0ZMT.2 size=576729 2024-09-12T00:27:41.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.512+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=YZAUHJ1O0ZMT tag=3RJS81I4YUS3 type=write size=3722457 2024-09-12T00:27:41.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.516+0000 7f712938c8c0 1 < suggested update operation key=W9YW6AS1RL48 tag=DR3UWN4QS8TX type=del size=1892627 2024-09-12T00:27:41.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.524+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~9F5ATBYDL0L0.0 size=1048576 2024-09-12T00:27:41.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.528+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~9F5ATBYDL0L0.1 size=1048576 2024-09-12T00:27:41.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.532+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~9F5ATBYDL0L0.2 size=838778 2024-09-12T00:27:41.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.532+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=9F5ATBYDL0L0 tag=NACX83F7Z029 type=write size=3984506 2024-09-12T00:27:41.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.540+0000 7f712938c8c0 1 < suggested update operation key=WP4RJQVZVEE2 tag=YK4827XB6BKW type=write size=621251 2024-09-12T00:27:41.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.544+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~LIK5V2YFT1HM.0 size=1048576 2024-09-12T00:27:41.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.548+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~LIK5V2YFT1HM.1 size=451984 2024-09-12T00:27:41.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.548+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=LIK5V2YFT1HM tag=Z62XEF43GC4G type=write size=2549136 2024-09-12T00:27:41.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.552+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=TIJS4WMM0D1Y type=del 2024-09-12T00:27:41.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.556+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=O8K0R58L2DS7 type=write size=221099 2024-09-12T00:27:41.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.560+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~GN124SQMPHH5.0 size=1048576 2024-09-12T00:27:41.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.564+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~GN124SQMPHH5.1 size=558792 2024-09-12T00:27:41.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.568+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=GN124SQMPHH5 tag=0XQ1VPZWGHTS type=write size=2655944 2024-09-12T00:27:41.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.572+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=VYE35JZYMWJE type=del size=1107587 2024-09-12T00:27:41.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.576+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=QCAXB0FX61AV type=del 2024-09-12T00:27:41.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.580+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=Y1YFC4G6NSYA type=write size=127318 2024-09-12T00:27:41.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.588+0000 7f712938c8c0 1 < suggested update operation key=QG0W04PRTQNP tag=BF62JOKW0MY0 type=write size=568828 2024-09-12T00:27:41.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.592+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=IPV8E8HB0FFF type=del size=1111740 2024-09-12T00:27:41.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.596+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~R1RMQ0KAN077.0 size=1048576 2024-09-12T00:27:41.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.596+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~R1RMQ0KAN077.1 size=1048576 2024-09-12T00:27:41.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.600+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~R1RMQ0KAN077.2 size=845598 2024-09-12T00:27:41.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.608+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=R1RMQ0KAN077 tag=7OR30YAX2CIY type=write size=3991326 2024-09-12T00:27:41.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.612+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~SLAPQCSO25JM.0 size=76779 2024-09-12T00:27:41.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.612+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=SLAPQCSO25JM tag=4WV4Q96J0ATF type=write size=1125355 2024-09-12T00:27:41.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.616+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=61XBN4DLXFOA type=del 2024-09-12T00:27:41.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.624+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=1V9B9KH16GIH type=del size=3607481 2024-09-12T00:27:41.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.628+0000 7f712938c8c0 1 < completed write operation key=UAJEZUYXN2R0 tag=G0IGE9PXN8YY type=write size=349000 2024-09-12T00:27:41.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.632+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=XK7B10LNKQ2G type=del size=1188652 2024-09-12T00:27:41.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.636+0000 7f712938c8c0 -1 < failed to complete operation key=W9YW6AS1RL48 tag=XM3EA6QLQ1R8 type=del size=392431: (22) Invalid argument 2024-09-12T00:27:41.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.640+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=NYEQ34ZSKXLR type=del size=339653 2024-09-12T00:27:41.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.644+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~8TJLBF19VRX2.0 size=1048576 2024-09-12T00:27:41.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.644+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~8TJLBF19VRX2.1 size=551927 2024-09-12T00:27:41.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.656+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=8TJLBF19VRX2 tag=ERNW9XLEN1D3 type=write size=2649079 2024-09-12T00:27:41.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.660+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DA2TQE4TVLFM.0 size=1048576 2024-09-12T00:27:41.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.664+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DA2TQE4TVLFM.1 size=234141 2024-09-12T00:27:41.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.664+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=DA2TQE4TVLFM tag=YJXMVJSOFXK3 type=write size=2331293 2024-09-12T00:27:41.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.668+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=4A354IVGCJGF type=del 2024-09-12T00:27:41.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.672+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=Y4QU9Q7JBH5V type=del size=3251068 2024-09-12T00:27:41.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.676+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=1AA4NZL0QDLD type=del 2024-09-12T00:27:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.680+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=VTRDXP5I6V0C type=write size=1001733 2024-09-12T00:27:41.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.688+0000 7f712938c8c0 1 < suggested remove operation key=Z2RYL03II71Z tag=57GEMMAAFWEI type=del 2024-09-12T00:27:41.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.692+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=ZHBNW68XQ5FG type=del size=4005436 2024-09-12T00:27:41.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.696+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~LYEO3SCQ7MVT.0 size=1048576 2024-09-12T00:27:41.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.696+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~LYEO3SCQ7MVT.1 size=1048576 2024-09-12T00:27:41.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.700+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~LYEO3SCQ7MVT.2 size=571736 2024-09-12T00:27:41.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.708+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=LYEO3SCQ7MVT tag=IKEP37DGFL3R type=write size=3717464 2024-09-12T00:27:41.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.712+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=MB9RL21M763I type=del size=196189 2024-09-12T00:27:41.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.716+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~YZAUHJ1O0ZMT.0 size=1048576 2024-09-12T00:27:41.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.716+0000 7f712938c8c0 1 < canceled part key=_multipart_L2SR6IAW0D38.2~YZAUHJ1O0ZMT.1 size=1048576 2024-09-12T00:27:41.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.716+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~YZAUHJ1O0ZMT.2 size=576729 2024-09-12T00:27:41.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.724+0000 7f712938c8c0 1 < canceled multipart upload key=L2SR6IAW0D38 upload=YZAUHJ1O0ZMT tag=3RJS81I4YUS3 type=write size=3722457 2024-09-12T00:27:41.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.728+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~N6GV0YFSNXWG.0 size=1048576 2024-09-12T00:27:41.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.732+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~N6GV0YFSNXWG.1 size=44025 2024-09-12T00:27:41.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.732+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=N6GV0YFSNXWG tag=PXZBW1O1MQ2H type=write size=2141177 2024-09-12T00:27:41.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.736+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~9F5ATBYDL0L0.0 size=1048576 2024-09-12T00:27:41.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.740+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~9F5ATBYDL0L0.1 size=1048576 2024-09-12T00:27:41.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.740+0000 7f712938c8c0 1 < canceled part key=_multipart_QL3FL4J9TKY4.2~9F5ATBYDL0L0.2 size=838778 2024-09-12T00:27:41.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.748+0000 7f712938c8c0 1 < canceled multipart upload key=QL3FL4J9TKY4 upload=9F5ATBYDL0L0 tag=NACX83F7Z029 type=write size=3984506 2024-09-12T00:27:41.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.752+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=3A68JLBF0046 type=del size=3962455 2024-09-12T00:27:41.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.756+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~LIK5V2YFT1HM.0 size=1048576 2024-09-12T00:27:41.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.760+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~LIK5V2YFT1HM.1 size=451984 2024-09-12T00:27:41.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.768+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=LIK5V2YFT1HM tag=Z62XEF43GC4G type=write size=2549136 2024-09-12T00:27:41.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.772+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=G4MCI3P3YU5L type=del size=739901 2024-09-12T00:27:41.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.776+0000 7f712938c8c0 1 < canceled operation key=9N3U208FGM79 tag=O8K0R58L2DS7 type=write size=221099 2024-09-12T00:27:41.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.780+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=GG8QQFDZ3NNX type=del size=2497494 2024-09-12T00:27:41.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.788+0000 7f712938c8c0 1 < suggested update operation key=04RL082VPLIM tag=VYE35JZYMWJE type=del size=1107587 2024-09-12T00:27:41.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.792+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=NRQGP57LYX34 type=del size=468601 2024-09-12T00:27:41.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.796+0000 7f712938c8c0 1 < canceled operation key=UAJEZUYXN2R0 tag=Y1YFC4G6NSYA type=write size=127318 2024-09-12T00:27:41.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.804+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~QRVMDC41BF02.0 size=1048576 2024-09-12T00:27:41.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.808+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~QRVMDC41BF02.1 size=940490 2024-09-12T00:27:41.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.808+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=QRVMDC41BF02 tag=REBGELY7WZ1N type=write size=3037642 2024-09-12T00:27:41.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.812+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=IPV8E8HB0FFF type=del 2024-09-12T00:27:41.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.816+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=2OFIPP01XV7D type=del size=3437837 2024-09-12T00:27:41.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.820+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~SLAPQCSO25JM.0 size=76779 2024-09-12T00:27:41.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.828+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=SLAPQCSO25JM tag=4WV4Q96J0ATF type=write size=1125355 2024-09-12T00:27:41.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.832+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~9HK45YJE1X6P.0 size=276883 2024-09-12T00:27:41.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.832+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=9HK45YJE1X6P tag=SHUKWG85E3ZI type=write size=1325459 2024-09-12T00:27:41.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.836+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=1V9B9KH16GIH type=del 2024-09-12T00:27:41.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.844+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~X90FHZ4PU78W.0 size=1048576 2024-09-12T00:27:41.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.848+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~X90FHZ4PU78W.1 size=621247 2024-09-12T00:27:41.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.848+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=X90FHZ4PU78W tag=965H5EJY8T42 type=write size=2718399 2024-09-12T00:27:41.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.852+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=XK7B10LNKQ2G type=del 2024-09-12T00:27:41.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.856+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~29VI9JXRHTM3.0 size=1048576 2024-09-12T00:27:41.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.860+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~29VI9JXRHTM3.1 size=1048576 2024-09-12T00:27:41.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.864+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~29VI9JXRHTM3.2 size=635398 2024-09-12T00:27:41.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.864+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=29VI9JXRHTM3 tag=H3XKWTG0H3XY type=write size=3781126 2024-09-12T00:27:41.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.868+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=NYEQ34ZSKXLR type=del 2024-09-12T00:27:41.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.872+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=8AA9YS37CU3C type=del size=919435 2024-09-12T00:27:41.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.872+0000 7f712938c8c0 1 < canceled part key=_multipart_WP4RJQVZVEE2.2~DA2TQE4TVLFM.0 size=1048576 2024-09-12T00:27:41.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.876+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~DA2TQE4TVLFM.1 size=234141 2024-09-12T00:27:41.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.884+0000 7f712938c8c0 1 < canceled multipart upload key=WP4RJQVZVEE2 upload=DA2TQE4TVLFM tag=YJXMVJSOFXK3 type=write size=2331293 2024-09-12T00:27:41.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.884+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=SSBDJK3HO8WZ type=del size=3777302 2024-09-12T00:27:41.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.888+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=Y4QU9Q7JBH5V type=del 2024-09-12T00:27:41.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.892+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=HVM156XI0V3E type=del size=3268868 2024-09-12T00:27:41.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.896+0000 7f712938c8c0 1 < canceled operation key=G0065P5NOJ2F tag=VTRDXP5I6V0C type=write size=1001733 2024-09-12T00:27:41.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.900+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=87I2UMSF1244 type=del size=898597 2024-09-12T00:27:41.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.904+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=ZHBNW68XQ5FG type=del 2024-09-12T00:27:41.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.908+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=V4UZX6AA324P type=del size=694785 2024-09-12T00:27:41.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.912+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=MB9RL21M763I type=del 2024-09-12T00:27:41.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.916+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=H1MQF99QZV8O type=del size=1078545 2024-09-12T00:27:41.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.920+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~N6GV0YFSNXWG.0 size=1048576 2024-09-12T00:27:41.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.924+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~N6GV0YFSNXWG.1 size=44025 2024-09-12T00:27:41.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.928+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=N6GV0YFSNXWG tag=PXZBW1O1MQ2H type=write size=2141177 2024-09-12T00:27:41.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.936+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~RL6Y0HGHX5GS.0 size=1048576 2024-09-12T00:27:41.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.940+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~RL6Y0HGHX5GS.1 size=1048576 2024-09-12T00:27:41.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.944+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~RL6Y0HGHX5GS.2 size=554890 2024-09-12T00:27:41.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.944+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=RL6Y0HGHX5GS tag=XOM03Q064GUC type=write size=3700618 2024-09-12T00:27:41.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.944+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=3A68JLBF0046 type=del 2024-09-12T00:27:41.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.948+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=M7Z5X0HNTL1U type=del size=1280617 2024-09-12T00:27:41.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.952+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=G4MCI3P3YU5L type=del 2024-09-12T00:27:41.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.960+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~GCI2GC0HAPJJ.0 size=1048576 2024-09-12T00:27:41.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.964+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~GCI2GC0HAPJJ.1 size=1048576 2024-09-12T00:27:41.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.964+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~GCI2GC0HAPJJ.2 size=825893 2024-09-12T00:27:41.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.964+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=GCI2GC0HAPJJ tag=APJOT6YO4LFB type=write size=3971621 2024-09-12T00:27:41.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.968+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=GG8QQFDZ3NNX type=del 2024-09-12T00:27:41.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.976+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~ZPOH10H2JY7F.0 size=134496 2024-09-12T00:27:41.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.976+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=ZPOH10H2JY7F tag=ZMIXI6RSVGVX type=write size=1183072 2024-09-12T00:27:41.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.980+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=NRQGP57LYX34 type=del 2024-09-12T00:27:41.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.988+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~1K9TPSDATKIJ.0 size=1048576 2024-09-12T00:27:41.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.992+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~1K9TPSDATKIJ.1 size=1017105 2024-09-12T00:27:41.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.992+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=1K9TPSDATKIJ tag=12IVRG2HS4SC type=write size=3114257 2024-09-12T00:27:41.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:41.996+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~QRVMDC41BF02.0 size=1048576 2024-09-12T00:27:41.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.000+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~QRVMDC41BF02.1 size=940490 2024-09-12T00:27:42.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.008+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=QRVMDC41BF02 tag=REBGELY7WZ1N type=write size=3037642 2024-09-12T00:27:42.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.012+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=QFHICCQ1EMJM type=del size=1295069 2024-09-12T00:27:42.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.016+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=2OFIPP01XV7D type=del 2024-09-12T00:27:42.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.020+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=20JETNWZQ0SP type=del size=16449 2024-09-12T00:27:42.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.024+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~9HK45YJE1X6P.0 size=276883 2024-09-12T00:27:42.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.032+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=9HK45YJE1X6P tag=SHUKWG85E3ZI type=write size=1325459 2024-09-12T00:27:42.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.036+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~K7R9QN1Y4BOQ.0 size=1048576 2024-09-12T00:27:42.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.040+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~K7R9QN1Y4BOQ.1 size=1048576 2024-09-12T00:27:42.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.044+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~K7R9QN1Y4BOQ.2 size=767007 2024-09-12T00:27:42.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.044+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=K7R9QN1Y4BOQ tag=1OJRNY2Q4HP9 type=write size=3912735 2024-09-12T00:27:42.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.048+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~X90FHZ4PU78W.0 size=1048576 2024-09-12T00:27:42.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.048+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~X90FHZ4PU78W.1 size=621247 2024-09-12T00:27:42.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.056+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=X90FHZ4PU78W tag=965H5EJY8T42 type=write size=2718399 2024-09-12T00:27:42.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.060+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=34LAY9QQIGXG type=del size=717106 2024-09-12T00:27:42.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.064+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~29VI9JXRHTM3.0 size=1048576 2024-09-12T00:27:42.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.068+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~29VI9JXRHTM3.1 size=1048576 2024-09-12T00:27:42.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.068+0000 7f712938c8c0 1 < canceled part key=_multipart_UAJEZUYXN2R0.2~29VI9JXRHTM3.2 size=635398 2024-09-12T00:27:42.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.072+0000 7f712938c8c0 1 < canceled multipart upload key=UAJEZUYXN2R0 upload=29VI9JXRHTM3 tag=H3XKWTG0H3XY type=write size=3781126 2024-09-12T00:27:42.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.076+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=KTU5YUTYUQJ8 type=write size=974151 2024-09-12T00:27:42.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.080+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=8AA9YS37CU3C type=del 2024-09-12T00:27:42.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.088+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~LDZGBWPKWGCE.0 size=1048576 2024-09-12T00:27:42.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.092+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~LDZGBWPKWGCE.1 size=1048576 2024-09-12T00:27:42.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.096+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~LDZGBWPKWGCE.2 size=902818 2024-09-12T00:27:42.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.096+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=LDZGBWPKWGCE tag=9NMHDMAU705U type=write size=4048546 2024-09-12T00:27:42.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.100+0000 7f712938c8c0 1 < suggested remove operation key=0QZKHZTVP3RQ tag=SSBDJK3HO8WZ type=del 2024-09-12T00:27:42.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.108+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~86ONINFA62M9.0 size=1048576 2024-09-12T00:27:42.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.112+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~86ONINFA62M9.1 size=1048576 2024-09-12T00:27:42.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.116+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~86ONINFA62M9.2 size=930231 2024-09-12T00:27:42.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.116+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=86ONINFA62M9 tag=2EMFCYCBOHOP type=write size=4075959 2024-09-12T00:27:42.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.120+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=HVM156XI0V3E type=del 2024-09-12T00:27:42.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.124+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=ZH6GCOBYXS97 type=del size=3676410 2024-09-12T00:27:42.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.128+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=87I2UMSF1244 type=del 2024-09-12T00:27:42.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.132+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=1TC4AZKMN4NA type=del size=560678 2024-09-12T00:27:42.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.136+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=V4UZX6AA324P type=del 2024-09-12T00:27:42.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.140+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=PZ76ZTNRX6Y8 type=write size=279928 2024-09-12T00:27:42.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.144+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=H1MQF99QZV8O type=del 2024-09-12T00:27:42.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.148+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=2K3SZTY5L2NV type=del size=764595 2024-09-12T00:27:42.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.152+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~RL6Y0HGHX5GS.0 size=1048576 2024-09-12T00:27:42.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.156+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~RL6Y0HGHX5GS.1 size=1048576 2024-09-12T00:27:42.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.160+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~RL6Y0HGHX5GS.2 size=554890 2024-09-12T00:27:42.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.164+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=RL6Y0HGHX5GS tag=XOM03Q064GUC type=write size=3700618 2024-09-12T00:27:42.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.168+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=SW1IVMBSU126 type=del size=701982 2024-09-12T00:27:42.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.172+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=M7Z5X0HNTL1U type=del 2024-09-12T00:27:42.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.180+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~HPLN0DEDFAG5.0 size=836358 2024-09-12T00:27:42.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.180+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=HPLN0DEDFAG5 tag=WJ854QZIAY9K type=write size=1884934 2024-09-12T00:27:42.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.184+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~GCI2GC0HAPJJ.0 size=1048576 2024-09-12T00:27:42.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.188+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~GCI2GC0HAPJJ.1 size=1048576 2024-09-12T00:27:42.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.192+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~GCI2GC0HAPJJ.2 size=825893 2024-09-12T00:27:42.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.196+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=GCI2GC0HAPJJ tag=APJOT6YO4LFB type=write size=3971621 2024-09-12T00:27:42.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.200+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=9AJR7G05UTYH type=del size=266795 2024-09-12T00:27:42.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.204+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~ZPOH10H2JY7F.0 size=134496 2024-09-12T00:27:42.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.208+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=ZPOH10H2JY7F tag=ZMIXI6RSVGVX type=write size=1183072 2024-09-12T00:27:42.216 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.212+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=ARB194C8B9HL type=del size=1654796 2024-09-12T00:27:42.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.216+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~1K9TPSDATKIJ.0 size=1048576 2024-09-12T00:27:42.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.220+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~1K9TPSDATKIJ.1 size=1017105 2024-09-12T00:27:42.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.228+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=1K9TPSDATKIJ tag=12IVRG2HS4SC type=write size=3114257 2024-09-12T00:27:42.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.232+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=6R3JIZPBS7MC type=del size=2563442 2024-09-12T00:27:42.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.236+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=QFHICCQ1EMJM type=del 2024-09-12T00:27:42.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.244+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~WX6CEJUQYC8R.0 size=1048576 2024-09-12T00:27:42.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.244+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~WX6CEJUQYC8R.1 size=712511 2024-09-12T00:27:42.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.244+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=WX6CEJUQYC8R tag=M79NDUAEY5RC type=write size=2809663 2024-09-12T00:27:42.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.248+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=20JETNWZQ0SP type=del 2024-09-12T00:27:42.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.256+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~WDRW7MISQ47F.0 size=374109 2024-09-12T00:27:42.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.256+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=WDRW7MISQ47F tag=SB5F45V5NYRS type=write size=1422685 2024-09-12T00:27:42.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.260+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~K7R9QN1Y4BOQ.0 size=1048576 2024-09-12T00:27:42.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.264+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~K7R9QN1Y4BOQ.1 size=1048576 2024-09-12T00:27:42.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.264+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~K7R9QN1Y4BOQ.2 size=767007 2024-09-12T00:27:42.272 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.272+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=K7R9QN1Y4BOQ tag=1OJRNY2Q4HP9 type=write size=3912735 2024-09-12T00:27:42.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.280+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~ZUD24WX8RYYH.0 size=221655 2024-09-12T00:27:42.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.280+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=ZUD24WX8RYYH tag=AGEN6S3DB0CM type=write size=1270231 2024-09-12T00:27:42.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.284+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=34LAY9QQIGXG type=del 2024-09-12T00:27:42.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.288+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~2BW8NSNY0RRC.0 size=1048576 2024-09-12T00:27:42.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.292+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~2BW8NSNY0RRC.1 size=278191 2024-09-12T00:27:42.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.292+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=2BW8NSNY0RRC tag=AB5667VWG0OX type=write size=2375343 2024-09-12T00:27:42.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.296+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=KTU5YUTYUQJ8 type=write size=974151 2024-09-12T00:27:42.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.304+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~RRWHPBH25T88.0 size=1048576 2024-09-12T00:27:42.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.304+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~RRWHPBH25T88.1 size=1048576 2024-09-12T00:27:42.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.308+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~RRWHPBH25T88.2 size=902482 2024-09-12T00:27:42.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.308+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=RRWHPBH25T88 tag=MLM6REMDVN35 type=write size=4048210 2024-09-12T00:27:42.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.312+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~LDZGBWPKWGCE.0 size=1048576 2024-09-12T00:27:42.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.316+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~LDZGBWPKWGCE.1 size=1048576 2024-09-12T00:27:42.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.320+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~LDZGBWPKWGCE.2 size=902818 2024-09-12T00:27:42.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.324+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=LDZGBWPKWGCE tag=9NMHDMAU705U type=write size=4048546 2024-09-12T00:27:42.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.332+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~NXBAFS5UTOAD.0 size=1048576 2024-09-12T00:27:42.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.336+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~NXBAFS5UTOAD.1 size=1048576 2024-09-12T00:27:42.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.340+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~NXBAFS5UTOAD.2 size=349704 2024-09-12T00:27:42.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.340+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=NXBAFS5UTOAD tag=MQ9ENK8KA9A5 type=write size=3495432 2024-09-12T00:27:42.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.344+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~86ONINFA62M9.0 size=1048576 2024-09-12T00:27:42.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.344+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~86ONINFA62M9.1 size=1048576 2024-09-12T00:27:42.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.348+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~86ONINFA62M9.2 size=930231 2024-09-12T00:27:42.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.352+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=86ONINFA62M9 tag=2EMFCYCBOHOP type=write size=4075959 2024-09-12T00:27:42.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.356+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=SU8TGWJB8KKY type=del size=3315871 2024-09-12T00:27:42.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.364+0000 7f712938c8c0 1 < canceled operation key=QG0W04PRTQNP tag=ZH6GCOBYXS97 type=del size=3676410 2024-09-12T00:27:42.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.368+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=J3M39MQI3YJG type=write size=703495 2024-09-12T00:27:42.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.372+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=1TC4AZKMN4NA type=del 2024-09-12T00:27:42.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.376+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=421ALRQDMYRU type=write size=94039 2024-09-12T00:27:42.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.380+0000 7f712938c8c0 1 < canceled operation key=T0C4ZDQB13X0 tag=PZ76ZTNRX6Y8 type=write size=279928 2024-09-12T00:27:42.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.384+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=LIOJNDGU5NAK type=del size=227044 2024-09-12T00:27:42.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.384+0000 7f712938c8c0 1 < canceled operation key=GZON46MODQZO tag=2K3SZTY5L2NV type=del size=764595 2024-09-12T00:27:42.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.392+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=DZVKHE3J5MCH type=del size=2601412 2024-09-12T00:27:42.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.396+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=SW1IVMBSU126 type=del 2024-09-12T00:27:42.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.400+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~4WPEGP2AD010.0 size=1048576 2024-09-12T00:27:42.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.404+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~4WPEGP2AD010.1 size=1048576 2024-09-12T00:27:42.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.408+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~4WPEGP2AD010.2 size=1013085 2024-09-12T00:27:42.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.408+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=4WPEGP2AD010 tag=XQFW0L7W7IC1 type=write size=4158813 2024-09-12T00:27:42.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.412+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~HPLN0DEDFAG5.0 size=836358 2024-09-12T00:27:42.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.416+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=HPLN0DEDFAG5 tag=WJ854QZIAY9K type=write size=1884934 2024-09-12T00:27:42.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.420+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=NCUQFGELIY9X type=del size=4152586 2024-09-12T00:27:42.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.424+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=9AJR7G05UTYH type=del 2024-09-12T00:27:42.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.432+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~DUC53H8AIJRX.0 size=1048576 2024-09-12T00:27:42.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.432+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~DUC53H8AIJRX.1 size=75153 2024-09-12T00:27:42.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.432+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=DUC53H8AIJRX tag=FVHN24PSY102 type=write size=2172305 2024-09-12T00:27:42.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.436+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=ARB194C8B9HL type=del 2024-09-12T00:27:42.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.440+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=P0253WO2PFU8 type=write size=855843 2024-09-12T00:27:42.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.444+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=6R3JIZPBS7MC type=del 2024-09-12T00:27:42.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.452+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~MEEZG6UHS72E.0 size=101271 2024-09-12T00:27:42.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.452+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=MEEZG6UHS72E tag=BAT212THTLGR type=write size=1149847 2024-09-12T00:27:42.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.456+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~WX6CEJUQYC8R.0 size=1048576 2024-09-12T00:27:42.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.460+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~WX6CEJUQYC8R.1 size=712511 2024-09-12T00:27:42.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.464+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=WX6CEJUQYC8R tag=M79NDUAEY5RC type=write size=2809663 2024-09-12T00:27:42.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.468+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=HMW96WH4QLYY type=del size=1875643 2024-09-12T00:27:42.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.472+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~WDRW7MISQ47F.0 size=374109 2024-09-12T00:27:42.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.480+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=WDRW7MISQ47F tag=SB5F45V5NYRS type=write size=1422685 2024-09-12T00:27:42.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.484+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=7I6C6PB3GYN3 type=write size=404739 2024-09-12T00:27:42.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.488+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~ZUD24WX8RYYH.0 size=221655 2024-09-12T00:27:42.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.496+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=ZUD24WX8RYYH tag=AGEN6S3DB0CM type=write size=1270231 2024-09-12T00:27:42.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.500+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~KRE0RA9KEXPS.0 size=1048576 2024-09-12T00:27:42.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.504+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~KRE0RA9KEXPS.1 size=62542 2024-09-12T00:27:42.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.504+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=KRE0RA9KEXPS tag=DOQ3P7675L31 type=write size=2159694 2024-09-12T00:27:42.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.508+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~2BW8NSNY0RRC.0 size=1048576 2024-09-12T00:27:42.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.512+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~2BW8NSNY0RRC.1 size=278191 2024-09-12T00:27:42.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.516+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=2BW8NSNY0RRC tag=AB5667VWG0OX type=write size=2375343 2024-09-12T00:27:42.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.524+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~R59IE7TQT91O.0 size=1048576 2024-09-12T00:27:42.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.528+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~R59IE7TQT91O.1 size=1048576 2024-09-12T00:27:42.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.532+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~R59IE7TQT91O.2 size=165038 2024-09-12T00:27:42.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.532+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=R59IE7TQT91O tag=SM88AS1TTB7V type=write size=3310766 2024-09-12T00:27:42.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.536+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~RRWHPBH25T88.0 size=1048576 2024-09-12T00:27:42.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.540+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~RRWHPBH25T88.1 size=1048576 2024-09-12T00:27:42.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.544+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~RRWHPBH25T88.2 size=902482 2024-09-12T00:27:42.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.548+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=RRWHPBH25T88 tag=MLM6REMDVN35 type=write size=4048210 2024-09-12T00:27:42.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.552+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=8SK9VVJ1ISAI type=del size=771070 2024-09-12T00:27:42.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.556+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~NXBAFS5UTOAD.0 size=1048576 2024-09-12T00:27:42.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.556+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~NXBAFS5UTOAD.1 size=1048576 2024-09-12T00:27:42.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.560+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~NXBAFS5UTOAD.2 size=349704 2024-09-12T00:27:42.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.564+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=NXBAFS5UTOAD tag=MQ9ENK8KA9A5 type=write size=3495432 2024-09-12T00:27:42.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.572+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~4542PFJC4DT4.0 size=649950 2024-09-12T00:27:42.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.572+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=4542PFJC4DT4 tag=6PUPVTYP1PG3 type=write size=1698526 2024-09-12T00:27:42.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.576+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=SU8TGWJB8KKY type=del 2024-09-12T00:27:42.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.576+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=MT1CM05SRY5O type=del size=654473 2024-09-12T00:27:42.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.580+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=J3M39MQI3YJG type=write size=703495 2024-09-12T00:27:42.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.584+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=1TVF93QAEOF3 type=del size=2047466 2024-09-12T00:27:42.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.588+0000 7f712938c8c0 1 < completed write operation key=G0065P5NOJ2F tag=421ALRQDMYRU type=write size=94039 2024-09-12T00:27:42.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.596+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~A0U2LBK3UYKF.0 size=1048576 2024-09-12T00:27:42.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.596+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~A0U2LBK3UYKF.1 size=1048576 2024-09-12T00:27:42.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.600+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~A0U2LBK3UYKF.2 size=361368 2024-09-12T00:27:42.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.600+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=A0U2LBK3UYKF tag=PFBINWPPBQLX type=write size=3507096 2024-09-12T00:27:42.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.604+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=LIOJNDGU5NAK type=del 2024-09-12T00:27:42.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.604+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=IBVMN377Y02K type=del size=2240189 2024-09-12T00:27:42.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.612+0000 7f712938c8c0 1 < suggested update operation key=HPM9GFRASWIV tag=DZVKHE3J5MCH type=del size=2601412 2024-09-12T00:27:42.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.616+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=AV4812UD4HRV type=del size=3178744 2024-09-12T00:27:42.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.620+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~4WPEGP2AD010.0 size=1048576 2024-09-12T00:27:42.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.620+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~4WPEGP2AD010.1 size=1048576 2024-09-12T00:27:42.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.624+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~4WPEGP2AD010.2 size=1013085 2024-09-12T00:27:42.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.628+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=4WPEGP2AD010 tag=XQFW0L7W7IC1 type=write size=4158813 2024-09-12T00:27:42.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.632+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=TXKJRNZTYQGS type=del size=827730 2024-09-12T00:27:42.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.636+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=NCUQFGELIY9X type=del 2024-09-12T00:27:42.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.640+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~HY9H91CPQSUN.0 size=1048576 2024-09-12T00:27:42.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.644+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~HY9H91CPQSUN.1 size=710163 2024-09-12T00:27:42.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.644+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=HY9H91CPQSUN tag=JY2OPXVABL7H type=write size=2807315 2024-09-12T00:27:42.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.648+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~DUC53H8AIJRX.0 size=1048576 2024-09-12T00:27:42.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.648+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~DUC53H8AIJRX.1 size=75153 2024-09-12T00:27:42.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.656+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=DUC53H8AIJRX tag=FVHN24PSY102 type=write size=2172305 2024-09-12T00:27:42.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.660+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~BQMI4IYA94A9.0 size=1048576 2024-09-12T00:27:42.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.664+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~BQMI4IYA94A9.1 size=52380 2024-09-12T00:27:42.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.664+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=BQMI4IYA94A9 tag=OYDXAS1KA04X type=write size=2149532 2024-09-12T00:27:42.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.668+0000 7f712938c8c0 1 < completed write operation key=G0065P5NOJ2F tag=P0253WO2PFU8 type=write size=855843 2024-09-12T00:27:42.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.668+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=8RKFN2S1K59P type=del size=4180975 2024-09-12T00:27:42.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.672+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~MEEZG6UHS72E.0 size=101271 2024-09-12T00:27:42.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.676+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=MEEZG6UHS72E tag=BAT212THTLGR type=write size=1149847 2024-09-12T00:27:42.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.680+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=OHYXAVK7S7TZ type=del size=3736093 2024-09-12T00:27:42.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.684+0000 7f712938c8c0 -1 < failed to complete operation key=HPM9GFRASWIV tag=HMW96WH4QLYY type=del size=1875643: (22) Invalid argument 2024-09-12T00:27:42.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.688+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=V1H74LE5X5BZ type=del size=3568829 2024-09-12T00:27:42.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.692+0000 7f712938c8c0 1 < completed write operation key=7X45VJAQO7PF tag=7I6C6PB3GYN3 type=write size=404739 2024-09-12T00:27:42.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.696+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=5HBM8EBVWPQD type=del size=3819691 2024-09-12T00:27:42.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.700+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~KRE0RA9KEXPS.0 size=1048576 2024-09-12T00:27:42.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.700+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~KRE0RA9KEXPS.1 size=62542 2024-09-12T00:27:42.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.708+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=KRE0RA9KEXPS tag=DOQ3P7675L31 type=write size=2159694 2024-09-12T00:27:42.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.712+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=HURNJUHBK7ZS type=write size=30395 2024-09-12T00:27:42.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.716+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~R59IE7TQT91O.0 size=1048576 2024-09-12T00:27:42.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.720+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~R59IE7TQT91O.1 size=1048576 2024-09-12T00:27:42.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.720+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~R59IE7TQT91O.2 size=165038 2024-09-12T00:27:42.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.728+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=R59IE7TQT91O tag=SM88AS1TTB7V type=write size=3310766 2024-09-12T00:27:42.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.732+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~P1Z2VVZK7XXO.0 size=1048576 2024-09-12T00:27:42.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.736+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~P1Z2VVZK7XXO.1 size=984601 2024-09-12T00:27:42.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.736+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=P1Z2VVZK7XXO tag=B13A0BT7D3MO type=write size=3081753 2024-09-12T00:27:42.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.740+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=8SK9VVJ1ISAI type=del 2024-09-12T00:27:42.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.748+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QA4R3F1CHE6L.0 size=1048576 2024-09-12T00:27:42.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.748+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QA4R3F1CHE6L.1 size=1048576 2024-09-12T00:27:42.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.752+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QA4R3F1CHE6L.2 size=572260 2024-09-12T00:27:42.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.752+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=QA4R3F1CHE6L tag=23D3C9LZ35G4 type=write size=3717988 2024-09-12T00:27:42.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.756+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~4542PFJC4DT4.0 size=649950 2024-09-12T00:27:42.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.760+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=4542PFJC4DT4 tag=6PUPVTYP1PG3 type=write size=1698526 2024-09-12T00:27:42.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.764+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=3O6TOURDMGJE type=del size=2953006 2024-09-12T00:27:42.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.768+0000 7f712938c8c0 -1 < failed to complete operation key=HPM9GFRASWIV tag=MT1CM05SRY5O type=del size=654473: (22) Invalid argument 2024-09-12T00:27:42.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.772+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~3DYJRSL4GPXZ.0 size=1048576 2024-09-12T00:27:42.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.776+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~3DYJRSL4GPXZ.1 size=402031 2024-09-12T00:27:42.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.776+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=3DYJRSL4GPXZ tag=MK9KXUS7FJRE type=write size=2499183 2024-09-12T00:27:42.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.780+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=1TVF93QAEOF3 type=del 2024-09-12T00:27:42.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.784+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~FA4SZ24NNCEC.0 size=1048576 2024-09-12T00:27:42.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.788+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~FA4SZ24NNCEC.1 size=473370 2024-09-12T00:27:42.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.788+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=FA4SZ24NNCEC tag=XUTK4L1QOK6J type=write size=2570522 2024-09-12T00:27:42.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.792+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~A0U2LBK3UYKF.0 size=1048576 2024-09-12T00:27:42.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.796+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~A0U2LBK3UYKF.1 size=1048576 2024-09-12T00:27:42.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.800+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~A0U2LBK3UYKF.2 size=361368 2024-09-12T00:27:42.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.804+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=A0U2LBK3UYKF tag=PFBINWPPBQLX type=write size=3507096 2024-09-12T00:27:42.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.812+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~LNO82K30TGP4.0 size=1048576 2024-09-12T00:27:42.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.812+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~LNO82K30TGP4.1 size=729776 2024-09-12T00:27:42.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.812+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=LNO82K30TGP4 tag=460BM6ANI6MS type=write size=2826928 2024-09-12T00:27:42.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.820+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=IBVMN377Y02K type=del 2024-09-12T00:27:42.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.820+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=K6LSUA9KFMDP type=write size=819154 2024-09-12T00:27:42.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.824+0000 7f712938c8c0 1 < canceled operation key=WP4RJQVZVEE2 tag=AV4812UD4HRV type=del size=3178744 2024-09-12T00:27:42.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.828+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=RYNN7X73XMI6 type=write size=309714 2024-09-12T00:27:42.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.832+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=TXKJRNZTYQGS type=del 2024-09-12T00:27:42.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.836+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=BCZ0YP3XQDB8 type=del size=3336198 2024-09-12T00:27:42.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.840+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~HY9H91CPQSUN.0 size=1048576 2024-09-12T00:27:42.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.844+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~HY9H91CPQSUN.1 size=710163 2024-09-12T00:27:42.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.848+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=HY9H91CPQSUN tag=JY2OPXVABL7H type=write size=2807315 2024-09-12T00:27:42.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.856+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~0Y9C96HJRCMZ.0 size=1048576 2024-09-12T00:27:42.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.856+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~0Y9C96HJRCMZ.1 size=1048576 2024-09-12T00:27:42.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.860+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~0Y9C96HJRCMZ.2 size=999231 2024-09-12T00:27:42.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.860+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=0Y9C96HJRCMZ tag=OHMLLKZBHORD type=write size=4144959 2024-09-12T00:27:42.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.864+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~BQMI4IYA94A9.0 size=1048576 2024-09-12T00:27:42.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.868+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~BQMI4IYA94A9.1 size=52380 2024-09-12T00:27:42.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.872+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=BQMI4IYA94A9 tag=OYDXAS1KA04X type=write size=2149532 2024-09-12T00:27:42.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.876+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~G6AAJJOFR31G.0 size=1048576 2024-09-12T00:27:42.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.880+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~G6AAJJOFR31G.1 size=1048576 2024-09-12T00:27:42.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.884+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~G6AAJJOFR31G.2 size=915535 2024-09-12T00:27:42.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.884+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=G6AAJJOFR31G tag=IK16MPCFMA07 type=write size=4061263 2024-09-12T00:27:42.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.888+0000 7f712938c8c0 1 < suggested update operation key=T1H3O6A6HBQH tag=8RKFN2S1K59P type=del size=4180975 2024-09-12T00:27:42.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.896+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~M39N37YSCVP5.0 size=159915 2024-09-12T00:27:42.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.896+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=M39N37YSCVP5 tag=1P3ARPK5ORTJ type=write size=1208491 2024-09-12T00:27:42.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.900+0000 7f712938c8c0 1 < canceled operation key=QG0W04PRTQNP tag=OHYXAVK7S7TZ type=del size=3736093 2024-09-12T00:27:42.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.908+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~0FBHS1C3XD4C.0 size=1048576 2024-09-12T00:27:42.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.908+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~0FBHS1C3XD4C.1 size=1048576 2024-09-12T00:27:42.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.912+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~0FBHS1C3XD4C.2 size=1865 2024-09-12T00:27:42.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.912+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=0FBHS1C3XD4C tag=QIFU1AKW20DM type=write size=3147593 2024-09-12T00:27:42.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.916+0000 7f712938c8c0 1 < canceled operation key=9HX9GER6OKVI tag=V1H74LE5X5BZ type=del size=3568829 2024-09-12T00:27:42.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.920+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=C19RVWRQMLCH type=del size=1959878 2024-09-12T00:27:42.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.924+0000 7f712938c8c0 1 < canceled operation key=T0C4ZDQB13X0 tag=5HBM8EBVWPQD type=del size=3819691 2024-09-12T00:27:42.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.924+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=IT0HJAKKIV2V type=del size=3001261 2024-09-12T00:27:42.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.928+0000 7f712938c8c0 1 < completed write operation key=9YZP0TIRWWRF tag=HURNJUHBK7ZS type=write size=30395 2024-09-12T00:27:42.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.932+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=17QHH1N8V23V type=del size=3473946 2024-09-12T00:27:42.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.936+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~P1Z2VVZK7XXO.0 size=1048576 2024-09-12T00:27:42.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.940+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~P1Z2VVZK7XXO.1 size=984601 2024-09-12T00:27:42.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.944+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=P1Z2VVZK7XXO tag=B13A0BT7D3MO type=write size=3081753 2024-09-12T00:27:42.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.952+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~4DC1C2Q67R39.0 size=960622 2024-09-12T00:27:42.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.952+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=4DC1C2Q67R39 tag=CT9GQB5NR1C1 type=write size=2009198 2024-09-12T00:27:42.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.956+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~QA4R3F1CHE6L.0 size=1048576 2024-09-12T00:27:42.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.956+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~QA4R3F1CHE6L.1 size=1048576 2024-09-12T00:27:42.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.960+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~QA4R3F1CHE6L.2 size=572260 2024-09-12T00:27:42.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.968+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=QA4R3F1CHE6L tag=23D3C9LZ35G4 type=write size=3717988 2024-09-12T00:27:42.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.972+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~I0EYF8AGFXLN.0 size=1048576 2024-09-12T00:27:42.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.976+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~I0EYF8AGFXLN.1 size=330999 2024-09-12T00:27:42.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.976+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=I0EYF8AGFXLN tag=V1CL2EIBTZ5O type=write size=2428151 2024-09-12T00:27:42.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.976+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=3O6TOURDMGJE type=del 2024-09-12T00:27:42.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.980+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=EATQ8NUXUTTK type=del size=2680292 2024-09-12T00:27:42.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.984+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~3DYJRSL4GPXZ.0 size=1048576 2024-09-12T00:27:42.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.988+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~3DYJRSL4GPXZ.1 size=402031 2024-09-12T00:27:42.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.992+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=3DYJRSL4GPXZ tag=MK9KXUS7FJRE type=write size=2499183 2024-09-12T00:27:42.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:42.996+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=N3ILMDMIFUYT type=write size=909361 2024-09-12T00:27:42.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.000+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~FA4SZ24NNCEC.0 size=1048576 2024-09-12T00:27:42.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.000+0000 7f712938c8c0 1 < canceled part key=_multipart_A8L061CQ0M0J.2~FA4SZ24NNCEC.1 size=473370 2024-09-12T00:27:43.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.008+0000 7f712938c8c0 1 < canceled multipart upload key=A8L061CQ0M0J upload=FA4SZ24NNCEC tag=XUTK4L1QOK6J type=write size=2570522 2024-09-12T00:27:43.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.012+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=BPZS0ISKCM3P type=del size=664943 2024-09-12T00:27:43.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.016+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~LNO82K30TGP4.0 size=1048576 2024-09-12T00:27:43.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.016+0000 7f712938c8c0 1 < canceled part key=_multipart_A8L061CQ0M0J.2~LNO82K30TGP4.1 size=729776 2024-09-12T00:27:43.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.020+0000 7f712938c8c0 1 < canceled multipart upload key=A8L061CQ0M0J upload=LNO82K30TGP4 tag=460BM6ANI6MS type=write size=2826928 2024-09-12T00:27:43.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.024+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=MNPFCO8H62ZF type=del size=432264 2024-09-12T00:27:43.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.028+0000 7f712938c8c0 1 < completed write operation key=UAJEZUYXN2R0 tag=K6LSUA9KFMDP type=write size=819154 2024-09-12T00:27:43.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.032+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=WQJUOFHHH1LA type=del size=3054336 2024-09-12T00:27:43.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.040+0000 7f712938c8c0 1 < suggested update operation key=7X45VJAQO7PF tag=RYNN7X73XMI6 type=write size=309714 2024-09-12T00:27:43.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.048+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~NGBHE3QADJBA.0 size=261080 2024-09-12T00:27:43.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.048+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=NGBHE3QADJBA tag=D58G68IATG4T type=write size=1309656 2024-09-12T00:27:43.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.052+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=BCZ0YP3XQDB8 type=del 2024-09-12T00:27:43.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.060+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~SROPIRGUTM26.0 size=43264 2024-09-12T00:27:43.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.060+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=SROPIRGUTM26 tag=VZJBM03F9K4H type=write size=1091840 2024-09-12T00:27:43.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.064+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~0Y9C96HJRCMZ.0 size=1048576 2024-09-12T00:27:43.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.064+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~0Y9C96HJRCMZ.1 size=1048576 2024-09-12T00:27:43.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.072+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~0Y9C96HJRCMZ.2 size=999231 2024-09-12T00:27:43.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.072+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=0Y9C96HJRCMZ tag=OHMLLKZBHORD type=write size=4144959 2024-09-12T00:27:43.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.076+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=IDF7WFDPV4L8 type=del size=461553 2024-09-12T00:27:43.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.080+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~G6AAJJOFR31G.0 size=1048576 2024-09-12T00:27:43.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.084+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~G6AAJJOFR31G.1 size=1048576 2024-09-12T00:27:43.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.088+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~G6AAJJOFR31G.2 size=915535 2024-09-12T00:27:43.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.092+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=G6AAJJOFR31G tag=IK16MPCFMA07 type=write size=4061263 2024-09-12T00:27:43.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.100+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~Q8SVXW9V96ZX.0 size=712960 2024-09-12T00:27:43.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.100+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=Q8SVXW9V96ZX tag=R303R00LBL8J type=write size=1761536 2024-09-12T00:27:43.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.104+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~M39N37YSCVP5.0 size=159915 2024-09-12T00:27:43.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.108+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=M39N37YSCVP5 tag=1P3ARPK5ORTJ type=write size=1208491 2024-09-12T00:27:43.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.116+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~ENAVL4OH0LP6.0 size=556434 2024-09-12T00:27:43.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.116+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=ENAVL4OH0LP6 tag=HFG7VHAKQUV9 type=write size=1605010 2024-09-12T00:27:43.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.120+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~0FBHS1C3XD4C.0 size=1048576 2024-09-12T00:27:43.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.124+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~0FBHS1C3XD4C.1 size=1048576 2024-09-12T00:27:43.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.124+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~0FBHS1C3XD4C.2 size=1865 2024-09-12T00:27:43.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.132+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=0FBHS1C3XD4C tag=QIFU1AKW20DM type=write size=3147593 2024-09-12T00:27:43.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.136+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~0HF149I9TRQT.0 size=1048576 2024-09-12T00:27:43.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.140+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~0HF149I9TRQT.1 size=1048576 2024-09-12T00:27:43.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.144+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~0HF149I9TRQT.2 size=202598 2024-09-12T00:27:43.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.144+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=0HF149I9TRQT tag=ZBG78CF39UCX type=write size=3348326 2024-09-12T00:27:43.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.148+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=C19RVWRQMLCH type=del 2024-09-12T00:27:43.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.148+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=EPY1IRI3ROHK type=del size=4084111 2024-09-12T00:27:43.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.152+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=IT0HJAKKIV2V type=del 2024-09-12T00:27:43.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.160+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~YTMN6IDIPPL1.0 size=1048576 2024-09-12T00:27:43.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.160+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~YTMN6IDIPPL1.1 size=1048576 2024-09-12T00:27:43.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.164+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~YTMN6IDIPPL1.2 size=802319 2024-09-12T00:27:43.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.164+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=YTMN6IDIPPL1 tag=J19TMISVZYXS type=write size=3948047 2024-09-12T00:27:43.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.168+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=17QHH1N8V23V type=del 2024-09-12T00:27:43.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.172+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=8HFHI6GUPLE0 type=del size=1460453 2024-09-12T00:27:43.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.176+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~4DC1C2Q67R39.0 size=960622 2024-09-12T00:27:43.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.180+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=4DC1C2Q67R39 tag=CT9GQB5NR1C1 type=write size=2009198 2024-09-12T00:27:43.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.184+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~8S1HOGC7URK8.0 size=637767 2024-09-12T00:27:43.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.184+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=8S1HOGC7URK8 tag=13Y4SLECY3U9 type=write size=1686343 2024-09-12T00:27:43.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.188+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~I0EYF8AGFXLN.0 size=1048576 2024-09-12T00:27:43.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.188+0000 7f712938c8c0 1 < canceled part key=_multipart_A8L061CQ0M0J.2~I0EYF8AGFXLN.1 size=330999 2024-09-12T00:27:43.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.196+0000 7f712938c8c0 1 < canceled multipart upload key=A8L061CQ0M0J upload=I0EYF8AGFXLN tag=V1CL2EIBTZ5O type=write size=2428151 2024-09-12T00:27:43.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.200+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=EY5N7ZRM3B8I type=del size=1046821 2024-09-12T00:27:43.202 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.200+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=EATQ8NUXUTTK type=del 2024-09-12T00:27:43.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.204+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=15JRTOT3Q7UB type=del size=1171393 2024-09-12T00:27:43.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.208+0000 7f712938c8c0 1 < completed write operation key=9YZP0TIRWWRF tag=N3ILMDMIFUYT type=write size=909361 2024-09-12T00:27:43.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.212+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=L680AQM1T8FI type=del size=3898523 2024-09-12T00:27:43.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.220+0000 7f712938c8c0 1 < suggested remove operation key=5KVIIZS50CNT tag=BPZS0ISKCM3P type=del 2024-09-12T00:27:43.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.228+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~IRL3FHTIHNGS.0 size=1048576 2024-09-12T00:27:43.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.228+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~IRL3FHTIHNGS.1 size=57148 2024-09-12T00:27:43.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.228+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=IRL3FHTIHNGS tag=6FKA4EXM5Y6G type=write size=2154300 2024-09-12T00:27:43.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.232+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=MNPFCO8H62ZF type=del 2024-09-12T00:27:43.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.240+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~6I55HC98NPRT.0 size=421310 2024-09-12T00:27:43.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.240+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=6I55HC98NPRT tag=8PI8RR8DU6KH type=write size=1469886 2024-09-12T00:27:43.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.244+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=WQJUOFHHH1LA type=del 2024-09-12T00:27:43.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.252+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~FSRX1OSRXE7U.0 size=1048576 2024-09-12T00:27:43.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.252+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~FSRX1OSRXE7U.1 size=1048576 2024-09-12T00:27:43.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.256+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~FSRX1OSRXE7U.2 size=12434 2024-09-12T00:27:43.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.256+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=FSRX1OSRXE7U tag=8HP5NKTFAMHV type=write size=3158162 2024-09-12T00:27:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.260+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~NGBHE3QADJBA.0 size=261080 2024-09-12T00:27:43.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.264+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=NGBHE3QADJBA tag=D58G68IATG4T type=write size=1309656 2024-09-12T00:27:43.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.268+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=CQAR4GAUZ698 type=del size=1549990 2024-09-12T00:27:43.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.272+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~SROPIRGUTM26.0 size=43264 2024-09-12T00:27:43.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.280+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=SROPIRGUTM26 tag=VZJBM03F9K4H type=write size=1091840 2024-09-12T00:27:43.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.284+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=RY6BHVY0FU5M type=del size=2118393 2024-09-12T00:27:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.288+0000 7f712938c8c0 1 < canceled operation key=04RL082VPLIM tag=IDF7WFDPV4L8 type=del size=461553 2024-09-12T00:27:43.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.292+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~4QBNOLI9U25S.0 size=1048576 2024-09-12T00:27:43.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.296+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~4QBNOLI9U25S.1 size=1048576 2024-09-12T00:27:43.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.300+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~4QBNOLI9U25S.2 size=576125 2024-09-12T00:27:43.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.300+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=4QBNOLI9U25S tag=ZOUI3ZZNP3EZ type=write size=3721853 2024-09-12T00:27:43.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.304+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~Q8SVXW9V96ZX.0 size=712960 2024-09-12T00:27:43.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.312+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=Q8SVXW9V96ZX tag=R303R00LBL8J type=write size=1761536 2024-09-12T00:27:43.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.316+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=6Z31EJ1K1T2J type=del size=215000 2024-09-12T00:27:43.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.320+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~ENAVL4OH0LP6.0 size=556434 2024-09-12T00:27:43.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.328+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=ENAVL4OH0LP6 tag=HFG7VHAKQUV9 type=write size=1605010 2024-09-12T00:27:43.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.332+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~ZV3XSM9AILQN.0 size=1048576 2024-09-12T00:27:43.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.340+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~ZV3XSM9AILQN.1 size=1048576 2024-09-12T00:27:43.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.344+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~ZV3XSM9AILQN.2 size=986732 2024-09-12T00:27:43.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.344+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=ZV3XSM9AILQN tag=VF36OVVALZTL type=write size=4132460 2024-09-12T00:27:43.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.348+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~0HF149I9TRQT.0 size=1048576 2024-09-12T00:27:43.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.352+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~0HF149I9TRQT.1 size=1048576 2024-09-12T00:27:43.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.356+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~0HF149I9TRQT.2 size=202598 2024-09-12T00:27:43.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.360+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=0HF149I9TRQT tag=ZBG78CF39UCX type=write size=3348326 2024-09-12T00:27:43.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.364+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=4RJXYWI8DZ8E type=del size=1443319 2024-09-12T00:27:43.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.372+0000 7f712938c8c0 1 < suggested remove operation key=W01PFMFNYLED tag=EPY1IRI3ROHK type=del 2024-09-12T00:27:43.376 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.376+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=2WQAELT9CN49 type=del size=2898703 2024-09-12T00:27:43.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.380+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~YTMN6IDIPPL1.0 size=1048576 2024-09-12T00:27:43.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.384+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~YTMN6IDIPPL1.1 size=1048576 2024-09-12T00:27:43.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.388+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~YTMN6IDIPPL1.2 size=802319 2024-09-12T00:27:43.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.392+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=YTMN6IDIPPL1 tag=J19TMISVZYXS type=write size=3948047 2024-09-12T00:27:43.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.396+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=336J6HL4L9VS type=del size=2688240 2024-09-12T00:27:43.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.400+0000 7f712938c8c0 -1 < failed to complete operation key=5KVIIZS50CNT tag=8HFHI6GUPLE0 type=del size=1460453: (22) Invalid argument 2024-09-12T00:27:43.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.404+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=4Q5PFRF0A01O type=del size=353305 2024-09-12T00:27:43.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.408+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~8S1HOGC7URK8.0 size=637767 2024-09-12T00:27:43.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.416+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=8S1HOGC7URK8 tag=13Y4SLECY3U9 type=write size=1686343 2024-09-12T00:27:43.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.420+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=M8MWIY1FAO1P type=del size=978979 2024-09-12T00:27:43.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.428+0000 7f712938c8c0 1 < suggested remove operation key=Z2RYL03II71Z tag=EY5N7ZRM3B8I type=del 2024-09-12T00:27:43.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.432+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=4OAST3J68WD7 type=del size=81631 2024-09-12T00:27:43.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.436+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=15JRTOT3Q7UB type=del 2024-09-12T00:27:43.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.440+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=TZ1K7RIESTK0 type=write size=405324 2024-09-12T00:27:43.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.444+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=L680AQM1T8FI type=del 2024-09-12T00:27:43.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.452+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~END24S9H36P4.0 size=1048576 2024-09-12T00:27:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.452+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~END24S9H36P4.1 size=1048576 2024-09-12T00:27:43.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.456+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~END24S9H36P4.2 size=716484 2024-09-12T00:27:43.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.456+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=END24S9H36P4 tag=ETBTW0M7Z3PM type=write size=3862212 2024-09-12T00:27:43.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.456+0000 7f712938c8c0 1 < canceled part key=_multipart_W01PFMFNYLED.2~IRL3FHTIHNGS.0 size=1048576 2024-09-12T00:27:43.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.460+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~IRL3FHTIHNGS.1 size=57148 2024-09-12T00:27:43.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.464+0000 7f712938c8c0 1 < canceled multipart upload key=W01PFMFNYLED upload=IRL3FHTIHNGS tag=6FKA4EXM5Y6G type=write size=2154300 2024-09-12T00:27:43.470 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.468+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=05S7T8CRES43 type=del size=1537283 2024-09-12T00:27:43.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.472+0000 7f712938c8c0 1 < canceled part key=_multipart_ULE6S9Y6DS62.2~6I55HC98NPRT.0 size=421310 2024-09-12T00:27:43.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.476+0000 7f712938c8c0 1 < canceled multipart upload key=ULE6S9Y6DS62 upload=6I55HC98NPRT tag=8PI8RR8DU6KH type=write size=1469886 2024-09-12T00:27:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.480+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=R196AMO9FBDF type=del size=3262818 2024-09-12T00:27:43.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.484+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~FSRX1OSRXE7U.0 size=1048576 2024-09-12T00:27:43.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.488+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~FSRX1OSRXE7U.1 size=1048576 2024-09-12T00:27:43.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.492+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~FSRX1OSRXE7U.2 size=12434 2024-09-12T00:27:43.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.496+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=FSRX1OSRXE7U tag=8HP5NKTFAMHV type=write size=3158162 2024-09-12T00:27:43.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.500+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=83RWV9974330 type=del size=2559536 2024-09-12T00:27:43.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.508+0000 7f712938c8c0 1 < suggested remove operation key=QL3FL4J9TKY4 tag=CQAR4GAUZ698 type=del 2024-09-12T00:27:43.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.516+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~JIAULHOUTIAG.0 size=1048576 2024-09-12T00:27:43.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.520+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~JIAULHOUTIAG.1 size=1048576 2024-09-12T00:27:43.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.524+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~JIAULHOUTIAG.2 size=894985 2024-09-12T00:27:43.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.524+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=JIAULHOUTIAG tag=J3Z2BDMZORZC type=write size=4040713 2024-09-12T00:27:43.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.528+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=RY6BHVY0FU5M type=del 2024-09-12T00:27:43.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.532+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~ISFH1LDZV63U.0 size=1048576 2024-09-12T00:27:43.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.536+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~ISFH1LDZV63U.1 size=1048576 2024-09-12T00:27:43.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.536+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~ISFH1LDZV63U.2 size=61516 2024-09-12T00:27:43.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.536+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=ISFH1LDZV63U tag=TGOFBYQLP1DI type=write size=3207244 2024-09-12T00:27:43.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.540+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~4QBNOLI9U25S.0 size=1048576 2024-09-12T00:27:43.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.544+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~4QBNOLI9U25S.1 size=1048576 2024-09-12T00:27:43.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.548+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~4QBNOLI9U25S.2 size=576125 2024-09-12T00:27:43.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.552+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=4QBNOLI9U25S tag=ZOUI3ZZNP3EZ type=write size=3721853 2024-09-12T00:27:43.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.556+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=3DIDWFUU6P7M type=del size=3293177 2024-09-12T00:27:43.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.560+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=6Z31EJ1K1T2J type=del 2024-09-12T00:27:43.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.568+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~9CC4QALG5TYP.0 size=1048576 2024-09-12T00:27:43.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.572+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~9CC4QALG5TYP.1 size=1048576 2024-09-12T00:27:43.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.572+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~9CC4QALG5TYP.2 size=940957 2024-09-12T00:27:43.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.572+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=9CC4QALG5TYP tag=57JP1TY1WAT8 type=write size=4086685 2024-09-12T00:27:43.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.576+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~ZV3XSM9AILQN.0 size=1048576 2024-09-12T00:27:43.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.580+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~ZV3XSM9AILQN.1 size=1048576 2024-09-12T00:27:43.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.580+0000 7f712938c8c0 1 < canceled part key=_multipart_0QZKHZTVP3RQ.2~ZV3XSM9AILQN.2 size=986732 2024-09-12T00:27:43.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.588+0000 7f712938c8c0 1 < canceled multipart upload key=0QZKHZTVP3RQ upload=ZV3XSM9AILQN tag=VF36OVVALZTL type=write size=4132460 2024-09-12T00:27:43.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.592+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=UI04KYIO4Y7M type=write size=28393 2024-09-12T00:27:43.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.596+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=4RJXYWI8DZ8E type=del 2024-09-12T00:27:43.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.600+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=Y7AUP1M7HFYV type=del size=1275702 2024-09-12T00:27:43.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.604+0000 7f712938c8c0 -1 < failed to complete operation key=Z2RYL03II71Z tag=2WQAELT9CN49 type=del size=2898703: (22) Invalid argument 2024-09-12T00:27:43.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.612+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~8LNT6G27OV98.0 size=389307 2024-09-12T00:27:43.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.612+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=8LNT6G27OV98 tag=A7YWUCS31FWA type=write size=1437883 2024-09-12T00:27:43.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.616+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=336J6HL4L9VS type=del 2024-09-12T00:27:43.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.624+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~S8089PGSHHBR.0 size=184474 2024-09-12T00:27:43.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.624+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=S8089PGSHHBR tag=KEW4LNJP43W4 type=write size=1233050 2024-09-12T00:27:43.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.628+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=4Q5PFRF0A01O type=del 2024-09-12T00:27:43.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.632+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~LYZC4FFK820H.0 size=1048576 2024-09-12T00:27:43.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.636+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~LYZC4FFK820H.1 size=1048576 2024-09-12T00:27:43.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.640+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~LYZC4FFK820H.2 size=110786 2024-09-12T00:27:43.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.640+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=LYZC4FFK820H tag=S2SM43Z61QRQ type=write size=3256514 2024-09-12T00:27:43.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.644+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=M8MWIY1FAO1P type=del 2024-09-12T00:27:43.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.648+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~DNJCHRUBC7W5.0 size=620848 2024-09-12T00:27:43.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.648+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=DNJCHRUBC7W5 tag=XFUBEEF1DYVC type=write size=1669424 2024-09-12T00:27:43.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.652+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=4OAST3J68WD7 type=del 2024-09-12T00:27:43.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.660+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=DFXB6IB2I26Z type=write size=753739 2024-09-12T00:27:43.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.664+0000 7f712938c8c0 1 < completed write operation key=9HX9GER6OKVI tag=TZ1K7RIESTK0 type=write size=405324 2024-09-12T00:27:43.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.664+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=95C5ESPH6Q3K type=del size=2879508 2024-09-12T00:27:43.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.668+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~END24S9H36P4.0 size=1048576 2024-09-12T00:27:43.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.672+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~END24S9H36P4.1 size=1048576 2024-09-12T00:27:43.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.676+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~END24S9H36P4.2 size=716484 2024-09-12T00:27:43.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.684+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=END24S9H36P4 tag=ETBTW0M7Z3PM type=write size=3862212 2024-09-12T00:27:43.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.688+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=26RQJNS6P4EW type=del size=1390186 2024-09-12T00:27:43.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.692+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=05S7T8CRES43 type=del 2024-09-12T00:27:43.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.700+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=79NO4PJHQS5N type=del size=2411739 2024-09-12T00:27:43.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.704+0000 7f712938c8c0 1 < suggested remove operation key=HPM9GFRASWIV tag=R196AMO9FBDF type=del 2024-09-12T00:27:43.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.708+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=ZF6Y3TSIQ130 type=del size=1695202 2024-09-12T00:27:43.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.712+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=83RWV9974330 type=del 2024-09-12T00:27:43.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.716+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=KGB1GC14OADR type=del size=3085176 2024-09-12T00:27:43.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.720+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~JIAULHOUTIAG.0 size=1048576 2024-09-12T00:27:43.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.724+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~JIAULHOUTIAG.1 size=1048576 2024-09-12T00:27:43.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.728+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~JIAULHOUTIAG.2 size=894985 2024-09-12T00:27:43.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.732+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=JIAULHOUTIAG tag=J3Z2BDMZORZC type=write size=4040713 2024-09-12T00:27:43.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.740+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~8S4U701YQQHW.0 size=1048576 2024-09-12T00:27:43.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.740+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~8S4U701YQQHW.1 size=203397 2024-09-12T00:27:43.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.740+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=8S4U701YQQHW tag=3HWRHHIRT61V type=write size=2300549 2024-09-12T00:27:43.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.744+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~ISFH1LDZV63U.0 size=1048576 2024-09-12T00:27:43.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.748+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~ISFH1LDZV63U.1 size=1048576 2024-09-12T00:27:43.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.748+0000 7f712938c8c0 1 < canceled part key=_multipart_V9K2307BGOKP.2~ISFH1LDZV63U.2 size=61516 2024-09-12T00:27:43.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.756+0000 7f712938c8c0 1 < canceled multipart upload key=V9K2307BGOKP upload=ISFH1LDZV63U tag=TGOFBYQLP1DI type=write size=3207244 2024-09-12T00:27:43.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.760+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~MPX1M8STI3CR.0 size=1048576 2024-09-12T00:27:43.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.764+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~MPX1M8STI3CR.1 size=469749 2024-09-12T00:27:43.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.764+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=MPX1M8STI3CR tag=XW70VKM7TUTU type=write size=2566901 2024-09-12T00:27:43.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.768+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=3DIDWFUU6P7M type=del 2024-09-12T00:27:43.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.772+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=W2CF36PVQD65 type=del size=3232316 2024-09-12T00:27:43.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.776+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~9CC4QALG5TYP.0 size=1048576 2024-09-12T00:27:43.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.776+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~9CC4QALG5TYP.1 size=1048576 2024-09-12T00:27:43.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.780+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~9CC4QALG5TYP.2 size=940957 2024-09-12T00:27:43.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.788+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=9CC4QALG5TYP tag=57JP1TY1WAT8 type=write size=4086685 2024-09-12T00:27:43.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.792+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=8YOVAS0OT5M5 type=del size=887498 2024-09-12T00:27:43.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.796+0000 7f712938c8c0 1 < completed write operation key=N69XPNN6Y6HZ tag=UI04KYIO4Y7M type=write size=28393 2024-09-12T00:27:43.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.800+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~0GNQO9PXSSZT.0 size=1048576 2024-09-12T00:27:43.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.804+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~0GNQO9PXSSZT.1 size=751654 2024-09-12T00:27:43.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.804+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=0GNQO9PXSSZT tag=LQMS123GGLTZ type=write size=2848806 2024-09-12T00:27:43.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.812+0000 7f712938c8c0 1 < suggested update operation key=T1H3O6A6HBQH tag=Y7AUP1M7HFYV type=del size=1275702 2024-09-12T00:27:43.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.816+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=EG5FUCD2N3XQ type=del size=3885607 2024-09-12T00:27:43.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.820+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~8LNT6G27OV98.0 size=389307 2024-09-12T00:27:43.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.828+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=8LNT6G27OV98 tag=A7YWUCS31FWA type=write size=1437883 2024-09-12T00:27:43.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.832+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=5EQ27VVGON74 type=del size=1049937 2024-09-12T00:27:43.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.836+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~S8089PGSHHBR.0 size=184474 2024-09-12T00:27:43.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.844+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=S8089PGSHHBR tag=KEW4LNJP43W4 type=write size=1233050 2024-09-12T00:27:43.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.848+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=O31LTU1WDVHZ type=write size=76979 2024-09-12T00:27:43.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.852+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~LYZC4FFK820H.0 size=1048576 2024-09-12T00:27:43.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.852+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~LYZC4FFK820H.1 size=1048576 2024-09-12T00:27:43.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.852+0000 7f712938c8c0 1 < canceled part key=_multipart_HPM9GFRASWIV.2~LYZC4FFK820H.2 size=110786 2024-09-12T00:27:43.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.860+0000 7f712938c8c0 1 < canceled multipart upload key=HPM9GFRASWIV upload=LYZC4FFK820H tag=S2SM43Z61QRQ type=write size=3256514 2024-09-12T00:27:43.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.864+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=MW01VUM09MLD type=del size=2685037 2024-09-12T00:27:43.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.868+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~DNJCHRUBC7W5.0 size=620848 2024-09-12T00:27:43.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.872+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=DNJCHRUBC7W5 tag=XFUBEEF1DYVC type=write size=1669424 2024-09-12T00:27:43.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.880+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~ZVO6HWLQP4NQ.0 size=1048576 2024-09-12T00:27:43.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.884+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~ZVO6HWLQP4NQ.1 size=302260 2024-09-12T00:27:43.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.884+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=ZVO6HWLQP4NQ tag=IRXSF9GJEE2E type=write size=2399412 2024-09-12T00:27:43.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.888+0000 7f712938c8c0 1 < completed write operation key=KNGB14TWW6XC tag=DFXB6IB2I26Z type=write size=753739 2024-09-12T00:27:43.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.892+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~L3GNIY8BDCM5.0 size=391375 2024-09-12T00:27:43.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.892+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=L3GNIY8BDCM5 tag=Q0UXAM0RMUQM type=write size=1439951 2024-09-12T00:27:43.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.896+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=95C5ESPH6Q3K type=del 2024-09-12T00:27:43.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.900+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=FLMB9P8P6I3N type=del size=2940087 2024-09-12T00:27:43.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.908+0000 7f712938c8c0 1 < suggested remove operation key=N69XPNN6Y6HZ tag=26RQJNS6P4EW type=del 2024-09-12T00:27:43.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.912+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~YCKLTLFHTAV1.0 size=1048576 2024-09-12T00:27:43.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.916+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~YCKLTLFHTAV1.1 size=1048576 2024-09-12T00:27:43.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.920+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~YCKLTLFHTAV1.2 size=882006 2024-09-12T00:27:43.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.920+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=YCKLTLFHTAV1 tag=EUT9QFV9BKN3 type=write size=4027734 2024-09-12T00:27:43.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.924+0000 7f712938c8c0 1 < canceled operation key=ULE6S9Y6DS62 tag=79NO4PJHQS5N type=del size=2411739 2024-09-12T00:27:43.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.928+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=GF6OXUT4WPVQ type=del size=1501538 2024-09-12T00:27:43.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.932+0000 7f712938c8c0 1 < canceled operation key=WP4RJQVZVEE2 tag=ZF6Y3TSIQ130 type=del size=1695202 2024-09-12T00:27:43.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.936+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~IM38YNSMFXMM.0 size=439275 2024-09-12T00:27:43.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.936+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=IM38YNSMFXMM tag=HXBE6R9KHAPN type=write size=1487851 2024-09-12T00:27:43.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.940+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=KGB1GC14OADR type=del 2024-09-12T00:27:43.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.944+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=RQZVMUWLZVC9 type=del size=1396499 2024-09-12T00:27:43.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.948+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~8S4U701YQQHW.0 size=1048576 2024-09-12T00:27:43.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.948+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~8S4U701YQQHW.1 size=203397 2024-09-12T00:27:43.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.956+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=8S4U701YQQHW tag=3HWRHHIRT61V type=write size=2300549 2024-09-12T00:27:43.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.960+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~1YPGNS2PGKE2.0 size=1048576 2024-09-12T00:27:43.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.964+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~1YPGNS2PGKE2.1 size=472599 2024-09-12T00:27:43.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.964+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=1YPGNS2PGKE2 tag=JA3IT9MBF0E1 type=write size=2569751 2024-09-12T00:27:43.968 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.968+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~MPX1M8STI3CR.0 size=1048576 2024-09-12T00:27:43.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.972+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~MPX1M8STI3CR.1 size=469749 2024-09-12T00:27:43.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.976+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=MPX1M8STI3CR tag=XW70VKM7TUTU type=write size=2566901 2024-09-12T00:27:43.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.984+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~JGUZTGR16CZA.0 size=1048576 2024-09-12T00:27:43.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.984+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~JGUZTGR16CZA.1 size=1048576 2024-09-12T00:27:43.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.988+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~JGUZTGR16CZA.2 size=1031861 2024-09-12T00:27:43.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.988+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=JGUZTGR16CZA tag=EKD9JQ3WCX4J type=write size=4177589 2024-09-12T00:27:43.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.992+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=W2CF36PVQD65 type=del 2024-09-12T00:27:43.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:43.996+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=UTB6Y2E0KEPL type=del size=3897520 2024-09-12T00:27:44.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.004+0000 7f712938c8c0 1 < suggested remove operation key=7X45VJAQO7PF tag=8YOVAS0OT5M5 type=del 2024-09-12T00:27:44.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.008+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=IPLZKWIYC830 type=del size=1087267 2024-09-12T00:27:44.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.008+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~0GNQO9PXSSZT.0 size=1048576 2024-09-12T00:27:44.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.012+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~0GNQO9PXSSZT.1 size=751654 2024-09-12T00:27:44.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.020+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=0GNQO9PXSSZT tag=LQMS123GGLTZ type=write size=2848806 2024-09-12T00:27:44.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.024+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=ZL9H0Y4RUST1 type=del size=1240083 2024-09-12T00:27:44.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.024+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=EG5FUCD2N3XQ type=del 2024-09-12T00:27:44.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.036+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~O11N4JZ9BWCI.0 size=1048576 2024-09-12T00:27:44.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.040+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~O11N4JZ9BWCI.1 size=222540 2024-09-12T00:27:44.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.040+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=O11N4JZ9BWCI tag=1RNV3WARLNMA type=write size=2319692 2024-09-12T00:27:44.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.044+0000 7f712938c8c0 1 < canceled operation key=04RL082VPLIM tag=5EQ27VVGON74 type=del size=1049937 2024-09-12T00:27:44.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.044+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=SXJRVZYTZAYQ type=del size=2727300 2024-09-12T00:27:44.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.048+0000 7f712938c8c0 -1 < no bi entry to suggest for operation key=7X45VJAQO7PF tag=O31LTU1WDVHZ type=write size=76979: (2) No such file or directory 2024-09-12T00:27:44.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.056+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~9YP24M8CJXKW.0 size=1048576 2024-09-12T00:27:44.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.056+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~9YP24M8CJXKW.1 size=1048576 2024-09-12T00:27:44.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.060+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~9YP24M8CJXKW.2 size=176309 2024-09-12T00:27:44.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.060+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=9YP24M8CJXKW tag=G6CKWTOUZOFG type=write size=3322037 2024-09-12T00:27:44.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.064+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=MW01VUM09MLD type=del 2024-09-12T00:27:44.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.068+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=V45BGSHRRM4H type=del size=735988 2024-09-12T00:27:44.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.072+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~ZVO6HWLQP4NQ.0 size=1048576 2024-09-12T00:27:44.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.076+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~ZVO6HWLQP4NQ.1 size=302260 2024-09-12T00:27:44.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.080+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=ZVO6HWLQP4NQ tag=IRXSF9GJEE2E type=write size=2399412 2024-09-12T00:27:44.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.084+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=5544EXUPAKFB type=del size=389017 2024-09-12T00:27:44.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.088+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~L3GNIY8BDCM5.0 size=391375 2024-09-12T00:27:44.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.096+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=L3GNIY8BDCM5 tag=Q0UXAM0RMUQM type=write size=1439951 2024-09-12T00:27:44.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.100+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=0NL4X90GYV5O type=write size=860567 2024-09-12T00:27:44.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.104+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=FLMB9P8P6I3N type=del 2024-09-12T00:27:44.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.108+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=48JYEVAMY79H type=del size=571474 2024-09-12T00:27:44.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.112+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~YCKLTLFHTAV1.0 size=1048576 2024-09-12T00:27:44.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.116+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~YCKLTLFHTAV1.1 size=1048576 2024-09-12T00:27:44.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.116+0000 7f712938c8c0 1 < canceled part key=_multipart_BH2YHXHVEZCH.2~YCKLTLFHTAV1.2 size=882006 2024-09-12T00:27:44.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.120+0000 7f712938c8c0 1 < canceled multipart upload key=BH2YHXHVEZCH upload=YCKLTLFHTAV1 tag=EUT9QFV9BKN3 type=write size=4027734 2024-09-12T00:27:44.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.124+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=AIB0NEHVDF4L type=write size=1023038 2024-09-12T00:27:44.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.128+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=GF6OXUT4WPVQ type=del 2024-09-12T00:27:44.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.132+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=1BBGYQH6TCEM type=del size=2968919 2024-09-12T00:27:44.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.136+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~IM38YNSMFXMM.0 size=439275 2024-09-12T00:27:44.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.144+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=IM38YNSMFXMM tag=HXBE6R9KHAPN type=write size=1487851 2024-09-12T00:27:44.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.144+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=UHYVJNOUS08G type=del size=1225794 2024-09-12T00:27:44.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.152+0000 7f712938c8c0 1 < suggested remove operation key=W01PFMFNYLED tag=RQZVMUWLZVC9 type=del 2024-09-12T00:27:44.157 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.156+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=LQ72QKVA6LLA type=write size=747618 2024-09-12T00:27:44.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.160+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~1YPGNS2PGKE2.0 size=1048576 2024-09-12T00:27:44.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.164+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~1YPGNS2PGKE2.1 size=472599 2024-09-12T00:27:44.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.168+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=1YPGNS2PGKE2 tag=JA3IT9MBF0E1 type=write size=2569751 2024-09-12T00:27:44.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.176+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~2Y42Y5V3Y7XR.0 size=1048576 2024-09-12T00:27:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.180+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~2Y42Y5V3Y7XR.1 size=1015862 2024-09-12T00:27:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.180+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=2Y42Y5V3Y7XR tag=15B8X4R8F04X type=write size=3113014 2024-09-12T00:27:44.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.184+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~JGUZTGR16CZA.0 size=1048576 2024-09-12T00:27:44.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.188+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~JGUZTGR16CZA.1 size=1048576 2024-09-12T00:27:44.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.188+0000 7f712938c8c0 1 < canceled part key=_multipart_5KVIIZS50CNT.2~JGUZTGR16CZA.2 size=1031861 2024-09-12T00:27:44.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.192+0000 7f712938c8c0 1 < canceled multipart upload key=5KVIIZS50CNT upload=JGUZTGR16CZA tag=EKD9JQ3WCX4J type=write size=4177589 2024-09-12T00:27:44.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.196+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=1DSUG3UXVNRQ type=del size=1923555 2024-09-12T00:27:44.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.200+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=UTB6Y2E0KEPL type=del 2024-09-12T00:27:44.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.204+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=40V3T5GBISGY type=del size=3815222 2024-09-12T00:27:44.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.212+0000 7f712938c8c0 1 < suggested update operation key=WP4RJQVZVEE2 tag=IPLZKWIYC830 type=del size=1087267 2024-09-12T00:27:44.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.216+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=2RK05BJ6PIY4 type=del size=2660827 2024-09-12T00:27:44.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.220+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=ZL9H0Y4RUST1 type=del 2024-09-12T00:27:44.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.224+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=NF3IHLD363FI type=del size=1417959 2024-09-12T00:27:44.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.228+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~O11N4JZ9BWCI.0 size=1048576 2024-09-12T00:27:44.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.232+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~O11N4JZ9BWCI.1 size=222540 2024-09-12T00:27:44.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.236+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=O11N4JZ9BWCI tag=1RNV3WARLNMA type=write size=2319692 2024-09-12T00:27:44.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.240+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=YZ237CPVIPNN type=write size=830761 2024-09-12T00:27:44.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.244+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=SXJRVZYTZAYQ type=del 2024-09-12T00:27:44.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.248+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=XCWSJUW6GW15 type=del size=2146946 2024-09-12T00:27:44.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.252+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~9YP24M8CJXKW.0 size=1048576 2024-09-12T00:27:44.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.256+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~9YP24M8CJXKW.1 size=1048576 2024-09-12T00:27:44.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.256+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~9YP24M8CJXKW.2 size=176309 2024-09-12T00:27:44.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.264+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=9YP24M8CJXKW tag=G6CKWTOUZOFG type=write size=3322037 2024-09-12T00:27:44.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.268+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~J2VNK6SRJ4VQ.0 size=1048576 2024-09-12T00:27:44.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.272+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~J2VNK6SRJ4VQ.1 size=811797 2024-09-12T00:27:44.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.272+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=J2VNK6SRJ4VQ tag=Y2D6O8VLMZ9X type=write size=2908949 2024-09-12T00:27:44.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.276+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=V45BGSHRRM4H type=del 2024-09-12T00:27:44.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.284+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~RK7YM73V60TA.0 size=1048576 2024-09-12T00:27:44.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.284+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~RK7YM73V60TA.1 size=528607 2024-09-12T00:27:44.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.284+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=RK7YM73V60TA tag=E60U9I42E13N type=write size=2625759 2024-09-12T00:27:44.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.292+0000 7f712938c8c0 1 < suggested update operation key=WP4RJQVZVEE2 tag=5544EXUPAKFB type=del size=389017 2024-09-12T00:27:44.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.296+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=AGH41GS7F0MN type=write size=205517 2024-09-12T00:27:44.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.300+0000 7f712938c8c0 1 < completed write operation key=9YZP0TIRWWRF tag=0NL4X90GYV5O type=write size=860567 2024-09-12T00:27:44.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.304+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=X5SO2P8MWED1 type=del size=703451 2024-09-12T00:27:44.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.312+0000 7f712938c8c0 1 < suggested remove operation key=ULE6S9Y6DS62 tag=48JYEVAMY79H type=del 2024-09-12T00:27:44.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.316+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~K3VB9TILDTBA.0 size=1048576 2024-09-12T00:27:44.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.320+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~K3VB9TILDTBA.1 size=1048576 2024-09-12T00:27:44.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.324+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~K3VB9TILDTBA.2 size=279499 2024-09-12T00:27:44.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.324+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=K3VB9TILDTBA tag=361WN97Z7Q8D type=write size=3425227 2024-09-12T00:27:44.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.328+0000 7f712938c8c0 1 < completed write operation key=HPM9GFRASWIV tag=AIB0NEHVDF4L type=write size=1023038 2024-09-12T00:27:44.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.332+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=H9TDXZVU7KMA type=del size=3416621 2024-09-12T00:27:44.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.336+0000 7f712938c8c0 1 < canceled operation key=9N3U208FGM79 tag=1BBGYQH6TCEM type=del size=2968919 2024-09-12T00:27:44.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.340+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~2HR56LJ49A0V.0 size=1048576 2024-09-12T00:27:44.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.344+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~2HR56LJ49A0V.1 size=1048576 2024-09-12T00:27:44.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.348+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~2HR56LJ49A0V.2 size=805027 2024-09-12T00:27:44.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.348+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=2HR56LJ49A0V tag=FZJ1HMNH2NWY type=write size=3950755 2024-09-12T00:27:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.356+0000 7f712938c8c0 1 < suggested update operation key=A8L061CQ0M0J tag=UHYVJNOUS08G type=del size=1225794 2024-09-12T00:27:44.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.364+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~PF4FMKKR32P7.0 size=1048576 2024-09-12T00:27:44.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.364+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~PF4FMKKR32P7.1 size=848509 2024-09-12T00:27:44.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.364+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=PF4FMKKR32P7 tag=LNKI6JF4AYBO type=write size=2945661 2024-09-12T00:27:44.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.368+0000 7f712938c8c0 -1 < failed to complete operation key=A8L061CQ0M0J tag=LQ72QKVA6LLA type=write size=747618: (22) Invalid argument 2024-09-12T00:27:44.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.372+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=B703GBZSKQIU type=write size=351118 2024-09-12T00:27:44.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.376+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~2Y42Y5V3Y7XR.0 size=1048576 2024-09-12T00:27:44.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.380+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~2Y42Y5V3Y7XR.1 size=1015862 2024-09-12T00:27:44.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.392+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=2Y42Y5V3Y7XR tag=15B8X4R8F04X type=write size=3113014 2024-09-12T00:27:44.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.396+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=BKZEZFPDG0B8 type=del size=811251 2024-09-12T00:27:44.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.396+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=1DSUG3UXVNRQ type=del 2024-09-12T00:27:44.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.404+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~UXBLJAETXHOQ.0 size=43046 2024-09-12T00:27:44.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.404+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=UXBLJAETXHOQ tag=7UKCMLEKAYT2 type=write size=1091622 2024-09-12T00:27:44.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.408+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=40V3T5GBISGY type=del 2024-09-12T00:27:44.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.412+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=C0DX7VO161D2 type=write size=530412 2024-09-12T00:27:44.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.420+0000 7f712938c8c0 1 < suggested remove operation key=F7T79C7MZX35 tag=2RK05BJ6PIY4 type=del 2024-09-12T00:27:44.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.428+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~JR3VRCF9ICJ6.0 size=1048576 2024-09-12T00:27:44.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.432+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~JR3VRCF9ICJ6.1 size=1048576 2024-09-12T00:27:44.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.432+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~JR3VRCF9ICJ6.2 size=193368 2024-09-12T00:27:44.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.432+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=JR3VRCF9ICJ6 tag=IKQUFDXXJQOA type=write size=3339096 2024-09-12T00:27:44.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.436+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=NF3IHLD363FI type=del 2024-09-12T00:27:44.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.444+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~RTXPK332UPUJ.0 size=312010 2024-09-12T00:27:44.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.444+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=RTXPK332UPUJ tag=3RA1M7GRIZ26 type=write size=1360586 2024-09-12T00:27:44.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.448+0000 7f712938c8c0 1 < completed write operation key=5KVIIZS50CNT tag=YZ237CPVIPNN type=write size=830761 2024-09-12T00:27:44.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.456+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~XAWBYCB0443H.0 size=1048576 2024-09-12T00:27:44.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.460+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~XAWBYCB0443H.1 size=1048576 2024-09-12T00:27:44.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.460+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~XAWBYCB0443H.2 size=280425 2024-09-12T00:27:44.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.460+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=XAWBYCB0443H tag=W3D8RHXYT1N9 type=write size=3426153 2024-09-12T00:27:44.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.468+0000 7f712938c8c0 1 < suggested update operation key=BH2YHXHVEZCH tag=XCWSJUW6GW15 type=del size=2146946 2024-09-12T00:27:44.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.472+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=7880TAKF4HG6 type=del size=4057886 2024-09-12T00:27:44.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.476+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~J2VNK6SRJ4VQ.0 size=1048576 2024-09-12T00:27:44.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.480+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~J2VNK6SRJ4VQ.1 size=811797 2024-09-12T00:27:44.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.484+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=J2VNK6SRJ4VQ tag=Y2D6O8VLMZ9X type=write size=2908949 2024-09-12T00:27:44.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.492+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~BUE9F290T8AE.0 size=1048576 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.496+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~BUE9F290T8AE.1 size=488910 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.496+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=BUE9F290T8AE tag=7FTNS1BGAQL9 type=write size=2586062 2024-09-12T00:27:44.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.500+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~RK7YM73V60TA.0 size=1048576 2024-09-12T00:27:44.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.504+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~RK7YM73V60TA.1 size=528607 2024-09-12T00:27:44.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.508+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=RK7YM73V60TA tag=E60U9I42E13N type=write size=2625759 2024-09-12T00:27:44.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.512+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=9F0YLE5QLL92 type=del size=455590 2024-09-12T00:27:44.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.516+0000 7f712938c8c0 1 < canceled operation key=QG0W04PRTQNP tag=AGH41GS7F0MN type=write size=205517 2024-09-12T00:27:44.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.520+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=Y2N31CN2OIWL type=del size=3618940 2024-09-12T00:27:44.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.528+0000 7f712938c8c0 1 < suggested update operation key=0QZKHZTVP3RQ tag=X5SO2P8MWED1 type=del size=703451 2024-09-12T00:27:44.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.532+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=R1RCYTQBI0E7 type=del size=2063707 2024-09-12T00:27:44.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.536+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~K3VB9TILDTBA.0 size=1048576 2024-09-12T00:27:44.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.536+0000 7f712938c8c0 1 < canceled part key=_multipart_9YZP0TIRWWRF.2~K3VB9TILDTBA.1 size=1048576 2024-09-12T00:27:44.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.536+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~K3VB9TILDTBA.2 size=279499 2024-09-12T00:27:44.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.544+0000 7f712938c8c0 1 < canceled multipart upload key=9YZP0TIRWWRF upload=K3VB9TILDTBA tag=361WN97Z7Q8D type=write size=3425227 2024-09-12T00:27:44.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.544+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=GBAB01O5MYKO type=del size=647667 2024-09-12T00:27:44.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.552+0000 7f712938c8c0 1 < suggested update operation key=W9YW6AS1RL48 tag=H9TDXZVU7KMA type=del size=3416621 2024-09-12T00:27:44.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.556+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=4RLBQVLDKP6L type=del size=3852620 2024-09-12T00:27:44.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.560+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~2HR56LJ49A0V.0 size=1048576 2024-09-12T00:27:44.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.560+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~2HR56LJ49A0V.1 size=1048576 2024-09-12T00:27:44.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.564+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~2HR56LJ49A0V.2 size=805027 2024-09-12T00:27:44.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.568+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=2HR56LJ49A0V tag=FZJ1HMNH2NWY type=write size=3950755 2024-09-12T00:27:44.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.576+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~SON1P9T9F1O2.0 size=1048576 2024-09-12T00:27:44.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.576+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~SON1P9T9F1O2.1 size=1048576 2024-09-12T00:27:44.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.580+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~SON1P9T9F1O2.2 size=35743 2024-09-12T00:27:44.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.580+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=SON1P9T9F1O2 tag=U7G1CKT76RNM type=write size=3181471 2024-09-12T00:27:44.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.584+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~PF4FMKKR32P7.0 size=1048576 2024-09-12T00:27:44.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.584+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~PF4FMKKR32P7.1 size=848509 2024-09-12T00:27:44.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.588+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=PF4FMKKR32P7 tag=LNKI6JF4AYBO type=write size=2945661 2024-09-12T00:27:44.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.592+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=0R6V4ZXM1JTF type=del size=432724 2024-09-12T00:27:44.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.596+0000 7f712938c8c0 1 < completed write operation key=9HX9GER6OKVI tag=B703GBZSKQIU type=write size=351118 2024-09-12T00:27:44.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.600+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=Y9FFPQR18XUB type=del size=4095395 2024-09-12T00:27:44.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.600+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=BKZEZFPDG0B8 type=del 2024-09-12T00:27:44.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.604+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=FYEP23I1PCAS type=del size=3281010 2024-09-12T00:27:44.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.608+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~UXBLJAETXHOQ.0 size=43046 2024-09-12T00:27:44.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.612+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=UXBLJAETXHOQ tag=7UKCMLEKAYT2 type=write size=1091622 2024-09-12T00:27:44.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.616+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=DZWBZPUF2GY3 type=del size=735563 2024-09-12T00:27:44.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.616+0000 7f712938c8c0 -1 < failed to complete operation key=F7T79C7MZX35 tag=C0DX7VO161D2 type=write size=530412: (22) Invalid argument 2024-09-12T00:27:44.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.620+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=LV3HJH89NGC8 type=write size=239268 2024-09-12T00:27:44.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.624+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~JR3VRCF9ICJ6.0 size=1048576 2024-09-12T00:27:44.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.628+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~JR3VRCF9ICJ6.1 size=1048576 2024-09-12T00:27:44.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.632+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~JR3VRCF9ICJ6.2 size=193368 2024-09-12T00:27:44.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.636+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=JR3VRCF9ICJ6 tag=IKQUFDXXJQOA type=write size=3339096 2024-09-12T00:27:44.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.640+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PZVL2R56LKUP.0 size=1048576 2024-09-12T00:27:44.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.644+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PZVL2R56LKUP.1 size=437297 2024-09-12T00:27:44.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.644+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=PZVL2R56LKUP tag=PEQ00WKRY1F5 type=write size=2534449 2024-09-12T00:27:44.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.648+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~RTXPK332UPUJ.0 size=312010 2024-09-12T00:27:44.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.652+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=RTXPK332UPUJ tag=3RA1M7GRIZ26 type=write size=1360586 2024-09-12T00:27:44.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.656+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=3YWJDBV35LLH type=del size=1676916 2024-09-12T00:27:44.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.660+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~XAWBYCB0443H.0 size=1048576 2024-09-12T00:27:44.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.664+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~XAWBYCB0443H.1 size=1048576 2024-09-12T00:27:44.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.664+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~XAWBYCB0443H.2 size=280425 2024-09-12T00:27:44.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.672+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=XAWBYCB0443H tag=W3D8RHXYT1N9 type=write size=3426153 2024-09-12T00:27:44.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.676+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=8GFIXNO2IP28 type=del size=2964315 2024-09-12T00:27:44.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.680+0000 7f712938c8c0 1 < suggested update operation key=Z2RYL03II71Z tag=7880TAKF4HG6 type=del size=4057886 2024-09-12T00:27:44.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.688+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~EXTD0EE3JRNO.0 size=1048576 2024-09-12T00:27:44.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.688+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~EXTD0EE3JRNO.1 size=1048576 2024-09-12T00:27:44.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.692+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~EXTD0EE3JRNO.2 size=359123 2024-09-12T00:27:44.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.692+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=EXTD0EE3JRNO tag=ENVO4Z8LE2SP type=write size=3504851 2024-09-12T00:27:44.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.696+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~BUE9F290T8AE.0 size=1048576 2024-09-12T00:27:44.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.700+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~BUE9F290T8AE.1 size=488910 2024-09-12T00:27:44.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.708+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=BUE9F290T8AE tag=7FTNS1BGAQL9 type=write size=2586062 2024-09-12T00:27:44.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.716+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~29CB3GQST120.0 size=1048576 2024-09-12T00:27:44.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.720+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~29CB3GQST120.1 size=298408 2024-09-12T00:27:44.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.720+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=29CB3GQST120 tag=7A0Y03NG3WKV type=write size=2395560 2024-09-12T00:27:44.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.724+0000 7f712938c8c0 -1 < failed to complete operation key=0QZKHZTVP3RQ tag=9F0YLE5QLL92 type=del size=455590: (22) Invalid argument 2024-09-12T00:27:44.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.728+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=RHZU8WS4G20Z type=del size=1903349 2024-09-12T00:27:44.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.728+0000 7f712938c8c0 1 < canceled operation key=G0065P5NOJ2F tag=Y2N31CN2OIWL type=del size=3618940 2024-09-12T00:27:44.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.736+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=K33EU928UCRT type=del size=1146967 2024-09-12T00:27:44.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.740+0000 7f712938c8c0 1 < canceled operation key=5KVIIZS50CNT tag=R1RCYTQBI0E7 type=del size=2063707 2024-09-12T00:27:44.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.744+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=S61EGJK3YVGP type=del size=2324942 2024-09-12T00:27:44.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.748+0000 7f712938c8c0 1 < canceled operation key=F7T79C7MZX35 tag=GBAB01O5MYKO type=del size=647667 2024-09-12T00:27:44.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.752+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~RLK1TUNOO3BW.0 size=1048576 2024-09-12T00:27:44.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.756+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~RLK1TUNOO3BW.1 size=1048576 2024-09-12T00:27:44.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.760+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~RLK1TUNOO3BW.2 size=627401 2024-09-12T00:27:44.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.760+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=RLK1TUNOO3BW tag=O0KEGZB3HG1P type=write size=3773129 2024-09-12T00:27:44.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.760+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=4RLBQVLDKP6L type=del 2024-09-12T00:27:44.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.764+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=HQK6OALGT226 type=del size=2607844 2024-09-12T00:27:44.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.768+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~SON1P9T9F1O2.0 size=1048576 2024-09-12T00:27:44.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.772+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~SON1P9T9F1O2.1 size=1048576 2024-09-12T00:27:44.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.776+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~SON1P9T9F1O2.2 size=35743 2024-09-12T00:27:44.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.780+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=SON1P9T9F1O2 tag=U7G1CKT76RNM type=write size=3181471 2024-09-12T00:27:44.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.784+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=QD4OPOG4OTUL type=del size=2196450 2024-09-12T00:27:44.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.792+0000 7f712938c8c0 1 < suggested remove operation key=WP4RJQVZVEE2 tag=0R6V4ZXM1JTF type=del 2024-09-12T00:27:44.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.796+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~DHNQ794G038W.0 size=1048576 2024-09-12T00:27:44.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.800+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~DHNQ794G038W.1 size=545221 2024-09-12T00:27:44.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.800+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=DHNQ794G038W tag=QE9QEB3LK720 type=write size=2642373 2024-09-12T00:27:44.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.804+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=Y9FFPQR18XUB type=del 2024-09-12T00:27:44.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.808+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=BHPCS7HF0XAX type=del size=374445 2024-09-12T00:27:44.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.812+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=FYEP23I1PCAS type=del 2024-09-12T00:27:44.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.816+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=TBSYUU1182J8 type=del size=2268060 2024-09-12T00:27:44.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.820+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=DZWBZPUF2GY3 type=del 2024-09-12T00:27:44.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.828+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~O7HMARDQC2AB.0 size=1048576 2024-09-12T00:27:44.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.828+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~O7HMARDQC2AB.1 size=1048576 2024-09-12T00:27:44.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.832+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~O7HMARDQC2AB.2 size=724676 2024-09-12T00:27:44.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.832+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=O7HMARDQC2AB tag=5D7ZGX5I4GFU type=write size=3870404 2024-09-12T00:27:44.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.836+0000 7f712938c8c0 -1 < failed to complete operation key=WP4RJQVZVEE2 tag=LV3HJH89NGC8 type=write size=239268: (22) Invalid argument 2024-09-12T00:27:44.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.844+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~DL86C3RMLISV.0 size=1048576 2024-09-12T00:27:44.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.848+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~DL86C3RMLISV.1 size=1048576 2024-09-12T00:27:44.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.848+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~DL86C3RMLISV.2 size=930548 2024-09-12T00:27:44.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.848+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=DL86C3RMLISV tag=DSX2BKP76OEE type=write size=4076276 2024-09-12T00:27:44.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.852+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PZVL2R56LKUP.0 size=1048576 2024-09-12T00:27:44.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.856+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PZVL2R56LKUP.1 size=437297 2024-09-12T00:27:44.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.864+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=PZVL2R56LKUP tag=PEQ00WKRY1F5 type=write size=2534449 2024-09-12T00:27:44.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.868+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=L4P10FB6OJBR type=del size=3659965 2024-09-12T00:27:44.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.876+0000 7f712938c8c0 1 < suggested remove operation key=G0065P5NOJ2F tag=3YWJDBV35LLH type=del 2024-09-12T00:27:44.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.884+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=0LP6X4LBCT8C type=write size=718202 2024-09-12T00:27:44.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.892+0000 7f712938c8c0 1 < suggested remove operation key=9YZP0TIRWWRF tag=8GFIXNO2IP28 type=del 2024-09-12T00:27:44.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.896+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~JJ8U83LAX3T8.0 size=1048576 2024-09-12T00:27:44.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.900+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~JJ8U83LAX3T8.1 size=1048576 2024-09-12T00:27:44.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.904+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~JJ8U83LAX3T8.2 size=731143 2024-09-12T00:27:44.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.904+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=JJ8U83LAX3T8 tag=WGV5ZBHIU75O type=write size=3876871 2024-09-12T00:27:44.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.908+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~EXTD0EE3JRNO.0 size=1048576 2024-09-12T00:27:44.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.912+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~EXTD0EE3JRNO.1 size=1048576 2024-09-12T00:27:44.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.912+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~EXTD0EE3JRNO.2 size=359123 2024-09-12T00:27:44.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.920+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=EXTD0EE3JRNO tag=ENVO4Z8LE2SP type=write size=3504851 2024-09-12T00:27:44.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.928+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~UPWK3XZE0FVB.0 size=1048576 2024-09-12T00:27:44.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.928+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~UPWK3XZE0FVB.1 size=1048576 2024-09-12T00:27:44.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.932+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~UPWK3XZE0FVB.2 size=684986 2024-09-12T00:27:44.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.932+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=UPWK3XZE0FVB tag=WQNU59B969XQ type=write size=3830714 2024-09-12T00:27:44.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.936+0000 7f712938c8c0 1 < canceled part key=_multipart_KEMQ3H8LAUI9.2~29CB3GQST120.0 size=1048576 2024-09-12T00:27:44.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.940+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~29CB3GQST120.1 size=298408 2024-09-12T00:27:44.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.944+0000 7f712938c8c0 1 < canceled multipart upload key=KEMQ3H8LAUI9 upload=29CB3GQST120 tag=7A0Y03NG3WKV type=write size=2395560 2024-09-12T00:27:44.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.948+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=TY241MEWAC0S type=del size=1535032 2024-09-12T00:27:44.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.956+0000 7f712938c8c0 1 < canceled operation key=W9YW6AS1RL48 tag=RHZU8WS4G20Z type=del size=1903349 2024-09-12T00:27:44.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.960+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=YQMZ74DW61SG type=del size=1654628 2024-09-12T00:27:44.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.964+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=K33EU928UCRT type=del 2024-09-12T00:27:44.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.964+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=IRKVB1VMNDSK type=del size=918970 2024-09-12T00:27:44.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.976+0000 7f712938c8c0 1 < suggested remove operation key=QL3FL4J9TKY4 tag=S61EGJK3YVGP type=del 2024-09-12T00:27:44.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.980+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~NPMV0UX5OF1T.0 size=1048576 2024-09-12T00:27:44.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.984+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~NPMV0UX5OF1T.1 size=1048576 2024-09-12T00:27:44.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.988+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~NPMV0UX5OF1T.2 size=376142 2024-09-12T00:27:44.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.988+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=NPMV0UX5OF1T tag=7DP07SPCJ58R type=write size=3521870 2024-09-12T00:27:44.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.992+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~RLK1TUNOO3BW.0 size=1048576 2024-09-12T00:27:44.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.992+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~RLK1TUNOO3BW.1 size=1048576 2024-09-12T00:27:44.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:44.996+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~RLK1TUNOO3BW.2 size=627401 2024-09-12T00:27:45.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.004+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=RLK1TUNOO3BW tag=O0KEGZB3HG1P type=write size=3773129 2024-09-12T00:27:45.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.012+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~Q0Y5H37MWVUX.0 size=1048576 2024-09-12T00:27:45.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.016+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~Q0Y5H37MWVUX.1 size=1048576 2024-09-12T00:27:45.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.016+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~Q0Y5H37MWVUX.2 size=959984 2024-09-12T00:27:45.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.016+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=Q0Y5H37MWVUX tag=GCSAT2D816KU type=write size=4105712 2024-09-12T00:27:45.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.020+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=HQK6OALGT226 type=del 2024-09-12T00:27:45.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.024+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=JPNEVBC6IC9T type=del size=154086 2024-09-12T00:27:45.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.032+0000 7f712938c8c0 1 < suggested remove operation key=W9YW6AS1RL48 tag=QD4OPOG4OTUL type=del 2024-09-12T00:27:45.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.040+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~I3NKSXQTIL1G.0 size=1048576 2024-09-12T00:27:45.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.044+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~I3NKSXQTIL1G.1 size=1048576 2024-09-12T00:27:45.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.048+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~I3NKSXQTIL1G.2 size=663073 2024-09-12T00:27:45.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.048+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=I3NKSXQTIL1G tag=UISDXZDZ61OS type=write size=3808801 2024-09-12T00:27:45.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.052+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~DHNQ794G038W.0 size=1048576 2024-09-12T00:27:45.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.056+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~DHNQ794G038W.1 size=545221 2024-09-12T00:27:45.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.064+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=DHNQ794G038W tag=QE9QEB3LK720 type=write size=2642373 2024-09-12T00:27:45.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.068+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=SXG1XJLWTTYH type=del size=703078 2024-09-12T00:27:45.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.072+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=BHPCS7HF0XAX type=del 2024-09-12T00:27:45.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.076+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~QSRLGKTZLVCA.0 size=385864 2024-09-12T00:27:45.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.076+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=QSRLGKTZLVCA tag=7HDWXAEPLD9A type=write size=1434440 2024-09-12T00:27:45.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.080+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=TBSYUU1182J8 type=del 2024-09-12T00:27:45.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.088+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~AN4XI6Q63OV8.0 size=674593 2024-09-12T00:27:45.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.088+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=AN4XI6Q63OV8 tag=IAGLN7E7YCT9 type=write size=1723169 2024-09-12T00:27:45.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.092+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~O7HMARDQC2AB.0 size=1048576 2024-09-12T00:27:45.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.096+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~O7HMARDQC2AB.1 size=1048576 2024-09-12T00:27:45.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.096+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~O7HMARDQC2AB.2 size=724676 2024-09-12T00:27:45.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.104+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=O7HMARDQC2AB tag=5D7ZGX5I4GFU type=write size=3870404 2024-09-12T00:27:45.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.108+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~XJROVMTLXHAO.0 size=1048576 2024-09-12T00:27:45.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.112+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~XJROVMTLXHAO.1 size=661357 2024-09-12T00:27:45.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.112+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=XJROVMTLXHAO tag=J0KLO11W7AKL type=write size=2758509 2024-09-12T00:27:45.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.112+0000 7f712938c8c0 1 < canceled part key=_multipart_V9K2307BGOKP.2~DL86C3RMLISV.0 size=1048576 2024-09-12T00:27:45.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.116+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~DL86C3RMLISV.1 size=1048576 2024-09-12T00:27:45.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.120+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~DL86C3RMLISV.2 size=930548 2024-09-12T00:27:45.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.124+0000 7f712938c8c0 1 < canceled multipart upload key=V9K2307BGOKP upload=DL86C3RMLISV tag=DSX2BKP76OEE type=write size=4076276 2024-09-12T00:27:45.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.128+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=C4ZPRLDQFXPS type=del size=3058784 2024-09-12T00:27:45.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.132+0000 7f712938c8c0 -1 < failed to complete operation key=QL3FL4J9TKY4 tag=L4P10FB6OJBR type=del size=3659965: (22) Invalid argument 2024-09-12T00:27:45.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.140+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~4PNT33MYM62M.0 size=468319 2024-09-12T00:27:45.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.140+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=4PNT33MYM62M tag=YOY65NAHB7O8 type=write size=1516895 2024-09-12T00:27:45.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.144+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=0LP6X4LBCT8C type=write size=718202 2024-09-12T00:27:45.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.152+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~P6DM5O5STNL7.0 size=1048576 2024-09-12T00:27:45.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.156+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~P6DM5O5STNL7.1 size=345781 2024-09-12T00:27:45.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.156+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=P6DM5O5STNL7 tag=QGPBGPSICQIY type=write size=2442933 2024-09-12T00:27:45.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.160+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~JJ8U83LAX3T8.0 size=1048576 2024-09-12T00:27:45.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.160+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~JJ8U83LAX3T8.1 size=1048576 2024-09-12T00:27:45.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.164+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~JJ8U83LAX3T8.2 size=731143 2024-09-12T00:27:45.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.172+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=JJ8U83LAX3T8 tag=WGV5ZBHIU75O type=write size=3876871 2024-09-12T00:27:45.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.176+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=731LZY86IUFV type=del size=3048401 2024-09-12T00:27:45.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.180+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~UPWK3XZE0FVB.0 size=1048576 2024-09-12T00:27:45.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.184+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~UPWK3XZE0FVB.1 size=1048576 2024-09-12T00:27:45.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.188+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~UPWK3XZE0FVB.2 size=684986 2024-09-12T00:27:45.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.192+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=UPWK3XZE0FVB tag=WQNU59B969XQ type=write size=3830714 2024-09-12T00:27:45.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.196+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=7I4UBQCXHALX type=write size=392575 2024-09-12T00:27:45.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.200+0000 7f712938c8c0 1 < canceled operation key=N69XPNN6Y6HZ tag=TY241MEWAC0S type=del size=1535032 2024-09-12T00:27:45.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.208+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~IU7BW9MX5XAN.0 size=98416 2024-09-12T00:27:45.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.208+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=IU7BW9MX5XAN tag=NVUNYGA1UXAQ type=write size=1146992 2024-09-12T00:27:45.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.216+0000 7f712938c8c0 1 < suggested update operation key=L2SR6IAW0D38 tag=YQMZ74DW61SG type=del size=1654628 2024-09-12T00:27:45.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.220+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QRZAGECIJOHT.0 size=1048576 2024-09-12T00:27:45.224 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.224+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QRZAGECIJOHT.1 size=382499 2024-09-12T00:27:45.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.224+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=QRZAGECIJOHT tag=A4MWEA3NJB6N type=write size=2479651 2024-09-12T00:27:45.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.228+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=IRKVB1VMNDSK type=del 2024-09-12T00:27:45.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.232+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=I73VZN0RQ6AD type=write size=255393 2024-09-12T00:27:45.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.236+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~NPMV0UX5OF1T.0 size=1048576 2024-09-12T00:27:45.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.240+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~NPMV0UX5OF1T.1 size=1048576 2024-09-12T00:27:45.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.244+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~NPMV0UX5OF1T.2 size=376142 2024-09-12T00:27:45.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.252+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=NPMV0UX5OF1T tag=7DP07SPCJ58R type=write size=3521870 2024-09-12T00:27:45.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.256+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=K99OQKQVFCGV type=del size=429233 2024-09-12T00:27:45.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.260+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~Q0Y5H37MWVUX.0 size=1048576 2024-09-12T00:27:45.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.264+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~Q0Y5H37MWVUX.1 size=1048576 2024-09-12T00:27:45.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.264+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~Q0Y5H37MWVUX.2 size=959984 2024-09-12T00:27:45.272 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.272+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=Q0Y5H37MWVUX tag=GCSAT2D816KU type=write size=4105712 2024-09-12T00:27:45.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.280+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~9T1NSUZNB87F.0 size=1048576 2024-09-12T00:27:45.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.280+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~9T1NSUZNB87F.1 size=1044668 2024-09-12T00:27:45.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.280+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=9T1NSUZNB87F tag=BI34SIPMT6K0 type=write size=3141820 2024-09-12T00:27:45.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.284+0000 7f712938c8c0 1 < canceled operation key=KEMQ3H8LAUI9 tag=JPNEVBC6IC9T type=del size=154086 2024-09-12T00:27:45.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.288+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=9UY1C0XWHRK2 type=write size=214501 2024-09-12T00:27:45.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.292+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~I3NKSXQTIL1G.0 size=1048576 2024-09-12T00:27:45.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.296+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~I3NKSXQTIL1G.1 size=1048576 2024-09-12T00:27:45.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.300+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~I3NKSXQTIL1G.2 size=663073 2024-09-12T00:27:45.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.304+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=I3NKSXQTIL1G tag=UISDXZDZ61OS type=write size=3808801 2024-09-12T00:27:45.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.308+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=ATG2JU30CBEC type=del size=1068606 2024-09-12T00:27:45.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.312+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=SXG1XJLWTTYH type=del 2024-09-12T00:27:45.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.320+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~CE4AAUGCBOG9.0 size=1035686 2024-09-12T00:27:45.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.320+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=CE4AAUGCBOG9 tag=9F6D5OMPDKBZ type=write size=2084262 2024-09-12T00:27:45.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.324+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~QSRLGKTZLVCA.0 size=385864 2024-09-12T00:27:45.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.332+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=QSRLGKTZLVCA tag=7HDWXAEPLD9A type=write size=1434440 2024-09-12T00:27:45.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.336+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=KPGS3YVI2E1Z type=del size=263078 2024-09-12T00:27:45.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.340+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~AN4XI6Q63OV8.0 size=674593 2024-09-12T00:27:45.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.344+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=AN4XI6Q63OV8 tag=IAGLN7E7YCT9 type=write size=1723169 2024-09-12T00:27:45.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.348+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=0AWTEIG7TB9X type=del size=2664569 2024-09-12T00:27:45.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.352+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~XJROVMTLXHAO.0 size=1048576 2024-09-12T00:27:45.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.356+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~XJROVMTLXHAO.1 size=661357 2024-09-12T00:27:45.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.364+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=XJROVMTLXHAO tag=J0KLO11W7AKL type=write size=2758509 2024-09-12T00:27:45.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.368+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=8IJFFROKEJPV type=del size=3010378 2024-09-12T00:27:45.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.372+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=C4ZPRLDQFXPS type=del 2024-09-12T00:27:45.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.376+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=I1EFS6LNW4A5 type=del size=790731 2024-09-12T00:27:45.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.380+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~4PNT33MYM62M.0 size=468319 2024-09-12T00:27:45.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.384+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=4PNT33MYM62M tag=YOY65NAHB7O8 type=write size=1516895 2024-09-12T00:27:45.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.392+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~AR0KPT11DA3W.0 size=1048576 2024-09-12T00:27:45.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.396+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~AR0KPT11DA3W.1 size=683851 2024-09-12T00:27:45.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.396+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=AR0KPT11DA3W tag=6GIVH54T1Y21 type=write size=2781003 2024-09-12T00:27:45.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.400+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~P6DM5O5STNL7.0 size=1048576 2024-09-12T00:27:45.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.404+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~P6DM5O5STNL7.1 size=345781 2024-09-12T00:27:45.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.408+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=P6DM5O5STNL7 tag=QGPBGPSICQIY type=write size=2442933 2024-09-12T00:27:45.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.420+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~QGQPHH157TSL.0 size=1048576 2024-09-12T00:27:45.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.420+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~QGQPHH157TSL.1 size=1048576 2024-09-12T00:27:45.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.424+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~QGQPHH157TSL.2 size=560481 2024-09-12T00:27:45.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.424+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=QGQPHH157TSL tag=WIK34PXBG1CR type=write size=3706209 2024-09-12T00:27:45.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.436+0000 7f712938c8c0 1 < suggested update operation key=WP4RJQVZVEE2 tag=731LZY86IUFV type=del size=3048401 2024-09-12T00:27:45.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.440+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=ZTXSPML60GFD type=del size=3831725 2024-09-12T00:27:45.446 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.448+0000 7f712938c8c0 1 < suggested update operation key=QG0W04PRTQNP tag=7I4UBQCXHALX type=write size=392575 2024-09-12T00:27:45.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.448+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=Y8UV03Q3Z5VQ type=del size=93262 2024-09-12T00:27:45.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.456+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~IU7BW9MX5XAN.0 size=98416 2024-09-12T00:27:45.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.460+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=IU7BW9MX5XAN tag=NVUNYGA1UXAQ type=write size=1146992 2024-09-12T00:27:45.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.464+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=RAKNKITPCKQD type=del size=2641096 2024-09-12T00:27:45.468 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.468+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~QRZAGECIJOHT.0 size=1048576 2024-09-12T00:27:45.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.472+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~QRZAGECIJOHT.1 size=382499 2024-09-12T00:27:45.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.476+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=QRZAGECIJOHT tag=A4MWEA3NJB6N type=write size=2479651 2024-09-12T00:27:45.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.484+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~6R3V2HC271E6.0 size=1048576 2024-09-12T00:27:45.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.488+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~6R3V2HC271E6.1 size=1048576 2024-09-12T00:27:45.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.492+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~6R3V2HC271E6.2 size=316090 2024-09-12T00:27:45.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.492+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=6R3V2HC271E6 tag=98LAC9L9VWFT type=write size=3461818 2024-09-12T00:27:45.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.496+0000 7f712938c8c0 1 < completed write operation key=L2SR6IAW0D38 tag=I73VZN0RQ6AD type=write size=255393 2024-09-12T00:27:45.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.500+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~G603QT7JTPHV.0 size=1048576 2024-09-12T00:27:45.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.504+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~G603QT7JTPHV.1 size=344254 2024-09-12T00:27:45.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.504+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=G603QT7JTPHV tag=WLE7R24I3O12 type=write size=2441406 2024-09-12T00:27:45.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.508+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=K99OQKQVFCGV type=del 2024-09-12T00:27:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.512+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=G1C2JZ3SOQPN type=del size=2106483 2024-09-12T00:27:45.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.516+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~9T1NSUZNB87F.0 size=1048576 2024-09-12T00:27:45.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.516+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~9T1NSUZNB87F.1 size=1044668 2024-09-12T00:27:45.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.524+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=9T1NSUZNB87F tag=BI34SIPMT6K0 type=write size=3141820 2024-09-12T00:27:45.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.528+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=RM1NDSYEFYPO type=write size=940290 2024-09-12T00:27:45.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.532+0000 7f712938c8c0 1 < completed write operation key=QL3FL4J9TKY4 tag=9UY1C0XWHRK2 type=write size=214501 2024-09-12T00:27:45.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.536+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=8OINS501C0SC type=del size=260381 2024-09-12T00:27:45.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.540+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=ATG2JU30CBEC type=del 2024-09-12T00:27:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.548+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~JU3AVUNJ3DZB.0 size=1048576 2024-09-12T00:27:45.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.548+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~JU3AVUNJ3DZB.1 size=558850 2024-09-12T00:27:45.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.548+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=JU3AVUNJ3DZB tag=761Y15TVTLBT type=write size=2656002 2024-09-12T00:27:45.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.552+0000 7f712938c8c0 1 < canceled part key=_multipart_Z2RYL03II71Z.2~CE4AAUGCBOG9.0 size=1035686 2024-09-12T00:27:45.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.556+0000 7f712938c8c0 1 < canceled multipart upload key=Z2RYL03II71Z upload=CE4AAUGCBOG9 tag=9F6D5OMPDKBZ type=write size=2084262 2024-09-12T00:27:45.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.564+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~RXA07WDE5R18.0 size=279280 2024-09-12T00:27:45.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.564+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=RXA07WDE5R18 tag=TNO3SJ9L5PGE type=write size=1327856 2024-09-12T00:27:45.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.568+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=KPGS3YVI2E1Z type=del 2024-09-12T00:27:45.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.572+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=ATK1453WKOGA type=del size=3785038 2024-09-12T00:27:45.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.576+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=0AWTEIG7TB9X type=del 2024-09-12T00:27:45.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.580+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=6U6E6BO3E05G type=del size=782112 2024-09-12T00:27:45.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.584+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=8IJFFROKEJPV type=del 2024-09-12T00:27:45.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.592+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~RDMP1BXLVX9J.0 size=1048576 2024-09-12T00:27:45.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.592+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~RDMP1BXLVX9J.1 size=1048576 2024-09-12T00:27:45.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.596+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~RDMP1BXLVX9J.2 size=292868 2024-09-12T00:27:45.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.596+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=RDMP1BXLVX9J tag=UH5PO45PFD78 type=write size=3438596 2024-09-12T00:27:45.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.600+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=I1EFS6LNW4A5 type=del 2024-09-12T00:27:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.608+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~Y21FUVI8C6JM.0 size=507628 2024-09-12T00:27:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.608+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=Y21FUVI8C6JM tag=0SY0RPK42L5T type=write size=1556204 2024-09-12T00:27:45.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.612+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~AR0KPT11DA3W.0 size=1048576 2024-09-12T00:27:45.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.612+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~AR0KPT11DA3W.1 size=683851 2024-09-12T00:27:45.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.620+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=AR0KPT11DA3W tag=6GIVH54T1Y21 type=write size=2781003 2024-09-12T00:27:45.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.624+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~SSF0OTCK84ZH.0 size=1048576 2024-09-12T00:27:45.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.628+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~SSF0OTCK84ZH.1 size=1048576 2024-09-12T00:27:45.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.632+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~SSF0OTCK84ZH.2 size=158097 2024-09-12T00:27:45.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.632+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=SSF0OTCK84ZH tag=33W4SJXX0FND type=write size=3303825 2024-09-12T00:27:45.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.636+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~QGQPHH157TSL.0 size=1048576 2024-09-12T00:27:45.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.636+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~QGQPHH157TSL.1 size=1048576 2024-09-12T00:27:45.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.640+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~QGQPHH157TSL.2 size=560481 2024-09-12T00:27:45.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.644+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=QGQPHH157TSL tag=WIK34PXBG1CR type=write size=3706209 2024-09-12T00:27:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.652+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~HZHYQHLKK1R9.0 size=1048576 2024-09-12T00:27:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.656+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~HZHYQHLKK1R9.1 size=715536 2024-09-12T00:27:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.656+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=HZHYQHLKK1R9 tag=JC100AQS0EU6 type=write size=2812688 2024-09-12T00:27:45.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.660+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=ZTXSPML60GFD type=del 2024-09-12T00:27:45.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.664+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=3LT1A91CK2AG type=del size=723019 2024-09-12T00:27:45.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.664+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=Y8UV03Q3Z5VQ type=del 2024-09-12T00:27:45.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.668+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=808LT09R6QM7 type=del size=1633000 2024-09-12T00:27:45.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.672+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=RAKNKITPCKQD type=del 2024-09-12T00:27:45.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.676+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=FVIA5KGK42GH type=del size=1404568 2024-09-12T00:27:45.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.680+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~6R3V2HC271E6.0 size=1048576 2024-09-12T00:27:45.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.684+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~6R3V2HC271E6.1 size=1048576 2024-09-12T00:27:45.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.684+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~6R3V2HC271E6.2 size=316090 2024-09-12T00:27:45.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.692+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=6R3V2HC271E6 tag=98LAC9L9VWFT type=write size=3461818 2024-09-12T00:27:45.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.696+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~Q8F3F84N1Z21.0 size=1048576 2024-09-12T00:27:45.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.700+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~Q8F3F84N1Z21.1 size=1048576 2024-09-12T00:27:45.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.704+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~Q8F3F84N1Z21.2 size=531236 2024-09-12T00:27:45.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.704+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=Q8F3F84N1Z21 tag=R8V0Q6AKLA7M type=write size=3676964 2024-09-12T00:27:45.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.708+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~G603QT7JTPHV.0 size=1048576 2024-09-12T00:27:45.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.708+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~G603QT7JTPHV.1 size=344254 2024-09-12T00:27:45.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.716+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=G603QT7JTPHV tag=WLE7R24I3O12 type=write size=2441406 2024-09-12T00:27:45.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.720+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=OD75QJ4CF6I7 type=del size=1987609 2024-09-12T00:27:45.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.724+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=G1C2JZ3SOQPN type=del 2024-09-12T00:27:45.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.728+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=0QIPQWO0HYWJ type=del size=1335599 2024-09-12T00:27:45.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.732+0000 7f712938c8c0 1 < completed write operation key=ZP88X00LMVSS tag=RM1NDSYEFYPO type=write size=940290 2024-09-12T00:27:45.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.732+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=Z80Z0615QXN2 type=write size=306729 2024-09-12T00:27:45.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.736+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=8OINS501C0SC type=del 2024-09-12T00:27:45.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.744+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~ZKIFUDNTDP3Y.0 size=539491 2024-09-12T00:27:45.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.744+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=ZKIFUDNTDP3Y tag=HSPC8B5G3N3N type=write size=1588067 2024-09-12T00:27:45.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.748+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~JU3AVUNJ3DZB.0 size=1048576 2024-09-12T00:27:45.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.748+0000 7f712938c8c0 1 < canceled part key=_multipart_UAJEZUYXN2R0.2~JU3AVUNJ3DZB.1 size=558850 2024-09-12T00:27:45.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.756+0000 7f712938c8c0 1 < canceled multipart upload key=UAJEZUYXN2R0 upload=JU3AVUNJ3DZB tag=761Y15TVTLBT type=write size=2656002 2024-09-12T00:27:45.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.764+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~7V5KDDC7QHT8.0 size=651092 2024-09-12T00:27:45.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.764+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=7V5KDDC7QHT8 tag=Z3DDBUQSNM6C type=write size=1699668 2024-09-12T00:27:45.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.768+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~RXA07WDE5R18.0 size=279280 2024-09-12T00:27:45.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.772+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=RXA07WDE5R18 tag=TNO3SJ9L5PGE type=write size=1327856 2024-09-12T00:27:45.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.780+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~BVZV8XV8CRTR.0 size=1048576 2024-09-12T00:27:45.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.780+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~BVZV8XV8CRTR.1 size=1048576 2024-09-12T00:27:45.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.784+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~BVZV8XV8CRTR.2 size=793501 2024-09-12T00:27:45.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.784+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=BVZV8XV8CRTR tag=7670E0TKF52H type=write size=3939229 2024-09-12T00:27:45.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.788+0000 7f712938c8c0 1 < canceled operation key=9751RNPPQJBO tag=ATK1453WKOGA type=del size=3785038 2024-09-12T00:27:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.796+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~2OVRRJVYS6C8.0 size=734831 2024-09-12T00:27:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.796+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=2OVRRJVYS6C8 tag=NWKWNH3BIFHK type=write size=1783407 2024-09-12T00:27:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.800+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=6U6E6BO3E05G type=del 2024-09-12T00:27:45.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.804+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=17BX2ADU971Q type=del size=799328 2024-09-12T00:27:45.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.804+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~RDMP1BXLVX9J.0 size=1048576 2024-09-12T00:27:45.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.808+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~RDMP1BXLVX9J.1 size=1048576 2024-09-12T00:27:45.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.808+0000 7f712938c8c0 1 < canceled part key=_multipart_G0065P5NOJ2F.2~RDMP1BXLVX9J.2 size=292868 2024-09-12T00:27:45.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.816+0000 7f712938c8c0 1 < canceled multipart upload key=G0065P5NOJ2F upload=RDMP1BXLVX9J tag=UH5PO45PFD78 type=write size=3438596 2024-09-12T00:27:45.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.820+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=VAHUA7Q9VDS4 type=del size=1172034 2024-09-12T00:27:45.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.820+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~Y21FUVI8C6JM.0 size=507628 2024-09-12T00:27:45.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.828+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=Y21FUVI8C6JM tag=0SY0RPK42L5T type=write size=1556204 2024-09-12T00:27:45.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.832+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=Q0P1ERQMZGIW type=del size=1689236 2024-09-12T00:27:45.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.836+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~SSF0OTCK84ZH.0 size=1048576 2024-09-12T00:27:45.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.836+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~SSF0OTCK84ZH.1 size=1048576 2024-09-12T00:27:45.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.840+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~SSF0OTCK84ZH.2 size=158097 2024-09-12T00:27:45.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.848+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=SSF0OTCK84ZH tag=33W4SJXX0FND type=write size=3303825 2024-09-12T00:27:45.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.852+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=702OWJHAWOUU type=del size=4179346 2024-09-12T00:27:45.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.856+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~HZHYQHLKK1R9.0 size=1048576 2024-09-12T00:27:45.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.856+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~HZHYQHLKK1R9.1 size=715536 2024-09-12T00:27:45.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.864+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=HZHYQHLKK1R9 tag=JC100AQS0EU6 type=write size=2812688 2024-09-12T00:27:45.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.868+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=38ZZU07IM7YW type=del size=1848338 2024-09-12T00:27:45.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.872+0000 7f712938c8c0 1 < canceled operation key=G0065P5NOJ2F tag=3LT1A91CK2AG type=del size=723019 2024-09-12T00:27:45.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.876+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~S687ZVOPMYYR.0 size=1048576 2024-09-12T00:27:45.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.880+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~S687ZVOPMYYR.1 size=377410 2024-09-12T00:27:45.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.880+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=S687ZVOPMYYR tag=AWL6BQMF0TGX type=write size=2474562 2024-09-12T00:27:45.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.884+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=808LT09R6QM7 type=del 2024-09-12T00:27:45.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.892+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~M91SPSF7OU01.0 size=1048576 2024-09-12T00:27:45.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.892+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~M91SPSF7OU01.1 size=1048576 2024-09-12T00:27:45.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.896+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~M91SPSF7OU01.2 size=811600 2024-09-12T00:27:45.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.896+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=M91SPSF7OU01 tag=YQIT4N32D1Z9 type=write size=3957328 2024-09-12T00:27:45.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.900+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=FVIA5KGK42GH type=del 2024-09-12T00:27:45.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.904+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=C6ADTQ1WYJVM type=del size=3774212 2024-09-12T00:27:45.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.908+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~Q8F3F84N1Z21.0 size=1048576 2024-09-12T00:27:45.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.912+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~Q8F3F84N1Z21.1 size=1048576 2024-09-12T00:27:45.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.916+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~Q8F3F84N1Z21.2 size=531236 2024-09-12T00:27:45.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.920+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=Q8F3F84N1Z21 tag=R8V0Q6AKLA7M type=write size=3676964 2024-09-12T00:27:45.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.928+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~CBKGXERCZ1EA.0 size=1048576 2024-09-12T00:27:45.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.928+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~CBKGXERCZ1EA.1 size=534502 2024-09-12T00:27:45.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.928+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=CBKGXERCZ1EA tag=2WR4KM7QRKBL type=write size=2631654 2024-09-12T00:27:45.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.932+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=OD75QJ4CF6I7 type=del 2024-09-12T00:27:45.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.940+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~ICIW2NFS1O94.0 size=1048576 2024-09-12T00:27:45.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.944+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~ICIW2NFS1O94.1 size=269922 2024-09-12T00:27:45.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.944+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=ICIW2NFS1O94 tag=0VLEGT1M4GWP type=write size=2367074 2024-09-12T00:27:45.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.948+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=0QIPQWO0HYWJ type=del 2024-09-12T00:27:45.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.952+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~23GM86HQO8C2.0 size=1048576 2024-09-12T00:27:45.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.956+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~23GM86HQO8C2.1 size=194030 2024-09-12T00:27:45.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.956+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=23GM86HQO8C2 tag=QMQTA70DULQ6 type=write size=2291182 2024-09-12T00:27:45.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.960+0000 7f712938c8c0 1 < canceled operation key=W9YW6AS1RL48 tag=Z80Z0615QXN2 type=write size=306729 2024-09-12T00:27:45.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.964+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=ZMLKMY7Y56G5 type=write size=367834 2024-09-12T00:27:45.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.964+0000 7f712938c8c0 1 < canceled part key=_multipart_HPM9GFRASWIV.2~ZKIFUDNTDP3Y.0 size=539491 2024-09-12T00:27:45.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.972+0000 7f712938c8c0 1 < canceled multipart upload key=HPM9GFRASWIV upload=ZKIFUDNTDP3Y tag=HSPC8B5G3N3N type=write size=1588067 2024-09-12T00:27:45.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.976+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~TXZ6EG5DQLRS.0 size=979081 2024-09-12T00:27:45.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.976+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=TXZ6EG5DQLRS tag=6DJBA5624EB0 type=write size=2027657 2024-09-12T00:27:45.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.980+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~7V5KDDC7QHT8.0 size=651092 2024-09-12T00:27:45.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.984+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=7V5KDDC7QHT8 tag=Z3DDBUQSNM6C type=write size=1699668 2024-09-12T00:27:45.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.988+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=PI1J30ZRGT6X type=del size=2884550 2024-09-12T00:27:45.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.992+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~BVZV8XV8CRTR.0 size=1048576 2024-09-12T00:27:45.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:45.996+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~BVZV8XV8CRTR.1 size=1048576 2024-09-12T00:27:45.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.000+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~BVZV8XV8CRTR.2 size=793501 2024-09-12T00:27:46.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.004+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=BVZV8XV8CRTR tag=7670E0TKF52H type=write size=3939229 2024-09-12T00:27:46.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.012+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~SLLQXUCFEK26.0 size=1048576 2024-09-12T00:27:46.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.016+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~SLLQXUCFEK26.1 size=1048576 2024-09-12T00:27:46.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.016+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~SLLQXUCFEK26.2 size=900717 2024-09-12T00:27:46.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.016+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=SLLQXUCFEK26 tag=SJ5ETTQYBK3C type=write size=4046445 2024-09-12T00:27:46.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.020+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~2OVRRJVYS6C8.0 size=734831 2024-09-12T00:27:46.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.028+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=2OVRRJVYS6C8 tag=NWKWNH3BIFHK type=write size=1783407 2024-09-12T00:27:46.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.032+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=1NPLFMZ6H336 type=del size=3377831 2024-09-12T00:27:46.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.036+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=17BX2ADU971Q type=del 2024-09-12T00:27:46.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.040+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=41S1HOY8KNNJ type=del size=3393195 2024-09-12T00:27:46.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.044+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=VAHUA7Q9VDS4 type=del 2024-09-12T00:27:46.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.048+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=5BGY44P55Y58 type=del size=2216261 2024-09-12T00:27:46.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.052+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=Q0P1ERQMZGIW type=del 2024-09-12T00:27:46.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.056+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=GPFCFE114D5Z type=del size=3096783 2024-09-12T00:27:46.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.060+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=702OWJHAWOUU type=del 2024-09-12T00:27:46.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.064+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~0Z6AAJV2QPBG.0 size=1048576 2024-09-12T00:27:46.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.068+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~0Z6AAJV2QPBG.1 size=1048576 2024-09-12T00:27:46.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.072+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~0Z6AAJV2QPBG.2 size=94250 2024-09-12T00:27:46.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.072+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=0Z6AAJV2QPBG tag=YHVU2U7E9Z4D type=write size=3239978 2024-09-12T00:27:46.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.076+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=38ZZU07IM7YW type=del 2024-09-12T00:27:46.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.080+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=G1XLE6RSYIFC type=write size=825615 2024-09-12T00:27:46.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.084+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~S687ZVOPMYYR.0 size=1048576 2024-09-12T00:27:46.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.084+0000 7f712938c8c0 1 < canceled part key=_multipart_WP4RJQVZVEE2.2~S687ZVOPMYYR.1 size=377410 2024-09-12T00:27:46.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.092+0000 7f712938c8c0 1 < canceled multipart upload key=WP4RJQVZVEE2 upload=S687ZVOPMYYR tag=AWL6BQMF0TGX type=write size=2474562 2024-09-12T00:27:46.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.096+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=2I82Q5LK0CJM type=del size=1393448 2024-09-12T00:27:46.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.100+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~M91SPSF7OU01.0 size=1048576 2024-09-12T00:27:46.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.104+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~M91SPSF7OU01.1 size=1048576 2024-09-12T00:27:46.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.108+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~M91SPSF7OU01.2 size=811600 2024-09-12T00:27:46.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.112+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=M91SPSF7OU01 tag=YQIT4N32D1Z9 type=write size=3957328 2024-09-12T00:27:46.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.116+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=38JUGHAYRF87 type=del size=2051779 2024-09-12T00:27:46.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.120+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=C6ADTQ1WYJVM type=del 2024-09-12T00:27:46.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.124+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=2C3MEKENDBVS type=del size=2702429 2024-09-12T00:27:46.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.128+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~CBKGXERCZ1EA.0 size=1048576 2024-09-12T00:27:46.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.128+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~CBKGXERCZ1EA.1 size=534502 2024-09-12T00:27:46.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.136+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=CBKGXERCZ1EA tag=2WR4KM7QRKBL type=write size=2631654 2024-09-12T00:27:46.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.140+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=91FA0YKMICU0 type=write size=467679 2024-09-12T00:27:46.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.144+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~ICIW2NFS1O94.0 size=1048576 2024-09-12T00:27:46.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.144+0000 7f712938c8c0 1 < canceled part key=_multipart_L2SR6IAW0D38.2~ICIW2NFS1O94.1 size=269922 2024-09-12T00:27:46.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.148+0000 7f712938c8c0 1 < canceled multipart upload key=L2SR6IAW0D38 upload=ICIW2NFS1O94 tag=0VLEGT1M4GWP type=write size=2367074 2024-09-12T00:27:46.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.156+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~BQPO1Y1J0VKA.0 size=398051 2024-09-12T00:27:46.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.156+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=BQPO1Y1J0VKA tag=TRGSXL6DBPLN type=write size=1446627 2024-09-12T00:27:46.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.160+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~23GM86HQO8C2.0 size=1048576 2024-09-12T00:27:46.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.164+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~23GM86HQO8C2.1 size=194030 2024-09-12T00:27:46.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.168+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=23GM86HQO8C2 tag=QMQTA70DULQ6 type=write size=2291182 2024-09-12T00:27:46.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.172+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=0YR2QLS7ZEJL type=write size=733835 2024-09-12T00:27:46.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.176+0000 7f712938c8c0 1 < completed write operation key=UAJEZUYXN2R0 tag=ZMLKMY7Y56G5 type=write size=367834 2024-09-12T00:27:46.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.184+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~ACBCR66CVKQ2.0 size=13889 2024-09-12T00:27:46.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.184+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=ACBCR66CVKQ2 tag=E538WGV8K4CL type=write size=1062465 2024-09-12T00:27:46.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.184+0000 7f712938c8c0 1 < canceled part key=_multipart_9YZP0TIRWWRF.2~TXZ6EG5DQLRS.0 size=979081 2024-09-12T00:27:46.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.188+0000 7f712938c8c0 1 < canceled multipart upload key=9YZP0TIRWWRF upload=TXZ6EG5DQLRS tag=6DJBA5624EB0 type=write size=2027657 2024-09-12T00:27:46.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.196+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~ILSYFF4VUT8M.0 size=1048576 2024-09-12T00:27:46.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.200+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~ILSYFF4VUT8M.1 size=197324 2024-09-12T00:27:46.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.200+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=ILSYFF4VUT8M tag=JI8SF76IAFCI type=write size=2294476 2024-09-12T00:27:46.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.208+0000 7f712938c8c0 1 < suggested remove operation key=N69XPNN6Y6HZ tag=PI1J30ZRGT6X type=del 2024-09-12T00:27:46.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.208+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=RTGMT1SVDNRR type=del size=1008554 2024-09-12T00:27:46.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.212+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~SLLQXUCFEK26.0 size=1048576 2024-09-12T00:27:46.216 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.216+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~SLLQXUCFEK26.1 size=1048576 2024-09-12T00:27:46.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.220+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~SLLQXUCFEK26.2 size=900717 2024-09-12T00:27:46.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.224+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=SLLQXUCFEK26 tag=SJ5ETTQYBK3C type=write size=4046445 2024-09-12T00:27:46.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.228+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=UUVUZLIHBFR4 type=del size=2630737 2024-09-12T00:27:46.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.232+0000 7f712938c8c0 1 < canceled operation key=ZP88X00LMVSS tag=1NPLFMZ6H336 type=del size=3377831 2024-09-12T00:27:46.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.236+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=VW4S8MSG4M94 type=write size=466333 2024-09-12T00:27:46.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.240+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=41S1HOY8KNNJ type=del 2024-09-12T00:27:46.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.244+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=CI0DA5ZAKF9J type=del size=1050046 2024-09-12T00:27:46.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.248+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=5BGY44P55Y58 type=del 2024-09-12T00:27:46.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.256+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~3C76BNKPT3VX.0 size=1024097 2024-09-12T00:27:46.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.256+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=3C76BNKPT3VX tag=RC601EOAO625 type=write size=2072673 2024-09-12T00:27:46.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.264+0000 7f712938c8c0 1 < suggested update operation key=QL3FL4J9TKY4 tag=GPFCFE114D5Z type=del size=3096783 2024-09-12T00:27:46.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.268+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~IUCWRMULZE7W.0 size=1048576 2024-09-12T00:27:46.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.272+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~IUCWRMULZE7W.1 size=95568 2024-09-12T00:27:46.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.272+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=IUCWRMULZE7W tag=704V2FBFOG8T type=write size=2192720 2024-09-12T00:27:46.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.276+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~0Z6AAJV2QPBG.0 size=1048576 2024-09-12T00:27:46.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.280+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~0Z6AAJV2QPBG.1 size=1048576 2024-09-12T00:27:46.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.284+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~0Z6AAJV2QPBG.2 size=94250 2024-09-12T00:27:46.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.288+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=0Z6AAJV2QPBG tag=YHVU2U7E9Z4D type=write size=3239978 2024-09-12T00:27:46.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.292+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=WPQ5WEXVU57P type=del size=3700442 2024-09-12T00:27:46.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.296+0000 7f712938c8c0 1 < canceled operation key=9HX9GER6OKVI tag=G1XLE6RSYIFC type=write size=825615 2024-09-12T00:27:46.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.300+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=VEUKCOPXD4M8 type=write size=236009 2024-09-12T00:27:46.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.304+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=2I82Q5LK0CJM type=del 2024-09-12T00:27:46.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.312+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~2MYO1ATFOF9V.0 size=1048576 2024-09-12T00:27:46.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.316+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~2MYO1ATFOF9V.1 size=562445 2024-09-12T00:27:46.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.316+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=2MYO1ATFOF9V tag=IW4O6OKA08D4 type=write size=2659597 2024-09-12T00:27:46.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.320+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=38JUGHAYRF87 type=del 2024-09-12T00:27:46.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.324+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~FOM6Z2537T4Z.0 size=1048576 2024-09-12T00:27:46.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.328+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~FOM6Z2537T4Z.1 size=523185 2024-09-12T00:27:46.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.328+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=FOM6Z2537T4Z tag=Z0ZXJXMG55YC type=write size=2620337 2024-09-12T00:27:46.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.332+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=2C3MEKENDBVS type=del 2024-09-12T00:27:46.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.340+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~JK52FS0ORARS.0 size=1048576 2024-09-12T00:27:46.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.344+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~JK52FS0ORARS.1 size=1048576 2024-09-12T00:27:46.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.348+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~JK52FS0ORARS.2 size=935140 2024-09-12T00:27:46.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.348+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=JK52FS0ORARS tag=R6SOIAT7ZCI7 type=write size=4080868 2024-09-12T00:27:46.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.352+0000 7f712938c8c0 1 < completed write operation key=QG0W04PRTQNP tag=91FA0YKMICU0 type=write size=467679 2024-09-12T00:27:46.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.356+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=RMGCZGGDK9HJ type=del size=4175534 2024-09-12T00:27:46.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.360+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~BQPO1Y1J0VKA.0 size=398051 2024-09-12T00:27:46.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.364+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=BQPO1Y1J0VKA tag=TRGSXL6DBPLN type=write size=1446627 2024-09-12T00:27:46.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.368+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=IHBCWRI5UR0O type=del size=2097011 2024-09-12T00:27:46.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.372+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=0YR2QLS7ZEJL type=write size=733835 2024-09-12T00:27:46.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.380+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~GPDNHCYPNV6L.0 size=1048576 2024-09-12T00:27:46.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.380+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~GPDNHCYPNV6L.1 size=1048576 2024-09-12T00:27:46.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.384+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~GPDNHCYPNV6L.2 size=86224 2024-09-12T00:27:46.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.384+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=GPDNHCYPNV6L tag=8ZV2FV3N7KUD type=write size=3231952 2024-09-12T00:27:46.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.388+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~ACBCR66CVKQ2.0 size=13889 2024-09-12T00:27:46.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.396+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=ACBCR66CVKQ2 tag=E538WGV8K4CL type=write size=1062465 2024-09-12T00:27:46.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.404+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~D0G0RN1GCHFG.0 size=1048576 2024-09-12T00:27:46.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.404+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~D0G0RN1GCHFG.1 size=1048576 2024-09-12T00:27:46.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.408+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~D0G0RN1GCHFG.2 size=696214 2024-09-12T00:27:46.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.408+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=D0G0RN1GCHFG tag=3U0A4V0NWRJ5 type=write size=3841942 2024-09-12T00:27:46.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.412+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~ILSYFF4VUT8M.0 size=1048576 2024-09-12T00:27:46.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.416+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~ILSYFF4VUT8M.1 size=197324 2024-09-12T00:27:46.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.420+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=ILSYFF4VUT8M tag=JI8SF76IAFCI type=write size=2294476 2024-09-12T00:27:46.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.424+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=4U04D252W0UJ type=write size=562607 2024-09-12T00:27:46.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.428+0000 7f712938c8c0 1 < canceled operation key=GZON46MODQZO tag=RTGMT1SVDNRR type=del size=1008554 2024-09-12T00:27:46.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.436+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~VRSBIQCDV3DS.0 size=1048576 2024-09-12T00:27:46.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.440+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~VRSBIQCDV3DS.1 size=1048576 2024-09-12T00:27:46.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.444+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~VRSBIQCDV3DS.2 size=100945 2024-09-12T00:27:46.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.444+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=VRSBIQCDV3DS tag=FXPJ4LY4AS6S type=write size=3246673 2024-09-12T00:27:46.447 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.448+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=UUVUZLIHBFR4 type=del 2024-09-12T00:27:46.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.452+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=UUU84S3E4Q40 type=del size=3943747 2024-09-12T00:27:46.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.460+0000 7f712938c8c0 1 < suggested update operation key=VAFU5FXA2KLC tag=VW4S8MSG4M94 type=write size=466333 2024-09-12T00:27:46.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.464+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~LGJXKA370QN2.0 size=777492 2024-09-12T00:27:46.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.464+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=LGJXKA370QN2 tag=JS2DD1OTPQ9R type=write size=1826068 2024-09-12T00:27:46.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.468+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=CI0DA5ZAKF9J type=del 2024-09-12T00:27:46.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.476+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~R92TT5YPIRJV.0 size=40465 2024-09-12T00:27:46.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.476+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=R92TT5YPIRJV tag=SK9NZXXE7HS6 type=write size=1089041 2024-09-12T00:27:46.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.480+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~3C76BNKPT3VX.0 size=1024097 2024-09-12T00:27:46.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.484+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=3C76BNKPT3VX tag=RC601EOAO625 type=write size=2072673 2024-09-12T00:27:46.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.488+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=RDNI4ULH0BQ1 type=write size=731105 2024-09-12T00:27:46.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.492+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~IUCWRMULZE7W.0 size=1048576 2024-09-12T00:27:46.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.496+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~IUCWRMULZE7W.1 size=95568 2024-09-12T00:27:46.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.504+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=IUCWRMULZE7W tag=704V2FBFOG8T type=write size=2192720 2024-09-12T00:27:46.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.508+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=PB0UEQJHOFBT type=del size=2244658 2024-09-12T00:27:46.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.508+0000 7f712938c8c0 1 < canceled operation key=QL3FL4J9TKY4 tag=WPQ5WEXVU57P type=del size=3700442 2024-09-12T00:27:46.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.512+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=AYVJ751864C5 type=write size=15591 2024-09-12T00:27:46.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.516+0000 7f712938c8c0 1 < completed write operation key=T0C4ZDQB13X0 tag=VEUKCOPXD4M8 type=write size=236009 2024-09-12T00:27:46.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.520+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=U44N1UCY2N0R type=del size=3562599 2024-09-12T00:27:46.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.524+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~2MYO1ATFOF9V.0 size=1048576 2024-09-12T00:27:46.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.528+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~2MYO1ATFOF9V.1 size=562445 2024-09-12T00:27:46.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.536+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=2MYO1ATFOF9V tag=IW4O6OKA08D4 type=write size=2659597 2024-09-12T00:27:46.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.540+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~JAKCXEX08B02.0 size=423379 2024-09-12T00:27:46.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.540+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=JAKCXEX08B02 tag=YMZ0059GTDCQ type=write size=1471955 2024-09-12T00:27:46.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.544+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~FOM6Z2537T4Z.0 size=1048576 2024-09-12T00:27:46.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.548+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~FOM6Z2537T4Z.1 size=523185 2024-09-12T00:27:46.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.552+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=FOM6Z2537T4Z tag=Z0ZXJXMG55YC type=write size=2620337 2024-09-12T00:27:46.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.556+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=JBIGP3ZI7YIO type=write size=12051 2024-09-12T00:27:46.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.560+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~JK52FS0ORARS.0 size=1048576 2024-09-12T00:27:46.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.564+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~JK52FS0ORARS.1 size=1048576 2024-09-12T00:27:46.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.568+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~JK52FS0ORARS.2 size=935140 2024-09-12T00:27:46.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.572+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=JK52FS0ORARS tag=R6SOIAT7ZCI7 type=write size=4080868 2024-09-12T00:27:46.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.576+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=5U4EJSNS46QA type=write size=147946 2024-09-12T00:27:46.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.580+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=RMGCZGGDK9HJ type=del 2024-09-12T00:27:46.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.588+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~PBMHPJJPHYKX.0 size=1048576 2024-09-12T00:27:46.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.592+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~PBMHPJJPHYKX.1 size=956882 2024-09-12T00:27:46.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.592+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=PBMHPJJPHYKX tag=ET0C82KKRZJW type=write size=3054034 2024-09-12T00:27:46.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.596+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=IHBCWRI5UR0O type=del 2024-09-12T00:27:46.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.604+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~2W7BR8F2B06F.0 size=1048576 2024-09-12T00:27:46.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.604+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~2W7BR8F2B06F.1 size=153106 2024-09-12T00:27:46.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.604+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=2W7BR8F2B06F tag=OC7I1K9JYV51 type=write size=2250258 2024-09-12T00:27:46.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.608+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~GPDNHCYPNV6L.0 size=1048576 2024-09-12T00:27:46.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.612+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~GPDNHCYPNV6L.1 size=1048576 2024-09-12T00:27:46.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.616+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~GPDNHCYPNV6L.2 size=86224 2024-09-12T00:27:46.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.620+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=GPDNHCYPNV6L tag=8ZV2FV3N7KUD type=write size=3231952 2024-09-12T00:27:46.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.624+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=8XMLBGTG67JN type=del size=2343241 2024-09-12T00:27:46.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.628+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~D0G0RN1GCHFG.0 size=1048576 2024-09-12T00:27:46.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.632+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~D0G0RN1GCHFG.1 size=1048576 2024-09-12T00:27:46.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.636+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~D0G0RN1GCHFG.2 size=696214 2024-09-12T00:27:46.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.640+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=D0G0RN1GCHFG tag=3U0A4V0NWRJ5 type=write size=3841942 2024-09-12T00:27:46.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.644+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=3WAJAKA43MW9 type=write size=956112 2024-09-12T00:27:46.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.648+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=4U04D252W0UJ type=write size=562607 2024-09-12T00:27:46.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.652+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=HTFU1L6F2RSZ type=del size=3480537 2024-09-12T00:27:46.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.656+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~VRSBIQCDV3DS.0 size=1048576 2024-09-12T00:27:46.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.660+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~VRSBIQCDV3DS.1 size=1048576 2024-09-12T00:27:46.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.664+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~VRSBIQCDV3DS.2 size=100945 2024-09-12T00:27:46.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.668+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=VRSBIQCDV3DS tag=FXPJ4LY4AS6S type=write size=3246673 2024-09-12T00:27:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.672+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=X6DTWC4974JI type=del size=3875569 2024-09-12T00:27:46.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.676+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=UUU84S3E4Q40 type=del 2024-09-12T00:27:46.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.680+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=NIVN6U1UX9QZ type=del size=1930748 2024-09-12T00:27:46.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.684+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~LGJXKA370QN2.0 size=777492 2024-09-12T00:27:46.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.692+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=LGJXKA370QN2 tag=JS2DD1OTPQ9R type=write size=1826068 2024-09-12T00:27:46.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.696+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=IY9NP2Z1OH87 type=del size=353744 2024-09-12T00:27:46.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.700+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~R92TT5YPIRJV.0 size=40465 2024-09-12T00:27:46.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.704+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=R92TT5YPIRJV tag=SK9NZXXE7HS6 type=write size=1089041 2024-09-12T00:27:46.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.708+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=X2CSCMZJ8S8P type=del size=2398179 2024-09-12T00:27:46.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.712+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=RDNI4ULH0BQ1 type=write size=731105 2024-09-12T00:27:46.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.716+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=VK7P17ECL70W type=write size=793019 2024-09-12T00:27:46.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.720+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=PB0UEQJHOFBT type=del 2024-09-12T00:27:46.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.724+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=MBX0T5UTND42 type=del size=58171 2024-09-12T00:27:46.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.728+0000 7f712938c8c0 1 < completed write operation key=BH2YHXHVEZCH tag=AYVJ751864C5 type=write size=15591 2024-09-12T00:27:46.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.732+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~I6G3YCCMAOY0.0 size=902263 2024-09-12T00:27:46.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.732+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=I6G3YCCMAOY0 tag=LU3MW23FQNUR type=write size=1950839 2024-09-12T00:27:46.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.740+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=U44N1UCY2N0R type=del 2024-09-12T00:27:46.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.744+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~TOHRNXQA7FN2.0 size=1048576 2024-09-12T00:27:46.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.748+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~TOHRNXQA7FN2.1 size=1048576 2024-09-12T00:27:46.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.752+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~TOHRNXQA7FN2.2 size=276071 2024-09-12T00:27:46.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.752+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=TOHRNXQA7FN2 tag=8162DBQIKT80 type=write size=3421799 2024-09-12T00:27:46.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.756+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~JAKCXEX08B02.0 size=423379 2024-09-12T00:27:46.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.760+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=JAKCXEX08B02 tag=YMZ0059GTDCQ type=write size=1471955 2024-09-12T00:27:46.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.764+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=FVPNAC6FVQLZ type=write size=733021 2024-09-12T00:27:46.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.768+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=JBIGP3ZI7YIO type=write size=12051 2024-09-12T00:27:46.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.776+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~QMK73S9TZ9OL.0 size=822647 2024-09-12T00:27:46.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.776+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=QMK73S9TZ9OL tag=YT0AWYKZBIM9 type=write size=1871223 2024-09-12T00:27:46.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.780+0000 7f712938c8c0 1 < completed write operation key=HPM9GFRASWIV tag=5U4EJSNS46QA type=write size=147946 2024-09-12T00:27:46.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.788+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~C9AO572MG177.0 size=1048576 2024-09-12T00:27:46.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.792+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~C9AO572MG177.1 size=1048576 2024-09-12T00:27:46.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.796+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~C9AO572MG177.2 size=865288 2024-09-12T00:27:46.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.796+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=C9AO572MG177 tag=ERW2USVTN58B type=write size=4011016 2024-09-12T00:27:46.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.800+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~PBMHPJJPHYKX.0 size=1048576 2024-09-12T00:27:46.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.800+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~PBMHPJJPHYKX.1 size=956882 2024-09-12T00:27:46.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.808+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=PBMHPJJPHYKX tag=ET0C82KKRZJW type=write size=3054034 2024-09-12T00:27:46.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.812+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=8FJ8OH1DS4GE type=del size=2147507 2024-09-12T00:27:46.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.816+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~2W7BR8F2B06F.0 size=1048576 2024-09-12T00:27:46.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.816+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~2W7BR8F2B06F.1 size=153106 2024-09-12T00:27:46.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.824+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=2W7BR8F2B06F tag=OC7I1K9JYV51 type=write size=2250258 2024-09-12T00:27:46.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.828+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=HS13JCYD0NNT type=del size=2805050 2024-09-12T00:27:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.836+0000 7f712938c8c0 1 < suggested update operation key=A8L061CQ0M0J tag=8XMLBGTG67JN type=del size=2343241 2024-09-12T00:27:46.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.840+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=I5VYYZ9EUKDK type=del size=2498404 2024-09-12T00:27:46.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.840+0000 7f712938c8c0 1 < completed write operation key=Z2RYL03II71Z tag=3WAJAKA43MW9 type=write size=956112 2024-09-12T00:27:46.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.848+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~H0D1YH8OBVU7.0 size=1048576 2024-09-12T00:27:46.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.852+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~H0D1YH8OBVU7.1 size=1048576 2024-09-12T00:27:46.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.856+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~H0D1YH8OBVU7.2 size=528797 2024-09-12T00:27:46.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.856+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=H0D1YH8OBVU7 tag=0NVA340IONIG type=write size=3674525 2024-09-12T00:27:46.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.856+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=HTFU1L6F2RSZ type=del 2024-09-12T00:27:46.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.864+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~KC2V4P8S3455.0 size=1016027 2024-09-12T00:27:46.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.864+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=KC2V4P8S3455 tag=VTYABUR9NM3V type=write size=2064603 2024-09-12T00:27:46.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.868+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=X6DTWC4974JI type=del 2024-09-12T00:27:46.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.876+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~XXORUU5PQZIX.0 size=1048576 2024-09-12T00:27:46.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.880+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~XXORUU5PQZIX.1 size=285067 2024-09-12T00:27:46.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.880+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=XXORUU5PQZIX tag=VD8ILAXD7TN8 type=write size=2382219 2024-09-12T00:27:46.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.888+0000 7f712938c8c0 1 < suggested update operation key=VAFU5FXA2KLC tag=NIVN6U1UX9QZ type=del size=1930748 2024-09-12T00:27:46.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.892+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=JP5DYZ6U1ZN7 type=del size=724172 2024-09-12T00:27:46.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.900+0000 7f712938c8c0 1 < suggested update operation key=7X45VJAQO7PF tag=IY9NP2Z1OH87 type=del size=353744 2024-09-12T00:27:46.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.904+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=VFJVSAYPHOKE type=del size=2689369 2024-09-12T00:27:46.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.908+0000 7f712938c8c0 -1 < failed to complete operation key=VAFU5FXA2KLC tag=X2CSCMZJ8S8P type=del size=2398179: (22) Invalid argument 2024-09-12T00:27:46.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.912+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=L6NZ0MC5TS6J type=del size=915277 2024-09-12T00:27:46.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.916+0000 7f712938c8c0 1 < completed write operation key=KNGB14TWW6XC tag=VK7P17ECL70W type=write size=793019 2024-09-12T00:27:46.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.924+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~ICT642HDI77C.0 size=915414 2024-09-12T00:27:46.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.924+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=ICT642HDI77C tag=K6XC11T8Y6IG type=write size=1963990 2024-09-12T00:27:46.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.928+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=MBX0T5UTND42 type=del 2024-09-12T00:27:46.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.936+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~PSHF54JRHL73.0 size=1048576 2024-09-12T00:27:46.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.936+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~PSHF54JRHL73.1 size=979509 2024-09-12T00:27:46.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.936+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=PSHF54JRHL73 tag=DCGQSHJWAYKB type=write size=3076661 2024-09-12T00:27:46.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.944+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~I6G3YCCMAOY0.0 size=902263 2024-09-12T00:27:46.948 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.948+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=I6G3YCCMAOY0 tag=LU3MW23FQNUR type=write size=1950839 2024-09-12T00:27:46.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.956+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~MBOHDD2ZBCVG.0 size=1048576 2024-09-12T00:27:46.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.960+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~MBOHDD2ZBCVG.1 size=1048576 2024-09-12T00:27:46.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.960+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~MBOHDD2ZBCVG.2 size=303724 2024-09-12T00:27:46.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.960+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=MBOHDD2ZBCVG tag=60SI5I6I39EP type=write size=3449452 2024-09-12T00:27:46.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.968+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~TOHRNXQA7FN2.0 size=1048576 2024-09-12T00:27:46.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.968+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~TOHRNXQA7FN2.1 size=1048576 2024-09-12T00:27:46.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.968+0000 7f712938c8c0 1 < canceled part key=_multipart_9N3U208FGM79.2~TOHRNXQA7FN2.2 size=276071 2024-09-12T00:27:46.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.976+0000 7f712938c8c0 1 < canceled multipart upload key=9N3U208FGM79 upload=TOHRNXQA7FN2 tag=8162DBQIKT80 type=write size=3421799 2024-09-12T00:27:46.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.984+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~HYZ8VLSRMC2E.0 size=1048576 2024-09-12T00:27:46.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.984+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~HYZ8VLSRMC2E.1 size=834551 2024-09-12T00:27:46.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.984+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=HYZ8VLSRMC2E tag=LAXNBLDH1IVO type=write size=2931703 2024-09-12T00:27:46.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.988+0000 7f712938c8c0 1 < completed write operation key=W9YW6AS1RL48 tag=FVPNAC6FVQLZ type=write size=733021 2024-09-12T00:27:46.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.992+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=Q8XFECH00EGI type=del size=2379004 2024-09-12T00:27:46.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:46.996+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~QMK73S9TZ9OL.0 size=822647 2024-09-12T00:27:47.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.000+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=QMK73S9TZ9OL tag=YT0AWYKZBIM9 type=write size=1871223 2024-09-12T00:27:47.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.008+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~K6N7X437PV7J.0 size=1048576 2024-09-12T00:27:47.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.012+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~K6N7X437PV7J.1 size=868350 2024-09-12T00:27:47.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.012+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=K6N7X437PV7J tag=XO3E7YXREG7G type=write size=2965502 2024-09-12T00:27:47.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.016+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~C9AO572MG177.0 size=1048576 2024-09-12T00:27:47.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.020+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~C9AO572MG177.1 size=1048576 2024-09-12T00:27:47.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.024+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~C9AO572MG177.2 size=865288 2024-09-12T00:27:47.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.028+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=C9AO572MG177 tag=ERW2USVTN58B type=write size=4011016 2024-09-12T00:27:47.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.036+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=M5P6ROWCWP2Q type=del size=1317968 2024-09-12T00:27:47.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.040+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=8FJ8OH1DS4GE type=del 2024-09-12T00:27:47.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.040+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=6UNP0NNXSJSF type=write size=420721 2024-09-12T00:27:47.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.044+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=HS13JCYD0NNT type=del 2024-09-12T00:27:47.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.048+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=YD8R94W4NMPL type=write size=186396 2024-09-12T00:27:47.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.052+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=I5VYYZ9EUKDK type=del 2024-09-12T00:27:47.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.056+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=P40MJOKSMJTF type=del size=3720170 2024-09-12T00:27:47.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.060+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~H0D1YH8OBVU7.0 size=1048576 2024-09-12T00:27:47.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.064+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~H0D1YH8OBVU7.1 size=1048576 2024-09-12T00:27:47.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.064+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~H0D1YH8OBVU7.2 size=528797 2024-09-12T00:27:47.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.072+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=H0D1YH8OBVU7 tag=0NVA340IONIG type=write size=3674525 2024-09-12T00:27:47.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.076+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=B1M8XMNH149V type=del size=2597251 2024-09-12T00:27:47.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.080+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~KC2V4P8S3455.0 size=1016027 2024-09-12T00:27:47.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.084+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=KC2V4P8S3455 tag=VTYABUR9NM3V type=write size=2064603 2024-09-12T00:27:47.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.092+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~4OW2OI9BBTL2.0 size=72853 2024-09-12T00:27:47.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.092+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=4OW2OI9BBTL2 tag=HWCJFW2DPKRJ type=write size=1121429 2024-09-12T00:27:47.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.096+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~XXORUU5PQZIX.0 size=1048576 2024-09-12T00:27:47.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.100+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~XXORUU5PQZIX.1 size=285067 2024-09-12T00:27:47.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.108+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=XXORUU5PQZIX tag=VD8ILAXD7TN8 type=write size=2382219 2024-09-12T00:27:47.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.112+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=XH2W9JFFHL1S type=del size=662257 2024-09-12T00:27:47.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.116+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=JP5DYZ6U1ZN7 type=del 2024-09-12T00:27:47.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.120+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=XM3XQGKQ39SV type=del size=463471 2024-09-12T00:27:47.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.124+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=VFJVSAYPHOKE type=del 2024-09-12T00:27:47.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.132+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~1S8K71SJUCP3.0 size=229291 2024-09-12T00:27:47.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.132+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=1S8K71SJUCP3 tag=VECNVJPTHCA2 type=write size=1277867 2024-09-12T00:27:47.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.136+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=L6NZ0MC5TS6J type=del 2024-09-12T00:27:47.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.140+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=CMFN0YCHCGI2 type=del size=3088830 2024-09-12T00:27:47.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.144+0000 7f712938c8c0 1 < canceled part key=_multipart_F7T79C7MZX35.2~ICT642HDI77C.0 size=915414 2024-09-12T00:27:47.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.148+0000 7f712938c8c0 1 < canceled multipart upload key=F7T79C7MZX35 upload=ICT642HDI77C tag=K6XC11T8Y6IG type=write size=1963990 2024-09-12T00:27:47.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.152+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=TH4O9ZYNI1AB type=del size=1693055 2024-09-12T00:27:47.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.156+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~PSHF54JRHL73.0 size=1048576 2024-09-12T00:27:47.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.160+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~PSHF54JRHL73.1 size=979509 2024-09-12T00:27:47.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.164+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=PSHF54JRHL73 tag=DCGQSHJWAYKB type=write size=3076661 2024-09-12T00:27:47.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.172+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~BW21VRWET2BL.0 size=1048576 2024-09-12T00:27:47.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.176+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~BW21VRWET2BL.1 size=588889 2024-09-12T00:27:47.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.176+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=BW21VRWET2BL tag=DSM8UW2A4149 type=write size=2686041 2024-09-12T00:27:47.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.180+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~MBOHDD2ZBCVG.0 size=1048576 2024-09-12T00:27:47.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.180+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~MBOHDD2ZBCVG.1 size=1048576 2024-09-12T00:27:47.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.184+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~MBOHDD2ZBCVG.2 size=303724 2024-09-12T00:27:47.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.188+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=MBOHDD2ZBCVG tag=60SI5I6I39EP type=write size=3449452 2024-09-12T00:27:47.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.192+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=JYVXX8GAR35Z type=del size=931206 2024-09-12T00:27:47.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.196+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~HYZ8VLSRMC2E.0 size=1048576 2024-09-12T00:27:47.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.200+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~HYZ8VLSRMC2E.1 size=834551 2024-09-12T00:27:47.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.208+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=HYZ8VLSRMC2E tag=LAXNBLDH1IVO type=write size=2931703 2024-09-12T00:27:47.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.212+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=MJU5NGROEAL3 type=del size=680486 2024-09-12T00:27:47.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.216+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=Q8XFECH00EGI type=del 2024-09-12T00:27:47.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.220+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~W3M75QL1UIH5.0 size=1048576 2024-09-12T00:27:47.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.224+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~W3M75QL1UIH5.1 size=330834 2024-09-12T00:27:47.224 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.224+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=W3M75QL1UIH5 tag=S12M5LVROX06 type=write size=2427986 2024-09-12T00:27:47.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.228+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~K6N7X437PV7J.0 size=1048576 2024-09-12T00:27:47.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.232+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~K6N7X437PV7J.1 size=868350 2024-09-12T00:27:47.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.236+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=K6N7X437PV7J tag=XO3E7YXREG7G type=write size=2965502 2024-09-12T00:27:47.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.240+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=IIEA721MCT5N type=del size=448544 2024-09-12T00:27:47.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.244+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=M5P6ROWCWP2Q type=del 2024-09-12T00:27:47.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.248+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=J5ZZT056CDN4 type=del size=1525243 2024-09-12T00:27:47.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.252+0000 7f712938c8c0 1 < completed write operation key=KNGB14TWW6XC tag=6UNP0NNXSJSF type=write size=420721 2024-09-12T00:27:47.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.256+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=9B7V2TFPNH89 type=del size=1441765 2024-09-12T00:27:47.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.260+0000 7f712938c8c0 1 < canceled operation key=L2SR6IAW0D38 tag=YD8R94W4NMPL type=write size=186396 2024-09-12T00:27:47.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.268+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~OE83LC88O76H.0 size=891853 2024-09-12T00:27:47.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.268+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=OE83LC88O76H tag=2O1JGGC37NIL type=write size=1940429 2024-09-12T00:27:47.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.272+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=P40MJOKSMJTF type=del 2024-09-12T00:27:47.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.276+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=TPB05NLAVC1T type=write size=827745 2024-09-12T00:27:47.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.280+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=B1M8XMNH149V type=del 2024-09-12T00:27:47.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.284+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=MKJM5O01N6Y3 type=del size=2853442 2024-09-12T00:27:47.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.288+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~4OW2OI9BBTL2.0 size=72853 2024-09-12T00:27:47.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.292+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=4OW2OI9BBTL2 tag=HWCJFW2DPKRJ type=write size=1121429 2024-09-12T00:27:47.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.300+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~QPP2NL8RX36A.0 size=1048576 2024-09-12T00:27:47.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.304+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~QPP2NL8RX36A.1 size=577910 2024-09-12T00:27:47.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.304+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=QPP2NL8RX36A tag=8IH0HXV3GSV3 type=write size=2675062 2024-09-12T00:27:47.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.308+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=XH2W9JFFHL1S type=del 2024-09-12T00:27:47.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.312+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=HZ62384D9B1W type=del size=2803043 2024-09-12T00:27:47.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.320+0000 7f712938c8c0 1 < suggested update operation key=ZP88X00LMVSS tag=XM3XQGKQ39SV type=del size=463471 2024-09-12T00:27:47.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.324+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~ZC4JXRXBF3K7.0 size=769853 2024-09-12T00:27:47.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.324+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=ZC4JXRXBF3K7 tag=8K48JK30FZCQ type=write size=1818429 2024-09-12T00:27:47.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.328+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~1S8K71SJUCP3.0 size=229291 2024-09-12T00:27:47.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.336+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=1S8K71SJUCP3 tag=VECNVJPTHCA2 type=write size=1277867 2024-09-12T00:27:47.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.340+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~42RDF53GGMDG.0 size=767315 2024-09-12T00:27:47.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.340+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=42RDF53GGMDG tag=VGY2YIAEG7XF type=write size=1815891 2024-09-12T00:27:47.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.348+0000 7f712938c8c0 1 < suggested remove operation key=0QZKHZTVP3RQ tag=CMFN0YCHCGI2 type=del 2024-09-12T00:27:47.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.356+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=4STIPSEPDZ1I type=del size=3639046 2024-09-12T00:27:47.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.360+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=TH4O9ZYNI1AB type=del 2024-09-12T00:27:47.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.364+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~5D5XGWCLI3WP.0 size=1048576 2024-09-12T00:27:47.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.368+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~5D5XGWCLI3WP.1 size=1048576 2024-09-12T00:27:47.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.372+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~5D5XGWCLI3WP.2 size=12752 2024-09-12T00:27:47.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.372+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=5D5XGWCLI3WP tag=G32VO2K7R66O type=write size=3158480 2024-09-12T00:27:47.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.376+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~BW21VRWET2BL.0 size=1048576 2024-09-12T00:27:47.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.376+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~BW21VRWET2BL.1 size=588889 2024-09-12T00:27:47.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.384+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=BW21VRWET2BL tag=DSM8UW2A4149 type=write size=2686041 2024-09-12T00:27:47.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.392+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~G36PHECIVF1W.0 size=509608 2024-09-12T00:27:47.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.392+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=G36PHECIVF1W tag=QM86T5K8GIKA type=write size=1558184 2024-09-12T00:27:47.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.396+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=JYVXX8GAR35Z type=del 2024-09-12T00:27:47.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.400+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=ZMV7DEOVJBMN type=del size=1258178 2024-09-12T00:27:47.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.404+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=MJU5NGROEAL3 type=del 2024-09-12T00:27:47.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.412+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~5IW8ZCG3OK9K.0 size=390135 2024-09-12T00:27:47.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.412+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=5IW8ZCG3OK9K tag=EDTIPVDMX5I1 type=write size=1438711 2024-09-12T00:27:47.414 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.416+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~W3M75QL1UIH5.0 size=1048576 2024-09-12T00:27:47.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.416+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~W3M75QL1UIH5.1 size=330834 2024-09-12T00:27:47.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.424+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=W3M75QL1UIH5 tag=S12M5LVROX06 type=write size=2427986 2024-09-12T00:27:47.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.432+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~U3Z3LX7JUVLZ.0 size=43760 2024-09-12T00:27:47.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.432+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=U3Z3LX7JUVLZ tag=25CRY28697UJ type=write size=1092336 2024-09-12T00:27:47.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.436+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=IIEA721MCT5N type=del 2024-09-12T00:27:47.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.440+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=8BUU57ZCZQ5I type=del size=2218944 2024-09-12T00:27:47.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.448+0000 7f712938c8c0 1 < suggested update operation key=G0065P5NOJ2F tag=J5ZZT056CDN4 type=del size=1525243 2024-09-12T00:27:47.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.452+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=ETE1QVJJ35IW type=del size=3280924 2024-09-12T00:27:47.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.456+0000 7f712938c8c0 -1 < failed to complete operation key=0QZKHZTVP3RQ tag=9B7V2TFPNH89 type=del size=1441765: (22) Invalid argument 2024-09-12T00:27:47.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.460+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=1KV154E2IEBB type=del size=1383451 2024-09-12T00:27:47.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.464+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~OE83LC88O76H.0 size=891853 2024-09-12T00:27:47.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.472+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=OE83LC88O76H tag=2O1JGGC37NIL type=write size=1940429 2024-09-12T00:27:47.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.476+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=EZI4DE02DQFG type=del size=2791902 2024-09-12T00:27:47.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.480+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=TPB05NLAVC1T type=write size=827745 2024-09-12T00:27:47.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.484+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=FYX531LSO05L type=del size=2106157 2024-09-12T00:27:47.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.492+0000 7f712938c8c0 1 < suggested update operation key=KEMQ3H8LAUI9 tag=MKJM5O01N6Y3 type=del size=2853442 2024-09-12T00:27:47.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.504+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~B7WC4SFG96V9.0 size=1048576 2024-09-12T00:27:47.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.504+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~B7WC4SFG96V9.1 size=159658 2024-09-12T00:27:47.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.504+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=B7WC4SFG96V9 tag=IKJQUV2FT5CK type=write size=2256810 2024-09-12T00:27:47.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.508+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~QPP2NL8RX36A.0 size=1048576 2024-09-12T00:27:47.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.512+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~QPP2NL8RX36A.1 size=577910 2024-09-12T00:27:47.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.516+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=QPP2NL8RX36A tag=8IH0HXV3GSV3 type=write size=2675062 2024-09-12T00:27:47.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.520+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=NE10582QQRXL type=write size=491771 2024-09-12T00:27:47.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.524+0000 7f712938c8c0 -1 < failed to complete operation key=ZP88X00LMVSS tag=HZ62384D9B1W type=del size=2803043: (22) Invalid argument 2024-09-12T00:27:47.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.532+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~NDJRJZ4FXGLV.0 size=1048576 2024-09-12T00:27:47.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.532+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~NDJRJZ4FXGLV.1 size=803494 2024-09-12T00:27:47.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.532+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=NDJRJZ4FXGLV tag=OBYRUT1NU0DR type=write size=2900646 2024-09-12T00:27:47.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.536+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~ZC4JXRXBF3K7.0 size=769853 2024-09-12T00:27:47.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.544+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=ZC4JXRXBF3K7 tag=8K48JK30FZCQ type=write size=1818429 2024-09-12T00:27:47.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.548+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=5QEE7P8BSP3K type=del size=2922245 2024-09-12T00:27:47.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.552+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~42RDF53GGMDG.0 size=767315 2024-09-12T00:27:47.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.556+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=42RDF53GGMDG tag=VGY2YIAEG7XF type=write size=1815891 2024-09-12T00:27:47.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.560+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=YVHTP5IDUGJI type=del size=1757269 2024-09-12T00:27:47.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.564+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=4STIPSEPDZ1I type=del 2024-09-12T00:27:47.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.568+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=YEGO3H65YFS0 type=del size=2000425 2024-09-12T00:27:47.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.572+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~5D5XGWCLI3WP.0 size=1048576 2024-09-12T00:27:47.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.576+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~5D5XGWCLI3WP.1 size=1048576 2024-09-12T00:27:47.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.576+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~5D5XGWCLI3WP.2 size=12752 2024-09-12T00:27:47.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.584+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=5D5XGWCLI3WP tag=G32VO2K7R66O type=write size=3158480 2024-09-12T00:27:47.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.588+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=ZOE7UG4C1QMW type=del size=1108120 2024-09-12T00:27:47.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.592+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~G36PHECIVF1W.0 size=509608 2024-09-12T00:27:47.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.596+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=G36PHECIVF1W tag=QM86T5K8GIKA type=write size=1558184 2024-09-12T00:27:47.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.600+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=SIVG57GZZQOI type=del size=1311017 2024-09-12T00:27:47.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.608+0000 7f712938c8c0 1 < suggested update operation key=T0C4ZDQB13X0 tag=ZMV7DEOVJBMN type=del size=1258178 2024-09-12T00:27:47.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.612+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=DV04W12V8C4A type=del size=24900 2024-09-12T00:27:47.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.616+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~5IW8ZCG3OK9K.0 size=390135 2024-09-12T00:27:47.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.624+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=5IW8ZCG3OK9K tag=EDTIPVDMX5I1 type=write size=1438711 2024-09-12T00:27:47.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.628+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=PMBV9FWIUOGK type=write size=60321 2024-09-12T00:27:47.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.632+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~U3Z3LX7JUVLZ.0 size=43760 2024-09-12T00:27:47.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.636+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=U3Z3LX7JUVLZ tag=25CRY28697UJ type=write size=1092336 2024-09-12T00:27:47.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.644+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~Z036PXCHUVB5.0 size=1048576 2024-09-12T00:27:47.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.648+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~Z036PXCHUVB5.1 size=286092 2024-09-12T00:27:47.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.648+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=Z036PXCHUVB5 tag=R4IWOWURJSVR type=write size=2383244 2024-09-12T00:27:47.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.656+0000 7f712938c8c0 1 < suggested remove operation key=7X45VJAQO7PF tag=8BUU57ZCZQ5I type=del 2024-09-12T00:27:47.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.660+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~0KXV5ZX5JT81.0 size=1048576 2024-09-12T00:27:47.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.664+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~0KXV5ZX5JT81.1 size=1048576 2024-09-12T00:27:47.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.668+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~0KXV5ZX5JT81.2 size=796019 2024-09-12T00:27:47.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.668+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=0KXV5ZX5JT81 tag=11NZYQAB4USJ type=write size=3941747 2024-09-12T00:27:47.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.676+0000 7f712938c8c0 1 < suggested update operation key=04RL082VPLIM tag=ETE1QVJJ35IW type=del size=3280924 2024-09-12T00:27:47.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.680+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=PH91RPBGVGLV type=write size=472098 2024-09-12T00:27:47.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.684+0000 7f712938c8c0 1 < canceled operation key=V9K2307BGOKP tag=1KV154E2IEBB type=del size=1383451 2024-09-12T00:27:47.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.688+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=S75CR5QXM2NA type=del size=179771 2024-09-12T00:27:47.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.692+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=EZI4DE02DQFG type=del 2024-09-12T00:27:47.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.700+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~QNL48AOWTV28.0 size=567191 2024-09-12T00:27:47.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.700+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=QNL48AOWTV28 tag=W2IMH63TN171 type=write size=1615767 2024-09-12T00:27:47.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.704+0000 7f712938c8c0 -1 < failed to complete operation key=T0C4ZDQB13X0 tag=FYX531LSO05L type=del size=2106157: (22) Invalid argument 2024-09-12T00:27:47.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.708+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=I7IZSGII5YKG type=del size=1972030 2024-09-12T00:27:47.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.712+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~B7WC4SFG96V9.0 size=1048576 2024-09-12T00:27:47.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.716+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~B7WC4SFG96V9.1 size=159658 2024-09-12T00:27:47.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.724+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=B7WC4SFG96V9 tag=IKJQUV2FT5CK type=write size=2256810 2024-09-12T00:27:47.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.728+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=9UUMTYWYOHDV type=write size=234756 2024-09-12T00:27:47.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.732+0000 7f712938c8c0 1 < completed write operation key=QG0W04PRTQNP tag=NE10582QQRXL type=write size=491771 2024-09-12T00:27:47.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.740+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~H88W74XGUECP.0 size=149654 2024-09-12T00:27:47.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.740+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=H88W74XGUECP tag=4XP7ANV910AK type=write size=1198230 2024-09-12T00:27:47.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.740+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~NDJRJZ4FXGLV.0 size=1048576 2024-09-12T00:27:47.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.744+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~NDJRJZ4FXGLV.1 size=803494 2024-09-12T00:27:47.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.752+0000 7f712938c8c0 1 < canceled multipart upload key=9751RNPPQJBO upload=NDJRJZ4FXGLV tag=OBYRUT1NU0DR type=write size=2900646 2024-09-12T00:27:47.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.756+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=TKCMXI9FPJWM type=del size=909005 2024-09-12T00:27:47.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.760+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=5QEE7P8BSP3K type=del 2024-09-12T00:27:47.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.764+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=SQABBKGL6Z6E type=del size=3309003 2024-09-12T00:27:47.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.768+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=YVHTP5IDUGJI type=del 2024-09-12T00:27:47.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.772+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=56F086XJOCJ5 type=del size=1306106 2024-09-12T00:27:47.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.776+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=YEGO3H65YFS0 type=del 2024-09-12T00:27:47.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.780+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=YI8ESDMU3DB0 type=del size=4054221 2024-09-12T00:27:47.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.784+0000 7f712938c8c0 -1 < failed to complete operation key=04RL082VPLIM tag=ZOE7UG4C1QMW type=del size=1108120: (22) Invalid argument 2024-09-12T00:27:47.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.788+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=DSRPENWCY81N type=write size=470548 2024-09-12T00:27:47.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.792+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=SIVG57GZZQOI type=del 2024-09-12T00:27:47.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.800+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~7WKZAGG06VYT.0 size=1048576 2024-09-12T00:27:47.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.804+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~7WKZAGG06VYT.1 size=1048576 2024-09-12T00:27:47.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.804+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~7WKZAGG06VYT.2 size=719205 2024-09-12T00:27:47.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.804+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=7WKZAGG06VYT tag=7XQNQQPBOAC1 type=write size=3864933 2024-09-12T00:27:47.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.808+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=DV04W12V8C4A type=del 2024-09-12T00:27:47.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.812+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=A1TTFPHB6614 type=write size=819083 2024-09-12T00:27:47.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.816+0000 7f712938c8c0 1 < completed write operation key=ZP88X00LMVSS tag=PMBV9FWIUOGK type=write size=60321 2024-09-12T00:27:47.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.824+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~814NLBLQLH9U.0 size=1048576 2024-09-12T00:27:47.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.828+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~814NLBLQLH9U.1 size=80958 2024-09-12T00:27:47.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.828+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=814NLBLQLH9U tag=WC116USNSPRN type=write size=2178110 2024-09-12T00:27:47.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.832+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~Z036PXCHUVB5.0 size=1048576 2024-09-12T00:27:47.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.832+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~Z036PXCHUVB5.1 size=286092 2024-09-12T00:27:47.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.840+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=Z036PXCHUVB5 tag=R4IWOWURJSVR type=write size=2383244 2024-09-12T00:27:47.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.844+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=62BA2XASGFTP type=del size=2837422 2024-09-12T00:27:47.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.848+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~0KXV5ZX5JT81.0 size=1048576 2024-09-12T00:27:47.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.848+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~0KXV5ZX5JT81.1 size=1048576 2024-09-12T00:27:47.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.852+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~0KXV5ZX5JT81.2 size=796019 2024-09-12T00:27:47.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.860+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=0KXV5ZX5JT81 tag=11NZYQAB4USJ type=write size=3941747 2024-09-12T00:27:47.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.868+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~W0LXGQVLLJOF.0 size=467306 2024-09-12T00:27:47.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.868+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=W0LXGQVLLJOF tag=CAGA4JCEJALP type=write size=1515882 2024-09-12T00:27:47.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.872+0000 7f712938c8c0 1 < completed write operation key=F7T79C7MZX35 tag=PH91RPBGVGLV type=write size=472098 2024-09-12T00:27:47.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.876+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=ZG5NZXP1HU8K type=write size=354452 2024-09-12T00:27:47.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.880+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=S75CR5QXM2NA type=del 2024-09-12T00:27:47.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.884+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=P2K4S4R1U0G3 type=del size=921459 2024-09-12T00:27:47.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.884+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~QNL48AOWTV28.0 size=567191 2024-09-12T00:27:47.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.892+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=QNL48AOWTV28 tag=W2IMH63TN171 type=write size=1615767 2024-09-12T00:27:47.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.896+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=KBIGZWGYUBQ6 type=del size=3796064 2024-09-12T00:27:47.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.900+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=I7IZSGII5YKG type=del 2024-09-12T00:27:47.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.904+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=OHZQQXAL4NAT type=del size=3377161 2024-09-12T00:27:47.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.912+0000 7f712938c8c0 1 < suggested update operation key=KEMQ3H8LAUI9 tag=9UUMTYWYOHDV type=write size=234756 2024-09-12T00:27:47.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.920+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~83D59MI8QBT0.0 size=193269 2024-09-12T00:27:47.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.920+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=83D59MI8QBT0 tag=W0C9S11XPG0I type=write size=1241845 2024-09-12T00:27:47.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.924+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~H88W74XGUECP.0 size=149654 2024-09-12T00:27:47.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.928+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=H88W74XGUECP tag=4XP7ANV910AK type=write size=1198230 2024-09-12T00:27:47.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.932+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=8G2FSKTKMQMM type=del size=2700676 2024-09-12T00:27:47.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.936+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=TKCMXI9FPJWM type=del 2024-09-12T00:27:47.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.940+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=FIN3JNKRMC77 type=del size=706754 2024-09-12T00:27:47.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.944+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=SQABBKGL6Z6E type=del 2024-09-12T00:27:47.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.948+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=WT2EV4F00RSV type=write size=307898 2024-09-12T00:27:47.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.952+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=56F086XJOCJ5 type=del 2024-09-12T00:27:47.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.956+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=LKSCL48R9B3X type=del size=3145758 2024-09-12T00:27:47.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.960+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=YI8ESDMU3DB0 type=del 2024-09-12T00:27:47.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.964+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=HUTHY3ALOEUS type=write size=78019 2024-09-12T00:27:47.968 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.964+0000 7f712938c8c0 1 < canceled operation key=HPM9GFRASWIV tag=DSRPENWCY81N type=write size=470548 2024-09-12T00:27:47.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.968+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=8GKIEDF2NJ0D type=del size=2716212 2024-09-12T00:27:47.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.976+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~7WKZAGG06VYT.0 size=1048576 2024-09-12T00:27:47.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.976+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~7WKZAGG06VYT.1 size=1048576 2024-09-12T00:27:47.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.980+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~7WKZAGG06VYT.2 size=719205 2024-09-12T00:27:47.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.988+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=7WKZAGG06VYT tag=7XQNQQPBOAC1 type=write size=3864933 2024-09-12T00:27:47.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.992+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~8RMTHZW7B663.0 size=1048576 2024-09-12T00:27:47.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:47.996+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~8RMTHZW7B663.1 size=1048576 2024-09-12T00:27:47.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.000+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~8RMTHZW7B663.2 size=1023250 2024-09-12T00:27:47.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.000+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=8RMTHZW7B663 tag=1SVJQXXWN3H1 type=write size=4168978 2024-09-12T00:27:48.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.004+0000 7f712938c8c0 1 < completed write operation key=F7T79C7MZX35 tag=A1TTFPHB6614 type=write size=819083 2024-09-12T00:27:48.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.008+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~NIER4CK3AS5F.0 size=880967 2024-09-12T00:27:48.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.008+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=NIER4CK3AS5F tag=2ZQZTKK6VKXV type=write size=1929543 2024-09-12T00:27:48.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.012+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~814NLBLQLH9U.0 size=1048576 2024-09-12T00:27:48.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.016+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~814NLBLQLH9U.1 size=80958 2024-09-12T00:27:48.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.024+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=814NLBLQLH9U tag=WC116USNSPRN type=write size=2178110 2024-09-12T00:27:48.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.028+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=NG8YVVKMWW0P type=del size=1066244 2024-09-12T00:27:48.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.032+0000 7f712938c8c0 1 < suggested remove operation key=VAFU5FXA2KLC tag=62BA2XASGFTP type=del 2024-09-12T00:27:48.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.040+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~UKS6GIYVJ43P.0 size=1048576 2024-09-12T00:27:48.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.044+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~UKS6GIYVJ43P.1 size=1048576 2024-09-12T00:27:48.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.048+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~UKS6GIYVJ43P.2 size=410217 2024-09-12T00:27:48.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.048+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=UKS6GIYVJ43P tag=GORTURR13XX0 type=write size=3555945 2024-09-12T00:27:48.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.052+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~W0LXGQVLLJOF.0 size=467306 2024-09-12T00:27:48.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.060+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=W0LXGQVLLJOF tag=CAGA4JCEJALP type=write size=1515882 2024-09-12T00:27:48.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.064+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~S9M68IF5XBJI.0 size=1048576 2024-09-12T00:27:48.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.068+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~S9M68IF5XBJI.1 size=1048576 2024-09-12T00:27:48.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.072+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~S9M68IF5XBJI.2 size=318586 2024-09-12T00:27:48.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.072+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=S9M68IF5XBJI tag=XC5FCNXMD77T type=write size=3464314 2024-09-12T00:27:48.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.076+0000 7f712938c8c0 1 < completed write operation key=9HX9GER6OKVI tag=ZG5NZXP1HU8K type=write size=354452 2024-09-12T00:27:48.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.080+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=926798T85QWB type=del size=2327212 2024-09-12T00:27:48.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.088+0000 7f712938c8c0 1 < suggested update operation key=MUNSUH4BMZNP tag=P2K4S4R1U0G3 type=del size=921459 2024-09-12T00:27:48.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.092+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=H4Z0LNXZWDKH type=del size=3914831 2024-09-12T00:27:48.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.096+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=KBIGZWGYUBQ6 type=del 2024-09-12T00:27:48.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.100+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=W9TACG6JYBKI type=del size=1904145 2024-09-12T00:27:48.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.104+0000 7f712938c8c0 1 < suggested update operation key=0QZKHZTVP3RQ tag=OHZQQXAL4NAT type=del size=3377161 2024-09-12T00:27:48.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.108+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=Q3J891J3R09B type=del size=2763269 2024-09-12T00:27:48.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.112+0000 7f712938c8c0 1 < canceled part key=_multipart_G0065P5NOJ2F.2~83D59MI8QBT0.0 size=193269 2024-09-12T00:27:48.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.116+0000 7f712938c8c0 1 < canceled multipart upload key=G0065P5NOJ2F upload=83D59MI8QBT0 tag=W0C9S11XPG0I type=write size=1241845 2024-09-12T00:27:48.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.120+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=81CZQXEE3Z07 type=del size=3656905 2024-09-12T00:27:48.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.124+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=8G2FSKTKMQMM type=del 2024-09-12T00:27:48.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.128+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=9NNR4N23LGRO type=write size=397542 2024-09-12T00:27:48.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.132+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=FIN3JNKRMC77 type=del 2024-09-12T00:27:48.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.136+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=GV60478T19T3 type=del size=1169451 2024-09-12T00:27:48.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.140+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=WT2EV4F00RSV type=write size=307898 2024-09-12T00:27:48.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.144+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=LF0LE2H0QJ6M type=del size=2725136 2024-09-12T00:27:48.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.148+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=LKSCL48R9B3X type=del 2024-09-12T00:27:48.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.152+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=P5QZRRIG3N5J type=del size=478512 2024-09-12T00:27:48.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.156+0000 7f712938c8c0 -1 < failed to complete operation key=VAFU5FXA2KLC tag=HUTHY3ALOEUS type=write size=78019: (22) Invalid argument 2024-09-12T00:27:48.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.160+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=POS2U9C7WUX4 type=del size=504847 2024-09-12T00:27:48.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.164+0000 7f712938c8c0 1 < canceled operation key=Z2RYL03II71Z tag=8GKIEDF2NJ0D type=del size=2716212 2024-09-12T00:27:48.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.168+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=M74VX65VC6FX type=del size=3030302 2024-09-12T00:27:48.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.168+0000 7f712938c8c0 1 < canceled part key=_multipart_04RL082VPLIM.2~8RMTHZW7B663.0 size=1048576 2024-09-12T00:27:48.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.172+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~8RMTHZW7B663.1 size=1048576 2024-09-12T00:27:48.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.172+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~8RMTHZW7B663.2 size=1023250 2024-09-12T00:27:48.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.180+0000 7f712938c8c0 1 < canceled multipart upload key=04RL082VPLIM upload=8RMTHZW7B663 tag=1SVJQXXWN3H1 type=write size=4168978 2024-09-12T00:27:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.188+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~XB7219WR64P1.0 size=358601 2024-09-12T00:27:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.188+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=XB7219WR64P1 tag=RWZV90CTYUEM type=write size=1407177 2024-09-12T00:27:48.191 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.192+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~NIER4CK3AS5F.0 size=880967 2024-09-12T00:27:48.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.196+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=NIER4CK3AS5F tag=2ZQZTKK6VKXV type=write size=1929543 2024-09-12T00:27:48.202 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.204+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=9YPSO0BY885H type=del size=500166 2024-09-12T00:27:48.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.204+0000 7f712938c8c0 -1 < no bi entry to suggest for operation key=VAFU5FXA2KLC tag=NG8YVVKMWW0P type=del size=1066244: (2) No such file or directory 2024-09-12T00:27:48.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.216+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~ZA6TV20LPEUD.0 size=40023 2024-09-12T00:27:48.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.216+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=ZA6TV20LPEUD tag=2WNU77ZDRMLU type=write size=1088599 2024-09-12T00:27:48.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.216+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~UKS6GIYVJ43P.0 size=1048576 2024-09-12T00:27:48.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.220+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~UKS6GIYVJ43P.1 size=1048576 2024-09-12T00:27:48.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.228+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~UKS6GIYVJ43P.2 size=410217 2024-09-12T00:27:48.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.232+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=UKS6GIYVJ43P tag=GORTURR13XX0 type=write size=3555945 2024-09-12T00:27:48.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.240+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=4WDW5FPEDFAF type=del size=949265 2024-09-12T00:27:48.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.244+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~S9M68IF5XBJI.0 size=1048576 2024-09-12T00:27:48.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.244+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~S9M68IF5XBJI.1 size=1048576 2024-09-12T00:27:48.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.244+0000 7f712938c8c0 1 < canceled part key=_multipart_QL3FL4J9TKY4.2~S9M68IF5XBJI.2 size=318586 2024-09-12T00:27:48.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.252+0000 7f712938c8c0 1 < canceled multipart upload key=QL3FL4J9TKY4 upload=S9M68IF5XBJI tag=XC5FCNXMD77T type=write size=3464314 2024-09-12T00:27:48.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.256+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=9UWWC26II6S6 type=del size=3200489 2024-09-12T00:27:48.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.260+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=926798T85QWB type=del 2024-09-12T00:27:48.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.264+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=OKGRPG9DJPMH type=write size=211481 2024-09-12T00:27:48.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.268+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=H4Z0LNXZWDKH type=del 2024-09-12T00:27:48.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.272+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=RH4F15NYMBVG type=del size=693321 2024-09-12T00:27:48.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.276+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=W9TACG6JYBKI type=del 2024-09-12T00:27:48.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.284+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~9HC2TASDHX16.0 size=480549 2024-09-12T00:27:48.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.284+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=9HC2TASDHX16 tag=F1MM55ZS08GL type=write size=1529125 2024-09-12T00:27:48.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.288+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=Q3J891J3R09B type=del 2024-09-12T00:27:48.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.292+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=Y5BUSA20OLQ6 type=del size=1238243 2024-09-12T00:27:48.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.296+0000 7f712938c8c0 1 < canceled operation key=F7T79C7MZX35 tag=81CZQXEE3Z07 type=del size=3656905 2024-09-12T00:27:48.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.300+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=04XDE8LL4C7I type=del size=2967032 2024-09-12T00:27:48.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.304+0000 7f712938c8c0 1 < completed write operation key=W9YW6AS1RL48 tag=9NNR4N23LGRO type=write size=397542 2024-09-12T00:27:48.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.308+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=U3Z0B3C3A7A6 type=del size=2622073 2024-09-12T00:27:48.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.312+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=GV60478T19T3 type=del 2024-09-12T00:27:48.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.316+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=5CLNMW93YG00 type=del size=276695 2024-09-12T00:27:48.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.320+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=LF0LE2H0QJ6M type=del 2024-09-12T00:27:48.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.324+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=T9BYOMJ6XFOP type=del size=908950 2024-09-12T00:27:48.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.332+0000 7f712938c8c0 1 < suggested update operation key=WP4RJQVZVEE2 tag=P5QZRRIG3N5J type=del size=478512 2024-09-12T00:27:48.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.336+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=HYW0045YOSUC type=del size=1656132 2024-09-12T00:27:48.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.340+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=POS2U9C7WUX4 type=del 2024-09-12T00:27:48.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.344+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=SS27F327P2HA type=write size=289539 2024-09-12T00:27:48.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.348+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=M74VX65VC6FX type=del 2024-09-12T00:27:48.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.352+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=MN514DHO6JVY type=del size=3105027 2024-09-12T00:27:48.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.356+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~XB7219WR64P1.0 size=358601 2024-09-12T00:27:48.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.360+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=XB7219WR64P1 tag=RWZV90CTYUEM type=write size=1407177 2024-09-12T00:27:48.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.364+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=32KITOXRV12Q type=write size=573914 2024-09-12T00:27:48.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.372+0000 7f712938c8c0 1 < suggested remove operation key=9751RNPPQJBO tag=9YPSO0BY885H type=del 2024-09-12T00:27:48.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.376+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=24QGC59AP0EW type=del size=511432 2024-09-12T00:27:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.380+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~ZA6TV20LPEUD.0 size=40023 2024-09-12T00:27:48.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.388+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=ZA6TV20LPEUD tag=2WNU77ZDRMLU type=write size=1088599 2024-09-12T00:27:48.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.392+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=Y7TK703JDCUQ type=del size=1929827 2024-09-12T00:27:48.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.396+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=4WDW5FPEDFAF type=del 2024-09-12T00:27:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.400+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~HSSYT9SQFQUC.0 size=662635 2024-09-12T00:27:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.400+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=HSSYT9SQFQUC tag=L66XN2ZDUZ9U type=write size=1711211 2024-09-12T00:27:48.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.404+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=9UWWC26II6S6 type=del 2024-09-12T00:27:48.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.408+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=SACCE3FFMZWJ type=write size=774997 2024-09-12T00:27:48.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.412+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=OKGRPG9DJPMH type=write size=211481 2024-09-12T00:27:48.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.420+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~1EVFKMAWV07F.0 size=376834 2024-09-12T00:27:48.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.420+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=1EVFKMAWV07F tag=W3CVUQ977Y22 type=write size=1425410 2024-09-12T00:27:48.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.424+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=RH4F15NYMBVG type=del 2024-09-12T00:27:48.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.432+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~6SXQ00VYDB53.0 size=340998 2024-09-12T00:27:48.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.432+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=6SXQ00VYDB53 tag=5NLED6FPLTGY type=write size=1389574 2024-09-12T00:27:48.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.436+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~9HC2TASDHX16.0 size=480549 2024-09-12T00:27:48.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.440+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=9HC2TASDHX16 tag=F1MM55ZS08GL type=write size=1529125 2024-09-12T00:27:48.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.448+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~R4G3OXG0YIMW.0 size=1048576 2024-09-12T00:27:48.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.452+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~R4G3OXG0YIMW.1 size=1048576 2024-09-12T00:27:48.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.452+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~R4G3OXG0YIMW.2 size=87405 2024-09-12T00:27:48.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.452+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=R4G3OXG0YIMW tag=3SPPHFHG8DXB type=write size=3233133 2024-09-12T00:27:48.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.456+0000 7f712938c8c0 -1 < no bi entry to suggest for operation key=9751RNPPQJBO tag=Y5BUSA20OLQ6 type=del size=1238243: (2) No such file or directory 2024-09-12T00:27:48.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.460+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=KEHCUIA3Y6K8 type=write size=876053 2024-09-12T00:27:48.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.464+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=04XDE8LL4C7I type=del 2024-09-12T00:27:48.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.468+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~L7NG766RI33C.0 size=1048576 2024-09-12T00:27:48.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.472+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~L7NG766RI33C.1 size=1048576 2024-09-12T00:27:48.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.476+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~L7NG766RI33C.2 size=673824 2024-09-12T00:27:48.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.476+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=L7NG766RI33C tag=ZW4Y165OYVOW type=write size=3819552 2024-09-12T00:27:48.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.480+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=U3Z0B3C3A7A6 type=del 2024-09-12T00:27:48.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.484+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=1UXL38XWWPR3 type=del size=969259 2024-09-12T00:27:48.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.488+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=5CLNMW93YG00 type=del 2024-09-12T00:27:48.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.492+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=JQKQOG3W4S19 type=del size=1653799 2024-09-12T00:27:48.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.496+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=T9BYOMJ6XFOP type=del 2024-09-12T00:27:48.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.504+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~MK55AMXVM68B.0 size=1048576 2024-09-12T00:27:48.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.504+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~MK55AMXVM68B.1 size=1048576 2024-09-12T00:27:48.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.508+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~MK55AMXVM68B.2 size=353554 2024-09-12T00:27:48.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.508+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=MK55AMXVM68B tag=FSSEON64BENR type=write size=3499282 2024-09-12T00:27:48.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.512+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=HYW0045YOSUC type=del 2024-09-12T00:27:48.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.516+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=0MCBECYUYEQW type=del size=2561478 2024-09-12T00:27:48.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.520+0000 7f712938c8c0 1 < canceled operation key=F7T79C7MZX35 tag=SS27F327P2HA type=write size=289539 2024-09-12T00:27:48.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.524+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~CNSU9K8351K8.0 size=1048576 2024-09-12T00:27:48.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.528+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~CNSU9K8351K8.1 size=1048576 2024-09-12T00:27:48.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.532+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~CNSU9K8351K8.2 size=1019838 2024-09-12T00:27:48.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.532+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=CNSU9K8351K8 tag=7NOT6MI2YITK type=write size=4165566 2024-09-12T00:27:48.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.540+0000 7f712938c8c0 1 < suggested remove operation key=W01PFMFNYLED tag=MN514DHO6JVY type=del 2024-09-12T00:27:48.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.544+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~9HPF096Y0P9G.0 size=498361 2024-09-12T00:27:48.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.544+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=9HPF096Y0P9G tag=K8X9FNQ4I4XG type=write size=1546937 2024-09-12T00:27:48.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.548+0000 7f712938c8c0 1 < completed write operation key=0QZKHZTVP3RQ tag=32KITOXRV12Q type=write size=573914 2024-09-12T00:27:48.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.552+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=7HP75DTJ90EN type=del size=2547843 2024-09-12T00:27:48.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.556+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=24QGC59AP0EW type=del 2024-09-12T00:27:48.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.560+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=R6WX7L81E1SB type=del size=2597715 2024-09-12T00:27:48.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.564+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=Y7TK703JDCUQ type=del 2024-09-12T00:27:48.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.568+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=ZHLKJ7NPS60A type=del size=4023586 2024-09-12T00:27:48.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.572+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~HSSYT9SQFQUC.0 size=662635 2024-09-12T00:27:48.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.576+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=HSSYT9SQFQUC tag=L66XN2ZDUZ9U type=write size=1711211 2024-09-12T00:27:48.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.580+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=XKHHOJRHAG76 type=del size=1284760 2024-09-12T00:27:48.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.588+0000 7f712938c8c0 1 < suggested update operation key=L2SR6IAW0D38 tag=SACCE3FFMZWJ type=write size=774997 2024-09-12T00:27:48.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.592+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=HNQPCPKFJJ09 type=del size=3937224 2024-09-12T00:27:48.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.596+0000 7f712938c8c0 1 < canceled part key=_multipart_ULE6S9Y6DS62.2~1EVFKMAWV07F.0 size=376834 2024-09-12T00:27:48.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.600+0000 7f712938c8c0 1 < canceled multipart upload key=ULE6S9Y6DS62 upload=1EVFKMAWV07F tag=W3CVUQ977Y22 type=write size=1425410 2024-09-12T00:27:48.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.604+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=J2XIGCH1VJ7Q type=del size=2535396 2024-09-12T00:27:48.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.608+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~6SXQ00VYDB53.0 size=340998 2024-09-12T00:27:48.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.616+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=6SXQ00VYDB53 tag=5NLED6FPLTGY type=write size=1389574 2024-09-12T00:27:48.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.620+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=SLK31NXKVIQM type=write size=230328 2024-09-12T00:27:48.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.624+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~R4G3OXG0YIMW.0 size=1048576 2024-09-12T00:27:48.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.628+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~R4G3OXG0YIMW.1 size=1048576 2024-09-12T00:27:48.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.632+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~R4G3OXG0YIMW.2 size=87405 2024-09-12T00:27:48.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.636+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=R4G3OXG0YIMW tag=3SPPHFHG8DXB type=write size=3233133 2024-09-12T00:27:48.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.640+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~T9UW7FADHCTQ.0 size=297144 2024-09-12T00:27:48.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.640+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=T9UW7FADHCTQ tag=AIMW0N13D2KT type=write size=1345720 2024-09-12T00:27:48.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.644+0000 7f712938c8c0 1 < completed write operation key=W9YW6AS1RL48 tag=KEHCUIA3Y6K8 type=write size=876053 2024-09-12T00:27:48.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.652+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~1CR79IYF7RWU.0 size=244383 2024-09-12T00:27:48.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.652+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=1CR79IYF7RWU tag=69SAMCE280SZ type=write size=1292959 2024-09-12T00:27:48.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.656+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~L7NG766RI33C.0 size=1048576 2024-09-12T00:27:48.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.660+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~L7NG766RI33C.1 size=1048576 2024-09-12T00:27:48.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.660+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~L7NG766RI33C.2 size=673824 2024-09-12T00:27:48.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.668+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=L7NG766RI33C tag=ZW4Y165OYVOW type=write size=3819552 2024-09-12T00:27:48.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.672+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=H3XJ3H0UBBXD type=del size=2724836 2024-09-12T00:27:48.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.672+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=1UXL38XWWPR3 type=del 2024-09-12T00:27:48.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.676+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=QSI44AA1I02R type=del size=837561 2024-09-12T00:27:48.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.680+0000 7f712938c8c0 -1 < failed to complete operation key=L2SR6IAW0D38 tag=JQKQOG3W4S19 type=del size=1653799: (22) Invalid argument 2024-09-12T00:27:48.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.684+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=ZRDIPDJ39KSW type=del size=618089 2024-09-12T00:27:48.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.688+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~MK55AMXVM68B.0 size=1048576 2024-09-12T00:27:48.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.692+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~MK55AMXVM68B.1 size=1048576 2024-09-12T00:27:48.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.696+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~MK55AMXVM68B.2 size=353554 2024-09-12T00:27:48.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.700+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=MK55AMXVM68B tag=FSSEON64BENR type=write size=3499282 2024-09-12T00:27:48.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.708+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~26E8YFCEJ8QB.0 size=613967 2024-09-12T00:27:48.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.708+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=26E8YFCEJ8QB tag=OA98G9B7JLQK type=write size=1662543 2024-09-12T00:27:48.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.712+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=0MCBECYUYEQW type=del 2024-09-12T00:27:48.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.716+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=MWOS4YJX1DH8 type=del size=3473161 2024-09-12T00:27:48.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.720+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~CNSU9K8351K8.0 size=1048576 2024-09-12T00:27:48.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.720+0000 7f712938c8c0 1 < canceled part key=_multipart_9N3U208FGM79.2~CNSU9K8351K8.1 size=1048576 2024-09-12T00:27:48.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.724+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~CNSU9K8351K8.2 size=1019838 2024-09-12T00:27:48.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.728+0000 7f712938c8c0 1 < canceled multipart upload key=9N3U208FGM79 upload=CNSU9K8351K8 tag=7NOT6MI2YITK type=write size=4165566 2024-09-12T00:27:48.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.732+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=U40RM07VFF4V type=del size=2995850 2024-09-12T00:27:48.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.736+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~9HPF096Y0P9G.0 size=498361 2024-09-12T00:27:48.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.740+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=9HPF096Y0P9G tag=K8X9FNQ4I4XG type=write size=1546937 2024-09-12T00:27:48.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.744+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=Y3EC5NWUTUYG type=del size=1835193 2024-09-12T00:27:48.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.748+0000 7f712938c8c0 -1 < failed to complete operation key=L2SR6IAW0D38 tag=7HP75DTJ90EN type=del size=2547843: (22) Invalid argument 2024-09-12T00:27:48.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.756+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=VINP2WPQ0VOQ type=write size=18650 2024-09-12T00:27:48.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.760+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=R6WX7L81E1SB type=del 2024-09-12T00:27:48.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.764+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~3B527JIJBQH1.0 size=1048576 2024-09-12T00:27:48.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.768+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~3B527JIJBQH1.1 size=1048576 2024-09-12T00:27:48.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.768+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~3B527JIJBQH1.2 size=761623 2024-09-12T00:27:48.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.768+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=3B527JIJBQH1 tag=77G5VR6X78UW type=write size=3907351 2024-09-12T00:27:48.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.772+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=ZHLKJ7NPS60A type=del 2024-09-12T00:27:48.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.776+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=3CM6BFAW4R3Q type=del size=168278 2024-09-12T00:27:48.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.780+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=XKHHOJRHAG76 type=del 2024-09-12T00:27:48.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.788+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~J5RWHY02BYFL.0 size=345640 2024-09-12T00:27:48.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.788+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=J5RWHY02BYFL tag=YT5UBHYR9YZT type=write size=1394216 2024-09-12T00:27:48.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.792+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=HNQPCPKFJJ09 type=del 2024-09-12T00:27:48.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.796+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~J31K3Q6MBSL6.0 size=1048576 2024-09-12T00:27:48.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.800+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~J31K3Q6MBSL6.1 size=1048576 2024-09-12T00:27:48.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.804+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~J31K3Q6MBSL6.2 size=999472 2024-09-12T00:27:48.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.804+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=J31K3Q6MBSL6 tag=T3XZAXFCHKRX type=write size=4145200 2024-09-12T00:27:48.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.808+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=J2XIGCH1VJ7Q type=del 2024-09-12T00:27:48.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.812+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=HA3RV172N4UQ type=del size=4078030 2024-09-12T00:27:48.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.820+0000 7f712938c8c0 1 < suggested update operation key=QG0W04PRTQNP tag=SLK31NXKVIQM type=write size=230328 2024-09-12T00:27:48.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.824+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=PI39BLJIPJSU type=del size=2754462 2024-09-12T00:27:48.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.828+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~T9UW7FADHCTQ.0 size=297144 2024-09-12T00:27:48.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.832+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=T9UW7FADHCTQ tag=AIMW0N13D2KT type=write size=1345720 2024-09-12T00:27:48.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.840+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~O2LSNWEGQLF3.0 size=1048576 2024-09-12T00:27:48.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.844+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~O2LSNWEGQLF3.1 size=1048576 2024-09-12T00:27:48.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.848+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~O2LSNWEGQLF3.2 size=291361 2024-09-12T00:27:48.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.848+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=O2LSNWEGQLF3 tag=JE71PSBVRHT5 type=write size=3437089 2024-09-12T00:27:48.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.852+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~1CR79IYF7RWU.0 size=244383 2024-09-12T00:27:48.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.856+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=1CR79IYF7RWU tag=69SAMCE280SZ type=write size=1292959 2024-09-12T00:27:48.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.860+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=9EHXB8THEIQ8 type=del size=797738 2024-09-12T00:27:48.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.864+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=H3XJ3H0UBBXD type=del 2024-09-12T00:27:48.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.868+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=OOUN1WIPMG8L type=write size=355331 2024-09-12T00:27:48.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.872+0000 7f712938c8c0 1 < canceled operation key=MUNSUH4BMZNP tag=QSI44AA1I02R type=del size=837561 2024-09-12T00:27:48.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.880+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=NJT1ZANEZHYV type=write size=1045356 2024-09-12T00:27:48.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.884+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=ZRDIPDJ39KSW type=del 2024-09-12T00:27:48.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.888+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=SLRMFN007H1A type=del size=4110845 2024-09-12T00:27:48.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.892+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~26E8YFCEJ8QB.0 size=613967 2024-09-12T00:27:48.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.896+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=26E8YFCEJ8QB tag=OA98G9B7JLQK type=write size=1662543 2024-09-12T00:27:48.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.904+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~BPHNU8057PEI.0 size=1048576 2024-09-12T00:27:48.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.908+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~BPHNU8057PEI.1 size=1048576 2024-09-12T00:27:48.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.908+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~BPHNU8057PEI.2 size=903048 2024-09-12T00:27:48.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.908+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=BPHNU8057PEI tag=N7LK5UV0UOY8 type=write size=4048776 2024-09-12T00:27:48.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.916+0000 7f712938c8c0 1 < suggested update operation key=BH2YHXHVEZCH tag=MWOS4YJX1DH8 type=del size=3473161 2024-09-12T00:27:48.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.920+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=H3QTPDJKBTBC type=del size=3096433 2024-09-12T00:27:48.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.924+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=U40RM07VFF4V type=del 2024-09-12T00:27:48.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.928+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=ZCYQTFPNFGT9 type=del size=3381535 2024-09-12T00:27:48.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.932+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=Y3EC5NWUTUYG type=del 2024-09-12T00:27:48.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.936+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=ZE4NOGA95QZ1 type=write size=831087 2024-09-12T00:27:48.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.940+0000 7f712938c8c0 1 < completed write operation key=0QZKHZTVP3RQ tag=VINP2WPQ0VOQ type=write size=18650 2024-09-12T00:27:48.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.948+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~7KPNM3GKUI82.0 size=1048576 2024-09-12T00:27:48.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.952+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~7KPNM3GKUI82.1 size=1048576 2024-09-12T00:27:48.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.956+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~7KPNM3GKUI82.2 size=546401 2024-09-12T00:27:48.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.956+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=7KPNM3GKUI82 tag=N9JPEQOK5FEJ type=write size=3692129 2024-09-12T00:27:48.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.960+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~3B527JIJBQH1.0 size=1048576 2024-09-12T00:27:48.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.964+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~3B527JIJBQH1.1 size=1048576 2024-09-12T00:27:48.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.964+0000 7f712938c8c0 1 < canceled part key=_multipart_T0C4ZDQB13X0.2~3B527JIJBQH1.2 size=761623 2024-09-12T00:27:48.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.968+0000 7f712938c8c0 1 < canceled multipart upload key=T0C4ZDQB13X0 upload=3B527JIJBQH1 tag=77G5VR6X78UW type=write size=3907351 2024-09-12T00:27:48.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.976+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~4LWCOX70P6KM.0 size=435452 2024-09-12T00:27:48.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.976+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=4LWCOX70P6KM tag=677E7GMZDLAD type=write size=1484028 2024-09-12T00:27:48.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.980+0000 7f712938c8c0 1 < canceled operation key=ZP88X00LMVSS tag=3CM6BFAW4R3Q type=del size=168278 2024-09-12T00:27:48.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.984+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~NZLV4VEJOO7Q.0 size=1048576 2024-09-12T00:27:48.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.988+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~NZLV4VEJOO7Q.1 size=1048576 2024-09-12T00:27:48.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.992+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~NZLV4VEJOO7Q.2 size=891705 2024-09-12T00:27:48.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.992+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=NZLV4VEJOO7Q tag=AQBFEUZ2B35J type=write size=4037433 2024-09-12T00:27:48.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:48.996+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~J5RWHY02BYFL.0 size=345640 2024-09-12T00:27:49.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.000+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=J5RWHY02BYFL tag=YT5UBHYR9YZT type=write size=1394216 2024-09-12T00:27:49.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.004+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=OAS05WHXADFC type=del size=2964005 2024-09-12T00:27:49.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.008+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~J31K3Q6MBSL6.0 size=1048576 2024-09-12T00:27:49.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.012+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~J31K3Q6MBSL6.1 size=1048576 2024-09-12T00:27:49.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.012+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~J31K3Q6MBSL6.2 size=999472 2024-09-12T00:27:49.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.020+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=J31K3Q6MBSL6 tag=T3XZAXFCHKRX type=write size=4145200 2024-09-12T00:27:49.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.024+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=QDIMH5H0OA6E type=write size=945185 2024-09-12T00:27:49.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.028+0000 7f712938c8c0 1 < canceled operation key=KEMQ3H8LAUI9 tag=HA3RV172N4UQ type=del size=4078030 2024-09-12T00:27:49.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.032+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~SGRSU8ATA6HX.0 size=521621 2024-09-12T00:27:49.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.032+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=SGRSU8ATA6HX tag=Q8OI2L7Y2P82 type=write size=1570197 2024-09-12T00:27:49.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.036+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=PI39BLJIPJSU type=del 2024-09-12T00:27:49.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.040+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=VRW33ZIV6B0R type=del size=1832245 2024-09-12T00:27:49.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.044+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~O2LSNWEGQLF3.0 size=1048576 2024-09-12T00:27:49.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.048+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~O2LSNWEGQLF3.1 size=1048576 2024-09-12T00:27:49.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.052+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~O2LSNWEGQLF3.2 size=291361 2024-09-12T00:27:49.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.056+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=O2LSNWEGQLF3 tag=JE71PSBVRHT5 type=write size=3437089 2024-09-12T00:27:49.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.064+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~06LMFUAWY6LV.0 size=225949 2024-09-12T00:27:49.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.064+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=06LMFUAWY6LV tag=J10RPF7TPF0Z type=write size=1274525 2024-09-12T00:27:49.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.072+0000 7f712938c8c0 1 < suggested update operation key=5KVIIZS50CNT tag=9EHXB8THEIQ8 type=del size=797738 2024-09-12T00:27:49.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.080+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~MI0HSOJEWO1V.0 size=1048576 2024-09-12T00:27:49.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.080+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~MI0HSOJEWO1V.1 size=622453 2024-09-12T00:27:49.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.080+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=MI0HSOJEWO1V tag=P06EQMPYYT44 type=write size=2719605 2024-09-12T00:27:49.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.084+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=OOUN1WIPMG8L type=write size=355331 2024-09-12T00:27:49.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.092+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~5NZ8DCUM0LJP.0 size=1048576 2024-09-12T00:27:49.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.096+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~5NZ8DCUM0LJP.1 size=1048576 2024-09-12T00:27:49.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.096+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~5NZ8DCUM0LJP.2 size=7321 2024-09-12T00:27:49.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.096+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=5NZ8DCUM0LJP tag=VQYY4CZH9TU0 type=write size=3153049 2024-09-12T00:27:49.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.100+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=NJT1ZANEZHYV type=write size=1045356 2024-09-12T00:27:49.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.104+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=FULJ9GP9H85P type=del size=866679 2024-09-12T00:27:49.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.108+0000 7f712938c8c0 1 < canceled operation key=V9K2307BGOKP tag=SLRMFN007H1A type=del size=4110845 2024-09-12T00:27:49.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.116+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~MP7HBMZJ4GEW.0 size=1048576 2024-09-12T00:27:49.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.120+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~MP7HBMZJ4GEW.1 size=189298 2024-09-12T00:27:49.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.120+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=MP7HBMZJ4GEW tag=STV200WPFSJK type=write size=2286450 2024-09-12T00:27:49.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.124+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~BPHNU8057PEI.0 size=1048576 2024-09-12T00:27:49.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.124+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~BPHNU8057PEI.1 size=1048576 2024-09-12T00:27:49.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.128+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~BPHNU8057PEI.2 size=903048 2024-09-12T00:27:49.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.132+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=BPHNU8057PEI tag=N7LK5UV0UOY8 type=write size=4048776 2024-09-12T00:27:49.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.136+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=5CK7QNDJDMTN type=write size=283208 2024-09-12T00:27:49.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.140+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=H3QTPDJKBTBC type=del 2024-09-12T00:27:49.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.144+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=T93QH2S12SOD type=del size=4135754 2024-09-12T00:27:49.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.148+0000 7f712938c8c0 1 < canceled operation key=N69XPNN6Y6HZ tag=ZCYQTFPNFGT9 type=del size=3381535 2024-09-12T00:27:49.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.156+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~MAXK9O8L9PVV.0 size=1048576 2024-09-12T00:27:49.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.160+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~MAXK9O8L9PVV.1 size=1048576 2024-09-12T00:27:49.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.160+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~MAXK9O8L9PVV.2 size=466820 2024-09-12T00:27:49.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.160+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=MAXK9O8L9PVV tag=SKZIKWN6T5Y7 type=write size=3612548 2024-09-12T00:27:49.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.164+0000 7f712938c8c0 1 < completed write operation key=Z2RYL03II71Z tag=ZE4NOGA95QZ1 type=write size=831087 2024-09-12T00:27:49.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.168+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=ARW9RGU7O1PT type=del size=2498986 2024-09-12T00:27:49.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.172+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~7KPNM3GKUI82.0 size=1048576 2024-09-12T00:27:49.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.176+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~7KPNM3GKUI82.1 size=1048576 2024-09-12T00:27:49.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.180+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~7KPNM3GKUI82.2 size=546401 2024-09-12T00:27:49.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.188+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=7KPNM3GKUI82 tag=N9JPEQOK5FEJ type=write size=3692129 2024-09-12T00:27:49.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.192+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=8684VDI5G5GJ type=del size=3573440 2024-09-12T00:27:49.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.196+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~4LWCOX70P6KM.0 size=435452 2024-09-12T00:27:49.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.200+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=4LWCOX70P6KM tag=677E7GMZDLAD type=write size=1484028 2024-09-12T00:27:49.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.204+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=T64UW4413GJP type=write size=650833 2024-09-12T00:27:49.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.208+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~NZLV4VEJOO7Q.0 size=1048576 2024-09-12T00:27:49.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.212+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~NZLV4VEJOO7Q.1 size=1048576 2024-09-12T00:27:49.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.216+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~NZLV4VEJOO7Q.2 size=891705 2024-09-12T00:27:49.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.220+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=NZLV4VEJOO7Q tag=AQBFEUZ2B35J type=write size=4037433 2024-09-12T00:27:49.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.228+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~1LCXOLVAAWPL.0 size=1048576 2024-09-12T00:27:49.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.232+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~1LCXOLVAAWPL.1 size=396842 2024-09-12T00:27:49.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.232+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=1LCXOLVAAWPL tag=RXO2RI5DWK0E type=write size=2493994 2024-09-12T00:27:49.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.240+0000 7f712938c8c0 1 < suggested update operation key=KNGB14TWW6XC tag=OAS05WHXADFC type=del size=2964005 2024-09-12T00:27:49.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.244+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=T2VFPB6VXNFG type=del size=368652 2024-09-12T00:27:49.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.248+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=QDIMH5H0OA6E type=write size=945185 2024-09-12T00:27:49.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.252+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~4X80D660N6WE.0 size=1048576 2024-09-12T00:27:49.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.256+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~4X80D660N6WE.1 size=1048576 2024-09-12T00:27:49.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.260+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~4X80D660N6WE.2 size=860888 2024-09-12T00:27:49.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.260+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=4X80D660N6WE tag=YMSI7NYCBI65 type=write size=4006616 2024-09-12T00:27:49.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.264+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~SGRSU8ATA6HX.0 size=521621 2024-09-12T00:27:49.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.272+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=SGRSU8ATA6HX tag=Q8OI2L7Y2P82 type=write size=1570197 2024-09-12T00:27:49.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.280+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~EORWI2F43P0Y.0 size=1048576 2024-09-12T00:27:49.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.280+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~EORWI2F43P0Y.1 size=1048576 2024-09-12T00:27:49.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.288+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~EORWI2F43P0Y.2 size=651199 2024-09-12T00:27:49.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.288+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=EORWI2F43P0Y tag=C8ZYH88HBXW1 type=write size=3796927 2024-09-12T00:27:49.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.296+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=VRW33ZIV6B0R type=del 2024-09-12T00:27:49.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.304+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~7JHGG1D5G7WS.0 size=1048576 2024-09-12T00:27:49.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.304+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~7JHGG1D5G7WS.1 size=938467 2024-09-12T00:27:49.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.304+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=7JHGG1D5G7WS tag=50TK9DVUUZKH type=write size=3035619 2024-09-12T00:27:49.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.312+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~06LMFUAWY6LV.0 size=225949 2024-09-12T00:27:49.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.316+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=06LMFUAWY6LV tag=J10RPF7TPF0Z type=write size=1274525 2024-09-12T00:27:49.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.324+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~QFB844L7RPA9.0 size=580707 2024-09-12T00:27:49.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.324+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=QFB844L7RPA9 tag=7FQ1E74RHZ57 type=write size=1629283 2024-09-12T00:27:49.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.328+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~MI0HSOJEWO1V.0 size=1048576 2024-09-12T00:27:49.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.328+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~MI0HSOJEWO1V.1 size=622453 2024-09-12T00:27:49.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.336+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=MI0HSOJEWO1V tag=P06EQMPYYT44 type=write size=2719605 2024-09-12T00:27:49.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.340+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=NUDBUDREBJT6 type=del size=1167430 2024-09-12T00:27:49.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.344+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~5NZ8DCUM0LJP.0 size=1048576 2024-09-12T00:27:49.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.348+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~5NZ8DCUM0LJP.1 size=1048576 2024-09-12T00:27:49.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.348+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~5NZ8DCUM0LJP.2 size=7321 2024-09-12T00:27:49.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.356+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=5NZ8DCUM0LJP tag=VQYY4CZH9TU0 type=write size=3153049 2024-09-12T00:27:49.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.360+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=PUHUWLL7DD6L type=write size=848646 2024-09-12T00:27:49.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.364+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=FULJ9GP9H85P type=del 2024-09-12T00:27:49.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.368+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=YRBRHVJU2KHO type=del size=2117073 2024-09-12T00:27:49.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.372+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~MP7HBMZJ4GEW.0 size=1048576 2024-09-12T00:27:49.376 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.376+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~MP7HBMZJ4GEW.1 size=189298 2024-09-12T00:27:49.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.384+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=MP7HBMZJ4GEW tag=STV200WPFSJK type=write size=2286450 2024-09-12T00:27:49.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.392+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~AUAWCXFW0N3O.0 size=1048576 2024-09-12T00:27:49.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.392+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~AUAWCXFW0N3O.1 size=1048576 2024-09-12T00:27:49.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.396+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~AUAWCXFW0N3O.2 size=461588 2024-09-12T00:27:49.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.396+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=AUAWCXFW0N3O tag=CJHPPLI2V4GR type=write size=3607316 2024-09-12T00:27:49.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.400+0000 7f712938c8c0 1 < completed write operation key=F7T79C7MZX35 tag=5CK7QNDJDMTN type=write size=283208 2024-09-12T00:27:49.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.404+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=WN0YG30LZ541 type=del size=1333113 2024-09-12T00:27:49.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.408+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=T93QH2S12SOD type=del 2024-09-12T00:27:49.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.416+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~63QFXPRDWXU3.0 size=713318 2024-09-12T00:27:49.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.416+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=63QFXPRDWXU3 tag=L2EGU6TLT9JL type=write size=1761894 2024-09-12T00:27:49.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.420+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~MAXK9O8L9PVV.0 size=1048576 2024-09-12T00:27:49.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.424+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~MAXK9O8L9PVV.1 size=1048576 2024-09-12T00:27:49.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.424+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~MAXK9O8L9PVV.2 size=466820 2024-09-12T00:27:49.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.432+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=MAXK9O8L9PVV tag=SKZIKWN6T5Y7 type=write size=3612548 2024-09-12T00:27:49.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.436+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=G4LZ17EKONG3 type=write size=55527 2024-09-12T00:27:49.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.440+0000 7f712938c8c0 1 < canceled operation key=F7T79C7MZX35 tag=ARW9RGU7O1PT type=del size=2498986 2024-09-12T00:27:49.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.444+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=1ZIEGGMOCYJO type=del size=3038198 2024-09-12T00:27:49.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.448+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=8684VDI5G5GJ type=del 2024-09-12T00:27:49.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.452+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=69XGDG78R5HR type=del size=2771105 2024-09-12T00:27:49.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.456+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=T64UW4413GJP type=write size=650833 2024-09-12T00:27:49.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.460+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=KDAV1KRP7BGK type=del size=3918010 2024-09-12T00:27:49.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.464+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~1LCXOLVAAWPL.0 size=1048576 2024-09-12T00:27:49.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.468+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~1LCXOLVAAWPL.1 size=396842 2024-09-12T00:27:49.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.476+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=1LCXOLVAAWPL tag=RXO2RI5DWK0E type=write size=2493994 2024-09-12T00:27:49.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.484+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~873QKAO268XX.0 size=1048576 2024-09-12T00:27:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.484+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~873QKAO268XX.1 size=806988 2024-09-12T00:27:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.484+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=873QKAO268XX tag=M7DH7VGGK9A4 type=write size=2904140 2024-09-12T00:27:49.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.488+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=T2VFPB6VXNFG type=del 2024-09-12T00:27:49.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.492+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=AS53CJLWKZ2Q type=del size=1267291 2024-09-12T00:27:49.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.496+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~4X80D660N6WE.0 size=1048576 2024-09-12T00:27:49.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.496+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~4X80D660N6WE.1 size=1048576 2024-09-12T00:27:49.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.496+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~4X80D660N6WE.2 size=860888 2024-09-12T00:27:49.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.504+0000 7f712938c8c0 1 < canceled multipart upload key=9751RNPPQJBO upload=4X80D660N6WE tag=YMSI7NYCBI65 type=write size=4006616 2024-09-12T00:27:49.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.508+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=8W85J2DDCNMF type=write size=797756 2024-09-12T00:27:49.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.512+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~EORWI2F43P0Y.0 size=1048576 2024-09-12T00:27:49.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.512+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~EORWI2F43P0Y.1 size=1048576 2024-09-12T00:27:49.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.516+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~EORWI2F43P0Y.2 size=651199 2024-09-12T00:27:49.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.520+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=EORWI2F43P0Y tag=C8ZYH88HBXW1 type=write size=3796927 2024-09-12T00:27:49.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.524+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=WLADPFYUE73J type=del size=752343 2024-09-12T00:27:49.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.528+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~7JHGG1D5G7WS.0 size=1048576 2024-09-12T00:27:49.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.532+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~7JHGG1D5G7WS.1 size=938467 2024-09-12T00:27:49.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.540+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=7JHGG1D5G7WS tag=50TK9DVUUZKH type=write size=3035619 2024-09-12T00:27:49.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.548+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~GG3TMXYWVNR0.0 size=945697 2024-09-12T00:27:49.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.548+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=GG3TMXYWVNR0 tag=03LWMSBZXZXV type=write size=1994273 2024-09-12T00:27:49.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.552+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~QFB844L7RPA9.0 size=580707 2024-09-12T00:27:49.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.556+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=QFB844L7RPA9 tag=7FQ1E74RHZ57 type=write size=1629283 2024-09-12T00:27:49.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.564+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~FR3CVPF2238R.0 size=1048576 2024-09-12T00:27:49.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.568+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~FR3CVPF2238R.1 size=253288 2024-09-12T00:27:49.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.568+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=FR3CVPF2238R tag=IJZCD75YBWPP type=write size=2350440 2024-09-12T00:27:49.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.572+0000 7f712938c8c0 1 < canceled operation key=F7T79C7MZX35 tag=NUDBUDREBJT6 type=del size=1167430 2024-09-12T00:27:49.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.576+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=XORAJCRHLMOM type=del size=1399746 2024-09-12T00:27:49.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.580+0000 7f712938c8c0 1 < completed write operation key=A8L061CQ0M0J tag=PUHUWLL7DD6L type=write size=848646 2024-09-12T00:27:49.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.580+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=RFAXBN3U7FF3 type=del size=3236419 2024-09-12T00:27:49.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.584+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=YRBRHVJU2KHO type=del 2024-09-12T00:27:49.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.592+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~KW6CYCGSJOWD.0 size=1048576 2024-09-12T00:27:49.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.596+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~KW6CYCGSJOWD.1 size=1048576 2024-09-12T00:27:49.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.600+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~KW6CYCGSJOWD.2 size=259868 2024-09-12T00:27:49.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.600+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=KW6CYCGSJOWD tag=CQN91KANUE9B type=write size=3405596 2024-09-12T00:27:49.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.604+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~AUAWCXFW0N3O.0 size=1048576 2024-09-12T00:27:49.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.604+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~AUAWCXFW0N3O.1 size=1048576 2024-09-12T00:27:49.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.608+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~AUAWCXFW0N3O.2 size=461588 2024-09-12T00:27:49.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.612+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=AUAWCXFW0N3O tag=CJHPPLI2V4GR type=write size=3607316 2024-09-12T00:27:49.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.616+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=CDS5KJHJ9CBF type=write size=581209 2024-09-12T00:27:49.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.620+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=WN0YG30LZ541 type=del 2024-09-12T00:27:49.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.624+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=18BZN7S838F1 type=del size=1924871 2024-09-12T00:27:49.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.624+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~63QFXPRDWXU3.0 size=713318 2024-09-12T00:27:49.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.632+0000 7f712938c8c0 1 < canceled multipart upload key=9751RNPPQJBO upload=63QFXPRDWXU3 tag=L2EGU6TLT9JL type=write size=1761894 2024-09-12T00:27:49.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.640+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~J0F6CQWC2YPD.0 size=1048576 2024-09-12T00:27:49.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.644+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~J0F6CQWC2YPD.1 size=89506 2024-09-12T00:27:49.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.644+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=J0F6CQWC2YPD tag=W3YUSK0T8TUK type=write size=2186658 2024-09-12T00:27:49.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.648+0000 7f712938c8c0 1 < canceled operation key=F7T79C7MZX35 tag=G4LZ17EKONG3 type=write size=55527 2024-09-12T00:27:49.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.652+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=1ULSBL3HGTA8 type=del size=294593 2024-09-12T00:27:49.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.660+0000 7f712938c8c0 1 < suggested update operation key=0QZKHZTVP3RQ tag=1ZIEGGMOCYJO type=del size=3038198 2024-09-12T00:27:49.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.664+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~OG1UQ3EAQ4I1.0 size=1048576 2024-09-12T00:27:49.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.668+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~OG1UQ3EAQ4I1.1 size=1048576 2024-09-12T00:27:49.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.672+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~OG1UQ3EAQ4I1.2 size=232466 2024-09-12T00:27:49.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.672+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=OG1UQ3EAQ4I1 tag=EF3AA6LNGSRG type=write size=3378194 2024-09-12T00:27:49.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.676+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=69XGDG78R5HR type=del 2024-09-12T00:27:49.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.680+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~EXUND1CE5F0N.0 size=475575 2024-09-12T00:27:49.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.680+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=EXUND1CE5F0N tag=OBK67GFW3R1V type=write size=1524151 2024-09-12T00:27:49.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.684+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=KDAV1KRP7BGK type=del 2024-09-12T00:27:49.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.688+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=70GC5BQM6S63 type=write size=180068 2024-09-12T00:27:49.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.692+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~873QKAO268XX.0 size=1048576 2024-09-12T00:27:49.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.696+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~873QKAO268XX.1 size=806988 2024-09-12T00:27:49.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.700+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=873QKAO268XX tag=M7DH7VGGK9A4 type=write size=2904140 2024-09-12T00:27:49.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.704+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=7TAJ5QKM2M1Z type=del size=3573728 2024-09-12T00:27:49.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.708+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=AS53CJLWKZ2Q type=del 2024-09-12T00:27:49.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.716+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~LUX5I68SVQIE.0 size=1048576 2024-09-12T00:27:49.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.720+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~LUX5I68SVQIE.1 size=1048576 2024-09-12T00:27:49.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.724+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~LUX5I68SVQIE.2 size=690900 2024-09-12T00:27:49.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.724+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=LUX5I68SVQIE tag=6Q4TK92B1YHF type=write size=3836628 2024-09-12T00:27:49.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.728+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=8W85J2DDCNMF type=write size=797756 2024-09-12T00:27:49.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.736+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~P2CVQBQA03RP.0 size=1048576 2024-09-12T00:27:49.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.736+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~P2CVQBQA03RP.1 size=1048576 2024-09-12T00:27:49.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.740+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~P2CVQBQA03RP.2 size=908884 2024-09-12T00:27:49.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.740+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=P2CVQBQA03RP tag=YH4AEH50R32J type=write size=4054612 2024-09-12T00:27:49.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.744+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=WLADPFYUE73J type=del 2024-09-12T00:27:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.748+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=6CYSF27JPOV3 type=write size=261906 2024-09-12T00:27:49.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.752+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~GG3TMXYWVNR0.0 size=945697 2024-09-12T00:27:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.756+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=GG3TMXYWVNR0 tag=03LWMSBZXZXV type=write size=1994273 2024-09-12T00:27:49.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.760+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=AOMH2PF9HOVJ type=del size=3931508 2024-09-12T00:27:49.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.764+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~FR3CVPF2238R.0 size=1048576 2024-09-12T00:27:49.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.768+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~FR3CVPF2238R.1 size=253288 2024-09-12T00:27:49.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.776+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=FR3CVPF2238R tag=IJZCD75YBWPP type=write size=2350440 2024-09-12T00:27:49.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.780+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=5ESD602JL37L type=del size=1575670 2024-09-12T00:27:49.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.784+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=XORAJCRHLMOM type=del 2024-09-12T00:27:49.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.788+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~6ICL661550BD.0 size=1048576 2024-09-12T00:27:49.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.792+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~6ICL661550BD.1 size=665141 2024-09-12T00:27:49.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.792+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=6ICL661550BD tag=1AL8PHB1TDEP type=write size=2762293 2024-09-12T00:27:49.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.800+0000 7f712938c8c0 1 < suggested update operation key=HPM9GFRASWIV tag=RFAXBN3U7FF3 type=del size=3236419 2024-09-12T00:27:49.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.808+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~65WQ3TWWH0YX.0 size=1048576 2024-09-12T00:27:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.808+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~65WQ3TWWH0YX.1 size=732948 2024-09-12T00:27:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.808+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=65WQ3TWWH0YX tag=VKY7LOHH4QQB type=write size=2830100 2024-09-12T00:27:49.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.812+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~KW6CYCGSJOWD.0 size=1048576 2024-09-12T00:27:49.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.812+0000 7f712938c8c0 1 < canceled part key=_multipart_T0C4ZDQB13X0.2~KW6CYCGSJOWD.1 size=1048576 2024-09-12T00:27:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.816+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~KW6CYCGSJOWD.2 size=259868 2024-09-12T00:27:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.824+0000 7f712938c8c0 1 < canceled multipart upload key=T0C4ZDQB13X0 upload=KW6CYCGSJOWD tag=CQN91KANUE9B type=write size=3405596 2024-09-12T00:27:49.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.828+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=033DICUKI0CV type=del size=1123274 2024-09-12T00:27:49.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.836+0000 7f712938c8c0 1 < suggested remove operation key=MUNSUH4BMZNP tag=CDS5KJHJ9CBF type=write 2024-09-12T00:27:49.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.844+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~3UNV6KSWOZK7.0 size=1048576 2024-09-12T00:27:49.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.844+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~3UNV6KSWOZK7.1 size=1048576 2024-09-12T00:27:49.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.848+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~3UNV6KSWOZK7.2 size=104669 2024-09-12T00:27:49.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.848+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=3UNV6KSWOZK7 tag=BHH1NVBQVDY1 type=write size=3250397 2024-09-12T00:27:49.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.856+0000 7f712938c8c0 1 < suggested remove operation key=0QZKHZTVP3RQ tag=18BZN7S838F1 type=del 2024-09-12T00:27:49.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.864+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~8PPAO3KDII9Q.0 size=1048576 2024-09-12T00:27:49.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.864+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~8PPAO3KDII9Q.1 size=1048576 2024-09-12T00:27:49.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.868+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~8PPAO3KDII9Q.2 size=790045 2024-09-12T00:27:49.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.868+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=8PPAO3KDII9Q tag=QB3ZK22CFM9W type=write size=3935773 2024-09-12T00:27:49.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.872+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~J0F6CQWC2YPD.0 size=1048576 2024-09-12T00:27:49.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.876+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~J0F6CQWC2YPD.1 size=89506 2024-09-12T00:27:49.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.880+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=J0F6CQWC2YPD tag=W3YUSK0T8TUK type=write size=2186658 2024-09-12T00:27:49.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.884+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=SCRCPU4UR0TU type=del size=2319333 2024-09-12T00:27:49.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.888+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=1ULSBL3HGTA8 type=del 2024-09-12T00:27:49.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.896+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~F32P325HZLCZ.0 size=1048576 2024-09-12T00:27:49.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.900+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~F32P325HZLCZ.1 size=225613 2024-09-12T00:27:49.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.900+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=F32P325HZLCZ tag=N5ASZ46NL945 type=write size=2322765 2024-09-12T00:27:49.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.904+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~OG1UQ3EAQ4I1.0 size=1048576 2024-09-12T00:27:49.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.908+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~OG1UQ3EAQ4I1.1 size=1048576 2024-09-12T00:27:49.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.912+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~OG1UQ3EAQ4I1.2 size=232466 2024-09-12T00:27:49.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.916+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=OG1UQ3EAQ4I1 tag=EF3AA6LNGSRG type=write size=3378194 2024-09-12T00:27:49.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.924+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~D23MJDY47J6P.0 size=305830 2024-09-12T00:27:49.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.924+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=D23MJDY47J6P tag=YVFMG6WE0YFX type=write size=1354406 2024-09-12T00:27:49.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.928+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~EXUND1CE5F0N.0 size=475575 2024-09-12T00:27:49.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.932+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=EXUND1CE5F0N tag=OBK67GFW3R1V type=write size=1524151 2024-09-12T00:27:49.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.936+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=V3YXZKWF64QO type=write size=758873 2024-09-12T00:27:49.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.940+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=70GC5BQM6S63 type=write size=180068 2024-09-12T00:27:49.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.944+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=OA04IFOPJ3N6 type=del size=150649 2024-09-12T00:27:49.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.948+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=7TAJ5QKM2M1Z type=del 2024-09-12T00:27:49.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.952+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=SY1XMXT2XZYJ type=write size=734942 2024-09-12T00:27:49.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.960+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~LUX5I68SVQIE.0 size=1048576 2024-09-12T00:27:49.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.960+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~LUX5I68SVQIE.1 size=1048576 2024-09-12T00:27:49.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.964+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~LUX5I68SVQIE.2 size=690900 2024-09-12T00:27:49.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.968+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=LUX5I68SVQIE tag=6Q4TK92B1YHF type=write size=3836628 2024-09-12T00:27:49.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.976+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~IT91C70BLCWT.0 size=1048576 2024-09-12T00:27:49.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.980+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~IT91C70BLCWT.1 size=1048576 2024-09-12T00:27:49.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.984+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~IT91C70BLCWT.2 size=309495 2024-09-12T00:27:49.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.984+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=IT91C70BLCWT tag=WV37JW87OO1R type=write size=3455223 2024-09-12T00:27:49.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.988+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~P2CVQBQA03RP.0 size=1048576 2024-09-12T00:27:49.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.996+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~P2CVQBQA03RP.1 size=1048576 2024-09-12T00:27:49.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:49.996+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~P2CVQBQA03RP.2 size=908884 2024-09-12T00:27:50.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.004+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=P2CVQBQA03RP tag=YH4AEH50R32J type=write size=4054612 2024-09-12T00:27:50.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.012+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~KPFXP95JDE3I.0 size=462990 2024-09-12T00:27:50.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.012+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=KPFXP95JDE3I tag=4K27QSTSLLTU type=write size=1511566 2024-09-12T00:27:50.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.020+0000 7f712938c8c0 1 < suggested update operation key=HPM9GFRASWIV tag=6CYSF27JPOV3 type=write size=261906 2024-09-12T00:27:50.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.024+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~FH0KMNLEGV1R.0 size=1048576 2024-09-12T00:27:50.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.028+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~FH0KMNLEGV1R.1 size=688124 2024-09-12T00:27:50.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.028+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=FH0KMNLEGV1R tag=KD73AT5SMCAQ type=write size=2785276 2024-09-12T00:27:50.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.032+0000 7f712938c8c0 1 < canceled operation key=5KVIIZS50CNT tag=AOMH2PF9HOVJ type=del size=3931508 2024-09-12T00:27:50.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.040+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~BFHQ6TRX2C8W.0 size=1048576 2024-09-12T00:27:50.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.044+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~BFHQ6TRX2C8W.1 size=1048576 2024-09-12T00:27:50.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.044+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~BFHQ6TRX2C8W.2 size=38027 2024-09-12T00:27:50.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.044+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=BFHQ6TRX2C8W tag=4YHAHM1HOGL0 type=write size=3183755 2024-09-12T00:27:50.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.048+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=5ESD602JL37L type=del 2024-09-12T00:27:50.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.052+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=L3GO0PJJMLAQ type=del size=3558998 2024-09-12T00:27:50.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.060+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~6ICL661550BD.0 size=1048576 2024-09-12T00:27:50.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.060+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~6ICL661550BD.1 size=665141 2024-09-12T00:27:50.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.068+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=6ICL661550BD tag=1AL8PHB1TDEP type=write size=2762293 2024-09-12T00:27:50.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.072+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=2RISVBRMNMJ1 type=write size=866747 2024-09-12T00:27:50.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.076+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~65WQ3TWWH0YX.0 size=1048576 2024-09-12T00:27:50.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.080+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~65WQ3TWWH0YX.1 size=732948 2024-09-12T00:27:50.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.084+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=65WQ3TWWH0YX tag=VKY7LOHH4QQB type=write size=2830100 2024-09-12T00:27:50.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.088+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=120V9CKCY61T type=del size=3948661 2024-09-12T00:27:50.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.092+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=033DICUKI0CV type=del 2024-09-12T00:27:50.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.100+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=CL64NG98Z5UU type=del size=1293826 2024-09-12T00:27:50.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.104+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~3UNV6KSWOZK7.0 size=1048576 2024-09-12T00:27:50.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.108+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~3UNV6KSWOZK7.1 size=1048576 2024-09-12T00:27:50.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.108+0000 7f712938c8c0 1 < canceled part key=_multipart_9YZP0TIRWWRF.2~3UNV6KSWOZK7.2 size=104669 2024-09-12T00:27:50.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.116+0000 7f712938c8c0 1 < canceled multipart upload key=9YZP0TIRWWRF upload=3UNV6KSWOZK7 tag=BHH1NVBQVDY1 type=write size=3250397 2024-09-12T00:27:50.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.120+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=XUI82OTIBU3Q type=del size=916608 2024-09-12T00:27:50.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.124+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~8PPAO3KDII9Q.0 size=1048576 2024-09-12T00:27:50.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.128+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~8PPAO3KDII9Q.1 size=1048576 2024-09-12T00:27:50.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.128+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~8PPAO3KDII9Q.2 size=790045 2024-09-12T00:27:50.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.136+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=8PPAO3KDII9Q tag=QB3ZK22CFM9W type=write size=3935773 2024-09-12T00:27:50.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.140+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=962DPWHAV82Q type=del size=3469478 2024-09-12T00:27:50.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.144+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=SCRCPU4UR0TU type=del 2024-09-12T00:27:50.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.148+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=BRZ50VC1PCY0 type=del size=2189305 2024-09-12T00:27:50.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.152+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~F32P325HZLCZ.0 size=1048576 2024-09-12T00:27:50.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.156+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~F32P325HZLCZ.1 size=225613 2024-09-12T00:27:50.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.160+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=F32P325HZLCZ tag=N5ASZ46NL945 type=write size=2322765 2024-09-12T00:27:50.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.164+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=W3JYH1NCTDS7 type=del size=608112 2024-09-12T00:27:50.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.168+0000 7f712938c8c0 1 < canceled part key=_multipart_L2SR6IAW0D38.2~D23MJDY47J6P.0 size=305830 2024-09-12T00:27:50.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.172+0000 7f712938c8c0 1 < canceled multipart upload key=L2SR6IAW0D38 upload=D23MJDY47J6P tag=YVFMG6WE0YFX type=write size=1354406 2024-09-12T00:27:50.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.180+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~OIKPP5W3RSYB.0 size=1048576 2024-09-12T00:27:50.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.184+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~OIKPP5W3RSYB.1 size=71044 2024-09-12T00:27:50.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.184+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=OIKPP5W3RSYB tag=0F20DACON9FJ type=write size=2168196 2024-09-12T00:27:50.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.192+0000 7f712938c8c0 1 < suggested remove operation key=ULE6S9Y6DS62 tag=V3YXZKWF64QO type=write 2024-09-12T00:27:50.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.196+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=5SZAPVO2NBKB type=del size=2258113 2024-09-12T00:27:50.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.200+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=OA04IFOPJ3N6 type=del 2024-09-12T00:27:50.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.204+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~JG2P3IDLDO5N.0 size=1048576 2024-09-12T00:27:50.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.208+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~JG2P3IDLDO5N.1 size=1048576 2024-09-12T00:27:50.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.212+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~JG2P3IDLDO5N.2 size=645420 2024-09-12T00:27:50.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.212+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=JG2P3IDLDO5N tag=NK14IIE2B0TN type=write size=3791148 2024-09-12T00:27:50.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.216+0000 7f712938c8c0 1 < completed write operation key=W9YW6AS1RL48 tag=SY1XMXT2XZYJ type=write size=734942 2024-09-12T00:27:50.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.224+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~4I6PRIB234G0.0 size=1048576 2024-09-12T00:27:50.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.224+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~4I6PRIB234G0.1 size=1048576 2024-09-12T00:27:50.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.228+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~4I6PRIB234G0.2 size=1007504 2024-09-12T00:27:50.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.228+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=4I6PRIB234G0 tag=BCH3GQ9LUG3H type=write size=4153232 2024-09-12T00:27:50.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.232+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~IT91C70BLCWT.0 size=1048576 2024-09-12T00:27:50.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.236+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~IT91C70BLCWT.1 size=1048576 2024-09-12T00:27:50.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.240+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~IT91C70BLCWT.2 size=309495 2024-09-12T00:27:50.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.244+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=IT91C70BLCWT tag=WV37JW87OO1R type=write size=3455223 2024-09-12T00:27:50.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.248+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=5N85W8VT8PXU type=write size=715403 2024-09-12T00:27:50.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.248+0000 7f712938c8c0 1 < canceled part key=_multipart_N69XPNN6Y6HZ.2~KPFXP95JDE3I.0 size=462990 2024-09-12T00:27:50.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.256+0000 7f712938c8c0 1 < canceled multipart upload key=N69XPNN6Y6HZ upload=KPFXP95JDE3I tag=4K27QSTSLLTU type=write size=1511566 2024-09-12T00:27:50.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.260+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=UIOKD0PQGIPU type=del size=3571468 2024-09-12T00:27:50.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.264+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~FH0KMNLEGV1R.0 size=1048576 2024-09-12T00:27:50.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.264+0000 7f712938c8c0 1 < canceled part key=_multipart_MUNSUH4BMZNP.2~FH0KMNLEGV1R.1 size=688124 2024-09-12T00:27:50.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.268+0000 7f712938c8c0 1 < canceled multipart upload key=MUNSUH4BMZNP upload=FH0KMNLEGV1R tag=KD73AT5SMCAQ type=write size=2785276 2024-09-12T00:27:50.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.272+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=HFM7EIV56GVM type=del size=2623856 2024-09-12T00:27:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.276+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~BFHQ6TRX2C8W.0 size=1048576 2024-09-12T00:27:50.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.280+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~BFHQ6TRX2C8W.1 size=1048576 2024-09-12T00:27:50.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.284+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~BFHQ6TRX2C8W.2 size=38027 2024-09-12T00:27:50.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.288+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=BFHQ6TRX2C8W tag=4YHAHM1HOGL0 type=write size=3183755 2024-09-12T00:27:50.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.292+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=CQX2IPSGG0G4 type=del size=2829509 2024-09-12T00:27:50.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.296+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=L3GO0PJJMLAQ type=del 2024-09-12T00:27:50.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.300+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=KG5LY9BAB2NQ type=del size=2801563 2024-09-12T00:27:50.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.308+0000 7f712938c8c0 1 < suggested remove operation key=F7T79C7MZX35 tag=2RISVBRMNMJ1 type=write 2024-09-12T00:27:50.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.312+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=2FVXKFO5RK1K type=del size=689166 2024-09-12T00:27:50.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.320+0000 7f712938c8c0 1 < suggested update operation key=GZON46MODQZO tag=120V9CKCY61T type=del size=3948661 2024-09-12T00:27:50.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.320+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=SIEF8F4OAH1K type=del size=3746204 2024-09-12T00:27:50.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.324+0000 7f712938c8c0 1 < canceled operation key=9HX9GER6OKVI tag=CL64NG98Z5UU type=del size=1293826 2024-09-12T00:27:50.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.332+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~O830FS4G60AY.0 size=1048576 2024-09-12T00:27:50.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.336+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~O830FS4G60AY.1 size=889339 2024-09-12T00:27:50.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.336+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=O830FS4G60AY tag=3PGYFR7AE8A1 type=write size=2986491 2024-09-12T00:27:50.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.340+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=XUI82OTIBU3Q type=del 2024-09-12T00:27:50.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.344+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=E1CSE573K6XC type=write size=4601 2024-09-12T00:27:50.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.348+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=962DPWHAV82Q type=del 2024-09-12T00:27:50.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.356+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=NA2Q76QQNW3T type=write size=857238 2024-09-12T00:27:50.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.360+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=BRZ50VC1PCY0 type=del 2024-09-12T00:27:50.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.364+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=QTCS8ZNDF2PV type=del size=1852405 2024-09-12T00:27:50.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.368+0000 7f712938c8c0 1 < suggested remove operation key=HPM9GFRASWIV tag=W3JYH1NCTDS7 type=del 2024-09-12T00:27:50.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.376+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~LFSPJMZY0S07.0 size=879787 2024-09-12T00:27:50.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.376+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=LFSPJMZY0S07 tag=TBXASEM1ZKCY type=write size=1928363 2024-09-12T00:27:50.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.376+0000 7f712938c8c0 1 < canceled part key=_multipart_5KVIIZS50CNT.2~OIKPP5W3RSYB.0 size=1048576 2024-09-12T00:27:50.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.380+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~OIKPP5W3RSYB.1 size=71044 2024-09-12T00:27:50.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.388+0000 7f712938c8c0 1 < canceled multipart upload key=5KVIIZS50CNT upload=OIKPP5W3RSYB tag=0F20DACON9FJ type=write size=2168196 2024-09-12T00:27:50.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.392+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~J09G900I5X2E.0 size=1048576 2024-09-12T00:27:50.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.396+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~J09G900I5X2E.1 size=1048576 2024-09-12T00:27:50.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.400+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~J09G900I5X2E.2 size=461745 2024-09-12T00:27:50.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.400+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=J09G900I5X2E tag=T3UB0MQLWPVU type=write size=3607473 2024-09-12T00:27:50.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.408+0000 7f712938c8c0 1 < suggested remove operation key=W01PFMFNYLED tag=5SZAPVO2NBKB type=del 2024-09-12T00:27:50.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.412+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~A0WIFJ1Q4E7W.0 size=992031 2024-09-12T00:27:50.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.412+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=A0WIFJ1Q4E7W tag=2G49IK0OBVD7 type=write size=2040607 2024-09-12T00:27:50.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.416+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~JG2P3IDLDO5N.0 size=1048576 2024-09-12T00:27:50.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.420+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~JG2P3IDLDO5N.1 size=1048576 2024-09-12T00:27:50.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.424+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~JG2P3IDLDO5N.2 size=645420 2024-09-12T00:27:50.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.428+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=JG2P3IDLDO5N tag=NK14IIE2B0TN type=write size=3791148 2024-09-12T00:27:50.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.432+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=3SPID46ZW31G type=del size=2401621 2024-09-12T00:27:50.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.436+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~4I6PRIB234G0.0 size=1048576 2024-09-12T00:27:50.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.440+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~4I6PRIB234G0.1 size=1048576 2024-09-12T00:27:50.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.444+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~4I6PRIB234G0.2 size=1007504 2024-09-12T00:27:50.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.448+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=4I6PRIB234G0 tag=BCH3GQ9LUG3H type=write size=4153232 2024-09-12T00:27:50.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.456+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~ZMBSA7SZ46X7.0 size=454673 2024-09-12T00:27:50.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.456+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=ZMBSA7SZ46X7 tag=ZHZAXCWR89I4 type=write size=1503249 2024-09-12T00:27:50.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.460+0000 7f712938c8c0 -1 < failed to complete operation key=GZON46MODQZO tag=5N85W8VT8PXU type=write size=715403: (22) Invalid argument 2024-09-12T00:27:50.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.468+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~1VR7YEQIBAUX.0 size=1048576 2024-09-12T00:27:50.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.468+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~1VR7YEQIBAUX.1 size=1032375 2024-09-12T00:27:50.470 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.468+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=1VR7YEQIBAUX tag=G8LTV0SOEH5G type=write size=3129527 2024-09-12T00:27:50.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.472+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=UIOKD0PQGIPU type=del 2024-09-12T00:27:50.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.480+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=64F22C6NCQ07 type=write size=492429 2024-09-12T00:27:50.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.484+0000 7f712938c8c0 -1 < failed to complete operation key=W01PFMFNYLED tag=HFM7EIV56GVM type=del size=2623856: (22) Invalid argument 2024-09-12T00:27:50.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.488+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=36C38P0RJEIF type=del size=3319736 2024-09-12T00:27:50.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.492+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=CQX2IPSGG0G4 type=del 2024-09-12T00:27:50.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.496+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=X1GPZ761QSW2 type=del size=4003556 2024-09-12T00:27:50.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.500+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=KG5LY9BAB2NQ type=del 2024-09-12T00:27:50.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.508+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~GQ5MHB8HKJEK.0 size=1048576 2024-09-12T00:27:50.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.508+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~GQ5MHB8HKJEK.1 size=1048576 2024-09-12T00:27:50.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.512+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~GQ5MHB8HKJEK.2 size=172742 2024-09-12T00:27:50.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.512+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=GQ5MHB8HKJEK tag=29Z0DCOEXTMV type=write size=3318470 2024-09-12T00:27:50.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.516+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=2FVXKFO5RK1K type=del 2024-09-12T00:27:50.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.524+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~4JRVSXBYKHIH.0 size=1048576 2024-09-12T00:27:50.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.528+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~4JRVSXBYKHIH.1 size=1048576 2024-09-12T00:27:50.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.528+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~4JRVSXBYKHIH.2 size=650557 2024-09-12T00:27:50.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.528+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=4JRVSXBYKHIH tag=JZD83MLJYPOF type=write size=3796285 2024-09-12T00:27:50.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.532+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=SIEF8F4OAH1K type=del 2024-09-12T00:27:50.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.536+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=2DZ4TCF4C2Z3 type=del size=3435409 2024-09-12T00:27:50.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.540+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~O830FS4G60AY.0 size=1048576 2024-09-12T00:27:50.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.544+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~O830FS4G60AY.1 size=889339 2024-09-12T00:27:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.548+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=O830FS4G60AY tag=3PGYFR7AE8A1 type=write size=2986491 2024-09-12T00:27:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.552+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=AC2KU220VHRJ type=del size=2504342 2024-09-12T00:27:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.552+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=E1CSE573K6XC type=write size=4601 2024-09-12T00:27:50.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.556+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=S41DT82DCDM8 type=del size=3949160 2024-09-12T00:27:50.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.560+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=NA2Q76QQNW3T type=write size=857238 2024-09-12T00:27:50.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.564+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~K0IBF5UR5FSM.0 size=1048576 2024-09-12T00:27:50.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.568+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~K0IBF5UR5FSM.1 size=1048576 2024-09-12T00:27:50.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.568+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~K0IBF5UR5FSM.2 size=298930 2024-09-12T00:27:50.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.568+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=K0IBF5UR5FSM tag=IQBGJOCS40B6 type=write size=3444658 2024-09-12T00:27:50.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.576+0000 7f712938c8c0 1 < suggested update operation key=Z2RYL03II71Z tag=QTCS8ZNDF2PV type=del size=1852405 2024-09-12T00:27:50.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.580+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=QNL18TXOKBC2 type=del size=3710934 2024-09-12T00:27:50.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.580+0000 7f712938c8c0 1 < canceled part key=_multipart_KEMQ3H8LAUI9.2~LFSPJMZY0S07.0 size=879787 2024-09-12T00:27:50.585 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.584+0000 7f712938c8c0 1 < canceled multipart upload key=KEMQ3H8LAUI9 upload=LFSPJMZY0S07 tag=TBXASEM1ZKCY type=write size=1928363 2024-09-12T00:27:50.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.588+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=K5DI5L3U2VZY type=write size=285195 2024-09-12T00:27:50.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.592+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~J09G900I5X2E.0 size=1048576 2024-09-12T00:27:50.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.592+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~J09G900I5X2E.1 size=1048576 2024-09-12T00:27:50.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.596+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~J09G900I5X2E.2 size=461745 2024-09-12T00:27:50.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.600+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=J09G900I5X2E tag=T3UB0MQLWPVU type=write size=3607473 2024-09-12T00:27:50.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.604+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=GZW9WJE547NU type=del size=298944 2024-09-12T00:27:50.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.608+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~A0WIFJ1Q4E7W.0 size=992031 2024-09-12T00:27:50.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.612+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=A0WIFJ1Q4E7W tag=2G49IK0OBVD7 type=write size=2040607 2024-09-12T00:27:50.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.612+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=QXQUMU9LQPMR type=del size=1556244 2024-09-12T00:27:50.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.616+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=3SPID46ZW31G type=del 2024-09-12T00:27:50.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.620+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=83T5KQ2KOGVO type=del size=3801607 2024-09-12T00:27:50.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.624+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~ZMBSA7SZ46X7.0 size=454673 2024-09-12T00:27:50.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.628+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=ZMBSA7SZ46X7 tag=ZHZAXCWR89I4 type=write size=1503249 2024-09-12T00:27:50.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.632+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=7ACI1S0AC4VP type=write size=69892 2024-09-12T00:27:50.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.636+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~1VR7YEQIBAUX.0 size=1048576 2024-09-12T00:27:50.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.636+0000 7f712938c8c0 1 < canceled part key=_multipart_UAJEZUYXN2R0.2~1VR7YEQIBAUX.1 size=1032375 2024-09-12T00:27:50.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.640+0000 7f712938c8c0 1 < canceled multipart upload key=UAJEZUYXN2R0 upload=1VR7YEQIBAUX tag=G8LTV0SOEH5G type=write size=3129527 2024-09-12T00:27:50.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.644+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=76BM8W94SHM4 type=del size=1909632 2024-09-12T00:27:50.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.648+0000 7f712938c8c0 1 < suggested update operation key=KNGB14TWW6XC tag=64F22C6NCQ07 type=write size=492429 2024-09-12T00:27:50.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.652+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~68IVJBW58O83.0 size=1048576 2024-09-12T00:27:50.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.656+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~68IVJBW58O83.1 size=1048576 2024-09-12T00:27:50.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.656+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~68IVJBW58O83.2 size=529811 2024-09-12T00:27:50.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.656+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=68IVJBW58O83 tag=VZF1Y7XL6LRY type=write size=3675539 2024-09-12T00:27:50.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.660+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=36C38P0RJEIF type=del 2024-09-12T00:27:50.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.664+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~X291GV5FZZ2A.0 size=1048576 2024-09-12T00:27:50.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.672+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~X291GV5FZZ2A.1 size=1048576 2024-09-12T00:27:50.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.672+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~X291GV5FZZ2A.2 size=573776 2024-09-12T00:27:50.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.672+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=X291GV5FZZ2A tag=MRH38PJ1Y9L1 type=write size=3719504 2024-09-12T00:27:50.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.676+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=X1GPZ761QSW2 type=del 2024-09-12T00:27:50.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.680+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=9BSJRWXOTUBJ type=del size=1347416 2024-09-12T00:27:50.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.684+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~GQ5MHB8HKJEK.0 size=1048576 2024-09-12T00:27:50.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.688+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~GQ5MHB8HKJEK.1 size=1048576 2024-09-12T00:27:50.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.688+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~GQ5MHB8HKJEK.2 size=172742 2024-09-12T00:27:50.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.692+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=GQ5MHB8HKJEK tag=29Z0DCOEXTMV type=write size=3318470 2024-09-12T00:27:50.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.700+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~NZ73VF76LT2L.0 size=1048576 2024-09-12T00:27:50.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.704+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~NZ73VF76LT2L.1 size=461788 2024-09-12T00:27:50.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.704+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=NZ73VF76LT2L tag=DBLO03E1ZH8W type=write size=2558940 2024-09-12T00:27:50.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.708+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~4JRVSXBYKHIH.0 size=1048576 2024-09-12T00:27:50.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.708+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~4JRVSXBYKHIH.1 size=1048576 2024-09-12T00:27:50.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.712+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~4JRVSXBYKHIH.2 size=650557 2024-09-12T00:27:50.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.716+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=4JRVSXBYKHIH tag=JZD83MLJYPOF type=write size=3796285 2024-09-12T00:27:50.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.724+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~GZQ0M6GEB48J.0 size=1048576 2024-09-12T00:27:50.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.724+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~GZQ0M6GEB48J.1 size=1048576 2024-09-12T00:27:50.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.728+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~GZQ0M6GEB48J.2 size=915384 2024-09-12T00:27:50.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.728+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=GZQ0M6GEB48J tag=Q0EARQISUI96 type=write size=4061112 2024-09-12T00:27:50.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.732+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=2DZ4TCF4C2Z3 type=del 2024-09-12T00:27:50.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.732+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=SPLGIQ3ZWB7M type=del size=102785 2024-09-12T00:27:50.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.736+0000 7f712938c8c0 1 < canceled operation key=T0C4ZDQB13X0 tag=AC2KU220VHRJ type=del size=2504342 2024-09-12T00:27:50.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.740+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=BDOKR5R91GNX type=del size=2968992 2024-09-12T00:27:50.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.744+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=S41DT82DCDM8 type=del 2024-09-12T00:27:50.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.748+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=C3049RGQ5PX8 type=del size=990901 2024-09-12T00:27:50.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.752+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~K0IBF5UR5FSM.0 size=1048576 2024-09-12T00:27:50.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.752+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~K0IBF5UR5FSM.1 size=1048576 2024-09-12T00:27:50.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.756+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~K0IBF5UR5FSM.2 size=298930 2024-09-12T00:27:50.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.760+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=K0IBF5UR5FSM tag=IQBGJOCS40B6 type=write size=3444658 2024-09-12T00:27:50.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.764+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=54ABUXZYG1DA type=del size=3647287 2024-09-12T00:27:50.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.768+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=QNL18TXOKBC2 type=del 2024-09-12T00:27:50.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.768+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=SWHOM3OMFR87 type=del size=2959675 2024-09-12T00:27:50.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.772+0000 7f712938c8c0 1 < completed write operation key=L2SR6IAW0D38 tag=K5DI5L3U2VZY type=write size=285195 2024-09-12T00:27:50.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.776+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~G2WO4UGMULQB.0 size=1048576 2024-09-12T00:27:50.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.780+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~G2WO4UGMULQB.1 size=1048576 2024-09-12T00:27:50.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.784+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~G2WO4UGMULQB.2 size=118056 2024-09-12T00:27:50.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.784+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=G2WO4UGMULQB tag=RD7ND2XOR7GW type=write size=3263784 2024-09-12T00:27:50.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.784+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=GZW9WJE547NU type=del 2024-09-12T00:27:50.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.792+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~BV55XRG6D52D.0 size=1048576 2024-09-12T00:27:50.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.792+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~BV55XRG6D52D.1 size=962741 2024-09-12T00:27:50.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.792+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=BV55XRG6D52D tag=2PQZUKMW2YZV type=write size=3059893 2024-09-12T00:27:50.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.796+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=QXQUMU9LQPMR type=del 2024-09-12T00:27:50.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.800+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~5EX4BLYQI9IR.0 size=1048576 2024-09-12T00:27:50.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.804+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~5EX4BLYQI9IR.1 size=1048576 2024-09-12T00:27:50.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.808+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~5EX4BLYQI9IR.2 size=327864 2024-09-12T00:27:50.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.808+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=5EX4BLYQI9IR tag=044JR3VY5P67 type=write size=3473592 2024-09-12T00:27:50.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.808+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=83T5KQ2KOGVO type=del 2024-09-12T00:27:50.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.812+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=7CW90S0K3HEH type=write size=71264 2024-09-12T00:27:50.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.816+0000 7f712938c8c0 1 < canceled operation key=ULE6S9Y6DS62 tag=7ACI1S0AC4VP type=write size=69892 2024-09-12T00:27:50.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.820+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=L9D16F1O4HPN type=del size=1798724 2024-09-12T00:27:50.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.824+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=76BM8W94SHM4 type=del 2024-09-12T00:27:50.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.828+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~07Y44V5RC7XS.0 size=1048576 2024-09-12T00:27:50.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.832+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~07Y44V5RC7XS.1 size=890863 2024-09-12T00:27:50.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.832+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=07Y44V5RC7XS tag=CGBK6R47D60S type=write size=2988015 2024-09-12T00:27:50.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.836+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~68IVJBW58O83.0 size=1048576 2024-09-12T00:27:50.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.840+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~68IVJBW58O83.1 size=1048576 2024-09-12T00:27:50.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.844+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~68IVJBW58O83.2 size=529811 2024-09-12T00:27:50.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.848+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=68IVJBW58O83 tag=VZF1Y7XL6LRY type=write size=3675539 2024-09-12T00:27:50.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.852+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=AT7SI2SL4RYR type=del size=2042721 2024-09-12T00:27:50.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.856+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~X291GV5FZZ2A.0 size=1048576 2024-09-12T00:27:50.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.860+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~X291GV5FZZ2A.1 size=1048576 2024-09-12T00:27:50.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.864+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~X291GV5FZZ2A.2 size=573776 2024-09-12T00:27:50.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.868+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=X291GV5FZZ2A tag=MRH38PJ1Y9L1 type=write size=3719504 2024-09-12T00:27:50.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.872+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=7X3QCT5OWYYQ type=write size=158556 2024-09-12T00:27:50.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.880+0000 7f712938c8c0 1 < suggested update operation key=HPM9GFRASWIV tag=9BSJRWXOTUBJ type=del size=1347416 2024-09-12T00:27:50.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.884+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~M7PYRD9P7L8C.0 size=1048576 2024-09-12T00:27:50.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.888+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~M7PYRD9P7L8C.1 size=314252 2024-09-12T00:27:50.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.888+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=M7PYRD9P7L8C tag=BLHWH3DXMMSE type=write size=2411404 2024-09-12T00:27:50.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.892+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~NZ73VF76LT2L.0 size=1048576 2024-09-12T00:27:50.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.892+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~NZ73VF76LT2L.1 size=461788 2024-09-12T00:27:50.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.896+0000 7f712938c8c0 1 < canceled multipart upload key=9751RNPPQJBO upload=NZ73VF76LT2L tag=DBLO03E1ZH8W type=write size=2558940 2024-09-12T00:27:50.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.900+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=E1HJKTI5PRKT type=write size=619418 2024-09-12T00:27:50.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.904+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~GZQ0M6GEB48J.0 size=1048576 2024-09-12T00:27:50.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.908+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~GZQ0M6GEB48J.1 size=1048576 2024-09-12T00:27:50.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.912+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~GZQ0M6GEB48J.2 size=915384 2024-09-12T00:27:50.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.920+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=GZQ0M6GEB48J tag=Q0EARQISUI96 type=write size=4061112 2024-09-12T00:27:50.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.924+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~CM41NH9W5QJF.0 size=1048576 2024-09-12T00:27:50.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.928+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~CM41NH9W5QJF.1 size=1048576 2024-09-12T00:27:50.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.932+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~CM41NH9W5QJF.2 size=207883 2024-09-12T00:27:50.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.932+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=CM41NH9W5QJF tag=GXLJIBD6XGFP type=write size=3353611 2024-09-12T00:27:50.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.936+0000 7f712938c8c0 1 < canceled operation key=N69XPNN6Y6HZ tag=SPLGIQ3ZWB7M type=del size=102785 2024-09-12T00:27:50.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.944+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~7XF30DVMO0LE.0 size=1048576 2024-09-12T00:27:50.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.944+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~7XF30DVMO0LE.1 size=873079 2024-09-12T00:27:50.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.944+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=7XF30DVMO0LE tag=S87DJZHJTF70 type=write size=2970231 2024-09-12T00:27:50.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.948+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=BDOKR5R91GNX type=del 2024-09-12T00:27:50.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.952+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=5SUIG72GGU6J type=del size=1872774 2024-09-12T00:27:50.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.956+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=C3049RGQ5PX8 type=del 2024-09-12T00:27:50.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.964+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~4SOCW0BIUBM1.0 size=1048576 2024-09-12T00:27:50.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.968+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~4SOCW0BIUBM1.1 size=443756 2024-09-12T00:27:50.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.968+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=4SOCW0BIUBM1 tag=AIIV1EST8CPP type=write size=2540908 2024-09-12T00:27:50.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.972+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=54ABUXZYG1DA type=del 2024-09-12T00:27:50.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.976+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=G2HPWO4PJYLM type=del size=895682 2024-09-12T00:27:50.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.980+0000 7f712938c8c0 1 < canceled operation key=N69XPNN6Y6HZ tag=SWHOM3OMFR87 type=del size=2959675 2024-09-12T00:27:50.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.984+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=EN2TF72R9B87 type=write size=491786 2024-09-12T00:27:50.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.988+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~G2WO4UGMULQB.0 size=1048576 2024-09-12T00:27:50.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.992+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~G2WO4UGMULQB.1 size=1048576 2024-09-12T00:27:50.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:50.996+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~G2WO4UGMULQB.2 size=118056 2024-09-12T00:27:51.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.000+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=G2WO4UGMULQB tag=RD7ND2XOR7GW type=write size=3263784 2024-09-12T00:27:51.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.004+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=ITTJYSMLLSS7 type=del size=2063394 2024-09-12T00:27:51.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.008+0000 7f712938c8c0 1 < canceled part key=_multipart_5KVIIZS50CNT.2~BV55XRG6D52D.0 size=1048576 2024-09-12T00:27:51.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.008+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~BV55XRG6D52D.1 size=962741 2024-09-12T00:27:51.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.016+0000 7f712938c8c0 1 < canceled multipart upload key=5KVIIZS50CNT upload=BV55XRG6D52D tag=2PQZUKMW2YZV type=write size=3059893 2024-09-12T00:27:51.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.020+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=D7CEE3I0UN4G type=del size=1401361 2024-09-12T00:27:51.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.024+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~5EX4BLYQI9IR.0 size=1048576 2024-09-12T00:27:51.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.028+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~5EX4BLYQI9IR.1 size=1048576 2024-09-12T00:27:51.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.028+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~5EX4BLYQI9IR.2 size=327864 2024-09-12T00:27:51.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.036+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=5EX4BLYQI9IR tag=044JR3VY5P67 type=write size=3473592 2024-09-12T00:27:51.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.040+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=TAZ80FUKFOW6 type=del size=952091 2024-09-12T00:27:51.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.044+0000 7f712938c8c0 1 < completed write operation key=9YZP0TIRWWRF tag=7CW90S0K3HEH type=write size=71264 2024-09-12T00:27:51.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.048+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~GICFEQCNMU4L.0 size=1048576 2024-09-12T00:27:51.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.052+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~GICFEQCNMU4L.1 size=511609 2024-09-12T00:27:51.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.052+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=GICFEQCNMU4L tag=87T7HVWRAWIE type=write size=2608761 2024-09-12T00:27:51.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.060+0000 7f712938c8c0 1 < suggested update operation key=UAJEZUYXN2R0 tag=L9D16F1O4HPN type=del size=1798724 2024-09-12T00:27:51.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.068+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~UEBGE59UE0U0.0 size=577954 2024-09-12T00:27:51.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.068+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=UEBGE59UE0U0 tag=NOUKOY1SD1C3 type=write size=1626530 2024-09-12T00:27:51.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.072+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~07Y44V5RC7XS.0 size=1048576 2024-09-12T00:27:51.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.076+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~07Y44V5RC7XS.1 size=890863 2024-09-12T00:27:51.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.080+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=07Y44V5RC7XS tag=CGBK6R47D60S type=write size=2988015 2024-09-12T00:27:51.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.084+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=J1W7SMF7SMVS type=del size=1664756 2024-09-12T00:27:51.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.088+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=AT7SI2SL4RYR type=del 2024-09-12T00:27:51.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.096+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~WH9GBSOM24YD.0 size=548185 2024-09-12T00:27:51.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.096+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=WH9GBSOM24YD tag=NMWUHJ4N4P57 type=write size=1596761 2024-09-12T00:27:51.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.100+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=7X3QCT5OWYYQ type=write size=158556 2024-09-12T00:27:51.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.104+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=ASZA0TJIC8RN type=del size=3522216 2024-09-12T00:27:51.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.108+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~M7PYRD9P7L8C.0 size=1048576 2024-09-12T00:27:51.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.112+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~M7PYRD9P7L8C.1 size=314252 2024-09-12T00:27:51.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.120+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=M7PYRD9P7L8C tag=BLHWH3DXMMSE type=write size=2411404 2024-09-12T00:27:51.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.124+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=UJND4X6PSUQQ type=del size=192116 2024-09-12T00:27:51.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.128+0000 7f712938c8c0 1 < completed write operation key=BH2YHXHVEZCH tag=E1HJKTI5PRKT type=write size=619418 2024-09-12T00:27:51.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.136+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~VYK7QX0CWK6W.0 size=1048576 2024-09-12T00:27:51.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.136+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~VYK7QX0CWK6W.1 size=822308 2024-09-12T00:27:51.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.136+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=VYK7QX0CWK6W tag=7YYDI9TRYGQT type=write size=2919460 2024-09-12T00:27:51.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.140+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~CM41NH9W5QJF.0 size=1048576 2024-09-12T00:27:51.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.144+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~CM41NH9W5QJF.1 size=1048576 2024-09-12T00:27:51.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.148+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~CM41NH9W5QJF.2 size=207883 2024-09-12T00:27:51.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.156+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=CM41NH9W5QJF tag=GXLJIBD6XGFP type=write size=3353611 2024-09-12T00:27:51.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.160+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~9Y4FIXNJYR69.0 size=1048576 2024-09-12T00:27:51.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.164+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~9Y4FIXNJYR69.1 size=1048576 2024-09-12T00:27:51.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.168+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~9Y4FIXNJYR69.2 size=17967 2024-09-12T00:27:51.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.168+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=9Y4FIXNJYR69 tag=XK7BCTV6G5BD type=write size=3163695 2024-09-12T00:27:51.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.172+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~7XF30DVMO0LE.0 size=1048576 2024-09-12T00:27:51.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.176+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~7XF30DVMO0LE.1 size=873079 2024-09-12T00:27:51.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.180+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=7XF30DVMO0LE tag=S87DJZHJTF70 type=write size=2970231 2024-09-12T00:27:51.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.188+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~MPZE7BD3NKJ5.0 size=1048576 2024-09-12T00:27:51.191 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.192+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~MPZE7BD3NKJ5.1 size=1048576 2024-09-12T00:27:51.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.192+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~MPZE7BD3NKJ5.2 size=557754 2024-09-12T00:27:51.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.192+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=MPZE7BD3NKJ5 tag=K2SPWGGTXQQJ type=write size=3703482 2024-09-12T00:27:51.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.200+0000 7f712938c8c0 1 < suggested remove operation key=KNGB14TWW6XC tag=5SUIG72GGU6J type=del 2024-09-12T00:27:51.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.204+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=RF2DV61EVIQL type=del size=3749101 2024-09-12T00:27:51.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.208+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~4SOCW0BIUBM1.0 size=1048576 2024-09-12T00:27:51.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.212+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~4SOCW0BIUBM1.1 size=443756 2024-09-12T00:27:51.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.216+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=4SOCW0BIUBM1 tag=AIIV1EST8CPP type=write size=2540908 2024-09-12T00:27:51.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.220+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=335OUR8VR5BB type=del size=45018 2024-09-12T00:27:51.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.224+0000 7f712938c8c0 1 < canceled operation key=A8L061CQ0M0J tag=G2HPWO4PJYLM type=del size=895682 2024-09-12T00:27:51.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.232+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~G62DYK7IK74V.0 size=1048576 2024-09-12T00:27:51.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.236+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~G62DYK7IK74V.1 size=886059 2024-09-12T00:27:51.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.236+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=G62DYK7IK74V tag=OL1VLP3U2RTC type=write size=2983211 2024-09-12T00:27:51.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.240+0000 7f712938c8c0 -1 < failed to complete operation key=UAJEZUYXN2R0 tag=EN2TF72R9B87 type=write size=491786: (22) Invalid argument 2024-09-12T00:27:51.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.244+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~DOUJALQS8EC1.0 size=196865 2024-09-12T00:27:51.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.244+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=DOUJALQS8EC1 tag=HNIJD9W8MMVV type=write size=1245441 2024-09-12T00:27:51.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.248+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=ITTJYSMLLSS7 type=del 2024-09-12T00:27:51.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.252+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=3XHSZV4J3199 type=del size=3018352 2024-09-12T00:27:51.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.260+0000 7f712938c8c0 1 < suggested remove operation key=7X45VJAQO7PF tag=D7CEE3I0UN4G type=del 2024-09-12T00:27:51.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.268+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~EVO1NZRIECIX.0 size=948782 2024-09-12T00:27:51.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.268+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=EVO1NZRIECIX tag=ZZMVNRH3IJ3X type=write size=1997358 2024-09-12T00:27:51.272 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.272+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=TAZ80FUKFOW6 type=del 2024-09-12T00:27:51.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.276+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=CTLLBIQKD4YE type=del size=394948 2024-09-12T00:27:51.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.280+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~GICFEQCNMU4L.0 size=1048576 2024-09-12T00:27:51.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.280+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~GICFEQCNMU4L.1 size=511609 2024-09-12T00:27:51.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.288+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=GICFEQCNMU4L tag=87T7HVWRAWIE type=write size=2608761 2024-09-12T00:27:51.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.292+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=V381VB8N6OI9 type=del size=625839 2024-09-12T00:27:51.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.296+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~UEBGE59UE0U0.0 size=577954 2024-09-12T00:27:51.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.300+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=UEBGE59UE0U0 tag=NOUKOY1SD1C3 type=write size=1626530 2024-09-12T00:27:51.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.304+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=BRRZ9IUSO17U type=del size=1634848 2024-09-12T00:27:51.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.312+0000 7f712938c8c0 1 < suggested remove operation key=QG0W04PRTQNP tag=J1W7SMF7SMVS type=del 2024-09-12T00:27:51.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.316+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=XUABWP9L06IV type=del size=3540502 2024-09-12T00:27:51.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.320+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~WH9GBSOM24YD.0 size=548185 2024-09-12T00:27:51.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.328+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=WH9GBSOM24YD tag=NMWUHJ4N4P57 type=write size=1596761 2024-09-12T00:27:51.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.332+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=RK87K5QZJFLG type=del size=702166 2024-09-12T00:27:51.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.340+0000 7f712938c8c0 1 < suggested update operation key=ULE6S9Y6DS62 tag=ASZA0TJIC8RN type=del size=3522216 2024-09-12T00:27:51.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.344+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=C3K0OO7K3R2Z type=write size=425887 2024-09-12T00:27:51.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.352+0000 7f712938c8c0 1 < suggested remove operation key=MUNSUH4BMZNP tag=UJND4X6PSUQQ type=del 2024-09-12T00:27:51.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.360+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~ITOF48L91IQX.0 size=439735 2024-09-12T00:27:51.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.360+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=ITOF48L91IQX tag=8R306LMZ7WK9 type=write size=1488311 2024-09-12T00:27:51.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.364+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~VYK7QX0CWK6W.0 size=1048576 2024-09-12T00:27:51.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.368+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~VYK7QX0CWK6W.1 size=822308 2024-09-12T00:27:51.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.372+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=VYK7QX0CWK6W tag=7YYDI9TRYGQT type=write size=2919460 2024-09-12T00:27:51.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.376+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=6S8NGEV55ZNE type=del size=2642965 2024-09-12T00:27:51.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.380+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~9Y4FIXNJYR69.0 size=1048576 2024-09-12T00:27:51.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.384+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~9Y4FIXNJYR69.1 size=1048576 2024-09-12T00:27:51.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.384+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~9Y4FIXNJYR69.2 size=17967 2024-09-12T00:27:51.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.392+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=9Y4FIXNJYR69 tag=XK7BCTV6G5BD type=write size=3163695 2024-09-12T00:27:51.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.400+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~SKYX6DUMSOKN.0 size=250717 2024-09-12T00:27:51.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.400+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=SKYX6DUMSOKN tag=J2TXE9VLHB9P type=write size=1299293 2024-09-12T00:27:51.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.404+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~MPZE7BD3NKJ5.0 size=1048576 2024-09-12T00:27:51.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.404+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~MPZE7BD3NKJ5.1 size=1048576 2024-09-12T00:27:51.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.408+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~MPZE7BD3NKJ5.2 size=557754 2024-09-12T00:27:51.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.416+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=MPZE7BD3NKJ5 tag=K2SPWGGTXQQJ type=write size=3703482 2024-09-12T00:27:51.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.420+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~A9WVYP631NAM.0 size=1048576 2024-09-12T00:27:51.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.424+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~A9WVYP631NAM.1 size=227247 2024-09-12T00:27:51.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.424+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=A9WVYP631NAM tag=2QG93CI47GB3 type=write size=2324399 2024-09-12T00:27:51.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.428+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=RF2DV61EVIQL type=del 2024-09-12T00:27:51.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.436+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~MQ0EDM5DKCKD.0 size=1048576 2024-09-12T00:27:51.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.436+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~MQ0EDM5DKCKD.1 size=1048576 2024-09-12T00:27:51.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.440+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~MQ0EDM5DKCKD.2 size=291727 2024-09-12T00:27:51.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.440+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=MQ0EDM5DKCKD tag=DXHC05WDCC2X type=write size=3437455 2024-09-12T00:27:51.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.444+0000 7f712938c8c0 -1 < failed to complete operation key=MUNSUH4BMZNP tag=335OUR8VR5BB type=del size=45018: (22) Invalid argument 2024-09-12T00:27:51.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.452+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~7QM4EZE7YFUS.0 size=1048576 2024-09-12T00:27:51.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.452+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~7QM4EZE7YFUS.1 size=1048576 2024-09-12T00:27:51.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.456+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~7QM4EZE7YFUS.2 size=252886 2024-09-12T00:27:51.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.456+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=7QM4EZE7YFUS tag=I7B05SA8LC1S type=write size=3398614 2024-09-12T00:27:51.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.460+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~G62DYK7IK74V.0 size=1048576 2024-09-12T00:27:51.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.464+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~G62DYK7IK74V.1 size=886059 2024-09-12T00:27:51.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.468+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=G62DYK7IK74V tag=OL1VLP3U2RTC type=write size=2983211 2024-09-12T00:27:51.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.472+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=7YAPKC16P50K type=del size=1139377 2024-09-12T00:27:51.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.476+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~DOUJALQS8EC1.0 size=196865 2024-09-12T00:27:51.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.484+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=DOUJALQS8EC1 tag=HNIJD9W8MMVV type=write size=1245441 2024-09-12T00:27:51.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.488+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=BK6EVB8I72JH type=del size=1210062 2024-09-12T00:27:51.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.492+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=3XHSZV4J3199 type=del 2024-09-12T00:27:51.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.496+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=L4NZXYN11D2W type=del size=788106 2024-09-12T00:27:51.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.500+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~EVO1NZRIECIX.0 size=948782 2024-09-12T00:27:51.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.504+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=EVO1NZRIECIX tag=ZZMVNRH3IJ3X type=write size=1997358 2024-09-12T00:27:51.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.512+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~6GPAJEXEF261.0 size=1048576 2024-09-12T00:27:51.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.512+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~6GPAJEXEF261.1 size=362732 2024-09-12T00:27:51.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.512+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=6GPAJEXEF261 tag=INFQ8DMXWAA6 type=write size=2459884 2024-09-12T00:27:51.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.516+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=CTLLBIQKD4YE type=del 2024-09-12T00:27:51.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.524+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DOADSURU9NSY.0 size=1048576 2024-09-12T00:27:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.528+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DOADSURU9NSY.1 size=1048576 2024-09-12T00:27:51.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.532+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~DOADSURU9NSY.2 size=722333 2024-09-12T00:27:51.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.532+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=DOADSURU9NSY tag=YDVDW9I2XQJ8 type=write size=3868061 2024-09-12T00:27:51.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.536+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=V381VB8N6OI9 type=del 2024-09-12T00:27:51.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.540+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=A3SSC61KSLUN type=del size=2032072 2024-09-12T00:27:51.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.540+0000 7f712938c8c0 -1 < failed to complete operation key=MUNSUH4BMZNP tag=BRRZ9IUSO17U type=del size=1634848: (22) Invalid argument 2024-09-12T00:27:51.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.544+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=PAIACZH9WUW7 type=del size=2220887 2024-09-12T00:27:51.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.548+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=XUABWP9L06IV type=del 2024-09-12T00:27:51.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.552+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=XHJ75KY9SK1O type=del size=3892923 2024-09-12T00:27:51.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.556+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=RK87K5QZJFLG type=del 2024-09-12T00:27:51.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.564+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~O6SFUG8363MW.0 size=974718 2024-09-12T00:27:51.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.564+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=O6SFUG8363MW tag=Z0K1UWRMR6BW type=write size=2023294 2024-09-12T00:27:51.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.568+0000 7f712938c8c0 1 < completed write operation key=KNGB14TWW6XC tag=C3K0OO7K3R2Z type=write size=425887 2024-09-12T00:27:51.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.568+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=CT0O08K6PSJH type=del size=347735 2024-09-12T00:27:51.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.572+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~ITOF48L91IQX.0 size=439735 2024-09-12T00:27:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.580+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=ITOF48L91IQX tag=8R306LMZ7WK9 type=write size=1488311 2024-09-12T00:27:51.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.584+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=C6PBFH38H84Y type=del size=3580488 2024-09-12T00:27:51.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.588+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=6S8NGEV55ZNE type=del 2024-09-12T00:27:51.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.592+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~LF4WHS68EER2.0 size=1048576 2024-09-12T00:27:51.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.596+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~LF4WHS68EER2.1 size=65826 2024-09-12T00:27:51.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.596+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=LF4WHS68EER2 tag=I08EYLKBNEVR type=write size=2162978 2024-09-12T00:27:51.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.600+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~SKYX6DUMSOKN.0 size=250717 2024-09-12T00:27:51.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.608+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=SKYX6DUMSOKN tag=J2TXE9VLHB9P type=write size=1299293 2024-09-12T00:27:51.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.612+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=65EMSF62458F type=del size=3119931 2024-09-12T00:27:51.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.616+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~A9WVYP631NAM.0 size=1048576 2024-09-12T00:27:51.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.616+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~A9WVYP631NAM.1 size=227247 2024-09-12T00:27:51.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.624+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=A9WVYP631NAM tag=2QG93CI47GB3 type=write size=2324399 2024-09-12T00:27:51.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.632+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~HG7GRVDUB53W.0 size=1048576 2024-09-12T00:27:51.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.632+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~HG7GRVDUB53W.1 size=1048576 2024-09-12T00:27:51.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.636+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~HG7GRVDUB53W.2 size=701416 2024-09-12T00:27:51.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.636+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=HG7GRVDUB53W tag=Y60UL04FZREC type=write size=3847144 2024-09-12T00:27:51.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.640+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~MQ0EDM5DKCKD.0 size=1048576 2024-09-12T00:27:51.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.644+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~MQ0EDM5DKCKD.1 size=1048576 2024-09-12T00:27:51.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.648+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~MQ0EDM5DKCKD.2 size=291727 2024-09-12T00:27:51.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.652+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=MQ0EDM5DKCKD tag=DXHC05WDCC2X type=write size=3437455 2024-09-12T00:27:51.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.656+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=YAGK7HTJ5BL8 type=del size=2464301 2024-09-12T00:27:51.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.664+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~7QM4EZE7YFUS.0 size=1048576 2024-09-12T00:27:51.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.664+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~7QM4EZE7YFUS.1 size=1048576 2024-09-12T00:27:51.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.668+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~7QM4EZE7YFUS.2 size=252886 2024-09-12T00:27:51.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.680+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=7QM4EZE7YFUS tag=I7B05SA8LC1S type=write size=3398614 2024-09-12T00:27:51.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.684+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=6TOTB18BWQP9 type=del size=2039651 2024-09-12T00:27:51.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.692+0000 7f712938c8c0 1 < suggested update operation key=QL3FL4J9TKY4 tag=7YAPKC16P50K type=del size=1139377 2024-09-12T00:27:51.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.696+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~DMFZJAW5QBN7.0 size=1048576 2024-09-12T00:27:51.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.700+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~DMFZJAW5QBN7.1 size=776591 2024-09-12T00:27:51.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.700+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=DMFZJAW5QBN7 tag=P33GN0IJCHWR type=write size=2873743 2024-09-12T00:27:51.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.704+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=BK6EVB8I72JH type=del 2024-09-12T00:27:51.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.708+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~OP2H4E6O2E0G.0 size=1048576 2024-09-12T00:27:51.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.712+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~OP2H4E6O2E0G.1 size=270103 2024-09-12T00:27:51.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.712+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=OP2H4E6O2E0G tag=S0GOE6HW282Y type=write size=2367255 2024-09-12T00:27:51.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.716+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=L4NZXYN11D2W type=del 2024-09-12T00:27:51.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.720+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~8SCQNPST8J2Q.0 size=1048576 2024-09-12T00:27:51.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.724+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~8SCQNPST8J2Q.1 size=548925 2024-09-12T00:27:51.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.724+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=8SCQNPST8J2Q tag=8I5TER1X1ZJE type=write size=2646077 2024-09-12T00:27:51.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.728+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~6GPAJEXEF261.0 size=1048576 2024-09-12T00:27:51.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.728+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~6GPAJEXEF261.1 size=362732 2024-09-12T00:27:51.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.736+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=6GPAJEXEF261 tag=INFQ8DMXWAA6 type=write size=2459884 2024-09-12T00:27:51.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.740+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=3NZXSW8NVSJN type=write size=872443 2024-09-12T00:27:51.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.744+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~DOADSURU9NSY.0 size=1048576 2024-09-12T00:27:51.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.744+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~DOADSURU9NSY.1 size=1048576 2024-09-12T00:27:51.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.748+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~DOADSURU9NSY.2 size=722333 2024-09-12T00:27:51.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.756+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=DOADSURU9NSY tag=YDVDW9I2XQJ8 type=write size=3868061 2024-09-12T00:27:51.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.760+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=LQEFM1G2INS0 type=del size=159133 2024-09-12T00:27:51.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.764+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=A3SSC61KSLUN type=del 2024-09-12T00:27:51.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.764+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=S0NQ2RKIJWGJ type=del size=1684088 2024-09-12T00:27:51.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.772+0000 7f712938c8c0 1 < suggested update operation key=HPM9GFRASWIV tag=PAIACZH9WUW7 type=del size=2220887 2024-09-12T00:27:51.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.780+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~P5W5YG4KBQPU.0 size=1048576 2024-09-12T00:27:51.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.784+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~P5W5YG4KBQPU.1 size=285556 2024-09-12T00:27:51.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.784+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=P5W5YG4KBQPU tag=GXTFZY6PPGAF type=write size=2382708 2024-09-12T00:27:51.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.792+0000 7f712938c8c0 1 < suggested update operation key=T1H3O6A6HBQH tag=XHJ75KY9SK1O type=del size=3892923 2024-09-12T00:27:51.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.796+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~O0HZO05TYE6B.0 size=651113 2024-09-12T00:27:51.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.796+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=O0HZO05TYE6B tag=L2E6033H0EPG type=write size=1699689 2024-09-12T00:27:51.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.800+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~O6SFUG8363MW.0 size=974718 2024-09-12T00:27:51.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.804+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=O6SFUG8363MW tag=Z0K1UWRMR6BW type=write size=2023294 2024-09-12T00:27:51.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.808+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=353JZJ75SPQ6 type=write size=555083 2024-09-12T00:27:51.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.812+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=CT0O08K6PSJH type=del 2024-09-12T00:27:51.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.816+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=DANZXAVYB3DD type=write size=1041110 2024-09-12T00:27:51.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.820+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=C6PBFH38H84Y type=del 2024-09-12T00:27:51.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.824+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=O2DL6GFYCQGI type=write size=648722 2024-09-12T00:27:51.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.828+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~LF4WHS68EER2.0 size=1048576 2024-09-12T00:27:51.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.832+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~LF4WHS68EER2.1 size=65826 2024-09-12T00:27:51.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.836+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=LF4WHS68EER2 tag=I08EYLKBNEVR type=write size=2162978 2024-09-12T00:27:51.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.844+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~QAOHNNB5L6YL.0 size=1048576 2024-09-12T00:27:51.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.844+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~QAOHNNB5L6YL.1 size=1048576 2024-09-12T00:27:51.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.848+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~QAOHNNB5L6YL.2 size=204617 2024-09-12T00:27:51.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.848+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=QAOHNNB5L6YL tag=3ZJ5OK6PE2FE type=write size=3350345 2024-09-12T00:27:51.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.852+0000 7f712938c8c0 -1 < failed to complete operation key=HPM9GFRASWIV tag=65EMSF62458F type=del size=3119931: (22) Invalid argument 2024-09-12T00:27:51.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.856+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=CLN0Z4ZRBPKJ type=del size=2042144 2024-09-12T00:27:51.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.856+0000 7f712938c8c0 1 < canceled part key=_multipart_ULE6S9Y6DS62.2~HG7GRVDUB53W.0 size=1048576 2024-09-12T00:27:51.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.860+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~HG7GRVDUB53W.1 size=1048576 2024-09-12T00:27:51.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.864+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~HG7GRVDUB53W.2 size=701416 2024-09-12T00:27:51.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.868+0000 7f712938c8c0 1 < canceled multipart upload key=ULE6S9Y6DS62 upload=HG7GRVDUB53W tag=Y60UL04FZREC type=write size=3847144 2024-09-12T00:27:51.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.876+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~5I0V732MAEQR.0 size=1012401 2024-09-12T00:27:51.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.876+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=5I0V732MAEQR tag=F9EKOXC7R9S7 type=write size=2060977 2024-09-12T00:27:51.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.880+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=YAGK7HTJ5BL8 type=del 2024-09-12T00:27:51.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.888+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~E0KF441BI0N0.0 size=692185 2024-09-12T00:27:51.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.888+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=E0KF441BI0N0 tag=E44RS2SWJPXQ type=write size=1740761 2024-09-12T00:27:51.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.888+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=6TOTB18BWQP9 type=del 2024-09-12T00:27:51.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.896+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~FCF09J1K8ZAR.0 size=893424 2024-09-12T00:27:51.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.896+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=FCF09J1K8ZAR tag=2L0FS99O6H2R type=write size=1942000 2024-09-12T00:27:51.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.900+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~DMFZJAW5QBN7.0 size=1048576 2024-09-12T00:27:51.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.900+0000 7f712938c8c0 1 < canceled part key=_multipart_9N3U208FGM79.2~DMFZJAW5QBN7.1 size=776591 2024-09-12T00:27:51.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.908+0000 7f712938c8c0 1 < canceled multipart upload key=9N3U208FGM79 upload=DMFZJAW5QBN7 tag=P33GN0IJCHWR type=write size=2873743 2024-09-12T00:27:51.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.912+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=APR6RBDRQM5W type=del size=1786240 2024-09-12T00:27:51.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.916+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~OP2H4E6O2E0G.0 size=1048576 2024-09-12T00:27:51.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.916+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~OP2H4E6O2E0G.1 size=270103 2024-09-12T00:27:51.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.924+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=OP2H4E6O2E0G tag=S0GOE6HW282Y type=write size=2367255 2024-09-12T00:27:51.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.928+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=J5AFCW03JXSJ type=write size=677569 2024-09-12T00:27:51.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.932+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~8SCQNPST8J2Q.0 size=1048576 2024-09-12T00:27:51.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.936+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~8SCQNPST8J2Q.1 size=548925 2024-09-12T00:27:51.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.940+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=8SCQNPST8J2Q tag=8I5TER1X1ZJE type=write size=2646077 2024-09-12T00:27:51.948 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.948+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~NFT43M9X1Q0P.0 size=1048576 2024-09-12T00:27:51.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.952+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~NFT43M9X1Q0P.1 size=68172 2024-09-12T00:27:51.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.952+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=NFT43M9X1Q0P tag=9RA03X67CXK8 type=write size=2165324 2024-09-12T00:27:51.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.956+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=3NZXSW8NVSJN type=write size=872443 2024-09-12T00:27:51.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.960+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=81KMG0MC22C7 type=write size=895238 2024-09-12T00:27:51.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.964+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=LQEFM1G2INS0 type=del 2024-09-12T00:27:51.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.968+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=FD02T21UQBV6 type=del size=2986076 2024-09-12T00:27:51.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.976+0000 7f712938c8c0 1 < suggested update operation key=W01PFMFNYLED tag=S0NQ2RKIJWGJ type=del size=1684088 2024-09-12T00:27:51.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.980+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=F57H81DTE83L type=write size=473914 2024-09-12T00:27:51.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.984+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~P5W5YG4KBQPU.0 size=1048576 2024-09-12T00:27:51.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.988+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~P5W5YG4KBQPU.1 size=285556 2024-09-12T00:27:51.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:51.996+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=P5W5YG4KBQPU tag=GXTFZY6PPGAF type=write size=2382708 2024-09-12T00:27:51.998 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.000+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=8LZBH2RIH4L8 type=del size=1726299 2024-09-12T00:27:52.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.004+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~O0HZO05TYE6B.0 size=651113 2024-09-12T00:27:52.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.008+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=O0HZO05TYE6B tag=L2E6033H0EPG type=write size=1699689 2024-09-12T00:27:52.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.012+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=ZGC8EEMZ32ZY type=del size=2504838 2024-09-12T00:27:52.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.016+0000 7f712938c8c0 1 < completed write operation key=G0065P5NOJ2F tag=353JZJ75SPQ6 type=write size=555083 2024-09-12T00:27:52.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.024+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=015WYV9MVWSU type=del size=3301935 2024-09-12T00:27:52.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.028+0000 7f712938c8c0 1 < completed write operation key=HPM9GFRASWIV tag=DANZXAVYB3DD type=write size=1041110 2024-09-12T00:27:52.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.032+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=QTQKBSD640XF type=del size=841138 2024-09-12T00:27:52.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.036+0000 7f712938c8c0 -1 < failed to complete operation key=W01PFMFNYLED tag=O2DL6GFYCQGI type=write size=648722: (22) Invalid argument 2024-09-12T00:27:52.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.040+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=VGRV11H7D1SY type=del size=760377 2024-09-12T00:27:52.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.044+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~QAOHNNB5L6YL.0 size=1048576 2024-09-12T00:27:52.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.048+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~QAOHNNB5L6YL.1 size=1048576 2024-09-12T00:27:52.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.052+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~QAOHNNB5L6YL.2 size=204617 2024-09-12T00:27:52.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.060+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=QAOHNNB5L6YL tag=3ZJ5OK6PE2FE type=write size=3350345 2024-09-12T00:27:52.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.068+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PMRH9MGEIJ6Y.0 size=1048576 2024-09-12T00:27:52.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.068+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PMRH9MGEIJ6Y.1 size=1048576 2024-09-12T00:27:52.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.072+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PMRH9MGEIJ6Y.2 size=411614 2024-09-12T00:27:52.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.072+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=PMRH9MGEIJ6Y tag=5J02RECCD8DH type=write size=3557342 2024-09-12T00:27:52.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.076+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=CLN0Z4ZRBPKJ type=del 2024-09-12T00:27:52.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.080+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=SGKO2BD7FKWU type=del size=107889 2024-09-12T00:27:52.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.084+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~5I0V732MAEQR.0 size=1012401 2024-09-12T00:27:52.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.092+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=5I0V732MAEQR tag=F9EKOXC7R9S7 type=write size=2060977 2024-09-12T00:27:52.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.100+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~AIQRVGJ31KLX.0 size=1048576 2024-09-12T00:27:52.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.100+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~AIQRVGJ31KLX.1 size=1048576 2024-09-12T00:27:52.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.104+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~AIQRVGJ31KLX.2 size=911195 2024-09-12T00:27:52.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.104+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=AIQRVGJ31KLX tag=MEW3CJ23T184 type=write size=4056923 2024-09-12T00:27:52.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.108+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~E0KF441BI0N0.0 size=692185 2024-09-12T00:27:52.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.112+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=E0KF441BI0N0 tag=E44RS2SWJPXQ type=write size=1740761 2024-09-12T00:27:52.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.120+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~D60XMGA4NQR8.0 size=1048576 2024-09-12T00:27:52.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.124+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~D60XMGA4NQR8.1 size=444600 2024-09-12T00:27:52.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.124+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=D60XMGA4NQR8 tag=J22IVC8GPP8A type=write size=2541752 2024-09-12T00:27:52.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.128+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~FCF09J1K8ZAR.0 size=893424 2024-09-12T00:27:52.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.132+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=FCF09J1K8ZAR tag=2L0FS99O6H2R type=write size=1942000 2024-09-12T00:27:52.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.136+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=EGV9N9DOGLQE type=del size=2747674 2024-09-12T00:27:52.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.140+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=APR6RBDRQM5W type=del 2024-09-12T00:27:52.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.144+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=11ZY6XP6NQ9Q type=del size=3064943 2024-09-12T00:27:52.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.148+0000 7f712938c8c0 1 < completed write operation key=T1H3O6A6HBQH tag=J5AFCW03JXSJ type=write size=677569 2024-09-12T00:27:52.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.152+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=0DBGCQ0B45FL type=del size=461557 2024-09-12T00:27:52.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.160+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~NFT43M9X1Q0P.0 size=1048576 2024-09-12T00:27:52.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.160+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~NFT43M9X1Q0P.1 size=68172 2024-09-12T00:27:52.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.168+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=NFT43M9X1Q0P tag=9RA03X67CXK8 type=write size=2165324 2024-09-12T00:27:52.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.172+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=L4JZKGQG4MX8 type=del size=314576 2024-09-12T00:27:52.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.176+0000 7f712938c8c0 1 < canceled operation key=KEMQ3H8LAUI9 tag=81KMG0MC22C7 type=write size=895238 2024-09-12T00:27:52.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.176+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=TN3KP4UJIQA2 type=del size=3287966 2024-09-12T00:27:52.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.180+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=FD02T21UQBV6 type=del 2024-09-12T00:27:52.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.188+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~I1JSFPIOE4CM.0 size=1048576 2024-09-12T00:27:52.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.192+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~I1JSFPIOE4CM.1 size=187934 2024-09-12T00:27:52.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.192+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=I1JSFPIOE4CM tag=ULJJ37RLO6Q9 type=write size=2285086 2024-09-12T00:27:52.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.196+0000 7f712938c8c0 1 < completed write operation key=W9YW6AS1RL48 tag=F57H81DTE83L type=write size=473914 2024-09-12T00:27:52.203 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.204+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~0J17SV58UTDL.0 size=1048576 2024-09-12T00:27:52.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.208+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~0J17SV58UTDL.1 size=152994 2024-09-12T00:27:52.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.208+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=0J17SV58UTDL tag=R4NTSS1MPN6V type=write size=2250146 2024-09-12T00:27:52.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.212+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=8LZBH2RIH4L8 type=del 2024-09-12T00:27:52.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.220+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~IL5C4BHRTTHJ.0 size=74929 2024-09-12T00:27:52.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.220+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=IL5C4BHRTTHJ tag=AJKJ3XTG4D1X type=write size=1123505 2024-09-12T00:27:52.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.228+0000 7f712938c8c0 1 < suggested remove operation key=9HX9GER6OKVI tag=ZGC8EEMZ32ZY type=del 2024-09-12T00:27:52.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.232+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=D1CM9KIZE639 type=write size=828569 2024-09-12T00:27:52.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.236+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=015WYV9MVWSU type=del 2024-09-12T00:27:52.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.244+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~77LLOG5D5YHZ.0 size=824978 2024-09-12T00:27:52.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.244+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=77LLOG5D5YHZ tag=OFJHHO0VO066 type=write size=1873554 2024-09-12T00:27:52.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.248+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=QTQKBSD640XF type=del 2024-09-12T00:27:52.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.252+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=Z5WYLPAGHZ17 type=del size=1316955 2024-09-12T00:27:52.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.256+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=VGRV11H7D1SY type=del 2024-09-12T00:27:52.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.260+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=VZ7CDR37BLV5 type=del size=3235740 2024-09-12T00:27:52.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.264+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PMRH9MGEIJ6Y.0 size=1048576 2024-09-12T00:27:52.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.264+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PMRH9MGEIJ6Y.1 size=1048576 2024-09-12T00:27:52.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.268+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PMRH9MGEIJ6Y.2 size=411614 2024-09-12T00:27:52.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.276+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=PMRH9MGEIJ6Y tag=5J02RECCD8DH type=write size=3557342 2024-09-12T00:27:52.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.280+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=OQVZKQKOBMQU type=write size=272956 2024-09-12T00:27:52.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.284+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=SGKO2BD7FKWU type=del 2024-09-12T00:27:52.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.288+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=BCLOU6UFBPKR type=del size=1496090 2024-09-12T00:27:52.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.288+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~AIQRVGJ31KLX.0 size=1048576 2024-09-12T00:27:52.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.288+0000 7f712938c8c0 1 < canceled part key=_multipart_QG0W04PRTQNP.2~AIQRVGJ31KLX.1 size=1048576 2024-09-12T00:27:52.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.292+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~AIQRVGJ31KLX.2 size=911195 2024-09-12T00:27:52.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.300+0000 7f712938c8c0 1 < canceled multipart upload key=QG0W04PRTQNP upload=AIQRVGJ31KLX tag=MEW3CJ23T184 type=write size=4056923 2024-09-12T00:27:52.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.304+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=APYGRK2AFWC8 type=del size=665510 2024-09-12T00:27:52.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.304+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~D60XMGA4NQR8.0 size=1048576 2024-09-12T00:27:52.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.308+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~D60XMGA4NQR8.1 size=444600 2024-09-12T00:27:52.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.316+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=D60XMGA4NQR8 tag=J22IVC8GPP8A type=write size=2541752 2024-09-12T00:27:52.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.324+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~VRXAECYI51SM.0 size=541360 2024-09-12T00:27:52.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.324+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=VRXAECYI51SM tag=EFRZI3RWAQDO type=write size=1589936 2024-09-12T00:27:52.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.328+0000 7f712938c8c0 -1 < failed to complete operation key=9HX9GER6OKVI tag=EGV9N9DOGLQE type=del size=2747674: (22) Invalid argument 2024-09-12T00:27:52.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.332+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=23FI8Y83HT7R type=del size=3126678 2024-09-12T00:27:52.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.336+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=11ZY6XP6NQ9Q type=del 2024-09-12T00:27:52.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.340+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=PIXB6XONQHC5 type=del size=3451 2024-09-12T00:27:52.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.344+0000 7f712938c8c0 -1 < failed to complete operation key=9HX9GER6OKVI tag=0DBGCQ0B45FL type=del size=461557: (22) Invalid argument 2024-09-12T00:27:52.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.348+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=730X9KUXJYN9 type=write size=767300 2024-09-12T00:27:52.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.352+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=L4JZKGQG4MX8 type=del 2024-09-12T00:27:52.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.356+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=98B90FWV5INU type=del size=2083769 2024-09-12T00:27:52.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.360+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=TN3KP4UJIQA2 type=del 2024-09-12T00:27:52.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.364+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=CRZEC9VM6MZQ type=write size=268776 2024-09-12T00:27:52.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.368+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~I1JSFPIOE4CM.0 size=1048576 2024-09-12T00:27:52.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.372+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~I1JSFPIOE4CM.1 size=187934 2024-09-12T00:27:52.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.376+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=I1JSFPIOE4CM tag=ULJJ37RLO6Q9 type=write size=2285086 2024-09-12T00:27:52.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.384+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~RX1UJ8433TPP.0 size=481678 2024-09-12T00:27:52.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.384+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=RX1UJ8433TPP tag=TST3EKDYJ2J3 type=write size=1530254 2024-09-12T00:27:52.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.392+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~0J17SV58UTDL.0 size=1048576 2024-09-12T00:27:52.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.396+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~0J17SV58UTDL.1 size=152994 2024-09-12T00:27:52.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.400+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=0J17SV58UTDL tag=R4NTSS1MPN6V type=write size=2250146 2024-09-12T00:27:52.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.404+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=BPYY2YWW0M0K type=del size=1226678 2024-09-12T00:27:52.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.408+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~IL5C4BHRTTHJ.0 size=74929 2024-09-12T00:27:52.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.416+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=IL5C4BHRTTHJ tag=AJKJ3XTG4D1X type=write size=1123505 2024-09-12T00:27:52.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.424+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~BFTWO4M775C1.0 size=779031 2024-09-12T00:27:52.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.424+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=BFTWO4M775C1 tag=9S9XNQHLX5AR type=write size=1827607 2024-09-12T00:27:52.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.432+0000 7f712938c8c0 1 < suggested update operation key=WP4RJQVZVEE2 tag=D1CM9KIZE639 type=write size=828569 2024-09-12T00:27:52.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.436+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=TE9H002TBA2M type=del size=75670 2024-09-12T00:27:52.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.440+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~77LLOG5D5YHZ.0 size=824978 2024-09-12T00:27:52.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.444+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=77LLOG5D5YHZ tag=OFJHHO0VO066 type=write size=1873554 2024-09-12T00:27:52.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.448+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=XFQ6P6BA0WJG type=del size=3940556 2024-09-12T00:27:52.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.452+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=Z5WYLPAGHZ17 type=del 2024-09-12T00:27:52.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.460+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=FUTPDYIM4JD2 type=del size=2886001 2024-09-12T00:27:52.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.464+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=VZ7CDR37BLV5 type=del 2024-09-12T00:27:52.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.468+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=L6ILZ83QEZMS type=del size=649690 2024-09-12T00:27:52.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.476+0000 7f712938c8c0 1 < suggested remove operation key=UAJEZUYXN2R0 tag=OQVZKQKOBMQU type=write 2024-09-12T00:27:52.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.480+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=LHCX8KJSJRH4 type=write size=889414 2024-09-12T00:27:52.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.484+0000 7f712938c8c0 1 < canceled operation key=9HX9GER6OKVI tag=BCLOU6UFBPKR type=del size=1496090 2024-09-12T00:27:52.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.488+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=72I7S4NNA0QP type=del size=1295059 2024-09-12T00:27:52.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.496+0000 7f712938c8c0 1 < suggested remove operation key=QL3FL4J9TKY4 tag=APYGRK2AFWC8 type=del 2024-09-12T00:27:52.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.504+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~XCAO8WSQK4J3.0 size=1048576 2024-09-12T00:27:52.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.504+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~XCAO8WSQK4J3.1 size=1048576 2024-09-12T00:27:52.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.508+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~XCAO8WSQK4J3.2 size=45891 2024-09-12T00:27:52.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.508+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=XCAO8WSQK4J3 tag=CKE4Y8R02ENP type=write size=3191619 2024-09-12T00:27:52.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.512+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~VRXAECYI51SM.0 size=541360 2024-09-12T00:27:52.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.520+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=VRXAECYI51SM tag=EFRZI3RWAQDO type=write size=1589936 2024-09-12T00:27:52.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.524+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=K5TGJIJAZ0JO type=write size=139497 2024-09-12T00:27:52.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.528+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=23FI8Y83HT7R type=del 2024-09-12T00:27:52.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.532+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~ZH0D0KRN6B2X.0 size=1048576 2024-09-12T00:27:52.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.536+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~ZH0D0KRN6B2X.1 size=1048576 2024-09-12T00:27:52.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.540+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~ZH0D0KRN6B2X.2 size=482863 2024-09-12T00:27:52.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.540+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=ZH0D0KRN6B2X tag=Y3CZCRYEH9LP type=write size=3628591 2024-09-12T00:27:52.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.540+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=PIXB6XONQHC5 type=del 2024-09-12T00:27:52.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.548+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~VHKW3TAGZ4W2.0 size=1048576 2024-09-12T00:27:52.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.552+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~VHKW3TAGZ4W2.1 size=1048576 2024-09-12T00:27:52.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.552+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~VHKW3TAGZ4W2.2 size=618147 2024-09-12T00:27:52.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.552+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=VHKW3TAGZ4W2 tag=RSVFP8FURT91 type=write size=3763875 2024-09-12T00:27:52.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.556+0000 7f712938c8c0 1 < completed write operation key=N69XPNN6Y6HZ tag=730X9KUXJYN9 type=write size=767300 2024-09-12T00:27:52.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.560+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~FBGQ4DOTGELB.0 size=1048576 2024-09-12T00:27:52.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.564+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~FBGQ4DOTGELB.1 size=506723 2024-09-12T00:27:52.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.564+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=FBGQ4DOTGELB tag=PLL5FPKGO3Y6 type=write size=2603875 2024-09-12T00:27:52.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.568+0000 7f712938c8c0 -1 < failed to complete operation key=WP4RJQVZVEE2 tag=98B90FWV5INU type=del size=2083769: (22) Invalid argument 2024-09-12T00:27:52.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.572+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=1V182AEXQ5IQ type=write size=631279 2024-09-12T00:27:52.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.572+0000 7f712938c8c0 1 < completed write operation key=L2SR6IAW0D38 tag=CRZEC9VM6MZQ type=write size=268776 2024-09-12T00:27:52.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.576+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=OP6H6BYN0BR3 type=del size=265960 2024-09-12T00:27:52.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.580+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~RX1UJ8433TPP.0 size=481678 2024-09-12T00:27:52.585 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.584+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=RX1UJ8433TPP tag=TST3EKDYJ2J3 type=write size=1530254 2024-09-12T00:27:52.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.588+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=W37DNICJVT19 type=del size=660560 2024-09-12T00:27:52.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.592+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=BPYY2YWW0M0K type=del 2024-09-12T00:27:52.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.596+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=DHPPDRZBBZYK type=del size=192240 2024-09-12T00:27:52.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.600+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~BFTWO4M775C1.0 size=779031 2024-09-12T00:27:52.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.604+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=BFTWO4M775C1 tag=9S9XNQHLX5AR type=write size=1827607 2024-09-12T00:27:52.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.612+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~KV3CFTHAXXL9.0 size=1048576 2024-09-12T00:27:52.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.612+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~KV3CFTHAXXL9.1 size=1048576 2024-09-12T00:27:52.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.616+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~KV3CFTHAXXL9.2 size=269534 2024-09-12T00:27:52.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.616+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=KV3CFTHAXXL9 tag=DAIFHEBPCS1O type=write size=3415262 2024-09-12T00:27:52.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.620+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=TE9H002TBA2M type=del 2024-09-12T00:27:52.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.620+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=USK74NME1JKR type=del size=2256971 2024-09-12T00:27:52.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.628+0000 7f712938c8c0 1 < suggested remove operation key=5KVIIZS50CNT tag=XFQ6P6BA0WJG type=del 2024-09-12T00:27:52.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.636+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~7OTUKS2K32OO.0 size=32958 2024-09-12T00:27:52.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.636+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=7OTUKS2K32OO tag=X3PQ6MDO6U82 type=write size=1081534 2024-09-12T00:27:52.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.640+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=FUTPDYIM4JD2 type=del 2024-09-12T00:27:52.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.640+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=RQH897YYDLFV type=del size=1347598 2024-09-12T00:27:52.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.644+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=L6ILZ83QEZMS type=del 2024-09-12T00:27:52.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.652+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~W186R0G4SWR0.0 size=764827 2024-09-12T00:27:52.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.652+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=W186R0G4SWR0 tag=EIB1PFWCPJJQ type=write size=1813403 2024-09-12T00:27:52.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.656+0000 7f712938c8c0 1 < suggested remove operation key=HPM9GFRASWIV tag=LHCX8KJSJRH4 type=write 2024-09-12T00:27:52.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.664+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~W3PRU03X9TFL.0 size=842022 2024-09-12T00:27:52.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.664+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=W3PRU03X9TFL tag=X3RXPNLF11RR type=write size=1890598 2024-09-12T00:27:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.668+0000 7f712938c8c0 1 < canceled operation key=T1H3O6A6HBQH tag=72I7S4NNA0QP type=del size=1295059 2024-09-12T00:27:52.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.668+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=WTB88697SPH2 type=write size=754963 2024-09-12T00:27:52.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.672+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~XCAO8WSQK4J3.0 size=1048576 2024-09-12T00:27:52.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.676+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~XCAO8WSQK4J3.1 size=1048576 2024-09-12T00:27:52.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.680+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~XCAO8WSQK4J3.2 size=45891 2024-09-12T00:27:52.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.684+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=XCAO8WSQK4J3 tag=CKE4Y8R02ENP type=write size=3191619 2024-09-12T00:27:52.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.688+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=EF5RZITOLMUV type=del size=1103942 2024-09-12T00:27:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.692+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=K5TGJIJAZ0JO type=write size=139497 2024-09-12T00:27:52.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.696+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=R2S6K6KTB1BT type=write size=97493 2024-09-12T00:27:52.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.700+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~ZH0D0KRN6B2X.0 size=1048576 2024-09-12T00:27:52.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.704+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~ZH0D0KRN6B2X.1 size=1048576 2024-09-12T00:27:52.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.708+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~ZH0D0KRN6B2X.2 size=482863 2024-09-12T00:27:52.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.712+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=ZH0D0KRN6B2X tag=Y3CZCRYEH9LP type=write size=3628591 2024-09-12T00:27:52.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.716+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=6QX9NCSR22MU type=write size=852789 2024-09-12T00:27:52.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.720+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~VHKW3TAGZ4W2.0 size=1048576 2024-09-12T00:27:52.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.724+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~VHKW3TAGZ4W2.1 size=1048576 2024-09-12T00:27:52.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.732+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~VHKW3TAGZ4W2.2 size=618147 2024-09-12T00:27:52.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.736+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=VHKW3TAGZ4W2 tag=RSVFP8FURT91 type=write size=3763875 2024-09-12T00:27:52.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.744+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~C0ZE0D9A5E44.0 size=1048576 2024-09-12T00:27:52.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.748+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~C0ZE0D9A5E44.1 size=1048576 2024-09-12T00:27:52.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.748+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~C0ZE0D9A5E44.2 size=87469 2024-09-12T00:27:52.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.748+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=C0ZE0D9A5E44 tag=KITB70DZFOUJ type=write size=3233197 2024-09-12T00:27:52.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.756+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~FBGQ4DOTGELB.0 size=1048576 2024-09-12T00:27:52.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.756+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~FBGQ4DOTGELB.1 size=506723 2024-09-12T00:27:52.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.764+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=FBGQ4DOTGELB tag=PLL5FPKGO3Y6 type=write size=2603875 2024-09-12T00:27:52.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.768+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=R6QHC74LIRVJ type=del size=2015056 2024-09-12T00:27:52.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.772+0000 7f712938c8c0 1 < completed write operation key=BH2YHXHVEZCH tag=1V182AEXQ5IQ type=write size=631279 2024-09-12T00:27:52.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.780+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~8MOYLQR5NS5L.0 size=1048576 2024-09-12T00:27:52.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.780+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~8MOYLQR5NS5L.1 size=1048576 2024-09-12T00:27:52.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.784+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~8MOYLQR5NS5L.2 size=578368 2024-09-12T00:27:52.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.784+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=8MOYLQR5NS5L tag=QZ7CDNRNSRED type=write size=3724096 2024-09-12T00:27:52.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.788+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=OP6H6BYN0BR3 type=del 2024-09-12T00:27:52.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.796+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~3UHJRI5F7YVK.0 size=1048576 2024-09-12T00:27:52.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.796+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~3UHJRI5F7YVK.1 size=1048576 2024-09-12T00:27:52.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.800+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~3UHJRI5F7YVK.2 size=446211 2024-09-12T00:27:52.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.800+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=3UHJRI5F7YVK tag=ICC8TPAJ5MJB type=write size=3591939 2024-09-12T00:27:52.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.808+0000 7f712938c8c0 1 < suggested update operation key=BH2YHXHVEZCH tag=W37DNICJVT19 type=del size=660560 2024-09-12T00:27:52.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.812+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=ILOQP1VBN2T3 type=del size=1307223 2024-09-12T00:27:52.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.816+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=DHPPDRZBBZYK type=del 2024-09-12T00:27:52.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.820+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=IWVCC6JNRD0O type=del size=2252746 2024-09-12T00:27:52.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.824+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~KV3CFTHAXXL9.0 size=1048576 2024-09-12T00:27:52.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.828+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~KV3CFTHAXXL9.1 size=1048576 2024-09-12T00:27:52.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.832+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~KV3CFTHAXXL9.2 size=269534 2024-09-12T00:27:52.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.836+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=KV3CFTHAXXL9 tag=DAIFHEBPCS1O type=write size=3415262 2024-09-12T00:27:52.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.844+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~EQCEMDSSX2K6.0 size=1048576 2024-09-12T00:27:52.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.844+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~EQCEMDSSX2K6.1 size=1048576 2024-09-12T00:27:52.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.848+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~EQCEMDSSX2K6.2 size=557529 2024-09-12T00:27:52.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.848+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=EQCEMDSSX2K6 tag=699VG9EZ9VR2 type=write size=3703257 2024-09-12T00:27:52.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.852+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=USK74NME1JKR type=del 2024-09-12T00:27:52.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.860+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~GSNP8GXP1128.0 size=1048576 2024-09-12T00:27:52.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.860+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~GSNP8GXP1128.1 size=1048576 2024-09-12T00:27:52.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.864+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~GSNP8GXP1128.2 size=801258 2024-09-12T00:27:52.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.864+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=GSNP8GXP1128 tag=RL6U2WXKIIYP type=write size=3946986 2024-09-12T00:27:52.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.864+0000 7f712938c8c0 1 < canceled part key=_multipart_VAFU5FXA2KLC.2~7OTUKS2K32OO.0 size=32958 2024-09-12T00:27:52.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.872+0000 7f712938c8c0 1 < canceled multipart upload key=VAFU5FXA2KLC upload=7OTUKS2K32OO tag=X3PQ6MDO6U82 type=write size=1081534 2024-09-12T00:27:52.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.876+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=0E55SR1Y2A7X type=del size=1601060 2024-09-12T00:27:52.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.880+0000 7f712938c8c0 1 < canceled operation key=W9YW6AS1RL48 tag=RQH897YYDLFV type=del size=1347598 2024-09-12T00:27:52.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.884+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=RS048ERYK6XO type=write size=274477 2024-09-12T00:27:52.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.892+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~W186R0G4SWR0.0 size=764827 2024-09-12T00:27:52.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.896+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=W186R0G4SWR0 tag=EIB1PFWCPJJQ type=write size=1813403 2024-09-12T00:27:52.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.900+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=42WJOD2OZFS8 type=del size=153464 2024-09-12T00:27:52.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.904+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~W3PRU03X9TFL.0 size=842022 2024-09-12T00:27:52.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.912+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=W3PRU03X9TFL tag=X3RXPNLF11RR type=write size=1890598 2024-09-12T00:27:52.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.920+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~18LNCPV19X04.0 size=241400 2024-09-12T00:27:52.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.920+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=18LNCPV19X04 tag=I0A9NVMHDPIP type=write size=1289976 2024-09-12T00:27:52.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.924+0000 7f712938c8c0 1 < completed write operation key=MUNSUH4BMZNP tag=WTB88697SPH2 type=write size=754963 2024-09-12T00:27:52.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.928+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=RD7E3O2SQYF7 type=del size=1445834 2024-09-12T00:27:52.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.936+0000 7f712938c8c0 1 < suggested remove operation key=W01PFMFNYLED tag=EF5RZITOLMUV type=del 2024-09-12T00:27:52.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.940+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=0OYBJK343U5G type=del size=2039172 2024-09-12T00:27:52.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.948+0000 7f712938c8c0 1 < suggested remove operation key=F7T79C7MZX35 tag=R2S6K6KTB1BT type=write 2024-09-12T00:27:52.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.952+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=O2DJ4WCCGAM3 type=del size=618587 2024-09-12T00:27:52.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.956+0000 7f712938c8c0 1 < completed write operation key=9HX9GER6OKVI tag=6QX9NCSR22MU type=write size=852789 2024-09-12T00:27:52.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.964+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~Z2O8W90BXTEX.0 size=443818 2024-09-12T00:27:52.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.964+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=Z2O8W90BXTEX tag=F73DUSFI1Q84 type=write size=1492394 2024-09-12T00:27:52.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.968+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~C0ZE0D9A5E44.0 size=1048576 2024-09-12T00:27:52.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.972+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~C0ZE0D9A5E44.1 size=1048576 2024-09-12T00:27:52.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.976+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~C0ZE0D9A5E44.2 size=87469 2024-09-12T00:27:52.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.984+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=C0ZE0D9A5E44 tag=KITB70DZFOUJ type=write size=3233197 2024-09-12T00:27:52.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.992+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~FEXIRG49Y0N4.0 size=738865 2024-09-12T00:27:52.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.992+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=FEXIRG49Y0N4 tag=G032ICHKVV7E type=write size=1787441 2024-09-12T00:27:52.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:52.996+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=R6QHC74LIRVJ type=del 2024-09-12T00:27:53.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.000+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=7MBFXMVHXS47 type=write size=63566 2024-09-12T00:27:53.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.004+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~8MOYLQR5NS5L.0 size=1048576 2024-09-12T00:27:53.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.008+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~8MOYLQR5NS5L.1 size=1048576 2024-09-12T00:27:53.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.012+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~8MOYLQR5NS5L.2 size=578368 2024-09-12T00:27:53.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.020+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=8MOYLQR5NS5L tag=QZ7CDNRNSRED type=write size=3724096 2024-09-12T00:27:53.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.028+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~RK012Y2XCFG7.0 size=1048576 2024-09-12T00:27:53.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.028+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~RK012Y2XCFG7.1 size=1048576 2024-09-12T00:27:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.032+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~RK012Y2XCFG7.2 size=930121 2024-09-12T00:27:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.032+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=RK012Y2XCFG7 tag=HD93HLPT433Q type=write size=4075849 2024-09-12T00:27:53.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.036+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~3UHJRI5F7YVK.0 size=1048576 2024-09-12T00:27:53.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.040+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~3UHJRI5F7YVK.1 size=1048576 2024-09-12T00:27:53.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.040+0000 7f712938c8c0 1 < canceled part key=_multipart_T0C4ZDQB13X0.2~3UHJRI5F7YVK.2 size=446211 2024-09-12T00:27:53.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.048+0000 7f712938c8c0 1 < canceled multipart upload key=T0C4ZDQB13X0 upload=3UHJRI5F7YVK tag=ICC8TPAJ5MJB type=write size=3591939 2024-09-12T00:27:53.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.052+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=GJUHID32PMD5 type=del size=3612855 2024-09-12T00:27:53.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.056+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=ILOQP1VBN2T3 type=del 2024-09-12T00:27:53.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.056+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=8DEY33AULVEV type=del size=2316868 2024-09-12T00:27:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.060+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=IWVCC6JNRD0O type=del 2024-09-12T00:27:53.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.064+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=IF9BCC6HBVSZ type=del size=80155 2024-09-12T00:27:53.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.068+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~EQCEMDSSX2K6.0 size=1048576 2024-09-12T00:27:53.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.072+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~EQCEMDSSX2K6.1 size=1048576 2024-09-12T00:27:53.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.076+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~EQCEMDSSX2K6.2 size=557529 2024-09-12T00:27:53.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.080+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=EQCEMDSSX2K6 tag=699VG9EZ9VR2 type=write size=3703257 2024-09-12T00:27:53.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.084+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=QYZ1TDR4CW5D type=del size=2228426 2024-09-12T00:27:53.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.088+0000 7f712938c8c0 1 < canceled part key=_multipart_ULE6S9Y6DS62.2~GSNP8GXP1128.0 size=1048576 2024-09-12T00:27:53.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.088+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~GSNP8GXP1128.1 size=1048576 2024-09-12T00:27:53.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.096+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~GSNP8GXP1128.2 size=801258 2024-09-12T00:27:53.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.100+0000 7f712938c8c0 1 < canceled multipart upload key=ULE6S9Y6DS62 upload=GSNP8GXP1128 tag=RL6U2WXKIIYP type=write size=3946986 2024-09-12T00:27:53.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.104+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=VV9J9KRDJ8DX type=del size=3200373 2024-09-12T00:27:53.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.112+0000 7f712938c8c0 1 < suggested update operation key=V9K2307BGOKP tag=0E55SR1Y2A7X type=del size=1601060 2024-09-12T00:27:53.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.116+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=IRXP5M6Z506Q type=del size=2774734 2024-09-12T00:27:53.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.120+0000 7f712938c8c0 1 < completed write operation key=N69XPNN6Y6HZ tag=RS048ERYK6XO type=write size=274477 2024-09-12T00:27:53.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.124+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=YTLJKZLIRM1A type=del size=3444549 2024-09-12T00:27:53.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.128+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=42WJOD2OZFS8 type=del 2024-09-12T00:27:53.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.132+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=2DXDZ6RZCX2E type=del size=2540108 2024-09-12T00:27:53.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.136+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~18LNCPV19X04.0 size=241400 2024-09-12T00:27:53.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.140+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=18LNCPV19X04 tag=I0A9NVMHDPIP type=write size=1289976 2024-09-12T00:27:53.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.144+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=XFPVN61BRA1Y type=del size=1393197 2024-09-12T00:27:53.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.148+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=RD7E3O2SQYF7 type=del 2024-09-12T00:27:53.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.152+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=6ZPZY1LU9S1X type=write size=155809 2024-09-12T00:27:53.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.160+0000 7f712938c8c0 1 < suggested update operation key=7X45VJAQO7PF tag=0OYBJK343U5G type=del size=2039172 2024-09-12T00:27:53.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.168+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~EFT81S9QB204.0 size=1048576 2024-09-12T00:27:53.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.172+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~EFT81S9QB204.1 size=242059 2024-09-12T00:27:53.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.172+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=EFT81S9QB204 tag=CN8NJ0UL8DKV type=write size=2339211 2024-09-12T00:27:53.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.180+0000 7f712938c8c0 1 < suggested update operation key=0QZKHZTVP3RQ tag=O2DJ4WCCGAM3 type=del size=618587 2024-09-12T00:27:53.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.184+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=CKHCSYVN2WBU type=write size=781484 2024-09-12T00:27:53.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.188+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~Z2O8W90BXTEX.0 size=443818 2024-09-12T00:27:53.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.192+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=Z2O8W90BXTEX tag=F73DUSFI1Q84 type=write size=1492394 2024-09-12T00:27:53.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.196+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=MAGCTOAVKV1L type=del size=3662812 2024-09-12T00:27:53.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.200+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~FEXIRG49Y0N4.0 size=738865 2024-09-12T00:27:53.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.208+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=FEXIRG49Y0N4 tag=G032ICHKVV7E type=write size=1787441 2024-09-12T00:27:53.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.212+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=4R386X5WNNLY type=del size=1864427 2024-09-12T00:27:53.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.212+0000 7f712938c8c0 1 < completed write operation key=L2SR6IAW0D38 tag=7MBFXMVHXS47 type=write size=63566 2024-09-12T00:27:53.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.220+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=EN4TE0INZ617 type=del size=2751126 2024-09-12T00:27:53.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.224+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~RK012Y2XCFG7.0 size=1048576 2024-09-12T00:27:53.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.224+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~RK012Y2XCFG7.1 size=1048576 2024-09-12T00:27:53.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.228+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~RK012Y2XCFG7.2 size=930121 2024-09-12T00:27:53.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.236+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=RK012Y2XCFG7 tag=HD93HLPT433Q type=write size=4075849 2024-09-12T00:27:53.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.240+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=3M1FA1IIZQG9 type=write size=234375 2024-09-12T00:27:53.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.244+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=GJUHID32PMD5 type=del 2024-09-12T00:27:53.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.252+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~NDPFM4NGHVTF.0 size=490971 2024-09-12T00:27:53.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.252+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=NDPFM4NGHVTF tag=JFT3E301N1GX type=write size=1539547 2024-09-12T00:27:53.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.256+0000 7f712938c8c0 1 < canceled operation key=Z2RYL03II71Z tag=8DEY33AULVEV type=del size=2316868 2024-09-12T00:27:53.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.260+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~72YQ67ICILH5.0 size=537136 2024-09-12T00:27:53.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.260+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=72YQ67ICILH5 tag=SYL96IDYBQAP type=write size=1585712 2024-09-12T00:27:53.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.264+0000 7f712938c8c0 -1 < failed to complete operation key=V9K2307BGOKP tag=IF9BCC6HBVSZ type=del size=80155: (22) Invalid argument 2024-09-12T00:27:53.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.268+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=H9LR6TCXWPU3 type=del size=3690465 2024-09-12T00:27:53.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.276+0000 7f712938c8c0 1 < suggested update operation key=KEMQ3H8LAUI9 tag=QYZ1TDR4CW5D type=del size=2228426 2024-09-12T00:27:53.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.280+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=3J6JHCHY7TS8 type=del size=3747911 2024-09-12T00:27:53.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.284+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=VV9J9KRDJ8DX type=del 2024-09-12T00:27:53.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.288+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=4LQ1U1UETBZL type=del size=2577319 2024-09-12T00:27:53.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.292+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=IRXP5M6Z506Q type=del 2024-09-12T00:27:53.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.296+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=D7035TOJ8XG5 type=write size=767974 2024-09-12T00:27:53.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.300+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=YTLJKZLIRM1A type=del 2024-09-12T00:27:53.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.308+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~MYYEQ9OA75W0.0 size=1048576 2024-09-12T00:27:53.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.312+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~MYYEQ9OA75W0.1 size=1048576 2024-09-12T00:27:53.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.312+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~MYYEQ9OA75W0.2 size=395748 2024-09-12T00:27:53.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.312+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=MYYEQ9OA75W0 tag=28GTT3XUZR0P type=write size=3541476 2024-09-12T00:27:53.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.316+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=2DXDZ6RZCX2E type=del 2024-09-12T00:27:53.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.324+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~H5FSHVIRFQPT.0 size=147117 2024-09-12T00:27:53.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.324+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=H5FSHVIRFQPT tag=6JWA9YPVI60X type=write size=1195693 2024-09-12T00:27:53.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.328+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=XFPVN61BRA1Y type=del 2024-09-12T00:27:53.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.332+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=VAU3DM0KY7GE type=write size=91001 2024-09-12T00:27:53.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.340+0000 7f712938c8c0 1 < completed write operation key=W9YW6AS1RL48 tag=6ZPZY1LU9S1X type=write size=155809 2024-09-12T00:27:53.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.344+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=TJXU5ERVGWXO type=del size=2607976 2024-09-12T00:27:53.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.344+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~EFT81S9QB204.0 size=1048576 2024-09-12T00:27:53.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.348+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~EFT81S9QB204.1 size=242059 2024-09-12T00:27:53.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.356+0000 7f712938c8c0 1 < canceled multipart upload key=9751RNPPQJBO upload=EFT81S9QB204 tag=CN8NJ0UL8DKV type=write size=2339211 2024-09-12T00:27:53.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.360+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=PRO8F38SEB98 type=del size=3884214 2024-09-12T00:27:53.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.364+0000 7f712938c8c0 1 < canceled operation key=GZON46MODQZO tag=CKHCSYVN2WBU type=write size=781484 2024-09-12T00:27:53.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.368+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~TKAZ7QZLXC68.0 size=794670 2024-09-12T00:27:53.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.368+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=TKAZ7QZLXC68 tag=KF870THZY4E9 type=write size=1843246 2024-09-12T00:27:53.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.372+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=MAGCTOAVKV1L type=del 2024-09-12T00:27:53.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.380+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~OZ43QRGTC0C6.0 size=1048576 2024-09-12T00:27:53.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.384+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~OZ43QRGTC0C6.1 size=1048576 2024-09-12T00:27:53.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.388+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~OZ43QRGTC0C6.2 size=981886 2024-09-12T00:27:53.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.388+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=OZ43QRGTC0C6 tag=4R96RWSKGO93 type=write size=4127614 2024-09-12T00:27:53.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.392+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=4R386X5WNNLY type=del 2024-09-12T00:27:53.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.396+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=6GKAFJV7AJC3 type=del size=2290833 2024-09-12T00:27:53.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.400+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=EN4TE0INZ617 type=del 2024-09-12T00:27:53.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.408+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~MXWV8D223P2W.0 size=1048576 2024-09-12T00:27:53.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.412+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~MXWV8D223P2W.1 size=343651 2024-09-12T00:27:53.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.412+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=MXWV8D223P2W tag=R5BWNYDS8B6B type=write size=2440803 2024-09-12T00:27:53.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.416+0000 7f712938c8c0 1 < completed write operation key=QG0W04PRTQNP tag=3M1FA1IIZQG9 type=write size=234375 2024-09-12T00:27:53.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.424+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~87Z7GM6GMMHI.0 size=1048576 2024-09-12T00:27:53.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.428+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~87Z7GM6GMMHI.1 size=1015516 2024-09-12T00:27:53.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.428+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=87Z7GM6GMMHI tag=X4DTJACX1IRR type=write size=3112668 2024-09-12T00:27:53.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.432+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~NDPFM4NGHVTF.0 size=490971 2024-09-12T00:27:53.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.436+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=NDPFM4NGHVTF tag=JFT3E301N1GX type=write size=1539547 2024-09-12T00:27:53.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.444+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~TSBIFWQA3RY1.0 size=745620 2024-09-12T00:27:53.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.444+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=TSBIFWQA3RY1 tag=UZX6LVIAZ1IQ type=write size=1794196 2024-09-12T00:27:53.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.448+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~72YQ67ICILH5.0 size=537136 2024-09-12T00:27:53.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.456+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=72YQ67ICILH5 tag=SYL96IDYBQAP type=write size=1585712 2024-09-12T00:27:53.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.460+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~I7T8HDQR4QS5.0 size=1048576 2024-09-12T00:27:53.468 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.468+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~I7T8HDQR4QS5.1 size=1048576 2024-09-12T00:27:53.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.472+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~I7T8HDQR4QS5.2 size=387126 2024-09-12T00:27:53.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.472+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=I7T8HDQR4QS5 tag=T5NI8GKP8310 type=write size=3532854 2024-09-12T00:27:53.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.476+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=H9LR6TCXWPU3 type=del 2024-09-12T00:27:53.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.480+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=51C7G30RUSG2 type=del size=3475513 2024-09-12T00:27:53.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.484+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=3J6JHCHY7TS8 type=del 2024-09-12T00:27:53.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.488+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=FY3ZGTDRWE3B type=del size=2250052 2024-09-12T00:27:53.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.492+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=4LQ1U1UETBZL type=del 2024-09-12T00:27:53.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.500+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~ZP0PKQ35YL8B.0 size=1048576 2024-09-12T00:27:53.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.500+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~ZP0PKQ35YL8B.1 size=625983 2024-09-12T00:27:53.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.500+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=ZP0PKQ35YL8B tag=R3MQIRNU02UV type=write size=2723135 2024-09-12T00:27:53.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.504+0000 7f712938c8c0 1 < completed write operation key=N69XPNN6Y6HZ tag=D7035TOJ8XG5 type=write size=767974 2024-09-12T00:27:53.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.508+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=6925U8DI9MQP type=del size=3229233 2024-09-12T00:27:53.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.516+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~MYYEQ9OA75W0.0 size=1048576 2024-09-12T00:27:53.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.516+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~MYYEQ9OA75W0.1 size=1048576 2024-09-12T00:27:53.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.520+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~MYYEQ9OA75W0.2 size=395748 2024-09-12T00:27:53.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.528+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=MYYEQ9OA75W0 tag=28GTT3XUZR0P type=write size=3541476 2024-09-12T00:27:53.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.532+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=VAL17PBSWKOC type=write size=851910 2024-09-12T00:27:53.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.532+0000 7f712938c8c0 1 < canceled part key=_multipart_9N3U208FGM79.2~H5FSHVIRFQPT.0 size=147117 2024-09-12T00:27:53.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.536+0000 7f712938c8c0 1 < canceled multipart upload key=9N3U208FGM79 upload=H5FSHVIRFQPT tag=6JWA9YPVI60X type=write size=1195693 2024-09-12T00:27:53.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.540+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=R61PEFHRCOHY type=del size=1543397 2024-09-12T00:27:53.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.544+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=VAU3DM0KY7GE type=write size=91001 2024-09-12T00:27:53.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.548+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=VL9SN6XWW5YE type=del size=3825028 2024-09-12T00:27:53.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.552+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=TJXU5ERVGWXO type=del 2024-09-12T00:27:53.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.560+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~1XOY2GQ1CHVY.0 size=1048576 2024-09-12T00:27:53.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.564+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~1XOY2GQ1CHVY.1 size=1048576 2024-09-12T00:27:53.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.568+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~1XOY2GQ1CHVY.2 size=361023 2024-09-12T00:27:53.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.568+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=1XOY2GQ1CHVY tag=173CI6E92XL9 type=write size=3506751 2024-09-12T00:27:53.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.572+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=PRO8F38SEB98 type=del 2024-09-12T00:27:53.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.576+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~GGI9ZIGHWNM9.0 size=959051 2024-09-12T00:27:53.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.576+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=GGI9ZIGHWNM9 tag=SKANCFWCG58A type=write size=2007627 2024-09-12T00:27:53.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.580+0000 7f712938c8c0 1 < canceled part key=_multipart_T1H3O6A6HBQH.2~TKAZ7QZLXC68.0 size=794670 2024-09-12T00:27:53.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.584+0000 7f712938c8c0 1 < canceled multipart upload key=T1H3O6A6HBQH upload=TKAZ7QZLXC68 tag=KF870THZY4E9 type=write size=1843246 2024-09-12T00:27:53.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.588+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=FEX5PTVJFWKO type=del size=88489 2024-09-12T00:27:53.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.592+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~OZ43QRGTC0C6.0 size=1048576 2024-09-12T00:27:53.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.596+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~OZ43QRGTC0C6.1 size=1048576 2024-09-12T00:27:53.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.600+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~OZ43QRGTC0C6.2 size=981886 2024-09-12T00:27:53.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.604+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=OZ43QRGTC0C6 tag=4R96RWSKGO93 type=write size=4127614 2024-09-12T00:27:53.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.608+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=PMQQDGA81VJ9 type=del size=762348 2024-09-12T00:27:53.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.612+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=6GKAFJV7AJC3 type=del 2024-09-12T00:27:53.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.616+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=8QJOPOX0XEXB type=del size=2528714 2024-09-12T00:27:53.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.616+0000 7f712938c8c0 1 < canceled part key=_multipart_KNGB14TWW6XC.2~MXWV8D223P2W.0 size=1048576 2024-09-12T00:27:53.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.620+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~MXWV8D223P2W.1 size=343651 2024-09-12T00:27:53.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.624+0000 7f712938c8c0 1 < canceled multipart upload key=KNGB14TWW6XC upload=MXWV8D223P2W tag=R5BWNYDS8B6B type=write size=2440803 2024-09-12T00:27:53.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.632+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~DI2203MYDAP9.0 size=1048576 2024-09-12T00:27:53.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.636+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~DI2203MYDAP9.1 size=1048576 2024-09-12T00:27:53.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.640+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~DI2203MYDAP9.2 size=720338 2024-09-12T00:27:53.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.640+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=DI2203MYDAP9 tag=TJEL4CL8UWXV type=write size=3866066 2024-09-12T00:27:53.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.644+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~87Z7GM6GMMHI.0 size=1048576 2024-09-12T00:27:53.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.644+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~87Z7GM6GMMHI.1 size=1015516 2024-09-12T00:27:53.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.652+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=87Z7GM6GMMHI tag=X4DTJACX1IRR type=write size=3112668 2024-09-12T00:27:53.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.660+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~J1QR78ZQLWM8.0 size=728672 2024-09-12T00:27:53.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.660+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=J1QR78ZQLWM8 tag=NCOJG7I9N30N type=write size=1777248 2024-09-12T00:27:53.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.664+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~TSBIFWQA3RY1.0 size=745620 2024-09-12T00:27:53.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.668+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=TSBIFWQA3RY1 tag=UZX6LVIAZ1IQ type=write size=1794196 2024-09-12T00:27:53.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.676+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~WWWSI8LBDEVW.0 size=744150 2024-09-12T00:27:53.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.676+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=WWWSI8LBDEVW tag=QMN4QYQ24UCQ type=write size=1792726 2024-09-12T00:27:53.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.680+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~I7T8HDQR4QS5.0 size=1048576 2024-09-12T00:27:53.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.684+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~I7T8HDQR4QS5.1 size=1048576 2024-09-12T00:27:53.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.684+0000 7f712938c8c0 1 < canceled part key=_multipart_UAJEZUYXN2R0.2~I7T8HDQR4QS5.2 size=387126 2024-09-12T00:27:53.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.688+0000 7f712938c8c0 1 < canceled multipart upload key=UAJEZUYXN2R0 upload=I7T8HDQR4QS5 tag=T5NI8GKP8310 type=write size=3532854 2024-09-12T00:27:53.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.696+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~90XWALSABNYI.0 size=1048576 2024-09-12T00:27:53.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.700+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~90XWALSABNYI.1 size=1048576 2024-09-12T00:27:53.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.700+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~90XWALSABNYI.2 size=649638 2024-09-12T00:27:53.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.700+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=90XWALSABNYI tag=4LNYSXW7ARHI type=write size=3795366 2024-09-12T00:27:53.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.704+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=51C7G30RUSG2 type=del 2024-09-12T00:27:53.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.712+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~NDUL631K71G4.0 size=1048576 2024-09-12T00:27:53.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.716+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~NDUL631K71G4.1 size=374474 2024-09-12T00:27:53.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.716+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=NDUL631K71G4 tag=1MP30YZ2GRWZ type=write size=2471626 2024-09-12T00:27:53.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.720+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=FY3ZGTDRWE3B type=del 2024-09-12T00:27:53.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.724+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=P6HVZG3YWD6A type=del size=3910769 2024-09-12T00:27:53.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.728+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~ZP0PKQ35YL8B.0 size=1048576 2024-09-12T00:27:53.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.732+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~ZP0PKQ35YL8B.1 size=625983 2024-09-12T00:27:53.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.736+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=ZP0PKQ35YL8B tag=R3MQIRNU02UV type=write size=2723135 2024-09-12T00:27:53.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.744+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~6UBCKG2W6J22.0 size=1048576 2024-09-12T00:27:53.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.748+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~6UBCKG2W6J22.1 size=646595 2024-09-12T00:27:53.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.748+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=6UBCKG2W6J22 tag=NAN0537IFOAS type=write size=2743747 2024-09-12T00:27:53.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.752+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=6925U8DI9MQP type=del 2024-09-12T00:27:53.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.756+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=VFU8EFU0OV4S type=del size=1224727 2024-09-12T00:27:53.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.760+0000 7f712938c8c0 1 < canceled operation key=9HX9GER6OKVI tag=VAL17PBSWKOC type=write size=851910 2024-09-12T00:27:53.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.764+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=3W5YWW547A80 type=del size=998866 2024-09-12T00:27:53.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.768+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=R61PEFHRCOHY type=del 2024-09-12T00:27:53.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.772+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=WWVK1HFLCB2P type=del size=87305 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.780+0000 7f712938c8c0 1 < suggested update operation key=F7T79C7MZX35 tag=VL9SN6XWW5YE type=del size=3825028 2024-09-12T00:27:53.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.784+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=DSCL9XX4CWM6 type=del size=3363487 2024-09-12T00:27:53.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.788+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~1XOY2GQ1CHVY.0 size=1048576 2024-09-12T00:27:53.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.788+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~1XOY2GQ1CHVY.1 size=1048576 2024-09-12T00:27:53.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.792+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~1XOY2GQ1CHVY.2 size=361023 2024-09-12T00:27:53.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.800+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=1XOY2GQ1CHVY tag=173CI6E92XL9 type=write size=3506751 2024-09-12T00:27:53.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.804+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~HNGDVJQOXU48.0 size=1048576 2024-09-12T00:27:53.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.808+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~HNGDVJQOXU48.1 size=388488 2024-09-12T00:27:53.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.808+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=HNGDVJQOXU48 tag=RNDRVNOC3UUM type=write size=2485640 2024-09-12T00:27:53.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.812+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~GGI9ZIGHWNM9.0 size=959051 2024-09-12T00:27:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.820+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=GGI9ZIGHWNM9 tag=SKANCFWCG58A type=write size=2007627 2024-09-12T00:27:53.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.828+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~0JLHVJD217PA.0 size=1048576 2024-09-12T00:27:53.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.832+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~0JLHVJD217PA.1 size=579816 2024-09-12T00:27:53.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.832+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=0JLHVJD217PA tag=0ELXXDGSHK1T type=write size=2676968 2024-09-12T00:27:53.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.836+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=FEX5PTVJFWKO type=del 2024-09-12T00:27:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.844+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~T49LVUR9JEDT.0 size=221912 2024-09-12T00:27:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.844+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=T49LVUR9JEDT tag=PW1C2D4101Y0 type=write size=1270488 2024-09-12T00:27:53.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.848+0000 7f712938c8c0 1 < canceled operation key=7X45VJAQO7PF tag=PMQQDGA81VJ9 type=del size=762348 2024-09-12T00:27:53.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.852+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=A001F002QC39 type=del size=687298 2024-09-12T00:27:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.852+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=8QJOPOX0XEXB type=del 2024-09-12T00:27:53.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.860+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QPU1UU7KQ34B.0 size=981612 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.860+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=QPU1UU7KQ34B tag=S5C9BYP3HRKR type=write size=2030188 2024-09-12T00:27:53.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.864+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~DI2203MYDAP9.0 size=1048576 2024-09-12T00:27:53.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.864+0000 7f712938c8c0 1 < canceled part key=_multipart_QL3FL4J9TKY4.2~DI2203MYDAP9.1 size=1048576 2024-09-12T00:27:53.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.868+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~DI2203MYDAP9.2 size=720338 2024-09-12T00:27:53.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.872+0000 7f712938c8c0 1 < canceled multipart upload key=QL3FL4J9TKY4 upload=DI2203MYDAP9 tag=TJEL4CL8UWXV type=write size=3866066 2024-09-12T00:27:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.876+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=9QZB9X7O9BKY type=del size=346376 2024-09-12T00:27:53.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.880+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~J1QR78ZQLWM8.0 size=728672 2024-09-12T00:27:53.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.888+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=J1QR78ZQLWM8 tag=NCOJG7I9N30N type=write size=1777248 2024-09-12T00:27:53.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.888+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=S4WH97P2LCVO type=del size=3239043 2024-09-12T00:27:53.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.892+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~WWWSI8LBDEVW.0 size=744150 2024-09-12T00:27:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.900+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=WWWSI8LBDEVW tag=QMN4QYQ24UCQ type=write size=1792726 2024-09-12T00:27:53.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.904+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~BPJTXEAWFHCM.0 size=970393 2024-09-12T00:27:53.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.908+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=BPJTXEAWFHCM tag=5CPG815PH65L type=write size=2018969 2024-09-12T00:27:53.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.908+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~90XWALSABNYI.0 size=1048576 2024-09-12T00:27:53.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.912+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~90XWALSABNYI.1 size=1048576 2024-09-12T00:27:53.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.916+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~90XWALSABNYI.2 size=649638 2024-09-12T00:27:53.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.924+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=90XWALSABNYI tag=4LNYSXW7ARHI type=write size=3795366 2024-09-12T00:27:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.928+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=TGOD3VL63SE1 type=del size=468447 2024-09-12T00:27:53.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.932+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~NDUL631K71G4.0 size=1048576 2024-09-12T00:27:53.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.932+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~NDUL631K71G4.1 size=374474 2024-09-12T00:27:53.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.940+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=NDUL631K71G4 tag=1MP30YZ2GRWZ type=write size=2471626 2024-09-12T00:27:53.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.944+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=U6B4N684OEZ0 type=del size=3598793 2024-09-12T00:27:53.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.948+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=P6HVZG3YWD6A type=del 2024-09-12T00:27:53.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.952+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=928F6RHZD0C7 type=write size=658485 2024-09-12T00:27:53.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.956+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~6UBCKG2W6J22.0 size=1048576 2024-09-12T00:27:53.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.956+0000 7f712938c8c0 1 < canceled part key=_multipart_HPM9GFRASWIV.2~6UBCKG2W6J22.1 size=646595 2024-09-12T00:27:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.960+0000 7f712938c8c0 1 < canceled multipart upload key=HPM9GFRASWIV upload=6UBCKG2W6J22 tag=NAN0537IFOAS type=write size=2743747 2024-09-12T00:27:53.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.964+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=HSSJ41HVIZE9 type=del size=2915796 2024-09-12T00:27:53.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.968+0000 7f712938c8c0 1 < canceled operation key=KNGB14TWW6XC tag=VFU8EFU0OV4S type=del size=1224727 2024-09-12T00:27:53.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.976+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~O7X4G1XP4B8Q.0 size=152277 2024-09-12T00:27:53.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.976+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=O7X4G1XP4B8Q tag=6RPXBZDH3ZK7 type=write size=1200853 2024-09-12T00:27:53.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.980+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=3W5YWW547A80 type=del 2024-09-12T00:27:53.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.988+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~9LR2MRKNVRNS.0 size=1048576 2024-09-12T00:27:53.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.992+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~9LR2MRKNVRNS.1 size=866391 2024-09-12T00:27:53.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.992+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=9LR2MRKNVRNS tag=BOUVEE6QABSU type=write size=2963543 2024-09-12T00:27:53.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:53.996+0000 7f712938c8c0 1 < canceled operation key=V9K2307BGOKP tag=WWVK1HFLCB2P type=del size=87305 2024-09-12T00:27:54.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.004+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~SJD9TCYCD2A7.0 size=1048576 2024-09-12T00:27:54.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.004+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~SJD9TCYCD2A7.1 size=1048576 2024-09-12T00:27:54.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.008+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~SJD9TCYCD2A7.2 size=974952 2024-09-12T00:27:54.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.008+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=SJD9TCYCD2A7 tag=M6Z9PUV1UCH9 type=write size=4120680 2024-09-12T00:27:54.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.012+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=DSCL9XX4CWM6 type=del 2024-09-12T00:27:54.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.020+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~UWO514S27W3F.0 size=1048576 2024-09-12T00:27:54.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.020+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~UWO514S27W3F.1 size=1048576 2024-09-12T00:27:54.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.024+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~UWO514S27W3F.2 size=576886 2024-09-12T00:27:54.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.024+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=UWO514S27W3F tag=GR6ZRZY0YGVT type=write size=3722614 2024-09-12T00:27:54.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.028+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~HNGDVJQOXU48.0 size=1048576 2024-09-12T00:27:54.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.028+0000 7f712938c8c0 1 < canceled part key=_multipart_W9YW6AS1RL48.2~HNGDVJQOXU48.1 size=388488 2024-09-12T00:27:54.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.036+0000 7f712938c8c0 1 < canceled multipart upload key=W9YW6AS1RL48 upload=HNGDVJQOXU48 tag=RNDRVNOC3UUM type=write size=2485640 2024-09-12T00:27:54.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.040+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~VWY5Z7YNR87F.0 size=1048576 2024-09-12T00:27:54.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.044+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~VWY5Z7YNR87F.1 size=477219 2024-09-12T00:27:54.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.044+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=VWY5Z7YNR87F tag=NSOFNTK0U2R1 type=write size=2574371 2024-09-12T00:27:54.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.048+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~0JLHVJD217PA.0 size=1048576 2024-09-12T00:27:54.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.052+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~0JLHVJD217PA.1 size=579816 2024-09-12T00:27:54.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.060+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=0JLHVJD217PA tag=0ELXXDGSHK1T type=write size=2676968 2024-09-12T00:27:54.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.064+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=F0E90OJKGRV9 type=del size=223518 2024-09-12T00:27:54.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.064+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~T49LVUR9JEDT.0 size=221912 2024-09-12T00:27:54.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.072+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=T49LVUR9JEDT tag=PW1C2D4101Y0 type=write size=1270488 2024-09-12T00:27:54.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.076+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=1UHGGG6AB45I type=del size=3537366 2024-09-12T00:27:54.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.080+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=A001F002QC39 type=del 2024-09-12T00:27:54.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.084+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=DWCQ9S3REYCF type=del size=2999590 2024-09-12T00:27:54.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.088+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~QPU1UU7KQ34B.0 size=981612 2024-09-12T00:27:54.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.096+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=QPU1UU7KQ34B tag=S5C9BYP3HRKR type=write size=2030188 2024-09-12T00:27:54.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.104+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~MK2DN502CLWI.0 size=770690 2024-09-12T00:27:54.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.104+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=MK2DN502CLWI tag=L1962AL9ZVUT type=write size=1819266 2024-09-12T00:27:54.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.108+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=9QZB9X7O9BKY type=del 2024-09-12T00:27:54.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.116+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~EKJM3F8OPDSV.0 size=1048576 2024-09-12T00:27:54.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.116+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~EKJM3F8OPDSV.1 size=255303 2024-09-12T00:27:54.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.116+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=EKJM3F8OPDSV tag=DSRM7E16PJO7 type=write size=2352455 2024-09-12T00:27:54.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.124+0000 7f712938c8c0 1 < suggested update operation key=BH2YHXHVEZCH tag=S4WH97P2LCVO type=del size=3239043 2024-09-12T00:27:54.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.128+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=QJVO661DLPYV type=del size=1163861 2024-09-12T00:27:54.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.132+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~BPJTXEAWFHCM.0 size=970393 2024-09-12T00:27:54.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.140+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=BPJTXEAWFHCM tag=5CPG815PH65L type=write size=2018969 2024-09-12T00:27:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.144+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=P2ZK0U9U158K type=del size=501411 2024-09-12T00:27:54.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.148+0000 7f712938c8c0 1 < suggested remove operation key=N69XPNN6Y6HZ tag=TGOD3VL63SE1 type=del 2024-09-12T00:27:54.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.156+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=5Q47CVEDZABH type=del size=505527 2024-09-12T00:27:54.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.160+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=U6B4N684OEZ0 type=del 2024-09-12T00:27:54.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.164+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=HLPKDG0BCARN type=del size=3204954 2024-09-12T00:27:54.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.168+0000 7f712938c8c0 1 < completed write operation key=F7T79C7MZX35 tag=928F6RHZD0C7 type=write size=658485 2024-09-12T00:27:54.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.172+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=F6C617HE26AW type=del size=1431279 2024-09-12T00:27:54.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.180+0000 7f712938c8c0 1 < canceled operation key=V9K2307BGOKP tag=HSSJ41HVIZE9 type=del size=2915796 2024-09-12T00:27:54.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.184+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=Y2F4P9NQU6P1 type=del size=100880 2024-09-12T00:27:54.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.188+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~O7X4G1XP4B8Q.0 size=152277 2024-09-12T00:27:54.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.192+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=O7X4G1XP4B8Q tag=6RPXBZDH3ZK7 type=write size=1200853 2024-09-12T00:27:54.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.196+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=O1LFI79E1KI7 type=del size=2454114 2024-09-12T00:27:54.202 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.200+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~9LR2MRKNVRNS.0 size=1048576 2024-09-12T00:27:54.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.204+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~9LR2MRKNVRNS.1 size=866391 2024-09-12T00:27:54.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.212+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=9LR2MRKNVRNS tag=BOUVEE6QABSU type=write size=2963543 2024-09-12T00:27:54.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.216+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=KHA70SOH2PCR type=del size=345177 2024-09-12T00:27:54.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.220+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~SJD9TCYCD2A7.0 size=1048576 2024-09-12T00:27:54.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.224+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~SJD9TCYCD2A7.1 size=1048576 2024-09-12T00:27:54.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.224+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~SJD9TCYCD2A7.2 size=974952 2024-09-12T00:27:54.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.232+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=SJD9TCYCD2A7 tag=M6Z9PUV1UCH9 type=write size=4120680 2024-09-12T00:27:54.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.236+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=8VFQ67E3GMAP type=del size=3020711 2024-09-12T00:27:54.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.240+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~UWO514S27W3F.0 size=1048576 2024-09-12T00:27:54.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.244+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~UWO514S27W3F.1 size=1048576 2024-09-12T00:27:54.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.248+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~UWO514S27W3F.2 size=576886 2024-09-12T00:27:54.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.256+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=UWO514S27W3F tag=GR6ZRZY0YGVT type=write size=3722614 2024-09-12T00:27:54.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.260+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=USOEYJMIHJYH type=del size=1777215 2024-09-12T00:27:54.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.264+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~VWY5Z7YNR87F.0 size=1048576 2024-09-12T00:27:54.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.264+0000 7f712938c8c0 1 < canceled part key=_multipart_Z2RYL03II71Z.2~VWY5Z7YNR87F.1 size=477219 2024-09-12T00:27:54.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.268+0000 7f712938c8c0 1 < canceled multipart upload key=Z2RYL03II71Z upload=VWY5Z7YNR87F tag=NSOFNTK0U2R1 type=write size=2574371 2024-09-12T00:27:54.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.272+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=SBS0N18M9D9F type=write size=274354 2024-09-12T00:27:54.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.280+0000 7f712938c8c0 1 < suggested remove operation key=KEMQ3H8LAUI9 tag=F0E90OJKGRV9 type=del 2024-09-12T00:27:54.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.288+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~3KX4P2U5XPDO.0 size=1048576 2024-09-12T00:27:54.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.288+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~3KX4P2U5XPDO.1 size=127040 2024-09-12T00:27:54.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.288+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=3KX4P2U5XPDO tag=WZCS9UB0DCBG type=write size=2224192 2024-09-12T00:27:54.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.296+0000 7f712938c8c0 1 < suggested update operation key=0QZKHZTVP3RQ tag=1UHGGG6AB45I type=del size=3537366 2024-09-12T00:27:54.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.304+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=UJDUOSDAUNMJ type=write size=907333 2024-09-12T00:27:54.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.308+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=DWCQ9S3REYCF type=del 2024-09-12T00:27:54.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.312+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=24AJO861QCLP type=write size=697716 2024-09-12T00:27:54.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.316+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~MK2DN502CLWI.0 size=770690 2024-09-12T00:27:54.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.320+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=MK2DN502CLWI tag=L1962AL9ZVUT type=write size=1819266 2024-09-12T00:27:54.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.324+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=RU7WBBEJ6G89 type=del size=798235 2024-09-12T00:27:54.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.328+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~EKJM3F8OPDSV.0 size=1048576 2024-09-12T00:27:54.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.332+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~EKJM3F8OPDSV.1 size=255303 2024-09-12T00:27:54.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.336+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=EKJM3F8OPDSV tag=DSRM7E16PJO7 type=write size=2352455 2024-09-12T00:27:54.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.340+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=GWWXIMH7UX3F type=del size=2857603 2024-09-12T00:27:54.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.344+0000 7f712938c8c0 -1 < failed to complete operation key=0QZKHZTVP3RQ tag=QJVO661DLPYV type=del size=1163861: (22) Invalid argument 2024-09-12T00:27:54.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.352+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~8124MXANU254.0 size=1048576 2024-09-12T00:27:54.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.352+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~8124MXANU254.1 size=75922 2024-09-12T00:27:54.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.352+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=8124MXANU254 tag=U8PANJFA2MV5 type=write size=2173074 2024-09-12T00:27:54.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.356+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=P2ZK0U9U158K type=del 2024-09-12T00:27:54.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.360+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=QHASI2ILHQNB type=del size=3975544 2024-09-12T00:27:54.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.368+0000 7f712938c8c0 1 < suggested remove operation key=0QZKHZTVP3RQ tag=5Q47CVEDZABH type=del 2024-09-12T00:27:54.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.372+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=UTDW3RR419H7 type=del size=3115730 2024-09-12T00:27:54.376 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.376+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=HLPKDG0BCARN type=del 2024-09-12T00:27:54.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.384+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~LF9XWPLWXCG1.0 size=1048576 2024-09-12T00:27:54.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.384+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~LF9XWPLWXCG1.1 size=349017 2024-09-12T00:27:54.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.384+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=LF9XWPLWXCG1 tag=6JFAGNEXIDAL type=write size=2446169 2024-09-12T00:27:54.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.388+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=F6C617HE26AW type=del 2024-09-12T00:27:54.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.396+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~5413EN03BJYE.0 size=231074 2024-09-12T00:27:54.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.396+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=5413EN03BJYE tag=ULFO26BMHLJC type=write size=1279650 2024-09-12T00:27:54.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.400+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=Y2F4P9NQU6P1 type=del 2024-09-12T00:27:54.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.408+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~7RR7YE5G1974.0 size=13861 2024-09-12T00:27:54.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.408+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=7RR7YE5G1974 tag=5U7WQJ7O3TG4 type=write size=1062437 2024-09-12T00:27:54.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.412+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=O1LFI79E1KI7 type=del 2024-09-12T00:27:54.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.416+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~5YPP1272AKR4.0 size=1048576 2024-09-12T00:27:54.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.420+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~5YPP1272AKR4.1 size=1048576 2024-09-12T00:27:54.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.424+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~5YPP1272AKR4.2 size=206779 2024-09-12T00:27:54.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.424+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=5YPP1272AKR4 tag=RLHTOPW0994N type=write size=3352507 2024-09-12T00:27:54.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.428+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=KHA70SOH2PCR type=del 2024-09-12T00:27:54.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.432+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~7QVBNAR48OE4.0 size=379825 2024-09-12T00:27:54.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.432+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=7QVBNAR48OE4 tag=2Y8C6L5C17LU type=write size=1428401 2024-09-12T00:27:54.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.436+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=8VFQ67E3GMAP type=del 2024-09-12T00:27:54.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.440+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=K46VV5LL6PRL type=write size=618331 2024-09-12T00:27:54.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.444+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=USOEYJMIHJYH type=del 2024-09-12T00:27:54.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.448+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=0AJ6C90ORDNF type=del size=567688 2024-09-12T00:27:54.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.452+0000 7f712938c8c0 1 < completed write operation key=F7T79C7MZX35 tag=SBS0N18M9D9F type=write size=274354 2024-09-12T00:27:54.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.456+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=U7C2TKZ0V9QM type=del size=2008582 2024-09-12T00:27:54.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.460+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~3KX4P2U5XPDO.0 size=1048576 2024-09-12T00:27:54.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.464+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~3KX4P2U5XPDO.1 size=127040 2024-09-12T00:27:54.470 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.472+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=3KX4P2U5XPDO tag=WZCS9UB0DCBG type=write size=2224192 2024-09-12T00:27:54.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.476+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=UL7UGNROI0QT type=del size=3245554 2024-09-12T00:27:54.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.480+0000 7f712938c8c0 1 < completed write operation key=BH2YHXHVEZCH tag=UJDUOSDAUNMJ type=write size=907333 2024-09-12T00:27:54.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.488+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~IBOI77G9EJ58.0 size=224762 2024-09-12T00:27:54.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.488+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=IBOI77G9EJ58 tag=XPMDYCV003TC type=write size=1273338 2024-09-12T00:27:54.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.492+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=24AJO861QCLP type=write size=697716 2024-09-12T00:27:54.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.496+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=P00DLHNS8GDS type=write size=678792 2024-09-12T00:27:54.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.500+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=RU7WBBEJ6G89 type=del 2024-09-12T00:27:54.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.504+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~1MAZRI81N6BN.0 size=756189 2024-09-12T00:27:54.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.504+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=1MAZRI81N6BN tag=VAA9SGSILK7B type=write size=1804765 2024-09-12T00:27:54.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.508+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=GWWXIMH7UX3F type=del 2024-09-12T00:27:54.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.512+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=44A4VR0L0FXI type=del size=1354257 2024-09-12T00:27:54.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.516+0000 7f712938c8c0 1 < canceled part key=_multipart_T0C4ZDQB13X0.2~8124MXANU254.0 size=1048576 2024-09-12T00:27:54.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.516+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~8124MXANU254.1 size=75922 2024-09-12T00:27:54.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.524+0000 7f712938c8c0 1 < canceled multipart upload key=T0C4ZDQB13X0 upload=8124MXANU254 tag=U8PANJFA2MV5 type=write size=2173074 2024-09-12T00:27:54.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.532+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~IMG3RTGA5TP5.0 size=1048576 2024-09-12T00:27:54.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.532+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~IMG3RTGA5TP5.1 size=31502 2024-09-12T00:27:54.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.532+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=IMG3RTGA5TP5 tag=N6M3B2QN70XU type=write size=2128654 2024-09-12T00:27:54.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.540+0000 7f712938c8c0 1 < canceled operation key=7X45VJAQO7PF tag=QHASI2ILHQNB type=del size=3975544 2024-09-12T00:27:54.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.548+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~QZG4XH6BONCW.0 size=1048576 2024-09-12T00:27:54.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.552+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~QZG4XH6BONCW.1 size=496369 2024-09-12T00:27:54.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.552+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=QZG4XH6BONCW tag=D6S4BYK2G452 type=write size=2593521 2024-09-12T00:27:54.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.560+0000 7f712938c8c0 1 < suggested update operation key=HPM9GFRASWIV tag=UTDW3RR419H7 type=del size=3115730 2024-09-12T00:27:54.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.564+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~Q681M7X87D31.0 size=664859 2024-09-12T00:27:54.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.564+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=Q681M7X87D31 tag=KC28957COVZ6 type=write size=1713435 2024-09-12T00:27:54.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.568+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~LF9XWPLWXCG1.0 size=1048576 2024-09-12T00:27:54.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.572+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~LF9XWPLWXCG1.1 size=349017 2024-09-12T00:27:54.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.576+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=LF9XWPLWXCG1 tag=6JFAGNEXIDAL type=write size=2446169 2024-09-12T00:27:54.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.584+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~T7M2Z43G0XC0.0 size=1048576 2024-09-12T00:27:54.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.588+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~T7M2Z43G0XC0.1 size=1048576 2024-09-12T00:27:54.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.588+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~T7M2Z43G0XC0.2 size=685700 2024-09-12T00:27:54.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.588+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=T7M2Z43G0XC0 tag=3UUW62MRJVO4 type=write size=3831428 2024-09-12T00:27:54.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.592+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~5413EN03BJYE.0 size=231074 2024-09-12T00:27:54.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.600+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=5413EN03BJYE tag=ULFO26BMHLJC type=write size=1279650 2024-09-12T00:27:54.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.604+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~3IIF6JCM95IA.0 size=122407 2024-09-12T00:27:54.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.604+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=3IIF6JCM95IA tag=IKUKZQ6V7L3A type=write size=1170983 2024-09-12T00:27:54.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.608+0000 7f712938c8c0 1 < canceled part key=_multipart_04RL082VPLIM.2~7RR7YE5G1974.0 size=13861 2024-09-12T00:27:54.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.612+0000 7f712938c8c0 1 < canceled multipart upload key=04RL082VPLIM upload=7RR7YE5G1974 tag=5U7WQJ7O3TG4 type=write size=1062437 2024-09-12T00:27:54.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.620+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~F9RK3ECR4Z8W.0 size=666183 2024-09-12T00:27:54.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.620+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=F9RK3ECR4Z8W tag=S6FARWNAP4OW type=write size=1714759 2024-09-12T00:27:54.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.624+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~5YPP1272AKR4.0 size=1048576 2024-09-12T00:27:54.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.628+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~5YPP1272AKR4.1 size=1048576 2024-09-12T00:27:54.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.632+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~5YPP1272AKR4.2 size=206779 2024-09-12T00:27:54.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.640+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=5YPP1272AKR4 tag=RLHTOPW0994N type=write size=3352507 2024-09-12T00:27:54.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.644+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~GHO88XCW1M8Z.0 size=1048576 2024-09-12T00:27:54.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.648+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~GHO88XCW1M8Z.1 size=816420 2024-09-12T00:27:54.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.648+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=GHO88XCW1M8Z tag=9YVL1XTHZ186 type=write size=2913572 2024-09-12T00:27:54.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.652+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~7QVBNAR48OE4.0 size=379825 2024-09-12T00:27:54.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.656+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=7QVBNAR48OE4 tag=2Y8C6L5C17LU type=write size=1428401 2024-09-12T00:27:54.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.664+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~SFWMSBUZ9A3W.0 size=1048576 2024-09-12T00:27:54.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.664+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~SFWMSBUZ9A3W.1 size=420256 2024-09-12T00:27:54.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.664+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=SFWMSBUZ9A3W tag=PJ4WM25P6KFJ type=write size=2517408 2024-09-12T00:27:54.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.668+0000 7f712938c8c0 1 < completed write operation key=BH2YHXHVEZCH tag=K46VV5LL6PRL type=write size=618331 2024-09-12T00:27:54.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.672+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=3ER6T3DE6GDD type=write size=492801 2024-09-12T00:27:54.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.676+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=0AJ6C90ORDNF type=del 2024-09-12T00:27:54.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.684+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~DNYBVYW3U35O.0 size=1048576 2024-09-12T00:27:54.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.684+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~DNYBVYW3U35O.1 size=399080 2024-09-12T00:27:54.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.684+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=DNYBVYW3U35O tag=TB1I3578BF21 type=write size=2496232 2024-09-12T00:27:54.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.692+0000 7f712938c8c0 1 < suggested update operation key=WP4RJQVZVEE2 tag=U7C2TKZ0V9QM type=del size=2008582 2024-09-12T00:27:54.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.696+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=RQ6R2OHA3Q0N type=del size=2671514 2024-09-12T00:27:54.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.704+0000 7f712938c8c0 1 < suggested update operation key=T0C4ZDQB13X0 tag=UL7UGNROI0QT type=del size=3245554 2024-09-12T00:27:54.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.712+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~XYWOOD0X9042.0 size=1048576 2024-09-12T00:27:54.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.716+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~XYWOOD0X9042.1 size=971453 2024-09-12T00:27:54.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.716+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=XYWOOD0X9042 tag=NQD1L7LLSF6D type=write size=3068605 2024-09-12T00:27:54.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.720+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~IBOI77G9EJ58.0 size=224762 2024-09-12T00:27:54.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.724+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=IBOI77G9EJ58 tag=XPMDYCV003TC type=write size=1273338 2024-09-12T00:27:54.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.728+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=2K5VU6SKWPB5 type=del size=265657 2024-09-12T00:27:54.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.732+0000 7f712938c8c0 1 < completed write operation key=ZP88X00LMVSS tag=P00DLHNS8GDS type=write size=678792 2024-09-12T00:27:54.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.740+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~380NC2NB67G3.0 size=1048576 2024-09-12T00:27:54.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.744+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~380NC2NB67G3.1 size=1048063 2024-09-12T00:27:54.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.744+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=380NC2NB67G3 tag=FAO0L4MJPL2S type=write size=3145215 2024-09-12T00:27:54.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.748+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~1MAZRI81N6BN.0 size=756189 2024-09-12T00:27:54.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.752+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=1MAZRI81N6BN tag=VAA9SGSILK7B type=write size=1804765 2024-09-12T00:27:54.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.756+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=NFRCM573JZD3 type=write size=183784 2024-09-12T00:27:54.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.760+0000 7f712938c8c0 1 < canceled operation key=0QZKHZTVP3RQ tag=44A4VR0L0FXI type=del size=1354257 2024-09-12T00:27:54.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.764+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=VV8UQ3X2P9R0 type=write size=277447 2024-09-12T00:27:54.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.768+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~IMG3RTGA5TP5.0 size=1048576 2024-09-12T00:27:54.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.772+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~IMG3RTGA5TP5.1 size=31502 2024-09-12T00:27:54.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.776+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=IMG3RTGA5TP5 tag=N6M3B2QN70XU type=write size=2128654 2024-09-12T00:27:54.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.784+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~6XDFR2J0HTI8.0 size=697484 2024-09-12T00:27:54.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.784+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=6XDFR2J0HTI8 tag=5KDC4PE73WJM type=write size=1746060 2024-09-12T00:27:54.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.788+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~QZG4XH6BONCW.0 size=1048576 2024-09-12T00:27:54.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.788+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~QZG4XH6BONCW.1 size=496369 2024-09-12T00:27:54.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.796+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=QZG4XH6BONCW tag=D6S4BYK2G452 type=write size=2593521 2024-09-12T00:27:54.803 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.804+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~5P9D8BXHU3J7.0 size=1048576 2024-09-12T00:27:54.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.804+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~5P9D8BXHU3J7.1 size=901816 2024-09-12T00:27:54.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.804+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=5P9D8BXHU3J7 tag=SJ1P74NJKQH7 type=write size=2998968 2024-09-12T00:27:54.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.808+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~Q681M7X87D31.0 size=664859 2024-09-12T00:27:54.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.816+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=Q681M7X87D31 tag=KC28957COVZ6 type=write size=1713435 2024-09-12T00:27:54.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.820+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=XPSXIUG1P6LI type=del size=978199 2024-09-12T00:27:54.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.820+0000 7f712938c8c0 1 < canceled part key=_multipart_F7T79C7MZX35.2~T7M2Z43G0XC0.0 size=1048576 2024-09-12T00:27:54.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.824+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~T7M2Z43G0XC0.1 size=1048576 2024-09-12T00:27:54.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.828+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~T7M2Z43G0XC0.2 size=685700 2024-09-12T00:27:54.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.832+0000 7f712938c8c0 1 < canceled multipart upload key=F7T79C7MZX35 upload=T7M2Z43G0XC0 tag=3UUW62MRJVO4 type=write size=3831428 2024-09-12T00:27:54.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.836+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=2Z35DWSQDJWR type=del size=838354 2024-09-12T00:27:54.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.840+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~3IIF6JCM95IA.0 size=122407 2024-09-12T00:27:54.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.848+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=3IIF6JCM95IA tag=IKUKZQ6V7L3A type=write size=1170983 2024-09-12T00:27:54.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.852+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~3JNDZTJBEDS6.0 size=692774 2024-09-12T00:27:54.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.852+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=3JNDZTJBEDS6 tag=E2O55GF3HVM8 type=write size=1741350 2024-09-12T00:27:54.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.856+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~F9RK3ECR4Z8W.0 size=666183 2024-09-12T00:27:54.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.864+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=F9RK3ECR4Z8W tag=S6FARWNAP4OW type=write size=1714759 2024-09-12T00:27:54.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.868+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=XQ1V4TH5SZAE type=write size=699938 2024-09-12T00:27:54.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.872+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~GHO88XCW1M8Z.0 size=1048576 2024-09-12T00:27:54.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.872+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~GHO88XCW1M8Z.1 size=816420 2024-09-12T00:27:54.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.884+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=GHO88XCW1M8Z tag=9YVL1XTHZ186 type=write size=2913572 2024-09-12T00:27:54.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.892+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~QJCYWRCA82HV.0 size=1048576 2024-09-12T00:27:54.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.892+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~QJCYWRCA82HV.1 size=1048576 2024-09-12T00:27:54.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.896+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~QJCYWRCA82HV.2 size=649154 2024-09-12T00:27:54.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.896+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=QJCYWRCA82HV tag=66M8QGY5ET0P type=write size=3794882 2024-09-12T00:27:54.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.900+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~SFWMSBUZ9A3W.0 size=1048576 2024-09-12T00:27:54.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.904+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~SFWMSBUZ9A3W.1 size=420256 2024-09-12T00:27:54.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.912+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=SFWMSBUZ9A3W tag=PJ4WM25P6KFJ type=write size=2517408 2024-09-12T00:27:54.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.920+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~93LSPFVDZX4N.0 size=749549 2024-09-12T00:27:54.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.920+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=93LSPFVDZX4N tag=UGB2WGWKOOV2 type=write size=1798125 2024-09-12T00:27:54.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.928+0000 7f712938c8c0 1 < suggested update operation key=KEMQ3H8LAUI9 tag=3ER6T3DE6GDD type=write size=492801 2024-09-12T00:27:54.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.936+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~3PCV308HUNDT.0 size=1048576 2024-09-12T00:27:54.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.940+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~3PCV308HUNDT.1 size=666109 2024-09-12T00:27:54.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.940+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=3PCV308HUNDT tag=S0YVZP1HMBZD type=write size=2763261 2024-09-12T00:27:54.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.940+0000 7f712938c8c0 1 < canceled part key=_multipart_Z2RYL03II71Z.2~DNYBVYW3U35O.0 size=1048576 2024-09-12T00:27:54.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.944+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~DNYBVYW3U35O.1 size=399080 2024-09-12T00:27:54.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.952+0000 7f712938c8c0 1 < canceled multipart upload key=Z2RYL03II71Z upload=DNYBVYW3U35O tag=TB1I3578BF21 type=write size=2496232 2024-09-12T00:27:54.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.956+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=K3MU42SSPNOV type=write size=502241 2024-09-12T00:27:54.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.960+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=RQ6R2OHA3Q0N type=del 2024-09-12T00:27:54.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.964+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~2RU2M61C4Y63.0 size=319963 2024-09-12T00:27:54.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.964+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=2RU2M61C4Y63 tag=35Z6JRUAO6YI type=write size=1368539 2024-09-12T00:27:54.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.968+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~XYWOOD0X9042.0 size=1048576 2024-09-12T00:27:54.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.972+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~XYWOOD0X9042.1 size=971453 2024-09-12T00:27:54.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.980+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=XYWOOD0X9042 tag=NQD1L7LLSF6D type=write size=3068605 2024-09-12T00:27:54.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.984+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=CK8LV024XE6G type=write size=563666 2024-09-12T00:27:54.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.992+0000 7f712938c8c0 1 < suggested remove operation key=5KVIIZS50CNT tag=2K5VU6SKWPB5 type=del 2024-09-12T00:27:54.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:54.996+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=YMK5CERL1LP8 type=del size=54355 2024-09-12T00:27:54.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.000+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~380NC2NB67G3.0 size=1048576 2024-09-12T00:27:55.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.000+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~380NC2NB67G3.1 size=1048063 2024-09-12T00:27:55.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.008+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=380NC2NB67G3 tag=FAO0L4MJPL2S type=write size=3145215 2024-09-12T00:27:55.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.012+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=2LVCLG4FTPJC type=write size=1003576 2024-09-12T00:27:55.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.016+0000 7f712938c8c0 1 < completed write operation key=7X45VJAQO7PF tag=NFRCM573JZD3 type=write size=183784 2024-09-12T00:27:55.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.020+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=113GG155SEHW type=del size=225732 2024-09-12T00:27:55.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.024+0000 7f712938c8c0 1 < completed write operation key=QL3FL4J9TKY4 tag=VV8UQ3X2P9R0 type=write size=277447 2024-09-12T00:27:55.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.028+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=4P182RUISSXE type=del size=1926410 2024-09-12T00:27:55.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.032+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~6XDFR2J0HTI8.0 size=697484 2024-09-12T00:27:55.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.040+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=6XDFR2J0HTI8 tag=5KDC4PE73WJM type=write size=1746060 2024-09-12T00:27:55.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.044+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=JJCFCOXEOCCT type=del size=3564337 2024-09-12T00:27:55.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.048+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~5P9D8BXHU3J7.0 size=1048576 2024-09-12T00:27:55.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.052+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~5P9D8BXHU3J7.1 size=901816 2024-09-12T00:27:55.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.056+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=5P9D8BXHU3J7 tag=SJ1P74NJKQH7 type=write size=2998968 2024-09-12T00:27:55.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.060+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=XV45SSP6N2NK type=del size=369603 2024-09-12T00:27:55.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.068+0000 7f712938c8c0 1 < suggested update operation key=ZP88X00LMVSS tag=XPSXIUG1P6LI type=del size=978199 2024-09-12T00:27:55.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.072+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=KBKT0X77V0H8 type=del size=2238025 2024-09-12T00:27:55.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.076+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=2Z35DWSQDJWR type=del 2024-09-12T00:27:55.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.080+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=1WBLL8P7IZLQ type=del size=4032388 2024-09-12T00:27:55.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.084+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~3JNDZTJBEDS6.0 size=692774 2024-09-12T00:27:55.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.088+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=3JNDZTJBEDS6 tag=E2O55GF3HVM8 type=write size=1741350 2024-09-12T00:27:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.092+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=S58JVFM6US1V type=del size=3394726 2024-09-12T00:27:55.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.100+0000 7f712938c8c0 1 < completed write operation key=GZON46MODQZO tag=XQ1V4TH5SZAE type=write size=699938 2024-09-12T00:27:55.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.104+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=GDNWK8N5XU8N type=del size=123433 2024-09-12T00:27:55.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.108+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~QJCYWRCA82HV.0 size=1048576 2024-09-12T00:27:55.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.112+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~QJCYWRCA82HV.1 size=1048576 2024-09-12T00:27:55.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.112+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~QJCYWRCA82HV.2 size=649154 2024-09-12T00:27:55.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.120+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=QJCYWRCA82HV tag=66M8QGY5ET0P type=write size=3794882 2024-09-12T00:27:55.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.124+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=ZS9K1M68R312 type=del size=3552017 2024-09-12T00:27:55.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.128+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~93LSPFVDZX4N.0 size=749549 2024-09-12T00:27:55.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.136+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=93LSPFVDZX4N tag=UGB2WGWKOOV2 type=write size=1798125 2024-09-12T00:27:55.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.140+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=AJ5XSYMO0QF0 type=del size=3895197 2024-09-12T00:27:55.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.144+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~3PCV308HUNDT.0 size=1048576 2024-09-12T00:27:55.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.144+0000 7f712938c8c0 1 < canceled part key=_multipart_UAJEZUYXN2R0.2~3PCV308HUNDT.1 size=666109 2024-09-12T00:27:55.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.148+0000 7f712938c8c0 1 < canceled multipart upload key=UAJEZUYXN2R0 upload=3PCV308HUNDT tag=S0YVZP1HMBZD type=write size=2763261 2024-09-12T00:27:55.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.156+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~3T2R4S964BKZ.0 size=1048576 2024-09-12T00:27:55.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.160+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~3T2R4S964BKZ.1 size=553406 2024-09-12T00:27:55.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.160+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=3T2R4S964BKZ tag=NTHOF0GFWJU6 type=write size=2650558 2024-09-12T00:27:55.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.164+0000 7f712938c8c0 1 < completed write operation key=QG0W04PRTQNP tag=K3MU42SSPNOV type=write size=502241 2024-09-12T00:27:55.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.172+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~IIU1XJXQ5BZS.0 size=1048576 2024-09-12T00:27:55.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.176+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~IIU1XJXQ5BZS.1 size=819844 2024-09-12T00:27:55.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.176+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=IIU1XJXQ5BZS tag=TSV9H1SAOSYC type=write size=2916996 2024-09-12T00:27:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.180+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~2RU2M61C4Y63.0 size=319963 2024-09-12T00:27:55.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.184+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=2RU2M61C4Y63 tag=35Z6JRUAO6YI type=write size=1368539 2024-09-12T00:27:55.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.192+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~GQC8UNTSCJQX.0 size=1048576 2024-09-12T00:27:55.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.196+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~GQC8UNTSCJQX.1 size=953221 2024-09-12T00:27:55.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.196+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=GQC8UNTSCJQX tag=OMU6RCTA4LYE type=write size=3050373 2024-09-12T00:27:55.203 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.204+0000 7f712938c8c0 1 < suggested remove operation key=Z2RYL03II71Z tag=CK8LV024XE6G type=write 2024-09-12T00:27:55.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.212+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~ZHP630I6VFMO.0 size=1048576 2024-09-12T00:27:55.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.212+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~ZHP630I6VFMO.1 size=225126 2024-09-12T00:27:55.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.212+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=ZHP630I6VFMO tag=ELI5WDTR8TCT type=write size=2322278 2024-09-12T00:27:55.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.216+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=YMK5CERL1LP8 type=del 2024-09-12T00:27:55.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.220+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=TLRL1XXRCR7D type=del size=2971461 2024-09-12T00:27:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.228+0000 7f712938c8c0 1 < completed write operation key=9751RNPPQJBO tag=2LVCLG4FTPJC type=write size=1003576 2024-09-12T00:27:55.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.228+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=KASTUT7FX4H7 type=write size=3326 2024-09-12T00:27:55.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.236+0000 7f712938c8c0 1 < suggested remove operation key=N69XPNN6Y6HZ tag=113GG155SEHW type=del 2024-09-12T00:27:55.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.248+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~L0PJ9SSX70WY.0 size=291619 2024-09-12T00:27:55.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.248+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=L0PJ9SSX70WY tag=GGTTV46476P1 type=write size=1340195 2024-09-12T00:27:55.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.260+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=4P182RUISSXE type=del 2024-09-12T00:27:55.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.264+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=86HIL9ZF98UW type=write size=938849 2024-09-12T00:27:55.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.268+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=JJCFCOXEOCCT type=del 2024-09-12T00:27:55.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.272+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=3YH5T3VI3VS0 type=write size=626285 2024-09-12T00:27:55.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.272+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=XV45SSP6N2NK type=del 2024-09-12T00:27:55.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.280+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~CN3HC72DQ7O4.0 size=1048576 2024-09-12T00:27:55.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.284+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~CN3HC72DQ7O4.1 size=189009 2024-09-12T00:27:55.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.284+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=CN3HC72DQ7O4 tag=1W1SPCA4P09R type=write size=2286161 2024-09-12T00:27:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.288+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=KBKT0X77V0H8 type=del 2024-09-12T00:27:55.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.292+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~31WMOQF4FQ4W.0 size=1048576 2024-09-12T00:27:55.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.296+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~31WMOQF4FQ4W.1 size=627763 2024-09-12T00:27:55.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.296+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=31WMOQF4FQ4W tag=7QHZD09H42HW type=write size=2724915 2024-09-12T00:27:55.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.300+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=1WBLL8P7IZLQ type=del 2024-09-12T00:27:55.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.308+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~YGDZ7R8VKNCH.0 size=1048576 2024-09-12T00:27:55.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.308+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~YGDZ7R8VKNCH.1 size=444273 2024-09-12T00:27:55.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.308+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=YGDZ7R8VKNCH tag=ZL0KC8G0QIMX type=write size=2541425 2024-09-12T00:27:55.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.312+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=S58JVFM6US1V type=del 2024-09-12T00:27:55.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.316+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=7V2Z9NRRM2Q0 type=del size=2175332 2024-09-12T00:27:55.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.320+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=GDNWK8N5XU8N type=del 2024-09-12T00:27:55.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.324+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=EV329IZBIMFF type=del size=513548 2024-09-12T00:27:55.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.328+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=ZS9K1M68R312 type=del 2024-09-12T00:27:55.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.332+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=ZH3N5D1UY2N2 type=del size=2929702 2024-09-12T00:27:55.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.336+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=AJ5XSYMO0QF0 type=del 2024-09-12T00:27:55.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.344+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~KNBUXUMBXO74.0 size=697610 2024-09-12T00:27:55.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.344+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=KNBUXUMBXO74 tag=FS5I9GK7QVX7 type=write size=1746186 2024-09-12T00:27:55.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.348+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~3T2R4S964BKZ.0 size=1048576 2024-09-12T00:27:55.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.352+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~3T2R4S964BKZ.1 size=553406 2024-09-12T00:27:55.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.356+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=3T2R4S964BKZ tag=NTHOF0GFWJU6 type=write size=2650558 2024-09-12T00:27:55.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.364+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~9ND1WM9NG46O.0 size=1048576 2024-09-12T00:27:55.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.364+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~9ND1WM9NG46O.1 size=1048576 2024-09-12T00:27:55.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.368+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~9ND1WM9NG46O.2 size=985940 2024-09-12T00:27:55.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.368+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=9ND1WM9NG46O tag=Q8RPXUWEQM02 type=write size=4131668 2024-09-12T00:27:55.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.372+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~IIU1XJXQ5BZS.0 size=1048576 2024-09-12T00:27:55.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.372+0000 7f712938c8c0 1 < canceled part key=_multipart_BH2YHXHVEZCH.2~IIU1XJXQ5BZS.1 size=819844 2024-09-12T00:27:55.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.380+0000 7f712938c8c0 1 < canceled multipart upload key=BH2YHXHVEZCH upload=IIU1XJXQ5BZS tag=TSV9H1SAOSYC type=write size=2916996 2024-09-12T00:27:55.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.380+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=IGY2H64EG3SI type=del size=695570 2024-09-12T00:27:55.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.384+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~GQC8UNTSCJQX.0 size=1048576 2024-09-12T00:27:55.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.388+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~GQC8UNTSCJQX.1 size=953221 2024-09-12T00:27:55.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.396+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=GQC8UNTSCJQX tag=OMU6RCTA4LYE type=write size=3050373 2024-09-12T00:27:55.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.400+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~7AX8K5RGY3U8.0 size=1048576 2024-09-12T00:27:55.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.404+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~7AX8K5RGY3U8.1 size=68462 2024-09-12T00:27:55.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.404+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=7AX8K5RGY3U8 tag=C0ROLENY85KI type=write size=2165614 2024-09-12T00:27:55.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.408+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~ZHP630I6VFMO.0 size=1048576 2024-09-12T00:27:55.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.412+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~ZHP630I6VFMO.1 size=225126 2024-09-12T00:27:55.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.420+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=ZHP630I6VFMO tag=ELI5WDTR8TCT type=write size=2322278 2024-09-12T00:27:55.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.424+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~1EZWIX7XMATG.0 size=1048576 2024-09-12T00:27:55.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.428+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~1EZWIX7XMATG.1 size=1048576 2024-09-12T00:27:55.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.432+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~1EZWIX7XMATG.2 size=37259 2024-09-12T00:27:55.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.432+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=1EZWIX7XMATG tag=N7YLWAG2VB46 type=write size=3182987 2024-09-12T00:27:55.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.436+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=TLRL1XXRCR7D type=del 2024-09-12T00:27:55.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.444+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~7OSS6ZZWFF6H.0 size=1048576 2024-09-12T00:27:55.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.444+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~7OSS6ZZWFF6H.1 size=658951 2024-09-12T00:27:55.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.444+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=7OSS6ZZWFF6H tag=7LEC4VQKTV9L type=write size=2756103 2024-09-12T00:27:55.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.448+0000 7f712938c8c0 -1 < failed to complete operation key=N69XPNN6Y6HZ tag=KASTUT7FX4H7 type=write size=3326: (22) Invalid argument 2024-09-12T00:27:55.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.456+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~JPWOQ5ME3ZTC.0 size=1048576 2024-09-12T00:27:55.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.460+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~JPWOQ5ME3ZTC.1 size=519686 2024-09-12T00:27:55.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.460+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=JPWOQ5ME3ZTC tag=9O01NVI425VL type=write size=2616838 2024-09-12T00:27:55.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.464+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~L0PJ9SSX70WY.0 size=291619 2024-09-12T00:27:55.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.468+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=L0PJ9SSX70WY tag=GGTTV46476P1 type=write size=1340195 2024-09-12T00:27:55.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.472+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=GBOOMZIF538T type=del size=2882234 2024-09-12T00:27:55.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.476+0000 7f712938c8c0 1 < completed write operation key=04RL082VPLIM tag=86HIL9ZF98UW type=write size=938849 2024-09-12T00:27:55.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.480+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=VGZ0KCMBX51M type=del size=3647200 2024-09-12T00:27:55.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.488+0000 7f712938c8c0 1 < suggested update operation key=9HX9GER6OKVI tag=3YH5T3VI3VS0 type=write size=626285 2024-09-12T00:27:55.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.492+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=9E9P4EUF0IQY type=write size=413774 2024-09-12T00:27:55.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.496+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~CN3HC72DQ7O4.0 size=1048576 2024-09-12T00:27:55.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.500+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~CN3HC72DQ7O4.1 size=189009 2024-09-12T00:27:55.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.504+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=CN3HC72DQ7O4 tag=1W1SPCA4P09R type=write size=2286161 2024-09-12T00:27:55.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.508+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=RR4ER32VC1TX type=del size=3047969 2024-09-12T00:27:55.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.512+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~31WMOQF4FQ4W.0 size=1048576 2024-09-12T00:27:55.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.516+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~31WMOQF4FQ4W.1 size=627763 2024-09-12T00:27:55.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.524+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=31WMOQF4FQ4W tag=7QHZD09H42HW type=write size=2724915 2024-09-12T00:27:55.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.528+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=GIRIC2OQAW1I type=del size=1583517 2024-09-12T00:27:55.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.532+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~YGDZ7R8VKNCH.0 size=1048576 2024-09-12T00:27:55.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.532+0000 7f712938c8c0 1 < canceled part key=_multipart_04RL082VPLIM.2~YGDZ7R8VKNCH.1 size=444273 2024-09-12T00:27:55.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.536+0000 7f712938c8c0 1 < canceled multipart upload key=04RL082VPLIM upload=YGDZ7R8VKNCH tag=ZL0KC8G0QIMX type=write size=2541425 2024-09-12T00:27:55.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.544+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~UA97NP2TUF9Y.0 size=1048576 2024-09-12T00:27:55.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.548+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~UA97NP2TUF9Y.1 size=1048576 2024-09-12T00:27:55.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.548+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~UA97NP2TUF9Y.2 size=866740 2024-09-12T00:27:55.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.548+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=UA97NP2TUF9Y tag=JWWGWH43FYOD type=write size=4012468 2024-09-12T00:27:55.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.552+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=7V2Z9NRRM2Q0 type=del 2024-09-12T00:27:55.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.556+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=TSOQV79RKFO6 type=write size=71569 2024-09-12T00:27:55.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.564+0000 7f712938c8c0 1 < suggested remove operation key=ULE6S9Y6DS62 tag=EV329IZBIMFF type=del 2024-09-12T00:27:55.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.572+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~G3QYFTT1EQE8.0 size=1048576 2024-09-12T00:27:55.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.576+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~G3QYFTT1EQE8.1 size=1048576 2024-09-12T00:27:55.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.576+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~G3QYFTT1EQE8.2 size=420488 2024-09-12T00:27:55.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.576+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=G3QYFTT1EQE8 tag=IBHTRQL5Y4EP type=write size=3566216 2024-09-12T00:27:55.585 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.584+0000 7f712938c8c0 1 < suggested remove operation key=T1H3O6A6HBQH tag=ZH3N5D1UY2N2 type=del 2024-09-12T00:27:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.592+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~LI5ZJ947ZHG3.0 size=1048576 2024-09-12T00:27:55.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.596+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~LI5ZJ947ZHG3.1 size=453093 2024-09-12T00:27:55.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.596+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=LI5ZJ947ZHG3 tag=V432Y155ZGI6 type=write size=2550245 2024-09-12T00:27:55.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.600+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~KNBUXUMBXO74.0 size=697610 2024-09-12T00:27:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.612+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=KNBUXUMBXO74 tag=FS5I9GK7QVX7 type=write size=1746186 2024-09-12T00:27:55.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.620+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~OGN6IOHK2TF5.0 size=1048576 2024-09-12T00:27:55.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.620+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~OGN6IOHK2TF5.1 size=1048576 2024-09-12T00:27:55.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.624+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~OGN6IOHK2TF5.2 size=206447 2024-09-12T00:27:55.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.624+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=OGN6IOHK2TF5 tag=UPXXY2SG801R type=write size=3352175 2024-09-12T00:27:55.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.628+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~9ND1WM9NG46O.0 size=1048576 2024-09-12T00:27:55.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.632+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~9ND1WM9NG46O.1 size=1048576 2024-09-12T00:27:55.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.636+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~9ND1WM9NG46O.2 size=985940 2024-09-12T00:27:55.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.640+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=9ND1WM9NG46O tag=Q8RPXUWEQM02 type=write size=4131668 2024-09-12T00:27:55.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.648+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~JHO85FHWR9C6.0 size=607547 2024-09-12T00:27:55.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.648+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=JHO85FHWR9C6 tag=NHEO9O3RSI6R type=write size=1656123 2024-09-12T00:27:55.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.656+0000 7f712938c8c0 1 < suggested remove operation key=5KVIIZS50CNT tag=IGY2H64EG3SI type=del 2024-09-12T00:27:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.660+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=NS30FITO03JV type=del size=192746 2024-09-12T00:27:55.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.664+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~7AX8K5RGY3U8.0 size=1048576 2024-09-12T00:27:55.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.668+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~7AX8K5RGY3U8.1 size=68462 2024-09-12T00:27:55.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.672+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=7AX8K5RGY3U8 tag=C0ROLENY85KI type=write size=2165614 2024-09-12T00:27:55.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.676+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=A0MALRDDK57V type=del size=493933 2024-09-12T00:27:55.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.680+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~1EZWIX7XMATG.0 size=1048576 2024-09-12T00:27:55.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.680+0000 7f712938c8c0 1 < canceled part key=_multipart_T0C4ZDQB13X0.2~1EZWIX7XMATG.1 size=1048576 2024-09-12T00:27:55.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.684+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~1EZWIX7XMATG.2 size=37259 2024-09-12T00:27:55.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.688+0000 7f712938c8c0 1 < canceled multipart upload key=T0C4ZDQB13X0 upload=1EZWIX7XMATG tag=N7YLWAG2VB46 type=write size=3182987 2024-09-12T00:27:55.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.696+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~FGT4BJ675KIZ.0 size=1048576 2024-09-12T00:27:55.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.696+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~FGT4BJ675KIZ.1 size=820266 2024-09-12T00:27:55.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.700+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=FGT4BJ675KIZ tag=XVGGKBBNCG47 type=write size=2917418 2024-09-12T00:27:55.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.700+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~7OSS6ZZWFF6H.0 size=1048576 2024-09-12T00:27:55.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.704+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~7OSS6ZZWFF6H.1 size=658951 2024-09-12T00:27:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.712+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=7OSS6ZZWFF6H tag=7LEC4VQKTV9L type=write size=2756103 2024-09-12T00:27:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.712+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=EH0RMC32KQE8 type=del size=2035754 2024-09-12T00:27:55.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.716+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~JPWOQ5ME3ZTC.0 size=1048576 2024-09-12T00:27:55.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.720+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~JPWOQ5ME3ZTC.1 size=519686 2024-09-12T00:27:55.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.728+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=JPWOQ5ME3ZTC tag=9O01NVI425VL type=write size=2616838 2024-09-12T00:27:55.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.732+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~4C2NGCG02TV6.0 size=918843 2024-09-12T00:27:55.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.732+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=4C2NGCG02TV6 tag=BCSVLV95EPPB type=write size=1967419 2024-09-12T00:27:55.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.740+0000 7f712938c8c0 1 < suggested remove operation key=0QZKHZTVP3RQ tag=GBOOMZIF538T type=del 2024-09-12T00:27:55.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.748+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~YYK0LDLN8UDB.0 size=1048576 2024-09-12T00:27:55.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.748+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~YYK0LDLN8UDB.1 size=511097 2024-09-12T00:27:55.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.748+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=YYK0LDLN8UDB tag=CLSXQACDZVK7 type=write size=2608249 2024-09-12T00:27:55.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.756+0000 7f712938c8c0 1 < suggested update operation key=W01PFMFNYLED tag=VGZ0KCMBX51M type=del size=3647200 2024-09-12T00:27:55.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.760+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=LT92BL8D9QVQ type=del size=1674612 2024-09-12T00:27:55.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.764+0000 7f712938c8c0 -1 < no bi entry to suggest for operation key=ULE6S9Y6DS62 tag=9E9P4EUF0IQY type=write size=413774: (2) No such file or directory 2024-09-12T00:27:55.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.768+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=TBXZ31X54PQ4 type=del size=1907074 2024-09-12T00:27:55.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.772+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=RR4ER32VC1TX type=del 2024-09-12T00:27:55.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.776+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=JG8GSY066ULW type=del size=4426 2024-09-12T00:27:55.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.780+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=GIRIC2OQAW1I type=del 2024-09-12T00:27:55.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.780+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=9Q1W3CYT7VTX type=del size=1777959 2024-09-12T00:27:55.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.784+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~UA97NP2TUF9Y.0 size=1048576 2024-09-12T00:27:55.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.788+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~UA97NP2TUF9Y.1 size=1048576 2024-09-12T00:27:55.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.792+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~UA97NP2TUF9Y.2 size=866740 2024-09-12T00:27:55.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.796+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=UA97NP2TUF9Y tag=JWWGWH43FYOD type=write size=4012468 2024-09-12T00:27:55.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.800+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=LVNGJZU3G132 type=write size=277301 2024-09-12T00:27:55.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.804+0000 7f712938c8c0 1 < canceled operation key=BH2YHXHVEZCH tag=TSOQV79RKFO6 type=write size=71569 2024-09-12T00:27:55.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.812+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~4NEQB7D71ZTU.0 size=767403 2024-09-12T00:27:55.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.812+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=4NEQB7D71ZTU tag=I1HDW8H16C40 type=write size=1815979 2024-09-12T00:27:55.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.816+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~G3QYFTT1EQE8.0 size=1048576 2024-09-12T00:27:55.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.820+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~G3QYFTT1EQE8.1 size=1048576 2024-09-12T00:27:55.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.824+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~G3QYFTT1EQE8.2 size=420488 2024-09-12T00:27:55.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.828+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=G3QYFTT1EQE8 tag=IBHTRQL5Y4EP type=write size=3566216 2024-09-12T00:27:55.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.832+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=ZYENGTTDIXRV type=del size=1489095 2024-09-12T00:27:55.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.836+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~LI5ZJ947ZHG3.0 size=1048576 2024-09-12T00:27:55.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.840+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~LI5ZJ947ZHG3.1 size=453093 2024-09-12T00:27:55.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.848+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=LI5ZJ947ZHG3 tag=V432Y155ZGI6 type=write size=2550245 2024-09-12T00:27:55.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.852+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~91FBZAC191P0.0 size=1048576 2024-09-12T00:27:55.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.856+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~91FBZAC191P0.1 size=1048576 2024-09-12T00:27:55.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.860+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~91FBZAC191P0.2 size=560932 2024-09-12T00:27:55.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.860+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=91FBZAC191P0 tag=OAUOYCF05N7E type=write size=3706660 2024-09-12T00:27:55.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.864+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~OGN6IOHK2TF5.0 size=1048576 2024-09-12T00:27:55.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.868+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~OGN6IOHK2TF5.1 size=1048576 2024-09-12T00:27:55.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.868+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~OGN6IOHK2TF5.2 size=206447 2024-09-12T00:27:55.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.876+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=OGN6IOHK2TF5 tag=UPXXY2SG801R type=write size=3352175 2024-09-12T00:27:55.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.880+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=31G9R5GZ7BP6 type=del size=625329 2024-09-12T00:27:55.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.884+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~JHO85FHWR9C6.0 size=607547 2024-09-12T00:27:55.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.888+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=JHO85FHWR9C6 tag=NHEO9O3RSI6R type=write size=1656123 2024-09-12T00:27:55.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.892+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=VB8VNP0M3MNB type=write size=28750 2024-09-12T00:27:55.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.896+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=NS30FITO03JV type=del 2024-09-12T00:27:55.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.904+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~DHSI0OKWIBL6.0 size=1048576 2024-09-12T00:27:55.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.908+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~DHSI0OKWIBL6.1 size=867590 2024-09-12T00:27:55.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.908+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=DHSI0OKWIBL6 tag=TXAP9KJOQ7EA type=write size=2964742 2024-09-12T00:27:55.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.912+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=A0MALRDDK57V type=del 2024-09-12T00:27:55.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.916+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=QLL55FM2IHY9 type=del size=3379576 2024-09-12T00:27:55.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.920+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~FGT4BJ675KIZ.0 size=1048576 2024-09-12T00:27:55.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.920+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~FGT4BJ675KIZ.1 size=820266 2024-09-12T00:27:55.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.928+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=FGT4BJ675KIZ tag=XVGGKBBNCG47 type=write size=2917418 2024-09-12T00:27:55.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.936+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~DS9V8MO2DLD3.0 size=1048576 2024-09-12T00:27:55.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.936+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~DS9V8MO2DLD3.1 size=6014 2024-09-12T00:27:55.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.936+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=DS9V8MO2DLD3 tag=TI0679TI73Y1 type=write size=2103166 2024-09-12T00:27:55.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.944+0000 7f712938c8c0 1 < suggested update operation key=9751RNPPQJBO tag=EH0RMC32KQE8 type=del size=2035754 2024-09-12T00:27:55.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.956+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=WDSTUHSY7XQI type=write size=25979 2024-09-12T00:27:55.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.956+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~4C2NGCG02TV6.0 size=918843 2024-09-12T00:27:55.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.964+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=4C2NGCG02TV6 tag=BCSVLV95EPPB type=write size=1967419 2024-09-12T00:27:55.968 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.968+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=RPDZOI5EDWQZ type=write size=966190 2024-09-12T00:27:55.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.968+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~YYK0LDLN8UDB.0 size=1048576 2024-09-12T00:27:55.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.972+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~YYK0LDLN8UDB.1 size=511097 2024-09-12T00:27:55.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.980+0000 7f712938c8c0 1 < canceled multipart upload key=9751RNPPQJBO upload=YYK0LDLN8UDB tag=CLSXQACDZVK7 type=write size=2608249 2024-09-12T00:27:55.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.984+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~D6M6M5P03QCN.0 size=1048576 2024-09-12T00:27:55.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.988+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~D6M6M5P03QCN.1 size=455859 2024-09-12T00:27:55.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.988+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=D6M6M5P03QCN tag=VDL7EE3QK1N1 type=write size=2553011 2024-09-12T00:27:55.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:55.996+0000 7f712938c8c0 1 < suggested update operation key=04RL082VPLIM tag=LT92BL8D9QVQ type=del size=1674612 2024-09-12T00:27:56.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.000+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=9SNOA2Y3419U type=del size=2553185 2024-09-12T00:27:56.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.004+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=TBXZ31X54PQ4 type=del 2024-09-12T00:27:56.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.008+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=9Y9N2YNECO7F type=del size=2163865 2024-09-12T00:27:56.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.016+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=JG8GSY066ULW type=del 2024-09-12T00:27:56.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.016+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=27MW84JUOXCI type=write size=971699 2024-09-12T00:27:56.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.020+0000 7f712938c8c0 1 < canceled operation key=UAJEZUYXN2R0 tag=9Q1W3CYT7VTX type=del size=1777959 2024-09-12T00:27:56.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.024+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=33EBV7JYMI5M type=write size=354231 2024-09-12T00:27:56.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.028+0000 7f712938c8c0 1 < completed write operation key=MUNSUH4BMZNP tag=LVNGJZU3G132 type=write size=277301 2024-09-12T00:27:56.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.036+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~RYK7GWBIM78W.0 size=1048576 2024-09-12T00:27:56.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.040+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~RYK7GWBIM78W.1 size=753516 2024-09-12T00:27:56.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.040+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=RYK7GWBIM78W tag=D3T3AVYZX1AM type=write size=2850668 2024-09-12T00:27:56.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.044+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~4NEQB7D71ZTU.0 size=767403 2024-09-12T00:27:56.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.052+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=4NEQB7D71ZTU tag=I1HDW8H16C40 type=write size=1815979 2024-09-12T00:27:56.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.056+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~4CWY5YWX03TR.0 size=55618 2024-09-12T00:27:56.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.056+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=4CWY5YWX03TR tag=TQ00OAWQLKHY type=write size=1104194 2024-09-12T00:27:56.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.060+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=ZYENGTTDIXRV type=del 2024-09-12T00:27:56.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.064+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=GLO90V3V6AJI type=write size=393491 2024-09-12T00:27:56.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.072+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~91FBZAC191P0.0 size=1048576 2024-09-12T00:27:56.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.072+0000 7f712938c8c0 1 < canceled part key=_multipart_W9YW6AS1RL48.2~91FBZAC191P0.1 size=1048576 2024-09-12T00:27:56.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.072+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~91FBZAC191P0.2 size=560932 2024-09-12T00:27:56.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.080+0000 7f712938c8c0 1 < canceled multipart upload key=W9YW6AS1RL48 upload=91FBZAC191P0 tag=OAUOYCF05N7E type=write size=3706660 2024-09-12T00:27:56.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.084+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=KHC2QV0Z0J5M type=del size=45707 2024-09-12T00:27:56.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.088+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=31G9R5GZ7BP6 type=del 2024-09-12T00:27:56.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.092+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=BLCDJ76ZE551 type=del size=787912 2024-09-12T00:27:56.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.096+0000 7f712938c8c0 1 < canceled operation key=F7T79C7MZX35 tag=VB8VNP0M3MNB type=write size=28750 2024-09-12T00:27:56.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.100+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=JVTCSXS675CG type=del size=2705769 2024-09-12T00:27:56.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.104+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~DHSI0OKWIBL6.0 size=1048576 2024-09-12T00:27:56.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.108+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~DHSI0OKWIBL6.1 size=867590 2024-09-12T00:27:56.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.112+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=DHSI0OKWIBL6 tag=TXAP9KJOQ7EA type=write size=2964742 2024-09-12T00:27:56.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.120+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~D9S1D6NK0O0O.0 size=1048576 2024-09-12T00:27:56.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.124+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~D9S1D6NK0O0O.1 size=1048576 2024-09-12T00:27:56.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.128+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~D9S1D6NK0O0O.2 size=849108 2024-09-12T00:27:56.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.128+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=D9S1D6NK0O0O tag=6GOTE668Y8H9 type=write size=3994836 2024-09-12T00:27:56.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.132+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=QLL55FM2IHY9 type=del 2024-09-12T00:27:56.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.136+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=YL7J50YDDS10 type=del size=1663746 2024-09-12T00:27:56.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.140+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~DS9V8MO2DLD3.0 size=1048576 2024-09-12T00:27:56.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.140+0000 7f712938c8c0 1 < canceled part key=_multipart_T1H3O6A6HBQH.2~DS9V8MO2DLD3.1 size=6014 2024-09-12T00:27:56.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.144+0000 7f712938c8c0 1 < canceled multipart upload key=T1H3O6A6HBQH upload=DS9V8MO2DLD3 tag=TI0679TI73Y1 type=write size=2103166 2024-09-12T00:27:56.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.148+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=HB1VLE1CQJBT type=del size=2921828 2024-09-12T00:27:56.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.156+0000 7f712938c8c0 1 < suggested update operation key=T1H3O6A6HBQH tag=WDSTUHSY7XQI type=write size=25979 2024-09-12T00:27:56.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.164+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~16N7DPZ5NQ6J.0 size=1048576 2024-09-12T00:27:56.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.164+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~16N7DPZ5NQ6J.1 size=1048576 2024-09-12T00:27:56.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.168+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~16N7DPZ5NQ6J.2 size=271466 2024-09-12T00:27:56.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.168+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=16N7DPZ5NQ6J tag=BKZD2P2R2Z4Q type=write size=3417194 2024-09-12T00:27:56.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.176+0000 7f712938c8c0 1 < suggested remove operation key=MUNSUH4BMZNP tag=RPDZOI5EDWQZ type=write 2024-09-12T00:27:56.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.180+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=8146OY9TIL7V type=del size=3192002 2024-09-12T00:27:56.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.184+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~D6M6M5P03QCN.0 size=1048576 2024-09-12T00:27:56.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.188+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~D6M6M5P03QCN.1 size=455859 2024-09-12T00:27:56.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.192+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=D6M6M5P03QCN tag=VDL7EE3QK1N1 type=write size=2553011 2024-09-12T00:27:56.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.196+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=O4NUM9VMPT1X type=del size=3854022 2024-09-12T00:27:56.203 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.204+0000 7f712938c8c0 1 < suggested remove operation key=9YZP0TIRWWRF tag=9SNOA2Y3419U type=del 2024-09-12T00:27:56.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.208+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=1AP3DCVPYY61 type=del size=1737210 2024-09-12T00:27:56.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.212+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=9Y9N2YNECO7F type=del 2024-09-12T00:27:56.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.216+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=7W837910E7E5 type=del size=2493682 2024-09-12T00:27:56.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.220+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=27MW84JUOXCI type=write size=971699 2024-09-12T00:27:56.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.224+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~XCWFY75AD063.0 size=255812 2024-09-12T00:27:56.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.224+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=XCWFY75AD063 tag=EVVURU7OW2GV type=write size=1304388 2024-09-12T00:27:56.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.228+0000 7f712938c8c0 1 < completed write operation key=9HX9GER6OKVI tag=33EBV7JYMI5M type=write size=354231 2024-09-12T00:27:56.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.236+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=56EVWHA1ZPII type=del size=1074990 2024-09-12T00:27:56.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.236+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~RYK7GWBIM78W.0 size=1048576 2024-09-12T00:27:56.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.240+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~RYK7GWBIM78W.1 size=753516 2024-09-12T00:27:56.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.248+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=RYK7GWBIM78W tag=D3T3AVYZX1AM type=write size=2850668 2024-09-12T00:27:56.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.252+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=JAUZEGPU7GJU type=write size=819114 2024-09-12T00:27:56.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.256+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~4CWY5YWX03TR.0 size=55618 2024-09-12T00:27:56.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.260+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=4CWY5YWX03TR tag=TQ00OAWQLKHY type=write size=1104194 2024-09-12T00:27:56.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.264+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=MKFMBR0ECHDZ type=del size=320754 2024-09-12T00:27:56.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.268+0000 7f712938c8c0 1 < completed write operation key=9751RNPPQJBO tag=GLO90V3V6AJI type=write size=393491 2024-09-12T00:27:56.272 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.272+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=9OI2MYYBXEOM type=del size=1459268 2024-09-12T00:27:56.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.276+0000 7f712938c8c0 1 < canceled operation key=WP4RJQVZVEE2 tag=KHC2QV0Z0J5M type=del size=45707 2024-09-12T00:27:56.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.284+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~VHJQ3Z6BINQT.0 size=1048576 2024-09-12T00:27:56.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.284+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~VHJQ3Z6BINQT.1 size=1048576 2024-09-12T00:27:56.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.288+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~VHJQ3Z6BINQT.2 size=937771 2024-09-12T00:27:56.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.288+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=VHJQ3Z6BINQT tag=NW9A0MZCGPQ4 type=write size=4083499 2024-09-12T00:27:56.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.292+0000 7f712938c8c0 1 < canceled operation key=7X45VJAQO7PF tag=BLCDJ76ZE551 type=del size=787912 2024-09-12T00:27:56.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.296+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=VPW6G23GS0FW type=del size=4192333 2024-09-12T00:27:56.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.304+0000 7f712938c8c0 1 < suggested remove operation key=9751RNPPQJBO tag=JVTCSXS675CG type=del 2024-09-12T00:27:56.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.312+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~2CETVFDGA0DT.0 size=1048576 2024-09-12T00:27:56.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.320+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~2CETVFDGA0DT.1 size=399288 2024-09-12T00:27:56.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.320+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=2CETVFDGA0DT tag=7TWZQU0FULV8 type=write size=2496440 2024-09-12T00:27:56.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.320+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~D9S1D6NK0O0O.0 size=1048576 2024-09-12T00:27:56.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.324+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~D9S1D6NK0O0O.1 size=1048576 2024-09-12T00:27:56.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.324+0000 7f712938c8c0 1 < canceled part key=_multipart_BH2YHXHVEZCH.2~D9S1D6NK0O0O.2 size=849108 2024-09-12T00:27:56.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.332+0000 7f712938c8c0 1 < canceled multipart upload key=BH2YHXHVEZCH upload=D9S1D6NK0O0O tag=6GOTE668Y8H9 type=write size=3994836 2024-09-12T00:27:56.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.336+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=OFFMJYOYM60Y type=del size=1731775 2024-09-12T00:27:56.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.340+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=YL7J50YDDS10 type=del 2024-09-12T00:27:56.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.344+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=KPNSB1EH3D0V type=write size=803936 2024-09-12T00:27:56.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.348+0000 7f712938c8c0 1 < suggested update operation key=A8L061CQ0M0J tag=HB1VLE1CQJBT type=del size=2921828 2024-09-12T00:27:56.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.356+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~YGGCFJ7NDXHU.0 size=631583 2024-09-12T00:27:56.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.356+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=YGGCFJ7NDXHU tag=SF48Y5NM3V5I type=write size=1680159 2024-09-12T00:27:56.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.360+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~16N7DPZ5NQ6J.0 size=1048576 2024-09-12T00:27:56.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.364+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~16N7DPZ5NQ6J.1 size=1048576 2024-09-12T00:27:56.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.364+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~16N7DPZ5NQ6J.2 size=271466 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.372+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=16N7DPZ5NQ6J tag=BKZD2P2R2Z4Q type=write size=3417194 2024-09-12T00:27:56.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.376+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=SFVZA32OJ5VY type=del size=2562807 2024-09-12T00:27:56.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.380+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=8146OY9TIL7V type=del 2024-09-12T00:27:56.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.388+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~RZQ4IVCITP1T.0 size=1048576 2024-09-12T00:27:56.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.392+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~RZQ4IVCITP1T.1 size=26855 2024-09-12T00:27:56.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.392+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=RZQ4IVCITP1T tag=I9QLSGXOKZXU type=write size=2124007 2024-09-12T00:27:56.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.396+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=O4NUM9VMPT1X type=del 2024-09-12T00:27:56.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.400+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~IJJMFZHRZM2U.0 size=1048576 2024-09-12T00:27:56.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.404+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~IJJMFZHRZM2U.1 size=304002 2024-09-12T00:27:56.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.404+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=IJJMFZHRZM2U tag=ULOHXFU8KROV type=write size=2401154 2024-09-12T00:27:56.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.408+0000 7f712938c8c0 -1 < failed to complete operation key=A8L061CQ0M0J tag=1AP3DCVPYY61 type=del size=1737210: (22) Invalid argument 2024-09-12T00:27:56.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.412+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=PAIANPDDH4BR type=del size=3091779 2024-09-12T00:27:56.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.416+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=7W837910E7E5 type=del 2024-09-12T00:27:56.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.420+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=BA8DLLZQKOQ9 type=del size=3475804 2024-09-12T00:27:56.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.424+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~XCWFY75AD063.0 size=255812 2024-09-12T00:27:56.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.428+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=XCWFY75AD063 tag=EVVURU7OW2GV type=write size=1304388 2024-09-12T00:27:56.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.432+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=0DL252O35MC1 type=del size=877415 2024-09-12T00:27:56.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.436+0000 7f712938c8c0 1 < canceled operation key=UAJEZUYXN2R0 tag=56EVWHA1ZPII type=del size=1074990 2024-09-12T00:27:56.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.444+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~LVKQ197BNJIR.0 size=1048576 2024-09-12T00:27:56.447 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.448+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~LVKQ197BNJIR.1 size=1038889 2024-09-12T00:27:56.447 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.448+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=LVKQ197BNJIR tag=1EW7Y0YIVECL type=write size=3136041 2024-09-12T00:27:56.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.452+0000 7f712938c8c0 1 < completed write operation key=KNGB14TWW6XC tag=JAUZEGPU7GJU type=write size=819114 2024-09-12T00:27:56.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.456+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~T11UCR6J0N01.0 size=1048576 2024-09-12T00:27:56.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.460+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~T11UCR6J0N01.1 size=1048576 2024-09-12T00:27:56.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.464+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~T11UCR6J0N01.2 size=801102 2024-09-12T00:27:56.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.464+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=T11UCR6J0N01 tag=BNM4IDK1KLUV type=write size=3946830 2024-09-12T00:27:56.468 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.468+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=MKFMBR0ECHDZ type=del 2024-09-12T00:27:56.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.472+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=RQ50W8TKVFJS type=del size=3709822 2024-09-12T00:27:56.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.476+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=9OI2MYYBXEOM type=del 2024-09-12T00:27:56.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.480+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=19PDGVBUAYP3 type=del size=3803726 2024-09-12T00:27:56.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.484+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~VHJQ3Z6BINQT.0 size=1048576 2024-09-12T00:27:56.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.488+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~VHJQ3Z6BINQT.1 size=1048576 2024-09-12T00:27:56.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.492+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~VHJQ3Z6BINQT.2 size=937771 2024-09-12T00:27:56.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.500+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=VHJQ3Z6BINQT tag=NW9A0MZCGPQ4 type=write size=4083499 2024-09-12T00:27:56.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.504+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~2FRQ2W35J943.0 size=1048576 2024-09-12T00:27:56.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.508+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~2FRQ2W35J943.1 size=1008765 2024-09-12T00:27:56.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.508+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=2FRQ2W35J943 tag=8KC6PZTVSBEF type=write size=3105917 2024-09-12T00:27:56.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.512+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=VPW6G23GS0FW type=del 2024-09-12T00:27:56.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.516+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=MYNO5RL80QIM type=del size=1954715 2024-09-12T00:27:56.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.520+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~2CETVFDGA0DT.0 size=1048576 2024-09-12T00:27:56.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.524+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~2CETVFDGA0DT.1 size=399288 2024-09-12T00:27:56.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.532+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=2CETVFDGA0DT tag=7TWZQU0FULV8 type=write size=2496440 2024-09-12T00:27:56.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.540+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~8BUJ3UYF8XAY.0 size=1048576 2024-09-12T00:27:56.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.540+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~8BUJ3UYF8XAY.1 size=551468 2024-09-12T00:27:56.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.540+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=8BUJ3UYF8XAY tag=K53RX4V17L0L type=write size=2648620 2024-09-12T00:27:56.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.544+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=OFFMJYOYM60Y type=del 2024-09-12T00:27:56.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.548+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=3EWCIM18DLK0 type=del size=2002642 2024-09-12T00:27:56.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.556+0000 7f712938c8c0 1 < suggested update operation key=G0065P5NOJ2F tag=KPNSB1EH3D0V type=write size=803936 2024-09-12T00:27:56.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.564+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~TQPJRYV4M8QP.0 size=1048576 2024-09-12T00:27:56.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.568+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~TQPJRYV4M8QP.1 size=333963 2024-09-12T00:27:56.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.568+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=TQPJRYV4M8QP tag=JMWCP8VQ69JX type=write size=2431115 2024-09-12T00:27:56.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.572+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~YGGCFJ7NDXHU.0 size=631583 2024-09-12T00:27:56.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.576+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=YGGCFJ7NDXHU tag=SF48Y5NM3V5I type=write size=1680159 2024-09-12T00:27:56.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.580+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=PPDEBP7C86QS type=del size=284528 2024-09-12T00:27:56.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.584+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=SFVZA32OJ5VY type=del 2024-09-12T00:27:56.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.588+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~9X94B4QPKY7C.0 size=1048576 2024-09-12T00:27:56.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.592+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~9X94B4QPKY7C.1 size=1048576 2024-09-12T00:27:56.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.596+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~9X94B4QPKY7C.2 size=84063 2024-09-12T00:27:56.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.596+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=9X94B4QPKY7C tag=2VT0B5BO5MU2 type=write size=3229791 2024-09-12T00:27:56.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.600+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~RZQ4IVCITP1T.0 size=1048576 2024-09-12T00:27:56.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.600+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~RZQ4IVCITP1T.1 size=26855 2024-09-12T00:27:56.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.608+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=RZQ4IVCITP1T tag=I9QLSGXOKZXU type=write size=2124007 2024-09-12T00:27:56.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.612+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=634A6G9S4F8Z type=del size=2028527 2024-09-12T00:27:56.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.616+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~IJJMFZHRZM2U.0 size=1048576 2024-09-12T00:27:56.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.620+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~IJJMFZHRZM2U.1 size=304002 2024-09-12T00:27:56.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.624+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=IJJMFZHRZM2U tag=ULOHXFU8KROV type=write size=2401154 2024-09-12T00:27:56.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.628+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=1CUR2Q34LR3C type=del size=4190965 2024-09-12T00:27:56.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.632+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=PAIANPDDH4BR type=del 2024-09-12T00:27:56.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.632+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=WT0KQ9HM2XQ6 type=del size=3198664 2024-09-12T00:27:56.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.636+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=BA8DLLZQKOQ9 type=del 2024-09-12T00:27:56.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.640+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=C6MXKY9HFS8L type=del size=1410291 2024-09-12T00:27:56.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.648+0000 7f712938c8c0 1 < suggested update operation key=04RL082VPLIM tag=0DL252O35MC1 type=del size=877415 2024-09-12T00:27:56.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.656+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~JWUFQGZ1ZUXU.0 size=1048576 2024-09-12T00:27:56.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.656+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~JWUFQGZ1ZUXU.1 size=238910 2024-09-12T00:27:56.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.656+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=JWUFQGZ1ZUXU tag=U3Y03IYXWUD8 type=write size=2336062 2024-09-12T00:27:56.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.660+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~LVKQ197BNJIR.0 size=1048576 2024-09-12T00:27:56.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.668+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~LVKQ197BNJIR.1 size=1038889 2024-09-12T00:27:56.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.672+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=LVKQ197BNJIR tag=1EW7Y0YIVECL type=write size=3136041 2024-09-12T00:27:56.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.676+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=PFJ4EWO7KDBJ type=del size=3829845 2024-09-12T00:27:56.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.680+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~T11UCR6J0N01.0 size=1048576 2024-09-12T00:27:56.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.680+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~T11UCR6J0N01.1 size=1048576 2024-09-12T00:27:56.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.684+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~T11UCR6J0N01.2 size=801102 2024-09-12T00:27:56.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.688+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=T11UCR6J0N01 tag=BNM4IDK1KLUV type=write size=3946830 2024-09-12T00:27:56.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.692+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=8FM1A7PI212A type=del size=3709113 2024-09-12T00:27:56.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.696+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=RQ50W8TKVFJS type=del 2024-09-12T00:27:56.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.700+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=ZG1ZGO834HMG type=write size=534743 2024-09-12T00:27:56.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.704+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=19PDGVBUAYP3 type=del 2024-09-12T00:27:56.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.708+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=U18LER9G3QSK type=del size=3778514 2024-09-12T00:27:56.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.712+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~2FRQ2W35J943.0 size=1048576 2024-09-12T00:27:56.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.712+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~2FRQ2W35J943.1 size=1008765 2024-09-12T00:27:56.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.720+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=2FRQ2W35J943 tag=8KC6PZTVSBEF type=write size=3105917 2024-09-12T00:27:56.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.724+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=C9OUMFHMPUN5 type=del size=491653 2024-09-12T00:27:56.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.732+0000 7f712938c8c0 1 < suggested remove operation key=T0C4ZDQB13X0 tag=MYNO5RL80QIM type=del 2024-09-12T00:27:56.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.736+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=EV2AD9FZHNNM type=write size=492566 2024-09-12T00:27:56.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.740+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~8BUJ3UYF8XAY.0 size=1048576 2024-09-12T00:27:56.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.740+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~8BUJ3UYF8XAY.1 size=551468 2024-09-12T00:27:56.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.748+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=8BUJ3UYF8XAY tag=K53RX4V17L0L type=write size=2648620 2024-09-12T00:27:56.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.752+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=J7F6C3VSAWIM type=write size=628502 2024-09-12T00:27:56.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.756+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=3EWCIM18DLK0 type=del 2024-09-12T00:27:56.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.760+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~87088ADUX9NZ.0 size=1048576 2024-09-12T00:27:56.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.764+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~87088ADUX9NZ.1 size=1048576 2024-09-12T00:27:56.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.768+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~87088ADUX9NZ.2 size=391439 2024-09-12T00:27:56.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.768+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=87088ADUX9NZ tag=VT4JNQG7UZQG type=write size=3537167 2024-09-12T00:27:56.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.768+0000 7f712938c8c0 1 < canceled part key=_multipart_L2SR6IAW0D38.2~TQPJRYV4M8QP.0 size=1048576 2024-09-12T00:27:56.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.772+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~TQPJRYV4M8QP.1 size=333963 2024-09-12T00:27:56.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.776+0000 7f712938c8c0 1 < canceled multipart upload key=L2SR6IAW0D38 upload=TQPJRYV4M8QP tag=JMWCP8VQ69JX type=write size=2431115 2024-09-12T00:27:56.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.780+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=EW8ZA69NZ6RJ type=write size=491123 2024-09-12T00:27:56.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.788+0000 7f712938c8c0 1 < suggested update operation key=QL3FL4J9TKY4 tag=PPDEBP7C86QS type=del size=284528 2024-09-12T00:27:56.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.792+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~XPNN9UXFDCCP.0 size=878422 2024-09-12T00:27:56.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.792+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=XPNN9UXFDCCP tag=6D67LA45K9G5 type=write size=1926998 2024-09-12T00:27:56.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.796+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~9X94B4QPKY7C.0 size=1048576 2024-09-12T00:27:56.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.800+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~9X94B4QPKY7C.1 size=1048576 2024-09-12T00:27:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.804+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~9X94B4QPKY7C.2 size=84063 2024-09-12T00:27:56.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.808+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=9X94B4QPKY7C tag=2VT0B5BO5MU2 type=write size=3229791 2024-09-12T00:27:56.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.816+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~V9Q0OVFSZFUF.0 size=1048576 2024-09-12T00:27:56.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.820+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~V9Q0OVFSZFUF.1 size=435222 2024-09-12T00:27:56.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.820+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=V9Q0OVFSZFUF tag=PIUA6TZA84RN type=write size=2532374 2024-09-12T00:27:56.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.824+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=634A6G9S4F8Z type=del 2024-09-12T00:27:56.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.828+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=UZS3HP72DY5S type=del size=2351619 2024-09-12T00:27:56.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.832+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=1CUR2Q34LR3C type=del 2024-09-12T00:27:56.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.836+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~UB0GQ5U9P6NK.0 size=1048576 2024-09-12T00:27:56.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.840+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~UB0GQ5U9P6NK.1 size=335713 2024-09-12T00:27:56.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.840+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=UB0GQ5U9P6NK tag=1O1FN2QBXQNX type=write size=2432865 2024-09-12T00:27:56.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.844+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=WT0KQ9HM2XQ6 type=del 2024-09-12T00:27:56.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.848+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=Y8TO5XI8ZN66 type=write size=349496 2024-09-12T00:27:56.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.852+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=C6MXKY9HFS8L type=del 2024-09-12T00:27:56.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.856+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=KFUBBV9OMIWP type=del size=2753175 2024-09-12T00:27:56.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.860+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~JWUFQGZ1ZUXU.0 size=1048576 2024-09-12T00:27:56.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.860+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~JWUFQGZ1ZUXU.1 size=238910 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.868+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=JWUFQGZ1ZUXU tag=U3Y03IYXWUD8 type=write size=2336062 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.872+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=NRYPEZ0G0VG7 type=del size=617434 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.880+0000 7f712938c8c0 1 < suggested remove operation key=KEMQ3H8LAUI9 tag=PFJ4EWO7KDBJ type=del 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.884+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=RDMJG3RAHKSH type=del size=3374195 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.884+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=8FM1A7PI212A type=del 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.888+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=WMQ27O9NHMOV type=del size=3973366 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.892+0000 7f712938c8c0 1 < completed write operation key=HPM9GFRASWIV tag=ZG1ZGO834HMG type=write size=534743 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.896+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=5A54ZNMNEMT4 type=del size=3423797 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.900+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=U18LER9G3QSK type=del 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.904+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=MPHTRFQ4UQ1K type=write size=677155 2024-09-12T00:27:56.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.912+0000 7f712938c8c0 1 < suggested update operation key=A8L061CQ0M0J tag=C9OUMFHMPUN5 type=del size=491653 2024-09-12T00:27:56.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.916+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=QO7CG6LY2HK5 type=write size=850886 2024-09-12T00:27:56.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.920+0000 7f712938c8c0 1 < completed write operation key=MUNSUH4BMZNP tag=EV2AD9FZHNNM type=write size=492566 2024-09-12T00:27:56.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.924+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=W3YI4HVIIOPC type=write size=317210 2024-09-12T00:27:56.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.928+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=J7F6C3VSAWIM type=write size=628502 2024-09-12T00:27:56.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.932+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=AO51QSKXNV7K type=del size=2950810 2024-09-12T00:27:56.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.932+0000 7f712938c8c0 1 < canceled part key=_multipart_QL3FL4J9TKY4.2~87088ADUX9NZ.0 size=1048576 2024-09-12T00:27:56.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.936+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~87088ADUX9NZ.1 size=1048576 2024-09-12T00:27:56.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.940+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~87088ADUX9NZ.2 size=391439 2024-09-12T00:27:56.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.944+0000 7f712938c8c0 1 < canceled multipart upload key=QL3FL4J9TKY4 upload=87088ADUX9NZ tag=VT4JNQG7UZQG type=write size=3537167 2024-09-12T00:27:56.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.948+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=PY90P9ABT0LW type=del size=1051100 2024-09-12T00:27:56.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.952+0000 7f712938c8c0 1 < completed write operation key=MUNSUH4BMZNP tag=EW8ZA69NZ6RJ type=write size=491123 2024-09-12T00:27:56.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.960+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=EBHNWXUX9A1I type=del size=3175308 2024-09-12T00:27:56.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.964+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~XPNN9UXFDCCP.0 size=878422 2024-09-12T00:27:56.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.968+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=XPNN9UXFDCCP tag=6D67LA45K9G5 type=write size=1926998 2024-09-12T00:27:56.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.972+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=BOQPGD6JG613 type=write size=144372 2024-09-12T00:27:56.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.976+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~V9Q0OVFSZFUF.0 size=1048576 2024-09-12T00:27:56.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.980+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~V9Q0OVFSZFUF.1 size=435222 2024-09-12T00:27:56.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.984+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=V9Q0OVFSZFUF tag=PIUA6TZA84RN type=write size=2532374 2024-09-12T00:27:56.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.988+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=KDKWYUA7O08Z type=write size=863662 2024-09-12T00:27:56.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.992+0000 7f712938c8c0 1 < canceled operation key=T0C4ZDQB13X0 tag=UZS3HP72DY5S type=del size=2351619 2024-09-12T00:27:56.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:56.996+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=S9YRFBKIU620 type=del size=3586287 2024-09-12T00:27:57.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.000+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~UB0GQ5U9P6NK.0 size=1048576 2024-09-12T00:27:57.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.004+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~UB0GQ5U9P6NK.1 size=335713 2024-09-12T00:27:57.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.012+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=UB0GQ5U9P6NK tag=1O1FN2QBXQNX type=write size=2432865 2024-09-12T00:27:57.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.016+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=K0ZEUAO28Z1O type=del size=2827936 2024-09-12T00:27:57.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.020+0000 7f712938c8c0 1 < completed write operation key=G0065P5NOJ2F tag=Y8TO5XI8ZN66 type=write size=349496 2024-09-12T00:27:57.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.024+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=4RFU6P3JRSUH type=del size=3469538 2024-09-12T00:27:57.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.028+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=KFUBBV9OMIWP type=del 2024-09-12T00:27:57.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.032+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=SRQITJ4GGM6Q type=del size=3438069 2024-09-12T00:27:57.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.036+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=NRYPEZ0G0VG7 type=del 2024-09-12T00:27:57.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.036+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=668FS100QOBL type=write size=293817 2024-09-12T00:27:57.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.040+0000 7f712938c8c0 1 < canceled operation key=MUNSUH4BMZNP tag=RDMJG3RAHKSH type=del size=3374195 2024-09-12T00:27:57.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.044+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=VO78BFC3WIQM type=del size=3047755 2024-09-12T00:27:57.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.048+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=WMQ27O9NHMOV type=del 2024-09-12T00:27:57.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.056+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~J3WZJCCQ5JIE.0 size=1048576 2024-09-12T00:27:57.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.060+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~J3WZJCCQ5JIE.1 size=114856 2024-09-12T00:27:57.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.060+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=J3WZJCCQ5JIE tag=II2RKYULZSJP type=write size=2212008 2024-09-12T00:27:57.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.064+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=5A54ZNMNEMT4 type=del 2024-09-12T00:27:57.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.068+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=65QHK9JTFX1L type=del size=1285425 2024-09-12T00:27:57.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.072+0000 7f712938c8c0 1 < completed write operation key=9751RNPPQJBO tag=MPHTRFQ4UQ1K type=write size=677155 2024-09-12T00:27:57.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.080+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~2NX0XJ6GD9GP.0 size=1048576 2024-09-12T00:27:57.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.084+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~2NX0XJ6GD9GP.1 size=1048576 2024-09-12T00:27:57.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.088+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~2NX0XJ6GD9GP.2 size=1002123 2024-09-12T00:27:57.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.088+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=2NX0XJ6GD9GP tag=J5FLONPQTTN0 type=write size=4147851 2024-09-12T00:27:57.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.092+0000 7f712938c8c0 1 < completed write operation key=W01PFMFNYLED tag=QO7CG6LY2HK5 type=write size=850886 2024-09-12T00:27:57.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.096+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=O6LW24TYICGF type=del size=1911120 2024-09-12T00:27:57.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.100+0000 7f712938c8c0 1 < canceled operation key=QL3FL4J9TKY4 tag=W3YI4HVIIOPC type=write size=317210 2024-09-12T00:27:57.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.108+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~FJ50PAFT0W01.0 size=1048576 2024-09-12T00:27:57.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.108+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~FJ50PAFT0W01.1 size=741292 2024-09-12T00:27:57.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.108+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=FJ50PAFT0W01 tag=G8THCSD4PIVZ type=write size=2838444 2024-09-12T00:27:57.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.112+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=AO51QSKXNV7K type=del 2024-09-12T00:27:57.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.120+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~XPXUOIW1UBX0.0 size=1346 2024-09-12T00:27:57.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.120+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=XPXUOIW1UBX0 tag=I85CSOADJOMT type=write size=1049922 2024-09-12T00:27:57.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.124+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=PY90P9ABT0LW type=del 2024-09-12T00:27:57.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.132+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~E2VLN5Z38PPJ.0 size=1048576 2024-09-12T00:27:57.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.136+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~E2VLN5Z38PPJ.1 size=1048576 2024-09-12T00:27:57.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.136+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~E2VLN5Z38PPJ.2 size=835946 2024-09-12T00:27:57.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.136+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=E2VLN5Z38PPJ tag=PLBI501CV6L6 type=write size=3981674 2024-09-12T00:27:57.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.140+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=EBHNWXUX9A1I type=del 2024-09-12T00:27:57.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.148+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~NIHY134DRNAC.0 size=1048576 2024-09-12T00:27:57.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.152+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~NIHY134DRNAC.1 size=751898 2024-09-12T00:27:57.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.152+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=NIHY134DRNAC tag=GB335UHT2WXB type=write size=2849050 2024-09-12T00:27:57.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.160+0000 7f712938c8c0 1 < suggested update operation key=9751RNPPQJBO tag=BOQPGD6JG613 type=write size=144372 2024-09-12T00:27:57.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.164+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=447TLBG1RW4T type=del size=3923084 2024-09-12T00:27:57.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.168+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=KDKWYUA7O08Z type=write size=863662 2024-09-12T00:27:57.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.172+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~JFJN1CK9JO1W.0 size=1048576 2024-09-12T00:27:57.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.176+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~JFJN1CK9JO1W.1 size=1048576 2024-09-12T00:27:57.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.180+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~JFJN1CK9JO1W.2 size=904862 2024-09-12T00:27:57.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.180+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=JFJN1CK9JO1W tag=DDN9ZOHIEPMC type=write size=4050590 2024-09-12T00:27:57.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.184+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=S9YRFBKIU620 type=del 2024-09-12T00:27:57.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.188+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=RFYJH3LMUN9C type=del size=1621419 2024-09-12T00:27:57.191 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.192+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=K0ZEUAO28Z1O type=del 2024-09-12T00:27:57.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.196+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=8YHB1KOF9XH7 type=write size=966225 2024-09-12T00:27:57.203 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.204+0000 7f712938c8c0 1 < suggested update operation key=UAJEZUYXN2R0 tag=4RFU6P3JRSUH type=del size=3469538 2024-09-12T00:27:57.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.212+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~C9CBGK7ITX8Y.0 size=1048576 2024-09-12T00:27:57.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.212+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~C9CBGK7ITX8Y.1 size=820696 2024-09-12T00:27:57.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.212+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=C9CBGK7ITX8Y tag=EQEW7IK3K0ZD type=write size=2917848 2024-09-12T00:27:57.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.220+0000 7f712938c8c0 1 < suggested remove operation key=9YZP0TIRWWRF tag=SRQITJ4GGM6Q type=del 2024-09-12T00:27:57.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.228+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~BA6Y5AUR54X9.0 size=503138 2024-09-12T00:27:57.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.228+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=BA6Y5AUR54X9 tag=W17L2J57CTJE type=write size=1551714 2024-09-12T00:27:57.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.232+0000 7f712938c8c0 -1 < failed to complete operation key=9751RNPPQJBO tag=668FS100QOBL type=write size=293817: (22) Invalid argument 2024-09-12T00:27:57.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.236+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=Z218PJR9KUXY type=del size=1205749 2024-09-12T00:27:57.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.236+0000 7f712938c8c0 -1 < no bi entry to suggest for operation key=9YZP0TIRWWRF tag=VO78BFC3WIQM type=del size=3047755: (2) No such file or directory 2024-09-12T00:27:57.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.240+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=A9VJDE1ZN7I5 type=del size=645990 2024-09-12T00:27:57.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.244+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~J3WZJCCQ5JIE.0 size=1048576 2024-09-12T00:27:57.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.248+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~J3WZJCCQ5JIE.1 size=114856 2024-09-12T00:27:57.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.256+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=J3WZJCCQ5JIE tag=II2RKYULZSJP type=write size=2212008 2024-09-12T00:27:57.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.260+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~03I0VW9R53LK.0 size=1048576 2024-09-12T00:27:57.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.264+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~03I0VW9R53LK.1 size=1048576 2024-09-12T00:27:57.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.268+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~03I0VW9R53LK.2 size=19507 2024-09-12T00:27:57.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.268+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=03I0VW9R53LK tag=QMTZ7PZ4YGSX type=write size=3165235 2024-09-12T00:27:57.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.272+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=65QHK9JTFX1L type=del 2024-09-12T00:27:57.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.276+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=7RYLN4WDEWL0 type=del size=1892528 2024-09-12T00:27:57.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.280+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~2NX0XJ6GD9GP.0 size=1048576 2024-09-12T00:27:57.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.280+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~2NX0XJ6GD9GP.1 size=1048576 2024-09-12T00:27:57.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.280+0000 7f712938c8c0 1 < canceled part key=_multipart_MUNSUH4BMZNP.2~2NX0XJ6GD9GP.2 size=1002123 2024-09-12T00:27:57.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.288+0000 7f712938c8c0 1 < canceled multipart upload key=MUNSUH4BMZNP upload=2NX0XJ6GD9GP tag=J5FLONPQTTN0 type=write size=4147851 2024-09-12T00:27:57.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.292+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~OXAR07U18DYI.0 size=1048576 2024-09-12T00:27:57.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.296+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~OXAR07U18DYI.1 size=1048576 2024-09-12T00:27:57.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.300+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~OXAR07U18DYI.2 size=727832 2024-09-12T00:27:57.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.300+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=OXAR07U18DYI tag=VW9HUHVBJTHG type=write size=3873560 2024-09-12T00:27:57.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.304+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=O6LW24TYICGF type=del 2024-09-12T00:27:57.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.308+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~VZ7XFKZD6MQJ.0 size=1048576 2024-09-12T00:27:57.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.312+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~VZ7XFKZD6MQJ.1 size=1048576 2024-09-12T00:27:57.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.316+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~VZ7XFKZD6MQJ.2 size=580162 2024-09-12T00:27:57.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.316+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=VZ7XFKZD6MQJ tag=KWDNREU9GQHS type=write size=3725890 2024-09-12T00:27:57.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.320+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~FJ50PAFT0W01.0 size=1048576 2024-09-12T00:27:57.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.320+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~FJ50PAFT0W01.1 size=741292 2024-09-12T00:27:57.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.328+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=FJ50PAFT0W01 tag=G8THCSD4PIVZ type=write size=2838444 2024-09-12T00:27:57.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.332+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=JM9B6A41NARQ type=del size=3425725 2024-09-12T00:27:57.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.336+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~XPXUOIW1UBX0.0 size=1346 2024-09-12T00:27:57.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.340+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=XPXUOIW1UBX0 tag=I85CSOADJOMT type=write size=1049922 2024-09-12T00:27:57.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.344+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=RPSWJNW5XGU5 type=del size=663953 2024-09-12T00:27:57.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.348+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~E2VLN5Z38PPJ.0 size=1048576 2024-09-12T00:27:57.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.352+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~E2VLN5Z38PPJ.1 size=1048576 2024-09-12T00:27:57.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.352+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~E2VLN5Z38PPJ.2 size=835946 2024-09-12T00:27:57.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.360+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=E2VLN5Z38PPJ tag=PLBI501CV6L6 type=write size=3981674 2024-09-12T00:27:57.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.368+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=JXZHON3OUPIJ type=del size=455440 2024-09-12T00:27:57.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.372+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~NIHY134DRNAC.0 size=1048576 2024-09-12T00:27:57.376 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.376+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~NIHY134DRNAC.1 size=751898 2024-09-12T00:27:57.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.384+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=NIHY134DRNAC tag=GB335UHT2WXB type=write size=2849050 2024-09-12T00:27:57.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.388+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=WFZMITCGPWJ2 type=del size=3770069 2024-09-12T00:27:57.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.392+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=447TLBG1RW4T type=del 2024-09-12T00:27:57.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.392+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=EOFG8747V6QL type=del size=2257197 2024-09-12T00:27:57.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.396+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~JFJN1CK9JO1W.0 size=1048576 2024-09-12T00:27:57.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.400+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~JFJN1CK9JO1W.1 size=1048576 2024-09-12T00:27:57.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.404+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~JFJN1CK9JO1W.2 size=904862 2024-09-12T00:27:57.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.408+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=JFJN1CK9JO1W tag=DDN9ZOHIEPMC type=write size=4050590 2024-09-12T00:27:57.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.416+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~Z6I260YHQ4PM.0 size=1048576 2024-09-12T00:27:57.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.416+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~Z6I260YHQ4PM.1 size=649210 2024-09-12T00:27:57.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.416+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=Z6I260YHQ4PM tag=5L7VCTPQU3EB type=write size=2746362 2024-09-12T00:27:57.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.420+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=RFYJH3LMUN9C type=del 2024-09-12T00:27:57.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.428+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~PMT0ZSORL0NI.0 size=1048576 2024-09-12T00:27:57.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.432+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~PMT0ZSORL0NI.1 size=133027 2024-09-12T00:27:57.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.432+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=PMT0ZSORL0NI tag=TCRYUTUEIVHS type=write size=2230179 2024-09-12T00:27:57.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.436+0000 7f712938c8c0 1 < canceled operation key=GZON46MODQZO tag=8YHB1KOF9XH7 type=write size=966225 2024-09-12T00:27:57.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.440+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=YXQFO6H11AZM type=del size=2120611 2024-09-12T00:27:57.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.444+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~C9CBGK7ITX8Y.0 size=1048576 2024-09-12T00:27:57.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.444+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~C9CBGK7ITX8Y.1 size=820696 2024-09-12T00:27:57.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.452+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=C9CBGK7ITX8Y tag=EQEW7IK3K0ZD type=write size=2917848 2024-09-12T00:27:57.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.456+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=8XQEBHG3ITLJ type=write size=491772 2024-09-12T00:27:57.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.460+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~BA6Y5AUR54X9.0 size=503138 2024-09-12T00:27:57.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.464+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=BA6Y5AUR54X9 tag=W17L2J57CTJE type=write size=1551714 2024-09-12T00:27:57.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.468+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=LA3ESSKK7Z6A type=write size=567607 2024-09-12T00:27:57.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.472+0000 7f712938c8c0 1 < canceled operation key=QG0W04PRTQNP tag=Z218PJR9KUXY type=del size=1205749 2024-09-12T00:27:57.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.476+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=NU2APTGXU2E1 type=del size=2755742 2024-09-12T00:27:57.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.480+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=A9VJDE1ZN7I5 type=del 2024-09-12T00:27:57.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.484+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=IVUOB53JJCRB type=del size=1062017 2024-09-12T00:27:57.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.488+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~03I0VW9R53LK.0 size=1048576 2024-09-12T00:27:57.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.492+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~03I0VW9R53LK.1 size=1048576 2024-09-12T00:27:57.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.496+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~03I0VW9R53LK.2 size=19507 2024-09-12T00:27:57.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.500+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=03I0VW9R53LK tag=QMTZ7PZ4YGSX type=write size=3165235 2024-09-12T00:27:57.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.508+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~X1IYM18UIDWB.0 size=262974 2024-09-12T00:27:57.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.508+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=X1IYM18UIDWB tag=P09XM6WERWLQ type=write size=1311550 2024-09-12T00:27:57.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.512+0000 7f712938c8c0 1 < suggested remove operation key=T1H3O6A6HBQH tag=7RYLN4WDEWL0 type=del 2024-09-12T00:27:57.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.516+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=CP7CBGLUCRVR type=del size=32255 2024-09-12T00:27:57.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.520+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~OXAR07U18DYI.0 size=1048576 2024-09-12T00:27:57.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.524+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~OXAR07U18DYI.1 size=1048576 2024-09-12T00:27:57.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.528+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~OXAR07U18DYI.2 size=727832 2024-09-12T00:27:57.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.532+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=OXAR07U18DYI tag=VW9HUHVBJTHG type=write size=3873560 2024-09-12T00:27:57.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.540+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~3L9DV4GJOHVD.0 size=172207 2024-09-12T00:27:57.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.540+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=3L9DV4GJOHVD tag=AC6G60WG4VUZ type=write size=1220783 2024-09-12T00:27:57.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.544+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~VZ7XFKZD6MQJ.0 size=1048576 2024-09-12T00:27:57.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.548+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~VZ7XFKZD6MQJ.1 size=1048576 2024-09-12T00:27:57.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.548+0000 7f712938c8c0 1 < canceled part key=_multipart_WP4RJQVZVEE2.2~VZ7XFKZD6MQJ.2 size=580162 2024-09-12T00:27:57.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.552+0000 7f712938c8c0 1 < canceled multipart upload key=WP4RJQVZVEE2 upload=VZ7XFKZD6MQJ tag=KWDNREU9GQHS type=write size=3725890 2024-09-12T00:27:57.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.556+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=TMVDYNPULX2M type=del size=3033635 2024-09-12T00:27:57.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.560+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=JM9B6A41NARQ type=del 2024-09-12T00:27:57.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.564+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=K5L8Q15JLUT8 type=del size=3461151 2024-09-12T00:27:57.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.568+0000 7f712938c8c0 1 < canceled operation key=V9K2307BGOKP tag=RPSWJNW5XGU5 type=del size=663953 2024-09-12T00:27:57.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.576+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~EHDKOX6DENV6.0 size=1048576 2024-09-12T00:27:57.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.576+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~EHDKOX6DENV6.1 size=1048576 2024-09-12T00:27:57.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.580+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~EHDKOX6DENV6.2 size=198005 2024-09-12T00:27:57.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.580+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=EHDKOX6DENV6 tag=AZMOEX89J81K type=write size=3343733 2024-09-12T00:27:57.585 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.584+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=JXZHON3OUPIJ type=del 2024-09-12T00:27:57.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.588+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=ZNIR91HSN95T type=del size=2932378 2024-09-12T00:27:57.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.592+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=WFZMITCGPWJ2 type=del 2024-09-12T00:27:57.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.600+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=6PY4KWILXWDC type=del size=2771943 2024-09-12T00:27:57.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.604+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=EOFG8747V6QL type=del 2024-09-12T00:27:57.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.608+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=UFM33CUPNJ3I type=write size=637455 2024-09-12T00:27:57.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.612+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~Z6I260YHQ4PM.0 size=1048576 2024-09-12T00:27:57.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.612+0000 7f712938c8c0 1 < canceled part key=_multipart_WP4RJQVZVEE2.2~Z6I260YHQ4PM.1 size=649210 2024-09-12T00:27:57.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.620+0000 7f712938c8c0 1 < canceled multipart upload key=WP4RJQVZVEE2 upload=Z6I260YHQ4PM tag=5L7VCTPQU3EB type=write size=2746362 2024-09-12T00:27:57.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.624+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~4IFPQVAKGGMH.0 size=1048576 2024-09-12T00:27:57.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.628+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~4IFPQVAKGGMH.1 size=970774 2024-09-12T00:27:57.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.628+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=4IFPQVAKGGMH tag=3MDZXXZIYPYQ type=write size=3067926 2024-09-12T00:27:57.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.632+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~PMT0ZSORL0NI.0 size=1048576 2024-09-12T00:27:57.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.636+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~PMT0ZSORL0NI.1 size=133027 2024-09-12T00:27:57.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.640+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=PMT0ZSORL0NI tag=TCRYUTUEIVHS type=write size=2230179 2024-09-12T00:27:57.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.644+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=AZQSW4GI5187 type=del size=642738 2024-09-12T00:27:57.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.648+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=YXQFO6H11AZM type=del 2024-09-12T00:27:57.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.652+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=0W2LE9P5JR82 type=del size=4147019 2024-09-12T00:27:57.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.656+0000 7f712938c8c0 1 < canceled operation key=QL3FL4J9TKY4 tag=8XQEBHG3ITLJ type=write size=491772 2024-09-12T00:27:57.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.660+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=PHBSFKH7G224 type=del size=1825305 2024-09-12T00:27:57.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.660+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=LA3ESSKK7Z6A type=write size=567607 2024-09-12T00:27:57.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.668+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~PXM184HMX2NC.0 size=95841 2024-09-12T00:27:57.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.668+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=PXM184HMX2NC tag=U7MXKAFICLDT type=write size=1144417 2024-09-12T00:27:57.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.672+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=NU2APTGXU2E1 type=del 2024-09-12T00:27:57.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.676+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=HISIGGC7FB2V type=del size=1776789 2024-09-12T00:27:57.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.680+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=IVUOB53JJCRB type=del 2024-09-12T00:27:57.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.684+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~09ABPCCKDS58.0 size=216295 2024-09-12T00:27:57.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.684+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=09ABPCCKDS58 tag=UWNXGPG1PBG6 type=write size=1264871 2024-09-12T00:27:57.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.688+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~X1IYM18UIDWB.0 size=262974 2024-09-12T00:27:57.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.696+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=X1IYM18UIDWB tag=P09XM6WERWLQ type=write size=1311550 2024-09-12T00:27:57.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.700+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~R4O9O6K22TLF.0 size=871937 2024-09-12T00:27:57.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.700+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=R4O9O6K22TLF tag=MXPYRZRSGHSV type=write size=1920513 2024-09-12T00:27:57.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.704+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=CP7CBGLUCRVR type=del 2024-09-12T00:27:57.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.716+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~WYPZ9M9T9ZLI.0 size=1048576 2024-09-12T00:27:57.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.720+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~WYPZ9M9T9ZLI.1 size=1033537 2024-09-12T00:27:57.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.720+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=WYPZ9M9T9ZLI tag=G2VDEMB0ZUGW type=write size=3130689 2024-09-12T00:27:57.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.724+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~3L9DV4GJOHVD.0 size=172207 2024-09-12T00:27:57.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.728+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=3L9DV4GJOHVD tag=AC6G60WG4VUZ type=write size=1220783 2024-09-12T00:27:57.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.736+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~X3VSP97P28X3.0 size=1048576 2024-09-12T00:27:57.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.740+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~X3VSP97P28X3.1 size=1048576 2024-09-12T00:27:57.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.740+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~X3VSP97P28X3.2 size=974467 2024-09-12T00:27:57.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.740+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=X3VSP97P28X3 tag=R8VRH7YVM5GJ type=write size=4120195 2024-09-12T00:27:57.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.744+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=TMVDYNPULX2M type=del 2024-09-12T00:27:57.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.752+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~XZYKMXCUWT2X.0 size=1048576 2024-09-12T00:27:57.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.756+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~XZYKMXCUWT2X.1 size=1000907 2024-09-12T00:27:57.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.756+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=XZYKMXCUWT2X tag=X3NXTZ5WO0SI type=write size=3098059 2024-09-12T00:27:57.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.760+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=K5L8Q15JLUT8 type=del 2024-09-12T00:27:57.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.764+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=MZJU9UR0YYC7 type=del size=1880038 2024-09-12T00:27:57.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.768+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~EHDKOX6DENV6.0 size=1048576 2024-09-12T00:27:57.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.768+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~EHDKOX6DENV6.1 size=1048576 2024-09-12T00:27:57.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.772+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~EHDKOX6DENV6.2 size=198005 2024-09-12T00:27:57.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.776+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=EHDKOX6DENV6 tag=AZMOEX89J81K type=write size=3343733 2024-09-12T00:27:57.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.784+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~ZE7S8BRAE1KO.0 size=1048576 2024-09-12T00:27:57.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.788+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~ZE7S8BRAE1KO.1 size=1048576 2024-09-12T00:27:57.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.788+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~ZE7S8BRAE1KO.2 size=615116 2024-09-12T00:27:57.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.788+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=ZE7S8BRAE1KO tag=05Y6M75WTCKG type=write size=3760844 2024-09-12T00:27:57.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.792+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=ZNIR91HSN95T type=del 2024-09-12T00:27:57.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.796+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=J6QH5PPCPGLS type=del size=3142328 2024-09-12T00:27:57.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.800+0000 7f712938c8c0 1 < canceled operation key=9YZP0TIRWWRF tag=6PY4KWILXWDC type=del size=2771943 2024-09-12T00:27:57.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.808+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~3S150UDQO1GV.0 size=1048576 2024-09-12T00:27:57.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.812+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~3S150UDQO1GV.1 size=970104 2024-09-12T00:27:57.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.812+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=3S150UDQO1GV tag=4TY0BDMRFJL6 type=write size=3067256 2024-09-12T00:27:57.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.816+0000 7f712938c8c0 1 < completed write operation key=QG0W04PRTQNP tag=UFM33CUPNJ3I type=write size=637455 2024-09-12T00:27:57.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.816+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=209PT3XBRV2W type=del size=1205209 2024-09-12T00:27:57.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.820+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~4IFPQVAKGGMH.0 size=1048576 2024-09-12T00:27:57.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.824+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~4IFPQVAKGGMH.1 size=970774 2024-09-12T00:27:57.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.828+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=4IFPQVAKGGMH tag=3MDZXXZIYPYQ type=write size=3067926 2024-09-12T00:27:57.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.832+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=XBEJHG5KK0MG type=del size=3964879 2024-09-12T00:27:57.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.836+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=AZQSW4GI5187 type=del 2024-09-12T00:27:57.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.840+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=AUKFEA3HODT2 type=del size=2169395 2024-09-12T00:27:57.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.844+0000 7f712938c8c0 1 < canceled operation key=A8L061CQ0M0J tag=0W2LE9P5JR82 type=del size=4147019 2024-09-12T00:27:57.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.848+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=Z30NZHIVJYW9 type=del size=1888649 2024-09-12T00:27:57.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.856+0000 7f712938c8c0 1 < suggested remove operation key=T1H3O6A6HBQH tag=PHBSFKH7G224 type=del 2024-09-12T00:27:57.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.860+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=WYFQNVFZ0BB5 type=del size=3605191 2024-09-12T00:27:57.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.864+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~PXM184HMX2NC.0 size=95841 2024-09-12T00:27:57.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.868+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=PXM184HMX2NC tag=U7MXKAFICLDT type=write size=1144417 2024-09-12T00:27:57.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.872+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=PS3XMYT8CLRT type=del size=3516267 2024-09-12T00:27:57.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.876+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=HISIGGC7FB2V type=del 2024-09-12T00:27:57.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.880+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=INGBL1UL0EQP type=del size=2811908 2024-09-12T00:27:57.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.884+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~09ABPCCKDS58.0 size=216295 2024-09-12T00:27:57.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.888+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=09ABPCCKDS58 tag=UWNXGPG1PBG6 type=write size=1264871 2024-09-12T00:27:57.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.896+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~0JGV7Z92Y5BX.0 size=453028 2024-09-12T00:27:57.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.896+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=0JGV7Z92Y5BX tag=P9U3KQ8WHREL type=write size=1501604 2024-09-12T00:27:57.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.900+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~R4O9O6K22TLF.0 size=871937 2024-09-12T00:27:57.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.904+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=R4O9O6K22TLF tag=MXPYRZRSGHSV type=write size=1920513 2024-09-12T00:27:57.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.908+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=M126S53I2UFR type=write size=93362 2024-09-12T00:27:57.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.912+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~WYPZ9M9T9ZLI.0 size=1048576 2024-09-12T00:27:57.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.916+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~WYPZ9M9T9ZLI.1 size=1033537 2024-09-12T00:27:57.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.924+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=WYPZ9M9T9ZLI tag=G2VDEMB0ZUGW type=write size=3130689 2024-09-12T00:27:57.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.928+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=P5NDJOAIK06A type=del size=3960777 2024-09-12T00:27:57.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.932+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~X3VSP97P28X3.0 size=1048576 2024-09-12T00:27:57.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.932+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~X3VSP97P28X3.1 size=1048576 2024-09-12T00:27:57.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.932+0000 7f712938c8c0 1 < canceled part key=_multipart_9751RNPPQJBO.2~X3VSP97P28X3.2 size=974467 2024-09-12T00:27:57.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.940+0000 7f712938c8c0 1 < canceled multipart upload key=9751RNPPQJBO upload=X3VSP97P28X3 tag=R8VRH7YVM5GJ type=write size=4120195 2024-09-12T00:27:57.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.944+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=PN6F977H0KDA type=write size=669148 2024-09-12T00:27:57.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.948+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~XZYKMXCUWT2X.0 size=1048576 2024-09-12T00:27:57.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.952+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~XZYKMXCUWT2X.1 size=1000907 2024-09-12T00:27:57.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.956+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=XZYKMXCUWT2X tag=X3NXTZ5WO0SI type=write size=3098059 2024-09-12T00:27:57.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.960+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=PMR5X2IWYICH type=del size=1592637 2024-09-12T00:27:57.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.964+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=MZJU9UR0YYC7 type=del 2024-09-12T00:27:57.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.968+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=RT85JSQZUTUO type=del size=889689 2024-09-12T00:27:57.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.972+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~ZE7S8BRAE1KO.0 size=1048576 2024-09-12T00:27:57.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.976+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~ZE7S8BRAE1KO.1 size=1048576 2024-09-12T00:27:57.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.980+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~ZE7S8BRAE1KO.2 size=615116 2024-09-12T00:27:57.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.984+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=ZE7S8BRAE1KO tag=05Y6M75WTCKG type=write size=3760844 2024-09-12T00:27:57.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.988+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=79FIYIOTVOEQ type=del size=2343866 2024-09-12T00:27:57.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.992+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=J6QH5PPCPGLS type=del 2024-09-12T00:27:57.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:57.996+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~VRKY2HLNCS9O.0 size=1048576 2024-09-12T00:27:58.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.000+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~VRKY2HLNCS9O.1 size=1048576 2024-09-12T00:27:58.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.004+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~VRKY2HLNCS9O.2 size=641384 2024-09-12T00:27:58.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.004+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=VRKY2HLNCS9O tag=3JBX119KW38P type=write size=3787112 2024-09-12T00:27:58.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.008+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~3S150UDQO1GV.0 size=1048576 2024-09-12T00:27:58.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.008+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~3S150UDQO1GV.1 size=970104 2024-09-12T00:27:58.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.016+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=3S150UDQO1GV tag=4TY0BDMRFJL6 type=write size=3067256 2024-09-12T00:27:58.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.020+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=14X4DO6HT6G7 type=del size=1999383 2024-09-12T00:27:58.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.024+0000 7f712938c8c0 1 < canceled operation key=A8L061CQ0M0J tag=209PT3XBRV2W type=del size=1205209 2024-09-12T00:27:58.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.028+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=XF5AHA0V2PVT type=del size=1845616 2024-09-12T00:27:58.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.036+0000 7f712938c8c0 1 < suggested update operation key=BH2YHXHVEZCH tag=XBEJHG5KK0MG type=del size=3964879 2024-09-12T00:27:58.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.040+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=MYZMFGPKSI5K type=del size=2497105 2024-09-12T00:27:58.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.044+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=AUKFEA3HODT2 type=del 2024-09-12T00:27:58.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.048+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=KGZND2V5BJ1U type=del size=1140296 2024-09-12T00:27:58.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.052+0000 7f712938c8c0 -1 < failed to complete operation key=T1H3O6A6HBQH tag=Z30NZHIVJYW9 type=del size=1888649: (22) Invalid argument 2024-09-12T00:27:58.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.060+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=GMQ7BKBI4YV9 type=del size=494122 2024-09-12T00:27:58.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.068+0000 7f712938c8c0 1 < suggested update operation key=KNGB14TWW6XC tag=WYFQNVFZ0BB5 type=del size=3605191 2024-09-12T00:27:58.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.076+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~0XY3Q2XT4S1H.0 size=575611 2024-09-12T00:27:58.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.076+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=0XY3Q2XT4S1H tag=XABGO81IMYO4 type=write size=1624187 2024-09-12T00:27:58.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.080+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=PS3XMYT8CLRT type=del 2024-09-12T00:27:58.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.084+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=K87FX3P1VHSM type=del size=4139671 2024-09-12T00:27:58.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.088+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=INGBL1UL0EQP type=del 2024-09-12T00:27:58.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.092+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=JE5SPIHCQQB7 type=del size=3448652 2024-09-12T00:27:58.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.096+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~0JGV7Z92Y5BX.0 size=453028 2024-09-12T00:27:58.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.100+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=0JGV7Z92Y5BX tag=P9U3KQ8WHREL type=write size=1501604 2024-09-12T00:27:58.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.104+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=WJE20UB1PV63 type=del size=2171168 2024-09-12T00:27:58.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.108+0000 7f712938c8c0 1 < canceled operation key=UAJEZUYXN2R0 tag=M126S53I2UFR type=write size=93362 2024-09-12T00:27:58.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.116+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~R3D1LRTYYEOT.0 size=1048576 2024-09-12T00:27:58.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.120+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~R3D1LRTYYEOT.1 size=1048576 2024-09-12T00:27:58.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.120+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~R3D1LRTYYEOT.2 size=440783 2024-09-12T00:27:58.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.120+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=R3D1LRTYYEOT tag=2WAKC2YLM0J2 type=write size=3586511 2024-09-12T00:27:58.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.124+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=P5NDJOAIK06A type=del 2024-09-12T00:27:58.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.128+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=OL1655NFA1FK type=del size=835083 2024-09-12T00:27:58.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.136+0000 7f712938c8c0 1 < completed write operation key=W01PFMFNYLED tag=PN6F977H0KDA type=write size=669148 2024-09-12T00:27:58.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.140+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=B816ORGQ94M3 type=del size=1087596 2024-09-12T00:27:58.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.144+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=PMR5X2IWYICH type=del 2024-09-12T00:27:58.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.148+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=LZ95II63ENQ7 type=write size=1035583 2024-09-12T00:27:58.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.152+0000 7f712938c8c0 -1 < failed to complete operation key=BH2YHXHVEZCH tag=RT85JSQZUTUO type=del size=889689: (22) Invalid argument 2024-09-12T00:27:58.157 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.156+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=BNWQ661V0ZKO type=write size=38993 2024-09-12T00:27:58.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.160+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=79FIYIOTVOEQ type=del 2024-09-12T00:27:58.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.164+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=KZ18NHR2SIQI type=del size=438457 2024-09-12T00:27:58.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.168+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~VRKY2HLNCS9O.0 size=1048576 2024-09-12T00:27:58.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.172+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~VRKY2HLNCS9O.1 size=1048576 2024-09-12T00:27:58.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.176+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~VRKY2HLNCS9O.2 size=641384 2024-09-12T00:27:58.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.180+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=VRKY2HLNCS9O tag=3JBX119KW38P type=write size=3787112 2024-09-12T00:27:58.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.188+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~B11ZF2WKALWA.0 size=463195 2024-09-12T00:27:58.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.188+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=B11ZF2WKALWA tag=RB21XZ0TX8MM type=write size=1511771 2024-09-12T00:27:58.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.192+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=14X4DO6HT6G7 type=del 2024-09-12T00:27:58.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.196+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=R940Q4Q3118Y type=write size=856160 2024-09-12T00:27:58.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.200+0000 7f712938c8c0 -1 < failed to complete operation key=BH2YHXHVEZCH tag=XF5AHA0V2PVT type=del size=1845616: (22) Invalid argument 2024-09-12T00:27:58.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.208+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~FA6ZLZ4QFWR9.0 size=1048576 2024-09-12T00:27:58.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.208+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~FA6ZLZ4QFWR9.1 size=1048576 2024-09-12T00:27:58.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.212+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~FA6ZLZ4QFWR9.2 size=147602 2024-09-12T00:27:58.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.212+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=FA6ZLZ4QFWR9 tag=5RO1PMGDUVLB type=write size=3293330 2024-09-12T00:27:58.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.216+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=MYZMFGPKSI5K type=del 2024-09-12T00:27:58.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.224+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=CLDOET7EB25X type=write size=278552 2024-09-12T00:27:58.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.228+0000 7f712938c8c0 1 < canceled operation key=Z2RYL03II71Z tag=KGZND2V5BJ1U type=del size=1140296 2024-09-12T00:27:58.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.232+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=AEW8E4UXJXLS type=del size=3675043 2024-09-12T00:27:58.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.236+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=GMQ7BKBI4YV9 type=del 2024-09-12T00:27:58.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.240+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=AY06C10DKAHO type=write size=671526 2024-09-12T00:27:58.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.244+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~0XY3Q2XT4S1H.0 size=575611 2024-09-12T00:27:58.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.252+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=0XY3Q2XT4S1H tag=XABGO81IMYO4 type=write size=1624187 2024-09-12T00:27:58.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.256+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=OBYFQZ3PEQ2I type=write size=194044 2024-09-12T00:27:58.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.260+0000 7f712938c8c0 1 < canceled operation key=BH2YHXHVEZCH tag=K87FX3P1VHSM type=del size=4139671 2024-09-12T00:27:58.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.268+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~UFXNGMYRP7VS.0 size=1048576 2024-09-12T00:27:58.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.268+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~UFXNGMYRP7VS.1 size=151860 2024-09-12T00:27:58.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.268+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=UFXNGMYRP7VS tag=YZ10HRS3D8OC type=write size=2249012 2024-09-12T00:27:58.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.272+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=JE5SPIHCQQB7 type=del 2024-09-12T00:27:58.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.280+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~0152F3XK72H8.0 size=1023608 2024-09-12T00:27:58.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.280+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=0152F3XK72H8 tag=ICY6HAXVMPOZ type=write size=2072184 2024-09-12T00:27:58.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.288+0000 7f712938c8c0 1 < suggested remove operation key=5KVIIZS50CNT tag=WJE20UB1PV63 type=del 2024-09-12T00:27:58.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.292+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=TSO4ZBM5GQ3P type=write size=905539 2024-09-12T00:27:58.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.296+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~R3D1LRTYYEOT.0 size=1048576 2024-09-12T00:27:58.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.296+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~R3D1LRTYYEOT.1 size=1048576 2024-09-12T00:27:58.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.296+0000 7f712938c8c0 1 < canceled part key=_multipart_ULE6S9Y6DS62.2~R3D1LRTYYEOT.2 size=440783 2024-09-12T00:27:58.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.304+0000 7f712938c8c0 1 < canceled multipart upload key=ULE6S9Y6DS62 upload=R3D1LRTYYEOT tag=2WAKC2YLM0J2 type=write size=3586511 2024-09-12T00:27:58.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.308+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=Z5J1UDNVX93F type=del size=2912196 2024-09-12T00:27:58.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.312+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=OL1655NFA1FK type=del 2024-09-12T00:27:58.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.316+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=LLRQ6HTO2HWF type=write size=530250 2024-09-12T00:27:58.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.320+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=B816ORGQ94M3 type=del 2024-09-12T00:27:58.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.324+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~YFGNYUJ7GTEU.0 size=1048576 2024-09-12T00:27:58.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.328+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~YFGNYUJ7GTEU.1 size=245428 2024-09-12T00:27:58.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.328+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=YFGNYUJ7GTEU tag=4VII9QXCNOLR type=write size=2342580 2024-09-12T00:27:58.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.332+0000 7f712938c8c0 1 < completed write operation key=QL3FL4J9TKY4 tag=LZ95II63ENQ7 type=write size=1035583 2024-09-12T00:27:58.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.336+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=1FW7AING4TBI type=del size=3780023 2024-09-12T00:27:58.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.340+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=BNWQ661V0ZKO type=write size=38993 2024-09-12T00:27:58.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.344+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=JQS616AA6T0K type=del size=3869654 2024-09-12T00:27:58.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.348+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=KZ18NHR2SIQI type=del 2024-09-12T00:27:58.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.356+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~CHK9YILOL4VN.0 size=746528 2024-09-12T00:27:58.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.356+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=CHK9YILOL4VN tag=C911W0C614HH type=write size=1795104 2024-09-12T00:27:58.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.360+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~B11ZF2WKALWA.0 size=463195 2024-09-12T00:27:58.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.364+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=B11ZF2WKALWA tag=RB21XZ0TX8MM type=write size=1511771 2024-09-12T00:27:58.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.368+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=R72EFWN4TW08 type=del size=2549546 2024-09-12T00:27:58.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.372+0000 7f712938c8c0 1 < completed write operation key=9N3U208FGM79 tag=R940Q4Q3118Y type=write size=856160 2024-09-12T00:27:58.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.380+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=TAGOSJDZRI8U type=del size=4014788 2024-09-12T00:27:58.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.380+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~FA6ZLZ4QFWR9.0 size=1048576 2024-09-12T00:27:58.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.380+0000 7f712938c8c0 1 < canceled part key=_multipart_VAFU5FXA2KLC.2~FA6ZLZ4QFWR9.1 size=1048576 2024-09-12T00:27:58.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.384+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~FA6ZLZ4QFWR9.2 size=147602 2024-09-12T00:27:58.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.392+0000 7f712938c8c0 1 < canceled multipart upload key=VAFU5FXA2KLC upload=FA6ZLZ4QFWR9 tag=5RO1PMGDUVLB type=write size=3293330 2024-09-12T00:27:58.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.396+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=5P2HN8B5YE4W type=del size=951408 2024-09-12T00:27:58.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.400+0000 7f712938c8c0 1 < completed write operation key=T0C4ZDQB13X0 tag=CLDOET7EB25X type=write size=278552 2024-09-12T00:27:58.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.400+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=85IR24M4US9W type=write size=960369 2024-09-12T00:27:58.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.404+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=AEW8E4UXJXLS type=del 2024-09-12T00:27:58.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.416+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~SKRVD5CDMZYA.0 size=1048576 2024-09-12T00:27:58.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.416+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~SKRVD5CDMZYA.1 size=1043079 2024-09-12T00:27:58.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.416+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=SKRVD5CDMZYA tag=S56RBE6FPZEX type=write size=3140231 2024-09-12T00:27:58.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.420+0000 7f712938c8c0 1 < completed write operation key=ZP88X00LMVSS tag=AY06C10DKAHO type=write size=671526 2024-09-12T00:27:58.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.424+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~9TFLCKBFGXDL.0 size=1048576 2024-09-12T00:27:58.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.432+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~9TFLCKBFGXDL.1 size=1048576 2024-09-12T00:27:58.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.436+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~9TFLCKBFGXDL.2 size=107728 2024-09-12T00:27:58.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.436+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=9TFLCKBFGXDL tag=VB9JC4OUG39B type=write size=3253456 2024-09-12T00:27:58.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.440+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=OBYFQZ3PEQ2I type=write size=194044 2024-09-12T00:27:58.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.444+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~YI2CJNZ6MY85.0 size=223980 2024-09-12T00:27:58.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.444+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=YI2CJNZ6MY85 tag=2OKQAVD9FD0Y type=write size=1272556 2024-09-12T00:27:58.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.448+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~UFXNGMYRP7VS.0 size=1048576 2024-09-12T00:27:58.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.452+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~UFXNGMYRP7VS.1 size=151860 2024-09-12T00:27:58.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.456+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=UFXNGMYRP7VS tag=YZ10HRS3D8OC type=write size=2249012 2024-09-12T00:27:58.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.460+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=HLG08XJ5QIWQ type=del size=1020654 2024-09-12T00:27:58.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.464+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~0152F3XK72H8.0 size=1023608 2024-09-12T00:27:58.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.468+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=0152F3XK72H8 tag=ICY6HAXVMPOZ type=write size=2072184 2024-09-12T00:27:58.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.472+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=NVPN4YY8W7KB type=del size=2887330 2024-09-12T00:27:58.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.480+0000 7f712938c8c0 1 < suggested remove operation key=ULE6S9Y6DS62 tag=TSO4ZBM5GQ3P type=write 2024-09-12T00:27:58.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.488+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~V0LNZXJGNRLW.0 size=1038951 2024-09-12T00:27:58.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.488+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=V0LNZXJGNRLW tag=3MQYEEUB2WCO type=write size=2087527 2024-09-12T00:27:58.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.492+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=Z5J1UDNVX93F type=del 2024-09-12T00:27:58.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.496+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=08ZX3RQEDC9L type=del size=1746659 2024-09-12T00:27:58.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.500+0000 7f712938c8c0 1 < completed write operation key=W01PFMFNYLED tag=LLRQ6HTO2HWF type=write size=530250 2024-09-12T00:27:58.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.504+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=J2N49UD2DI58 type=del size=899428 2024-09-12T00:27:58.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.504+0000 7f712938c8c0 1 < canceled part key=_multipart_F7T79C7MZX35.2~YFGNYUJ7GTEU.0 size=1048576 2024-09-12T00:27:58.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.508+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~YFGNYUJ7GTEU.1 size=245428 2024-09-12T00:27:58.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.512+0000 7f712938c8c0 1 < canceled multipart upload key=F7T79C7MZX35 upload=YFGNYUJ7GTEU tag=4VII9QXCNOLR type=write size=2342580 2024-09-12T00:27:58.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.520+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~FOD8SHM60P34.0 size=1048576 2024-09-12T00:27:58.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.520+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~FOD8SHM60P34.1 size=1048576 2024-09-12T00:27:58.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.524+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~FOD8SHM60P34.2 size=974003 2024-09-12T00:27:58.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.524+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=FOD8SHM60P34 tag=W3ZEK1AZ39RV type=write size=4119731 2024-09-12T00:27:58.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.528+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=1FW7AING4TBI type=del 2024-09-12T00:27:58.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.532+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=BB1U80461YE5 type=del size=761221 2024-09-12T00:27:58.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.536+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=JQS616AA6T0K type=del 2024-09-12T00:27:58.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.540+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~2UQPK0P3IL1J.0 size=1048576 2024-09-12T00:27:58.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.544+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~2UQPK0P3IL1J.1 size=706246 2024-09-12T00:27:58.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.544+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=2UQPK0P3IL1J tag=Q8DAYDV06J4D type=write size=2803398 2024-09-12T00:27:58.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.548+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~CHK9YILOL4VN.0 size=746528 2024-09-12T00:27:58.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.552+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=CHK9YILOL4VN tag=C911W0C614HH type=write size=1795104 2024-09-12T00:27:58.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.556+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=X5WHSLFKMFRS type=del size=2191526 2024-09-12T00:27:58.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.560+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=R72EFWN4TW08 type=del 2024-09-12T00:27:58.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.564+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=HQDM4UGHJ8C1 type=write size=101804 2024-09-12T00:27:58.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.568+0000 7f712938c8c0 1 < suggested update operation key=5KVIIZS50CNT tag=TAGOSJDZRI8U type=del size=4014788 2024-09-12T00:27:58.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.572+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=S1QHZF9OH0LF type=del size=1186095 2024-09-12T00:27:58.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.576+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=5P2HN8B5YE4W type=del 2024-09-12T00:27:58.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.576+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=RLDOADVAOGQ7 type=del size=2269097 2024-09-12T00:27:58.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.580+0000 7f712938c8c0 1 < completed write operation key=MUNSUH4BMZNP tag=85IR24M4US9W type=write size=960369 2024-09-12T00:27:58.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.584+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~TCU8PQ6GWQ3M.0 size=1048576 2024-09-12T00:27:58.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.588+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~TCU8PQ6GWQ3M.1 size=221452 2024-09-12T00:27:58.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.588+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=TCU8PQ6GWQ3M tag=ZMXS913TLWE4 type=write size=2318604 2024-09-12T00:27:58.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.592+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~SKRVD5CDMZYA.0 size=1048576 2024-09-12T00:27:58.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.592+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~SKRVD5CDMZYA.1 size=1043079 2024-09-12T00:27:58.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.600+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=SKRVD5CDMZYA tag=S56RBE6FPZEX type=write size=3140231 2024-09-12T00:27:58.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.600+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=0SD4FE1NRY2R type=del size=2796728 2024-09-12T00:27:58.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.604+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~9TFLCKBFGXDL.0 size=1048576 2024-09-12T00:27:58.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.608+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~9TFLCKBFGXDL.1 size=1048576 2024-09-12T00:27:58.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.608+0000 7f712938c8c0 1 < canceled part key=_multipart_N69XPNN6Y6HZ.2~9TFLCKBFGXDL.2 size=107728 2024-09-12T00:27:58.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.612+0000 7f712938c8c0 1 < canceled multipart upload key=N69XPNN6Y6HZ upload=9TFLCKBFGXDL tag=VB9JC4OUG39B type=write size=3253456 2024-09-12T00:27:58.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.616+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~P8RTAIFMQ9MZ.0 size=683958 2024-09-12T00:27:58.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.616+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=P8RTAIFMQ9MZ tag=MONF5KFQ4MPP type=write size=1732534 2024-09-12T00:27:58.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.620+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~YI2CJNZ6MY85.0 size=223980 2024-09-12T00:27:58.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.624+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=YI2CJNZ6MY85 tag=2OKQAVD9FD0Y type=write size=1272556 2024-09-12T00:27:58.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.628+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=V6MS31OE157F type=del size=2962164 2024-09-12T00:27:58.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.632+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=HLG08XJ5QIWQ type=del 2024-09-12T00:27:58.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.640+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~GG52PK8FR13C.0 size=815573 2024-09-12T00:27:58.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.640+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=GG52PK8FR13C tag=TMSBRCY50YRA type=write size=1864149 2024-09-12T00:27:58.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.644+0000 7f712938c8c0 1 < suggested remove operation key=VAFU5FXA2KLC tag=NVPN4YY8W7KB type=del 2024-09-12T00:27:58.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.648+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=N2XLR3AX20FZ type=del size=4038152 2024-09-12T00:27:58.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.652+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~V0LNZXJGNRLW.0 size=1038951 2024-09-12T00:27:58.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.656+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=V0LNZXJGNRLW tag=3MQYEEUB2WCO type=write size=2087527 2024-09-12T00:27:58.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.660+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=W8H1SG18LWEJ type=del size=1633714 2024-09-12T00:27:58.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.664+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=08ZX3RQEDC9L type=del 2024-09-12T00:27:58.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.668+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=WEDFOPAPA544 type=del size=1267369 2024-09-12T00:27:58.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.672+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=J2N49UD2DI58 type=del 2024-09-12T00:27:58.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.676+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=UMPKL5G4MMTJ type=del size=3428032 2024-09-12T00:27:58.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.680+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~FOD8SHM60P34.0 size=1048576 2024-09-12T00:27:58.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.684+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~FOD8SHM60P34.1 size=1048576 2024-09-12T00:27:58.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.688+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~FOD8SHM60P34.2 size=974003 2024-09-12T00:27:58.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.692+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=FOD8SHM60P34 tag=W3ZEK1AZ39RV type=write size=4119731 2024-09-12T00:27:58.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.696+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=9QVQ24S92HF8 type=del size=3253690 2024-09-12T00:27:58.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.700+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=BB1U80461YE5 type=del 2024-09-12T00:27:58.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.704+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=PYILT4K1NE3J type=del size=2469723 2024-09-12T00:27:58.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.704+0000 7f712938c8c0 1 < canceled part key=_multipart_9N3U208FGM79.2~2UQPK0P3IL1J.0 size=1048576 2024-09-12T00:27:58.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.708+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~2UQPK0P3IL1J.1 size=706246 2024-09-12T00:27:58.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.712+0000 7f712938c8c0 1 < canceled multipart upload key=9N3U208FGM79 upload=2UQPK0P3IL1J tag=Q8DAYDV06J4D type=write size=2803398 2024-09-12T00:27:58.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.716+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=A115BUM2LKTO type=del size=1090312 2024-09-12T00:27:58.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.720+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=X5WHSLFKMFRS type=del 2024-09-12T00:27:58.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.724+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=MKLUPDGELQVV type=del size=1255420 2024-09-12T00:27:58.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.728+0000 7f712938c8c0 1 < completed write operation key=7X45VJAQO7PF tag=HQDM4UGHJ8C1 type=write size=101804 2024-09-12T00:27:58.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.736+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~AY9YZNUGR4LK.0 size=1048576 2024-09-12T00:27:58.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.740+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~AY9YZNUGR4LK.1 size=706804 2024-09-12T00:27:58.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.740+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=AY9YZNUGR4LK tag=WSOU9ZWXFXC0 type=write size=2803956 2024-09-12T00:27:58.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.744+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=S1QHZF9OH0LF type=del 2024-09-12T00:27:58.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.744+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=5T7MM5BC3B3H type=del size=773655 2024-09-12T00:27:58.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.748+0000 7f712938c8c0 1 < canceled operation key=T0C4ZDQB13X0 tag=RLDOADVAOGQ7 type=del size=2269097 2024-09-12T00:27:58.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.756+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=YA5RT1APUGF2 type=del size=3896197 2024-09-12T00:27:58.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.760+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~TCU8PQ6GWQ3M.0 size=1048576 2024-09-12T00:27:58.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.764+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~TCU8PQ6GWQ3M.1 size=221452 2024-09-12T00:27:58.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.768+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=TCU8PQ6GWQ3M tag=ZMXS913TLWE4 type=write size=2318604 2024-09-12T00:27:58.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.772+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=2QDAY1RZ9TFT type=write size=406880 2024-09-12T00:27:58.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.780+0000 7f712938c8c0 1 < suggested remove operation key=5KVIIZS50CNT tag=0SD4FE1NRY2R type=del 2024-09-12T00:27:58.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.784+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=51IMUG5MGLIO type=del size=3380149 2024-09-12T00:27:58.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.788+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~P8RTAIFMQ9MZ.0 size=683958 2024-09-12T00:27:58.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.792+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=P8RTAIFMQ9MZ tag=MONF5KFQ4MPP type=write size=1732534 2024-09-12T00:27:58.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.800+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~5W5652FVN8P5.0 size=792564 2024-09-12T00:27:58.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.800+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=5W5652FVN8P5 tag=GGKXPIUODY42 type=write size=1841140 2024-09-12T00:27:58.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.808+0000 7f712938c8c0 1 < suggested remove operation key=V9K2307BGOKP tag=V6MS31OE157F type=del 2024-09-12T00:27:58.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.816+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~T54X740UT50L.0 size=1048576 2024-09-12T00:27:58.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.816+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~T54X740UT50L.1 size=791622 2024-09-12T00:27:58.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.816+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=T54X740UT50L tag=51LQLV4XWVNI type=write size=2888774 2024-09-12T00:27:58.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.820+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~GG52PK8FR13C.0 size=815573 2024-09-12T00:27:58.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.828+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=GG52PK8FR13C tag=TMSBRCY50YRA type=write size=1864149 2024-09-12T00:27:58.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.836+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~21RLSEFO526D.0 size=878515 2024-09-12T00:27:58.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.836+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=21RLSEFO526D tag=2UEY2836V3OE type=write size=1927091 2024-09-12T00:27:58.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.840+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=N2XLR3AX20FZ type=del 2024-09-12T00:27:58.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.844+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=0W6REAH79DRL type=del size=1190142 2024-09-12T00:27:58.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.848+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=W8H1SG18LWEJ type=del 2024-09-12T00:27:58.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.852+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=00UVURC2LQZD type=del size=1068225 2024-09-12T00:27:58.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.860+0000 7f712938c8c0 1 < suggested update operation key=VAFU5FXA2KLC tag=WEDFOPAPA544 type=del size=1267369 2024-09-12T00:27:58.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.864+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=4XUU8KH07FQU type=del size=64791 2024-09-12T00:27:58.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.872+0000 7f712938c8c0 1 < suggested update operation key=KNGB14TWW6XC tag=UMPKL5G4MMTJ type=del size=3428032 2024-09-12T00:27:58.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.876+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=YYCIIB2S0L7T type=write size=458374 2024-09-12T00:27:58.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.884+0000 7f712938c8c0 1 < suggested update operation key=MUNSUH4BMZNP tag=9QVQ24S92HF8 type=del size=3253690 2024-09-12T00:27:58.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.892+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~232QE8R9HVE2.0 size=494636 2024-09-12T00:27:58.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.892+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=232QE8R9HVE2 tag=PZCPHXPT43A1 type=write size=1543212 2024-09-12T00:27:58.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.896+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=PYILT4K1NE3J type=del 2024-09-12T00:27:58.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.904+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~JFJOUB3U35GE.0 size=1048576 2024-09-12T00:27:58.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.904+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~JFJOUB3U35GE.1 size=958115 2024-09-12T00:27:58.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.904+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=JFJOUB3U35GE tag=KGQRS1YXM3WY type=write size=3055267 2024-09-12T00:27:58.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.908+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=A115BUM2LKTO type=del 2024-09-12T00:27:58.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.912+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=W7ZMIJ1RP51U type=del size=1980394 2024-09-12T00:27:58.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.920+0000 7f712938c8c0 1 < suggested update operation key=G0065P5NOJ2F tag=MKLUPDGELQVV type=del size=1255420 2024-09-12T00:27:58.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.924+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=9I2EW0I9UKYH type=del size=3080115 2024-09-12T00:27:58.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.928+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~AY9YZNUGR4LK.0 size=1048576 2024-09-12T00:27:58.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.932+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~AY9YZNUGR4LK.1 size=706804 2024-09-12T00:27:58.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.936+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=AY9YZNUGR4LK tag=WSOU9ZWXFXC0 type=write size=2803956 2024-09-12T00:27:58.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.940+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=20Q6V4GDZYZU type=del size=2373541 2024-09-12T00:27:58.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.944+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=5T7MM5BC3B3H type=del 2024-09-12T00:27:58.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.952+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~V2A0UKRSI63J.0 size=172771 2024-09-12T00:27:58.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.952+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=V2A0UKRSI63J tag=6CD7I8GHE059 type=write size=1221347 2024-09-12T00:27:58.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.956+0000 7f712938c8c0 -1 < failed to complete operation key=V9K2307BGOKP tag=YA5RT1APUGF2 type=del size=3896197: (22) Invalid argument 2024-09-12T00:27:58.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.960+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=998GZAF1P7MK type=del size=1898613 2024-09-12T00:27:58.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.964+0000 7f712938c8c0 1 < canceled operation key=Z2RYL03II71Z tag=2QDAY1RZ9TFT type=write size=406880 2024-09-12T00:27:58.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.968+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=F3Q4UAB1AWWE type=write size=306709 2024-09-12T00:27:58.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.972+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=51IMUG5MGLIO type=del 2024-09-12T00:27:58.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.976+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=39IP5VHF5M83 type=write size=745609 2024-09-12T00:27:58.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.980+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~5W5652FVN8P5.0 size=792564 2024-09-12T00:27:58.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.988+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=5W5652FVN8P5 tag=GGKXPIUODY42 type=write size=1841140 2024-09-12T00:27:58.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.992+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~GTMHXQS8ZMQS.0 size=302204 2024-09-12T00:27:58.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.992+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=GTMHXQS8ZMQS tag=Q8IYKWV2NITC type=write size=1350780 2024-09-12T00:27:58.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:58.996+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~T54X740UT50L.0 size=1048576 2024-09-12T00:27:58.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.000+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~T54X740UT50L.1 size=791622 2024-09-12T00:27:59.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.004+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=T54X740UT50L tag=51LQLV4XWVNI type=write size=2888774 2024-09-12T00:27:59.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.012+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~DYHWHMXWZPA6.0 size=556300 2024-09-12T00:27:59.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.012+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=DYHWHMXWZPA6 tag=YGAFPNVJH37U type=write size=1604876 2024-09-12T00:27:59.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.016+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~21RLSEFO526D.0 size=878515 2024-09-12T00:27:59.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.024+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=21RLSEFO526D tag=2UEY2836V3OE type=write size=1927091 2024-09-12T00:27:59.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.028+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=YXOWEUJ1QXCJ type=del size=1655195 2024-09-12T00:27:59.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.032+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=0W6REAH79DRL type=del 2024-09-12T00:27:59.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.040+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~TIEZJ9WQ859C.0 size=790238 2024-09-12T00:27:59.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.040+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=TIEZJ9WQ859C tag=NN84OCRBC0EE type=write size=1838814 2024-09-12T00:27:59.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.044+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=00UVURC2LQZD type=del 2024-09-12T00:27:59.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.048+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=MFIBXM6ZRXN7 type=del size=2078831 2024-09-12T00:27:59.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.048+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=4XUU8KH07FQU type=del 2024-09-12T00:27:59.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.056+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~4O135RZFWHT1.0 size=1048576 2024-09-12T00:27:59.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.060+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~4O135RZFWHT1.1 size=392570 2024-09-12T00:27:59.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.060+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=4O135RZFWHT1 tag=ME82L2QHM37X type=write size=2489722 2024-09-12T00:27:59.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.064+0000 7f712938c8c0 -1 < failed to complete operation key=MUNSUH4BMZNP tag=YYCIIB2S0L7T type=write size=458374: (22) Invalid argument 2024-09-12T00:27:59.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.068+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=R0I6ZWKK1O7R type=del size=1295984 2024-09-12T00:27:59.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.072+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~232QE8R9HVE2.0 size=494636 2024-09-12T00:27:59.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.076+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=232QE8R9HVE2 tag=PZCPHXPT43A1 type=write size=1543212 2024-09-12T00:27:59.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.080+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=901WE8PHPMLG type=del size=4014774 2024-09-12T00:27:59.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.084+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~JFJOUB3U35GE.0 size=1048576 2024-09-12T00:27:59.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.088+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~JFJOUB3U35GE.1 size=958115 2024-09-12T00:27:59.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.096+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=JFJOUB3U35GE tag=KGQRS1YXM3WY type=write size=3055267 2024-09-12T00:27:59.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.104+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~F2C8CLTY2WGP.0 size=762344 2024-09-12T00:27:59.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.104+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=F2C8CLTY2WGP tag=5800D9X3XR6W type=write size=1810920 2024-09-12T00:27:59.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.108+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=W7ZMIJ1RP51U type=del 2024-09-12T00:27:59.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.112+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=1M0VVOJ7FEAN type=del size=3521245 2024-09-12T00:27:59.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.116+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=9I2EW0I9UKYH type=del 2024-09-12T00:27:59.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.124+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=2XJJMI14RXZH type=del size=2032049 2024-09-12T00:27:59.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.128+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=20Q6V4GDZYZU type=del 2024-09-12T00:27:59.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.132+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=SWWTSVLHXTJV type=del size=3370331 2024-09-12T00:27:59.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.136+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~V2A0UKRSI63J.0 size=172771 2024-09-12T00:27:59.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.144+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=V2A0UKRSI63J tag=6CD7I8GHE059 type=write size=1221347 2024-09-12T00:27:59.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.148+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~3G36ITLR6Q6S.0 size=1048576 2024-09-12T00:27:59.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.152+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~3G36ITLR6Q6S.1 size=1048576 2024-09-12T00:27:59.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.156+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~3G36ITLR6Q6S.2 size=633369 2024-09-12T00:27:59.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.156+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=3G36ITLR6Q6S tag=JKHMD08FZ17X type=write size=3779097 2024-09-12T00:27:59.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.160+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=998GZAF1P7MK type=del 2024-09-12T00:27:59.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.168+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~TS122AJWLCTB.0 size=1048576 2024-09-12T00:27:59.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.168+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~TS122AJWLCTB.1 size=1048576 2024-09-12T00:27:59.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.172+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~TS122AJWLCTB.2 size=973399 2024-09-12T00:27:59.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.172+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=TS122AJWLCTB tag=NFIV0U33DTY2 type=write size=4119127 2024-09-12T00:27:59.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.176+0000 7f712938c8c0 1 < completed write operation key=ZP88X00LMVSS tag=F3Q4UAB1AWWE type=write size=306709 2024-09-12T00:27:59.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.180+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=4XU3N3FQ5FKW type=del size=3816803 2024-09-12T00:27:59.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.184+0000 7f712938c8c0 1 < completed write operation key=9YZP0TIRWWRF tag=39IP5VHF5M83 type=write size=745609 2024-09-12T00:27:59.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.192+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=8DX90TKK5IJL type=del size=30423 2024-09-12T00:27:59.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.196+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~GTMHXQS8ZMQS.0 size=302204 2024-09-12T00:27:59.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.200+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=GTMHXQS8ZMQS tag=Q8IYKWV2NITC type=write size=1350780 2024-09-12T00:27:59.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.204+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=IZNJT7TY0LHP type=write size=358900 2024-09-12T00:27:59.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.208+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~DYHWHMXWZPA6.0 size=556300 2024-09-12T00:27:59.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.212+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=DYHWHMXWZPA6 tag=YGAFPNVJH37U type=write size=1604876 2024-09-12T00:27:59.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.216+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=K1XUS969RHB1 type=del size=2996206 2024-09-12T00:27:59.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.220+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=YXOWEUJ1QXCJ type=del 2024-09-12T00:27:59.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.224+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=ZSBBX6Y47YPK type=del size=3766097 2024-09-12T00:27:59.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.232+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~TIEZJ9WQ859C.0 size=790238 2024-09-12T00:27:59.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.236+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=TIEZJ9WQ859C tag=NN84OCRBC0EE type=write size=1838814 2024-09-12T00:27:59.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.244+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~3CI9EZ0Q5TNY.0 size=1048576 2024-09-12T00:27:59.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.244+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~3CI9EZ0Q5TNY.1 size=1048576 2024-09-12T00:27:59.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.248+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~3CI9EZ0Q5TNY.2 size=155108 2024-09-12T00:27:59.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.248+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=3CI9EZ0Q5TNY tag=GFFVVSKITB3P type=write size=3300836 2024-09-12T00:27:59.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.252+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=MFIBXM6ZRXN7 type=del 2024-09-12T00:27:59.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.260+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~N8L8A18M5LH1.0 size=1048576 2024-09-12T00:27:59.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.264+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~N8L8A18M5LH1.1 size=1048576 2024-09-12T00:27:59.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.264+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~N8L8A18M5LH1.2 size=427342 2024-09-12T00:27:59.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.264+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=N8L8A18M5LH1 tag=H0BKEN7WZ94M type=write size=3573070 2024-09-12T00:27:59.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.268+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~4O135RZFWHT1.0 size=1048576 2024-09-12T00:27:59.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.272+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~4O135RZFWHT1.1 size=392570 2024-09-12T00:27:59.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.280+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=4O135RZFWHT1 tag=ME82L2QHM37X type=write size=2489722 2024-09-12T00:27:59.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.280+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=SYKN6266NY2F type=del size=1357247 2024-09-12T00:27:59.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.284+0000 7f712938c8c0 1 < canceled operation key=L2SR6IAW0D38 tag=R0I6ZWKK1O7R type=del size=1295984 2024-09-12T00:27:59.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.288+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=Q75FKKAH55JP type=del size=309958 2024-09-12T00:27:59.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.292+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=901WE8PHPMLG type=del 2024-09-12T00:27:59.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.296+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=5ZPI2S57GRXK type=write size=369635 2024-09-12T00:27:59.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.300+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~F2C8CLTY2WGP.0 size=762344 2024-09-12T00:27:59.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.304+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=F2C8CLTY2WGP tag=5800D9X3XR6W type=write size=1810920 2024-09-12T00:27:59.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.308+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=UT55U9VXANKD type=del size=3242631 2024-09-12T00:27:59.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.316+0000 7f712938c8c0 1 < suggested update operation key=UAJEZUYXN2R0 tag=1M0VVOJ7FEAN type=del size=3521245 2024-09-12T00:27:59.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.320+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=O7SF6VEGOBTY type=del size=4015432 2024-09-12T00:27:59.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.324+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=2XJJMI14RXZH type=del 2024-09-12T00:27:59.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.332+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~NK5CWZGJM4ER.0 size=1048576 2024-09-12T00:27:59.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.332+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~NK5CWZGJM4ER.1 size=1048576 2024-09-12T00:27:59.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.336+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~NK5CWZGJM4ER.2 size=885704 2024-09-12T00:27:59.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.336+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=NK5CWZGJM4ER tag=CQJM9PD4APCA type=write size=4031432 2024-09-12T00:27:59.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.340+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=SWWTSVLHXTJV type=del 2024-09-12T00:27:59.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.344+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=E2P1BAA0RWVN type=del size=2529466 2024-09-12T00:27:59.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.344+0000 7f712938c8c0 1 < canceled part key=_multipart_VAFU5FXA2KLC.2~3G36ITLR6Q6S.0 size=1048576 2024-09-12T00:27:59.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.348+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~3G36ITLR6Q6S.1 size=1048576 2024-09-12T00:27:59.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.348+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~3G36ITLR6Q6S.2 size=633369 2024-09-12T00:27:59.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.356+0000 7f712938c8c0 1 < canceled multipart upload key=VAFU5FXA2KLC upload=3G36ITLR6Q6S tag=JKHMD08FZ17X type=write size=3779097 2024-09-12T00:27:59.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.360+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=2Y4KFXC0IP9M type=del size=2771788 2024-09-12T00:27:59.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.364+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~TS122AJWLCTB.0 size=1048576 2024-09-12T00:27:59.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.368+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~TS122AJWLCTB.1 size=1048576 2024-09-12T00:27:59.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.372+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~TS122AJWLCTB.2 size=973399 2024-09-12T00:27:59.376 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.376+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=TS122AJWLCTB tag=NFIV0U33DTY2 type=write size=4119127 2024-09-12T00:27:59.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.380+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=N37E41IZKHAQ type=del size=795487 2024-09-12T00:27:59.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.384+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=4XU3N3FQ5FKW type=del 2024-09-12T00:27:59.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.388+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=DHXKW5WUL28V type=del size=1621407 2024-09-12T00:27:59.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.392+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=8DX90TKK5IJL type=del 2024-09-12T00:27:59.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.396+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=3A46036D7I27 type=write size=843888 2024-09-12T00:27:59.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.400+0000 7f712938c8c0 1 < completed write operation key=9N3U208FGM79 tag=IZNJT7TY0LHP type=write size=358900 2024-09-12T00:27:59.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.404+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=1Q4WJ44MMTQS type=write size=450591 2024-09-12T00:27:59.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.408+0000 7f712938c8c0 1 < canceled operation key=VAFU5FXA2KLC tag=K1XUS969RHB1 type=del size=2996206 2024-09-12T00:27:59.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.412+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=O1893Y2CYIWL type=del size=478573 2024-09-12T00:27:59.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.416+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=ZSBBX6Y47YPK type=del 2024-09-12T00:27:59.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.420+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~YGUTNVF2NBOB.0 size=1048576 2024-09-12T00:27:59.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.424+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~YGUTNVF2NBOB.1 size=1048576 2024-09-12T00:27:59.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.428+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~YGUTNVF2NBOB.2 size=503414 2024-09-12T00:27:59.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.428+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=YGUTNVF2NBOB tag=LF5UO7MI3ZPH type=write size=3649142 2024-09-12T00:27:59.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.428+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~3CI9EZ0Q5TNY.0 size=1048576 2024-09-12T00:27:59.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.432+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~3CI9EZ0Q5TNY.1 size=1048576 2024-09-12T00:27:59.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.436+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~3CI9EZ0Q5TNY.2 size=155108 2024-09-12T00:27:59.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.440+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=3CI9EZ0Q5TNY tag=GFFVVSKITB3P type=write size=3300836 2024-09-12T00:27:59.447 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.448+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~7CXV2HVYXL7W.0 size=1048576 2024-09-12T00:27:59.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.448+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~7CXV2HVYXL7W.1 size=1048576 2024-09-12T00:27:59.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.452+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~7CXV2HVYXL7W.2 size=44578 2024-09-12T00:27:59.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.452+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=7CXV2HVYXL7W tag=3S1L0IMP8XKS type=write size=3190306 2024-09-12T00:27:59.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.456+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~N8L8A18M5LH1.0 size=1048576 2024-09-12T00:27:59.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.460+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~N8L8A18M5LH1.1 size=1048576 2024-09-12T00:27:59.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.464+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~N8L8A18M5LH1.2 size=427342 2024-09-12T00:27:59.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.472+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=N8L8A18M5LH1 tag=H0BKEN7WZ94M type=write size=3573070 2024-09-12T00:27:59.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.476+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=FYEWG1Y8JHW1 type=del size=1090044 2024-09-12T00:27:59.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.480+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=SYKN6266NY2F type=del 2024-09-12T00:27:59.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.484+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~TG5J7FK94BIK.0 size=1048576 2024-09-12T00:27:59.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.488+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~TG5J7FK94BIK.1 size=609922 2024-09-12T00:27:59.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.488+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=TG5J7FK94BIK tag=WLLRJGFS0SX6 type=write size=2707074 2024-09-12T00:27:59.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.492+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=Q75FKKAH55JP type=del 2024-09-12T00:27:59.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.496+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=P8W6XMW3JG1L type=del size=1732911 2024-09-12T00:27:59.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.500+0000 7f712938c8c0 1 < completed write operation key=QL3FL4J9TKY4 tag=5ZPI2S57GRXK type=write size=369635 2024-09-12T00:27:59.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.500+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=IC34NCXTSV8T type=del size=3979596 2024-09-12T00:27:59.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.504+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=UT55U9VXANKD type=del 2024-09-12T00:27:59.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.508+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=ZG6K8FOZHZUZ type=del size=2956983 2024-09-12T00:27:59.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.512+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=O7SF6VEGOBTY type=del 2024-09-12T00:27:59.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.520+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~MFPMMFFNU17V.0 size=156729 2024-09-12T00:27:59.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.520+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=MFPMMFFNU17V tag=7Q2GTHAOFS9N type=write size=1205305 2024-09-12T00:27:59.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.524+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~NK5CWZGJM4ER.0 size=1048576 2024-09-12T00:27:59.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.524+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~NK5CWZGJM4ER.1 size=1048576 2024-09-12T00:27:59.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.528+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~NK5CWZGJM4ER.2 size=885704 2024-09-12T00:27:59.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.532+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=NK5CWZGJM4ER tag=CQJM9PD4APCA type=write size=4031432 2024-09-12T00:27:59.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.540+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~AL7L14E807BJ.0 size=1048576 2024-09-12T00:27:59.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.544+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~AL7L14E807BJ.1 size=552785 2024-09-12T00:27:59.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.544+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=AL7L14E807BJ tag=SYV1TZAMXWDZ type=write size=2649937 2024-09-12T00:27:59.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.548+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=E2P1BAA0RWVN type=del 2024-09-12T00:27:59.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.548+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=71SNA5X9TUT5 type=write size=409960 2024-09-12T00:27:59.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.552+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=2Y4KFXC0IP9M type=del 2024-09-12T00:27:59.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.560+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~8FYE594D50JY.0 size=1048576 2024-09-12T00:27:59.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.564+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~8FYE594D50JY.1 size=1048576 2024-09-12T00:27:59.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.564+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~8FYE594D50JY.2 size=578566 2024-09-12T00:27:59.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.564+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=8FYE594D50JY tag=DKZ5Z1IKGOHB type=write size=3724294 2024-09-12T00:27:59.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.568+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=N37E41IZKHAQ type=del 2024-09-12T00:27:59.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.572+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=F1MNZHUYIXKF type=del size=692977 2024-09-12T00:27:59.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.576+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=DHXKW5WUL28V type=del 2024-09-12T00:27:59.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.584+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~685ZCA32X38Z.0 size=1006985 2024-09-12T00:27:59.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.584+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=685ZCA32X38Z tag=U63HWFQ4A27Y type=write size=2055561 2024-09-12T00:27:59.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.588+0000 7f712938c8c0 1 < completed write operation key=VAFU5FXA2KLC tag=3A46036D7I27 type=write size=843888 2024-09-12T00:27:59.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.592+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=8WZ2P5H4O5LT type=del size=1804373 2024-09-12T00:27:59.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.596+0000 7f712938c8c0 1 < suggested update operation key=04RL082VPLIM tag=1Q4WJ44MMTQS type=write size=450591 2024-09-12T00:27:59.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.604+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~UZ9LYI17F10A.0 size=164811 2024-09-12T00:27:59.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.604+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=UZ9LYI17F10A tag=SC0KZ78U4PGD type=write size=1213387 2024-09-12T00:27:59.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.608+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=O1893Y2CYIWL type=del 2024-09-12T00:27:59.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.612+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=3GRG6YPFVKTJ type=del size=516411 2024-09-12T00:27:59.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.616+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~YGUTNVF2NBOB.0 size=1048576 2024-09-12T00:27:59.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.620+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~YGUTNVF2NBOB.1 size=1048576 2024-09-12T00:27:59.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.620+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~YGUTNVF2NBOB.2 size=503414 2024-09-12T00:27:59.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.628+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=YGUTNVF2NBOB tag=LF5UO7MI3ZPH type=write size=3649142 2024-09-12T00:27:59.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.636+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~E6GNG1MHKXYS.0 size=1048576 2024-09-12T00:27:59.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.640+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~E6GNG1MHKXYS.1 size=195734 2024-09-12T00:27:59.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.640+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=E6GNG1MHKXYS tag=TBAT7T7HU20H type=write size=2292886 2024-09-12T00:27:59.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.644+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~7CXV2HVYXL7W.0 size=1048576 2024-09-12T00:27:59.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.644+0000 7f712938c8c0 1 < canceled part key=_multipart_BH2YHXHVEZCH.2~7CXV2HVYXL7W.1 size=1048576 2024-09-12T00:27:59.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.648+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~7CXV2HVYXL7W.2 size=44578 2024-09-12T00:27:59.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.652+0000 7f712938c8c0 1 < canceled multipart upload key=BH2YHXHVEZCH upload=7CXV2HVYXL7W tag=3S1L0IMP8XKS type=write size=3190306 2024-09-12T00:27:59.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.656+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=ISG0J1G8HRPN type=del size=3049473 2024-09-12T00:27:59.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.660+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=FYEWG1Y8JHW1 type=del 2024-09-12T00:27:59.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.664+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=GGGW1CJRNOTN type=del size=1563871 2024-09-12T00:27:59.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.668+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~TG5J7FK94BIK.0 size=1048576 2024-09-12T00:27:59.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.672+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~TG5J7FK94BIK.1 size=609922 2024-09-12T00:27:59.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.676+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=TG5J7FK94BIK tag=WLLRJGFS0SX6 type=write size=2707074 2024-09-12T00:27:59.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.684+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~5DI8QNDWHL2V.0 size=1048576 2024-09-12T00:27:59.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.688+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~5DI8QNDWHL2V.1 size=1048576 2024-09-12T00:27:59.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.692+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~5DI8QNDWHL2V.2 size=528869 2024-09-12T00:27:59.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.692+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=5DI8QNDWHL2V tag=XV1VQXXB1VEK type=write size=3674597 2024-09-12T00:27:59.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.692+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=P8W6XMW3JG1L type=del 2024-09-12T00:27:59.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.696+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=9X9PADEZNCO2 type=write size=931113 2024-09-12T00:27:59.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.700+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=IC34NCXTSV8T type=del 2024-09-12T00:27:59.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.704+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=F07Q1NJRL4GW type=del size=1756772 2024-09-12T00:27:59.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.708+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=ZG6K8FOZHZUZ type=del 2024-09-12T00:27:59.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.712+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=61Y9OI7O7KFZ type=del size=4001955 2024-09-12T00:27:59.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.716+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~MFPMMFFNU17V.0 size=156729 2024-09-12T00:27:59.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.724+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=MFPMMFFNU17V tag=7Q2GTHAOFS9N type=write size=1205305 2024-09-12T00:27:59.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.728+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=6CRNE3LAU12X type=write size=618297 2024-09-12T00:27:59.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.732+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~AL7L14E807BJ.0 size=1048576 2024-09-12T00:27:59.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.736+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~AL7L14E807BJ.1 size=552785 2024-09-12T00:27:59.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.740+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=AL7L14E807BJ tag=SYV1TZAMXWDZ type=write size=2649937 2024-09-12T00:27:59.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.744+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=897UNBSGB5FQ type=del size=867515 2024-09-12T00:27:59.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.748+0000 7f712938c8c0 1 < completed write operation key=L2SR6IAW0D38 tag=71SNA5X9TUT5 type=write size=409960 2024-09-12T00:27:59.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.756+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=6BR7SWQ0LY40 type=write size=695957 2024-09-12T00:27:59.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.760+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~8FYE594D50JY.0 size=1048576 2024-09-12T00:27:59.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.760+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~8FYE594D50JY.1 size=1048576 2024-09-12T00:27:59.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.764+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~8FYE594D50JY.2 size=578566 2024-09-12T00:27:59.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.772+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=8FYE594D50JY tag=DKZ5Z1IKGOHB type=write size=3724294 2024-09-12T00:27:59.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.780+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~9Z5KLE29NS57.0 size=1048576 2024-09-12T00:27:59.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.780+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~9Z5KLE29NS57.1 size=1048576 2024-09-12T00:27:59.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.784+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~9Z5KLE29NS57.2 size=212987 2024-09-12T00:27:59.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.784+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=9Z5KLE29NS57 tag=5DYQQOJXP3VD type=write size=3358715 2024-09-12T00:27:59.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.788+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=F1MNZHUYIXKF type=del 2024-09-12T00:27:59.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.792+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=6RTPMFWTL8TA type=del size=3928387 2024-09-12T00:27:59.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.796+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~685ZCA32X38Z.0 size=1006985 2024-09-12T00:27:59.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.804+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=685ZCA32X38Z tag=U63HWFQ4A27Y type=write size=2055561 2024-09-12T00:27:59.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.808+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~EW8YPKIG5IF3.0 size=441809 2024-09-12T00:27:59.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.808+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=EW8YPKIG5IF3 tag=7AH860O1FEZZ type=write size=1490385 2024-09-12T00:27:59.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.816+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=8WZ2P5H4O5LT type=del 2024-09-12T00:27:59.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.824+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~EIZ4KG2CIW20.0 size=1048576 2024-09-12T00:27:59.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.824+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~EIZ4KG2CIW20.1 size=37342 2024-09-12T00:27:59.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.824+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=EIZ4KG2CIW20 tag=GFHWORDZU4AQ type=write size=2134494 2024-09-12T00:27:59.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.828+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~UZ9LYI17F10A.0 size=164811 2024-09-12T00:27:59.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.836+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=UZ9LYI17F10A tag=SC0KZ78U4PGD type=write size=1213387 2024-09-12T00:27:59.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.844+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~SNKUDW1QI9TW.0 size=1048576 2024-09-12T00:27:59.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.844+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~SNKUDW1QI9TW.1 size=132001 2024-09-12T00:27:59.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.844+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=SNKUDW1QI9TW tag=RDD9NPD3AQ6I type=write size=2229153 2024-09-12T00:27:59.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.848+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=3GRG6YPFVKTJ type=del 2024-09-12T00:27:59.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.852+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=GSKDMNURYWLG type=del size=2208916 2024-09-12T00:27:59.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.852+0000 7f712938c8c0 1 < canceled part key=_multipart_VAFU5FXA2KLC.2~E6GNG1MHKXYS.0 size=1048576 2024-09-12T00:27:59.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.856+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~E6GNG1MHKXYS.1 size=195734 2024-09-12T00:27:59.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.864+0000 7f712938c8c0 1 < canceled multipart upload key=VAFU5FXA2KLC upload=E6GNG1MHKXYS tag=TBAT7T7HU20H type=write size=2292886 2024-09-12T00:27:59.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.868+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~0KJ1R1QZC15Z.0 size=1048576 2024-09-12T00:27:59.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.872+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~0KJ1R1QZC15Z.1 size=1048576 2024-09-12T00:27:59.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.876+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~0KJ1R1QZC15Z.2 size=41393 2024-09-12T00:27:59.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.876+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=0KJ1R1QZC15Z tag=XZPMK6T1CW28 type=write size=3187121 2024-09-12T00:27:59.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.884+0000 7f712938c8c0 1 < suggested update operation key=W9YW6AS1RL48 tag=ISG0J1G8HRPN type=del size=3049473 2024-09-12T00:27:59.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.888+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~5LB9WLK960LG.0 size=1048576 2024-09-12T00:27:59.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.892+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~5LB9WLK960LG.1 size=833530 2024-09-12T00:27:59.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.892+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=5LB9WLK960LG tag=IFW01Q4Y1FPN type=write size=2930682 2024-09-12T00:27:59.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.896+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=GGGW1CJRNOTN type=del 2024-09-12T00:27:59.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.900+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=V7CHB2KNK64J type=write size=79675 2024-09-12T00:27:59.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.904+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~5DI8QNDWHL2V.0 size=1048576 2024-09-12T00:27:59.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.904+0000 7f712938c8c0 1 < canceled part key=_multipart_5KVIIZS50CNT.2~5DI8QNDWHL2V.1 size=1048576 2024-09-12T00:27:59.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.908+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~5DI8QNDWHL2V.2 size=528869 2024-09-12T00:27:59.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.912+0000 7f712938c8c0 1 < canceled multipart upload key=5KVIIZS50CNT upload=5DI8QNDWHL2V tag=XV1VQXXB1VEK type=write size=3674597 2024-09-12T00:27:59.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.916+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=6ABVAP3QD5W0 type=del size=1125835 2024-09-12T00:27:59.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.920+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=9X9PADEZNCO2 type=write size=931113 2024-09-12T00:27:59.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.924+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=DIKIOQCHBSV7 type=del size=593393 2024-09-12T00:27:59.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.932+0000 7f712938c8c0 1 < suggested update operation key=F7T79C7MZX35 tag=F07Q1NJRL4GW type=del size=1756772 2024-09-12T00:27:59.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.940+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~KJ8VSWZET0Z3.0 size=747928 2024-09-12T00:27:59.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.940+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=KJ8VSWZET0Z3 tag=XNDHGOS03JTI type=write size=1796504 2024-09-12T00:27:59.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.944+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=61Y9OI7O7KFZ type=del 2024-09-12T00:27:59.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.948+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=W0JO7O82Y7HN type=del size=732731 2024-09-12T00:27:59.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.952+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=6CRNE3LAU12X type=write size=618297 2024-09-12T00:27:59.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.960+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~TE8PBVQ8X9J1.0 size=153747 2024-09-12T00:27:59.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.960+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=TE8PBVQ8X9J1 tag=8FYG8KVJYP52 type=write size=1202323 2024-09-12T00:27:59.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.960+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=897UNBSGB5FQ type=del 2024-09-12T00:27:59.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.964+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=FCAXS9IWCVN7 type=write size=123364 2024-09-12T00:27:59.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.968+0000 7f712938c8c0 1 < completed write operation key=UAJEZUYXN2R0 tag=6BR7SWQ0LY40 type=write size=695957 2024-09-12T00:27:59.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.972+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=4BYWNFIZ4LOM type=del size=3077975 2024-09-12T00:27:59.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.976+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~9Z5KLE29NS57.0 size=1048576 2024-09-12T00:27:59.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.980+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~9Z5KLE29NS57.1 size=1048576 2024-09-12T00:27:59.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.984+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~9Z5KLE29NS57.2 size=212987 2024-09-12T00:27:59.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.988+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=9Z5KLE29NS57 tag=5DYQQOJXP3VD type=write size=3358715 2024-09-12T00:27:59.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:27:59.996+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~ZQGR1M5AQCBY.0 size=1048576 2024-09-12T00:27:59.998 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.000+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~ZQGR1M5AQCBY.1 size=1048576 2024-09-12T00:28:00.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.000+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~ZQGR1M5AQCBY.2 size=174692 2024-09-12T00:28:00.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.000+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=ZQGR1M5AQCBY tag=CO3B9LTNMH7N type=write size=3320420 2024-09-12T00:28:00.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.012+0000 7f712938c8c0 1 < suggested remove operation key=9HX9GER6OKVI tag=6RTPMFWTL8TA type=del 2024-09-12T00:28:00.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.016+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~ZYLX15H9YWHX.0 size=1048576 2024-09-12T00:28:00.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.020+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~ZYLX15H9YWHX.1 size=1048576 2024-09-12T00:28:00.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.024+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~ZYLX15H9YWHX.2 size=17348 2024-09-12T00:28:00.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.024+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=ZYLX15H9YWHX tag=HPPXRBG82FKD type=write size=3163076 2024-09-12T00:28:00.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.024+0000 7f712938c8c0 1 < canceled part key=_multipart_W01PFMFNYLED.2~EW8YPKIG5IF3.0 size=441809 2024-09-12T00:28:00.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.032+0000 7f712938c8c0 1 < canceled multipart upload key=W01PFMFNYLED upload=EW8YPKIG5IF3 tag=7AH860O1FEZZ type=write size=1490385 2024-09-12T00:28:00.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.036+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=0Y72NS2DGX9W type=del size=2118398 2024-09-12T00:28:00.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.036+0000 7f712938c8c0 1 < canceled part key=_multipart_9HX9GER6OKVI.2~EIZ4KG2CIW20.0 size=1048576 2024-09-12T00:28:00.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.040+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~EIZ4KG2CIW20.1 size=37342 2024-09-12T00:28:00.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.044+0000 7f712938c8c0 1 < canceled multipart upload key=9HX9GER6OKVI upload=EIZ4KG2CIW20 tag=GFHWORDZU4AQ type=write size=2134494 2024-09-12T00:28:00.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.048+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=BC9T3O237ZW2 type=del size=582212 2024-09-12T00:28:00.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.052+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~SNKUDW1QI9TW.0 size=1048576 2024-09-12T00:28:00.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.056+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~SNKUDW1QI9TW.1 size=132001 2024-09-12T00:28:00.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.064+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=SNKUDW1QI9TW tag=RDD9NPD3AQ6I type=write size=2229153 2024-09-12T00:28:00.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.072+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~FCVYW7K8F2ND.0 size=1048576 2024-09-12T00:28:00.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.072+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~FCVYW7K8F2ND.1 size=1048576 2024-09-12T00:28:00.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.076+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~FCVYW7K8F2ND.2 size=446342 2024-09-12T00:28:00.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.076+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=FCVYW7K8F2ND tag=P31RYFMWWGGO type=write size=3592070 2024-09-12T00:28:00.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.080+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=GSKDMNURYWLG type=del 2024-09-12T00:28:00.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.088+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~OCES5T7RLPKL.0 size=1048576 2024-09-12T00:28:00.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.088+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~OCES5T7RLPKL.1 size=1048576 2024-09-12T00:28:00.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.092+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~OCES5T7RLPKL.2 size=1043389 2024-09-12T00:28:00.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.092+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=OCES5T7RLPKL tag=2LRH0025NKA3 type=write size=4189117 2024-09-12T00:28:00.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.096+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~0KJ1R1QZC15Z.0 size=1048576 2024-09-12T00:28:00.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.096+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~0KJ1R1QZC15Z.1 size=1048576 2024-09-12T00:28:00.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.100+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~0KJ1R1QZC15Z.2 size=41393 2024-09-12T00:28:00.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.104+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=0KJ1R1QZC15Z tag=XZPMK6T1CW28 type=write size=3187121 2024-09-12T00:28:00.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.108+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=56BMD8CXJ0U5 type=del size=4183952 2024-09-12T00:28:00.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.112+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~5LB9WLK960LG.0 size=1048576 2024-09-12T00:28:00.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.116+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~5LB9WLK960LG.1 size=833530 2024-09-12T00:28:00.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.120+0000 7f712938c8c0 1 < completed multipart upload key=7X45VJAQO7PF upload=5LB9WLK960LG tag=IFW01Q4Y1FPN type=write size=2930682 2024-09-12T00:28:00.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.128+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~TT8LDNGI1TXJ.0 size=1048576 2024-09-12T00:28:00.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.128+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~TT8LDNGI1TXJ.1 size=130059 2024-09-12T00:28:00.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.128+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=TT8LDNGI1TXJ tag=FMGKMNZGPLAG type=write size=2227211 2024-09-12T00:28:00.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.136+0000 7f712938c8c0 1 < suggested remove operation key=MUNSUH4BMZNP tag=V7CHB2KNK64J type=write 2024-09-12T00:28:00.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.136+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=YMMPVLH53WBQ type=del size=1640659 2024-09-12T00:28:00.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.140+0000 7f712938c8c0 -1 < failed to complete operation key=F7T79C7MZX35 tag=6ABVAP3QD5W0 type=del size=1125835: (22) Invalid argument 2024-09-12T00:28:00.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.144+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=HHB4IWKYIQ6N type=del size=615170 2024-09-12T00:28:00.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.152+0000 7f712938c8c0 1 < suggested remove operation key=G0065P5NOJ2F tag=DIKIOQCHBSV7 type=del 2024-09-12T00:28:00.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.156+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=Z1USL9WR75PE type=del size=3027961 2024-09-12T00:28:00.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.160+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~KJ8VSWZET0Z3.0 size=747928 2024-09-12T00:28:00.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.164+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=KJ8VSWZET0Z3 tag=XNDHGOS03JTI type=write size=1796504 2024-09-12T00:28:00.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.168+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=YGAFYUEH1Q4N type=del size=1198080 2024-09-12T00:28:00.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.172+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=W0JO7O82Y7HN type=del 2024-09-12T00:28:00.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.176+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~JB8EJKNB7BZ0.0 size=132222 2024-09-12T00:28:00.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.176+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=JB8EJKNB7BZ0 tag=1FIUTNMOC2IR type=write size=1180798 2024-09-12T00:28:00.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.180+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~TE8PBVQ8X9J1.0 size=153747 2024-09-12T00:28:00.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.188+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=TE8PBVQ8X9J1 tag=8FYG8KVJYP52 type=write size=1202323 2024-09-12T00:28:00.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.192+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=1Y26U15TKR3M type=write size=386376 2024-09-12T00:28:00.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.200+0000 7f712938c8c0 1 < suggested remove operation key=9751RNPPQJBO tag=FCAXS9IWCVN7 type=write 2024-09-12T00:28:00.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.204+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=EORGD1HZ12UL type=del size=3072155 2024-09-12T00:28:00.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.208+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=4BYWNFIZ4LOM type=del 2024-09-12T00:28:00.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.212+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=KZRL5EAAX9SX type=write size=397278 2024-09-12T00:28:00.216 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.216+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~ZQGR1M5AQCBY.0 size=1048576 2024-09-12T00:28:00.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.220+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~ZQGR1M5AQCBY.1 size=1048576 2024-09-12T00:28:00.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.220+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~ZQGR1M5AQCBY.2 size=174692 2024-09-12T00:28:00.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.228+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=ZQGR1M5AQCBY tag=CO3B9LTNMH7N type=write size=3320420 2024-09-12T00:28:00.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.232+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=MLJXF6M71PI6 type=del size=423483 2024-09-12T00:28:00.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.236+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~ZYLX15H9YWHX.0 size=1048576 2024-09-12T00:28:00.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.240+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~ZYLX15H9YWHX.1 size=1048576 2024-09-12T00:28:00.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.244+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~ZYLX15H9YWHX.2 size=17348 2024-09-12T00:28:00.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.248+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=ZYLX15H9YWHX tag=HPPXRBG82FKD type=write size=3163076 2024-09-12T00:28:00.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.252+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=ZQ6F46XTXD2R type=del size=2491017 2024-09-12T00:28:00.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.260+0000 7f712938c8c0 1 < suggested remove operation key=QG0W04PRTQNP tag=0Y72NS2DGX9W type=del 2024-09-12T00:28:00.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.264+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=4Y6SCAUC15EF type=del size=996274 2024-09-12T00:28:00.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.268+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=BC9T3O237ZW2 type=del 2024-09-12T00:28:00.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.276+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~N6UVLUSNIPJ1.0 size=1048576 2024-09-12T00:28:00.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.280+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~N6UVLUSNIPJ1.1 size=924577 2024-09-12T00:28:00.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.280+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=N6UVLUSNIPJ1 tag=EG7UXRNPD9TY type=write size=3021729 2024-09-12T00:28:00.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.284+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~FCVYW7K8F2ND.0 size=1048576 2024-09-12T00:28:00.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.288+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~FCVYW7K8F2ND.1 size=1048576 2024-09-12T00:28:00.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.288+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~FCVYW7K8F2ND.2 size=446342 2024-09-12T00:28:00.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.296+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=FCVYW7K8F2ND tag=P31RYFMWWGGO type=write size=3592070 2024-09-12T00:28:00.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.300+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=SWOPT23AKFCA type=del size=278776 2024-09-12T00:28:00.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.304+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~OCES5T7RLPKL.0 size=1048576 2024-09-12T00:28:00.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.304+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~OCES5T7RLPKL.1 size=1048576 2024-09-12T00:28:00.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.304+0000 7f712938c8c0 1 < canceled part key=_multipart_WP4RJQVZVEE2.2~OCES5T7RLPKL.2 size=1043389 2024-09-12T00:28:00.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.312+0000 7f712938c8c0 1 < canceled multipart upload key=WP4RJQVZVEE2 upload=OCES5T7RLPKL tag=2LRH0025NKA3 type=write size=4189117 2024-09-12T00:28:00.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.316+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=UKNYDEVS7HAQ type=del size=1447458 2024-09-12T00:28:00.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.320+0000 7f712938c8c0 -1 < failed to complete operation key=G0065P5NOJ2F tag=56BMD8CXJ0U5 type=del size=4183952: (22) Invalid argument 2024-09-12T00:28:00.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.324+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~E15BL846T8D3.0 size=1048576 2024-09-12T00:28:00.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.328+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~E15BL846T8D3.1 size=1048576 2024-09-12T00:28:00.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.332+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~E15BL846T8D3.2 size=1015386 2024-09-12T00:28:00.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.332+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=E15BL846T8D3 tag=NVFRL0QBKJ3X type=write size=4161114 2024-09-12T00:28:00.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.336+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~TT8LDNGI1TXJ.0 size=1048576 2024-09-12T00:28:00.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.336+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~TT8LDNGI1TXJ.1 size=130059 2024-09-12T00:28:00.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.344+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=TT8LDNGI1TXJ tag=FMGKMNZGPLAG type=write size=2227211 2024-09-12T00:28:00.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.348+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=7H9XC2AZNR1F type=del size=241574 2024-09-12T00:28:00.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.356+0000 7f712938c8c0 1 < suggested update operation key=F7T79C7MZX35 tag=YMMPVLH53WBQ type=del size=1640659 2024-09-12T00:28:00.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.360+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=JRZXQKUEK2UL type=del size=2519452 2024-09-12T00:28:00.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.364+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=HHB4IWKYIQ6N type=del 2024-09-12T00:28:00.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.368+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=NYGI341Q8P22 type=write size=31613 2024-09-12T00:28:00.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.372+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=Z1USL9WR75PE type=del 2024-09-12T00:28:00.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.376+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=MR1B519SZ4AZ type=del size=2111627 2024-09-12T00:28:00.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.380+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=YGAFYUEH1Q4N type=del 2024-09-12T00:28:00.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.384+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~MM9TCTT985OX.0 size=1048576 2024-09-12T00:28:00.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.388+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~MM9TCTT985OX.1 size=972235 2024-09-12T00:28:00.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.388+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=MM9TCTT985OX tag=00P9OI7AB7M2 type=write size=3069387 2024-09-12T00:28:00.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.392+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~JB8EJKNB7BZ0.0 size=132222 2024-09-12T00:28:00.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.400+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=JB8EJKNB7BZ0 tag=1FIUTNMOC2IR type=write size=1180798 2024-09-12T00:28:00.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.404+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=I3S3OMFHPCNF type=del size=1841725 2024-09-12T00:28:00.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.408+0000 7f712938c8c0 1 < completed write operation key=N69XPNN6Y6HZ tag=1Y26U15TKR3M type=write size=386376 2024-09-12T00:28:00.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.412+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=BSH0YBGA3DV7 type=del size=1401432 2024-09-12T00:28:00.414 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.416+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=EORGD1HZ12UL type=del 2024-09-12T00:28:00.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.420+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=72682Y4FMAT1 type=del size=3389243 2024-09-12T00:28:00.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.424+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=KZRL5EAAX9SX type=write size=397278 2024-09-12T00:28:00.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.424+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=TWDT8HA0LKZZ type=del size=1230058 2024-09-12T00:28:00.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.428+0000 7f712938c8c0 -1 < failed to complete operation key=QG0W04PRTQNP tag=MLJXF6M71PI6 type=del size=423483: (22) Invalid argument 2024-09-12T00:28:00.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.432+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=N33UTKF92AJO type=write size=196885 2024-09-12T00:28:00.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.436+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=ZQ6F46XTXD2R type=del 2024-09-12T00:28:00.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.440+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=KQPMCYS215SW type=del size=3406090 2024-09-12T00:28:00.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.444+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=4Y6SCAUC15EF type=del 2024-09-12T00:28:00.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.448+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=QACRH2NABG73 type=write size=31586 2024-09-12T00:28:00.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.452+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~N6UVLUSNIPJ1.0 size=1048576 2024-09-12T00:28:00.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.456+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~N6UVLUSNIPJ1.1 size=924577 2024-09-12T00:28:00.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.464+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=N6UVLUSNIPJ1 tag=EG7UXRNPD9TY type=write size=3021729 2024-09-12T00:28:00.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.468+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=GYZBOS5UXMOY type=del size=1339456 2024-09-12T00:28:00.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.472+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=SWOPT23AKFCA type=del 2024-09-12T00:28:00.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.480+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~B9W9XWJEWERQ.0 size=1048576 2024-09-12T00:28:00.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.480+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~B9W9XWJEWERQ.1 size=881443 2024-09-12T00:28:00.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.480+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=B9W9XWJEWERQ tag=Y8A8OK1H49B9 type=write size=2978595 2024-09-12T00:28:00.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.488+0000 7f712938c8c0 1 < suggested remove operation key=BH2YHXHVEZCH tag=UKNYDEVS7HAQ type=del 2024-09-12T00:28:00.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.496+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=6STUUC2X650M type=write size=304229 2024-09-12T00:28:00.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.496+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~E15BL846T8D3.0 size=1048576 2024-09-12T00:28:00.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.500+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~E15BL846T8D3.1 size=1048576 2024-09-12T00:28:00.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.500+0000 7f712938c8c0 1 < canceled part key=_multipart_L2SR6IAW0D38.2~E15BL846T8D3.2 size=1015386 2024-09-12T00:28:00.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.512+0000 7f712938c8c0 1 < canceled multipart upload key=L2SR6IAW0D38 upload=E15BL846T8D3 tag=NVFRL0QBKJ3X type=write size=4161114 2024-09-12T00:28:00.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.516+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=FFW57BOWDGUK type=del size=4074102 2024-09-12T00:28:00.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.520+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=7H9XC2AZNR1F type=del 2024-09-12T00:28:00.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.524+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~TGITNNSYT1WQ.0 size=1048576 2024-09-12T00:28:00.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.528+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~TGITNNSYT1WQ.1 size=451110 2024-09-12T00:28:00.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.528+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=TGITNNSYT1WQ tag=RHXQXGN6EY2S type=write size=2548262 2024-09-12T00:28:00.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.536+0000 7f712938c8c0 1 < suggested update operation key=KNGB14TWW6XC tag=JRZXQKUEK2UL type=del size=2519452 2024-09-12T00:28:00.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.540+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=GQ4H9HQS4K0G type=write size=515999 2024-09-12T00:28:00.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.544+0000 7f712938c8c0 1 < completed write operation key=MUNSUH4BMZNP tag=NYGI341Q8P22 type=write size=31613 2024-09-12T00:28:00.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.544+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=0CC6LNNIGBN7 type=del size=1397064 2024-09-12T00:28:00.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.548+0000 7f712938c8c0 -1 < no bi entry to suggest for operation key=BH2YHXHVEZCH tag=MR1B519SZ4AZ type=del size=2111627: (2) No such file or directory 2024-09-12T00:28:00.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.552+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=DWC86YU72EPV type=write size=209964 2024-09-12T00:28:00.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.556+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~MM9TCTT985OX.0 size=1048576 2024-09-12T00:28:00.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.556+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~MM9TCTT985OX.1 size=972235 2024-09-12T00:28:00.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.564+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=MM9TCTT985OX tag=00P9OI7AB7M2 type=write size=3069387 2024-09-12T00:28:00.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.568+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=MNZOEYV3HLYR type=del size=1180822 2024-09-12T00:28:00.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.572+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=I3S3OMFHPCNF type=del 2024-09-12T00:28:00.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.576+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=MUWTHBV10CN9 type=del size=2180997 2024-09-12T00:28:00.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.576+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=BSH0YBGA3DV7 type=del 2024-09-12T00:28:00.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.584+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~I75C8KGKML6B.0 size=1048576 2024-09-12T00:28:00.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.584+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~I75C8KGKML6B.1 size=1048576 2024-09-12T00:28:00.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.588+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~I75C8KGKML6B.2 size=796474 2024-09-12T00:28:00.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.588+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=I75C8KGKML6B tag=TVCV7OMHLSAS type=write size=3942202 2024-09-12T00:28:00.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.592+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=72682Y4FMAT1 type=del 2024-09-12T00:28:00.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.600+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~QXUXR7KA6V0B.0 size=1048576 2024-09-12T00:28:00.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.600+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~QXUXR7KA6V0B.1 size=1048576 2024-09-12T00:28:00.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.604+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~QXUXR7KA6V0B.2 size=131734 2024-09-12T00:28:00.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.604+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=QXUXR7KA6V0B tag=YJ7IA9JGXJ4A type=write size=3277462 2024-09-12T00:28:00.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.608+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=TWDT8HA0LKZZ type=del 2024-09-12T00:28:00.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.612+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QN9BOKZSSRIU.0 size=1048576 2024-09-12T00:28:00.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.616+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QN9BOKZSSRIU.1 size=1048576 2024-09-12T00:28:00.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.620+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~QN9BOKZSSRIU.2 size=290188 2024-09-12T00:28:00.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.620+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=QN9BOKZSSRIU tag=O99E0W1VWIAP type=write size=3435916 2024-09-12T00:28:00.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.624+0000 7f712938c8c0 1 < suggested update operation key=HPM9GFRASWIV tag=N33UTKF92AJO type=write size=196885 2024-09-12T00:28:00.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.632+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~RF1240W05BPG.0 size=936477 2024-09-12T00:28:00.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.632+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=RF1240W05BPG tag=WY89J8U3W7K7 type=write size=1985053 2024-09-12T00:28:00.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.636+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=KQPMCYS215SW type=del 2024-09-12T00:28:00.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.640+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=5W2PE4KZL2MU type=del size=1191553 2024-09-12T00:28:00.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.644+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=QACRH2NABG73 type=write size=31586 2024-09-12T00:28:00.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.648+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=N1CJSCNKLN16 type=del size=909941 2024-09-12T00:28:00.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.656+0000 7f712938c8c0 1 < suggested update operation key=5KVIIZS50CNT tag=GYZBOS5UXMOY type=del size=1339456 2024-09-12T00:28:00.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.660+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=JB5CC29SYP2I type=del size=3891228 2024-09-12T00:28:00.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.660+0000 7f712938c8c0 1 < canceled part key=_multipart_W01PFMFNYLED.2~B9W9XWJEWERQ.0 size=1048576 2024-09-12T00:28:00.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.660+0000 7f712938c8c0 1 < canceled part key=_multipart_W01PFMFNYLED.2~B9W9XWJEWERQ.1 size=881443 2024-09-12T00:28:00.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.668+0000 7f712938c8c0 1 < canceled multipart upload key=W01PFMFNYLED upload=B9W9XWJEWERQ tag=Y8A8OK1H49B9 type=write size=2978595 2024-09-12T00:28:00.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.672+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~62S3LE0Q03DB.0 size=1048576 2024-09-12T00:28:00.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.676+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~62S3LE0Q03DB.1 size=1048576 2024-09-12T00:28:00.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.680+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~62S3LE0Q03DB.2 size=412800 2024-09-12T00:28:00.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.680+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=62S3LE0Q03DB tag=0K71FXGA3OBQ type=write size=3558528 2024-09-12T00:28:00.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.684+0000 7f712938c8c0 1 < completed write operation key=W01PFMFNYLED tag=6STUUC2X650M type=write size=304229 2024-09-12T00:28:00.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.692+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~LM1SUEIE3XDT.0 size=435021 2024-09-12T00:28:00.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.692+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=LM1SUEIE3XDT tag=NWP78RQSBYJ4 type=write size=1483597 2024-09-12T00:28:00.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.696+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=FFW57BOWDGUK type=del 2024-09-12T00:28:00.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.696+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=WZMLKZD2LV9R type=del size=22650 2024-09-12T00:28:00.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.700+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~TGITNNSYT1WQ.0 size=1048576 2024-09-12T00:28:00.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.704+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~TGITNNSYT1WQ.1 size=451110 2024-09-12T00:28:00.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.708+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=TGITNNSYT1WQ tag=RHXQXGN6EY2S type=write size=2548262 2024-09-12T00:28:00.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.712+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=7US27HJOLJUI type=del size=4022884 2024-09-12T00:28:00.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.716+0000 7f712938c8c0 1 < completed write operation key=A8L061CQ0M0J tag=GQ4H9HQS4K0G type=write size=515999 2024-09-12T00:28:00.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.720+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=5GZIRHOMIQBG type=del size=3629576 2024-09-12T00:28:00.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.724+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=0CC6LNNIGBN7 type=del 2024-09-12T00:28:00.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.732+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~B7B010EK2V2S.0 size=317297 2024-09-12T00:28:00.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.732+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=B7B010EK2V2S tag=6QV6SHZ9RT50 type=write size=1365873 2024-09-12T00:28:00.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.736+0000 7f712938c8c0 1 < completed write operation key=ZP88X00LMVSS tag=DWC86YU72EPV type=write size=209964 2024-09-12T00:28:00.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.740+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~ATNC4FB7SQQE.0 size=1029692 2024-09-12T00:28:00.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.740+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=ATNC4FB7SQQE tag=W50FFIHINN5G type=write size=2078268 2024-09-12T00:28:00.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.744+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=MNZOEYV3HLYR type=del 2024-09-12T00:28:00.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.748+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=9V1IYJJ8HZVG type=del size=1297835 2024-09-12T00:28:00.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.752+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=MUWTHBV10CN9 type=del 2024-09-12T00:28:00.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.760+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~C90KVXK25693.0 size=1048576 2024-09-12T00:28:00.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.760+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~C90KVXK25693.1 size=60442 2024-09-12T00:28:00.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.760+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=C90KVXK25693 tag=VPQ586QPGB5N type=write size=2157594 2024-09-12T00:28:00.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.764+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~I75C8KGKML6B.0 size=1048576 2024-09-12T00:28:00.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.768+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~I75C8KGKML6B.1 size=1048576 2024-09-12T00:28:00.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.772+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~I75C8KGKML6B.2 size=796474 2024-09-12T00:28:00.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.776+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=I75C8KGKML6B tag=TVCV7OMHLSAS type=write size=3942202 2024-09-12T00:28:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.780+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=13C6NJK10I25 type=del size=680054 2024-09-12T00:28:00.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.784+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~QXUXR7KA6V0B.0 size=1048576 2024-09-12T00:28:00.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.788+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~QXUXR7KA6V0B.1 size=1048576 2024-09-12T00:28:00.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.792+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~QXUXR7KA6V0B.2 size=131734 2024-09-12T00:28:00.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.796+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=QXUXR7KA6V0B tag=YJ7IA9JGXJ4A type=write size=3277462 2024-09-12T00:28:00.803 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.804+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~UN6N2O7KGGPT.0 size=1048576 2024-09-12T00:28:00.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.808+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~UN6N2O7KGGPT.1 size=173450 2024-09-12T00:28:00.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.808+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=UN6N2O7KGGPT tag=JED33X15R8OS type=write size=2270602 2024-09-12T00:28:00.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.808+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~QN9BOKZSSRIU.0 size=1048576 2024-09-12T00:28:00.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.812+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~QN9BOKZSSRIU.1 size=1048576 2024-09-12T00:28:00.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.812+0000 7f712938c8c0 1 < canceled part key=_multipart_UAJEZUYXN2R0.2~QN9BOKZSSRIU.2 size=290188 2024-09-12T00:28:00.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.820+0000 7f712938c8c0 1 < canceled multipart upload key=UAJEZUYXN2R0 upload=QN9BOKZSSRIU tag=O99E0W1VWIAP type=write size=3435916 2024-09-12T00:28:00.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.824+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=38BUCS8YL2Q6 type=del size=1485352 2024-09-12T00:28:00.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.824+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~RF1240W05BPG.0 size=936477 2024-09-12T00:28:00.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.832+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=RF1240W05BPG tag=WY89J8U3W7K7 type=write size=1985053 2024-09-12T00:28:00.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.836+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=N4Q9SQW01QN6 type=write size=63011 2024-09-12T00:28:00.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.840+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=5W2PE4KZL2MU type=del 2024-09-12T00:28:00.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.844+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=9GC7YU93SGNF type=del size=131565 2024-09-12T00:28:00.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.856+0000 7f712938c8c0 1 < suggested update operation key=ZP88X00LMVSS tag=N1CJSCNKLN16 type=del size=909941 2024-09-12T00:28:00.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.860+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=TL3Q5VQS4D28 type=del size=1571788 2024-09-12T00:28:00.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.864+0000 7f712938c8c0 1 < canceled operation key=L2SR6IAW0D38 tag=JB5CC29SYP2I type=del size=3891228 2024-09-12T00:28:00.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.872+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~0UVL1XCPJY30.0 size=942433 2024-09-12T00:28:00.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.872+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=0UVL1XCPJY30 tag=D94AFQBHAO6L type=write size=1991009 2024-09-12T00:28:00.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.876+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~62S3LE0Q03DB.0 size=1048576 2024-09-12T00:28:00.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.880+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~62S3LE0Q03DB.1 size=1048576 2024-09-12T00:28:00.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.884+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~62S3LE0Q03DB.2 size=412800 2024-09-12T00:28:00.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.892+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=62S3LE0Q03DB tag=0K71FXGA3OBQ type=write size=3558528 2024-09-12T00:28:00.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.896+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=8P53OO8KN1Z8 type=write size=974763 2024-09-12T00:28:00.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.900+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~LM1SUEIE3XDT.0 size=435021 2024-09-12T00:28:00.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.904+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=LM1SUEIE3XDT tag=NWP78RQSBYJ4 type=write size=1483597 2024-09-12T00:28:00.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.908+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=II0XVZKGOGU0 type=del size=422686 2024-09-12T00:28:00.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.912+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=WZMLKZD2LV9R type=del 2024-09-12T00:28:00.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.916+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=OS9Z5QOX1PEP type=del size=3739886 2024-09-12T00:28:00.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.920+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=7US27HJOLJUI type=del 2024-09-12T00:28:00.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.928+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~Q3VK8PEOEFH9.0 size=1048576 2024-09-12T00:28:00.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.932+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~Q3VK8PEOEFH9.1 size=1048576 2024-09-12T00:28:00.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.936+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~Q3VK8PEOEFH9.2 size=528295 2024-09-12T00:28:00.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.936+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=Q3VK8PEOEFH9 tag=NOJFPXAZPZ0G type=write size=3674023 2024-09-12T00:28:00.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.940+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=5GZIRHOMIQBG type=del 2024-09-12T00:28:00.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.944+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=91ZVJV9OPSTQ type=del size=3962930 2024-09-12T00:28:00.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.948+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~B7B010EK2V2S.0 size=317297 2024-09-12T00:28:00.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.952+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=B7B010EK2V2S tag=6QV6SHZ9RT50 type=write size=1365873 2024-09-12T00:28:00.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.956+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=OETVRMGMQWP3 type=del size=2181239 2024-09-12T00:28:00.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.960+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~ATNC4FB7SQQE.0 size=1029692 2024-09-12T00:28:00.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.964+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=ATNC4FB7SQQE tag=W50FFIHINN5G type=write size=2078268 2024-09-12T00:28:00.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.972+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~E99QDH7JI9GY.0 size=1048576 2024-09-12T00:28:00.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.976+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~E99QDH7JI9GY.1 size=41078 2024-09-12T00:28:00.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.976+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=E99QDH7JI9GY tag=ECK6A7NOAS0D type=write size=2138230 2024-09-12T00:28:00.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.980+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=9V1IYJJ8HZVG type=del 2024-09-12T00:28:00.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.984+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=YF2I2771B9GI type=write size=1043291 2024-09-12T00:28:00.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.988+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~C90KVXK25693.0 size=1048576 2024-09-12T00:28:00.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.992+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~C90KVXK25693.1 size=60442 2024-09-12T00:28:00.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:00.996+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=C90KVXK25693 tag=VPQ586QPGB5N type=write size=2157594 2024-09-12T00:28:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.000+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=ZXYLKXAOHPGA type=del size=893785 2024-09-12T00:28:01.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.004+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=13C6NJK10I25 type=del 2024-09-12T00:28:01.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.012+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~7TH7K4QZWJJS.0 size=1048576 2024-09-12T00:28:01.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.016+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~7TH7K4QZWJJS.1 size=633043 2024-09-12T00:28:01.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.016+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=7TH7K4QZWJJS tag=T403CQZGHH1G type=write size=2730195 2024-09-12T00:28:01.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.020+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~UN6N2O7KGGPT.0 size=1048576 2024-09-12T00:28:01.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.020+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~UN6N2O7KGGPT.1 size=173450 2024-09-12T00:28:01.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.028+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=UN6N2O7KGGPT tag=JED33X15R8OS type=write size=2270602 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.032+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=DP2P9K9K7E6G type=write size=871432 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.036+0000 7f712938c8c0 1 < canceled operation key=0QZKHZTVP3RQ tag=38BUCS8YL2Q6 type=del size=1485352 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.040+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=OIILZTNFUMAP type=del size=3631958 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.048+0000 7f712938c8c0 1 < suggested update operation key=5KVIIZS50CNT tag=N4Q9SQW01QN6 type=write size=63011 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.052+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~4T3P0843PTKS.0 size=1048576 2024-09-12T00:28:01.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.056+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~4T3P0843PTKS.1 size=856517 2024-09-12T00:28:01.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.056+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=4T3P0843PTKS tag=HXED0HNAAL03 type=write size=2953669 2024-09-12T00:28:01.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.060+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=9GC7YU93SGNF type=del 2024-09-12T00:28:01.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.068+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~K718C4TGEXIS.0 size=193389 2024-09-12T00:28:01.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.068+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=K718C4TGEXIS tag=QXPMVKPL1FWV type=write size=1241965 2024-09-12T00:28:01.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.072+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=TL3Q5VQS4D28 type=del 2024-09-12T00:28:01.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.080+0000 7f712938c8c0 1 > prepared part key=_multipart_KNGB14TWW6XC.2~D4MMUTMKLG8V.0 size=151135 2024-09-12T00:28:01.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.080+0000 7f712938c8c0 1 > prepared multipart upload key=KNGB14TWW6XC upload=D4MMUTMKLG8V tag=4CK3R74WCHWP type=write size=1199711 2024-09-12T00:28:01.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.084+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~0UVL1XCPJY30.0 size=942433 2024-09-12T00:28:01.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.088+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=0UVL1XCPJY30 tag=D94AFQBHAO6L type=write size=1991009 2024-09-12T00:28:01.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.096+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~H21K3SC8WDHS.0 size=339921 2024-09-12T00:28:01.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.096+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=H21K3SC8WDHS tag=80WAT0L07VWJ type=write size=1388497 2024-09-12T00:28:01.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.100+0000 7f712938c8c0 1 < completed write operation key=T1H3O6A6HBQH tag=8P53OO8KN1Z8 type=write size=974763 2024-09-12T00:28:01.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.108+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~65IO0N8HUVCT.0 size=1048576 2024-09-12T00:28:01.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.112+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~65IO0N8HUVCT.1 size=172101 2024-09-12T00:28:01.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.112+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=65IO0N8HUVCT tag=9R1WV6M4K4V4 type=write size=2269253 2024-09-12T00:28:01.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.116+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=II0XVZKGOGU0 type=del 2024-09-12T00:28:01.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.120+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=SKZ1WYZQLIB7 type=write size=145938 2024-09-12T00:28:01.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.124+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=OS9Z5QOX1PEP type=del 2024-09-12T00:28:01.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.128+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=M2X52Q109V28 type=write size=784299 2024-09-12T00:28:01.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.132+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~Q3VK8PEOEFH9.0 size=1048576 2024-09-12T00:28:01.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.136+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~Q3VK8PEOEFH9.1 size=1048576 2024-09-12T00:28:01.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.140+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~Q3VK8PEOEFH9.2 size=528295 2024-09-12T00:28:01.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.144+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=Q3VK8PEOEFH9 tag=NOJFPXAZPZ0G type=write size=3674023 2024-09-12T00:28:01.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.152+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~9EH3OZVTNBW8.0 size=1048576 2024-09-12T00:28:01.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.156+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~9EH3OZVTNBW8.1 size=961811 2024-09-12T00:28:01.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.156+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=9EH3OZVTNBW8 tag=SILOBU8PQEV7 type=write size=3058963 2024-09-12T00:28:01.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.160+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=91ZVJV9OPSTQ type=del 2024-09-12T00:28:01.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.168+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~1AMNOQE9V20E.0 size=1048576 2024-09-12T00:28:01.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.168+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~1AMNOQE9V20E.1 size=1048576 2024-09-12T00:28:01.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.172+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~1AMNOQE9V20E.2 size=893445 2024-09-12T00:28:01.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.172+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=1AMNOQE9V20E tag=7P8DOS60E9N1 type=write size=4039173 2024-09-12T00:28:01.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.176+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=OETVRMGMQWP3 type=del 2024-09-12T00:28:01.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.184+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~SQA00HSVHMXO.0 size=1048576 2024-09-12T00:28:01.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.184+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~SQA00HSVHMXO.1 size=72100 2024-09-12T00:28:01.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.184+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=SQA00HSVHMXO tag=97O9E0ACL2TS type=write size=2169252 2024-09-12T00:28:01.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.188+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~E99QDH7JI9GY.0 size=1048576 2024-09-12T00:28:01.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.192+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~E99QDH7JI9GY.1 size=41078 2024-09-12T00:28:01.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.200+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=E99QDH7JI9GY tag=ECK6A7NOAS0D type=write size=2138230 2024-09-12T00:28:01.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.208+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~ZIK2T462S8LY.0 size=1048576 2024-09-12T00:28:01.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.216+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~ZIK2T462S8LY.1 size=1048576 2024-09-12T00:28:01.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.216+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~ZIK2T462S8LY.2 size=907338 2024-09-12T00:28:01.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.216+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=ZIK2T462S8LY tag=AZTHF2LP1XPH type=write size=4053066 2024-09-12T00:28:01.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.224+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=YF2I2771B9GI type=write size=1043291 2024-09-12T00:28:01.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.228+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=DOV0XL71ZQEK type=del size=1861274 2024-09-12T00:28:01.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.232+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=ZXYLKXAOHPGA type=del 2024-09-12T00:28:01.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.236+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=D971HI87XWJO type=write size=940024 2024-09-12T00:28:01.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.240+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~7TH7K4QZWJJS.0 size=1048576 2024-09-12T00:28:01.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.240+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~7TH7K4QZWJJS.1 size=633043 2024-09-12T00:28:01.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.248+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=7TH7K4QZWJJS tag=T403CQZGHH1G type=write size=2730195 2024-09-12T00:28:01.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.252+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=09SRI25Y4HX6 type=del size=3635886 2024-09-12T00:28:01.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.256+0000 7f712938c8c0 1 < completed write operation key=N69XPNN6Y6HZ tag=DP2P9K9K7E6G type=write size=871432 2024-09-12T00:28:01.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.260+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=U68CCSWVCHU1 type=del size=1801634 2024-09-12T00:28:01.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.268+0000 7f712938c8c0 1 < suggested remove operation key=UAJEZUYXN2R0 tag=OIILZTNFUMAP type=del 2024-09-12T00:28:01.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.272+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=6V845K4Q9DDD type=del size=3001779 2024-09-12T00:28:01.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.276+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~4T3P0843PTKS.0 size=1048576 2024-09-12T00:28:01.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.276+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~4T3P0843PTKS.1 size=856517 2024-09-12T00:28:01.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.284+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=4T3P0843PTKS tag=HXED0HNAAL03 type=write size=2953669 2024-09-12T00:28:01.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.288+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=GEYLTFRK9YK5 type=del size=2923428 2024-09-12T00:28:01.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.292+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~K718C4TGEXIS.0 size=193389 2024-09-12T00:28:01.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.296+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=K718C4TGEXIS tag=QXPMVKPL1FWV type=write size=1241965 2024-09-12T00:28:01.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.304+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~6KPNFR4PVW8C.0 size=1048576 2024-09-12T00:28:01.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.304+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~6KPNFR4PVW8C.1 size=1048576 2024-09-12T00:28:01.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.308+0000 7f712938c8c0 1 > prepared part key=_multipart_W01PFMFNYLED.2~6KPNFR4PVW8C.2 size=277299 2024-09-12T00:28:01.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.308+0000 7f712938c8c0 1 > prepared multipart upload key=W01PFMFNYLED upload=6KPNFR4PVW8C tag=65ICUZVV4XW5 type=write size=3423027 2024-09-12T00:28:01.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.312+0000 7f712938c8c0 1 < completed part key=_multipart_KNGB14TWW6XC.2~D4MMUTMKLG8V.0 size=151135 2024-09-12T00:28:01.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.320+0000 7f712938c8c0 1 < completed multipart upload key=KNGB14TWW6XC upload=D4MMUTMKLG8V tag=4CK3R74WCHWP type=write size=1199711 2024-09-12T00:28:01.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.324+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=YF0A2I0Q62KT type=write size=455812 2024-09-12T00:28:01.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.328+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~H21K3SC8WDHS.0 size=339921 2024-09-12T00:28:01.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.332+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=H21K3SC8WDHS tag=80WAT0L07VWJ type=write size=1388497 2024-09-12T00:28:01.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.336+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=TKFWU8IIFMDX type=del size=2516564 2024-09-12T00:28:01.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.340+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~65IO0N8HUVCT.0 size=1048576 2024-09-12T00:28:01.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.344+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~65IO0N8HUVCT.1 size=172101 2024-09-12T00:28:01.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.348+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=65IO0N8HUVCT tag=9R1WV6M4K4V4 type=write size=2269253 2024-09-12T00:28:01.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.352+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=I3HINRD1FU31 type=write size=172102 2024-09-12T00:28:01.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.364+0000 7f712938c8c0 1 < suggested remove operation key=0QZKHZTVP3RQ tag=SKZ1WYZQLIB7 type=write 2024-09-12T00:28:01.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.368+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=YNB8RS36B79J type=del size=3786556 2024-09-12T00:28:01.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.372+0000 7f712938c8c0 1 < completed write operation key=W9YW6AS1RL48 tag=M2X52Q109V28 type=write size=784299 2024-09-12T00:28:01.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.380+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~N47FB6G4153U.0 size=1048576 2024-09-12T00:28:01.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.380+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~N47FB6G4153U.1 size=1048576 2024-09-12T00:28:01.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.384+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~N47FB6G4153U.2 size=944118 2024-09-12T00:28:01.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.384+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=N47FB6G4153U tag=0KI742VBH9MM type=write size=4089846 2024-09-12T00:28:01.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.388+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~9EH3OZVTNBW8.0 size=1048576 2024-09-12T00:28:01.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.392+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~9EH3OZVTNBW8.1 size=961811 2024-09-12T00:28:01.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.396+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=9EH3OZVTNBW8 tag=SILOBU8PQEV7 type=write size=3058963 2024-09-12T00:28:01.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.404+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~WTIIE06KAAEW.0 size=214325 2024-09-12T00:28:01.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.404+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=WTIIE06KAAEW tag=WMKC8G3E1W11 type=write size=1262901 2024-09-12T00:28:01.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.408+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~1AMNOQE9V20E.0 size=1048576 2024-09-12T00:28:01.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.412+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~1AMNOQE9V20E.1 size=1048576 2024-09-12T00:28:01.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.412+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~1AMNOQE9V20E.2 size=893445 2024-09-12T00:28:01.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.420+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=1AMNOQE9V20E tag=7P8DOS60E9N1 type=write size=4039173 2024-09-12T00:28:01.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.428+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~VPR0TJROW92R.0 size=1048576 2024-09-12T00:28:01.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.428+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~VPR0TJROW92R.1 size=1048576 2024-09-12T00:28:01.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.432+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~VPR0TJROW92R.2 size=514386 2024-09-12T00:28:01.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.432+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=VPR0TJROW92R tag=NUQ3MI3U5R1C type=write size=3660114 2024-09-12T00:28:01.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.436+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~SQA00HSVHMXO.0 size=1048576 2024-09-12T00:28:01.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.440+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~SQA00HSVHMXO.1 size=72100 2024-09-12T00:28:01.446 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.444+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=SQA00HSVHMXO tag=97O9E0ACL2TS type=write size=2169252 2024-09-12T00:28:01.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.448+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=CU7HINC0R1SO type=del size=460954 2024-09-12T00:28:01.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.452+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~ZIK2T462S8LY.0 size=1048576 2024-09-12T00:28:01.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.456+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~ZIK2T462S8LY.1 size=1048576 2024-09-12T00:28:01.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.460+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~ZIK2T462S8LY.2 size=907338 2024-09-12T00:28:01.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.468+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=ZIK2T462S8LY tag=AZTHF2LP1XPH type=write size=4053066 2024-09-12T00:28:01.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.476+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~I15WCO8WZB8I.0 size=226085 2024-09-12T00:28:01.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.476+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=I15WCO8WZB8I tag=FZAZ5CQ1AGK0 type=write size=1274661 2024-09-12T00:28:01.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.480+0000 7f712938c8c0 1 < completed delete operation key=5KVIIZS50CNT tag=DOV0XL71ZQEK type=del 2024-09-12T00:28:01.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.484+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~OSNLEB26XLOF.0 size=1048576 2024-09-12T00:28:01.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.488+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~OSNLEB26XLOF.1 size=1048576 2024-09-12T00:28:01.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.492+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~OSNLEB26XLOF.2 size=287873 2024-09-12T00:28:01.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.492+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=OSNLEB26XLOF tag=NR8JVL8TPT4V type=write size=3433601 2024-09-12T00:28:01.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.496+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=D971HI87XWJO type=write size=940024 2024-09-12T00:28:01.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.500+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=LNY4Z7WKG2VB type=del size=3532664 2024-09-12T00:28:01.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.504+0000 7f712938c8c0 1 < canceled operation key=T1H3O6A6HBQH tag=09SRI25Y4HX6 type=del size=3635886 2024-09-12T00:28:01.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.508+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=RYJC8B173PXG type=del size=3685001 2024-09-12T00:28:01.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.512+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=U68CCSWVCHU1 type=del 2024-09-12T00:28:01.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.516+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=KHLGC7CBS1NW type=del size=765472 2024-09-12T00:28:01.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.520+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=6V845K4Q9DDD type=del 2024-09-12T00:28:01.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.524+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=06ONJH9OEKTN type=write size=11132 2024-09-12T00:28:01.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.528+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=GEYLTFRK9YK5 type=del 2024-09-12T00:28:01.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.532+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=QYDIUQEY88HY type=del size=804127 2024-09-12T00:28:01.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.536+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~6KPNFR4PVW8C.0 size=1048576 2024-09-12T00:28:01.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.536+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~6KPNFR4PVW8C.1 size=1048576 2024-09-12T00:28:01.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.540+0000 7f712938c8c0 1 < completed part key=_multipart_W01PFMFNYLED.2~6KPNFR4PVW8C.2 size=277299 2024-09-12T00:28:01.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.548+0000 7f712938c8c0 1 < completed multipart upload key=W01PFMFNYLED upload=6KPNFR4PVW8C tag=65ICUZVV4XW5 type=write size=3423027 2024-09-12T00:28:01.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.552+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=GKE4H6W2Q1XD type=del size=1956185 2024-09-12T00:28:01.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.556+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=YF0A2I0Q62KT type=write size=455812 2024-09-12T00:28:01.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.560+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~SRVNLIXJLUP0.0 size=1048576 2024-09-12T00:28:01.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.568+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~SRVNLIXJLUP0.1 size=952223 2024-09-12T00:28:01.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.568+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=SRVNLIXJLUP0 tag=MFHK9ZY916PC type=write size=3049375 2024-09-12T00:28:01.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.576+0000 7f712938c8c0 1 < suggested remove operation key=ULE6S9Y6DS62 tag=TKFWU8IIFMDX type=del 2024-09-12T00:28:01.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.580+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=99I8V07B3UQ0 type=del size=319737 2024-09-12T00:28:01.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.584+0000 7f712938c8c0 1 < completed write operation key=A8L061CQ0M0J tag=I3HINRD1FU31 type=write size=172102 2024-09-12T00:28:01.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.588+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~4SGC5RXAE8TQ.0 size=1048576 2024-09-12T00:28:01.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.592+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~4SGC5RXAE8TQ.1 size=1048576 2024-09-12T00:28:01.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.596+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~4SGC5RXAE8TQ.2 size=743680 2024-09-12T00:28:01.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.596+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=4SGC5RXAE8TQ tag=QXAGC8L86RQR type=write size=3889408 2024-09-12T00:28:01.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.600+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=YNB8RS36B79J type=del 2024-09-12T00:28:01.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.604+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=L0B832TYPSQG type=write size=674816 2024-09-12T00:28:01.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.608+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~N47FB6G4153U.0 size=1048576 2024-09-12T00:28:01.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.612+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~N47FB6G4153U.1 size=1048576 2024-09-12T00:28:01.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.612+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~N47FB6G4153U.2 size=944118 2024-09-12T00:28:01.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.620+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=N47FB6G4153U tag=0KI742VBH9MM type=write size=4089846 2024-09-12T00:28:01.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.624+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=NRAO02R0RF2L type=del size=4018144 2024-09-12T00:28:01.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.628+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~WTIIE06KAAEW.0 size=214325 2024-09-12T00:28:01.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.632+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=WTIIE06KAAEW tag=WMKC8G3E1W11 type=write size=1262901 2024-09-12T00:28:01.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.640+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=4F6DIQZ63V20 type=del size=362900 2024-09-12T00:28:01.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.644+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~VPR0TJROW92R.0 size=1048576 2024-09-12T00:28:01.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.648+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~VPR0TJROW92R.1 size=1048576 2024-09-12T00:28:01.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.648+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~VPR0TJROW92R.2 size=514386 2024-09-12T00:28:01.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.656+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=VPR0TJROW92R tag=NUQ3MI3U5R1C type=write size=3660114 2024-09-12T00:28:01.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.660+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=PKM0GPV2VAXM type=del size=969375 2024-09-12T00:28:01.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.668+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=CU7HINC0R1SO type=del 2024-09-12T00:28:01.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.672+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=Q64TF9BY1VG1 type=del size=3315185 2024-09-12T00:28:01.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.676+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~I15WCO8WZB8I.0 size=226085 2024-09-12T00:28:01.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.680+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=I15WCO8WZB8I tag=FZAZ5CQ1AGK0 type=write size=1274661 2024-09-12T00:28:01.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.684+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=C7RTPWZNBAHW type=write size=108081 2024-09-12T00:28:01.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.688+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~OSNLEB26XLOF.0 size=1048576 2024-09-12T00:28:01.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.692+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~OSNLEB26XLOF.1 size=1048576 2024-09-12T00:28:01.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.696+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~OSNLEB26XLOF.2 size=287873 2024-09-12T00:28:01.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.704+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=OSNLEB26XLOF tag=NR8JVL8TPT4V type=write size=3433601 2024-09-12T00:28:01.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.708+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=SXAWG31OK2WT type=write size=446328 2024-09-12T00:28:01.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.712+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=LNY4Z7WKG2VB type=del 2024-09-12T00:28:01.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.716+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=CMGUPUZOEU0O type=write size=559844 2024-09-12T00:28:01.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.720+0000 7f712938c8c0 -1 < failed to complete operation key=ULE6S9Y6DS62 tag=RYJC8B173PXG type=del size=3685001: (22) Invalid argument 2024-09-12T00:28:01.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.724+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=UUSBC7VVPDCM type=del size=965415 2024-09-12T00:28:01.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.728+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=KHLGC7CBS1NW type=del 2024-09-12T00:28:01.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.732+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=TBHAGT8EMZVC type=write size=216708 2024-09-12T00:28:01.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.736+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=06ONJH9OEKTN type=write size=11132 2024-09-12T00:28:01.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.740+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=M3GQJEPAQP70 type=del size=439535 2024-09-12T00:28:01.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.744+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=QYDIUQEY88HY type=del 2024-09-12T00:28:01.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.748+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=95CK5ZFHERA5 type=del size=2900751 2024-09-12T00:28:01.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.752+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=GKE4H6W2Q1XD type=del 2024-09-12T00:28:01.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.756+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=B5ORYUCCNTVG type=del size=3332622 2024-09-12T00:28:01.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.756+0000 7f712938c8c0 1 < canceled part key=_multipart_04RL082VPLIM.2~SRVNLIXJLUP0.0 size=1048576 2024-09-12T00:28:01.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.760+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~SRVNLIXJLUP0.1 size=952223 2024-09-12T00:28:01.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.764+0000 7f712938c8c0 1 < canceled multipart upload key=04RL082VPLIM upload=SRVNLIXJLUP0 tag=MFHK9ZY916PC type=write size=3049375 2024-09-12T00:28:01.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.768+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=4V9BRU1S09S7 type=del size=482789 2024-09-12T00:28:01.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.772+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=99I8V07B3UQ0 type=del 2024-09-12T00:28:01.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.780+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~L56XQAU42DTO.0 size=463767 2024-09-12T00:28:01.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.780+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=L56XQAU42DTO tag=JFQOK8IJ1URW type=write size=1512343 2024-09-12T00:28:01.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.784+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~4SGC5RXAE8TQ.0 size=1048576 2024-09-12T00:28:01.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.784+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~4SGC5RXAE8TQ.1 size=1048576 2024-09-12T00:28:01.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.788+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~4SGC5RXAE8TQ.2 size=743680 2024-09-12T00:28:01.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.796+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=4SGC5RXAE8TQ tag=QXAGC8L86RQR type=write size=3889408 2024-09-12T00:28:01.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.800+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=R8FE3F9NVNHN type=del size=3959281 2024-09-12T00:28:01.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.804+0000 7f712938c8c0 1 < suggested remove operation key=BH2YHXHVEZCH tag=L0B832TYPSQG type=write 2024-09-12T00:28:01.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.812+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~ADU0EP7N3U2J.0 size=566057 2024-09-12T00:28:01.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.812+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=ADU0EP7N3U2J tag=4R31UU7I64CH type=write size=1614633 2024-09-12T00:28:01.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.816+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=NRAO02R0RF2L type=del 2024-09-12T00:28:01.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.820+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~UBP2IQM613QO.0 size=1048576 2024-09-12T00:28:01.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.824+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~UBP2IQM613QO.1 size=222356 2024-09-12T00:28:01.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.824+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=UBP2IQM613QO tag=SNAQ285CNRKE type=write size=2319508 2024-09-12T00:28:01.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.828+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=4F6DIQZ63V20 type=del 2024-09-12T00:28:01.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.836+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~PHJI80TKR8LE.0 size=729037 2024-09-12T00:28:01.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.836+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=PHJI80TKR8LE tag=D1WRYK7J8E1B type=write size=1777613 2024-09-12T00:28:01.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.844+0000 7f712938c8c0 1 < suggested update operation key=Z2RYL03II71Z tag=PKM0GPV2VAXM type=del size=969375 2024-09-12T00:28:01.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.848+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~OTO4L58WD1FM.0 size=652651 2024-09-12T00:28:01.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.848+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=OTO4L58WD1FM tag=5V4VFJ0MZ7JW type=write size=1701227 2024-09-12T00:28:01.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.852+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=Q64TF9BY1VG1 type=del 2024-09-12T00:28:01.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.856+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=P8QF1DDCGY4Q type=del size=540610 2024-09-12T00:28:01.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.860+0000 7f712938c8c0 1 < canceled operation key=T0C4ZDQB13X0 tag=C7RTPWZNBAHW type=write size=108081 2024-09-12T00:28:01.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.864+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=EQMNJD6A1RF3 type=del size=3830370 2024-09-12T00:28:01.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.868+0000 7f712938c8c0 1 < completed write operation key=7X45VJAQO7PF tag=SXAWG31OK2WT type=write size=446328 2024-09-12T00:28:01.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.872+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=M1UET4A53RTW type=del size=164719 2024-09-12T00:28:01.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.876+0000 7f712938c8c0 1 < completed write operation key=7X45VJAQO7PF tag=CMGUPUZOEU0O type=write size=559844 2024-09-12T00:28:01.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.880+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=TOXVQQV48SOY type=del size=1858930 2024-09-12T00:28:01.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.884+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=UUSBC7VVPDCM type=del 2024-09-12T00:28:01.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.888+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=8HGZLZ6CPDNY type=del size=1035180 2024-09-12T00:28:01.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.892+0000 7f712938c8c0 1 < completed write operation key=T0C4ZDQB13X0 tag=TBHAGT8EMZVC type=write size=216708 2024-09-12T00:28:01.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.896+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~1W6FVN52RIWM.0 size=1048576 2024-09-12T00:28:01.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.900+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~1W6FVN52RIWM.1 size=1048576 2024-09-12T00:28:01.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.904+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~1W6FVN52RIWM.2 size=105525 2024-09-12T00:28:01.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.904+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=1W6FVN52RIWM tag=UC5GR3OSRAKB type=write size=3251253 2024-09-12T00:28:01.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.908+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=M3GQJEPAQP70 type=del 2024-09-12T00:28:01.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.908+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=T2TDO6D40L7D type=del size=4172368 2024-09-12T00:28:01.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.912+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=95CK5ZFHERA5 type=del 2024-09-12T00:28:01.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.916+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=7YU1TL0FV6FA type=del size=2182983 2024-09-12T00:28:01.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.920+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=B5ORYUCCNTVG type=del 2024-09-12T00:28:01.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.932+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~8B3TQLE5FL71.0 size=915751 2024-09-12T00:28:01.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.932+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=8B3TQLE5FL71 tag=MKPR6ITK030O type=write size=1964327 2024-09-12T00:28:01.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.936+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=4V9BRU1S09S7 type=del 2024-09-12T00:28:01.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.944+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~F8J0YWCBU0N1.0 size=809550 2024-09-12T00:28:01.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.944+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=F8J0YWCBU0N1 tag=PHK72QZYDWEE type=write size=1858126 2024-09-12T00:28:01.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.948+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~L56XQAU42DTO.0 size=463767 2024-09-12T00:28:01.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.952+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=L56XQAU42DTO tag=JFQOK8IJ1URW type=write size=1512343 2024-09-12T00:28:01.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.956+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=MID5W6IAMYP7 type=del size=116966 2024-09-12T00:28:01.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.960+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=R8FE3F9NVNHN type=del 2024-09-12T00:28:01.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.968+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~O8KGHRE2IKAT.0 size=495934 2024-09-12T00:28:01.968 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.968+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=O8KGHRE2IKAT tag=81MCG204QDRX type=write size=1544510 2024-09-12T00:28:01.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.972+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~ADU0EP7N3U2J.0 size=566057 2024-09-12T00:28:01.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.980+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=ADU0EP7N3U2J tag=4R31UU7I64CH type=write size=1614633 2024-09-12T00:28:01.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.980+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=ZW1355RL3YOJ type=write size=406284 2024-09-12T00:28:01.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.984+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~UBP2IQM613QO.0 size=1048576 2024-09-12T00:28:01.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.988+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~UBP2IQM613QO.1 size=222356 2024-09-12T00:28:01.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:01.996+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=UBP2IQM613QO tag=SNAQ285CNRKE type=write size=2319508 2024-09-12T00:28:02.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.004+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~WM9GTWEOMBPU.0 size=39221 2024-09-12T00:28:02.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.004+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=WM9GTWEOMBPU tag=V6JU6YD21BUQ type=write size=1087797 2024-09-12T00:28:02.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.008+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~PHJI80TKR8LE.0 size=729037 2024-09-12T00:28:02.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.012+0000 7f712938c8c0 1 < completed multipart upload key=A8L061CQ0M0J upload=PHJI80TKR8LE tag=D1WRYK7J8E1B type=write size=1777613 2024-09-12T00:28:02.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.016+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=T3BFSDUF5G93 type=del size=658895 2024-09-12T00:28:02.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.020+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~OTO4L58WD1FM.0 size=652651 2024-09-12T00:28:02.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.028+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=OTO4L58WD1FM tag=5V4VFJ0MZ7JW type=write size=1701227 2024-09-12T00:28:02.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.032+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=1J0L0PCSIJPI type=del size=108607 2024-09-12T00:28:02.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.036+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=P8QF1DDCGY4Q type=del 2024-09-12T00:28:02.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.040+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=9OQILUH6OXIP type=del size=3062390 2024-09-12T00:28:02.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.044+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=EQMNJD6A1RF3 type=del 2024-09-12T00:28:02.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.052+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~3AQGQV6BTTFE.0 size=1048576 2024-09-12T00:28:02.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.052+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~3AQGQV6BTTFE.1 size=1048576 2024-09-12T00:28:02.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.056+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~3AQGQV6BTTFE.2 size=852718 2024-09-12T00:28:02.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.056+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=3AQGQV6BTTFE tag=UTESTUOKTOJE type=write size=3998446 2024-09-12T00:28:02.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.060+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=M1UET4A53RTW type=del 2024-09-12T00:28:02.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.068+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~ICSHOKHHHJ8J.0 size=221940 2024-09-12T00:28:02.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.068+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=ICSHOKHHHJ8J tag=X25D278LWUC9 type=write size=1270516 2024-09-12T00:28:02.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.076+0000 7f712938c8c0 1 < suggested update operation key=N69XPNN6Y6HZ tag=TOXVQQV48SOY type=del size=1858930 2024-09-12T00:28:02.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.080+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=F6L8C43JW3LV type=del size=551957 2024-09-12T00:28:02.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.084+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=8HGZLZ6CPDNY type=del 2024-09-12T00:28:02.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.088+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=21KQL7CU183O type=del size=225304 2024-09-12T00:28:02.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.088+0000 7f712938c8c0 1 < canceled part key=_multipart_ZP88X00LMVSS.2~1W6FVN52RIWM.0 size=1048576 2024-09-12T00:28:02.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.092+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~1W6FVN52RIWM.1 size=1048576 2024-09-12T00:28:02.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.096+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~1W6FVN52RIWM.2 size=105525 2024-09-12T00:28:02.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.100+0000 7f712938c8c0 1 < canceled multipart upload key=ZP88X00LMVSS upload=1W6FVN52RIWM tag=UC5GR3OSRAKB type=write size=3251253 2024-09-12T00:28:02.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.108+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~CYEIV6RGJYOB.0 size=1048576 2024-09-12T00:28:02.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.108+0000 7f712938c8c0 1 > prepared part key=_multipart_T1H3O6A6HBQH.2~CYEIV6RGJYOB.1 size=1035236 2024-09-12T00:28:02.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.108+0000 7f712938c8c0 1 > prepared multipart upload key=T1H3O6A6HBQH upload=CYEIV6RGJYOB tag=ANVOMAIQI0DN type=write size=3132388 2024-09-12T00:28:02.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.116+0000 7f712938c8c0 1 < suggested remove operation key=ULE6S9Y6DS62 tag=T2TDO6D40L7D type=del 2024-09-12T00:28:02.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.120+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=WHBEPZFD1RS7 type=del size=1525020 2024-09-12T00:28:02.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.124+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=7YU1TL0FV6FA type=del 2024-09-12T00:28:02.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.128+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=9W63Y33CIXGI type=del size=2761914 2024-09-12T00:28:02.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.132+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~8B3TQLE5FL71.0 size=915751 2024-09-12T00:28:02.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.140+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=8B3TQLE5FL71 tag=MKPR6ITK030O type=write size=1964327 2024-09-12T00:28:02.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.144+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~O59OUGHJD26S.0 size=1048576 2024-09-12T00:28:02.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.148+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~O59OUGHJD26S.1 size=1048576 2024-09-12T00:28:02.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.152+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~O59OUGHJD26S.2 size=930180 2024-09-12T00:28:02.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.152+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=O59OUGHJD26S tag=SIM816RPBALJ type=write size=4075908 2024-09-12T00:28:02.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.156+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~F8J0YWCBU0N1.0 size=809550 2024-09-12T00:28:02.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.160+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=F8J0YWCBU0N1 tag=PHK72QZYDWEE type=write size=1858126 2024-09-12T00:28:02.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.164+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=QRU5YEQSBN2L type=del size=2314526 2024-09-12T00:28:02.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.168+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=MID5W6IAMYP7 type=del 2024-09-12T00:28:02.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.176+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~99Z7WU8K8CTW.0 size=782365 2024-09-12T00:28:02.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.176+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=99Z7WU8K8CTW tag=V3MEBYBO5C5B type=write size=1830941 2024-09-12T00:28:02.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.180+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~O8KGHRE2IKAT.0 size=495934 2024-09-12T00:28:02.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.184+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=O8KGHRE2IKAT tag=81MCG204QDRX type=write size=1544510 2024-09-12T00:28:02.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.188+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=5IYY9PFB2T22 type=del size=216363 2024-09-12T00:28:02.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.200+0000 7f712938c8c0 1 < suggested remove operation key=ULE6S9Y6DS62 tag=ZW1355RL3YOJ type=write 2024-09-12T00:28:02.202 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.204+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=P8AKZAHT5GJE type=del size=47211 2024-09-12T00:28:02.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.208+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~WM9GTWEOMBPU.0 size=39221 2024-09-12T00:28:02.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.212+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=WM9GTWEOMBPU tag=V6JU6YD21BUQ type=write size=1087797 2024-09-12T00:28:02.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.216+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=ADOP8DOQPRX2 type=del size=2064026 2024-09-12T00:28:02.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.220+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=T3BFSDUF5G93 type=del 2024-09-12T00:28:02.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.224+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=YQAVNA47A9NS type=write size=804517 2024-09-12T00:28:02.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.228+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=1J0L0PCSIJPI type=del 2024-09-12T00:28:02.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.236+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~P37J79I4GKSM.0 size=179379 2024-09-12T00:28:02.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.236+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=P37J79I4GKSM tag=7WTUVOPRFE8I type=write size=1227955 2024-09-12T00:28:02.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.240+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=9OQILUH6OXIP type=del 2024-09-12T00:28:02.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.244+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=VHLSBCVJFWIR type=del size=2588829 2024-09-12T00:28:02.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.248+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~3AQGQV6BTTFE.0 size=1048576 2024-09-12T00:28:02.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.252+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~3AQGQV6BTTFE.1 size=1048576 2024-09-12T00:28:02.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.252+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~3AQGQV6BTTFE.2 size=852718 2024-09-12T00:28:02.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.260+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=3AQGQV6BTTFE tag=UTESTUOKTOJE type=write size=3998446 2024-09-12T00:28:02.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.264+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=6T8BD1XTH71Z type=del size=3539373 2024-09-12T00:28:02.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.268+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~ICSHOKHHHJ8J.0 size=221940 2024-09-12T00:28:02.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.276+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=ICSHOKHHHJ8J tag=X25D278LWUC9 type=write size=1270516 2024-09-12T00:28:02.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.280+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=52XA4V7ZWR4P type=del size=2193521 2024-09-12T00:28:02.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.284+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=F6L8C43JW3LV type=del 2024-09-12T00:28:02.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.288+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=HFMFA04NGFRC type=del size=1797940 2024-09-12T00:28:02.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.296+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=21KQL7CU183O type=del 2024-09-12T00:28:02.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.304+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~025TENPICO5H.0 size=1048576 2024-09-12T00:28:02.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.308+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~025TENPICO5H.1 size=1048576 2024-09-12T00:28:02.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.308+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~025TENPICO5H.2 size=815065 2024-09-12T00:28:02.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.308+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=025TENPICO5H tag=QB60RRH2FIY2 type=write size=3960793 2024-09-12T00:28:02.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.312+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~CYEIV6RGJYOB.0 size=1048576 2024-09-12T00:28:02.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.316+0000 7f712938c8c0 1 < completed part key=_multipart_T1H3O6A6HBQH.2~CYEIV6RGJYOB.1 size=1035236 2024-09-12T00:28:02.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.324+0000 7f712938c8c0 1 < completed multipart upload key=T1H3O6A6HBQH upload=CYEIV6RGJYOB tag=ANVOMAIQI0DN type=write size=3132388 2024-09-12T00:28:02.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.328+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=MHA8R25ETFKM type=write size=694783 2024-09-12T00:28:02.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.332+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=WHBEPZFD1RS7 type=del 2024-09-12T00:28:02.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.336+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=W0WGC2FP4ALN type=del size=1472313 2024-09-12T00:28:02.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.340+0000 7f712938c8c0 1 < suggested update operation key=UAJEZUYXN2R0 tag=9W63Y33CIXGI type=del size=2761914 2024-09-12T00:28:02.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.344+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=VHTG83Y5FSRW type=del size=3408121 2024-09-12T00:28:02.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.344+0000 7f712938c8c0 1 < canceled part key=_multipart_N69XPNN6Y6HZ.2~O59OUGHJD26S.0 size=1048576 2024-09-12T00:28:02.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.348+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~O59OUGHJD26S.1 size=1048576 2024-09-12T00:28:02.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.352+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~O59OUGHJD26S.2 size=930180 2024-09-12T00:28:02.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.356+0000 7f712938c8c0 1 < canceled multipart upload key=N69XPNN6Y6HZ upload=O59OUGHJD26S tag=SIM816RPBALJ type=write size=4075908 2024-09-12T00:28:02.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.364+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=DOCVM11D2RQC type=del size=3131691 2024-09-12T00:28:02.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.368+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=QRU5YEQSBN2L type=del 2024-09-12T00:28:02.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.376+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~FM770A34STRO.0 size=1048576 2024-09-12T00:28:02.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.380+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~FM770A34STRO.1 size=1022995 2024-09-12T00:28:02.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.380+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=FM770A34STRO tag=S0YDH2AAVCBE type=write size=3120147 2024-09-12T00:28:02.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.384+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~99Z7WU8K8CTW.0 size=782365 2024-09-12T00:28:02.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.388+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=99Z7WU8K8CTW tag=V3MEBYBO5C5B type=write size=1830941 2024-09-12T00:28:02.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.396+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=437RKM0G9AYW type=del size=3999525 2024-09-12T00:28:02.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.404+0000 7f712938c8c0 1 < suggested update operation key=ULE6S9Y6DS62 tag=5IYY9PFB2T22 type=del size=216363 2024-09-12T00:28:02.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.408+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=QM8WCZB0MB10 type=del size=1137675 2024-09-12T00:28:02.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.412+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=P8AKZAHT5GJE type=del 2024-09-12T00:28:02.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.416+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=1BKO4VXF5D6X type=write size=999321 2024-09-12T00:28:02.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.420+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=ADOP8DOQPRX2 type=del 2024-09-12T00:28:02.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.424+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=E2ETH18UYPBC type=del size=1564422 2024-09-12T00:28:02.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.428+0000 7f712938c8c0 1 < completed write operation key=9N3U208FGM79 tag=YQAVNA47A9NS type=write size=804517 2024-09-12T00:28:02.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.436+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=8D3V3I2MBGPQ type=del size=1271585 2024-09-12T00:28:02.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.440+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~P37J79I4GKSM.0 size=179379 2024-09-12T00:28:02.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.444+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=P37J79I4GKSM tag=7WTUVOPRFE8I type=write size=1227955 2024-09-12T00:28:02.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.452+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~P53DX3UINXP5.0 size=1048576 2024-09-12T00:28:02.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.456+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~P53DX3UINXP5.1 size=1048576 2024-09-12T00:28:02.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.460+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~P53DX3UINXP5.2 size=262738 2024-09-12T00:28:02.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.460+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=P53DX3UINXP5 tag=60RLKMNIOVOY type=write size=3408466 2024-09-12T00:28:02.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.464+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=VHLSBCVJFWIR type=del 2024-09-12T00:28:02.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.468+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=19MXMLOPSONB type=del size=1566330 2024-09-12T00:28:02.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.476+0000 7f712938c8c0 1 < suggested update operation key=UAJEZUYXN2R0 tag=6T8BD1XTH71Z type=del size=3539373 2024-09-12T00:28:02.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.480+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~1G2ZFDWWBN1T.0 size=1048576 2024-09-12T00:28:02.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.484+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~1G2ZFDWWBN1T.1 size=370136 2024-09-12T00:28:02.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.484+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=1G2ZFDWWBN1T tag=YWJKADLXRSLQ type=write size=2467288 2024-09-12T00:28:02.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.488+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=52XA4V7ZWR4P type=del 2024-09-12T00:28:02.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.496+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~8LXVAZ22VFDL.0 size=1048576 2024-09-12T00:28:02.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.500+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~8LXVAZ22VFDL.1 size=1048576 2024-09-12T00:28:02.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.500+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~8LXVAZ22VFDL.2 size=336476 2024-09-12T00:28:02.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.500+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=8LXVAZ22VFDL tag=FA4FKP3LHI2V type=write size=3482204 2024-09-12T00:28:02.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.508+0000 7f712938c8c0 1 < suggested remove operation key=T1H3O6A6HBQH tag=HFMFA04NGFRC type=del 2024-09-12T00:28:02.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.512+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=ABC1GNV318JR type=del size=2838051 2024-09-12T00:28:02.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.516+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~025TENPICO5H.0 size=1048576 2024-09-12T00:28:02.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.520+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~025TENPICO5H.1 size=1048576 2024-09-12T00:28:02.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.520+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~025TENPICO5H.2 size=815065 2024-09-12T00:28:02.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.528+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=025TENPICO5H tag=QB60RRH2FIY2 type=write size=3960793 2024-09-12T00:28:02.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.532+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~24SLV5H1IFG4.0 size=1048576 2024-09-12T00:28:02.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.536+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~24SLV5H1IFG4.1 size=469941 2024-09-12T00:28:02.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.536+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=24SLV5H1IFG4 tag=2HSOIYPGYSK0 type=write size=2567093 2024-09-12T00:28:02.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.540+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=MHA8R25ETFKM type=write size=694783 2024-09-12T00:28:02.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.544+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=L6P0R30YUG2A type=del size=2631025 2024-09-12T00:28:02.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.548+0000 7f712938c8c0 1 < suggested update operation key=T0C4ZDQB13X0 tag=W0WGC2FP4ALN type=del size=1472313 2024-09-12T00:28:02.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.556+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~HSUXMDP46ZSH.0 size=835831 2024-09-12T00:28:02.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.556+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=HSUXMDP46ZSH tag=GCB2THMGNIZN type=write size=1884407 2024-09-12T00:28:02.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.564+0000 7f712938c8c0 1 < suggested remove operation key=ULE6S9Y6DS62 tag=VHTG83Y5FSRW type=del 2024-09-12T00:28:02.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.568+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~WIY51O62ZVL2.0 size=1048576 2024-09-12T00:28:02.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.572+0000 7f712938c8c0 1 > prepared part key=_multipart_G0065P5NOJ2F.2~WIY51O62ZVL2.1 size=424147 2024-09-12T00:28:02.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.572+0000 7f712938c8c0 1 > prepared multipart upload key=G0065P5NOJ2F upload=WIY51O62ZVL2 tag=M3D0H2PQHHM8 type=write size=2521299 2024-09-12T00:28:02.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.576+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=DOCVM11D2RQC type=del 2024-09-12T00:28:02.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.580+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=GEPXKL20UH6M type=del size=3837446 2024-09-12T00:28:02.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.580+0000 7f712938c8c0 1 < canceled part key=_multipart_W9YW6AS1RL48.2~FM770A34STRO.0 size=1048576 2024-09-12T00:28:02.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.580+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~FM770A34STRO.1 size=1022995 2024-09-12T00:28:02.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.588+0000 7f712938c8c0 1 < canceled multipart upload key=W9YW6AS1RL48 upload=FM770A34STRO tag=S0YDH2AAVCBE type=write size=3120147 2024-09-12T00:28:02.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.592+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=IBZHL68VN2QP type=del size=68964 2024-09-12T00:28:02.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.596+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=437RKM0G9AYW type=del 2024-09-12T00:28:02.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.596+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=7W0QQXX5VV42 type=del size=2889083 2024-09-12T00:28:02.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.604+0000 7f712938c8c0 1 < suggested remove operation key=7X45VJAQO7PF tag=QM8WCZB0MB10 type=del 2024-09-12T00:28:02.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.612+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~GR0E06T04ZSE.0 size=528261 2024-09-12T00:28:02.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.612+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=GR0E06T04ZSE tag=VKPIS8OPN3WR type=write size=1576837 2024-09-12T00:28:02.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.616+0000 7f712938c8c0 1 < suggested remove operation key=UAJEZUYXN2R0 tag=1BKO4VXF5D6X type=write 2024-09-12T00:28:02.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.624+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~JRU2A2LEIHMJ.0 size=481210 2024-09-12T00:28:02.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.624+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=JRU2A2LEIHMJ tag=3QPEWD9XWWNU type=write size=1529786 2024-09-12T00:28:02.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.628+0000 7f712938c8c0 1 < canceled operation key=04RL082VPLIM tag=E2ETH18UYPBC type=del size=1564422 2024-09-12T00:28:02.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.632+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=3C72OIDVG70T type=del size=3476655 2024-09-12T00:28:02.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.636+0000 7f712938c8c0 1 < canceled operation key=ZP88X00LMVSS tag=8D3V3I2MBGPQ type=del size=1271585 2024-09-12T00:28:02.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.636+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=EOS9PNL2BP0O type=del size=1518117 2024-09-12T00:28:02.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.640+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~P53DX3UINXP5.0 size=1048576 2024-09-12T00:28:02.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.644+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~P53DX3UINXP5.1 size=1048576 2024-09-12T00:28:02.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.652+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~P53DX3UINXP5.2 size=262738 2024-09-12T00:28:02.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.660+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=P53DX3UINXP5 tag=60RLKMNIOVOY type=write size=3408466 2024-09-12T00:28:02.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.664+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~QLNKSMXA6380.0 size=780010 2024-09-12T00:28:02.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.664+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=QLNKSMXA6380 tag=XMUN778KJ4HH type=write size=1828586 2024-09-12T00:28:02.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.668+0000 7f712938c8c0 1 < canceled operation key=9N3U208FGM79 tag=19MXMLOPSONB type=del size=1566330 2024-09-12T00:28:02.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.672+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=YV5JXOX4RVEX type=del size=3990068 2024-09-12T00:28:02.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.676+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~1G2ZFDWWBN1T.0 size=1048576 2024-09-12T00:28:02.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.680+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~1G2ZFDWWBN1T.1 size=370136 2024-09-12T00:28:02.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.688+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=1G2ZFDWWBN1T tag=YWJKADLXRSLQ type=write size=2467288 2024-09-12T00:28:02.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.696+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~8VGZLG5JBI7E.0 size=1048576 2024-09-12T00:28:02.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.700+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~8VGZLG5JBI7E.1 size=1048576 2024-09-12T00:28:02.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.704+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~8VGZLG5JBI7E.2 size=390707 2024-09-12T00:28:02.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.704+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=8VGZLG5JBI7E tag=ZV7H0L8MI7VT type=write size=3536435 2024-09-12T00:28:02.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.708+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~8LXVAZ22VFDL.0 size=1048576 2024-09-12T00:28:02.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.712+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~8LXVAZ22VFDL.1 size=1048576 2024-09-12T00:28:02.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.712+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~8LXVAZ22VFDL.2 size=336476 2024-09-12T00:28:02.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.720+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=8LXVAZ22VFDL tag=FA4FKP3LHI2V type=write size=3482204 2024-09-12T00:28:02.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.728+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~C09SWYF1YMSI.0 size=1048576 2024-09-12T00:28:02.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.732+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~C09SWYF1YMSI.1 size=1048576 2024-09-12T00:28:02.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.736+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~C09SWYF1YMSI.2 size=339822 2024-09-12T00:28:02.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.736+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=C09SWYF1YMSI tag=HLJ48M1YBAJB type=write size=3485550 2024-09-12T00:28:02.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.740+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=ABC1GNV318JR type=del 2024-09-12T00:28:02.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.744+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~IKO421BA0R8C.0 size=668212 2024-09-12T00:28:02.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.744+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=IKO421BA0R8C tag=ZS4N157MH4HL type=write size=1716788 2024-09-12T00:28:02.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.748+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~24SLV5H1IFG4.0 size=1048576 2024-09-12T00:28:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.752+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~24SLV5H1IFG4.1 size=469941 2024-09-12T00:28:02.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.760+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=24SLV5H1IFG4 tag=2HSOIYPGYSK0 type=write size=2567093 2024-09-12T00:28:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.764+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~E7UPI1FPWT77.0 size=410663 2024-09-12T00:28:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.764+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=E7UPI1FPWT77 tag=K5KVEBYLL7ZN type=write size=1459239 2024-09-12T00:28:02.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.768+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=L6P0R30YUG2A type=del 2024-09-12T00:28:02.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.776+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~HW3IH1KIT3BK.0 size=1048576 2024-09-12T00:28:02.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.776+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~HW3IH1KIT3BK.1 size=440000 2024-09-12T00:28:02.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.776+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=HW3IH1KIT3BK tag=A3U9XN7KSVPJ type=write size=2537152 2024-09-12T00:28:02.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.780+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~HSUXMDP46ZSH.0 size=835831 2024-09-12T00:28:02.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.788+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=HSUXMDP46ZSH tag=GCB2THMGNIZN type=write size=1884407 2024-09-12T00:28:02.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.792+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=NTYOUPWY2BCY type=del size=2711375 2024-09-12T00:28:02.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.796+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~WIY51O62ZVL2.0 size=1048576 2024-09-12T00:28:02.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.800+0000 7f712938c8c0 1 < completed part key=_multipart_G0065P5NOJ2F.2~WIY51O62ZVL2.1 size=424147 2024-09-12T00:28:02.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.804+0000 7f712938c8c0 1 < completed multipart upload key=G0065P5NOJ2F upload=WIY51O62ZVL2 tag=M3D0H2PQHHM8 type=write size=2521299 2024-09-12T00:28:02.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.812+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~UVLOXGKK93JW.0 size=719136 2024-09-12T00:28:02.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.812+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=UVLOXGKK93JW tag=EZYA2G691H8F type=write size=1767712 2024-09-12T00:28:02.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.816+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=GEPXKL20UH6M type=del 2024-09-12T00:28:02.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.820+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~48BBJVH77T9G.0 size=1048576 2024-09-12T00:28:02.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.824+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~48BBJVH77T9G.1 size=1048576 2024-09-12T00:28:02.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.828+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~48BBJVH77T9G.2 size=86401 2024-09-12T00:28:02.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.828+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=48BBJVH77T9G tag=C2M0E6797BTK type=write size=3232129 2024-09-12T00:28:02.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.836+0000 7f712938c8c0 1 < suggested update operation key=0QZKHZTVP3RQ tag=IBZHL68VN2QP type=del size=68964 2024-09-12T00:28:02.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.840+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~0N4B7Q681ZLG.0 size=1048576 2024-09-12T00:28:02.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.844+0000 7f712938c8c0 1 > prepared part key=_multipart_MUNSUH4BMZNP.2~0N4B7Q681ZLG.1 size=841752 2024-09-12T00:28:02.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.844+0000 7f712938c8c0 1 > prepared multipart upload key=MUNSUH4BMZNP upload=0N4B7Q681ZLG tag=ZK09B7L6OXUE type=write size=2938904 2024-09-12T00:28:02.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.848+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=7W0QQXX5VV42 type=del 2024-09-12T00:28:02.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.852+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=3SXL2ECZSINC type=del size=755982 2024-09-12T00:28:02.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.856+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~GR0E06T04ZSE.0 size=528261 2024-09-12T00:28:02.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.860+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=GR0E06T04ZSE tag=VKPIS8OPN3WR type=write size=1576837 2024-09-12T00:28:02.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.868+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~77C18DQP663M.0 size=54647 2024-09-12T00:28:02.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.868+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=77C18DQP663M tag=ED4JJ4B680YF type=write size=1103223 2024-09-12T00:28:02.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.868+0000 7f712938c8c0 1 < canceled part key=_multipart_5KVIIZS50CNT.2~JRU2A2LEIHMJ.0 size=481210 2024-09-12T00:28:02.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.876+0000 7f712938c8c0 1 < canceled multipart upload key=5KVIIZS50CNT upload=JRU2A2LEIHMJ tag=3QPEWD9XWWNU type=write size=1529786 2024-09-12T00:28:02.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.880+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=C4ZB18LG90FW type=del size=3393114 2024-09-12T00:28:02.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.880+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=3C72OIDVG70T type=del 2024-09-12T00:28:02.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.884+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=RY7ODNIYJAGZ type=write size=626453 2024-09-12T00:28:02.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.888+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=EOS9PNL2BP0O type=del 2024-09-12T00:28:02.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.892+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=OLBAWBLUTDM3 type=del size=2161349 2024-09-12T00:28:02.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.896+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~QLNKSMXA6380.0 size=780010 2024-09-12T00:28:02.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.900+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=QLNKSMXA6380 tag=XMUN778KJ4HH type=write size=1828586 2024-09-12T00:28:02.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.908+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=DE9LIT98JVA7 type=write size=840706 2024-09-12T00:28:02.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.916+0000 7f712938c8c0 1 < suggested remove operation key=T1H3O6A6HBQH tag=YV5JXOX4RVEX type=del 2024-09-12T00:28:02.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.920+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=8O2QCG0B9UFW type=del size=3408956 2024-09-12T00:28:02.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.924+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~8VGZLG5JBI7E.0 size=1048576 2024-09-12T00:28:02.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.924+0000 7f712938c8c0 1 < canceled part key=_multipart_F7T79C7MZX35.2~8VGZLG5JBI7E.1 size=1048576 2024-09-12T00:28:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.924+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~8VGZLG5JBI7E.2 size=390707 2024-09-12T00:28:02.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.932+0000 7f712938c8c0 1 < canceled multipart upload key=F7T79C7MZX35 upload=8VGZLG5JBI7E tag=ZV7H0L8MI7VT type=write size=3536435 2024-09-12T00:28:02.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.936+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~TCK23EUK43VP.0 size=1048576 2024-09-12T00:28:02.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.940+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~TCK23EUK43VP.1 size=1048576 2024-09-12T00:28:02.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.944+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~TCK23EUK43VP.2 size=567236 2024-09-12T00:28:02.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.944+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=TCK23EUK43VP tag=DQLKC0DRN0ON type=write size=3712964 2024-09-12T00:28:02.948 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.948+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~C09SWYF1YMSI.0 size=1048576 2024-09-12T00:28:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.952+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~C09SWYF1YMSI.1 size=1048576 2024-09-12T00:28:02.954 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.956+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~C09SWYF1YMSI.2 size=339822 2024-09-12T00:28:02.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.960+0000 7f712938c8c0 1 < completed multipart upload key=V9K2307BGOKP upload=C09SWYF1YMSI tag=HLJ48M1YBAJB type=write size=3485550 2024-09-12T00:28:02.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.964+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=S9CLYWS3EP7U type=del size=3728761 2024-09-12T00:28:02.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.968+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~IKO421BA0R8C.0 size=668212 2024-09-12T00:28:02.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.976+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=IKO421BA0R8C tag=ZS4N157MH4HL type=write size=1716788 2024-09-12T00:28:02.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.980+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=J8THH077DLF8 type=write size=478332 2024-09-12T00:28:02.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.984+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~E7UPI1FPWT77.0 size=410663 2024-09-12T00:28:02.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.988+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=E7UPI1FPWT77 tag=K5KVEBYLL7ZN type=write size=1459239 2024-09-12T00:28:02.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:02.992+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=NLR3QN2DZEEO type=write size=351491 2024-09-12T00:28:03.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.000+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~HW3IH1KIT3BK.0 size=1048576 2024-09-12T00:28:03.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.004+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~HW3IH1KIT3BK.1 size=440000 2024-09-12T00:28:03.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.012+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=HW3IH1KIT3BK tag=A3U9XN7KSVPJ type=write size=2537152 2024-09-12T00:28:03.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.016+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=26ESCBILXU01 type=del size=1743639 2024-09-12T00:28:03.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.020+0000 7f712938c8c0 1 < suggested remove operation key=KEMQ3H8LAUI9 tag=NTYOUPWY2BCY type=del 2024-09-12T00:28:03.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.028+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~KPKR34ADNSTT.0 size=875422 2024-09-12T00:28:03.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.028+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=KPKR34ADNSTT tag=ICH8TKCVGBO9 type=write size=1923998 2024-09-12T00:28:03.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.032+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~UVLOXGKK93JW.0 size=719136 2024-09-12T00:28:03.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.040+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=UVLOXGKK93JW tag=EZYA2G691H8F type=write size=1767712 2024-09-12T00:28:03.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.044+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=VP61LNHFF0D1 type=write size=270433 2024-09-12T00:28:03.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.048+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~48BBJVH77T9G.0 size=1048576 2024-09-12T00:28:03.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.048+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~48BBJVH77T9G.1 size=1048576 2024-09-12T00:28:03.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.052+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~48BBJVH77T9G.2 size=86401 2024-09-12T00:28:03.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.060+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=48BBJVH77T9G tag=C2M0E6797BTK type=write size=3232129 2024-09-12T00:28:03.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.064+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~JK9S9NQ0FNTU.0 size=474740 2024-09-12T00:28:03.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.064+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=JK9S9NQ0FNTU tag=T4XEFFHDX6YF type=write size=1523316 2024-09-12T00:28:03.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.068+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~0N4B7Q681ZLG.0 size=1048576 2024-09-12T00:28:03.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.072+0000 7f712938c8c0 1 < completed part key=_multipart_MUNSUH4BMZNP.2~0N4B7Q681ZLG.1 size=841752 2024-09-12T00:28:03.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.076+0000 7f712938c8c0 1 < completed multipart upload key=MUNSUH4BMZNP upload=0N4B7Q681ZLG tag=ZK09B7L6OXUE type=write size=2938904 2024-09-12T00:28:03.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.080+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=LU3WT27BIVUF type=del size=2645363 2024-09-12T00:28:03.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.084+0000 7f712938c8c0 1 < completed delete operation key=9HX9GER6OKVI tag=3SXL2ECZSINC type=del 2024-09-12T00:28:03.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.088+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=8ISV4WXW8INS type=del size=2631334 2024-09-12T00:28:03.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.092+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~77C18DQP663M.0 size=54647 2024-09-12T00:28:03.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.100+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=77C18DQP663M tag=ED4JJ4B680YF type=write size=1103223 2024-09-12T00:28:03.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.104+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=3OK6NEHCCCBM type=write size=964905 2024-09-12T00:28:03.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.108+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=C4ZB18LG90FW type=del 2024-09-12T00:28:03.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.116+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~TKFRVIWSNLRT.0 size=120706 2024-09-12T00:28:03.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.116+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=TKFRVIWSNLRT tag=ERANUJR0ON5H type=write size=1169282 2024-09-12T00:28:03.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.120+0000 7f712938c8c0 1 < suggested remove operation key=L2SR6IAW0D38 tag=RY7ODNIYJAGZ type=write 2024-09-12T00:28:03.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.124+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=63NR07A1DW8W type=del size=1451902 2024-09-12T00:28:03.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.128+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=OLBAWBLUTDM3 type=del 2024-09-12T00:28:03.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.136+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~V13HT3S5J86E.0 size=1048576 2024-09-12T00:28:03.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.136+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~V13HT3S5J86E.1 size=1048576 2024-09-12T00:28:03.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.140+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~V13HT3S5J86E.2 size=372215 2024-09-12T00:28:03.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.140+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=V13HT3S5J86E tag=BWODZDNYA4VQ type=write size=3517943 2024-09-12T00:28:03.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.148+0000 7f712938c8c0 1 < suggested remove operation key=5KVIIZS50CNT tag=DE9LIT98JVA7 type=write 2024-09-12T00:28:03.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.156+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~ISK4OGJGNO81.0 size=1048576 2024-09-12T00:28:03.157 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.156+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~ISK4OGJGNO81.1 size=1010688 2024-09-12T00:28:03.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.156+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=ISK4OGJGNO81 tag=21EA4DKOG08X type=write size=3107840 2024-09-12T00:28:03.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.164+0000 7f712938c8c0 1 < suggested update operation key=BH2YHXHVEZCH tag=8O2QCG0B9UFW type=del size=3408956 2024-09-12T00:28:03.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.168+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=HCIF5FV104AD type=write size=166448 2024-09-12T00:28:03.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.172+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~TCK23EUK43VP.0 size=1048576 2024-09-12T00:28:03.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.172+0000 7f712938c8c0 1 < canceled part key=_multipart_QG0W04PRTQNP.2~TCK23EUK43VP.1 size=1048576 2024-09-12T00:28:03.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.172+0000 7f712938c8c0 1 < canceled part key=_multipart_QG0W04PRTQNP.2~TCK23EUK43VP.2 size=567236 2024-09-12T00:28:03.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.180+0000 7f712938c8c0 1 < canceled multipart upload key=QG0W04PRTQNP upload=TCK23EUK43VP tag=DQLKC0DRN0ON type=write size=3712964 2024-09-12T00:28:03.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.184+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=BUYIMPEQ1KJ2 type=del size=2165974 2024-09-12T00:28:03.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.188+0000 7f712938c8c0 -1 < failed to complete operation key=BH2YHXHVEZCH tag=S9CLYWS3EP7U type=del size=3728761: (22) Invalid argument 2024-09-12T00:28:03.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.192+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=DF1TY06YVOU2 type=del size=1215570 2024-09-12T00:28:03.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.192+0000 7f712938c8c0 1 < completed write operation key=N69XPNN6Y6HZ tag=J8THH077DLF8 type=write size=478332 2024-09-12T00:28:03.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.196+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=14GF1J4BRBZJ type=del size=3567276 2024-09-12T00:28:03.202 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.200+0000 7f712938c8c0 1 < completed write operation key=W01PFMFNYLED tag=NLR3QN2DZEEO type=write size=351491 2024-09-12T00:28:03.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.204+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=C7JWK1NMKWDL type=write size=913770 2024-09-12T00:28:03.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.208+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=26ESCBILXU01 type=del 2024-09-12T00:28:03.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.212+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=WH3FUJAD2ULT type=write size=1013810 2024-09-12T00:28:03.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.216+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~KPKR34ADNSTT.0 size=875422 2024-09-12T00:28:03.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.224+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=KPKR34ADNSTT tag=ICH8TKCVGBO9 type=write size=1923998 2024-09-12T00:28:03.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.232+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~YQ6TJOLNSME4.0 size=1048576 2024-09-12T00:28:03.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.232+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~YQ6TJOLNSME4.1 size=624809 2024-09-12T00:28:03.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.232+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=YQ6TJOLNSME4 tag=7WXXWMVJZRB7 type=write size=2721961 2024-09-12T00:28:03.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.236+0000 7f712938c8c0 -1 < failed to complete operation key=BH2YHXHVEZCH tag=VP61LNHFF0D1 type=write size=270433: (22) Invalid argument 2024-09-12T00:28:03.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.240+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=IZXNZ6PA3REK type=del size=2900516 2024-09-12T00:28:03.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.244+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~JK9S9NQ0FNTU.0 size=474740 2024-09-12T00:28:03.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.252+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=JK9S9NQ0FNTU tag=T4XEFFHDX6YF type=write size=1523316 2024-09-12T00:28:03.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.256+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=88ZG63IOMMWK type=del size=2035668 2024-09-12T00:28:03.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.260+0000 7f712938c8c0 1 < suggested update operation key=W9YW6AS1RL48 tag=LU3WT27BIVUF type=del size=2645363 2024-09-12T00:28:03.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.264+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=K9H4JMGRECSE type=del size=3331479 2024-09-12T00:28:03.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.272+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=8ISV4WXW8INS type=del 2024-09-12T00:28:03.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.272+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=256TFNYSIQGD type=del size=2879743 2024-09-12T00:28:03.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.280+0000 7f712938c8c0 1 < completed write operation key=UAJEZUYXN2R0 tag=3OK6NEHCCCBM type=write size=964905 2024-09-12T00:28:03.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.284+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=9QDKVTWB47EJ type=del size=3802657 2024-09-12T00:28:03.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.284+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~TKFRVIWSNLRT.0 size=120706 2024-09-12T00:28:03.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.292+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=TKFRVIWSNLRT tag=ERANUJR0ON5H type=write size=1169282 2024-09-12T00:28:03.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.300+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~ASM0CQW5G43Y.0 size=1048576 2024-09-12T00:28:03.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.304+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~ASM0CQW5G43Y.1 size=1001407 2024-09-12T00:28:03.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.304+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=ASM0CQW5G43Y tag=WPAVH6Q3FVY2 type=write size=3098559 2024-09-12T00:28:03.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.308+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=63NR07A1DW8W type=del 2024-09-12T00:28:03.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.312+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=H83169UHEMFO type=del size=317468 2024-09-12T00:28:03.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.316+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~V13HT3S5J86E.0 size=1048576 2024-09-12T00:28:03.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.320+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~V13HT3S5J86E.1 size=1048576 2024-09-12T00:28:03.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.324+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~V13HT3S5J86E.2 size=372215 2024-09-12T00:28:03.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.328+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=V13HT3S5J86E tag=BWODZDNYA4VQ type=write size=3517943 2024-09-12T00:28:03.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.336+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~MXZHAYKYXKYN.0 size=319534 2024-09-12T00:28:03.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.336+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=MXZHAYKYXKYN tag=OOIMG9CKX6IS type=write size=1368110 2024-09-12T00:28:03.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.340+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~ISK4OGJGNO81.0 size=1048576 2024-09-12T00:28:03.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.344+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~ISK4OGJGNO81.1 size=1010688 2024-09-12T00:28:03.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.348+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=ISK4OGJGNO81 tag=21EA4DKOG08X type=write size=3107840 2024-09-12T00:28:03.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.360+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=M4SZHC7IE3ME type=del size=3350003 2024-09-12T00:28:03.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.364+0000 7f712938c8c0 1 < completed write operation key=KEMQ3H8LAUI9 tag=HCIF5FV104AD type=write size=166448 2024-09-12T00:28:03.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.368+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~YVA6K60MHZ7P.0 size=1032344 2024-09-12T00:28:03.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.368+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=YVA6K60MHZ7P tag=FWJ398XZ1Q96 type=write size=2080920 2024-09-12T00:28:03.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.376+0000 7f712938c8c0 1 < suggested update operation key=G0065P5NOJ2F tag=BUYIMPEQ1KJ2 type=del size=2165974 2024-09-12T00:28:03.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.380+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=XA28OA3G9K8S type=write size=688733 2024-09-12T00:28:03.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.384+0000 7f712938c8c0 1 < completed delete operation key=9N3U208FGM79 tag=DF1TY06YVOU2 type=del 2024-09-12T00:28:03.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.388+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=CP2RP0PB6T47 type=del size=3035336 2024-09-12T00:28:03.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.396+0000 7f712938c8c0 1 < suggested update operation key=W01PFMFNYLED tag=14GF1J4BRBZJ type=del size=3567276 2024-09-12T00:28:03.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.400+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=RM2OVHXTH87N type=write size=757814 2024-09-12T00:28:03.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.404+0000 7f712938c8c0 1 < completed write operation key=Z2RYL03II71Z tag=C7JWK1NMKWDL type=write size=913770 2024-09-12T00:28:03.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.408+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=GV1DMTUPBBVY type=del size=1826936 2024-09-12T00:28:03.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.412+0000 7f712938c8c0 1 < completed write operation key=T1H3O6A6HBQH tag=WH3FUJAD2ULT type=write size=1013810 2024-09-12T00:28:03.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.416+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=PLYZ6D3XBYUB type=del size=756809 2024-09-12T00:28:03.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.420+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~YQ6TJOLNSME4.0 size=1048576 2024-09-12T00:28:03.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.424+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~YQ6TJOLNSME4.1 size=624809 2024-09-12T00:28:03.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.428+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=YQ6TJOLNSME4 tag=7WXXWMVJZRB7 type=write size=2721961 2024-09-12T00:28:03.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.436+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~38GEU6RUB1SU.0 size=332373 2024-09-12T00:28:03.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.436+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=38GEU6RUB1SU tag=NWUZDVC24KK9 type=write size=1380949 2024-09-12T00:28:03.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.440+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=IZXNZ6PA3REK type=del 2024-09-12T00:28:03.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.444+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=HOB0ZIYGW19X type=write size=48578 2024-09-12T00:28:03.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.452+0000 7f712938c8c0 1 < suggested remove operation key=0QZKHZTVP3RQ tag=88ZG63IOMMWK type=del 2024-09-12T00:28:03.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.456+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=GGK0O4VC0A8F type=del size=4172162 2024-09-12T00:28:03.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.460+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=K9H4JMGRECSE type=del 2024-09-12T00:28:03.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.464+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=HA3XPN1J829B type=del size=435094 2024-09-12T00:28:03.468 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.468+0000 7f712938c8c0 1 < canceled operation key=ZP88X00LMVSS tag=256TFNYSIQGD type=del size=2879743 2024-09-12T00:28:03.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.472+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=Y27TZM38VOJ9 type=del size=3433797 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.476+0000 7f712938c8c0 1 < completed delete operation key=WP4RJQVZVEE2 tag=9QDKVTWB47EJ type=del 2024-09-12T00:28:03.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.484+0000 7f712938c8c0 1 > prepared part key=_multipart_L2SR6IAW0D38.2~CY4KBL9240NI.0 size=645964 2024-09-12T00:28:03.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.484+0000 7f712938c8c0 1 > prepared multipart upload key=L2SR6IAW0D38 upload=CY4KBL9240NI tag=ZAGI3DL9561H type=write size=1694540 2024-09-12T00:28:03.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.488+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~ASM0CQW5G43Y.0 size=1048576 2024-09-12T00:28:03.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.488+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~ASM0CQW5G43Y.1 size=1001407 2024-09-12T00:28:03.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.496+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=ASM0CQW5G43Y tag=WPAVH6Q3FVY2 type=write size=3098559 2024-09-12T00:28:03.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.500+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~AF68YO68S094.0 size=1048576 2024-09-12T00:28:03.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.504+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~AF68YO68S094.1 size=1048576 2024-09-12T00:28:03.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.508+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~AF68YO68S094.2 size=802440 2024-09-12T00:28:03.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.508+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=AF68YO68S094 tag=OPE1F59TXER8 type=write size=3948168 2024-09-12T00:28:03.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.512+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=H83169UHEMFO type=del 2024-09-12T00:28:03.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.516+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=TGO3SOMFNUKR type=del size=2086545 2024-09-12T00:28:03.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.520+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~MXZHAYKYXKYN.0 size=319534 2024-09-12T00:28:03.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.524+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=MXZHAYKYXKYN tag=OOIMG9CKX6IS type=write size=1368110 2024-09-12T00:28:03.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.528+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=1DABCLWRUGVQ type=del size=650995 2024-09-12T00:28:03.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.532+0000 7f712938c8c0 1 < completed delete operation key=Z2RYL03II71Z tag=M4SZHC7IE3ME type=del 2024-09-12T00:28:03.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.536+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=TIHZCXS8WYG0 type=del size=2717696 2024-09-12T00:28:03.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.540+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~YVA6K60MHZ7P.0 size=1032344 2024-09-12T00:28:03.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.548+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=YVA6K60MHZ7P tag=FWJ398XZ1Q96 type=write size=2080920 2024-09-12T00:28:03.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.552+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PS0VPXTZNZC7.0 size=1048576 2024-09-12T00:28:03.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.556+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~PS0VPXTZNZC7.1 size=487453 2024-09-12T00:28:03.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.556+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=PS0VPXTZNZC7 tag=J561YEK3D4U5 type=write size=2584605 2024-09-12T00:28:03.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.560+0000 7f712938c8c0 1 < completed write operation key=A8L061CQ0M0J tag=XA28OA3G9K8S type=write size=688733 2024-09-12T00:28:03.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.564+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=I2ETPWH92Z55 type=del size=1301529 2024-09-12T00:28:03.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.568+0000 7f712938c8c0 1 < suggested update operation key=L2SR6IAW0D38 tag=CP2RP0PB6T47 type=del size=3035336 2024-09-12T00:28:03.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.572+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=HTTO1YJRGEOY type=del size=281785 2024-09-12T00:28:03.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.576+0000 7f712938c8c0 1 < completed write operation key=04RL082VPLIM tag=RM2OVHXTH87N type=write size=757814 2024-09-12T00:28:03.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.584+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~BW08XA3PI3KZ.0 size=1048576 2024-09-12T00:28:03.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.588+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~BW08XA3PI3KZ.1 size=1048576 2024-09-12T00:28:03.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.592+0000 7f712938c8c0 1 > prepared part key=_multipart_9HX9GER6OKVI.2~BW08XA3PI3KZ.2 size=99354 2024-09-12T00:28:03.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.592+0000 7f712938c8c0 1 > prepared multipart upload key=9HX9GER6OKVI upload=BW08XA3PI3KZ tag=0YFEPKCLTS7F type=write size=3245082 2024-09-12T00:28:03.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.596+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=GV1DMTUPBBVY type=del 2024-09-12T00:28:03.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.600+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~Z9C47K6ABH1E.0 size=1048576 2024-09-12T00:28:03.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.604+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~Z9C47K6ABH1E.1 size=1048576 2024-09-12T00:28:03.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.608+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~Z9C47K6ABH1E.2 size=447541 2024-09-12T00:28:03.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.608+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=Z9C47K6ABH1E tag=NXOEHAK6H4RX type=write size=3593269 2024-09-12T00:28:03.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.612+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=PLYZ6D3XBYUB type=del 2024-09-12T00:28:03.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.616+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=4ZXMHLK5DKBX type=del size=2874835 2024-09-12T00:28:03.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.620+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~38GEU6RUB1SU.0 size=332373 2024-09-12T00:28:03.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.624+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=38GEU6RUB1SU tag=NWUZDVC24KK9 type=write size=1380949 2024-09-12T00:28:03.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.628+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=T925E06IWCIT type=del size=840719 2024-09-12T00:28:03.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.636+0000 7f712938c8c0 1 < suggested remove operation key=04RL082VPLIM tag=HOB0ZIYGW19X type=write 2024-09-12T00:28:03.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.640+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=CLJQZ8KEVA8E type=del size=3664996 2024-09-12T00:28:03.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.644+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=GGK0O4VC0A8F type=del 2024-09-12T00:28:03.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.648+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=1MXQ8CD0ITRD type=del size=1098173 2024-09-12T00:28:03.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.652+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=HA3XPN1J829B type=del 2024-09-12T00:28:03.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.656+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=TJ6PAM7IBM65 type=write size=818345 2024-09-12T00:28:03.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.660+0000 7f712938c8c0 1 < completed delete operation key=KEMQ3H8LAUI9 tag=Y27TZM38VOJ9 type=del 2024-09-12T00:28:03.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.668+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~E1AWJMKPKBQG.0 size=1048576 2024-09-12T00:28:03.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.672+0000 7f712938c8c0 1 > prepared part key=_multipart_A8L061CQ0M0J.2~E1AWJMKPKBQG.1 size=35424 2024-09-12T00:28:03.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.672+0000 7f712938c8c0 1 > prepared multipart upload key=A8L061CQ0M0J upload=E1AWJMKPKBQG tag=NR3DHCVUIOP3 type=write size=2132576 2024-09-12T00:28:03.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.672+0000 7f712938c8c0 1 < completed part key=_multipart_L2SR6IAW0D38.2~CY4KBL9240NI.0 size=645964 2024-09-12T00:28:03.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.680+0000 7f712938c8c0 1 < completed multipart upload key=L2SR6IAW0D38 upload=CY4KBL9240NI tag=ZAGI3DL9561H type=write size=1694540 2024-09-12T00:28:03.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.684+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=9AIIVIE0Q1UL type=del size=3134028 2024-09-12T00:28:03.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.688+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~AF68YO68S094.0 size=1048576 2024-09-12T00:28:03.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.688+0000 7f712938c8c0 1 < canceled part key=_multipart_GZON46MODQZO.2~AF68YO68S094.1 size=1048576 2024-09-12T00:28:03.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.688+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~AF68YO68S094.2 size=802440 2024-09-12T00:28:03.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.696+0000 7f712938c8c0 1 < canceled multipart upload key=GZON46MODQZO upload=AF68YO68S094 tag=OPE1F59TXER8 type=write size=3948168 2024-09-12T00:28:03.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.700+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=SKDOCQ8YVG01 type=del size=2986084 2024-09-12T00:28:03.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.708+0000 7f712938c8c0 1 < suggested update operation key=T1H3O6A6HBQH tag=TGO3SOMFNUKR type=del size=2086545 2024-09-12T00:28:03.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.712+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=K4X02CD9MXB4 type=write size=377028 2024-09-12T00:28:03.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.720+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=1DABCLWRUGVQ type=del 2024-09-12T00:28:03.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.724+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~EO2C3CKI5RG5.0 size=1048576 2024-09-12T00:28:03.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.728+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~EO2C3CKI5RG5.1 size=489313 2024-09-12T00:28:03.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.728+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=EO2C3CKI5RG5 tag=I1ANTZA2YHYZ type=write size=2586465 2024-09-12T00:28:03.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.732+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=TIHZCXS8WYG0 type=del 2024-09-12T00:28:03.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.736+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=3J9GZ18VCI75 type=del size=3490001 2024-09-12T00:28:03.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.740+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PS0VPXTZNZC7.0 size=1048576 2024-09-12T00:28:03.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.744+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~PS0VPXTZNZC7.1 size=487453 2024-09-12T00:28:03.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.748+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=PS0VPXTZNZC7 tag=J561YEK3D4U5 type=write size=2584605 2024-09-12T00:28:03.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.752+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=XN9HQUGOX7CS type=del size=2771798 2024-09-12T00:28:03.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.760+0000 7f712938c8c0 1 < suggested update operation key=5KVIIZS50CNT tag=I2ETPWH92Z55 type=del size=1301529 2024-09-12T00:28:03.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.768+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~HPUAFPM58SC9.0 size=1048576 2024-09-12T00:28:03.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.772+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~HPUAFPM58SC9.1 size=1048576 2024-09-12T00:28:03.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.772+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~HPUAFPM58SC9.2 size=729583 2024-09-12T00:28:03.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.772+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=HPUAFPM58SC9 tag=T9XFPVF3GZDN type=write size=3875311 2024-09-12T00:28:03.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.780+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=HTTO1YJRGEOY type=del 2024-09-12T00:28:03.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.780+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=LYXVRHPVS6Z0 type=del size=3896540 2024-09-12T00:28:03.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.788+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~BW08XA3PI3KZ.0 size=1048576 2024-09-12T00:28:03.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.788+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~BW08XA3PI3KZ.1 size=1048576 2024-09-12T00:28:03.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.792+0000 7f712938c8c0 1 < completed part key=_multipart_9HX9GER6OKVI.2~BW08XA3PI3KZ.2 size=99354 2024-09-12T00:28:03.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.800+0000 7f712938c8c0 1 < completed multipart upload key=9HX9GER6OKVI upload=BW08XA3PI3KZ tag=0YFEPKCLTS7F type=write size=3245082 2024-09-12T00:28:03.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.808+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~JL1VCCGT6AMX.0 size=1048576 2024-09-12T00:28:03.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.812+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~JL1VCCGT6AMX.1 size=1048576 2024-09-12T00:28:03.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.816+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~JL1VCCGT6AMX.2 size=777043 2024-09-12T00:28:03.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.816+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=JL1VCCGT6AMX tag=JZN38TXZXMGX type=write size=3922771 2024-09-12T00:28:03.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.820+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~Z9C47K6ABH1E.0 size=1048576 2024-09-12T00:28:03.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.824+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~Z9C47K6ABH1E.1 size=1048576 2024-09-12T00:28:03.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.824+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~Z9C47K6ABH1E.2 size=447541 2024-09-12T00:28:03.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.832+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=Z9C47K6ABH1E tag=NXOEHAK6H4RX type=write size=3593269 2024-09-12T00:28:03.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.836+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=A6QFK2VQ3G3J type=write size=1045382 2024-09-12T00:28:03.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.840+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=4ZXMHLK5DKBX type=del 2024-09-12T00:28:03.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.844+0000 7f712938c8c0 1 > prepared operation key=F7T79C7MZX35 tag=YVQGGXRPZCA8 type=del size=2851275 2024-09-12T00:28:03.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.848+0000 7f712938c8c0 1 < canceled operation key=QG0W04PRTQNP tag=T925E06IWCIT type=del size=840719 2024-09-12T00:28:03.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.856+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~F53AFSJ4IVHS.0 size=718818 2024-09-12T00:28:03.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.856+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=F53AFSJ4IVHS tag=223OH3817AL6 type=write size=1767394 2024-09-12T00:28:03.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.864+0000 7f712938c8c0 1 < suggested remove operation key=QG0W04PRTQNP tag=CLJQZ8KEVA8E type=del 2024-09-12T00:28:03.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.868+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=5TUOVA0ATIPO type=del size=485480 2024-09-12T00:28:03.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.872+0000 7f712938c8c0 1 < completed delete operation key=T0C4ZDQB13X0 tag=1MXQ8CD0ITRD type=del 2024-09-12T00:28:03.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.876+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=4XDILFQIMXCP type=write size=752602 2024-09-12T00:28:03.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.880+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=TJ6PAM7IBM65 type=write size=818345 2024-09-12T00:28:03.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.884+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=DSEJ1GA7EPWX type=del size=2672006 2024-09-12T00:28:03.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.884+0000 7f712938c8c0 1 < canceled part key=_multipart_A8L061CQ0M0J.2~E1AWJMKPKBQG.0 size=1048576 2024-09-12T00:28:03.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.888+0000 7f712938c8c0 1 < completed part key=_multipart_A8L061CQ0M0J.2~E1AWJMKPKBQG.1 size=35424 2024-09-12T00:28:03.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.892+0000 7f712938c8c0 1 < canceled multipart upload key=A8L061CQ0M0J upload=E1AWJMKPKBQG tag=NR3DHCVUIOP3 type=write size=2132576 2024-09-12T00:28:03.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.896+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=R7UBGU565211 type=del size=1974104 2024-09-12T00:28:03.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.900+0000 7f712938c8c0 1 < completed delete operation key=V9K2307BGOKP tag=9AIIVIE0Q1UL type=del 2024-09-12T00:28:03.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.904+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=OGDN3SOFAFK9 type=write size=118993 2024-09-12T00:28:03.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.908+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=SKDOCQ8YVG01 type=del 2024-09-12T00:28:03.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.912+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=KAYT3UFV3SBY type=del size=1962363 2024-09-12T00:28:03.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.916+0000 7f712938c8c0 1 < canceled operation key=9YZP0TIRWWRF tag=K4X02CD9MXB4 type=write size=377028 2024-09-12T00:28:03.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.920+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=W8F49HYI4X5P type=del size=1158737 2024-09-12T00:28:03.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.924+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~EO2C3CKI5RG5.0 size=1048576 2024-09-12T00:28:03.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.924+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~EO2C3CKI5RG5.1 size=489313 2024-09-12T00:28:03.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.932+0000 7f712938c8c0 1 < completed multipart upload key=04RL082VPLIM upload=EO2C3CKI5RG5 tag=I1ANTZA2YHYZ type=write size=2586465 2024-09-12T00:28:03.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.940+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~TG57SY9OPM98.0 size=1048576 2024-09-12T00:28:03.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.940+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~TG57SY9OPM98.1 size=1048576 2024-09-12T00:28:03.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.944+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~TG57SY9OPM98.2 size=219574 2024-09-12T00:28:03.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.944+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=TG57SY9OPM98 tag=GXO5ISKERZJ7 type=write size=3365302 2024-09-12T00:28:03.948 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.948+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=3J9GZ18VCI75 type=del 2024-09-12T00:28:03.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.952+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=AZNFGB2PL5SP type=del size=3285070 2024-09-12T00:28:03.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.956+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=XN9HQUGOX7CS type=del 2024-09-12T00:28:03.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.960+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=BRU3OS9DYA9N type=del size=2353332 2024-09-12T00:28:03.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.964+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~HPUAFPM58SC9.0 size=1048576 2024-09-12T00:28:03.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.968+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~HPUAFPM58SC9.1 size=1048576 2024-09-12T00:28:03.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.968+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~HPUAFPM58SC9.2 size=729583 2024-09-12T00:28:03.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.976+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=HPUAFPM58SC9 tag=T9XFPVF3GZDN type=write size=3875311 2024-09-12T00:28:03.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.980+0000 7f712938c8c0 1 > prepared operation key=A8L061CQ0M0J tag=MC4CIEKXW5L0 type=del size=1731237 2024-09-12T00:28:03.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.984+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=LYXVRHPVS6Z0 type=del 2024-09-12T00:28:03.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.992+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~WW3TR72NAO1T.0 size=1048576 2024-09-12T00:28:03.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.992+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~WW3TR72NAO1T.1 size=1048576 2024-09-12T00:28:03.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.996+0000 7f712938c8c0 1 > prepared part key=_multipart_04RL082VPLIM.2~WW3TR72NAO1T.2 size=110251 2024-09-12T00:28:03.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:03.996+0000 7f712938c8c0 1 > prepared multipart upload key=04RL082VPLIM upload=WW3TR72NAO1T tag=3RAKPPT0ND6X type=write size=3255979 2024-09-12T00:28:04.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.000+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~JL1VCCGT6AMX.0 size=1048576 2024-09-12T00:28:04.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.004+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~JL1VCCGT6AMX.1 size=1048576 2024-09-12T00:28:04.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.008+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~JL1VCCGT6AMX.2 size=777043 2024-09-12T00:28:04.013 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.012+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=JL1VCCGT6AMX tag=JZN38TXZXMGX type=write size=3922771 2024-09-12T00:28:04.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.016+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=6LHSCIAY376A type=del size=765786 2024-09-12T00:28:04.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.020+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=A6QFK2VQ3G3J type=write size=1045382 2024-09-12T00:28:04.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.024+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=RKT4N0VAMSU6 type=del size=1304204 2024-09-12T00:28:04.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.028+0000 7f712938c8c0 1 < completed delete operation key=F7T79C7MZX35 tag=YVQGGXRPZCA8 type=del 2024-09-12T00:28:04.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.032+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=2TIFX6UA5VG5 type=del size=948206 2024-09-12T00:28:04.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.036+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~F53AFSJ4IVHS.0 size=718818 2024-09-12T00:28:04.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.040+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=F53AFSJ4IVHS tag=223OH3817AL6 type=write size=1767394 2024-09-12T00:28:04.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.044+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=KJM751TMTW0E type=del size=1462423 2024-09-12T00:28:04.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.048+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=5TUOVA0ATIPO type=del 2024-09-12T00:28:04.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.056+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~59SLGF78C813.0 size=1048576 2024-09-12T00:28:04.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.060+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~59SLGF78C813.1 size=807163 2024-09-12T00:28:04.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.060+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=59SLGF78C813 tag=YKXBD2DK7C5U type=write size=2904315 2024-09-12T00:28:04.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.068+0000 7f712938c8c0 1 < suggested update operation key=MUNSUH4BMZNP tag=4XDILFQIMXCP type=write size=752602 2024-09-12T00:28:04.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.080+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~6FBI4O1M8CPR.0 size=1048576 2024-09-12T00:28:04.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.084+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~6FBI4O1M8CPR.1 size=116925 2024-09-12T00:28:04.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.084+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=6FBI4O1M8CPR tag=DCRNGIUC5ELC type=write size=2214077 2024-09-12T00:28:04.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.088+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=DSEJ1GA7EPWX type=del 2024-09-12T00:28:04.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.092+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=SZN4DH1PQW1I type=write size=793127 2024-09-12T00:28:04.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.096+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=R7UBGU565211 type=del 2024-09-12T00:28:04.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.100+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=SZ9FRY3QJF38 type=del size=709899 2024-09-12T00:28:04.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.104+0000 7f712938c8c0 1 < canceled operation key=ZP88X00LMVSS tag=OGDN3SOFAFK9 type=write size=118993 2024-09-12T00:28:04.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.108+0000 7f712938c8c0 1 > prepared operation key=KEMQ3H8LAUI9 tag=L8REOCORLHSF type=del size=1514899 2024-09-12T00:28:04.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.112+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=KAYT3UFV3SBY type=del 2024-09-12T00:28:04.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.116+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=CH8VGII9MNHH type=del size=2127160 2024-09-12T00:28:04.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.120+0000 7f712938c8c0 1 < canceled operation key=UAJEZUYXN2R0 tag=W8F49HYI4X5P type=del size=1158737 2024-09-12T00:28:04.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.128+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~XF6GBPL7V284.0 size=1048576 2024-09-12T00:28:04.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.132+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~XF6GBPL7V284.1 size=55883 2024-09-12T00:28:04.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.132+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=XF6GBPL7V284 tag=K3IXOX87O8DZ type=write size=2153035 2024-09-12T00:28:04.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.136+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~TG57SY9OPM98.0 size=1048576 2024-09-12T00:28:04.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.140+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~TG57SY9OPM98.1 size=1048576 2024-09-12T00:28:04.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.144+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~TG57SY9OPM98.2 size=219574 2024-09-12T00:28:04.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.152+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=TG57SY9OPM98 tag=GXO5ISKERZJ7 type=write size=3365302 2024-09-12T00:28:04.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.156+0000 7f712938c8c0 1 > prepared operation key=G0065P5NOJ2F tag=KULDWDZ8GKZ2 type=del size=3888796 2024-09-12T00:28:04.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.160+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=AZNFGB2PL5SP type=del 2024-09-12T00:28:04.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.164+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=J50KY26C9A42 type=del size=1712017 2024-09-12T00:28:04.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.168+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=BRU3OS9DYA9N type=del 2024-09-12T00:28:04.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.172+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=VG6EBA2G1VK2 type=write size=93113 2024-09-12T00:28:04.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.180+0000 7f712938c8c0 1 < completed delete operation key=A8L061CQ0M0J tag=MC4CIEKXW5L0 type=del 2024-09-12T00:28:04.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.184+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=6LM6IB3U5G0M type=write size=630384 2024-09-12T00:28:04.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.184+0000 7f712938c8c0 1 < canceled part key=_multipart_04RL082VPLIM.2~WW3TR72NAO1T.0 size=1048576 2024-09-12T00:28:04.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.188+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~WW3TR72NAO1T.1 size=1048576 2024-09-12T00:28:04.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.188+0000 7f712938c8c0 1 < completed part key=_multipart_04RL082VPLIM.2~WW3TR72NAO1T.2 size=110251 2024-09-12T00:28:04.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.196+0000 7f712938c8c0 1 < canceled multipart upload key=04RL082VPLIM upload=WW3TR72NAO1T tag=3RAKPPT0ND6X type=write size=3255979 2024-09-12T00:28:04.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.200+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=S05UF66ZCQRR type=del size=861258 2024-09-12T00:28:04.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.204+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=6LHSCIAY376A type=del 2024-09-12T00:28:04.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.208+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=7Q7EXHSL5LM8 type=del size=3798773 2024-09-12T00:28:04.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.212+0000 7f712938c8c0 1 < completed delete operation key=BH2YHXHVEZCH tag=RKT4N0VAMSU6 type=del 2024-09-12T00:28:04.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.220+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~7RZYZGTE8GNS.0 size=1048576 2024-09-12T00:28:04.224 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.220+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~7RZYZGTE8GNS.1 size=753666 2024-09-12T00:28:04.224 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.220+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=7RZYZGTE8GNS tag=EL6BK50BP9CY type=write size=2850818 2024-09-12T00:28:04.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.228+0000 7f712938c8c0 1 < suggested remove operation key=WP4RJQVZVEE2 tag=2TIFX6UA5VG5 type=del 2024-09-12T00:28:04.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.232+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=5N4KOD3HYU8I type=del size=650127 2024-09-12T00:28:04.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.236+0000 7f712938c8c0 1 < canceled operation key=5KVIIZS50CNT tag=KJM751TMTW0E type=del size=1462423 2024-09-12T00:28:04.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.244+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~R9GFAIPOP8ZE.0 size=1048576 2024-09-12T00:28:04.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.248+0000 7f712938c8c0 1 > prepared part key=_multipart_9751RNPPQJBO.2~R9GFAIPOP8ZE.1 size=669134 2024-09-12T00:28:04.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.248+0000 7f712938c8c0 1 > prepared multipart upload key=9751RNPPQJBO upload=R9GFAIPOP8ZE tag=4O8DBW8EV61Y type=write size=2766286 2024-09-12T00:28:04.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.252+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~59SLGF78C813.0 size=1048576 2024-09-12T00:28:04.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.252+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~59SLGF78C813.1 size=807163 2024-09-12T00:28:04.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.260+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=59SLGF78C813 tag=YKXBD2DK7C5U type=write size=2904315 2024-09-12T00:28:04.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.264+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=3HRJZ206ICG1 type=del size=282205 2024-09-12T00:28:04.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.268+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~6FBI4O1M8CPR.0 size=1048576 2024-09-12T00:28:04.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.272+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~6FBI4O1M8CPR.1 size=116925 2024-09-12T00:28:04.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.276+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=6FBI4O1M8CPR tag=DCRNGIUC5ELC type=write size=2214077 2024-09-12T00:28:04.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.284+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~FRGU9OBWDPY0.0 size=1048576 2024-09-12T00:28:04.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.288+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~FRGU9OBWDPY0.1 size=1048576 2024-09-12T00:28:04.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.288+0000 7f712938c8c0 1 > prepared part key=_multipart_9YZP0TIRWWRF.2~FRGU9OBWDPY0.2 size=365321 2024-09-12T00:28:04.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.288+0000 7f712938c8c0 1 > prepared multipart upload key=9YZP0TIRWWRF upload=FRGU9OBWDPY0 tag=26ZCGXY7J6Q6 type=write size=3511049 2024-09-12T00:28:04.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.296+0000 7f712938c8c0 1 < completed write operation key=HPM9GFRASWIV tag=SZN4DH1PQW1I type=write size=793127 2024-09-12T00:28:04.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.300+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=C3ZVW3OXUOM0 type=del size=3551811 2024-09-12T00:28:04.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.304+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=SZ9FRY3QJF38 type=del 2024-09-12T00:28:04.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.308+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=5X0TUHWK1WQ5 type=del size=1012741 2024-09-12T00:28:04.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.316+0000 7f712938c8c0 1 < suggested remove operation key=KEMQ3H8LAUI9 tag=L8REOCORLHSF type=del 2024-09-12T00:28:04.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.320+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~2PQYQUX60XST.0 size=1048576 2024-09-12T00:28:04.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.324+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~2PQYQUX60XST.1 size=203092 2024-09-12T00:28:04.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.324+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=2PQYQUX60XST tag=CEUDRR1MUI1P type=write size=2300244 2024-09-12T00:28:04.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.328+0000 7f712938c8c0 1 < completed delete operation key=UAJEZUYXN2R0 tag=CH8VGII9MNHH type=del 2024-09-12T00:28:04.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.332+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=K5F75TWKGR84 type=del size=655535 2024-09-12T00:28:04.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.336+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~XF6GBPL7V284.0 size=1048576 2024-09-12T00:28:04.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.340+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~XF6GBPL7V284.1 size=55883 2024-09-12T00:28:04.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.348+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=XF6GBPL7V284 tag=K3IXOX87O8DZ type=write size=2153035 2024-09-12T00:28:04.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.348+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=33E87TTH91ES type=write size=498794 2024-09-12T00:28:04.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.356+0000 7f712938c8c0 1 < completed delete operation key=G0065P5NOJ2F tag=KULDWDZ8GKZ2 type=del 2024-09-12T00:28:04.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.360+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~4V93LOLVOC48.0 size=1048576 2024-09-12T00:28:04.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.364+0000 7f712938c8c0 1 > prepared part key=_multipart_5KVIIZS50CNT.2~4V93LOLVOC48.1 size=547077 2024-09-12T00:28:04.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.364+0000 7f712938c8c0 1 > prepared multipart upload key=5KVIIZS50CNT upload=4V93LOLVOC48 tag=Y8GE4EYSED7S type=write size=2644229 2024-09-12T00:28:04.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.368+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=J50KY26C9A42 type=del 2024-09-12T00:28:04.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.376+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~QLT3UC5VCCWB.0 size=30776 2024-09-12T00:28:04.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.376+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=QLT3UC5VCCWB tag=ET3JD6HI0SAI type=write size=1079352 2024-09-12T00:28:04.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.380+0000 7f712938c8c0 1 < completed write operation key=UAJEZUYXN2R0 tag=VG6EBA2G1VK2 type=write size=93113 2024-09-12T00:28:04.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.384+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~2BYSAHNS3K2N.0 size=1048576 2024-09-12T00:28:04.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.388+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~2BYSAHNS3K2N.1 size=376035 2024-09-12T00:28:04.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.388+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=2BYSAHNS3K2N tag=IG0DJY0AWF1D type=write size=2473187 2024-09-12T00:28:04.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.392+0000 7f712938c8c0 1 < completed write operation key=9YZP0TIRWWRF tag=6LM6IB3U5G0M type=write size=630384 2024-09-12T00:28:04.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.400+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~Y2ATJCRV1U05.0 size=76564 2024-09-12T00:28:04.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.400+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=Y2ATJCRV1U05 tag=SPZAQWWS6YAO type=write size=1125140 2024-09-12T00:28:04.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.404+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=S05UF66ZCQRR type=del 2024-09-12T00:28:04.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.408+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=33BGUSR1ZLFS type=del size=146981 2024-09-12T00:28:04.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.412+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=7Q7EXHSL5LM8 type=del 2024-09-12T00:28:04.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.416+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~IJ4Y26BYZIUM.0 size=1048576 2024-09-12T00:28:04.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.420+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~IJ4Y26BYZIUM.1 size=1048576 2024-09-12T00:28:04.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.424+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~IJ4Y26BYZIUM.2 size=616152 2024-09-12T00:28:04.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.424+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=IJ4Y26BYZIUM tag=Z43B7J6T8C9R type=write size=3761880 2024-09-12T00:28:04.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.428+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~7RZYZGTE8GNS.0 size=1048576 2024-09-12T00:28:04.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.428+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~7RZYZGTE8GNS.1 size=753666 2024-09-12T00:28:04.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.436+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=7RZYZGTE8GNS tag=EL6BK50BP9CY type=write size=2850818 2024-09-12T00:28:04.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.440+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=NVKZ6TR14K7X type=del size=2588620 2024-09-12T00:28:04.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.444+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=5N4KOD3HYU8I type=del 2024-09-12T00:28:04.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.452+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=JEP5SZRBK4WV type=del size=1213282 2024-09-12T00:28:04.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.456+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~R9GFAIPOP8ZE.0 size=1048576 2024-09-12T00:28:04.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.460+0000 7f712938c8c0 1 < completed part key=_multipart_9751RNPPQJBO.2~R9GFAIPOP8ZE.1 size=669134 2024-09-12T00:28:04.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.464+0000 7f712938c8c0 1 < completed multipart upload key=9751RNPPQJBO upload=R9GFAIPOP8ZE tag=4O8DBW8EV61Y type=write size=2766286 2024-09-12T00:28:04.468 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.468+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=GRACB4HSC8EU type=del size=726644 2024-09-12T00:28:04.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.472+0000 7f712938c8c0 1 < canceled operation key=ZP88X00LMVSS tag=3HRJZ206ICG1 type=del size=282205 2024-09-12T00:28:04.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.476+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=TESXMWPCKUC1 type=write size=117413 2024-09-12T00:28:04.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.480+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~FRGU9OBWDPY0.0 size=1048576 2024-09-12T00:28:04.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.484+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~FRGU9OBWDPY0.1 size=1048576 2024-09-12T00:28:04.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.484+0000 7f712938c8c0 1 < completed part key=_multipart_9YZP0TIRWWRF.2~FRGU9OBWDPY0.2 size=365321 2024-09-12T00:28:04.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.492+0000 7f712938c8c0 1 < completed multipart upload key=9YZP0TIRWWRF upload=FRGU9OBWDPY0 tag=26ZCGXY7J6Q6 type=write size=3511049 2024-09-12T00:28:04.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.496+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=HMG3DT49RAEQ type=del size=65466 2024-09-12T00:28:04.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.500+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=C3ZVW3OXUOM0 type=del 2024-09-12T00:28:04.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.504+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~35RE39UERDKI.0 size=1048576 2024-09-12T00:28:04.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.508+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~35RE39UERDKI.1 size=1048576 2024-09-12T00:28:04.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.512+0000 7f712938c8c0 1 > prepared part key=_multipart_W9YW6AS1RL48.2~35RE39UERDKI.2 size=196422 2024-09-12T00:28:04.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.512+0000 7f712938c8c0 1 > prepared multipart upload key=W9YW6AS1RL48 upload=35RE39UERDKI tag=47CMR02C64O4 type=write size=3342150 2024-09-12T00:28:04.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.520+0000 7f712938c8c0 1 < suggested update operation key=5KVIIZS50CNT tag=5X0TUHWK1WQ5 type=del size=1012741 2024-09-12T00:28:04.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.520+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=C8J853C74GPU type=del size=116092 2024-09-12T00:28:04.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.524+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~2PQYQUX60XST.0 size=1048576 2024-09-12T00:28:04.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.528+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~2PQYQUX60XST.1 size=203092 2024-09-12T00:28:04.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.532+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=2PQYQUX60XST tag=CEUDRR1MUI1P type=write size=2300244 2024-09-12T00:28:04.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.536+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=TU5MH6ZM2F59 type=del size=3166061 2024-09-12T00:28:04.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.540+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=K5F75TWKGR84 type=del 2024-09-12T00:28:04.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.544+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=ZB9TAJM02JMI type=del size=2690184 2024-09-12T00:28:04.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.548+0000 7f712938c8c0 1 < completed write operation key=WP4RJQVZVEE2 tag=33E87TTH91ES type=write size=498794 2024-09-12T00:28:04.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.552+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=XSIHCZJ80J1Q type=del size=2740884 2024-09-12T00:28:04.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.556+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~4V93LOLVOC48.0 size=1048576 2024-09-12T00:28:04.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.560+0000 7f712938c8c0 1 < completed part key=_multipart_5KVIIZS50CNT.2~4V93LOLVOC48.1 size=547077 2024-09-12T00:28:04.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.564+0000 7f712938c8c0 1 < completed multipart upload key=5KVIIZS50CNT upload=4V93LOLVOC48 tag=Y8GE4EYSED7S type=write size=2644229 2024-09-12T00:28:04.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.568+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=QSK9NY3N9CR3 type=del size=2779969 2024-09-12T00:28:04.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.572+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~QLT3UC5VCCWB.0 size=30776 2024-09-12T00:28:04.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.580+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=QLT3UC5VCCWB tag=ET3JD6HI0SAI type=write size=1079352 2024-09-12T00:28:04.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.584+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=57V8FQAM3U5S type=del size=3181874 2024-09-12T00:28:04.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.584+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~2BYSAHNS3K2N.0 size=1048576 2024-09-12T00:28:04.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.588+0000 7f712938c8c0 1 < completed part key=_multipart_WP4RJQVZVEE2.2~2BYSAHNS3K2N.1 size=376035 2024-09-12T00:28:04.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.592+0000 7f712938c8c0 1 < completed multipart upload key=WP4RJQVZVEE2 upload=2BYSAHNS3K2N tag=IG0DJY0AWF1D type=write size=2473187 2024-09-12T00:28:04.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.596+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=UER5OC4RYZ16 type=write size=799476 2024-09-12T00:28:04.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.600+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~Y2ATJCRV1U05.0 size=76564 2024-09-12T00:28:04.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.608+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=Y2ATJCRV1U05 tag=SPZAQWWS6YAO type=write size=1125140 2024-09-12T00:28:04.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.612+0000 7f712938c8c0 1 > prepared part key=_multipart_QL3FL4J9TKY4.2~BVZVOSH054HC.0 size=641538 2024-09-12T00:28:04.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.612+0000 7f712938c8c0 1 > prepared multipart upload key=QL3FL4J9TKY4 upload=BVZVOSH054HC tag=M3J8R8VGNAG8 type=write size=1690114 2024-09-12T00:28:04.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.620+0000 7f712938c8c0 1 < suggested remove operation key=5KVIIZS50CNT tag=33BGUSR1ZLFS type=del 2024-09-12T00:28:04.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.628+0000 7f712938c8c0 1 > prepared part key=_multipart_HPM9GFRASWIV.2~4WY0D8YCQIF7.0 size=659039 2024-09-12T00:28:04.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.628+0000 7f712938c8c0 1 > prepared multipart upload key=HPM9GFRASWIV upload=4WY0D8YCQIF7 tag=F0SXVO6ZDWVE type=write size=1707615 2024-09-12T00:28:04.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.628+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~IJ4Y26BYZIUM.0 size=1048576 2024-09-12T00:28:04.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.632+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~IJ4Y26BYZIUM.1 size=1048576 2024-09-12T00:28:04.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.636+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~IJ4Y26BYZIUM.2 size=616152 2024-09-12T00:28:04.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.640+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=IJ4Y26BYZIUM tag=Z43B7J6T8C9R type=write size=3761880 2024-09-12T00:28:04.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.648+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~NSHE8AD01JBS.0 size=1048576 2024-09-12T00:28:04.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.652+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~NSHE8AD01JBS.1 size=1048576 2024-09-12T00:28:04.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.652+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~NSHE8AD01JBS.2 size=566078 2024-09-12T00:28:04.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.652+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=NSHE8AD01JBS tag=16LIU164EVCY type=write size=3711806 2024-09-12T00:28:04.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.656+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=NVKZ6TR14K7X type=del 2024-09-12T00:28:04.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.664+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~ISMFRY9HMZ1K.0 size=609653 2024-09-12T00:28:04.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.664+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=ISMFRY9HMZ1K tag=L5JOB0PRDP5J type=write size=1658229 2024-09-12T00:28:04.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.668+0000 7f712938c8c0 1 < completed delete operation key=HPM9GFRASWIV tag=JEP5SZRBK4WV type=del 2024-09-12T00:28:04.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.672+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=MG0XIEOYGZ7J type=del size=2660045 2024-09-12T00:28:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.680+0000 7f712938c8c0 1 < suggested remove operation key=W9YW6AS1RL48 tag=GRACB4HSC8EU type=del 2024-09-12T00:28:04.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.684+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~4L5O49J07SUW.0 size=1048576 2024-09-12T00:28:04.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.688+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~4L5O49J07SUW.1 size=1048576 2024-09-12T00:28:04.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.692+0000 7f712938c8c0 1 > prepared part key=_multipart_0QZKHZTVP3RQ.2~4L5O49J07SUW.2 size=265522 2024-09-12T00:28:04.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.692+0000 7f712938c8c0 1 > prepared multipart upload key=0QZKHZTVP3RQ upload=4L5O49J07SUW tag=897JT5NPSX56 type=write size=3411250 2024-09-12T00:28:04.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.696+0000 7f712938c8c0 1 < completed write operation key=MUNSUH4BMZNP tag=TESXMWPCKUC1 type=write size=117413 2024-09-12T00:28:04.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.700+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=IALWMCLRI7PF type=del size=2866281 2024-09-12T00:28:04.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.704+0000 7f712938c8c0 1 < canceled operation key=ULE6S9Y6DS62 tag=HMG3DT49RAEQ type=del size=65466 2024-09-12T00:28:04.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.712+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~SBPJ1S3EJGJD.0 size=1048576 2024-09-12T00:28:04.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.712+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~SBPJ1S3EJGJD.1 size=1048576 2024-09-12T00:28:04.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.716+0000 7f712938c8c0 1 > prepared part key=_multipart_N69XPNN6Y6HZ.2~SBPJ1S3EJGJD.2 size=172047 2024-09-12T00:28:04.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.716+0000 7f712938c8c0 1 > prepared multipart upload key=N69XPNN6Y6HZ upload=SBPJ1S3EJGJD tag=8R2MMFLKW4I7 type=write size=3317775 2024-09-12T00:28:04.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.720+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~35RE39UERDKI.0 size=1048576 2024-09-12T00:28:04.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.720+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~35RE39UERDKI.1 size=1048576 2024-09-12T00:28:04.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.724+0000 7f712938c8c0 1 < completed part key=_multipart_W9YW6AS1RL48.2~35RE39UERDKI.2 size=196422 2024-09-12T00:28:04.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.732+0000 7f712938c8c0 1 < completed multipart upload key=W9YW6AS1RL48 upload=35RE39UERDKI tag=47CMR02C64O4 type=write size=3342150 2024-09-12T00:28:04.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.740+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~IRLDJ1AWBFD2.0 size=1048576 2024-09-12T00:28:04.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.740+0000 7f712938c8c0 1 > prepared part key=_multipart_ULE6S9Y6DS62.2~IRLDJ1AWBFD2.1 size=391708 2024-09-12T00:28:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.740+0000 7f712938c8c0 1 > prepared multipart upload key=ULE6S9Y6DS62 upload=IRLDJ1AWBFD2 tag=U319L8V72GWK type=write size=2488860 2024-09-12T00:28:04.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.748+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=C8J853C74GPU type=del 2024-09-12T00:28:04.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.752+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~K7Z8CMGTPRNC.0 size=662679 2024-09-12T00:28:04.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.752+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=K7Z8CMGTPRNC tag=NCSXGKAU4OK9 type=write size=1711255 2024-09-12T00:28:04.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.756+0000 7f712938c8c0 1 < completed delete operation key=0QZKHZTVP3RQ tag=TU5MH6ZM2F59 type=del 2024-09-12T00:28:04.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.764+0000 7f712938c8c0 1 > prepared operation key=7X45VJAQO7PF tag=LTK9OZNM2CU9 type=del size=3755694 2024-09-12T00:28:04.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.764+0000 7f712938c8c0 1 < canceled operation key=QG0W04PRTQNP tag=ZB9TAJM02JMI type=del size=2690184 2024-09-12T00:28:04.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.772+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=Y1XLPC02TITL type=del size=2397779 2024-09-12T00:28:04.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.776+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=XSIHCZJ80J1Q type=del 2024-09-12T00:28:04.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.780+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=ZN6HSF5S0PJ3 type=del size=3837144 2024-09-12T00:28:04.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.784+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=QSK9NY3N9CR3 type=del 2024-09-12T00:28:04.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.788+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=DD0AR28UU0QJ type=del size=2579947 2024-09-12T00:28:04.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.796+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=57V8FQAM3U5S type=del 2024-09-12T00:28:04.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.800+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=TEATBB3RA7J7 type=del size=1492170 2024-09-12T00:28:04.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.804+0000 7f712938c8c0 1 < completed write operation key=V9K2307BGOKP tag=UER5OC4RYZ16 type=write size=799476 2024-09-12T00:28:04.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.808+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=ZLQXQ5W7AUIP type=del size=2626446 2024-09-12T00:28:04.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.812+0000 7f712938c8c0 1 < completed part key=_multipart_QL3FL4J9TKY4.2~BVZVOSH054HC.0 size=641538 2024-09-12T00:28:04.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.816+0000 7f712938c8c0 1 < completed multipart upload key=QL3FL4J9TKY4 upload=BVZVOSH054HC tag=M3J8R8VGNAG8 type=write size=1690114 2024-09-12T00:28:04.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.820+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=6E8KHFWS047T type=del size=780768 2024-09-12T00:28:04.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.824+0000 7f712938c8c0 1 < completed part key=_multipart_HPM9GFRASWIV.2~4WY0D8YCQIF7.0 size=659039 2024-09-12T00:28:04.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.828+0000 7f712938c8c0 1 < completed multipart upload key=HPM9GFRASWIV upload=4WY0D8YCQIF7 tag=F0SXVO6ZDWVE type=write size=1707615 2024-09-12T00:28:04.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.832+0000 7f712938c8c0 1 > prepared operation key=0QZKHZTVP3RQ tag=PYHDFEFJ2ZY1 type=write size=874145 2024-09-12T00:28:04.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.836+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~NSHE8AD01JBS.0 size=1048576 2024-09-12T00:28:04.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.840+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~NSHE8AD01JBS.1 size=1048576 2024-09-12T00:28:04.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.840+0000 7f712938c8c0 1 < canceled part key=_multipart_9N3U208FGM79.2~NSHE8AD01JBS.2 size=566078 2024-09-12T00:28:04.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.844+0000 7f712938c8c0 1 < canceled multipart upload key=9N3U208FGM79 upload=NSHE8AD01JBS tag=16LIU164EVCY type=write size=3711806 2024-09-12T00:28:04.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.852+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~3N29QXTMJKZX.0 size=1048576 2024-09-12T00:28:04.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.852+0000 7f712938c8c0 1 > prepared part key=_multipart_VAFU5FXA2KLC.2~3N29QXTMJKZX.1 size=723552 2024-09-12T00:28:04.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.852+0000 7f712938c8c0 1 > prepared multipart upload key=VAFU5FXA2KLC upload=3N29QXTMJKZX tag=ENWH47FN74C3 type=write size=2820704 2024-09-12T00:28:04.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.856+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~ISMFRY9HMZ1K.0 size=609653 2024-09-12T00:28:04.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.864+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=ISMFRY9HMZ1K tag=L5JOB0PRDP5J type=write size=1658229 2024-09-12T00:28:04.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.864+0000 7f712938c8c0 1 > prepared operation key=KNGB14TWW6XC tag=4IP67AH788HD type=write size=756017 2024-09-12T00:28:04.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.868+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=MG0XIEOYGZ7J type=del 2024-09-12T00:28:04.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.876+0000 7f712938c8c0 1 > prepared part key=_multipart_GZON46MODQZO.2~QW3526LY8015.0 size=319904 2024-09-12T00:28:04.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.876+0000 7f712938c8c0 1 > prepared multipart upload key=GZON46MODQZO upload=QW3526LY8015 tag=QW4C8VI38RZX type=write size=1368480 2024-09-12T00:28:04.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.880+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~4L5O49J07SUW.0 size=1048576 2024-09-12T00:28:04.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.884+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~4L5O49J07SUW.1 size=1048576 2024-09-12T00:28:04.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.884+0000 7f712938c8c0 1 < completed part key=_multipart_0QZKHZTVP3RQ.2~4L5O49J07SUW.2 size=265522 2024-09-12T00:28:04.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.892+0000 7f712938c8c0 1 < completed multipart upload key=0QZKHZTVP3RQ upload=4L5O49J07SUW tag=897JT5NPSX56 type=write size=3411250 2024-09-12T00:28:04.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.896+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=00W9JVY7PL3H type=del size=2276 2024-09-12T00:28:04.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.904+0000 7f712938c8c0 1 < suggested update operation key=V9K2307BGOKP tag=IALWMCLRI7PF type=del size=2866281 2024-09-12T00:28:04.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.912+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~0YS841MZGRUX.0 size=47254 2024-09-12T00:28:04.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.912+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=0YS841MZGRUX tag=GTA204CYGKDV type=write size=1095830 2024-09-12T00:28:04.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.916+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~SBPJ1S3EJGJD.0 size=1048576 2024-09-12T00:28:04.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.920+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~SBPJ1S3EJGJD.1 size=1048576 2024-09-12T00:28:04.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.920+0000 7f712938c8c0 1 < completed part key=_multipart_N69XPNN6Y6HZ.2~SBPJ1S3EJGJD.2 size=172047 2024-09-12T00:28:04.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.928+0000 7f712938c8c0 1 < completed multipart upload key=N69XPNN6Y6HZ upload=SBPJ1S3EJGJD tag=8R2MMFLKW4I7 type=write size=3317775 2024-09-12T00:28:04.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.932+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~K2XS42L7VE64.0 size=432486 2024-09-12T00:28:04.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.932+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=K2XS42L7VE64 tag=1E13B0B5805K type=write size=1481062 2024-09-12T00:28:04.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.936+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~IRLDJ1AWBFD2.0 size=1048576 2024-09-12T00:28:04.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.940+0000 7f712938c8c0 1 < completed part key=_multipart_ULE6S9Y6DS62.2~IRLDJ1AWBFD2.1 size=391708 2024-09-12T00:28:04.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.944+0000 7f712938c8c0 1 < completed multipart upload key=ULE6S9Y6DS62 upload=IRLDJ1AWBFD2 tag=U319L8V72GWK type=write size=2488860 2024-09-12T00:28:04.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.952+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=JXLAGLOLRP56 type=del size=1152470 2024-09-12T00:28:04.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.952+0000 7f712938c8c0 1 < canceled part key=_multipart_ZP88X00LMVSS.2~K7Z8CMGTPRNC.0 size=662679 2024-09-12T00:28:04.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.956+0000 7f712938c8c0 1 < canceled multipart upload key=ZP88X00LMVSS upload=K7Z8CMGTPRNC tag=NCSXGKAU4OK9 type=write size=1711255 2024-09-12T00:28:04.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.960+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=RHS3H4F1FG0A type=del size=2823703 2024-09-12T00:28:04.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.964+0000 7f712938c8c0 1 < completed delete operation key=7X45VJAQO7PF tag=LTK9OZNM2CU9 type=del 2024-09-12T00:28:04.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.968+0000 7f712938c8c0 1 > prepared operation key=Z2RYL03II71Z tag=46Q1Y3NCBNCR type=write size=43719 2024-09-12T00:28:04.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.972+0000 7f712938c8c0 1 < completed delete operation key=KNGB14TWW6XC tag=Y1XLPC02TITL type=del 2024-09-12T00:28:04.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.980+0000 7f712938c8c0 1 > prepared part key=_multipart_KEMQ3H8LAUI9.2~P9KZBGGA2RA3.0 size=471068 2024-09-12T00:28:04.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.980+0000 7f712938c8c0 1 > prepared multipart upload key=KEMQ3H8LAUI9 upload=P9KZBGGA2RA3 tag=2UXDVQ40P600 type=write size=1519644 2024-09-12T00:28:04.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.984+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=ZN6HSF5S0PJ3 type=del 2024-09-12T00:28:04.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.988+0000 7f712938c8c0 1 > prepared operation key=T0C4ZDQB13X0 tag=37XGW61R9X78 type=del size=2371082 2024-09-12T00:28:04.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.992+0000 7f712938c8c0 1 < completed delete operation key=MUNSUH4BMZNP tag=DD0AR28UU0QJ type=del 2024-09-12T00:28:04.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:04.996+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=9JGRMCALK7BZ type=del size=3036691 2024-09-12T00:28:04.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.000+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=TEATBB3RA7J7 type=del 2024-09-12T00:28:05.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.004+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=BXRSJY78W5PQ type=del size=3876217 2024-09-12T00:28:05.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.008+0000 7f712938c8c0 1 < canceled operation key=ZP88X00LMVSS tag=ZLQXQ5W7AUIP type=del size=2626446 2024-09-12T00:28:05.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.012+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=7JKZAN2UAAMW type=del size=2932419 2024-09-12T00:28:05.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.016+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=6E8KHFWS047T type=del 2024-09-12T00:28:05.019 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.020+0000 7f712938c8c0 1 > prepared operation key=V9K2307BGOKP tag=SJ7J3I3K05VF type=del size=2033857 2024-09-12T00:28:05.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.024+0000 7f712938c8c0 1 < completed write operation key=0QZKHZTVP3RQ tag=PYHDFEFJ2ZY1 type=write size=874145 2024-09-12T00:28:05.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.028+0000 7f712938c8c0 1 > prepared operation key=9N3U208FGM79 tag=LQX6BIZ8UOMM type=write size=88298 2024-09-12T00:28:05.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.032+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~3N29QXTMJKZX.0 size=1048576 2024-09-12T00:28:05.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.032+0000 7f712938c8c0 1 < completed part key=_multipart_VAFU5FXA2KLC.2~3N29QXTMJKZX.1 size=723552 2024-09-12T00:28:05.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.040+0000 7f712938c8c0 1 < completed multipart upload key=VAFU5FXA2KLC upload=3N29QXTMJKZX tag=ENWH47FN74C3 type=write size=2820704 2024-09-12T00:28:05.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.044+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=U569618V2Z45 type=write size=279148 2024-09-12T00:28:05.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.048+0000 7f712938c8c0 1 < completed write operation key=KNGB14TWW6XC tag=4IP67AH788HD type=write size=756017 2024-09-12T00:28:05.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.052+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=W52JYGCSVOZB type=del size=2362153 2024-09-12T00:28:05.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.056+0000 7f712938c8c0 1 < completed part key=_multipart_GZON46MODQZO.2~QW3526LY8015.0 size=319904 2024-09-12T00:28:05.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.064+0000 7f712938c8c0 1 < completed multipart upload key=GZON46MODQZO upload=QW3526LY8015 tag=QW4C8VI38RZX type=write size=1368480 2024-09-12T00:28:05.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.068+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~X3HD90RESDUW.0 size=1048576 2024-09-12T00:28:05.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.072+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~X3HD90RESDUW.1 size=1048576 2024-09-12T00:28:05.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.076+0000 7f712938c8c0 1 > prepared part key=_multipart_F7T79C7MZX35.2~X3HD90RESDUW.2 size=830975 2024-09-12T00:28:05.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.076+0000 7f712938c8c0 1 > prepared multipart upload key=F7T79C7MZX35 upload=X3HD90RESDUW tag=0OIAGQJ35Z8V type=write size=3976703 2024-09-12T00:28:05.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.080+0000 7f712938c8c0 1 < completed delete operation key=04RL082VPLIM tag=00W9JVY7PL3H type=del 2024-09-12T00:28:05.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.088+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~322G210R37HP.0 size=1048576 2024-09-12T00:28:05.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.088+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~322G210R37HP.1 size=1048576 2024-09-12T00:28:05.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.092+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~322G210R37HP.2 size=901 2024-09-12T00:28:05.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.092+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=322G210R37HP tag=O4ED69R932H3 type=write size=3146629 2024-09-12T00:28:05.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.096+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~0YS841MZGRUX.0 size=47254 2024-09-12T00:28:05.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.104+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=0YS841MZGRUX tag=GTA204CYGKDV type=write size=1095830 2024-09-12T00:28:05.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.108+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=V0D4NY4HYTXR type=del size=1980491 2024-09-12T00:28:05.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.112+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~K2XS42L7VE64.0 size=432486 2024-09-12T00:28:05.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.116+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=K2XS42L7VE64 tag=1E13B0B5805K type=write size=1481062 2024-09-12T00:28:05.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.120+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=OU3I8WWA9TDF type=del size=3020095 2024-09-12T00:28:05.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.128+0000 7f712938c8c0 1 < suggested update operation key=W01PFMFNYLED tag=JXLAGLOLRP56 type=del size=1152470 2024-09-12T00:28:05.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.136+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~UNOB3O57JBK0.0 size=1048576 2024-09-12T00:28:05.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.140+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~UNOB3O57JBK0.1 size=1048576 2024-09-12T00:28:05.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.148+0000 7f712938c8c0 1 > prepared part key=_multipart_BH2YHXHVEZCH.2~UNOB3O57JBK0.2 size=573257 2024-09-12T00:28:05.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.148+0000 7f712938c8c0 1 > prepared multipart upload key=BH2YHXHVEZCH upload=UNOB3O57JBK0 tag=QZ213OPALK1G type=write size=3718985 2024-09-12T00:28:05.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.156+0000 7f712938c8c0 1 < suggested remove operation key=T1H3O6A6HBQH tag=RHS3H4F1FG0A type=del 2024-09-12T00:28:05.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.160+0000 7f712938c8c0 1 > prepared operation key=9HX9GER6OKVI tag=7QZH1N0HDL2S type=del size=2832421 2024-09-12T00:28:05.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.164+0000 7f712938c8c0 1 < completed write operation key=Z2RYL03II71Z tag=46Q1Y3NCBNCR type=write size=43719 2024-09-12T00:28:05.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.168+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=DCQ5QUMXUBH6 type=del size=1524927 2024-09-12T00:28:05.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.172+0000 7f712938c8c0 1 < completed part key=_multipart_KEMQ3H8LAUI9.2~P9KZBGGA2RA3.0 size=471068 2024-09-12T00:28:05.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.176+0000 7f712938c8c0 1 < completed multipart upload key=KEMQ3H8LAUI9 upload=P9KZBGGA2RA3 tag=2UXDVQ40P600 type=write size=1519644 2024-09-12T00:28:05.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.184+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~2I3LEA0NEHTY.0 size=1048576 2024-09-12T00:28:05.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.188+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~2I3LEA0NEHTY.1 size=1048576 2024-09-12T00:28:05.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.188+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~2I3LEA0NEHTY.2 size=938068 2024-09-12T00:28:05.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.188+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=2I3LEA0NEHTY tag=B8IA2HVU0Z92 type=write size=4083796 2024-09-12T00:28:05.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.196+0000 7f712938c8c0 1 < suggested remove operation key=T0C4ZDQB13X0 tag=37XGW61R9X78 type=del 2024-09-12T00:28:05.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.200+0000 7f712938c8c0 1 > prepared operation key=T1H3O6A6HBQH tag=0OO3PSWQQ4XL type=del size=1476666 2024-09-12T00:28:05.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.204+0000 7f712938c8c0 1 < completed delete operation key=L2SR6IAW0D38 tag=9JGRMCALK7BZ type=del 2024-09-12T00:28:05.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.208+0000 7f712938c8c0 1 > prepared operation key=GZON46MODQZO tag=OYIGJHVDAR5C type=del size=249550 2024-09-12T00:28:05.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.212+0000 7f712938c8c0 1 < canceled operation key=9N3U208FGM79 tag=BXRSJY78W5PQ type=del size=3876217 2024-09-12T00:28:05.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.216+0000 7f712938c8c0 1 > prepared operation key=L2SR6IAW0D38 tag=GE0KVWWSQFCM type=del size=1718458 2024-09-12T00:28:05.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.220+0000 7f712938c8c0 1 < completed delete operation key=ULE6S9Y6DS62 tag=7JKZAN2UAAMW type=del 2024-09-12T00:28:05.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.224+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=0BRFZUO42NXI type=del size=818179 2024-09-12T00:28:05.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.232+0000 7f712938c8c0 1 < suggested update operation key=V9K2307BGOKP tag=SJ7J3I3K05VF type=del size=2033857 2024-09-12T00:28:05.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.236+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=JYLB648FJC8H type=del size=3689351 2024-09-12T00:28:05.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.240+0000 7f712938c8c0 1 < completed write operation key=9N3U208FGM79 tag=LQX6BIZ8UOMM type=write size=88298 2024-09-12T00:28:05.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.248+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~M0OXG2QJ7D1R.0 size=1048576 2024-09-12T00:28:05.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.252+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~M0OXG2QJ7D1R.1 size=8207 2024-09-12T00:28:05.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.252+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=M0OXG2QJ7D1R tag=OOA3V7C93Z0S type=write size=2105359 2024-09-12T00:28:05.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.256+0000 7f712938c8c0 1 < completed write operation key=GZON46MODQZO tag=U569618V2Z45 type=write size=279148 2024-09-12T00:28:05.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.260+0000 7f712938c8c0 1 > prepared operation key=9YZP0TIRWWRF tag=6BPDFWRPYN2U type=del size=3810720 2024-09-12T00:28:05.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.268+0000 7f712938c8c0 1 < suggested update operation key=9HX9GER6OKVI tag=W52JYGCSVOZB type=del size=2362153 2024-09-12T00:28:05.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.276+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~9A4KIQ44LU0G.0 size=481152 2024-09-12T00:28:05.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.276+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=9A4KIQ44LU0G tag=L6HIW4NZ75AN type=write size=1529728 2024-09-12T00:28:05.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.280+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~X3HD90RESDUW.0 size=1048576 2024-09-12T00:28:05.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.284+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~X3HD90RESDUW.1 size=1048576 2024-09-12T00:28:05.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.284+0000 7f712938c8c0 1 < completed part key=_multipart_F7T79C7MZX35.2~X3HD90RESDUW.2 size=830975 2024-09-12T00:28:05.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.292+0000 7f712938c8c0 1 < completed multipart upload key=F7T79C7MZX35 upload=X3HD90RESDUW tag=0OIAGQJ35Z8V type=write size=3976703 2024-09-12T00:28:05.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.296+0000 7f712938c8c0 1 > prepared operation key=QG0W04PRTQNP tag=JBCVXQLOVDHA type=del size=1500856 2024-09-12T00:28:05.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.300+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~322G210R37HP.0 size=1048576 2024-09-12T00:28:05.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.304+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~322G210R37HP.1 size=1048576 2024-09-12T00:28:05.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.308+0000 7f712938c8c0 1 < completed part key=_multipart_UAJEZUYXN2R0.2~322G210R37HP.2 size=901 2024-09-12T00:28:05.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.316+0000 7f712938c8c0 1 < completed multipart upload key=UAJEZUYXN2R0 upload=322G210R37HP tag=O4ED69R932H3 type=write size=3146629 2024-09-12T00:28:05.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.320+0000 7f712938c8c0 1 > prepared operation key=MUNSUH4BMZNP tag=967JRPO8R8KW type=write size=602200 2024-09-12T00:28:05.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.324+0000 7f712938c8c0 1 < completed delete operation key=ZP88X00LMVSS tag=V0D4NY4HYTXR type=del 2024-09-12T00:28:05.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.328+0000 7f712938c8c0 1 > prepared operation key=5KVIIZS50CNT tag=FMX1N1472ZU4 type=del size=1488847 2024-09-12T00:28:05.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.332+0000 7f712938c8c0 1 < completed delete operation key=9751RNPPQJBO tag=OU3I8WWA9TDF type=del 2024-09-12T00:28:05.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.336+0000 7f712938c8c0 1 > prepared part key=_multipart_QG0W04PRTQNP.2~C2U1QI9D7BRS.0 size=692869 2024-09-12T00:28:05.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.336+0000 7f712938c8c0 1 > prepared multipart upload key=QG0W04PRTQNP upload=C2U1QI9D7BRS tag=CKI242YADRKQ type=write size=1741445 2024-09-12T00:28:05.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.344+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~UNOB3O57JBK0.0 size=1048576 2024-09-12T00:28:05.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.344+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~UNOB3O57JBK0.1 size=1048576 2024-09-12T00:28:05.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.348+0000 7f712938c8c0 1 < completed part key=_multipart_BH2YHXHVEZCH.2~UNOB3O57JBK0.2 size=573257 2024-09-12T00:28:05.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.356+0000 7f712938c8c0 1 < completed multipart upload key=BH2YHXHVEZCH upload=UNOB3O57JBK0 tag=QZ213OPALK1G type=write size=3718985 2024-09-12T00:28:05.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.360+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~LNZSWH6WC9KW.0 size=1048576 2024-09-12T00:28:05.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.364+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~LNZSWH6WC9KW.1 size=1048576 2024-09-12T00:28:05.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.368+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~LNZSWH6WC9KW.2 size=90308 2024-09-12T00:28:05.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.368+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=LNZSWH6WC9KW tag=GIQ7Y5PT95NQ type=write size=3236036 2024-09-12T00:28:05.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.372+0000 7f712938c8c0 -1 < failed to complete operation key=9HX9GER6OKVI tag=7QZH1N0HDL2S type=del size=2832421: (22) Invalid argument 2024-09-12T00:28:05.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.376+0000 7f712938c8c0 1 > prepared operation key=W01PFMFNYLED tag=0C1A3LHH2TZO type=del size=1941345 2024-09-12T00:28:05.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.380+0000 7f712938c8c0 1 < completed delete operation key=QG0W04PRTQNP tag=DCQ5QUMXUBH6 type=del 2024-09-12T00:28:05.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.384+0000 7f712938c8c0 1 > prepared operation key=W9YW6AS1RL48 tag=T4ALOM91NVIT type=del size=1048763 2024-09-12T00:28:05.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.388+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~2I3LEA0NEHTY.0 size=1048576 2024-09-12T00:28:05.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.388+0000 7f712938c8c0 1 < completed part key=_multipart_7X45VJAQO7PF.2~2I3LEA0NEHTY.1 size=1048576 2024-09-12T00:28:05.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.388+0000 7f712938c8c0 1 < canceled part key=_multipart_7X45VJAQO7PF.2~2I3LEA0NEHTY.2 size=938068 2024-09-12T00:28:05.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.400+0000 7f712938c8c0 1 < canceled multipart upload key=7X45VJAQO7PF upload=2I3LEA0NEHTY tag=B8IA2HVU0Z92 type=write size=4083796 2024-09-12T00:28:05.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.400+0000 7f712938c8c0 1 > prepared operation key=VAFU5FXA2KLC tag=NHZJYKAELI5K type=del size=1748009 2024-09-12T00:28:05.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.404+0000 7f712938c8c0 1 < completed delete operation key=T1H3O6A6HBQH tag=0OO3PSWQQ4XL type=del 2024-09-12T00:28:05.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.408+0000 7f712938c8c0 1 > prepared operation key=N69XPNN6Y6HZ tag=YZ2AEG95XL71 type=del size=2500349 2024-09-12T00:28:05.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.412+0000 7f712938c8c0 1 < completed delete operation key=GZON46MODQZO tag=OYIGJHVDAR5C type=del 2024-09-12T00:28:05.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.420+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~40TD2M1B9DRZ.0 size=910803 2024-09-12T00:28:05.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.420+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=40TD2M1B9DRZ tag=31INDGF2GY39 type=write size=1959379 2024-09-12T00:28:05.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.424+0000 7f712938c8c0 1 < canceled operation key=L2SR6IAW0D38 tag=GE0KVWWSQFCM type=del size=1718458 2024-09-12T00:28:05.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.432+0000 7f712938c8c0 1 > prepared part key=_multipart_9N3U208FGM79.2~FCCBICHH7318.0 size=930526 2024-09-12T00:28:05.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.432+0000 7f712938c8c0 1 > prepared multipart upload key=9N3U208FGM79 upload=FCCBICHH7318 tag=5CQ1JI2SQF4F type=write size=1979102 2024-09-12T00:28:05.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.436+0000 7f712938c8c0 1 < completed delete operation key=QL3FL4J9TKY4 tag=0BRFZUO42NXI type=del 2024-09-12T00:28:05.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.444+0000 7f712938c8c0 1 > prepared operation key=ULE6S9Y6DS62 tag=VE3Y67QPBA7Q type=write size=281378 2024-09-12T00:28:05.447 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.448+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=JYLB648FJC8H type=del 2024-09-12T00:28:05.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.456+0000 7f712938c8c0 1 > prepared part key=_multipart_T0C4ZDQB13X0.2~4NTCW3ACVYS9.0 size=329786 2024-09-12T00:28:05.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.456+0000 7f712938c8c0 1 > prepared multipart upload key=T0C4ZDQB13X0 upload=4NTCW3ACVYS9 tag=F1W5EMH2THDR type=write size=1378362 2024-09-12T00:28:05.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.460+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~M0OXG2QJ7D1R.0 size=1048576 2024-09-12T00:28:05.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.460+0000 7f712938c8c0 1 < completed part key=_multipart_ZP88X00LMVSS.2~M0OXG2QJ7D1R.1 size=8207 2024-09-12T00:28:05.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.468+0000 7f712938c8c0 1 < completed multipart upload key=ZP88X00LMVSS upload=M0OXG2QJ7D1R tag=OOA3V7C93Z0S type=write size=2105359 2024-09-12T00:28:05.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.472+0000 7f712938c8c0 1 > prepared operation key=QL3FL4J9TKY4 tag=YZT2XY64V71P type=del size=3343955 2024-09-12T00:28:05.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.476+0000 7f712938c8c0 1 < completed delete operation key=9YZP0TIRWWRF tag=6BPDFWRPYN2U type=del 2024-09-12T00:28:05.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.480+0000 7f712938c8c0 1 > prepared part key=_multipart_V9K2307BGOKP.2~VHTSUODTXBCM.0 size=20463 2024-09-12T00:28:05.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.480+0000 7f712938c8c0 1 > prepared multipart upload key=V9K2307BGOKP upload=VHTSUODTXBCM tag=28OBT885W04P type=write size=1069039 2024-09-12T00:28:05.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.484+0000 7f712938c8c0 1 < completed part key=_multipart_9N3U208FGM79.2~9A4KIQ44LU0G.0 size=481152 2024-09-12T00:28:05.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.492+0000 7f712938c8c0 1 < completed multipart upload key=9N3U208FGM79 upload=9A4KIQ44LU0G tag=L6HIW4NZ75AN type=write size=1529728 2024-09-12T00:28:05.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.496+0000 7f712938c8c0 1 > prepared operation key=HPM9GFRASWIV tag=B8N6KCATNM0B type=write size=733943 2024-09-12T00:28:05.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.504+0000 7f712938c8c0 1 < suggested remove operation key=QG0W04PRTQNP tag=JBCVXQLOVDHA type=del 2024-09-12T00:28:05.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.512+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~SBMUZ3TODN89.0 size=1048576 2024-09-12T00:28:05.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.516+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~SBMUZ3TODN89.1 size=1048576 2024-09-12T00:28:05.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.520+0000 7f712938c8c0 1 > prepared part key=_multipart_7X45VJAQO7PF.2~SBMUZ3TODN89.2 size=535759 2024-09-12T00:28:05.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.520+0000 7f712938c8c0 1 > prepared multipart upload key=7X45VJAQO7PF upload=SBMUZ3TODN89 tag=WYT24B6317UT type=write size=3681487 2024-09-12T00:28:05.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.532+0000 7f712938c8c0 1 < suggested remove operation key=MUNSUH4BMZNP tag=967JRPO8R8KW type=write 2024-09-12T00:28:05.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.536+0000 7f712938c8c0 1 > prepared operation key=ZP88X00LMVSS tag=66GKDD8F43P2 type=del size=2394976 2024-09-12T00:28:05.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.540+0000 7f712938c8c0 1 < suggested update operation key=5KVIIZS50CNT tag=FMX1N1472ZU4 type=del size=1488847 2024-09-12T00:28:05.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.544+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=JPOUY7VS3C96 type=del size=22871 2024-09-12T00:28:05.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.548+0000 7f712938c8c0 1 < completed part key=_multipart_QG0W04PRTQNP.2~C2U1QI9D7BRS.0 size=692869 2024-09-12T00:28:05.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.556+0000 7f712938c8c0 1 < completed multipart upload key=QG0W04PRTQNP upload=C2U1QI9D7BRS tag=CKI242YADRKQ type=write size=1741445 2024-09-12T00:28:05.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.556+0000 7f712938c8c0 1 > prepared operation key=BH2YHXHVEZCH tag=YUZI7O122X14 type=del size=481604 2024-09-12T00:28:05.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.560+0000 7f712938c8c0 1 < canceled part key=_multipart_V9K2307BGOKP.2~LNZSWH6WC9KW.0 size=1048576 2024-09-12T00:28:05.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.560+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~LNZSWH6WC9KW.1 size=1048576 2024-09-12T00:28:05.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.564+0000 7f712938c8c0 1 < completed part key=_multipart_V9K2307BGOKP.2~LNZSWH6WC9KW.2 size=90308 2024-09-12T00:28:05.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.568+0000 7f712938c8c0 1 < canceled multipart upload key=V9K2307BGOKP upload=LNZSWH6WC9KW tag=GIQ7Y5PT95NQ type=write size=3236036 2024-09-12T00:28:05.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.572+0000 7f712938c8c0 1 > prepared operation key=04RL082VPLIM tag=0A59HGFYZB4K type=write size=725980 2024-09-12T00:28:05.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.576+0000 7f712938c8c0 1 < completed delete operation key=W01PFMFNYLED tag=0C1A3LHH2TZO type=del 2024-09-12T00:28:05.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.580+0000 7f712938c8c0 1 > prepared operation key=9751RNPPQJBO tag=2FYSNLO6GJFO type=del size=3130563 2024-09-12T00:28:05.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.580+0000 7f712938c8c0 1 < completed delete operation key=W9YW6AS1RL48 tag=T4ALOM91NVIT type=del 2024-09-12T00:28:05.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.588+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~49AP63EK95ED.0 size=29449 2024-09-12T00:28:05.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.588+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=49AP63EK95ED tag=DYITNMLTOHZM type=write size=1078025 2024-09-12T00:28:05.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.592+0000 7f712938c8c0 1 < completed delete operation key=VAFU5FXA2KLC tag=NHZJYKAELI5K type=del 2024-09-12T00:28:05.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.596+0000 7f712938c8c0 1 > prepared operation key=WP4RJQVZVEE2 tag=V8MRE2OIBMPD type=del size=575713 2024-09-12T00:28:05.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.600+0000 7f712938c8c0 1 < completed delete operation key=N69XPNN6Y6HZ tag=YZ2AEG95XL71 type=del 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.608+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~ADFAGJPFLYVL.0 size=1048576 2024-09-12T00:28:05.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.608+0000 7f712938c8c0 1 > prepared part key=_multipart_ZP88X00LMVSS.2~ADFAGJPFLYVL.1 size=266852 2024-09-12T00:28:05.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.608+0000 7f712938c8c0 1 > prepared multipart upload key=ZP88X00LMVSS upload=ADFAGJPFLYVL tag=3T61Y04FEH7U type=write size=2364004 2024-09-12T00:28:05.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.612+0000 7f712938c8c0 1 < completed part key=_multipart_Z2RYL03II71Z.2~40TD2M1B9DRZ.0 size=910803 2024-09-12T00:28:05.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.620+0000 7f712938c8c0 1 < completed multipart upload key=Z2RYL03II71Z upload=40TD2M1B9DRZ tag=31INDGF2GY39 type=write size=1959379 2024-09-12T00:28:05.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.628+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~OID5ZREQRSQI.0 size=1048576 2024-09-12T00:28:05.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.632+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~OID5ZREQRSQI.1 size=1048576 2024-09-12T00:28:05.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.632+0000 7f712938c8c0 1 > prepared part key=_multipart_Z2RYL03II71Z.2~OID5ZREQRSQI.2 size=901279 2024-09-12T00:28:05.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.632+0000 7f712938c8c0 1 > prepared multipart upload key=Z2RYL03II71Z upload=OID5ZREQRSQI tag=QB31H7QHVYVD type=write size=4047007 2024-09-12T00:28:05.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.636+0000 7f712938c8c0 1 < canceled part key=_multipart_9N3U208FGM79.2~FCCBICHH7318.0 size=930526 2024-09-12T00:28:05.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.640+0000 7f712938c8c0 1 < canceled multipart upload key=9N3U208FGM79 upload=FCCBICHH7318 tag=5CQ1JI2SQF4F type=write size=1979102 2024-09-12T00:28:05.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.644+0000 7f712938c8c0 1 > prepared operation key=UAJEZUYXN2R0 tag=SA6A27CZOECF type=write size=794890 2024-09-12T00:28:05.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.648+0000 7f712938c8c0 1 < completed write operation key=ULE6S9Y6DS62 tag=VE3Y67QPBA7Q type=write size=281378 2024-09-12T00:28:05.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.656+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~VAQ0LS4BLUCJ.0 size=1048576 2024-09-12T00:28:05.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.660+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~VAQ0LS4BLUCJ.1 size=1048576 2024-09-12T00:28:05.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.660+0000 7f712938c8c0 1 > prepared part key=_multipart_WP4RJQVZVEE2.2~VAQ0LS4BLUCJ.2 size=261960 2024-09-12T00:28:05.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.660+0000 7f712938c8c0 1 > prepared multipart upload key=WP4RJQVZVEE2 upload=VAQ0LS4BLUCJ tag=J62ROYTULJ94 type=write size=3407688 2024-09-12T00:28:05.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.664+0000 7f712938c8c0 1 < completed part key=_multipart_T0C4ZDQB13X0.2~4NTCW3ACVYS9.0 size=329786 2024-09-12T00:28:05.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.672+0000 7f712938c8c0 1 < completed multipart upload key=T0C4ZDQB13X0 upload=4NTCW3ACVYS9 tag=F1W5EMH2THDR type=write size=1378362 2024-09-12T00:28:05.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.680+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~3DHO1I0D40U5.0 size=1048576 2024-09-12T00:28:05.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.684+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~3DHO1I0D40U5.1 size=1048576 2024-09-12T00:28:05.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.684+0000 7f712938c8c0 1 > prepared part key=_multipart_UAJEZUYXN2R0.2~3DHO1I0D40U5.2 size=798772 2024-09-12T00:28:05.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:28:05.684+0000 7f712938c8c0 1 > prepared multipart upload key=UAJEZUYXN2R0 upload=3DHO1I0D40U5 tag=PUHSL5D7MDPK type=write size=3944500 2024-09-12T00:28:05.686 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] cls_rgw_stats.simulate (27929 ms) 2024-09-12T00:28:05.686 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 1 test from cls_rgw_stats (27929 ms total) 2024-09-12T00:28:05.686 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:28:05.686 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:28:06.689 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 1 test from 1 test suite ran. (30797 ms total) 2024-09-12T00:28:06.689 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 1 test. 2024-09-12T00:28:06.701 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:28:06.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:28:06.759 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:28:06.760 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:28:06.761 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:28:06.824 INFO:tasks.workunit.client.0.smithi137.stdout:Running main() from gmock_main.cc 2024-09-12T00:28:06.824 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:28:06.825 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:28:08.724 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:28:08.724 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:28:08.741 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2024-09-12T00:28:08.741 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:28:08.745 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (5 ms) 2024-09-12T00:28:08.745 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:28:08.749 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (4 ms) 2024-09-12T00:28:08.749 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:28:08.757 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-12T00:28:08.757 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:28:08.766 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_str (10 ms) 2024-09-12T00:28:08.766 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:28:08.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_u64 (15 ms) 2024-09-12T00:28:08.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:28:08.787 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (5 ms) 2024-09-12T00:28:08.787 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:28:08.792 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (5 ms) 2024-09-12T00:28:08.792 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:28:08.799 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (6 ms) 2024-09-12T00:28:08.799 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:28:08.808 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (10 ms) 2024-09-12T00:28:08.809 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:28:08.809 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:28:08.809 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:28:08.810 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T00:28:08.810 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:28:08.820 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (10 ms) 2024-09-12T00:28:08.820 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:28:08.839 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (18 ms) 2024-09-12T00:28:08.839 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:28:08.855 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (16 ms) 2024-09-12T00:28:08.855 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:28:08.870 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (15 ms) 2024-09-12T00:28:08.870 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:28:08.891 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-09-12T00:28:08.891 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:28:08.908 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (17 ms) 2024-09-12T00:28:08.908 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:28:08.913 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (5 ms) 2024-09-12T00:28:08.913 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:28:08.919 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-12T00:28:08.920 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:28:08.921 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T00:28:08.921 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:28:08.921 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T00:28:08.921 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:28:08.940 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (18 ms) 2024-09-12T00:28:08.940 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:28:08.958 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (19 ms) 2024-09-12T00:28:08.959 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:28:08.980 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (21 ms) 2024-09-12T00:28:08.980 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:28:08.999 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (19 ms) 2024-09-12T00:28:08.999 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:28:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-12T00:28:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:28:09.012 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T00:28:09.012 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:28:09.015 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T00:28:09.015 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:28:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T00:28:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:28:09.043 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (26 ms) 2024-09-12T00:28:09.043 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 31 tests from CmpOmap (319 ms total) 2024-09-12T00:28:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:28:09.043 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:28:09.720 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 31 tests from 1 test suite ran. (2896 ms total) 2024-09-12T00:28:09.720 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 31 tests. 2024-09-12T00:28:09.725 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:28:09.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:28:09.779 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:28:09.780 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:28:09.780 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:28:09.844 INFO:tasks.workunit.client.0.smithi137.stdout:Running main() from gmock_main.cc 2024-09-12T00:28:09.844 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:28:09.845 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:28:09.845 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:28:09.845 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:28:12.766 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2921 ms) 2024-09-12T00:28:12.767 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:28:15.803 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3036 ms) 2024-09-12T00:28:15.803 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:28:18.822 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.Reserve (3011 ms) 2024-09-12T00:28:18.822 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:28:21.888 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3073 ms) 2024-09-12T00:28:21.888 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:28:25.949 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.Commit (4062 ms) 2024-09-12T00:28:25.950 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:28:30.014 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.Stats (4059 ms) 2024-09-12T00:28:30.014 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:28:35.084 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (5075 ms) 2024-09-12T00:28:35.085 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:28:38.145 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.Abort (3062 ms) 2024-09-12T00:28:38.146 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:28:41.179 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.ReserveError (3034 ms) 2024-09-12T00:28:41.180 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:28:44.230 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.CommitError (3045 ms) 2024-09-12T00:28:44.230 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:28:47.249 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.AbortError (3024 ms) 2024-09-12T00:28:47.249 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:28:50.309 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3059 ms) 2024-09-12T00:28:50.309 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:28:53.328 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3018 ms) 2024-09-12T00:28:53.329 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:28:56.366 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3031 ms) 2024-09-12T00:28:56.366 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:28:59.416 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3059 ms) 2024-09-12T00:28:59.416 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:29:02.477 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3055 ms) 2024-09-12T00:29:02.477 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:29:05.495 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3024 ms) 2024-09-12T00:29:05.495 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:29:08.545 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.Cleanup (3049 ms) 2024-09-12T00:29:08.545 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:29:23.643 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.MultiProducer (15098 ms) 2024-09-12T00:29:23.643 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:29:28.700 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5057 ms) 2024-09-12T00:29:28.700 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:29:41.695 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12994 ms) 2024-09-12T00:29:41.696 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:29:48.758 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (7062 ms) 2024-09-12T00:29:48.758 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:29:55.705 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6947 ms) 2024-09-12T00:29:55.705 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:30:02.778 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (7075 ms) 2024-09-12T00:30:02.779 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 24 tests from TestCls2PCQueue (112934 ms total) 2024-09-12T00:30:02.779 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:30:02.779 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:02.779 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 24 tests from 1 test suite ran. (112934 ms total) 2024-09-12T00:30:02.779 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 24 tests. 2024-09-12T00:30:02.784 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:02.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:02.839 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:30:02.841 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:30:02.842 DEBUG:teuthology.orchestra.run.smithi137:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:30:02.918 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:02.918 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:02.919 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:30:02.919 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:04.799 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:30:04.799 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:30:04.828 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsAccount.add (29 ms) 2024-09-12T00:30:04.828 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:30:04.839 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsAccount.get (12 ms) 2024-09-12T00:30:04.839 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:30:04.856 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsAccount.rm (16 ms) 2024-09-12T00:30:04.856 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:30:04.891 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] ClsAccount.list (36 ms) 2024-09-12T00:30:04.891 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 4 tests from ClsAccount (93 ms total) 2024-09-12T00:30:04.891 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:30:04.892 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:05.809 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 4 tests from 1 test suite ran. (2890 ms total) 2024-09-12T00:30:05.809 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 4 tests. 2024-09-12T00:30:05.813 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:05.813 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:05.874 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:30:05.877 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:30:05.877 DEBUG:teuthology.orchestra.run.smithi137:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:30:05.951 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:05.951 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:05.951 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:30:05.951 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:07.831 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:30:07.832 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:30:07.858 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] rgw_gc_log.init_existing_queue (26 ms) 2024-09-12T00:30:07.858 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:30:07.868 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] rgw_gc_log.init_existing_omap (10 ms) 2024-09-12T00:30:07.868 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:30:07.897 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (29 ms) 2024-09-12T00:30:07.897 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:30:07.899 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T00:30:07.899 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:30:07.905 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-09-12T00:30:07.906 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:30:07.909 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] rgw_gc_log.defer2_before_init (4 ms) 2024-09-12T00:30:07.909 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 6 tests from rgw_gc_log (78 ms total) 2024-09-12T00:30:07.909 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:30:07.910 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:08.840 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 6 tests from 1 test suite ran. (2890 ms total) 2024-09-12T00:30:08.841 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 6 tests. 2024-09-12T00:30:08.850 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:08.851 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:08.906 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:30:08.908 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:30:08.908 DEBUG:teuthology.orchestra.run.smithi137:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:Running main() from gmock_main.cc 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns= i= 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.979 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns= i= 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns= i= 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "obj1": { 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.980 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "obj2": { 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.981 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3": { 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.983 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3-2": { 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.984 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns=ns i= 2024-09-12T00:30:08.985 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns=ns i= 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns=ns i= 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout: "obj1": { 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.986 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "obj2": { 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.987 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:08.988 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3": { 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.989 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3-2": { 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.990 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:08.991 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns= i=v1 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns= i=v1 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns= i=v1 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout: "obj1": { 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.992 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.993 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "obj2": { 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.994 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3": { 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.995 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3-2": { 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.996 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:08.997 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:30:08.998 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: _obj[v1] 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout: "obj1": { 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:08.999 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.000 INFO:tasks.workunit.client.0.smithi137.stdout: "obj2": { 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.001 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3": { 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.002 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3-2": { 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.003 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_obj", 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.004 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns= i= 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns= i= 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns= i= 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout: "obj1": { 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.005 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.006 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "obj2": { 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.007 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3": { 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.008 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3-2": { 2024-09-12T00:30:09.009 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.010 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns=ns i= 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns=ns i= 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns=ns i= 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.011 INFO:tasks.workunit.client.0.smithi137.stdout: "obj1": { 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.012 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "obj2": { 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.013 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3": { 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.014 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3-2": { 2024-09-12T00:30:09.015 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.016 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns= i=v1 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns= i=v1 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns= i=v1 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.017 INFO:tasks.workunit.client.0.smithi137.stdout: "obj1": { 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.018 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "obj2": { 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.019 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3": { 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.020 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3-2": { 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.021 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.022 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:parsed: obj[v1] 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout: "obj1": { 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.023 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.024 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "obj2": { 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.025 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3": { 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.026 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: "obj3-2": { 2024-09-12T00:30:09.027 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "obj", 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "v1", 2024-09-12T00:30:09.028 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.029 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.030 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.031 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker_myobj", 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.032 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.033 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.033 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.033 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.033 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.033 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.033 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.036 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.037 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.038 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.039 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker_myobj", 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.040 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.041 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.042 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.043 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.044 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.045 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.046 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.047 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.048 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.049 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.050 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.051 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.052 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.054 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.055 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.056 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.057 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.058 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.059 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.060 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:30:09.061 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.062 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.063 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.070 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker___myobj", 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj" 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.071 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.072 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.073 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.074 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker___myobj", 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj" 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.075 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.076 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.077 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.078 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:30:09.079 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.080 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.081 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.082 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.083 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.084 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.085 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.086 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.087 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj" 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.088 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.089 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.090 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.091 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj" 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.096 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.097 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.098 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.103 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker___myobj_", 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj_" 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.107 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.109 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.110 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker___myobj_", 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj_" 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.111 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.113 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.115 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.117 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.119 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.121 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.123 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj_" 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.124 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.126 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.127 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj_" 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.129 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.130 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.131 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": "default-placement.data", 2024-09-12T00:30:09.132 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "test", 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": "", 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.133 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": "" 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.134 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "obj": { 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.135 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.136 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.137 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T00:30:09.138 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker_myobj", 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.139 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.140 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker_myobj", 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.141 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:30:09.144 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.145 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.146 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.147 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.148 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.149 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.150 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.151 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.152 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.153 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "myobj", 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.154 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker___myobj", 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj" 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.155 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.156 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker___myobj", 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj" 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.157 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.158 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.159 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.160 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.161 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.162 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj" 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.163 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.164 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj" 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.165 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.166 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.167 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.168 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.169 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj", 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.170 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker___myobj_", 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj_" 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.171 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.172 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker___myobj_", 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj_" 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.173 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.174 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.175 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.176 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.178 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "", 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj_" 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.179 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.180 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "marker__myobj_" 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.181 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.182 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "" 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj": { 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj": { 2024-09-12T00:30:09.183 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.184 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout: "raw_obj2": { 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": ".data-pool", 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout: "loc": "" 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.185 INFO:tasks.workunit.client.0.smithi137.stdout: "new_obj2": { 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": { 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "ebtest", 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "marker": "marker", 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_id": "bucket-id", 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "tenant": "", 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "explicit_placement": { 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "data_pool": ".data-pool", 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "data_extra_pool": "", 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "index_pool": ".index-pool" 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "key": { 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "_myobj_", 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "instance": "inst", 2024-09-12T00:30:09.186 INFO:tasks.workunit.client.0.smithi137.stdout: "ns": "ns" 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T00:30:09.187 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 4 tests. 2024-09-12T00:30:09.188 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:09.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:09.242 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:30:09.244 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:30:09.244 DEBUG:teuthology.orchestra.run.smithi137:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:30:09.348 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:09.348 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:09.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 realm 2024-09-12T00:30:09.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:09.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:09.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.394+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.398+0000 7fea5dab19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:09.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.398+0000 7fea5dab19c0 20 searching for the correct realm 2024-09-12T00:30:09.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.402+0000 7fea5b5b7640 0 -- 172.21.15.137:0/1066178674 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fea4c0c1020 msgr2=0x7fea4c134aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:09.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.406+0000 7fea5b5b7640 0 -- 172.21.15.137:0/1066178674 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x55bdccfc6a40 msgr2=0x7fea5402e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:09.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:09.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:30:09.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:09.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:30:09.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:09.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:09.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:09.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.626+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:09.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 zone default found 2024-09-12T00:30:09.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 4 Realm: () 2024-09-12T00:30:09.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:30:09.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:30:09.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:09.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 zonegroup default 2024-09-12T00:30:09.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 started sync module instance, tier type = 2024-09-12T00:30:09.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.630+0000 7fea5dab19c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:30:09.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.654+0000 7fea5dab19c0 20 add_watcher() i=0 2024-09-12T00:30:09.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.654+0000 7fea5dab19c0 20 add_watcher() i=1 2024-09-12T00:30:09.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.654+0000 7fea5dab19c0 20 add_watcher() i=2 2024-09-12T00:30:09.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.654+0000 7fea5dab19c0 20 add_watcher() i=3 2024-09-12T00:30:09.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.654+0000 7fea5dab19c0 20 add_watcher() i=4 2024-09-12T00:30:09.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.654+0000 7fea5dab19c0 20 add_watcher() i=5 2024-09-12T00:30:09.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.654+0000 7fea5dab19c0 20 add_watcher() i=6 2024-09-12T00:30:09.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.658+0000 7fea5dab19c0 20 add_watcher() i=7 2024-09-12T00:30:09.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.658+0000 7fea5dab19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:09.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.662+0000 7fe9127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:09.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.662+0000 7fea5dab19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:09.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.662+0000 7fea5dab19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:09.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 5 note: GC not initialized 2024-09-12T00:30:09.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fe9117e2640 20 reqs_thread_entry: start 2024-09-12T00:30:09.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:30:09.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 20 Filter name: none 2024-09-12T00:30:09.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fe90a7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:09.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:30:09.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:30:09.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:30:09.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:30:09.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:30:09.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:30:09.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 cache get: name=default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= : miss 2024-09-12T00:30:09.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 cache put: name=default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= info.flags=0x0 2024-09-12T00:30:09.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 adding default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= to cache LRU end 2024-09-12T00:30:09.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 cache get: name=default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= : hit (negative entry) 2024-09-12T00:30:09.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.666+0000 7fea5dab19c0 10 cache get: name=default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= : hit (negative entry) 2024-09-12T00:30:09.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.670+0000 7fea5dab19c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:30:09.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.670+0000 7fea5dab19c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:30:09.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.670+0000 7fea5dab19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:30:09.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.670+0000 7fe93effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660481 cookie 94273678812688 notifier 5336 bl.length()=697 2024-09-12T00:30:09.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.670+0000 7fe93effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:30:09.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.670+0000 7fe93effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:30:09.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fea5dab19c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:30:09.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fea5dab19c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:30:09.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fea5dab19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:30:09.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fe93effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660480 cookie 94273678807952 notifier 5336 bl.length()=194 2024-09-12T00:30:09.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fe93effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:30:09.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fe93effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:30:09.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fea5dab19c0 10 cache put: name=default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= info.flags=0x7 2024-09-12T00:30:09.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fea5dab19c0 10 moving default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= to cache LRU end 2024-09-12T00:30:09.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fea5dab19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:vQKZBMgQpGQ40C3+5bjFKSZriT4=, ofs0, ns] 2024-09-12T00:30:09.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.674+0000 7fe93effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660481 cookie 94273678807952 notifier 5336 bl.length()=203 2024-09-12T00:30:09.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.678+0000 7fe93effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= info.flags=0x7 2024-09-12T00:30:09.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.678+0000 7fe93effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+vQKZBMgQpGQ40C3+5bjFKSZriT4= to cache LRU end 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "display_name": "librgw test user", 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "email": "librgw@example.com", 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "suspended": 0, 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "subusers": [], 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "keys": [ 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "access_key": "vQKZBMgQpGQ40C3+5bjFKSZriT4=", 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "secret_key": "wh1muJPbr7TKIrDIibYVBya5bTZoAWPDqBOpV0llhW94jLWNhFRp+w==", 2024-09-12T00:30:09.678 INFO:tasks.workunit.client.0.smithi137.stdout: "active": true, 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "create_date": "2024-09-12T00:30:09.673735Z" 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "swift_keys": [], 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "caps": [], 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "default_placement": "", 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "placement_tags": [], 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_quota": { 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": false, 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size": -1, 2024-09-12T00:30:09.679 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "max_objects": -1 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "user_quota": { 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": false, 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size": -1, 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "max_objects": -1 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "rgw", 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:30:09.680 INFO:tasks.workunit.client.0.smithi137.stdout: "account_id": "", 2024-09-12T00:30:09.681 INFO:tasks.workunit.client.0.smithi137.stdout: "path": "/", 2024-09-12T00:30:09.681 INFO:tasks.workunit.client.0.smithi137.stdout: "create_date": "2024-09-12T00:30:09.673687Z", 2024-09-12T00:30:09.681 INFO:tasks.workunit.client.0.smithi137.stdout: "tags": [], 2024-09-12T00:30:09.681 INFO:tasks.workunit.client.0.smithi137.stdout: "group_ids": [] 2024-09-12T00:30:09.681 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:30:09.681 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:30:09.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.678+0000 7fe9127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:09.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.682+0000 7fea5dab19c0 20 remove_watcher() i=0 2024-09-12T00:30:09.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.682+0000 7fea5dab19c0 2 removed watcher, disabling cache 2024-09-12T00:30:09.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.686+0000 7fea5dab19c0 20 remove_watcher() i=1 2024-09-12T00:30:09.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.686+0000 7fea5dab19c0 20 remove_watcher() i=2 2024-09-12T00:30:09.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.690+0000 7fea5dab19c0 20 remove_watcher() i=3 2024-09-12T00:30:09.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.690+0000 7fea5dab19c0 20 remove_watcher() i=4 2024-09-12T00:30:09.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.694+0000 7fea5dab19c0 20 remove_watcher() i=5 2024-09-12T00:30:09.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.694+0000 7fea5dab19c0 20 remove_watcher() i=6 2024-09-12T00:30:09.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:09.698+0000 7fea5dab19c0 20 remove_watcher() i=7 2024-09-12T00:30:09.714 INFO:tasks.workunit.client.0.smithi137.stdout:phase 1.1 2024-09-12T00:30:09.736 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:30:09.736 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:09.736 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:30:09.736 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:30:09.749 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:09.749 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:10.457 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (722 ms) 2024-09-12T00:30:10.458 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:30:10.459 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:30:10.459 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:30:10.459 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:30:10.459 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:30:10.474 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:30:10.482 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/f1 2024-09-12T00:30:10.488 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/f2 2024-09-12T00:30:10.494 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:30:10.501 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:30:10.507 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:30:10.513 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:30:10.520 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:30:10.525 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:30:10.533 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:30:10.540 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:30:10.548 INFO:tasks.workunit.client.0.smithi137.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:30:10.555 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETUP_HIER1 (97 ms) 2024-09-12T00:30:10.556 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:30:10.826 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETUP_DIRS1 (270 ms) 2024-09-12T00:30:10.826 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:30:10.826 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:30:10.826 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:30:10.873 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (48 ms) 2024-09-12T00:30:10.873 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:30:10.970 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (96 ms) 2024-09-12T00:30:10.970 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:30:10.970 INFO:tasks.workunit.client.0.smithi137.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:30:10.986 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (16 ms) 2024-09-12T00:30:10.986 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:30:10.986 INFO:tasks.workunit.client.0.smithi137.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (18 ms) 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi137.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:30:11.006 INFO:tasks.workunit.client.0.smithi137.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:30:11.006 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:30:11.008 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:30:11.008 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:30:11.013 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:30:11.013 INFO:tasks.workunit.client.0.smithi137.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:30:11.013 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:30:11.016 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:30:11.016 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:30:11.020 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:30:11.020 INFO:tasks.workunit.client.0.smithi137.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:30:11.020 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:30:11.025 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:30:11.025 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:30:11.028 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:30:11.029 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READ_DIRS1 (25 ms) 2024-09-12T00:30:11.029 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:30:11.260 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READF_SETUP1 (231 ms) 2024-09-12T00:30:11.260 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:30:11.260 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:30:11.260 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:30:11.260 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:30:11.260 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:30:11.260 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:30:11.260 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:30:11.261 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:30:11.271 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:30:11.271 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:30:11.277 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:30:11.279 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:30:11.284 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:30:11.284 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:30:11.285 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:30:11.286 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:30:11.287 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:30:11.289 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:30:11.290 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.HIER1 (33 ms) 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:30:11.293 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:30:11.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:11.290+0000 7fdbed840a80 -1 shutting down 2024-09-12T00:30:11.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:11.294+0000 7fdac7592640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57664, si_uid : 1000, si_addr0x3e80000e140, si_status0 2024-09-12T00:30:40.432 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (29139 ms) 2024-09-12T00:30:40.433 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 24 tests from LibRGW (30696 ms total) 2024-09-12T00:30:40.433 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:30:40.433 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:40.433 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 24 tests from 1 test suite ran. (30696 ms total) 2024-09-12T00:30:40.433 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 24 tests. 2024-09-12T00:30:40.446 INFO:tasks.workunit.client.0.smithi137.stdout:phase 1.2 2024-09-12T00:30:40.469 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:30:40.469 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:40.469 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:30:40.469 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:30:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:40.779 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (310 ms) 2024-09-12T00:30:40.779 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:30:40.781 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:30:40.782 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:30:40.783 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:30:40.784 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:30:40.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:40.782+0000 7f0569de9a80 -1 shutting down 2024-09-12T00:30:40.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:30:40.786+0000 7f0443b3b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58309, si_uid : 1000, si_addr0x3e80000e3c5, si_status0 2024-09-12T00:31:11.188 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (30407 ms) 2024-09-12T00:31:11.189 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 24 tests from LibRGW (30718 ms total) 2024-09-12T00:31:11.189 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:31:11.189 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:31:11.189 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 24 tests from 1 test suite ran. (30718 ms total) 2024-09-12T00:31:11.189 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 24 tests. 2024-09-12T00:31:11.202 INFO:tasks.workunit.client.0.smithi137.stdout:phase 1.3 2024-09-12T00:31:11.225 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:31:11.225 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:31:11.225 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:31:11.225 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:31:11.238 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:11.238 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:11.562 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (337 ms) 2024-09-12T00:31:11.563 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:31:11.563 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:31:11.563 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:31:11.563 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:31:11.564 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:31:11.572 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETUP_HIER1 (9 ms) 2024-09-12T00:31:11.572 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:31:11.690 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETUP_DIRS1 (117 ms) 2024-09-12T00:31:11.690 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:31:11.690 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:31:11.690 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:31:11.690 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:31:11.690 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:31:11.690 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:31:11.690 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:31:11.691 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:31:11.692 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:31:11.693 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:31:11.693 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:31:11.696 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:31:11.696 INFO:tasks.workunit.client.0.smithi137.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:31:11.696 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:31:11.699 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:31:11.699 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:31:11.702 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:31:11.702 INFO:tasks.workunit.client.0.smithi137.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:31:11.703 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:31:11.705 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:31:11.705 INFO:tasks.workunit.client.0.smithi137.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:31:11.708 INFO:tasks.workunit.client.0.smithi137.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:31:11.708 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READ_DIRS1 (18 ms) 2024-09-12T00:31:11.708 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:31:11.708 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:31:11.708 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:31:11.708 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:31:11.708 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:31:11.708 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:31:11.709 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:31:11.710 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:31:11.710 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:31:11.710 INFO:tasks.workunit.client.0.smithi137.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:31:11.710 INFO:tasks.workunit.client.0.smithi137.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:31:11.710 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:31:11.710 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:31:11.718 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:31:11.719 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:31:11.724 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:31:11.726 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:31:11.730 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:31:11.731 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:31:11.732 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:31:11.733 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:31:11.734 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:31:11.735 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:31:11.736 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:31:11.738 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:31:11.738 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.HIER1 (30 ms) 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:31:11.739 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:31:11.740 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:31:11.740 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:31:11.740 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:31:11.740 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:31:11.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:31:11.742+0000 7f0dfefa3a80 -1 shutting down 2024-09-12T00:31:11.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:31:11.746+0000 7f0cd8cf5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58954, si_uid : 1000, si_addr0x3e80000e64a, si_status0 2024-09-12T00:31:41.841 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (30102 ms) 2024-09-12T00:31:41.842 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 24 tests from LibRGW (30615 ms total) 2024-09-12T00:31:41.842 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:31:41.842 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:31:41.842 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 24 tests from 1 test suite ran. (30616 ms total) 2024-09-12T00:31:41.842 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 24 tests. 2024-09-12T00:31:41.854 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2.1 2024-09-12T00:31:41.878 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:31:41.878 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:31:41.878 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:31:41.878 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:31:41.889 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:41.889 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:42.827 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (949 ms) 2024-09-12T00:31:42.827 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:31:42.827 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:31:42.827 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:31:42.840 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKET (14 ms) 2024-09-12T00:31:42.841 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:31:42.841 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:31:42.841 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:31:42.857 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave0 2024-09-12T00:31:42.871 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave1 2024-09-12T00:31:42.884 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave2 2024-09-12T00:31:42.900 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave3 2024-09-12T00:31:42.915 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave4 2024-09-12T00:31:42.931 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave5 2024-09-12T00:31:42.946 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave6 2024-09-12T00:31:42.961 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave7 2024-09-12T00:31:42.979 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave8 2024-09-12T00:31:42.995 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave9 2024-09-12T00:31:42.995 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (154 ms) 2024-09-12T00:31:42.995 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:31:43.365 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (369 ms) 2024-09-12T00:31:43.365 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:31:43.365 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:31:43.365 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:31:43.365 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:31:43.365 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:31:43.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:31:43.369+0000 7f6e2e87ca80 -1 shutting down 2024-09-12T00:31:43.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:31:43.369+0000 7f6d085ce640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59600, si_uid : 1000, si_addr0x3e80000e8d0, si_status0 2024-09-12T00:32:13.200 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (29836 ms) 2024-09-12T00:32:13.201 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 9 tests from LibRGW (31322 ms total) 2024-09-12T00:32:13.201 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:32:13.201 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:13.201 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 9 tests from 1 test suite ran. (31322 ms total) 2024-09-12T00:32:13.201 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 9 tests. 2024-09-12T00:32:13.209 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2.2 2024-09-12T00:32:13.233 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:32:13.233 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:13.233 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:32:13.233 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:32:13.244 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:13.244 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:13.995 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (763 ms) 2024-09-12T00:32:13.995 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:32:13.996 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:32:13.996 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:32:13.996 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:32:13.996 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:32:14.023 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_BUCKET (27 ms) 2024-09-12T00:32:14.023 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:32:14.037 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave0 2024-09-12T00:32:14.052 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave1 2024-09-12T00:32:14.066 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave2 2024-09-12T00:32:14.082 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave3 2024-09-12T00:32:14.098 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave4 2024-09-12T00:32:14.116 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave5 2024-09-12T00:32:14.133 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave6 2024-09-12T00:32:14.149 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave7 2024-09-12T00:32:14.168 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave8 2024-09-12T00:32:14.185 INFO:tasks.workunit.client.0.smithi137.stdout:created: sorrydave9 2024-09-12T00:32:14.185 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (161 ms) 2024-09-12T00:32:14.185 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:32:14.542 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (357 ms) 2024-09-12T00:32:14.542 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:32:14.542 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:32:14.543 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:32:14.543 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:32:14.543 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:32:14.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:32:14.545+0000 7f6e8ce27a80 -1 shutting down 2024-09-12T00:32:14.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:32:14.549+0000 7f6d66b79640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60245, si_uid : 1000, si_addr0x3e80000eb55, si_status0 2024-09-12T00:32:44.173 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (29631 ms) 2024-09-12T00:32:44.173 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 9 tests from LibRGW (30940 ms total) 2024-09-12T00:32:44.173 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:32:44.173 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:44.173 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 9 tests from 1 test suite ran. (30940 ms total) 2024-09-12T00:32:44.173 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 9 tests. 2024-09-12T00:32:44.186 INFO:tasks.workunit.client.0.smithi137.stdout:phase 3.1 2024-09-12T00:32:44.527 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:32:44.528 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:44.528 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:32:44.528 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:32:44.537 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:44.537 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:44.805 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (277 ms) 2024-09-12T00:32:44.805 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:32:44.805 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:32:44.805 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:32:44.818 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKET (12 ms) 2024-09-12T00:32:44.818 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:32:44.822 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T00:32:44.822 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:32:44.823 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:32:44.824 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:32:44.876 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LARGE1 (52 ms) 2024-09-12T00:32:44.876 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:32:44.927 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LARGE2 (51 ms) 2024-09-12T00:32:44.927 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:32:44.927 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:32:44.927 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:32:44.927 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:32:44.927 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:32:44.927 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:32:44.927 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:32:44.928 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:32:44.928 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:32:44.928 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:32:44.928 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:32:44.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:32:44.929+0000 7f083fbb4a80 -1 shutting down 2024-09-12T00:32:44.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:32:44.933+0000 7f0719906640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60890, si_uid : 1000, si_addr0x3e80000edda, si_status0 2024-09-12T00:33:14.895 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (29968 ms) 2024-09-12T00:33:14.895 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 13 tests from LibRGW (30367 ms total) 2024-09-12T00:33:14.895 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:33:14.896 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:33:14.896 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 13 tests from 1 test suite ran. (30367 ms total) 2024-09-12T00:33:14.896 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 13 tests. 2024-09-12T00:33:14.907 INFO:tasks.workunit.client.0.smithi137.stdout:phase 3.2 2024-09-12T00:33:15.249 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:33:15.249 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:33:15.249 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:33:15.249 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:33:15.257 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:15.258 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:15.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (310 ms) 2024-09-12T00:33:15.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:33:15.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:33:15.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:33:15.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:33:15.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:33:15.569 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-12T00:33:15.569 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:33:15.575 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:33:15.575 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:33:15.643 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LARGE1 (70 ms) 2024-09-12T00:33:15.643 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:33:15.644 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:33:15.644 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:33:15.644 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:33:15.644 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:33:15.650 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_OBJECT (7 ms) 2024-09-12T00:33:15.650 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:33:15.678 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_BUCKET (27 ms) 2024-09-12T00:33:15.678 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:33:15.678 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:33:15.678 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:33:15.678 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:33:15.678 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:33:15.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:33:15.680+0000 7fe56c05ca80 -1 shutting down 2024-09-12T00:33:15.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:33:15.680+0000 7fe445dae640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61535, si_uid : 1000, si_addr0x3e80000f05f, si_status0 2024-09-12T00:33:45.652 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (29974 ms) 2024-09-12T00:33:45.652 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 13 tests from LibRGW (30403 ms total) 2024-09-12T00:33:45.652 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:33:45.652 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:33:45.652 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 13 tests from 1 test suite ran. (30403 ms total) 2024-09-12T00:33:45.652 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 13 tests. 2024-09-12T00:33:45.670 INFO:tasks.workunit.client.0.smithi137.stdout:phase 4.1 2024-09-12T00:33:45.693 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:33:45.693 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:33:45.693 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:33:45.693 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:33:45.693 INFO:tasks.workunit.client.0.smithi137.stdout:read i1: 64001 2024-09-12T00:33:45.693 INFO:tasks.workunit.client.0.smithi137.stdout:read s1: blunderbuss 2024-09-12T00:33:45.693 INFO:tasks.workunit.client.0.smithi137.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:33:45.693 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:33:45.706 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:45.706 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:46.018 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (325 ms) 2024-09-12T00:33:46.019 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:33:46.019 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:33:46.019 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:33:46.041 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (21 ms) 2024-09-12T00:33:46.041 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_0 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_1 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_2 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_3 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_4 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_5 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_6 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_7 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_8 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_9 2024-09-12T00:33:47.362 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_10 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_11 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_12 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_13 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_14 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_15 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_16 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_17 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_18 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_19 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_20 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_21 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_22 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_23 2024-09-12T00:33:47.363 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_24 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_25 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_26 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_27 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_28 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_29 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_30 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_31 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_32 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_33 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_34 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_35 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_36 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_37 2024-09-12T00:33:47.364 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_38 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_39 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_40 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_41 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_42 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_43 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_44 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_45 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_46 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_47 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_48 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_49 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_50 2024-09-12T00:33:47.365 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_51 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_52 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_53 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_54 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_55 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_56 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_57 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_58 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_59 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_60 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_61 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_62 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_63 2024-09-12T00:33:47.366 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_64 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_65 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_66 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_67 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_68 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_69 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_70 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_71 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_72 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_73 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_74 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_75 2024-09-12T00:33:47.367 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_76 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_77 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_78 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_79 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_80 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_81 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_82 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_83 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_84 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_85 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_86 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_87 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_88 2024-09-12T00:33:47.368 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_89 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_90 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_91 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_92 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_93 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_94 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_95 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_96 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_97 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_98 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:created: dmarker:f_99 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1321 ms) 2024-09-12T00:33:47.369 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:33:47.370 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:33:47.370 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:33:47.370 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:33:47.370 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:33:47.370 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:33:47.370 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:33:47.370 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:33:47.370 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:33:47.371 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:33:47.372 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:33:47.373 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:33:47.374 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:33:47.375 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:33:47.376 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:33:47.377 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:33:47.378 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_READDIR (9 ms) 2024-09-12T00:33:47.378 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:33:47.378 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:33:47.378 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:33:47.379 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:33:47.380 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:33:47.381 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:33:47.382 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:33:47.383 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:33:47.384 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:33:47.385 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:33:47.386 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER2_READDIR (7 ms) 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:33:47.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:33:47.380+0000 7f56458aba80 -1 shutting down 2024-09-12T00:33:47.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:33:47.384+0000 7f551f5fd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62180, si_uid : 1000, si_addr0x3e80000f2e4, si_status0 2024-09-12T00:34:16.151 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (28773 ms) 2024-09-12T00:34:16.151 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 11 tests from LibRGW (30457 ms total) 2024-09-12T00:34:16.152 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:34:16.152 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:16.152 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 11 tests from 1 test suite ran. (30457 ms total) 2024-09-12T00:34:16.152 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 11 tests. 2024-09-12T00:34:16.165 INFO:tasks.workunit.client.0.smithi137.stdout:phase 4.2 2024-09-12T00:34:16.188 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:34:16.188 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:16.188 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:34:16.188 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:34:16.188 INFO:tasks.workunit.client.0.smithi137.stdout:read i1: 64001 2024-09-12T00:34:16.189 INFO:tasks.workunit.client.0.smithi137.stdout:read s1: blunderbuss 2024-09-12T00:34:16.189 INFO:tasks.workunit.client.0.smithi137.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:34:16.189 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:34:16.198 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:16.198 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:16.494 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (307 ms) 2024-09-12T00:34:16.495 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:34:16.495 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:34:16.495 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:34:16.505 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-09-12T00:34:16.505 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:34:16.505 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:34:16.506 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:34:16.506 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:34:16.506 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:34:16.510 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:34:16.639 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:34:16.640 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:34:16.641 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:34:16.642 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:34:16.643 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:34:16.644 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:34:16.645 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:34:16.646 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:34:16.647 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:34:16.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:34:16.512+0000 7fad7ab2fa80 -1 shutting down 2024-09-12T00:34:16.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:34:16.516+0000 7fac54881640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62825, si_uid : 1000, si_addr0x3e80000f569, si_status0 2024-09-12T00:34:46.759 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (30249 ms) 2024-09-12T00:34:46.759 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 11 tests from LibRGW (30571 ms total) 2024-09-12T00:34:46.760 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:34:46.760 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:46.760 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 11 tests from 1 test suite ran. (30571 ms total) 2024-09-12T00:34:46.760 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 11 tests. 2024-09-12T00:34:46.773 INFO:tasks.workunit.client.0.smithi137.stdout:phase 5.1 2024-09-12T00:34:46.806 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:34:46.807 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:46.807 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:34:46.807 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:34:46.818 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:46.818 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:47.127 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (321 ms) 2024-09-12T00:34:47.127 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:34:47.127 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:34:47.128 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:34:47.141 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKET (14 ms) 2024-09-12T00:34:47.142 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:34:47.145 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-12T00:34:47.145 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:34:47.145 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:34:47.145 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:34:47.148 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T00:34:47.148 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:34:47.148 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:34:47.148 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:34:47.158 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.PUT_OBJECT (10 ms) 2024-09-12T00:34:47.158 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:34:47.161 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-12T00:34:47.161 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:34:47.162 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:34:47.163 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:34:47.163 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:34:47.163 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:34:47.163 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:34:47.163 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:34:47.163 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:34:47.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:34:47.163+0000 7f8139c12a80 -1 shutting down 2024-09-12T00:34:47.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:34:47.163+0000 7f8013964640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63470, si_uid : 1000, si_addr0x3e80000f7ee, si_status0 2024-09-12T00:35:17.184 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (30022 ms) 2024-09-12T00:35:17.185 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 19 tests from LibRGW (30378 ms total) 2024-09-12T00:35:17.185 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:35:17.185 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:35:17.185 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 19 tests from 1 test suite ran. (30378 ms total) 2024-09-12T00:35:17.185 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 19 tests. 2024-09-12T00:35:17.196 INFO:tasks.workunit.client.0.smithi137.stdout:phase 5.2 2024-09-12T00:35:17.230 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:35:17.230 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:35:17.230 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:35:17.230 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:35:17.238 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:17.238 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:17.551 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (322 ms) 2024-09-12T00:35:17.552 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:35:17.552 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:35:17.552 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:35:17.552 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:35:17.552 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:35:17.558 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:35:17.559 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:35:17.568 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-12T00:35:17.568 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:35:17.596 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-12T00:35:17.596 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:35:17.596 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:35:17.596 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:35:17.596 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:35:17.596 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:35:17.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:35:17.599+0000 7fdfcfd77a80 -1 shutting down 2024-09-12T00:35:17.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:35:17.599+0000 7fdea9ac9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64118, si_uid : 1000, si_addr0x3e80000fa76, si_status0 2024-09-12T00:35:47.552 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (29956 ms) 2024-09-12T00:35:47.552 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 19 tests from LibRGW (30322 ms total) 2024-09-12T00:35:47.552 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:35:47.552 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:35:47.552 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 19 tests from 1 test suite ran. (30322 ms total) 2024-09-12T00:35:47.552 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 19 tests. 2024-09-12T00:35:47.565 INFO:tasks.workunit.client.0.smithi137.stdout:phase 6.1 2024-09-12T00:35:47.589 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:35:47.590 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment set-up. 2024-09-12T00:35:47.590 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:35:47.590 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:35:47.599 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:47.599 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:48.135 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.INIT (546 ms) 2024-09-12T00:35:48.135 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:35:48.136 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:35:48.136 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:35:48.161 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CREATE_BUCKETS (24 ms) 2024-09-12T00:35:48.161 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:35:48.171 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (10 ms) 2024-09-12T00:35:48.171 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:35:48.209 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.TOPDIR_RENAME (39 ms) 2024-09-12T00:35:48.209 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:35:48.253 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SUBDIR_RENAME (43 ms) 2024-09-12T00:35:48.253 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:35:48.300 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (48 ms) 2024-09-12T00:35:48.301 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:35:48.301 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:35:48.301 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:35:48.301 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:35:48.301 INFO:tasks.workunit.client.0.smithi137.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:35:48.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:35:48.303+0000 7f5d2bdaca80 -1 shutting down 2024-09-12T00:35:48.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:35:48.303+0000 7f5c05afe640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64763, si_uid : 1000, si_addr0x3e80000fcfb, si_status0 2024-09-12T00:36:18.424 INFO:tasks.workunit.client.0.smithi137.stdout:[ OK ] LibRGW.SHUTDOWN (30122 ms) 2024-09-12T00:36:18.424 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] 10 tests from LibRGW (30833 ms total) 2024-09-12T00:36:18.424 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:36:18.424 INFO:tasks.workunit.client.0.smithi137.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:18.424 INFO:tasks.workunit.client.0.smithi137.stdout:[==========] 10 tests from 1 test suite ran. (30833 ms total) 2024-09-12T00:36:18.425 INFO:tasks.workunit.client.0.smithi137.stdout:[ PASSED ] 10 tests. 2024-09-12T00:36:18.433 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:18.434 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:18.449 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:36:18.450 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:36:18.450 DEBUG:teuthology.orchestra.run.smithi137:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:36:18.503 INFO:tasks.workunit.client.0.smithi137.stderr:+ [ -z ] 2024-09-12T00:36:18.503 INFO:tasks.workunit.client.0.smithi137.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:36:18.504 INFO:tasks.workunit.client.0.smithi137.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:36:18.504 INFO:tasks.workunit.client.0.smithi137.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T00:36:18.545 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:18.545 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:18.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.594+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 realm 2024-09-12T00:36:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:18.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:18.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.598+0000 7fef862279c0 20 searching for the correct realm 2024-09-12T00:36:18.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.606+0000 7fef8352c640 0 -- 172.21.15.137:0/2595133443 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fef6c008040 msgr2=0x7fef6c0163f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:18.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.818+0000 7fef83d2d640 0 -- 172.21.15.137:0/2595133443 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fef740cc400 msgr2=0x7fef740cc860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:18.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:18.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:36:18.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:18.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:36:18.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:18.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:18.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:18.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 zone default found 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 4 Realm: () 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 zonegroup default 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.834+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.838+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.838+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.838+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.838+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.838+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.838+0000 7fef862279c0 20 started sync module instance, tier type = 2024-09-12T00:36:18.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.838+0000 7fef862279c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:36:18.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.858+0000 7fef862279c0 20 add_watcher() i=0 2024-09-12T00:36:18.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.858+0000 7fef862279c0 20 add_watcher() i=1 2024-09-12T00:36:18.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.858+0000 7fef862279c0 20 add_watcher() i=2 2024-09-12T00:36:18.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.858+0000 7fef862279c0 20 add_watcher() i=3 2024-09-12T00:36:18.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.858+0000 7fef862279c0 20 add_watcher() i=4 2024-09-12T00:36:18.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.858+0000 7fef862279c0 20 add_watcher() i=5 2024-09-12T00:36:18.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.858+0000 7fef862279c0 20 add_watcher() i=6 2024-09-12T00:36:18.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.862+0000 7fef862279c0 20 add_watcher() i=7 2024-09-12T00:36:18.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.862+0000 7fef862279c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:18.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.866+0000 7fee39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:18.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.866+0000 7fef862279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:18.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.866+0000 7fef862279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:18.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.866+0000 7fef862279c0 5 note: GC not initialized 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fee38fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 20 init_complete bucket index max shards: 1 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 20 Filter name: none 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fedb27fc640 20 reqs_thread_entry: start 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:36:18.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:36:18.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:36:18.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:36:18.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:36:18.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:36:18.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:36:18.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.870+0000 7fef862279c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:36:18.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.874+0000 7fef862279c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:36:18.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.874+0000 7fef862279c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:36:18.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.874+0000 7fef862279c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:36:18.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.874+0000 7fee62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660542 cookie 94287072262016 notifier 5787 bl.length()=677 2024-09-12T00:36:18.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.878+0000 7fee62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:36:18.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.878+0000 7fee62ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:36:18.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.878+0000 7fef862279c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:36:18.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.878+0000 7fef862279c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:36:18.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.878+0000 7fef862279c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:36:18.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.882+0000 7fee62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660488 cookie 94287072246480 notifier 5787 bl.length()=187 2024-09-12T00:36:18.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.882+0000 7fee62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:36:18.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.882+0000 7fee62ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:36:18.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.882+0000 7fef862279c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:36:18.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.882+0000 7fef862279c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:36:18.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.882+0000 7fef862279c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:36:18.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.882+0000 7fee62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660489 cookie 94287072246480 notifier 5787 bl.length()=197 2024-09-12T00:36:18.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.886+0000 7fee62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:36:18.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.886+0000 7fee62ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:36:18.879 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "display_name": "maven test user", 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "email": "sigv4@example.com", 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "suspended": 0, 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "subusers": [], 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "keys": [ 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "user": "ceph-test-maven", 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:36:18.880 INFO:tasks.workunit.client.0.smithi137.stdout: "active": true, 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "create_date": "2024-09-12T00:36:18.874386Z" 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "swift_keys": [], 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "caps": [], 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "default_placement": "", 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "placement_tags": [], 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_quota": { 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": false, 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size": -1, 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "max_objects": -1 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "user_quota": { 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": false, 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size": -1, 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "max_objects": -1 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "rgw", 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:36:18.883 INFO:tasks.workunit.client.0.smithi137.stdout: "account_id": "", 2024-09-12T00:36:18.883 INFO:tasks.workunit.client.0.smithi137.stdout: "path": "/", 2024-09-12T00:36:18.883 INFO:tasks.workunit.client.0.smithi137.stdout: "create_date": "2024-09-12T00:36:18.874352Z", 2024-09-12T00:36:18.883 INFO:tasks.workunit.client.0.smithi137.stdout: "tags": [], 2024-09-12T00:36:18.883 INFO:tasks.workunit.client.0.smithi137.stdout: "group_ids": [] 2024-09-12T00:36:18.883 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:36:18.883 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:36:18.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.886+0000 7fee39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:18.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.890+0000 7fef862279c0 20 remove_watcher() i=0 2024-09-12T00:36:18.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.890+0000 7fef862279c0 2 removed watcher, disabling cache 2024-09-12T00:36:18.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.890+0000 7fef862279c0 20 remove_watcher() i=1 2024-09-12T00:36:18.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.894+0000 7fef862279c0 20 remove_watcher() i=2 2024-09-12T00:36:18.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.894+0000 7fef862279c0 20 remove_watcher() i=3 2024-09-12T00:36:18.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.898+0000 7fef862279c0 20 remove_watcher() i=4 2024-09-12T00:36:18.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.902+0000 7fef862279c0 20 remove_watcher() i=5 2024-09-12T00:36:18.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.902+0000 7fef862279c0 20 remove_watcher() i=6 2024-09-12T00:36:18.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:36:18.906+0000 7fef862279c0 20 remove_watcher() i=7 2024-09-12T00:36:18.921 INFO:tasks.workunit.client.0.smithi137.stderr:+ [ -z ] 2024-09-12T00:36:18.921 INFO:tasks.workunit.client.0.smithi137.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T00:36:18.921 INFO:tasks.workunit.client.0.smithi137.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:36:18.921 INFO:tasks.workunit.client.0.smithi137.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi137.front.sepia.ceph.com:443 2024-09-12T00:36:18.921 INFO:tasks.workunit.client.0.smithi137.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T00:36:18.922 INFO:tasks.workunit.client.0.smithi137.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:36:18.922 INFO:tasks.workunit.client.0.smithi137.stderr:+ ./mvnw clean package 2024-09-12T00:36:18.928 INFO:tasks.workunit.client.0.smithi137.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:36:21.906 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Scanning for projects... 2024-09-12T00:36:22.035 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:36:22.138 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 53 kB/s) 2024-09-12T00:36:22.177 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:36:22.218 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.8 MB/s) 2024-09-12T00:36:22.238 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:36:22.267 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 2.6 MB/s) 2024-09-12T00:36:22.303 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:22.303 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:36:22.303 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:36:22.303 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] from pom.xml 2024-09-12T00:36:22.303 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:36:22.308 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:36:22.325 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 295 kB/s) 2024-09-12T00:36:22.336 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:36:22.355 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 521 kB/s) 2024-09-12T00:36:22.359 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:36:22.379 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.3 MB/s) 2024-09-12T00:36:22.388 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:36:22.409 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 934 kB/s) 2024-09-12T00:36:22.429 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:36:22.454 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.4 MB/s) 2024-09-12T00:36:22.463 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:36:22.485 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 388 kB/s) 2024-09-12T00:36:22.488 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:36:22.506 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 450 kB/s) 2024-09-12T00:36:22.509 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:36:22.532 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.2 MB/s) 2024-09-12T00:36:22.540 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:36:22.561 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 987 kB/s) 2024-09-12T00:36:22.569 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:36:22.588 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.5 MB/s) 2024-09-12T00:36:22.597 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:36:22.615 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 577 kB/s) 2024-09-12T00:36:22.624 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:36:22.642 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-12T00:36:22.651 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:36:22.668 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-09-12T00:36:22.671 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:36:22.689 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-12T00:36:22.693 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:36:22.714 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.5 MB/s) 2024-09-12T00:36:22.720 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:36:22.734 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-12T00:36:22.743 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:36:22.760 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 313 kB/s) 2024-09-12T00:36:22.765 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:36:22.785 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-09-12T00:36:22.790 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T00:36:22.813 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:36:22.828 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 521 kB/s) 2024-09-12T00:36:22.830 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.5 MB/s) 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 234 kB/s) 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:36:22.973 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 927 kB/s) 2024-09-12T00:36:22.982 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:36:23.003 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 953 kB/s) 2024-09-12T00:36:23.017 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:36:23.053 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 108 kB/s) 2024-09-12T00:36:23.057 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:36:23.079 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 68 kB/s) 2024-09-12T00:36:23.082 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:36:23.104 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 106 kB/s) 2024-09-12T00:36:23.115 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:36:23.135 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 173 kB/s) 2024-09-12T00:36:23.148 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:36:23.169 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 153 kB/s) 2024-09-12T00:36:23.179 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:36:23.197 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 577 kB/s) 2024-09-12T00:36:23.206 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:36:23.226 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 80 kB/s) 2024-09-12T00:36:23.233 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:36:23.253 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 191 kB/s) 2024-09-12T00:36:23.259 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:36:23.278 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 258 kB/s) 2024-09-12T00:36:23.283 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:36:23.299 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 72 kB/s) 2024-09-12T00:36:23.302 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:36:23.319 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-09-12T00:36:23.321 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:36:23.337 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T00:36:23.340 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:36:23.363 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 160 kB/s) 2024-09-12T00:36:23.370 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:36:23.390 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 122 kB/s) 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:36:23.416 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-09-12T00:36:23.424 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:36:23.443 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 390 kB/s) 2024-09-12T00:36:23.452 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:36:23.481 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 182 kB/s) 2024-09-12T00:36:23.490 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:36:23.514 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 145 kB/s) 2024-09-12T00:36:23.522 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:36:23.541 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 231 kB/s) 2024-09-12T00:36:23.545 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 115 kB/s) 2024-09-12T00:36:23.572 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:36:23.597 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 268 kB/s) 2024-09-12T00:36:23.605 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:36:23.622 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 337 kB/s) 2024-09-12T00:36:23.636 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:36:23.656 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 142 kB/s) 2024-09-12T00:36:23.669 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:36:23.688 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-12T00:36:23.698 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:36:23.717 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 227 kB/s) 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:36:23.742 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 85 kB/s) 2024-09-12T00:36:23.754 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:36:23.778 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 275 kB/s) 2024-09-12T00:36:23.785 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:36:23.803 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 862 kB/s) 2024-09-12T00:36:23.812 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:36:23.838 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.3 MB/s) 2024-09-12T00:36:23.848 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:36:23.868 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 855 kB/s) 2024-09-12T00:36:23.878 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:36:23.902 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 207 kB/s) 2024-09-12T00:36:23.905 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:36:23.922 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 823 kB/s) 2024-09-12T00:36:23.928 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:36:23.949 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 665 kB/s) 2024-09-12T00:36:23.953 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:36:23.972 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.6 MB/s) 2024-09-12T00:36:23.993 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:36:24.008 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T00:36:24.013 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:36:24.030 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 965 kB/s) 2024-09-12T00:36:24.032 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:36:24.051 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-09-12T00:36:24.060 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:36:24.078 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 970 kB/s) 2024-09-12T00:36:24.088 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:36:24.108 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 951 kB/s) 2024-09-12T00:36:24.115 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:36:24.136 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.7 MB/s) 2024-09-12T00:36:24.147 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:36:24.164 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-12T00:36:24.167 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:36:24.183 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 863 kB/s) 2024-09-12T00:36:24.188 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:36:24.213 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 128 kB/s) 2024-09-12T00:36:24.216 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:36:24.233 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 199 kB/s) 2024-09-12T00:36:24.235 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:36:24.251 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-12T00:36:24.256 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:36:24.274 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-09-12T00:36:24.278 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:36:24.295 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 95 kB/s) 2024-09-12T00:36:24.301 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 167 kB/s) 2024-09-12T00:36:24.324 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:36:24.341 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-12T00:36:24.346 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:36:24.367 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 153 kB/s) 2024-09-12T00:36:24.373 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:36:24.389 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-09-12T00:36:24.397 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:36:24.414 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-09-12T00:36:24.419 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:36:24.437 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-12T00:36:24.441 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:36:24.458 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T00:36:24.463 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:36:24.481 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:36:24.485 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:36:24.502 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:36:24.506 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:36:24.529 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 138 kB/s) 2024-09-12T00:36:24.572 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:36:24.694 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 27 MB/s) 2024-09-12T00:36:24.696 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:36:24.696 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:36:24.697 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:36:24.697 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:36:24.697 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:36:24.718 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 63/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.2 MB/s) 2024-09-12T00:36:24.718 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:36:24.736 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 411 kB/s) 2024-09-12T00:36:24.736 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:36:24.749 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/35 kB Progress (1): 2.8/35 kB Progress (1): 4.1/35 kB Progress (1): 5.5/35 kB Progress (1): 6.9/35 kB Progress (1): 8.3/35 kB Progress (1): 9.7/35 kB Progress (1): 11/35 kB Progress (2): 11/35 kB | 1.4/16 kB Progress (2): 12/35 kB | 1.4/16 kB Progress (2): 12/35 kB | 2.8/16 kB Progress (2): 14/35 kB | 2.8/16 kB Progress (2): 14/35 kB | 4.1/16 kB Progress (2): 15/35 kB | 4.1/16 kB Progress (2): 15/35 kB | 5.5/16 kB Progress (2): 15/35 kB | 6.9/16 kB Progress (2): 15/35 kB | 8.3/16 kB Progress (2): 17/35 kB | 8.3/16 kB Progress (2): 17/35 kB | 9.7/16 kB Progress (2): 18/35 kB | 9.7/16 kB Progress (2): 18/35 kB | 11/16 kB Progress (2): 19/35 kB | 11/16 kB Progress (2): 19/35 kB | 12/16 kB Progress (2): 19/35 kB | 14/16 kB Progress (2): 19/35 kB | 15/16 kB Progress (2): 19/35 kB | 16 kB Progress (2): 21/35 kB | 16 kB Progress (2): 22/35 kB | 16 kB Progress (2): 23/35 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 304 kB/s) 2024-09-12T00:36:24.749 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:36:24.752 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 25/35 kB Progress (1): 26/35 kB Progress (1): 28/35 kB Progress (2): 28/35 kB | 16/98 kB Progress (2): 29/35 kB | 16/98 kB Progress (3): 29/35 kB | 16/98 kB | 1.4/49 kB Progress (3): 30/35 kB | 16/98 kB | 1.4/49 kB Progress (3): 30/35 kB | 16/98 kB | 2.8/49 kB Progress (3): 32/35 kB | 16/98 kB | 2.8/49 kB Progress (3): 32/35 kB | 16/98 kB | 4.1/49 kB Progress (3): 32/35 kB | 16/98 kB | 5.5/49 kB Progress (3): 32/35 kB | 16/98 kB | 6.9/49 kB Progress (3): 32/35 kB | 16/98 kB | 8.3/49 kB Progress (3): 33/35 kB | 16/98 kB | 8.3/49 kB Progress (3): 33/35 kB | 16/98 kB | 9.7/49 kB Progress (3): 34/35 kB | 16/98 kB | 9.7/49 kB Progress (3): 34/35 kB | 16/98 kB | 11/49 kB Progress (3): 35 kB | 16/98 kB | 11/49 kB Progress (3): 35 kB | 16/98 kB | 12/49 kB Progress (3): 35 kB | 16/98 kB | 14/49 kB Progress (3): 35 kB | 16/98 kB | 15/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 628 kB/s) 2024-09-12T00:36:24.752 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 16/98 kB | 16/49 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:36:24.764 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 16/98 kB | 17/49 kB Progress (2): 16/98 kB | 19/49 kB Progress (2): 16/98 kB | 20/49 kB Progress (2): 33/98 kB | 20/49 kB Progress (2): 33/98 kB | 21/49 kB Progress (2): 33/98 kB | 23/49 kB Progress (2): 33/98 kB | 24/49 kB Progress (2): 33/98 kB | 25/49 kB Progress (2): 33/98 kB | 27/49 kB Progress (3): 33/98 kB | 27/49 kB | 16/782 kB Progress (3): 33/98 kB | 28/49 kB | 16/782 kB Progress (3): 33/98 kB | 30/49 kB | 16/782 kB Progress (3): 33/98 kB | 31/49 kB | 16/782 kB Progress (3): 33/98 kB | 31/49 kB | 32/782 kB Progress (3): 33/98 kB | 32/49 kB | 32/782 kB Progress (3): 33/98 kB | 34/49 kB | 32/782 kB Progress (3): 33/98 kB | 34/49 kB | 49/782 kB Progress (3): 33/98 kB | 35/49 kB | 49/782 kB Progress (3): 33/98 kB | 35/49 kB | 65/782 kB Progress (3): 33/98 kB | 37/49 kB | 65/782 kB Progress (3): 33/98 kB | 38/49 kB | 65/782 kB Progress (3): 33/98 kB | 38/49 kB | 81/782 kB Progress (3): 33/98 kB | 39/49 kB | 81/782 kB Progress (3): 33/98 kB | 39/49 kB | 98/782 kB Progress (3): 33/98 kB | 39/49 kB | 114/782 kB Progress (3): 33/98 kB | 39/49 kB | 130/782 kB Progress (3): 33/98 kB | 39/49 kB | 147/782 kB Progress (3): 33/98 kB | 39/49 kB | 163/782 kB Progress (3): 33/98 kB | 39/49 kB | 180/782 kB Progress (3): 33/98 kB | 39/49 kB | 196/782 kB Progress (3): 33/98 kB | 39/49 kB | 212/782 kB Progress (3): 33/98 kB | 39/49 kB | 229/782 kB Progress (3): 33/98 kB | 39/49 kB | 245/782 kB Progress (3): 33/98 kB | 39/49 kB | 262/782 kB Progress (3): 33/98 kB | 39/49 kB | 278/782 kB Progress (3): 33/98 kB | 39/49 kB | 294/782 kB Progress (3): 33/98 kB | 39/49 kB | 311/782 kB Progress (3): 33/98 kB | 39/49 kB | 327/782 kB Progress (3): 33/98 kB | 39/49 kB | 343/782 kB Progress (3): 49/98 kB | 39/49 kB | 343/782 kB Progress (3): 49/98 kB | 41/49 kB | 343/782 kB Progress (3): 49/98 kB | 41/49 kB | 360/782 kB Progress (3): 49/98 kB | 42/49 kB | 360/782 kB Progress (3): 49/98 kB | 43/49 kB | 360/782 kB Progress (3): 49/98 kB | 45/49 kB | 360/782 kB Progress (3): 49/98 kB | 45/49 kB | 376/782 kB Progress (3): 49/98 kB | 46/49 kB | 376/782 kB Progress (3): 49/98 kB | 48/49 kB | 376/782 kB Progress (3): 49/98 kB | 48/49 kB | 393/782 kB Progress (3): 49/98 kB | 49/49 kB | 393/782 kB Progress (3): 49/98 kB | 49 kB | 393/782 kB Progress (3): 49/98 kB | 49 kB | 402/782 kB Progress (4): 49/98 kB | 49 kB | 402/782 kB | 1.4/11 kB Progress (4): 49/98 kB | 49 kB | 418/782 kB | 1.4/11 kB Progress (4): 66/98 kB | 49 kB | 418/782 kB | 1.4/11 kB Progress (4): 66/98 kB | 49 kB | 418/782 kB | 2.8/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 735 kB/s) 2024-09-12T00:36:24.764 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (3): 66/98 kB | 418/782 kB | 4.1/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:36:24.765 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (3): 66/98 kB | 418/782 kB | 5.5/11 kB Progress (3): 66/98 kB | 435/782 kB | 5.5/11 kB Progress (3): 66/98 kB | 435/782 kB | 6.9/11 kB Progress (3): 66/98 kB | 435/782 kB | 8.3/11 kB Progress (3): 66/98 kB | 435/782 kB | 9.7/11 kB Progress (3): 66/98 kB | 435/782 kB | 11/11 kB Progress (3): 66/98 kB | 451/782 kB | 11/11 kB Progress (3): 66/98 kB | 451/782 kB | 11 kB Progress (3): 66/98 kB | 468/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 165 kB/s) 2024-09-12T00:36:24.765 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:36:24.768 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 82/98 kB | 468/782 kB Progress (2): 82/98 kB | 484/782 kB Progress (2): 82/98 kB | 500/782 kB Progress (2): 98 kB | 500/782 kB Progress (2): 98 kB | 517/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.4 MB/s) 2024-09-12T00:36:24.768 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:36:24.776 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 533/782 kB Progress (2): 533/782 kB | 16/205 kB Progress (2): 549/782 kB | 16/205 kB Progress (2): 566/782 kB | 16/205 kB Progress (2): 582/782 kB | 16/205 kB Progress (2): 582/782 kB | 33/205 kB Progress (2): 599/782 kB | 33/205 kB Progress (2): 615/782 kB | 33/205 kB Progress (2): 631/782 kB | 33/205 kB Progress (2): 631/782 kB | 49/205 kB Progress (2): 648/782 kB | 49/205 kB Progress (2): 664/782 kB | 49/205 kB Progress (2): 681/782 kB | 49/205 kB Progress (2): 697/782 kB | 49/205 kB Progress (2): 713/782 kB | 49/205 kB Progress (2): 730/782 kB | 49/205 kB Progress (2): 746/782 kB | 49/205 kB Progress (2): 762/782 kB | 49/205 kB Progress (2): 779/782 kB | 49/205 kB Progress (2): 782 kB | 49/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 9.8 MB/s) 2024-09-12T00:36:24.776 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:36:24.791 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 66/205 kB Progress (1): 82/205 kB Progress (1): 98/205 kB Progress (2): 98/205 kB | 16/81 kB Progress (2): 115/205 kB | 16/81 kB Progress (2): 131/205 kB | 16/81 kB Progress (2): 147/205 kB | 16/81 kB Progress (2): 164/205 kB | 16/81 kB Progress (2): 164/205 kB | 33/81 kB Progress (2): 180/205 kB | 33/81 kB Progress (3): 180/205 kB | 33/81 kB | 16/798 kB Progress (3): 180/205 kB | 33/81 kB | 33/798 kB Progress (3): 180/205 kB | 33/81 kB | 49/798 kB Progress (3): 180/205 kB | 33/81 kB | 66/798 kB Progress (3): 180/205 kB | 33/81 kB | 82/798 kB Progress (3): 180/205 kB | 33/81 kB | 98/798 kB Progress (3): 197/205 kB | 33/81 kB | 98/798 kB Progress (3): 205 kB | 33/81 kB | 98/798 kB Progress (3): 205 kB | 33/81 kB | 115/798 kB Progress (3): 205 kB | 33/81 kB | 131/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-12T00:36:24.791 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:36:24.797 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 49/81 kB | 131/798 kB Progress (2): 66/81 kB | 131/798 kB Progress (2): 81 kB | 131/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 813 kB/s) 2024-09-12T00:36:24.797 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 147/798 kB Progress (1): 164/798 kB Progress (1): 180/798 kB Progress (1): 197/798 kB Progress (1): 213/798 kB Progress (1): 229/798 kB Progress (1): 246/798 kB Progress (1): 256/798 kB Progress (1): 272/798 kB Progress (1): 289/798 kB Progress (1): 292/798 kB Progress (1): 309/798 kB Progress (1): 325/798 kB Progress (2): 325/798 kB | 13 kB Progress (2): 342/798 kB | 13 kB Progress (2): 358/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 123 kB/s) 2024-09-12T00:36:24.806 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:36:24.808 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 374/798 kB Progress (1): 391/798 kB Progress (2): 391/798 kB | 16/30 kB Progress (2): 407/798 kB | 16/30 kB Progress (2): 407/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 272 kB/s) 2024-09-12T00:36:24.809 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:36:24.813 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 407/798 kB | 16/182 kB Progress (2): 407/798 kB | 32/182 kB Progress (2): 423/798 kB | 32/182 kB Progress (2): 423/798 kB | 49/182 kB Progress (2): 423/798 kB | 65/182 kB Progress (2): 440/798 kB | 65/182 kB Progress (2): 440/798 kB | 81/182 kB Progress (2): 456/798 kB | 81/182 kB Progress (2): 456/798 kB | 98/182 kB Progress (2): 456/798 kB | 114/182 kB Progress (2): 473/798 kB | 114/182 kB Progress (2): 473/798 kB | 130/182 kB Progress (2): 473/798 kB | 147/182 kB Progress (2): 489/798 kB | 147/182 kB Progress (2): 489/798 kB | 163/182 kB Progress (2): 489/798 kB | 180/182 kB Progress (2): 489/798 kB | 182 kB Progress (2): 505/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-12T00:36:24.813 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:36:24.823 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 522/798 kB Progress (1): 538/798 kB Progress (1): 548/798 kB Progress (1): 565/798 kB Progress (1): 581/798 kB Progress (1): 597/798 kB Progress (2): 597/798 kB | 16/151 kB Progress (2): 614/798 kB | 16/151 kB Progress (2): 614/798 kB | 32/151 kB Progress (2): 630/798 kB | 32/151 kB Progress (2): 630/798 kB | 49/151 kB Progress (2): 646/798 kB | 49/151 kB Progress (2): 663/798 kB | 49/151 kB Progress (2): 663/798 kB | 65/151 kB Progress (2): 679/798 kB | 65/151 kB Progress (2): 696/798 kB | 65/151 kB Progress (2): 696/798 kB | 81/151 kB Progress (2): 712/798 kB | 81/151 kB Progress (2): 728/798 kB | 81/151 kB Progress (2): 745/798 kB | 81/151 kB Progress (2): 745/798 kB | 98/151 kB Progress (2): 761/798 kB | 98/151 kB Progress (2): 778/798 kB | 98/151 kB Progress (2): 778/798 kB | 114/151 kB Progress (2): 794/798 kB | 114/151 kB Progress (2): 798 kB | 114/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.4 MB/s) 2024-09-12T00:36:24.823 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:36:24.828 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 114/151 kB | 16/30 kB Progress (2): 114/151 kB | 30 kB Progress (2): 130/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 231 kB/s) 2024-09-12T00:36:24.828 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 147/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:36:24.829 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.1 MB/s) 2024-09-12T00:36:24.829 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:36:24.841 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 66/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (1): 115/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 197/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 246/385 kB Progress (1): 256/385 kB Progress (1): 272/385 kB Progress (1): 289/385 kB Progress (1): 305/385 kB Progress (1): 321/385 kB Progress (1): 338/385 kB Progress (1): 354/385 kB Progress (2): 354/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 93 kB/s) 2024-09-12T00:36:24.841 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:36:24.842 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 370/385 kB Progress (1): 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.7 MB/s) 2024-09-12T00:36:24.842 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:36:24.849 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/780 kB Progress (1): 32/780 kB Progress (1): 49/780 kB Progress (2): 49/780 kB | 16/75 kB Progress (2): 49/780 kB | 32/75 kB Progress (2): 49/780 kB | 49/75 kB Progress (2): 65/780 kB | 49/75 kB Progress (2): 65/780 kB | 65/75 kB Progress (2): 65/780 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 497 kB/s) 2024-09-12T00:36:24.849 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:36:24.864 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 81/780 kB Progress (1): 97/780 kB Progress (1): 114/780 kB Progress (1): 130/780 kB Progress (1): 147/780 kB Progress (2): 147/780 kB | 16/501 kB Progress (2): 163/780 kB | 16/501 kB Progress (2): 163/780 kB | 32/501 kB Progress (2): 179/780 kB | 32/501 kB Progress (2): 179/780 kB | 49/501 kB Progress (2): 179/780 kB | 65/501 kB Progress (2): 196/780 kB | 65/501 kB Progress (3): 196/780 kB | 65/501 kB | 16/27 kB Progress (3): 196/780 kB | 81/501 kB | 16/27 kB Progress (3): 196/780 kB | 98/501 kB | 16/27 kB Progress (3): 212/780 kB | 98/501 kB | 16/27 kB Progress (3): 212/780 kB | 114/501 kB | 16/27 kB Progress (3): 212/780 kB | 130/501 kB | 16/27 kB Progress (3): 229/780 kB | 130/501 kB | 16/27 kB Progress (3): 229/780 kB | 130/501 kB | 27 kB Progress (3): 229/780 kB | 147/501 kB | 27 kB Progress (3): 245/780 kB | 147/501 kB | 27 kB Progress (3): 245/780 kB | 163/501 kB | 27 kB Progress (3): 261/780 kB | 163/501 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 164 kB/s) 2024-09-12T00:36:24.864 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:36:24.875 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (3): 261/780 kB | 163/501 kB | 16/354 kB Progress (3): 261/780 kB | 180/501 kB | 16/354 kB Progress (3): 261/780 kB | 180/501 kB | 33/354 kB Progress (3): 261/780 kB | 196/501 kB | 33/354 kB Progress (3): 261/780 kB | 196/501 kB | 49/354 kB Progress (3): 261/780 kB | 212/501 kB | 49/354 kB Progress (3): 261/780 kB | 219/501 kB | 49/354 kB Progress (3): 261/780 kB | 219/501 kB | 66/354 kB Progress (3): 261/780 kB | 236/501 kB | 66/354 kB Progress (3): 261/780 kB | 236/501 kB | 78/354 kB Progress (3): 261/780 kB | 252/501 kB | 78/354 kB Progress (3): 261/780 kB | 252/501 kB | 94/354 kB Progress (3): 261/780 kB | 256/501 kB | 94/354 kB Progress (3): 261/780 kB | 256/501 kB | 111/354 kB Progress (3): 261/780 kB | 272/501 kB | 111/354 kB Progress (3): 261/780 kB | 272/501 kB | 127/354 kB Progress (3): 261/780 kB | 289/501 kB | 127/354 kB Progress (3): 261/780 kB | 289/501 kB | 143/354 kB Progress (3): 261/780 kB | 305/501 kB | 143/354 kB Progress (4): 261/780 kB | 305/501 kB | 143/354 kB | 16/329 kB Progress (4): 261/780 kB | 321/501 kB | 143/354 kB | 16/329 kB Progress (4): 261/780 kB | 321/501 kB | 160/354 kB | 16/329 kB Progress (4): 261/780 kB | 321/501 kB | 160/354 kB | 33/329 kB Progress (4): 261/780 kB | 338/501 kB | 160/354 kB | 33/329 kB Progress (4): 261/780 kB | 338/501 kB | 176/354 kB | 33/329 kB Progress (4): 261/780 kB | 338/501 kB | 176/354 kB | 49/329 kB Progress (4): 261/780 kB | 354/501 kB | 176/354 kB | 49/329 kB Progress (4): 261/780 kB | 354/501 kB | 193/354 kB | 49/329 kB Progress (4): 261/780 kB | 354/501 kB | 193/354 kB | 66/329 kB Progress (4): 261/780 kB | 370/501 kB | 193/354 kB | 66/329 kB Progress (4): 261/780 kB | 370/501 kB | 209/354 kB | 66/329 kB Progress (4): 278/780 kB | 370/501 kB | 209/354 kB | 66/329 kB Progress (4): 278/780 kB | 370/501 kB | 209/354 kB | 82/329 kB Progress (4): 278/780 kB | 370/501 kB | 225/354 kB | 82/329 kB Progress (4): 278/780 kB | 387/501 kB | 225/354 kB | 82/329 kB Progress (4): 278/780 kB | 387/501 kB | 225/354 kB | 98/329 kB Progress (4): 294/780 kB | 387/501 kB | 225/354 kB | 98/329 kB Progress (4): 294/780 kB | 387/501 kB | 242/354 kB | 98/329 kB Progress (4): 294/780 kB | 387/501 kB | 242/354 kB | 115/329 kB Progress (4): 294/780 kB | 403/501 kB | 242/354 kB | 115/329 kB Progress (4): 294/780 kB | 403/501 kB | 258/354 kB | 115/329 kB Progress (4): 310/780 kB | 403/501 kB | 258/354 kB | 115/329 kB Progress (4): 310/780 kB | 403/501 kB | 258/354 kB | 131/329 kB Progress (4): 310/780 kB | 420/501 kB | 258/354 kB | 131/329 kB Progress (4): 310/780 kB | 420/501 kB | 258/354 kB | 147/329 kB Progress (4): 327/780 kB | 420/501 kB | 258/354 kB | 147/329 kB Progress (4): 327/780 kB | 420/501 kB | 258/354 kB | 164/329 kB Progress (4): 327/780 kB | 436/501 kB | 258/354 kB | 164/329 kB Progress (4): 343/780 kB | 436/501 kB | 258/354 kB | 164/329 kB Progress (4): 343/780 kB | 436/501 kB | 258/354 kB | 180/329 kB Progress (4): 343/780 kB | 452/501 kB | 258/354 kB | 180/329 kB Progress (4): 360/780 kB | 452/501 kB | 258/354 kB | 180/329 kB Progress (4): 360/780 kB | 452/501 kB | 258/354 kB | 197/329 kB Progress (4): 360/780 kB | 469/501 kB | 258/354 kB | 197/329 kB Progress (4): 376/780 kB | 469/501 kB | 258/354 kB | 197/329 kB Progress (4): 376/780 kB | 469/501 kB | 258/354 kB | 213/329 kB Progress (4): 376/780 kB | 485/501 kB | 258/354 kB | 213/329 kB Progress (4): 392/780 kB | 485/501 kB | 258/354 kB | 213/329 kB Progress (4): 392/780 kB | 485/501 kB | 258/354 kB | 229/329 kB Progress (4): 392/780 kB | 501 kB | 258/354 kB | 229/329 kB Progress (4): 409/780 kB | 501 kB | 258/354 kB | 229/329 kB Progress (4): 413/780 kB | 501 kB | 258/354 kB | 229/329 kB Progress (4): 413/780 kB | 501 kB | 258/354 kB | 246/329 kB Progress (4): 429/780 kB | 501 kB | 258/354 kB | 246/329 kB Progress (4): 429/780 kB | 501 kB | 258/354 kB | 256/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.9 MB/s) 2024-09-12T00:36:24.875 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (3): 446/780 kB | 258/354 kB | 256/329 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:36:24.878 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (3): 458/780 kB | 258/354 kB | 256/329 kB Progress (3): 458/780 kB | 258/354 kB | 272/329 kB Progress (3): 474/780 kB | 258/354 kB | 272/329 kB Progress (3): 474/780 kB | 274/354 kB | 272/329 kB Progress (3): 474/780 kB | 274/354 kB | 289/329 kB Progress (3): 491/780 kB | 274/354 kB | 289/329 kB Progress (3): 491/780 kB | 291/354 kB | 289/329 kB Progress (3): 507/780 kB | 291/354 kB | 289/329 kB Progress (3): 507/780 kB | 291/354 kB | 305/329 kB Progress (3): 507/780 kB | 307/354 kB | 305/329 kB Progress (3): 523/780 kB | 307/354 kB | 305/329 kB Progress (3): 523/780 kB | 324/354 kB | 305/329 kB Progress (3): 540/780 kB | 324/354 kB | 305/329 kB Progress (3): 540/780 kB | 324/354 kB | 321/329 kB Progress (3): 540/780 kB | 340/354 kB | 321/329 kB Progress (3): 556/780 kB | 340/354 kB | 321/329 kB Progress (3): 556/780 kB | 340/354 kB | 329 kB Progress (3): 556/780 kB | 354 kB | 329 kB Progress (3): 573/780 kB | 354 kB | 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.0 MB/s) 2024-09-12T00:36:24.878 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:36:24.878 INFO:tasks.workunit.client.0.smithi137.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.8 MB/s) 2024-09-12T00:36:24.878 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 589/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:36:24.884 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 605/780 kB Progress (1): 622/780 kB Progress (1): 638/780 kB Progress (1): 655/780 kB Progress (1): 671/780 kB Progress (1): 687/780 kB Progress (1): 704/780 kB Progress (1): 720/780 kB Progress (1): 736/780 kB Progress (1): 753/780 kB Progress (1): 769/780 kB Progress (1): 780 kB Progress (2): 780 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.2 MB/s) 2024-09-12T00:36:24.884 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:36:24.886 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 32/41 kB Progress (1): 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 221 kB/s) 2024-09-12T00:36:24.886 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:36:24.891 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 33 kB/s) 2024-09-12T00:36:24.891 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:36:24.899 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/211 kB Progress (1): 33/211 kB Progress (1): 49/211 kB Progress (1): 65/211 kB Progress (1): 81/211 kB Progress (1): 98/211 kB Progress (1): 114/211 kB Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (1): 163/211 kB Progress (1): 180/211 kB Progress (1): 196/211 kB Progress (1): 211 kB Progress (2): 211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-12T00:36:24.899 INFO:tasks.workunit.client.0.smithi137.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 72 kB/s) 2024-09-12T00:36:24.899 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:36:24.899 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:36:24.906 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/586 kB Progress (1): 32/586 kB Progress (1): 49/586 kB Progress (1): 65/586 kB Progress (1): 81/586 kB Progress (2): 81/586 kB | 6.8 kB Progress (2): 98/586 kB | 6.8 kB Progress (2): 114/586 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 33 kB/s) 2024-09-12T00:36:24.906 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:36:24.931 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 130/586 kB Progress (1): 147/586 kB Progress (1): 163/586 kB Progress (1): 180/586 kB Progress (1): 196/586 kB Progress (1): 212/586 kB Progress (1): 229/586 kB Progress (1): 245/586 kB Progress (1): 262/586 kB Progress (1): 278/586 kB Progress (1): 294/586 kB Progress (1): 311/586 kB Progress (1): 327/586 kB Progress (1): 343/586 kB Progress (1): 360/586 kB Progress (1): 376/586 kB Progress (1): 393/586 kB Progress (1): 402/586 kB Progress (1): 418/586 kB Progress (1): 435/586 kB Progress (1): 451/586 kB Progress (1): 468/586 kB Progress (1): 484/586 kB Progress (1): 500/586 kB Progress (1): 517/586 kB Progress (1): 533/586 kB Progress (2): 533/586 kB | 16/205 kB Progress (2): 549/586 kB | 16/205 kB Progress (2): 549/586 kB | 32/205 kB Progress (2): 566/586 kB | 32/205 kB Progress (2): 566/586 kB | 49/205 kB Progress (2): 582/586 kB | 49/205 kB Progress (2): 586 kB | 49/205 kB Progress (2): 586 kB | 65/205 kB Progress (2): 586 kB | 81/205 kB Progress (2): 586 kB | 98/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.6 MB/s) 2024-09-12T00:36:24.931 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:36:24.932 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 114/205 kB Progress (2): 114/205 kB | 15 kB Progress (3): 114/205 kB | 15 kB | 16/245 kB Progress (3): 130/205 kB | 15 kB | 16/245 kB Progress (3): 147/205 kB | 15 kB | 16/245 kB Progress (3): 147/205 kB | 15 kB | 33/245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 66 kB/s) 2024-09-12T00:36:24.933 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:36:24.934 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 163/205 kB | 33/245 kB Progress (2): 163/205 kB | 49/245 kB Progress (2): 180/205 kB | 49/245 kB Progress (2): 180/205 kB | 66/245 kB Progress (2): 196/205 kB | 66/245 kB Progress (2): 196/205 kB | 82/245 kB Progress (2): 205 kB | 82/245 kB Progress (3): 205 kB | 82/245 kB | 16/106 kB Progress (3): 205 kB | 98/245 kB | 16/106 kB Progress (3): 205 kB | 115/245 kB | 16/106 kB Progress (3): 205 kB | 115/245 kB | 32/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 879 kB/s) 2024-09-12T00:36:24.934 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 131/245 kB | 32/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:36:24.936 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 131/245 kB | 49/106 kB Progress (2): 147/245 kB | 49/106 kB Progress (2): 147/245 kB | 65/106 kB Progress (2): 164/245 kB | 65/106 kB Progress (2): 164/245 kB | 81/106 kB Progress (2): 164/245 kB | 98/106 kB Progress (2): 180/245 kB | 98/106 kB Progress (2): 180/245 kB | 106 kB Progress (2): 197/245 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 452 kB/s) 2024-09-12T00:36:24.936 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 213/245 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:36:24.937 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.0 MB/s) 2024-09-12T00:36:24.937 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:36:24.946 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Progress (2): 16 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 67 kB/s) 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi137.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 26 kB/s) 2024-09-12T00:36:24.952 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 90 kB/s) 2024-09-12T00:36:24.953 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 68 kB/s) 2024-09-12T00:36:24.969 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/24 kB Progress (2): 16/24 kB | 16/184 kB Progress (2): 16/24 kB | 33/184 kB Progress (2): 16/24 kB | 49/184 kB Progress (2): 16/24 kB | 66/184 kB Progress (2): 16/24 kB | 82/184 kB Progress (2): 16/24 kB | 98/184 kB Progress (2): 16/24 kB | 115/184 kB Progress (2): 16/24 kB | 131/184 kB Progress (2): 16/24 kB | 147/184 kB Progress (2): 16/24 kB | 164/184 kB Progress (2): 16/24 kB | 180/184 kB Progress (2): 16/24 kB | 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 683 kB/s) 2024-09-12T00:36:24.972 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 89 kB/s) 2024-09-12T00:36:25.003 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:25.003 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:36:25.009 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:36:25.034 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 243 kB/s) 2024-09-12T00:36:25.037 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:36:25.064 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 189 kB/s) 2024-09-12T00:36:25.066 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:36:25.086 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15/43 kB Progress (1): 31/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.3 MB/s) 2024-09-12T00:36:25.091 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:36:25.108 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-09-12T00:36:25.115 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:36:25.135 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.7 MB/s) 2024-09-12T00:36:25.135 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:36:25.158 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 130/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 9.3 MB/s) 2024-09-12T00:36:25.235 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:25.235 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:36:25.241 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:36:25.256 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 166 kB/s) 2024-09-12T00:36:25.259 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.1 MB/s) 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 516 kB/s) 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.5 MB/s) 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 201 kB/s) 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 169 kB/s) 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 36 kB/s) 2024-09-12T00:36:25.403 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:36:25.418 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-12T00:36:25.421 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:36:25.437 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-09-12T00:36:25.443 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:36:25.461 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 178 kB/s) 2024-09-12T00:36:25.465 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:36:25.491 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 321 kB/s) 2024-09-12T00:36:25.495 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:36:25.512 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 465 kB/s) 2024-09-12T00:36:25.518 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:36:25.538 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 382 kB/s) 2024-09-12T00:36:25.545 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:36:25.565 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 986 kB/s) 2024-09-12T00:36:25.575 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:36:25.595 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 268 kB/s) 2024-09-12T00:36:25.600 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:36:25.617 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.7 MB/s) 2024-09-12T00:36:25.628 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:36:25.643 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-09-12T00:36:25.653 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:36:25.671 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 63/85 kB Progress (1): 79/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.5 MB/s) 2024-09-12T00:36:25.672 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:36:25.672 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:36:25.673 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:36:25.673 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:36:25.674 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:36:25.690 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/41 kB Progress (2): 16/41 kB | 15/269 kB Progress (2): 33/41 kB | 15/269 kB Progress (2): 41 kB | 15/269 kB Progress (2): 41 kB | 31/269 kB Progress (2): 41 kB | 48/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-09-12T00:36:25.690 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 48/269 kB | 15/55 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:36:25.692 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 64/269 kB | 15/55 kB Progress (2): 64/269 kB | 31/55 kB Progress (2): 80/269 kB | 31/55 kB Progress (2): 80/269 kB | 48/55 kB Progress (2): 96/269 kB | 48/55 kB Progress (2): 96/269 kB | 55 kB Progress (3): 96/269 kB | 55 kB | 2.5 kB Progress (4): 96/269 kB | 55 kB | 2.5 kB | 8.5 kB Progress (4): 112/269 kB | 55 kB | 2.5 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.7 MB/s) 2024-09-12T00:36:25.693 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:36:25.693 INFO:tasks.workunit.client.0.smithi137.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 125 kB/s) 2024-09-12T00:36:25.693 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 129/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 424 kB/s) 2024-09-12T00:36:25.696 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 11 MB/s) 2024-09-12T00:36:25.711 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 66/327 kB Progress (1): 82/327 kB Progress (1): 98/327 kB Progress (1): 115/327 kB Progress (1): 131/327 kB Progress (1): 147/327 kB Progress (1): 164/327 kB Progress (1): 180/327 kB Progress (1): 197/327 kB Progress (1): 213/327 kB Progress (1): 229/327 kB Progress (1): 246/327 kB Progress (1): 256/327 kB Progress (1): 272/327 kB Progress (1): 289/327 kB Progress (1): 292/327 kB Progress (1): 309/327 kB Progress (1): 325/327 kB Progress (1): 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.6 MB/s) 2024-09-12T00:36:25.727 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (1): 49/587 kB Progress (1): 64/587 kB Progress (1): 81/587 kB Progress (1): 97/587 kB Progress (1): 113/587 kB Progress (1): 130/587 kB Progress (1): 146/587 kB Progress (1): 158/587 kB Progress (1): 175/587 kB Progress (1): 191/587 kB Progress (1): 208/587 kB Progress (1): 224/587 kB Progress (1): 240/587 kB Progress (1): 257/587 kB Progress (1): 273/587 kB Progress (1): 289/587 kB Progress (1): 306/587 kB Progress (1): 322/587 kB Progress (1): 339/587 kB Progress (1): 355/587 kB Progress (1): 371/587 kB Progress (1): 388/587 kB Progress (1): 404/587 kB Progress (1): 421/587 kB Progress (1): 437/587 kB Progress (1): 453/587 kB Progress (1): 470/587 kB Progress (1): 486/587 kB Progress (1): 502/587 kB Progress (1): 519/587 kB Progress (1): 535/587 kB Progress (1): 552/587 kB Progress (1): 568/587 kB Progress (1): 584/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 11 MB/s) 2024-09-12T00:36:25.779 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:36:25.780 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:25.780 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:36:25.786 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:36:25.800 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T00:36:25.803 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:36:25.818 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T00:36:25.820 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:36:25.836 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-12T00:36:25.839 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:36:25.853 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-12T00:36:25.858 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:36:25.873 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-12T00:36:25.875 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:36:25.889 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-12T00:36:25.892 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:36:25.907 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T00:36:25.911 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:36:25.927 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 292 kB/s) 2024-09-12T00:36:25.930 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:36:25.945 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 259 kB/s) 2024-09-12T00:36:25.949 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:36:25.967 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 132 kB/s) 2024-09-12T00:36:25.969 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:36:25.985 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T00:36:25.988 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:36:26.005 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.0 MB/s) 2024-09-12T00:36:26.008 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:36:26.026 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 365 kB/s) 2024-09-12T00:36:26.029 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:36:26.050 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 50 kB/s) 2024-09-12T00:36:26.053 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:36:26.070 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 493 kB/s) 2024-09-12T00:36:26.075 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:36:26.091 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-09-12T00:36:26.096 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:36:26.111 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-12T00:36:26.117 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:36:26.134 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-12T00:36:26.141 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:36:26.158 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 45 kB/s) 2024-09-12T00:36:26.162 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:36:26.179 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 355 kB/s) 2024-09-12T00:36:26.182 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:36:26.204 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.2 MB/s) 2024-09-12T00:36:26.211 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:36:26.227 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 75 kB/s) 2024-09-12T00:36:26.230 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:36:26.246 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-12T00:36:26.265 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:36:26.281 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 846 kB/s) 2024-09-12T00:36:26.282 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:36:26.282 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:36:26.282 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:36:26.283 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:36:26.283 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:36:26.299 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 234 kB/s) 2024-09-12T00:36:26.299 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:36:26.302 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 33/334 kB Progress (1): 49/334 kB Progress (1): 66/334 kB Progress (1): 82/334 kB Progress (2): 82/334 kB | 16/27 kB Progress (2): 98/334 kB | 16/27 kB Progress (2): 98/334 kB | 27 kB Progress (2): 115/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.4 MB/s) 2024-09-12T00:36:26.302 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 131/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:36:26.304 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 147/334 kB Progress (2): 147/334 kB | 16/55 kB Progress (2): 164/334 kB | 16/55 kB Progress (2): 164/334 kB | 33/55 kB Progress (2): 180/334 kB | 33/55 kB Progress (2): 180/334 kB | 49/55 kB Progress (2): 197/334 kB | 49/55 kB Progress (2): 197/334 kB | 55 kB Progress (2): 213/334 kB | 55 kB Progress (3): 213/334 kB | 55 kB | 16/122 kB Progress (3): 229/334 kB | 55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.5 MB/s) 2024-09-12T00:36:26.304 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 229/334 kB | 32/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:36:26.307 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 246/334 kB | 32/122 kB Progress (2): 246/334 kB | 49/122 kB Progress (2): 256/334 kB | 49/122 kB Progress (2): 256/334 kB | 65/122 kB Progress (2): 272/334 kB | 65/122 kB Progress (2): 272/334 kB | 81/122 kB Progress (2): 289/334 kB | 81/122 kB Progress (2): 289/334 kB | 98/122 kB Progress (2): 305/334 kB | 98/122 kB Progress (2): 305/334 kB | 114/122 kB Progress (2): 305/334 kB | 122 kB Progress (2): 321/334 kB | 122 kB Progress (2): 334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 4.9 MB/s) 2024-09-12T00:36:26.307 INFO:tasks.workunit.client.0.smithi137.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 13 MB/s) 2024-09-12T00:36:26.317 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/267 kB Progress (2): 16/267 kB | 4.7 kB Progress (2): 33/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 137 kB/s) 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (2): 98/267 kB | 16/23 kB Progress (2): 115/267 kB | 16/23 kB Progress (2): 115/267 kB | 23 kB Progress (2): 131/267 kB | 23 kB Progress (2): 147/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 633 kB/s) 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 6.9 MB/s) 2024-09-12T00:36:26.461 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:36:26.463 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:36:27.679 INFO:tasks.workunit.client.0.smithi137.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:36:27.679 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:27.679 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:36:27.683 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:36:27.684 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:27.684 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:36:27.691 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:36:27.691 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi137.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 390 kB/s) 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:36:27.970 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 153 kB/s) 2024-09-12T00:36:27.976 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:36:27.996 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 155 kB/s) 2024-09-12T00:36:28.001 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:36:28.021 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 203 kB/s) 2024-09-12T00:36:28.025 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:36:28.041 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 194 kB/s) 2024-09-12T00:36:28.045 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 98 kB/s) 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.8 MB/s) 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 112 kB/s) 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 305 kB/s) 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:36:28.185 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 147 kB/s) 2024-09-12T00:36:28.188 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:36:28.204 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.4 MB/s) 2024-09-12T00:36:28.207 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:36:28.225 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.0 MB/s) 2024-09-12T00:36:28.228 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:36:28.244 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-12T00:36:28.248 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:36:28.263 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-09-12T00:36:28.266 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:36:28.283 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-09-12T00:36:28.287 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:36:28.336 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 168 kB/s) 2024-09-12T00:36:28.340 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:36:28.355 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-12T00:36:28.359 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:36:28.378 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 130 kB/s) 2024-09-12T00:36:28.381 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:36:28.397 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-12T00:36:28.399 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:36:28.421 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 139 kB/s) 2024-09-12T00:36:28.423 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:36:28.441 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.2 MB/s) 2024-09-12T00:36:28.445 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:36:28.462 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 398 kB/s) 2024-09-12T00:36:28.466 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:36:28.483 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 798 kB/s) 2024-09-12T00:36:28.489 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:36:28.511 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 135 kB/s) 2024-09-12T00:36:28.515 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:36:28.535 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 340 kB/s) 2024-09-12T00:36:28.538 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:36:28.558 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 420 kB/s) 2024-09-12T00:36:28.562 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:36:28.587 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 83 kB/s) 2024-09-12T00:36:28.592 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:36:28.615 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 97 kB/s) 2024-09-12T00:36:28.623 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:36:28.642 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 159 kB/s) 2024-09-12T00:36:28.653 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:36:28.673 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 713 kB/s) 2024-09-12T00:36:28.678 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:36:28.694 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-09-12T00:36:28.700 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:36:28.723 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 560 kB/s) 2024-09-12T00:36:28.726 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:36:28.748 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 218 kB/s) 2024-09-12T00:36:28.752 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:36:28.769 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 349 kB/s) 2024-09-12T00:36:28.773 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:36:28.792 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.6 MB/s) 2024-09-12T00:36:28.799 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:36:28.816 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 963 kB/s) 2024-09-12T00:36:28.820 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:36:28.841 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 705 kB/s) 2024-09-12T00:36:28.848 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:36:28.868 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 36 kB/s) 2024-09-12T00:36:28.872 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:36:28.892 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 240 kB/s) 2024-09-12T00:36:28.897 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:36:28.914 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-09-12T00:36:28.919 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:36:28.938 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 166 kB/s) 2024-09-12T00:36:28.945 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:36:28.974 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 152 kB/s) 2024-09-12T00:36:28.980 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:36:28.999 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 108 kB/s) 2024-09-12T00:36:29.005 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:36:29.026 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 165 kB/s) 2024-09-12T00:36:29.033 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:36:29.049 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-09-12T00:36:29.053 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:36:29.075 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 642 kB/s) 2024-09-12T00:36:29.078 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:36:29.111 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 568 kB/s) 2024-09-12T00:36:29.117 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:36:29.135 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 20 kB/s) 2024-09-12T00:36:29.140 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:36:29.159 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 321 kB/s) 2024-09-12T00:36:29.162 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:36:29.182 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 386 kB/s) 2024-09-12T00:36:29.187 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:36:29.204 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-09-12T00:36:29.211 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:36:29.229 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 406 kB/s) 2024-09-12T00:36:29.236 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:36:29.253 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.2 MB/s) 2024-09-12T00:36:29.258 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:36:29.280 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 3.5 MB/s) 2024-09-12T00:36:29.291 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.1 MB/s) 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:36:29.336 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 353 kB/s) 2024-09-12T00:36:29.341 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:36:29.360 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 225 kB/s) 2024-09-12T00:36:29.365 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:36:29.381 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-09-12T00:36:29.384 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:36:29.406 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.2 MB/s) 2024-09-12T00:36:29.413 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:36:29.430 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 148 kB/s) 2024-09-12T00:36:29.447 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:36:29.482 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 8.6 MB/s) 2024-09-12T00:36:29.483 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:36:29.483 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:36:29.483 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:36:29.484 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:36:29.484 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:36:29.501 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-09-12T00:36:29.501 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:36:29.509 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 62/171 kB Progress (1): 79/171 kB Progress (1): 95/171 kB Progress (1): 112/171 kB Progress (1): 128/171 kB Progress (1): 144/171 kB Progress (1): 161/171 kB Progress (1): 171 kB Progress (2): 171 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 6.6 MB/s) 2024-09-12T00:36:29.509 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 16/118 kB | 16/26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:36:29.510 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 32/118 kB | 16/26 kB Progress (2): 49/118 kB | 16/26 kB Progress (2): 49/118 kB | 26 kB Progress (2): 65/118 kB | 26 kB Progress (2): 81/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 957 kB/s) 2024-09-12T00:36:29.510 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:36:29.511 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 98/118 kB Progress (1): 114/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 4.2 MB/s) 2024-09-12T00:36:29.511 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:36:29.522 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/146 kB Progress (1): 32/146 kB Progress (1): 49/146 kB Progress (1): 65/146 kB Progress (1): 81/146 kB Progress (1): 98/146 kB Progress (1): 114/146 kB Progress (1): 130/146 kB Progress (1): 146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.9 MB/s) 2024-09-12T00:36:29.522 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:36:29.528 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/61 kB Progress (1): 33/61 kB Progress (1): 49/61 kB Progress (1): 61 kB Progress (2): 61 kB | 16/136 kB Progress (2): 61 kB | 32/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.4 MB/s) 2024-09-12T00:36:29.528 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:36:29.532 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 32/136 kB | 16/501 kB Progress (2): 49/136 kB | 16/501 kB Progress (2): 49/136 kB | 32/501 kB Progress (2): 65/136 kB | 32/501 kB Progress (2): 65/136 kB | 49/501 kB Progress (2): 81/136 kB | 49/501 kB Progress (2): 81/136 kB | 65/501 kB Progress (2): 98/136 kB | 65/501 kB Progress (2): 98/136 kB | 81/501 kB Progress (2): 98/136 kB | 98/501 kB Progress (2): 114/136 kB | 98/501 kB Progress (2): 114/136 kB | 114/501 kB Progress (2): 130/136 kB | 114/501 kB Progress (2): 130/136 kB | 130/501 kB Progress (2): 136 kB | 130/501 kB Progress (2): 136 kB | 147/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 2.9 MB/s) 2024-09-12T00:36:29.532 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 163/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:36:29.533 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 180/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (2): 212/501 kB | 8.2 kB Progress (2): 229/501 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 163 kB/s) 2024-09-12T00:36:29.540 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 245/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (1): 402/501 kB Progress (1): 418/501 kB Progress (1): 435/501 kB Progress (1): 451/501 kB Progress (1): 468/501 kB Progress (1): 484/501 kB Progress (1): 500/501 kB Progress (1): 501 kB Progress (2): 501 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 8.9 MB/s) 2024-09-12T00:36:29.541 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 32/58 kB Progress (1): 49/58 kB Progress (1): 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.0 MB/s) 2024-09-12T00:36:29.546 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.0 MB/s) 2024-09-12T00:36:29.618 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 18 MB/s) 2024-09-12T00:36:29.772 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:29.772 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:36:29.778 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:36:29.797 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 224 kB/s) 2024-09-12T00:36:29.800 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:36:29.819 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 258 kB/s) 2024-09-12T00:36:29.822 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:36:29.838 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.8 MB/s) 2024-09-12T00:36:29.841 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:36:29.859 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.1 MB/s) 2024-09-12T00:36:29.864 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:36:29.879 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 324 kB/s) 2024-09-12T00:36:29.884 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:36:29.900 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 245 kB/s) 2024-09-12T00:36:29.906 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:36:29.930 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 261 kB/s) 2024-09-12T00:36:29.935 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:36:29.953 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 368 kB/s) 2024-09-12T00:36:29.957 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:36:29.974 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-09-12T00:36:29.985 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:36:30.002 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 855 kB/s) 2024-09-12T00:36:30.007 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:36:30.023 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 120 kB/s) 2024-09-12T00:36:30.028 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:36:30.045 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 483 kB/s) 2024-09-12T00:36:30.049 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:36:30.071 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.2 MB/s) 2024-09-12T00:36:30.084 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:36:30.100 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.0 MB/s) 2024-09-12T00:36:30.100 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:36:30.100 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:36:30.101 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:36:30.101 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:36:30.101 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:36:30.119 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (2): 49/79 kB | 16/26 kB Progress (3): 49/79 kB | 16/26 kB | 16/58 kB Progress (3): 66/79 kB | 16/26 kB | 16/58 kB Progress (4): 66/79 kB | 16/26 kB | 16/58 kB | 0/1.0 MB Progress (4): 66/79 kB | 26 kB | 16/58 kB | 0/1.0 MB Progress (4): 79 kB | 26 kB | 16/58 kB | 0/1.0 MB Progress (4): 79 kB | 26 kB | 16/58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T00:36:30.119 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (4): 26 kB | 16/58 kB | 0/1.0 MB | 16/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:36:30.119 INFO:tasks.workunit.client.0.smithi137.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.4 MB/s) 2024-09-12T00:36:30.119 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (3): 16/58 kB | 0/1.0 MB | 16/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:36:30.121 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (3): 32/58 kB | 0/1.0 MB | 16/211 kB Progress (3): 32/58 kB | 0/1.0 MB | 32/211 kB Progress (3): 32/58 kB | 0.1/1.0 MB | 32/211 kB Progress (3): 32/58 kB | 0.1/1.0 MB | 49/211 kB Progress (3): 49/58 kB | 0.1/1.0 MB | 49/211 kB Progress (3): 49/58 kB | 0.1/1.0 MB | 49/211 kB Progress (3): 49/58 kB | 0.1/1.0 MB | 65/211 kB Progress (3): 49/58 kB | 0.1/1.0 MB | 65/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 65/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 81/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 81/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 98/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 98/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 114/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 114/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.9 MB/s) 2024-09-12T00:36:30.124 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 0.2/1.0 MB | 114/211 kB Progress (2): 0.2/1.0 MB | 130/211 kB Progress (2): 0.2/1.0 MB | 130/211 kB Progress (2): 0.2/1.0 MB | 147/211 kB Progress (2): 0.2/1.0 MB | 147/211 kB Progress (2): 0.2/1.0 MB | 163/211 kB Progress (2): 0.2/1.0 MB | 163/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 196/211 kB Progress (2): 0.2/1.0 MB | 196/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.2 MB/s) 2024-09-12T00:36:30.136 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 32/116 kB Progress (2): 0.9/1.0 MB | 32/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 0.9/1.0 MB | 64/116 kB Progress (2): 0.9/1.0 MB | 64/116 kB Progress (2): 0.9/1.0 MB | 78/116 kB Progress (2): 0.9/1.0 MB | 78/116 kB Progress (2): 0.9/1.0 MB | 95/116 kB Progress (2): 0.9/1.0 MB | 95/116 kB Progress (2): 0.9/1.0 MB | 111/116 kB Progress (2): 0.9/1.0 MB | 116 kB Progress (2): 0.9/1.0 MB | 116 kB Progress (2): 1.0/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.3 MB/s) 2024-09-12T00:36:30.139 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/267 kB Progress (2): 1.0/1.0 MB | 16/267 kB Progress (2): 1.0/1.0 MB | 32/267 kB Progress (2): 1.0/1.0 MB | 32/267 kB Progress (2): 1.0 MB | 32/267 kB Progress (2): 1.0 MB | 49/267 kB Progress (2): 1.0 MB | 65/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 27 MB/s) 2024-09-12T00:36:30.143 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.4 MB/s) 2024-09-12T00:36:30.337 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:36:30.365 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:36:30.365 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:36:30.365 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:36:30.365 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Total time: 8.500 s 2024-09-12T00:36:30.365 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Finished at: 2024-09-12T00:36:30Z 2024-09-12T00:36:30.366 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:36:30.395 INFO:tasks.workunit.client.0.smithi137.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:36:30.401 INFO:tasks.workunit.client.0.smithi137.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:36:31.613 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Scanning for projects... 2024-09-12T00:36:31.719 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:31.719 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:36:31.719 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:36:31.719 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] from pom.xml 2024-09-12T00:36:31.719 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:36:32.087 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:32.087 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:36:32.218 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:36:32.219 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:32.219 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:36:32.314 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:36:32.314 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:32.314 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:36:32.316 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:36:32.316 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:32.316 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:36:32.321 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:36:32.322 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:32.322 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:36:32.517 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:36:32.720 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:36:32.909 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-12T00:36:32.917 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:36:32.941 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 109 kB/s) 2024-09-12T00:36:32.947 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:36:32.966 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-12T00:36:32.970 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:36:32.988 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T00:36:32.991 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:36:33.012 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 160 kB/s) 2024-09-12T00:36:33.015 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:36:33.032 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-12T00:36:33.035 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:36:33.053 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 149 kB/s) 2024-09-12T00:36:33.059 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:36:33.082 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 17/27 kB Progress (1): 19/27 kB Progress (1): 20/27 kB Progress (1): 21/27 kB Progress (1): 23/27 kB Progress (1): 24/27 kB Progress (1): 25/27 kB Progress (1): 27/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T00:36:33.084 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:36:33.084 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:36:33.085 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:36:33.085 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:36:33.087 INFO:tasks.workunit.client.0.smithi137.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:36:33.129 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.8 MB/s) 2024-09-12T00:36:33.144 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 1.4/103 kB Progress (2): 1.4/103 kB | 1.4/7.7 kB Progress (2): 2.8/103 kB | 1.4/7.7 kB Progress (2): 2.8/103 kB | 2.8/7.7 kB Progress (2): 4.1/103 kB | 2.8/7.7 kB Progress (2): 4.1/103 kB | 4.1/7.7 kB Progress (3): 4.1/103 kB | 4.1/7.7 kB | 1.4/18 kB Progress (3): 4.1/103 kB | 5.5/7.7 kB | 1.4/18 kB Progress (3): 5.5/103 kB | 5.5/7.7 kB | 1.4/18 kB Progress (3): 5.5/103 kB | 6.9/7.7 kB | 1.4/18 kB Progress (3): 5.5/103 kB | 6.9/7.7 kB | 2.8/18 kB Progress (3): 5.5/103 kB | 7.7 kB | 2.8/18 kB Progress (4): 5.5/103 kB | 7.7 kB | 2.8/18 kB | 1.4/189 kB Progress (4): 6.9/103 kB | 7.7 kB | 2.8/18 kB | 1.4/189 kB Progress (4): 6.9/103 kB | 7.7 kB | 2.8/18 kB | 2.8/189 kB Progress (4): 6.9/103 kB | 7.7 kB | 4.1/18 kB | 2.8/189 kB Progress (4): 6.9/103 kB | 7.7 kB | 4.1/18 kB | 4.1/189 kB Progress (4): 8.3/103 kB | 7.7 kB | 4.1/18 kB | 4.1/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 130 kB/s) 2024-09-12T00:36:33.154 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (3): 8.3/103 kB | 4.1/18 kB | 5.5/189 kB Progress (3): 8.3/103 kB | 5.5/18 kB | 5.5/189 kB Progress (3): 8.3/103 kB | 5.5/18 kB | 6.9/189 kB Progress (3): 9.7/103 kB | 5.5/18 kB | 6.9/189 kB Progress (3): 9.7/103 kB | 5.5/18 kB | 8.3/189 kB Progress (3): 9.7/103 kB | 6.9/18 kB | 8.3/189 kB Progress (3): 9.7/103 kB | 6.9/18 kB | 9.7/189 kB Progress (3): 11/103 kB | 6.9/18 kB | 9.7/189 kB Progress (3): 11/103 kB | 6.9/18 kB | 11/189 kB Progress (3): 11/103 kB | 8.3/18 kB | 11/189 kB Progress (3): 11/103 kB | 8.3/18 kB | 12/189 kB Progress (3): 12/103 kB | 8.3/18 kB | 12/189 kB Progress (3): 12/103 kB | 8.3/18 kB | 14/189 kB Progress (3): 14/103 kB | 8.3/18 kB | 14/189 kB Progress (3): 14/103 kB | 9.7/18 kB | 14/189 kB Progress (3): 15/103 kB | 9.7/18 kB | 14/189 kB Progress (3): 15/103 kB | 9.7/18 kB | 15/189 kB Progress (3): 16/103 kB | 9.7/18 kB | 15/189 kB Progress (3): 16/103 kB | 11/18 kB | 15/189 kB Progress (3): 18/103 kB | 11/18 kB | 15/189 kB Progress (3): 18/103 kB | 11/18 kB | 16/189 kB Progress (3): 19/103 kB | 11/18 kB | 16/189 kB Progress (3): 19/103 kB | 12/18 kB | 16/189 kB Progress (3): 21/103 kB | 12/18 kB | 16/189 kB Progress (3): 21/103 kB | 14/18 kB | 16/189 kB Progress (3): 21/103 kB | 14/18 kB | 32/189 kB Progress (3): 22/103 kB | 14/18 kB | 32/189 kB Progress (3): 22/103 kB | 15/18 kB | 32/189 kB Progress (3): 23/103 kB | 15/18 kB | 32/189 kB Progress (3): 23/103 kB | 16/18 kB | 32/189 kB Progress (3): 25/103 kB | 16/18 kB | 32/189 kB Progress (3): 25/103 kB | 17/18 kB | 32/189 kB Progress (3): 26/103 kB | 17/18 kB | 32/189 kB Progress (3): 26/103 kB | 18 kB | 32/189 kB Progress (3): 27/103 kB | 18 kB | 32/189 kB Progress (3): 29/103 kB | 18 kB | 32/189 kB Progress (3): 29/103 kB | 18 kB | 49/189 kB Progress (3): 30/103 kB | 18 kB | 49/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 244 kB/s) 2024-09-12T00:36:33.166 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (2): 32/103 kB | 49/189 kB Progress (2): 33/103 kB | 49/189 kB Progress (2): 34/103 kB | 49/189 kB Progress (2): 36/103 kB | 49/189 kB Progress (2): 36/103 kB | 65/189 kB Progress (2): 37/103 kB | 65/189 kB Progress (2): 38/103 kB | 65/189 kB Progress (2): 40/103 kB | 65/189 kB Progress (2): 41/103 kB | 65/189 kB Progress (2): 43/103 kB | 65/189 kB Progress (2): 44/103 kB | 65/189 kB Progress (2): 45/103 kB | 65/189 kB Progress (2): 47/103 kB | 65/189 kB Progress (2): 48/103 kB | 65/189 kB Progress (2): 49/103 kB | 65/189 kB Progress (2): 66/103 kB | 65/189 kB Progress (2): 82/103 kB | 65/189 kB Progress (2): 98/103 kB | 65/189 kB Progress (2): 98/103 kB | 81/189 kB Progress (2): 103 kB | 81/189 kB Progress (2): 103 kB | 98/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T00:36:33.177 INFO:tasks.workunit.client.0.smithi137.stdout:Progress (1): 114/189 kB Progress (1): 130/189 kB Progress (1): 147/189 kB Progress (1): 163/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-12T00:36:33.194 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:33.194 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:36:33.194 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] T E S T S 2024-09-12T00:36:33.194 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:36:33.822 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:36:33.868 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjects.java: starting test run: 2024-09-12T00:36:33.868 INFO:tasks.workunit.client.0.smithi137.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:36:33.868 INFO:tasks.workunit.client.0.smithi137.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:36:33.868 INFO:tasks.workunit.client.0.smithi137.stdout: EndpointUrl=https://smithi137.front.sepia.ceph.com:443 2024-09-12T00:36:33.965 INFO:tasks.workunit.client.0.smithi137.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:36:34.065 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Environment Variables Read 2024-09-12T00:36:34.467 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:36:34.467 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Generating File 2024-09-12T00:36:34.467 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: File Generated 2024-09-12T00:36:34.468 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Generating File 2024-09-12T00:36:34.468 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: File Generated 2024-09-12T00:36:34.468 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Generating File 2024-09-12T00:36:34.567 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: File Generated 2024-09-12T00:36:34.567 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Generating File 2024-09-12T00:36:34.568 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: File Generated 2024-09-12T00:36:34.568 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Generating File 2024-09-12T00:36:34.568 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: File Generated 2024-09-12T00:36:34.568 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Generating File 2024-09-12T00:36:34.568 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: File Generated 2024-09-12T00:36:34.568 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Generated Big Files 2024-09-12T00:36:34.897 INFO:tasks.workunit.client.0.smithi137.stdout:HeadBucketResponse() 2024-09-12T00:36:34.898 INFO:tasks.workunit.client.0.smithi137.stdout:sheik is ready 2024-09-12T00:36:34.898 INFO:tasks.workunit.client.0.smithi137.stdout:DEBUG: Test Bucket Created 2024-09-12T00:36:34.967 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:36:35.067 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:36:35.168 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:36:35.268 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:36:35.368 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:36:35.469 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:36:35.569 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:36:35.669 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:36:35.769 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:36:35.969 INFO:tasks.workunit.client.0.smithi137.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:36:37.974 INFO:tasks.workunit.client.0.smithi137.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:36:38.675 INFO:tasks.workunit.client.0.smithi137.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:36:42.000 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-0b 2024-09-12T00:36:42.001 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-8b 2024-09-12T00:36:42.002 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-200b 2024-09-12T00:36:42.003 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-21983b 2024-09-12T00:36:42.005 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-5519b 2024-09-12T00:36:42.006 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-204329b 2024-09-12T00:36:42.007 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-256k 2024-09-12T00:36:42.008 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-1m 2024-09-12T00:36:42.009 INFO:tasks.workunit.client.0.smithi137.stdout:arg: file-1038757b 2024-09-12T00:36:42.054 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:36:42.054 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.089 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:36:42.089 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.189 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:36:42.189 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.286 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:36:42.286 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.289 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:36:42.369 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.389 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:36:42.433 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.490 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:36:42.490 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.590 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:36:42.666 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.690 INFO:tasks.workunit.client.0.smithi137.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:36:42.790 INFO:tasks.workunit.client.0.smithi137.stdout:PutObjectResponse 2024-09-12T00:36:42.891 INFO:tasks.workunit.client.0.smithi137.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:36:43.292 INFO:tasks.workunit.client.0.smithi137.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:36:43.993 INFO:tasks.workunit.client.0.smithi137.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:36:48.527 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.66 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:36:48.565 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:48.565 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Results: 2024-09-12T00:36:48.565 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:48.565 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:36:48.566 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] 2024-09-12T00:36:48.568 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:36:48.568 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:36:48.568 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:36:48.569 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Total time: 16.979 s 2024-09-12T00:36:48.570 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] Finished at: 2024-09-12T00:36:48Z 2024-09-12T00:36:48.570 INFO:tasks.workunit.client.0.smithi137.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:36:48.590 INFO:tasks.workunit.client.0.smithi137.stderr:+ exit 2024-09-12T00:36:48.590 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:48.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:48.646 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:36:48.646 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:36:49.043 DEBUG:teuthology.parallel:result is None 2024-09-12T00:36:49.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:49.056 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:49.056 DEBUG:teuthology.orchestra.run.smithi137:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:49.104 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:49.105 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:36:49.121 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:36:49.122 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:36:49.122 DEBUG:teuthology.orchestra.run.smithi137:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:49.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:36:49.154 INFO:teuthology.orchestra.run.smithi137.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:36:49.154 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:49.200 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:49.200 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:36:49.248 INFO:tasks.workunit:timeout=3h 2024-09-12T00:36:49.248 INFO:tasks.workunit:cleanup=True 2024-09-12T00:36:49.249 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:36:49.302 INFO:tasks.workunit.client.0.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:37:31.688 INFO:tasks.workunit.client.0.smithi137.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:37:31.688 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:37:31.688 INFO:tasks.workunit.client.0.smithi137.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:37:31.688 INFO:tasks.workunit.client.0.smithi137.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr: git switch -c 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr:Or undo this operation with: 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr: git switch - 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:37:31.689 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:37:31.690 INFO:tasks.workunit.client.0.smithi137.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:37:31.695 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:37:31.745 INFO:tasks.workunit.client.0.smithi137.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:37:31.748 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:37:31.748 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:37:31.857 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:37:31.914 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:37:31.958 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:37:31.959 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:37:31.959 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:37:32.008 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:37:32.011 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:37:32.011 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:37:32.063 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:37:32.065 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:37:32.065 DEBUG:teuthology.orchestra.run.smithi137:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:37:32.118 INFO:tasks.workunit.client.0.smithi137.stdout:INFO: fully qualified domain name: smithi137.front.sepia.ceph.com 2024-09-12T00:37:32.119 INFO:tasks.workunit.client.0.smithi137.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:37:32.119 INFO:tasks.workunit.client.0.smithi137.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T00:37:35.415 INFO:tasks.workunit.client.0.smithi137.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:37:35.630 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting pip 2024-09-12T00:37:35.636 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:37:35.673 INFO:tasks.workunit.client.0.smithi137.stdout:Installing collected packages: pip 2024-09-12T00:37:35.673 INFO:tasks.workunit.client.0.smithi137.stdout: Attempting uninstall: pip 2024-09-12T00:37:35.674 INFO:tasks.workunit.client.0.smithi137.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:37:35.949 INFO:tasks.workunit.client.0.smithi137.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:37:35.955 INFO:tasks.workunit.client.0.smithi137.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:37:36.989 INFO:tasks.workunit.client.0.smithi137.stdout:Successfully installed pip-24.2 2024-09-12T00:37:38.059 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting boto3 2024-09-12T00:37:38.060 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:37:38.680 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:37:38.681 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:37:38.735 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:37:38.736 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:37:39.083 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:37:39.084 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:37:39.087 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:37:39.089 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:37:39.098 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:37:39.099 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:37:39.100 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:37:39.102 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:37:39.103 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:37:39.171 INFO:tasks.workunit.client.0.smithi137.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:37:40.222 INFO:tasks.workunit.client.0.smithi137.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:37:40.587 INFO:tasks.workunit.client.0.smithi137.stdout:INFO: creating user 2024-09-12T00:37:40.721 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "user_id": "testid", 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "display_name": "M. Tester", 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "email": "tester@ceph.com", 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "suspended": 0, 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "subusers": [], 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "keys": [ 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "user": "testid", 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi137.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "active": true, 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "create_date": "2024-09-12T00:37:40.717512Z" 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "swift_keys": [], 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "caps": [], 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "default_placement": "", 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "placement_tags": [], 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_quota": { 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": false, 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:37:40.723 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size": -1, 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "max_objects": -1 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "user_quota": { 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": false, 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size": -1, 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "max_objects": -1 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "rgw", 2024-09-12T00:37:40.724 INFO:tasks.workunit.client.0.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi137.stdout: "account_id": "", 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi137.stdout: "path": "/", 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi137.stdout: "create_date": "2024-09-12T00:37:40.717496Z", 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi137.stdout: "tags": [], 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi137.stdout: "group_ids": [] 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi137.stdout: 2024-09-12T00:37:45.517 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.517 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:45.541 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:45.573 INFO:tasks.workunit.client.0.smithi137.stderr:5+0 records in 2024-09-12T00:37:45.573 INFO:tasks.workunit.client.0.smithi137.stderr:5+0 records out 2024-09-12T00:37:45.573 INFO:tasks.workunit.client.0.smithi137.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0212643 s, 247 MB/s 2024-09-12T00:37:45.576 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:45.647 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.647 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:45.779 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.779 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:45.910 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.910 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:46.029 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.029 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:46.166 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.166 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:46.301 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.301 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:46.436 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.436 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:46.569 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.569 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:46.704 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.704 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:46.840 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.840 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:46.974 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.975 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:47.110 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:47.110 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:47.241 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:47.241 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:47.361 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:47.361 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:37:47.447 INFO:tasks.workunit.client.0.smithi137.stdout:bucket nams is reupload-bkt-128694 2024-09-12T00:37:47.447 INFO:tasks.workunit.client.0.smithi137.stdout:endpoint is https://smithi137.front.sepia.ceph.com:443 2024-09-12T00:37:47.447 INFO:tasks.workunit.client.0.smithi137.stdout:start UploadId=2~_SmQz5I33ScfBfaDbNOFPsya5z5eJly 2024-09-12T00:37:47.447 INFO:tasks.workunit.client.0.smithi137.stdout:phase 1 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 1 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 2} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.449 INFO:tasks.workunit.client.0.smithi137.stdout:phase 2 uploaded part {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1} 2024-09-12T00:37:47.449 INFO:tasks.workunit.client.0.smithi137.stdout:completing multipart upload, parts=[{'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 1}, {'ETag': '"60cdc6df34f670a01781204f9cb8633e"', 'PartNumber': 2}] 2024-09-12T00:37:48.581 INFO:tasks.workunit.client.0.smithi137.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:37:48.581 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3_mpu_test4 2024-09-12T00:37:48.581 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__multipart_mpu_test4.2~_SmQz5I33ScfBfaDbNOFPsya5z5eJly.2 2024-09-12T00:37:48.581 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__multipart_mpu_test4.BIy6Y1gpE3gTzlqRai-46sqd-gEZxjWB.1 2024-09-12T00:37:48.581 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__shadow_mpu_test4.2~_SmQz5I33ScfBfaDbNOFPsya5z5eJly.2_1 2024-09-12T00:37:48.581 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__shadow_mpu_test4.BIy6Y1gpE3gTzlqRai-46sqd-gEZxjWB.1_1 2024-09-12T00:37:48.581 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__:Te.zLoeaMHSomBypobOTz4fIVsZu9PJ_mpu_test4 2024-09-12T00:37:48.667 INFO:tasks.workunit.client.0.smithi137.stdout:rados ls: 2024-09-12T00:37:48.668 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3_mpu_test4 2024-09-12T00:37:48.668 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__multipart_mpu_test4.2~_SmQz5I33ScfBfaDbNOFPsya5z5eJly.2 2024-09-12T00:37:48.668 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__multipart_mpu_test4.BIy6Y1gpE3gTzlqRai-46sqd-gEZxjWB.1 2024-09-12T00:37:48.668 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__shadow_mpu_test4.2~_SmQz5I33ScfBfaDbNOFPsya5z5eJly.2_1 2024-09-12T00:37:48.669 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__shadow_mpu_test4.BIy6Y1gpE3gTzlqRai-46sqd-gEZxjWB.1_1 2024-09-12T00:37:48.669 INFO:tasks.workunit.client.0.smithi137.stdout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3__:Te.zLoeaMHSomBypobOTz4fIVsZu9PJ_mpu_test4 2024-09-12T00:37:48.685 INFO:tasks.workunit.client.0.smithi137.stdout:== PASSED == 2024-09-12T00:37:48.686 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:37:48.686 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:37:48.742 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:37:48.742 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:37:49.148 DEBUG:teuthology.parallel:result is None 2024-09-12T00:37:49.149 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:37:49.161 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:37:49.161 DEBUG:teuthology.orchestra.run.smithi137:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:37:49.208 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:37:49.209 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:37:49.224 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:37:49.224 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:37:49.224 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:37:49.225 DEBUG:teuthology.orchestra.run.smithi137:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:37:49.256 INFO:teuthology.orchestra.run.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:37:49.432 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:37:49.432 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:37:49.433 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key SGIASVAVJVQRRGYMBONH --secret SffCtr1EQiF9zYn3atXSY51FuzeLkx1B2k6ITtb16ignnugtvv/GKw== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:37:49.522 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:49.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.567+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 realm 2024-09-12T00:37:49.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:49.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:49.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:49.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.571+0000 7fd12ea839c0 20 searching for the correct realm 2024-09-12T00:37:49.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.579+0000 7fd12cd8a640 0 -- 172.21.15.137:0/866306022 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fd120008040 msgr2=0x7fd12007bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:49.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.583+0000 7fd12c589640 0 -- 172.21.15.137:0/866306022 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fd11c0d2040 msgr2=0x7fd11c0e8410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:37:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:37:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 zone default found 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 4 Realm: () 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 zonegroup default 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 started sync module instance, tier type = 2024-09-12T00:37:49.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.591+0000 7fd12ea839c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:37:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 20 add_watcher() i=0 2024-09-12T00:37:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 20 add_watcher() i=1 2024-09-12T00:37:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 20 add_watcher() i=2 2024-09-12T00:37:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 20 add_watcher() i=3 2024-09-12T00:37:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 20 add_watcher() i=4 2024-09-12T00:37:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 20 add_watcher() i=5 2024-09-12T00:37:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 20 add_watcher() i=6 2024-09-12T00:37:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 20 add_watcher() i=7 2024-09-12T00:37:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.611+0000 7fd12ea839c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.615+0000 7fcfe2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.615+0000 7fd12ea839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.615+0000 7fd12ea839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.615+0000 7fd12ea839c0 5 note: GC not initialized 2024-09-12T00:37:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.615+0000 7fcfe1fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 20 Filter name: none 2024-09-12T00:37:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fcf537fe640 20 reqs_thread_entry: start 2024-09-12T00:37:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:37:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:37:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:37:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:37:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:37:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:37:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache get: name=default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH : miss 2024-09-12T00:37:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache put: name=default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH info.flags=0x0 2024-09-12T00:37:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 adding default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH to cache LRU end 2024-09-12T00:37:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache get: name=default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH : hit (negative entry) 2024-09-12T00:37:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache get: name=default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH : hit (negative entry) 2024-09-12T00:37:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:37:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:37:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd12ea839c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:37:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd0037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562420 cookie 94346988274816 notifier 5901 bl.length()=675 2024-09-12T00:37:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd0037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:37:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.619+0000 7fd0037fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:37:49.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd12ea839c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:37:49.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd12ea839c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:37:49.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd12ea839c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:37:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd0037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562378 cookie 94346988261824 notifier 5901 bl.length()=202 2024-09-12T00:37:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd0037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:37:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd0037fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:37:49.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd12ea839c0 10 cache put: name=default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH info.flags=0x7 2024-09-12T00:37:49.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd12ea839c0 10 moving default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH to cache LRU end 2024-09-12T00:37:49.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd12ea839c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:SGIASVAVJVQRRGYMBONH, ofs0, ns] 2024-09-12T00:37:49.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd002ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562433 cookie 94346988283072 notifier 5901 bl.length()=190 2024-09-12T00:37:49.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd002ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH info.flags=0x7 2024-09-12T00:37:49.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.623+0000 7fd002ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SGIASVAVJVQRRGYMBONH to cache LRU end 2024-09-12T00:37:49.624 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:37:49.624 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:37:49.624 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:37:49.624 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:37:49.624 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:37:49.624 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "ragweed.client.0", 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "SGIASVAVJVQRRGYMBONH", 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "SffCtr1EQiF9zYn3atXSY51FuzeLkx1B2k6ITtb16ignnugtvv/GKw==", 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:37:49.623931Z" 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:37:49.625 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:37:49.626 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "rgw", 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "", 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:37:49.623917Z", 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:37:49.627 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:37:49.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.627+0000 7fcfe2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:49.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.631+0000 7fd12ea839c0 20 remove_watcher() i=0 2024-09-12T00:37:49.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.631+0000 7fd12ea839c0 2 removed watcher, disabling cache 2024-09-12T00:37:49.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.631+0000 7fd12ea839c0 20 remove_watcher() i=1 2024-09-12T00:37:49.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.635+0000 7fd12ea839c0 20 remove_watcher() i=2 2024-09-12T00:37:49.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.635+0000 7fd12ea839c0 20 remove_watcher() i=3 2024-09-12T00:37:49.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.639+0000 7fd12ea839c0 20 remove_watcher() i=4 2024-09-12T00:37:49.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.639+0000 7fd12ea839c0 20 remove_watcher() i=5 2024-09-12T00:37:49.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.643+0000 7fd12ea839c0 20 remove_watcher() i=6 2024-09-12T00:37:49.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.643+0000 7fd12ea839c0 20 remove_watcher() i=7 2024-09-12T00:37:49.658 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:37:49.658 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key OCJFZROXDYRBNTZRKHPN --secret CwIPWwDPGqPDyvVTuL7OhYsBdEwW4fzmGwkbFP2+FTu/uwAuhmBjcw== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:37:49.699 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:49.699 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:49.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.739+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 realm 2024-09-12T00:37:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.743+0000 7fb25f0829c0 20 searching for the correct realm 2024-09-12T00:37:49.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.751+0000 7fb25cb88640 0 -- 172.21.15.137:0/2528266852 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fb24c008050 msgr2=0x7fb24c09a1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:49.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.759+0000 7fb25cb88640 0 -- 172.21.15.137:0/2528266852 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5562988a5710 msgr2=0x5562988a7b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:37:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:37:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:49.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.763+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 zone default found 2024-09-12T00:37:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 4 Realm: () 2024-09-12T00:37:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:37:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:37:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 zonegroup default 2024-09-12T00:37:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 started sync module instance, tier type = 2024-09-12T00:37:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.767+0000 7fb25f0829c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:37:49.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.783+0000 7fb25f0829c0 20 add_watcher() i=0 2024-09-12T00:37:49.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.783+0000 7fb25f0829c0 20 add_watcher() i=1 2024-09-12T00:37:49.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.783+0000 7fb25f0829c0 20 add_watcher() i=2 2024-09-12T00:37:49.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.783+0000 7fb25f0829c0 20 add_watcher() i=3 2024-09-12T00:37:49.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.783+0000 7fb25f0829c0 20 add_watcher() i=4 2024-09-12T00:37:49.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.783+0000 7fb25f0829c0 20 add_watcher() i=5 2024-09-12T00:37:49.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.783+0000 7fb25f0829c0 20 add_watcher() i=6 2024-09-12T00:37:49.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.787+0000 7fb25f0829c0 20 add_watcher() i=7 2024-09-12T00:37:49.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.787+0000 7fb25f0829c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:49.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:49.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:49.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb112fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:49.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 5 note: GC not initialized 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb111fe3640 20 reqs_thread_entry: start 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 Filter name: none 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb0837fe640 20 reqs_thread_entry: start 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:37:49.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:37:49.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:37:49.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 cache get: name=default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN : miss 2024-09-12T00:37:49.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 cache put: name=default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN info.flags=0x0 2024-09-12T00:37:49.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 adding default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN to cache LRU end 2024-09-12T00:37:49.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 cache get: name=default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN : hit (negative entry) 2024-09-12T00:37:49.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.791+0000 7fb25f0829c0 10 cache get: name=default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN : hit (negative entry) 2024-09-12T00:37:49.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.795+0000 7fb25f0829c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:37:49.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.795+0000 7fb25f0829c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:37:49.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.795+0000 7fb25f0829c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:37:49.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.795+0000 7fb133fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562379 cookie 93881954393200 notifier 5684 bl.length()=675 2024-09-12T00:37:49.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.795+0000 7fb133fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:37:49.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.795+0000 7fb133fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:37:49.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.799+0000 7fb25f0829c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:37:49.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.799+0000 7fb25f0829c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:37:49.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.799+0000 7fb25f0829c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:37:49.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.799+0000 7fb133fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562421 cookie 93881954394256 notifier 5684 bl.length()=202 2024-09-12T00:37:49.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.799+0000 7fb133fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:37:49.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.799+0000 7fb133fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:37:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.803+0000 7fb25f0829c0 10 cache put: name=default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN info.flags=0x7 2024-09-12T00:37:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.803+0000 7fb25f0829c0 10 moving default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN to cache LRU end 2024-09-12T00:37:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.803+0000 7fb25f0829c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OCJFZROXDYRBNTZRKHPN, ofs0, ns] 2024-09-12T00:37:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.803+0000 7fb1337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562384 cookie 93881954364816 notifier 5684 bl.length()=190 2024-09-12T00:37:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.803+0000 7fb1337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN info.flags=0x7 2024-09-12T00:37:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.803+0000 7fb1337fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OCJFZROXDYRBNTZRKHPN to cache LRU end 2024-09-12T00:37:49.801 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:37:49.801 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:37:49.801 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:37:49.801 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:37:49.801 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:37:49.801 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:37:49.801 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "sysuser.client.0", 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "OCJFZROXDYRBNTZRKHPN", 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "CwIPWwDPGqPDyvVTuL7OhYsBdEwW4fzmGwkbFP2+FTu/uwAuhmBjcw==", 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:37:49.798559Z" 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:37:49.802 INFO:teuthology.orchestra.run.smithi137.stdout: "system": true, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:37:49.803 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "rgw", 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "", 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:37:49.798527Z", 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:37:49.804 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:37:49.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.803+0000 7fb112fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.807+0000 7fb25f0829c0 20 remove_watcher() i=0 2024-09-12T00:37:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.807+0000 7fb25f0829c0 2 removed watcher, disabling cache 2024-09-12T00:37:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.811+0000 7fb25f0829c0 20 remove_watcher() i=1 2024-09-12T00:37:49.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.811+0000 7fb25f0829c0 20 remove_watcher() i=2 2024-09-12T00:37:49.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.815+0000 7fb25f0829c0 20 remove_watcher() i=3 2024-09-12T00:37:49.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.815+0000 7fb25f0829c0 20 remove_watcher() i=4 2024-09-12T00:37:49.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.819+0000 7fb25f0829c0 20 remove_watcher() i=5 2024-09-12T00:37:49.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.819+0000 7fb25f0829c0 20 remove_watcher() i=6 2024-09-12T00:37:49.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:37:49.823+0000 7fb25f0829c0 20 remove_watcher() i=7 2024-09-12T00:37:49.835 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:37:49.836 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:37:49.836 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:37:49.889 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:37:49.889 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:37:49.889 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:37:49.940 DEBUG:teuthology.orchestra.run.smithi137:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:37:50.135 INFO:teuthology.orchestra.run.smithi137.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:37:50.319 INFO:teuthology.orchestra.run.smithi137.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:37:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:37:53.542 INFO:teuthology.orchestra.run.smithi137.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:37:58.067 INFO:teuthology.orchestra.run.smithi137.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=909f1cbe9d2d88939f05da9f4b1714638f2033250e1422465690955e44f040ec,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T00:37:58.067 INFO:teuthology.orchestra.run.smithi137.stdout:py run-test-pre: PYTHONHASHSEED='884499344' 2024-09-12T00:37:58.067 INFO:teuthology.orchestra.run.smithi137.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:37:58.224 INFO:teuthology.orchestra.run.smithi137.stdout:============================= test session starts ============================== 2024-09-12T00:37:58.224 INFO:teuthology.orchestra.run.smithi137.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:37:58.224 INFO:teuthology.orchestra.run.smithi137.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:37:58.224 INFO:teuthology.orchestra.run.smithi137.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T00:37:58.371 INFO:teuthology.orchestra.run.smithi137.stdout:collecting ... collected 9 items 2024-09-12T00:37:58.371 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:38:00.630 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:38:01.832 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:38:03.067 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:38:04.173 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:38:05.431 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:38:12.793 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:38:15.126 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:38:18.210 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:38:22.813 INFO:teuthology.orchestra.run.smithi137.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:38:22.813 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:38:22.813 INFO:teuthology.orchestra.run.smithi137.stdout:=============================== warnings summary =============================== 2024-09-12T00:38:22.813 INFO:teuthology.orchestra.run.smithi137.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T00:38:22.813 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T00:38:22.813 INFO:teuthology.orchestra.run.smithi137.stdout: import imp 2024-09-12T00:38:22.814 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:38:22.814 INFO:teuthology.orchestra.run.smithi137.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T00:38:22.814 INFO:teuthology.orchestra.run.smithi137.stdout:======================== 9 passed, 1 warning in 24.59s ========================= 2024-09-12T00:38:22.858 INFO:teuthology.orchestra.run.smithi137.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:38:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: py: commands succeeded 2024-09-12T00:38:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: congratulations :) 2024-09-12T00:38:22.877 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:38:22.877 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:38:22.882 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:38:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:22.956 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:22.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:22.999+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 realm 2024-09-12T00:38:23.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:23.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:23.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:23.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.003+0000 7f1d7a2e19c0 20 searching for the correct realm 2024-09-12T00:38:23.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.007+0000 7f1d77de7640 0 -- 172.21.15.137:0/4185825516 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f1d680723e0 msgr2=0x7f1d68003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:23.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.219+0000 7f1d77de7640 0 -- 172.21.15.137:0/4185825516 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1d70025040 msgr2=0x7f1d70033400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:23.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:23.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:38:23.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:23.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:38:23.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:23.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:23.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:23.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:23.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 zone default found 2024-09-12T00:38:23.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 4 Realm: () 2024-09-12T00:38:23.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:38:23.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:38:23.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:23.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 zonegroup default 2024-09-12T00:38:23.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.439+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.443+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.443+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.443+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.443+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.443+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.443+0000 7f1d7a2e19c0 20 started sync module instance, tier type = 2024-09-12T00:38:23.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.443+0000 7f1d7a2e19c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:38:23.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.467+0000 7f1d7a2e19c0 20 add_watcher() i=0 2024-09-12T00:38:23.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.467+0000 7f1d7a2e19c0 20 add_watcher() i=1 2024-09-12T00:38:23.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.467+0000 7f1d7a2e19c0 20 add_watcher() i=2 2024-09-12T00:38:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.467+0000 7f1d7a2e19c0 20 add_watcher() i=3 2024-09-12T00:38:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.467+0000 7f1d7a2e19c0 20 add_watcher() i=4 2024-09-12T00:38:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.467+0000 7f1d7a2e19c0 20 add_watcher() i=5 2024-09-12T00:38:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.467+0000 7f1d7a2e19c0 20 add_watcher() i=6 2024-09-12T00:38:23.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.471+0000 7f1d7a2e19c0 20 add_watcher() i=7 2024-09-12T00:38:23.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.471+0000 7f1d7a2e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:23.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.475+0000 7f1c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:23.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.475+0000 7f1d7a2e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:23.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.475+0000 7f1d7a2e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:23.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1c2cfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:23.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:23.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 20 Filter name: none 2024-09-12T00:38:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1ba67fc640 20 reqs_thread_entry: start 2024-09-12T00:38:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:38:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:38:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:38:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:38:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:23.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4 : miss 2024-09-12T00:38:23.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.567+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:38:23.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4 info.flags=0x17 2024-09-12T00:38:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4 to cache LRU end 2024-09-12T00:38:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4 2024-09-12T00:38:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:38:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 10 manifest: total_size = 7671 2024-09-12T00:38:23.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18082052346983333561 2024-09-12T00:38:23.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.571+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.575+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.575+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.575+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18082052346983333561 2024-09-12T00:38:23.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.575+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.575+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.E71GqXb3IfGVS_gMYYntXcK1Ax9w5cc_0 2024-09-12T00:38:23.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.575+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:23.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.575+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.575+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18082052346983333561 2024-09-12T00:38:23.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.579+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:38:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.579+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.579+0000 7f1d7a2e19c0 10 manifest: total_size = 5209 2024-09-12T00:38:23.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.579+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6723429214614070990 2024-09-12T00:38:23.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.579+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.579+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.579+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5209 stripe_ofs=5209 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6723429214614070990 2024-09-12T00:38:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.v6M3RpikRclkDZa9lqppLUNxVSC6gZ7_0 2024-09-12T00:38:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:38:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6723429214614070990 2024-09-12T00:38:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:38:23.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.587+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.591+0000 7f1d7a2e19c0 10 manifest: total_size = 5079 2024-09-12T00:38:23.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.591+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13565597472375044945 2024-09-12T00:38:23.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.591+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.591+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.591+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5079 stripe_ofs=5079 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13565597472375044945 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.pqJSszpV73iqOEAEhGBcos_PMCKQl9h_0 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:23.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13565597472375044945 2024-09-12T00:38:23.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.595+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:38:23.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.599+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.599+0000 7f1d7a2e19c0 10 manifest: total_size = 7427 2024-09-12T00:38:23.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.599+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2690242146807296384 2024-09-12T00:38:23.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.599+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.599+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.599+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=7427 stripe_ofs=7427 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2690242146807296384 2024-09-12T00:38:23.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.NtOmBj32aRH3tQg6gRPonRWHONRrAcI_0 2024-09-12T00:38:23.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:38:23.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2690242146807296384 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.603+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.607+0000 7f1d7a2e19c0 10 manifest: total_size = 4982 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.607+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11142735719276150189 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.607+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.607+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.607+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4982 stripe_ofs=4982 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11142735719276150189 2024-09-12T00:38:23.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.XpV3YB_cVgYYN1T-Mto-CzOYYZwfiKG_0 2024-09-12T00:38:23.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:23.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11142735719276150189 2024-09-12T00:38:23.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.611+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:38:23.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.615+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.615+0000 7f1d7a2e19c0 10 manifest: total_size = 7696 2024-09-12T00:38:23.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.615+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15363106844412019892 2024-09-12T00:38:23.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.615+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70018f20 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.615+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.615+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.619+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.619+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=7696 stripe_ofs=7696 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.619+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15363106844412019892 2024-09-12T00:38:23.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.619+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.619+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.hMEP4XQo9bb46pPXSXZUe-ipj9kKbU0_0 2024-09-12T00:38:23.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.619+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:23.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.619+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.619+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15363106844412019892 2024-09-12T00:38:23.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.623+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:38:23.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.623+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9f7b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.623+0000 7f1d7a2e19c0 10 manifest: total_size = 5384 2024-09-12T00:38:23.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.623+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5806294821694888612 2024-09-12T00:38:23.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.623+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9f7b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.623+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.623+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.627+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.627+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5384 stripe_ofs=5384 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.627+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5806294821694888612 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.627+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.627+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.2xGCSBs0MdsLtPR4u3zHmZSlTC2Gjk6_0 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.627+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.627+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.627+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5806294821694888612 2024-09-12T00:38:23.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.631+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:38:23.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.631+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9f7b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.631+0000 7f1d7a2e19c0 10 manifest: total_size = 5083 2024-09-12T00:38:23.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.631+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7441884542923628493 2024-09-12T00:38:23.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.631+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9f7b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.631+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.631+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5083 stripe_ofs=5083 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7441884542923628493 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.tm8gTamFKHvYrC53XoCb2O2CE06oYMM_0 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7441884542923628493 2024-09-12T00:38:23.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:38:23.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9f7b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 10 manifest: total_size = 38605 2024-09-12T00:38:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12965751929160141143 2024-09-12T00:38:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9f7b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x561a7da9e5c8 s->prefetch_data=0 2024-09-12T00:38:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9e5c8 2024-09-12T00:38:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.639+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4.0 2024-09-12T00:38:23.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=38605 stripe_ofs=38605 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12965751929160141143 2024-09-12T00:38:23.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.GqxqpQQvr4O5sYx8f3eOawbhrWplEQy_0 2024-09-12T00:38:23.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:23.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12965751929160141143 2024-09-12T00:38:23.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.647+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:38:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.651+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.651+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:23.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.651+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:23.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.651+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:23.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.651+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:23.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.651+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:23.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.651+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.655+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.655+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.655+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.655+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.655+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:38:23.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.655+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:38:23.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.655+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:38:23.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.659+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94671777207008 notifier 5708 bl.length()=162 2024-09-12T00:38:23.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.659+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4 from cache 2024-09-12T00:38:23.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.659+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4, ofs0, ns] 2024-09-12T00:38:23.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.659+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94671777225040 notifier 5708 bl.length()=219 2024-09-12T00:38:23.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.663+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4 : miss 2024-09-12T00:38:23.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.663+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.663+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.663+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4 info.flags=0x0 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.663+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4 to cache LRU end 2024-09-12T00:38:23.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.667+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11 : miss 2024-09-12T00:38:23.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.667+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11 info.flags=0x17 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11 to cache LRU end 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11 2024-09-12T00:38:23.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:38:23.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c109550 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x561a7da9c068 s->prefetch_data=0 2024-09-12T00:38:23.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 10 manifest: total_size = 886297 2024-09-12T00:38:23.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2410429415558141803 2024-09-12T00:38:23.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c109550 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x561a7da9c068 s->prefetch_data=0 2024-09-12T00:38:23.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9c068 2024-09-12T00:38:23.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.671+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11.0 2024-09-12T00:38:23.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:23.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:38:23.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:38:23.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2410429415558141803 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11__multipart_foo.2~jqvxjEBo3iUot8gBd096VARsDGbysv4.1 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11__multipart_foo.2~jqvxjEBo3iUot8gBd096VARsDGbysv4.2 2024-09-12T00:38:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:38:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11__multipart_foo.2~jqvxjEBo3iUot8gBd096VARsDGbysv4.3 2024-09-12T00:38:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:38:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11__multipart_foo.2~jqvxjEBo3iUot8gBd096VARsDGbysv4.4 2024-09-12T00:38:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:38:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.679+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2410429415558141803 2024-09-12T00:38:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.683+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.683+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.683+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:38:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.683+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.683+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.683+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.683+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.683+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.687+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:38:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.687+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.687+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:38:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.687+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:38:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.687+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:38:23.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.691+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:38:23.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.691+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:38:23.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.691+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366207 cookie 94671777210784 notifier 5708 bl.length()=191 2024-09-12T00:38:23.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.695+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11 from cache 2024-09-12T00:38:23.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.695+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11, ofs0, ns] 2024-09-12T00:38:23.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.695+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94671777210784 notifier 5708 bl.length()=249 2024-09-12T00:38:23.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.699+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11 : miss 2024-09-12T00:38:23.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.699+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.699+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.699+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11 info.flags=0x0 2024-09-12T00:38:23.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.699+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11 to cache LRU end 2024-09-12T00:38:23.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.703+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12 : miss 2024-09-12T00:38:23.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.703+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:38:23.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12 info.flags=0x17 2024-09-12T00:38:23.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12 to cache LRU end 2024-09-12T00:38:23.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:23.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:23.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12 2024-09-12T00:38:23.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:38:23.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccd30 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x561a7da9c068 s->prefetch_data=0 2024-09-12T00:38:23.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 10 manifest: total_size = 18874368 2024-09-12T00:38:23.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11675433722985138976 2024-09-12T00:38:23.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccd30 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x561a7da9c068 s->prefetch_data=0 2024-09-12T00:38:23.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9c068 2024-09-12T00:38:23.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.707+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12.0 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11675433722985138976 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__multipart_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.1 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__shadow_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.1_1 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__multipart_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.2 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__shadow_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.2_1 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__multipart_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.3 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2024-09-12T00:38:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__shadow_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.3_1 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__multipart_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.4 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.715+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11675433722985138976 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.719+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.719+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:23.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.719+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:23.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.719+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:23.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.719+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:23.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.719+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:23.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.719+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:23.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.719+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:23.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.723+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:38:23.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.723+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.723+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:38:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.723+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:38:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.723+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:38:23.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.727+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:38:23.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.727+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:38:23.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.727+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366160 cookie 94671777218016 notifier 5708 bl.length()=198 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.731+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12 from cache 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.731+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12, ofs0, ns] 2024-09-12T00:38:23.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.735+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94671777227536 notifier 5708 bl.length()=256 2024-09-12T00:38:23.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.739+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12 : miss 2024-09-12T00:38:23.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.739+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.739+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.739+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12 info.flags=0x0 2024-09-12T00:38:23.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.739+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12 to cache LRU end 2024-09-12T00:38:23.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.743+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10 : miss 2024-09-12T00:38:23.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.743+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.743+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:38:23.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.743+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10 info.flags=0x17 2024-09-12T00:38:23.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.743+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10 to cache LRU end 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.743+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.743+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.743+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10 2024-09-12T00:38:23.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.747+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo[YUqMzH6GADunrsgDeTxNsOeKw5Q443s] 2024-09-12T00:38:23.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.747+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10.0 2024-09-12T00:38:23.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.747+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9ce10 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x561a7da9c068 s->prefetch_data=0 2024-09-12T00:38:23.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.747+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to z4gzrew3cwjbp5dy7cvhdfsbskbuslal 2024-09-12T00:38:23.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.747+0000 7f1d7a2e19c0 20 get_obj_state_impl: setting s->olh_tag to wh9cji1ne5nxajph9j23emw326uoy7rv 2024-09-12T00:38:23.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.747+0000 7f1d7a2e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wh9cji1ne5nxajph9j23emw326uoy7rv 2024-09-12T00:38:23.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.751+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10.0 2024-09-12T00:38:23.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.755+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10.0 2024-09-12T00:38:23.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.755+0000 7f1d7a2e19c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:38:23.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.755+0000 7f1d7a2e19c0 20 olh_log_entry: epoch=3 op=3 key=foo[YUqMzH6GADunrsgDeTxNsOeKw5Q443s] 2024-09-12T00:38:23.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.755+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9ce10 obj=test-client.0-r-test-multipart-index-versioning.1:_:YUqMzH6GADunrsgDeTxNsOeKw5Q443s_foo state=0x561a7dab2958 s->prefetch_data=0 2024-09-12T00:38:23.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.759+0000 7f1d7a2e19c0 10 manifest: total_size = 1667 2024-09-12T00:38:23.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.759+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8902715874227619212 2024-09-12T00:38:23.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.759+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9ce10 obj=test-client.0-r-test-multipart-index-versioning.1:_:YUqMzH6GADunrsgDeTxNsOeKw5Q443s_foo state=0x561a7dab2958 s->prefetch_data=0 2024-09-12T00:38:23.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.759+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab2958 2024-09-12T00:38:23.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.759+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10.0 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8902715874227619212 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10__multipart_foo.2~xnOP5ufN1wEoDlXx-edib0qp9G-L3Zg.1 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10__multipart_foo.2~xnOP5ufN1wEoDlXx-edib0qp9G-L3Zg.2 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10__multipart_foo.2~xnOP5ufN1wEoDlXx-edib0qp9G-L3Zg.3 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10__multipart_foo.2~xnOP5ufN1wEoDlXx-edib0qp9G-L3Zg.4 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.763+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8902715874227619212 2024-09-12T00:38:23.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.767+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo[YUqMzH6GADunrsgDeTxNsOeKw5Q443s] 2024-09-12T00:38:23.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.771+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9ce10 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x561a7da9c068 s->prefetch_data=0 2024-09-12T00:38:23.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.775+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10.0 2024-09-12T00:38:23.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.779+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10.0 2024-09-12T00:38:23.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.779+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:23.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.779+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:23.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.779+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:23.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.779+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:23.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.779+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:23.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.779+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:23.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.779+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:23.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.783+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:38:23.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.783+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.783+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:38:23.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.783+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:38:23.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.783+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:38:23.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.787+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:38:23.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.787+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:38:23.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.787+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366161 cookie 94671777218016 notifier 5708 bl.length()=193 2024-09-12T00:38:23.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.791+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10 from cache 2024-09-12T00:38:23.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.791+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10, ofs0, ns] 2024-09-12T00:38:23.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.791+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 94671777223984 notifier 5708 bl.length()=251 2024-09-12T00:38:23.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.795+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10 : miss 2024-09-12T00:38:23.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.795+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.795+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.795+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10 info.flags=0x0 2024-09-12T00:38:23.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.795+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10 to cache LRU end 2024-09-12T00:38:23.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9 : miss 2024-09-12T00:38:23.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:38:23.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9 info.flags=0x17 2024-09-12T00:38:23.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9 to cache LRU end 2024-09-12T00:38:23.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:23.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:23.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9 2024-09-12T00:38:23.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:38:23.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ea8a0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x561a7da9c068 s->prefetch_data=0 2024-09-12T00:38:23.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 10 manifest: total_size = 886297 2024-09-12T00:38:23.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2317704166395227262 2024-09-12T00:38:23.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ea8a0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x561a7da9c068 s->prefetch_data=0 2024-09-12T00:38:23.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7da9c068 2024-09-12T00:38:23.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.803+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9.0 2024-09-12T00:38:23.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:23.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:38:23.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:38:23.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:23.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2317704166395227262 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9__multipart_foo.2~dWb6fegdDmhi6UDHsonUOSpreTL04Ms.1 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9__multipart_foo.2~dWb6fegdDmhi6UDHsonUOSpreTL04Ms.2 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9__multipart_foo.2~dWb6fegdDmhi6UDHsonUOSpreTL04Ms.3 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9__multipart_foo.2~dWb6fegdDmhi6UDHsonUOSpreTL04Ms.4 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.811+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2317704166395227262 2024-09-12T00:38:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.815+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:38:23.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.815+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:23.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.815+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:23.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.815+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.815+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.815+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.815+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.815+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:23.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.823+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:38:23.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.823+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.823+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:38:23.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.823+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:38:23.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.823+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:38:23.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.827+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.827+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.827+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 94671777223984 notifier 5708 bl.length()=183 2024-09-12T00:38:23.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.831+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9 from cache 2024-09-12T00:38:23.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.831+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9, ofs0, ns] 2024-09-12T00:38:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.831+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94671777208064 notifier 5708 bl.length()=240 2024-09-12T00:38:23.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.835+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9 : miss 2024-09-12T00:38:23.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.835+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.839+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.839+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9 info.flags=0x0 2024-09-12T00:38:23.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.839+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9 to cache LRU end 2024-09-12T00:38:23.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.843+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15 : miss 2024-09-12T00:38:23.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.843+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.843+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.843+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15 info.flags=0x17 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.843+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15 to cache LRU end 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.843+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.843+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.843+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15 2024-09-12T00:38:23.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:38:23.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:38:23.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:38:23.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:38:23.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7d893990 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 10 manifest: total_size = 5242880 2024-09-12T00:38:23.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13464161237666588757 2024-09-12T00:38:23.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7d893990 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab7fd8 2024-09-12T00:38:23.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.847+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13464161237666588757 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.3dG4vsDhUOiLU101QO132qdmvo6Moio_0 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:38:23.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.3dG4vsDhUOiLU101QO132qdmvo6Moio_1 2024-09-12T00:38:23.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:38:23.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.855+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13464161237666588757 2024-09-12T00:38:23.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.859+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:38:23.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.859+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7d893990 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.859+0000 7f1d7a2e19c0 10 manifest: total_size = 5242880 2024-09-12T00:38:23.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.859+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1727877715676901833 2024-09-12T00:38:23.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.859+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7d893990 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.859+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab7fd8 2024-09-12T00:38:23.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.859+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1727877715676901833 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.3dG4vsDhUOiLU101QO132qdmvo6Moio_0 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.3dG4vsDhUOiLU101QO132qdmvo6Moio_1 2024-09-12T00:38:23.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:38:23.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.863+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.867+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1727877715676901833 2024-09-12T00:38:23.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.867+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:38:23.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.867+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7d893990 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.871+0000 7f1d7a2e19c0 10 manifest: total_size = 5242880 2024-09-12T00:38:23.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.871+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _AMRSdYHVAfZEmemfPnLmqvYh4wQn0QX 2024-09-12T00:38:23.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.871+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7d893990 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.871+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab7fd8 2024-09-12T00:38:23.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.871+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _AMRSdYHVAfZEmemfPnLmqvYh4wQn0QX 2024-09-12T00:38:23.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.R53C5ESKv6Y7KHuN1bZhbEkg9QI7ROQ_0 2024-09-12T00:38:23.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:38:23.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.R53C5ESKv6Y7KHuN1bZhbEkg9QI7ROQ_1 2024-09-12T00:38:23.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:38:23.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.875+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _AMRSdYHVAfZEmemfPnLmqvYh4wQn0QX 2024-09-12T00:38:23.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.879+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:38:23.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.879+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c004ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.879+0000 7f1d7a2e19c0 10 manifest: total_size = 5242880 2024-09-12T00:38:23.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.879+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _Cxqqs_p-x7SopvqB770d6MgJifd2dJL 2024-09-12T00:38:23.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.879+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c004ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.879+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab7fd8 2024-09-12T00:38:23.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.883+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Cxqqs_p-x7SopvqB770d6MgJifd2dJL 2024-09-12T00:38:23.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.iamwPoQXVb_mdC8IAAnL5UsA4KXDAbJ_0 2024-09-12T00:38:23.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:38:23.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.iamwPoQXVb_mdC8IAAnL5UsA4KXDAbJ_1 2024-09-12T00:38:23.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:38:23.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.887+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _Cxqqs_p-x7SopvqB770d6MgJifd2dJL 2024-09-12T00:38:23.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.891+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:38:23.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.891+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7daa7560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.891+0000 7f1d7a2e19c0 10 manifest: total_size = 5242880 2024-09-12T00:38:23.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.891+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1766724577228741593 2024-09-12T00:38:23.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.891+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7daa7560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.891+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab7fd8 2024-09-12T00:38:23.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.891+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1766724577228741593 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Zd3ilCO_YJnTgakOrZ342hbzUEU2Oql_0 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:38:23.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Zd3ilCO_YJnTgakOrZ342hbzUEU2Oql_1 2024-09-12T00:38:23.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:38:23.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.899+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1766724577228741593 2024-09-12T00:38:23.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.903+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:38:23.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.903+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da7a150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.903+0000 7f1d7a2e19c0 10 manifest: total_size = 5242880 2024-09-12T00:38:23.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.903+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _dWQitoNrIA6TeT-VJvywcldqtFfUU9N 2024-09-12T00:38:23.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.903+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da7a150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.903+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab7fd8 2024-09-12T00:38:23.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.903+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _dWQitoNrIA6TeT-VJvywcldqtFfUU9N 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Dab863m0NLWbCSk7lAoRj0hien_HuFy_0 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Dab863m0NLWbCSk7lAoRj0hien_HuFy_1 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.911+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _dWQitoNrIA6TeT-VJvywcldqtFfUU9N 2024-09-12T00:38:23.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.915+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:38:23.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.915+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70064480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.915+0000 7f1d7a2e19c0 10 manifest: total_size = 5242880 2024-09-12T00:38:23.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.915+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15392162542722894952 2024-09-12T00:38:23.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.915+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70064480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.915+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab7fd8 2024-09-12T00:38:23.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.915+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15392162542722894952 2024-09-12T00:38:23.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Zd3ilCO_YJnTgakOrZ342hbzUEU2Oql_0 2024-09-12T00:38:23.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:38:23.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Zd3ilCO_YJnTgakOrZ342hbzUEU2Oql_1 2024-09-12T00:38:23.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:38:23.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.923+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15392162542722894952 2024-09-12T00:38:23.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.927+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:38:23.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.927+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70064480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.927+0000 7f1d7a2e19c0 10 manifest: total_size = 5242880 2024-09-12T00:38:23.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.927+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _74IvHFLQZ58y8ku5eDxrcM0qlUOMMCP 2024-09-12T00:38:23.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.927+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70064480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x561a7dab7fd8 s->prefetch_data=0 2024-09-12T00:38:23.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.927+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab7fd8 2024-09-12T00:38:23.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.927+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _74IvHFLQZ58y8ku5eDxrcM0qlUOMMCP 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.udap7EJSsQt9134NWKtQfxiAtJMJ6Gm_0 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.udap7EJSsQt9134NWKtQfxiAtJMJ6Gm_1 2024-09-12T00:38:23.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:38:23.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _74IvHFLQZ58y8ku5eDxrcM0qlUOMMCP 2024-09-12T00:38:23.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:38:23.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.935+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c004ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x561a7daa41f8 s->prefetch_data=0 2024-09-12T00:38:23.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.939+0000 7f1d7a2e19c0 10 manifest: total_size = 27199 2024-09-12T00:38:23.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.939+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12116136436557743323 2024-09-12T00:38:23.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.939+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c004ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x561a7daa41f8 s->prefetch_data=0 2024-09-12T00:38:23.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.939+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa41f8 2024-09-12T00:38:23.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.939+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.943+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.943+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.943+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12116136436557743323 2024-09-12T00:38:23.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.943+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.943+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.UWbjlDCvL4-_KZIoYFICmbk5bnosJTw_0 2024-09-12T00:38:23.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.943+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:38:23.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.943+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.943+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12116136436557743323 2024-09-12T00:38:23.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.947+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:38:23.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.947+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9f650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x561a7daa41f8 s->prefetch_data=0 2024-09-12T00:38:23.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.947+0000 7f1d7a2e19c0 10 manifest: total_size = 27199 2024-09-12T00:38:23.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.947+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _RhXoA_rMAg1k5-QqhSu0F_RljYEaBXh 2024-09-12T00:38:23.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.947+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9f650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x561a7daa41f8 s->prefetch_data=0 2024-09-12T00:38:23.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.947+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa41f8 2024-09-12T00:38:23.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.947+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.955+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.955+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.955+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _RhXoA_rMAg1k5-QqhSu0F_RljYEaBXh 2024-09-12T00:38:23.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.955+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.955+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Pf5vRn6dPAInCRcKWiEp1k-4bXkKEdM_0 2024-09-12T00:38:23.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.955+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:38:23.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.955+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.955+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _RhXoA_rMAg1k5-QqhSu0F_RljYEaBXh 2024-09-12T00:38:23.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.959+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:38:23.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.959+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da7a150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x561a7daa41f8 s->prefetch_data=0 2024-09-12T00:38:23.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.959+0000 7f1d7a2e19c0 10 manifest: total_size = 27199 2024-09-12T00:38:23.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.959+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _kSFjkRJpvri2VKxKgxAtElqxnpu1nEY 2024-09-12T00:38:23.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.959+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da7a150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x561a7daa41f8 s->prefetch_data=0 2024-09-12T00:38:23.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.959+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa41f8 2024-09-12T00:38:23.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.959+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.967+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.967+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.967+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _kSFjkRJpvri2VKxKgxAtElqxnpu1nEY 2024-09-12T00:38:23.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.967+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.967+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.jY8x4BKpAMsvw5C5cuZwV4_kN6sRgN1_0 2024-09-12T00:38:23.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.967+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:38:23.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.967+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.967+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _kSFjkRJpvri2VKxKgxAtElqxnpu1nEY 2024-09-12T00:38:23.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.971+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:38:23.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.971+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c004ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x561a7daa41f8 s->prefetch_data=0 2024-09-12T00:38:23.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.971+0000 7f1d7a2e19c0 10 manifest: total_size = 27199 2024-09-12T00:38:23.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.971+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15857204626996212775 2024-09-12T00:38:23.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.971+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c004ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x561a7daa41f8 s->prefetch_data=0 2024-09-12T00:38:23.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.971+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa41f8 2024-09-12T00:38:23.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.971+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15.0 2024-09-12T00:38:23.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.979+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:23.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.979+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T00:38:23.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.979+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15857204626996212775 2024-09-12T00:38:23.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.979+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:23.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.979+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.UWbjlDCvL4-_KZIoYFICmbk5bnosJTw_0 2024-09-12T00:38:23.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.979+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:38:23.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.979+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:23.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.979+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15857204626996212775 2024-09-12T00:38:23.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.983+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:38:23.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.983+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:23.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.983+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:23.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.983+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:23.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.983+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:23.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.983+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:23.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.983+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.983+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:23.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.987+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:38:23.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.987+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.987+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:38:23.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.987+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:38:23.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.987+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:38:23.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.991+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:38:23.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.991+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:38:23.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.991+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366162 cookie 94671777218016 notifier 5708 bl.length()=189 2024-09-12T00:38:23.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.995+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15 from cache 2024-09-12T00:38:23.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.995+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15, ofs0, ns] 2024-09-12T00:38:23.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:23.999+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 94671777223984 notifier 5708 bl.length()=247 2024-09-12T00:38:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.003+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15 : miss 2024-09-12T00:38:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.003+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.003+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.003+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15 info.flags=0x0 2024-09-12T00:38:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.003+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15 to cache LRU end 2024-09-12T00:38:24.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.007+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16 : miss 2024-09-12T00:38:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.007+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:38:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16 info.flags=0x17 2024-09-12T00:38:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16 to cache LRU end 2024-09-12T00:38:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:24.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16 2024-09-12T00:38:24.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:38:24.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:38:24.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccf80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1225490261366057273 2024-09-12T00:38:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccf80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.011+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1225490261366057273 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.1 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.1_1 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:38:24.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.2 2024-09-12T00:38:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:38:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.2_1 2024-09-12T00:38:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:38:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.3 2024-09-12T00:38:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:38:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.019+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1225490261366057273 2024-09-12T00:38:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.023+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:38:24.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.023+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab62b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.023+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.023+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12420192300422293832 2024-09-12T00:38:24.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.023+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab62b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.023+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.023+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12420192300422293832 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.1 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.1_1 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.2 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.2_1 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.3 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.031+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12420192300422293832 2024-09-12T00:38:24.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.035+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:38:24.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.035+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab70c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.035+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.035+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _Bol8F7obqm23Ocnw-s8HNvj1utv7sS8 2024-09-12T00:38:24.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.035+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab70c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.035+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.035+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Bol8F7obqm23Ocnw-s8HNvj1utv7sS8 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.PkLLlJwBE2SVxF8RJW6jEqkeyG-XTIO_0 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.PkLLlJwBE2SVxF8RJW6jEqkeyG-XTIO_1 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.PkLLlJwBE2SVxF8RJW6jEqkeyG-XTIO_2 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.043+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _Bol8F7obqm23Ocnw-s8HNvj1utv7sS8 2024-09-12T00:38:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.047+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:38:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.047+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab70c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.047+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.047+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _wD7AEuXfBT_ahUu_FtJmGlg1fdQsSXi 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.047+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab70c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.047+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.047+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _wD7AEuXfBT_ahUu_FtJmGlg1fdQsSXi 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.03wmSYKc4NWdRHZeOiWDgwyoD4T0FHd_0 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.03wmSYKc4NWdRHZeOiWDgwyoD4T0FHd_1 2024-09-12T00:38:24.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:38:24.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.03wmSYKc4NWdRHZeOiWDgwyoD4T0FHd_2 2024-09-12T00:38:24.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:38:24.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.055+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _wD7AEuXfBT_ahUu_FtJmGlg1fdQsSXi 2024-09-12T00:38:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.059+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:38:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.059+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7daa70c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.059+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.059+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17155208232630382861 2024-09-12T00:38:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.059+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7daa70c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.059+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.059+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17155208232630382861 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.1 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.1_1 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.2 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.2_1 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:38:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.3 2024-09-12T00:38:24.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:38:24.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.063+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17155208232630382861 2024-09-12T00:38:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.067+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:38:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.067+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccd30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.071+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.071+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _buaLVvxWYEHxi9eMD-MBCcRbLerAlaf 2024-09-12T00:38:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.071+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccd30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.071+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.071+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _buaLVvxWYEHxi9eMD-MBCcRbLerAlaf 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.kDV_Dirie0e0IRSW87zqqK8AEcZbApb_0 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.kDV_Dirie0e0IRSW87zqqK8AEcZbApb_1 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.kDV_Dirie0e0IRSW87zqqK8AEcZbApb_2 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.075+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _buaLVvxWYEHxi9eMD-MBCcRbLerAlaf 2024-09-12T00:38:24.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.079+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:38:24.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.079+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d7004f480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.083+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.083+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4344258100534045415 2024-09-12T00:38:24.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.083+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d7004f480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.083+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.083+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4344258100534045415 2024-09-12T00:38:24.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.1 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.1_1 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.2 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.2_1 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.3 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.087+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4344258100534045415 2024-09-12T00:38:24.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.091+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:38:24.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.095+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70025f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x561a7dab4958 s->prefetch_data=0 2024-09-12T00:38:24.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.095+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.095+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _N4KOTQBXNti4Vbhqyd7ccmbNyqBMESx 2024-09-12T00:38:24.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.095+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70025f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x561a7dab4958 s->prefetch_data=0 2024-09-12T00:38:24.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.095+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7dab4958 2024-09-12T00:38:24.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.095+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _N4KOTQBXNti4Vbhqyd7ccmbNyqBMESx 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.Bg-juM9rd7gByJ4CQDX1RUh25xtxVWs_0 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.Bg-juM9rd7gByJ4CQDX1RUh25xtxVWs_1 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.Bg-juM9rd7gByJ4CQDX1RUh25xtxVWs_2 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.103+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _N4KOTQBXNti4Vbhqyd7ccmbNyqBMESx 2024-09-12T00:38:24.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.107+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:38:24.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.107+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70025f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.107+0000 7f1d7a2e19c0 10 manifest: total_size = 541681 2024-09-12T00:38:24.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.107+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9234104548329529724 2024-09-12T00:38:24.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.107+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70025f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.107+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.107+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:24.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:38:24.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:38:24.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:24.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:38:24.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:38:24.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9234104548329529724 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.1 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.2 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.3 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.115+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9234104548329529724 2024-09-12T00:38:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.119+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:38:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.119+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccd30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.119+0000 7f1d7a2e19c0 10 manifest: total_size = 541681 2024-09-12T00:38:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.119+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _IIHFJtU3WFLvcMHs8jBdY83wM5KpuAG 2024-09-12T00:38:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.119+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccd30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.119+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.119+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.123+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.123+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.123+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _IIHFJtU3WFLvcMHs8jBdY83wM5KpuAG 2024-09-12T00:38:24.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.123+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.123+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.a1mOpuGczRKXuhH10Ha4-CIHgAcvIG4_0 2024-09-12T00:38:24.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.123+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:38:24.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.123+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.123+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _IIHFJtU3WFLvcMHs8jBdY83wM5KpuAG 2024-09-12T00:38:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.127+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:38:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.127+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70025f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.131+0000 7f1d7a2e19c0 10 manifest: total_size = 541681 2024-09-12T00:38:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.131+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to _jZkhCkcwIQjWiWlFnm31aXqzkpIAFob 2024-09-12T00:38:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.131+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d70025f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.131+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.131+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.135+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.135+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.135+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: _jZkhCkcwIQjWiWlFnm31aXqzkpIAFob 2024-09-12T00:38:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.135+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.135+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.xRgxP2yuyHMUK9r-6B0sapklxa1C6r6_0 2024-09-12T00:38:24.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.135+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:38:24.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.135+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.135+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _jZkhCkcwIQjWiWlFnm31aXqzkpIAFob 2024-09-12T00:38:24.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.139+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:38:24.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.139+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da99cf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.143+0000 7f1d7a2e19c0 10 manifest: total_size = 541681 2024-09-12T00:38:24.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.143+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1602472788173440852 2024-09-12T00:38:24.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.143+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da99cf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.143+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.143+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16.0 2024-09-12T00:38:24.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:24.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:38:24.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:38:24.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1602472788173440852 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.1 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.2 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:38:24.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.3 2024-09-12T00:38:24.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:38:24.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.151+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1602472788173440852 2024-09-12T00:38:24.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.155+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:24.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.155+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:38:24.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.155+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:24.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.155+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:24.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.155+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:24.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.155+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:24.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.155+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:24.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.155+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:24.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.159+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:38:24.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.159+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.159+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:38:24.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.159+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:38:24.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.159+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:38:24.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.163+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:38:24.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.163+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:38:24.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.163+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94671777208064 notifier 5708 bl.length()=199 2024-09-12T00:38:24.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.167+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16 from cache 2024-09-12T00:38:24.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.167+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16, ofs0, ns] 2024-09-12T00:38:24.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.167+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94671777231232 notifier 5708 bl.length()=257 2024-09-12T00:38:24.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.171+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16 : miss 2024-09-12T00:38:24.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.171+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.175+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.175+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16 info.flags=0x0 2024-09-12T00:38:24.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.175+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16 to cache LRU end 2024-09-12T00:38:24.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14 : miss 2024-09-12T00:38:24.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:38:24.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14 info.flags=0x17 2024-09-12T00:38:24.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14 to cache LRU end 2024-09-12T00:38:24.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:24.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:24.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14 2024-09-12T00:38:24.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:38:24.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:38:24.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:38:24.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.179+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da7a150 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.183+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.183+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4284001784754705353 2024-09-12T00:38:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.183+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da7a150 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.183+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.183+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14.0 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4284001784754705353 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.1 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__shadow_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.1_1 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.2 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__shadow_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.2_1 2024-09-12T00:38:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:38:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.3 2024-09-12T00:38:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:38:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.187+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4284001784754705353 2024-09-12T00:38:24.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.191+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:38:24.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.191+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6801a450 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.191+0000 7f1d7a2e19c0 10 manifest: total_size = 11534336 2024-09-12T00:38:24.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.191+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18329846714066474852 2024-09-12T00:38:24.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.191+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6801a450 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.191+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.191+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14.0 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18329846714066474852 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.1 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__shadow_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.1_1 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.2 2024-09-12T00:38:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:38:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__shadow_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.2_1 2024-09-12T00:38:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:38:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.3 2024-09-12T00:38:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:38:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.199+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18329846714066474852 2024-09-12T00:38:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.203+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:38:24.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.207+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccd30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.207+0000 7f1d7a2e19c0 10 manifest: total_size = 45360 2024-09-12T00:38:24.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.207+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13940922646380237668 2024-09-12T00:38:24.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.207+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6c0ccd30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.207+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.207+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14.0 2024-09-12T00:38:24.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:38:24.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T00:38:24.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:38:24.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13940922646380237668 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-STANDARD.2~lUVzowMzw3_ZQqLIGQX3qEAcs5JqHvc.1 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-STANDARD.2~lUVzowMzw3_ZQqLIGQX3qEAcs5JqHvc.2 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-STANDARD.2~lUVzowMzw3_ZQqLIGQX3qEAcs5JqHvc.3 2024-09-12T00:38:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:38:24.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.211+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13940922646380237668 2024-09-12T00:38:24.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.215+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:38:24.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.215+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:24.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.215+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:24.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.215+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:24.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.215+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:24.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.215+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:24.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.215+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:24.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.215+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:24.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.219+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:38:24.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.219+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.223+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:38:24.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.223+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:38:24.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.223+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:38:24.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.223+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:38:24.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.223+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:38:24.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.227+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94671777225040 notifier 5708 bl.length()=194 2024-09-12T00:38:24.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.231+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14 from cache 2024-09-12T00:38:24.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.231+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14, ofs0, ns] 2024-09-12T00:38:24.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.231+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94671777231232 notifier 5708 bl.length()=252 2024-09-12T00:38:24.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.235+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14 : miss 2024-09-12T00:38:24.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.235+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.235+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.235+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14 info.flags=0x0 2024-09-12T00:38:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.235+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14 to cache LRU end 2024-09-12T00:38:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13 : miss 2024-09-12T00:38:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:38:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13 info.flags=0x17 2024-09-12T00:38:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13 to cache LRU end 2024-09-12T00:38:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:24.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13 2024-09-12T00:38:24.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:38:24.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:38:24.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:38:24.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.243+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7daa7560 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.246+0000 7f1d7a2e19c0 10 manifest: total_size = 10485760 2024-09-12T00:38:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.246+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8824900813053310674 2024-09-12T00:38:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.246+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7daa7560 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.246+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.246+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13.0 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8824900813053310674 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.ihl3og6mMcq9vO96gGIJKgGApk-RLHx_0 2024-09-12T00:38:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:38:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.ihl3og6mMcq9vO96gGIJKgGApk-RLHx_1 2024-09-12T00:38:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:38:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.ihl3og6mMcq9vO96gGIJKgGApk-RLHx_2 2024-09-12T00:38:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-09-12T00:38:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.250+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8824900813053310674 2024-09-12T00:38:24.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.254+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:38:24.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.254+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.254+0000 7f1d7a2e19c0 10 manifest: total_size = 10485760 2024-09-12T00:38:24.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.254+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2728085434152388860 2024-09-12T00:38:24.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.254+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.254+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.254+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13.0 2024-09-12T00:38:24.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2728085434152388860 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.7VO0ay2Ue86qeJGF4kUjuBRErcGwpIr_0 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.7VO0ay2Ue86qeJGF4kUjuBRErcGwpIr_1 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.7VO0ay2Ue86qeJGF4kUjuBRErcGwpIr_2 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T00:38:24.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.262+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2728085434152388860 2024-09-12T00:38:24.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.266+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d7004f480 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.266+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:38:24.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.270+0000 7f1d7a2e19c0 10 manifest: total_size = 44258 2024-09-12T00:38:24.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.270+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4271728512572506110 2024-09-12T00:38:24.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.270+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d7004f480 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.270+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.270+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13.0 2024-09-12T00:38:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.274+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.274+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=44258 stripe_ofs=44258 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.274+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4271728512572506110 2024-09-12T00:38:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.274+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.274+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.ts1DkAxKrUW4cnVC5VNXiEHnsYKRH5r_0 2024-09-12T00:38:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.274+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:38:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.274+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.274+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4271728512572506110 2024-09-12T00:38:24.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.278+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:38:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.278+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.278+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:24.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.278+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:24.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.278+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:24.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.278+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:24.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.278+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:24.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.278+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.282+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.282+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.286+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:38:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.286+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:38:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.286+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:38:24.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.286+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:38:24.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.286+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:38:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.290+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 94671777218016 notifier 5708 bl.length()=184 2024-09-12T00:38:24.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.294+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13 from cache 2024-09-12T00:38:24.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.294+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13, ofs0, ns] 2024-09-12T00:38:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.294+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 94671777227536 notifier 5708 bl.length()=242 2024-09-12T00:38:24.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.298+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13 : miss 2024-09-12T00:38:24.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.298+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.298+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.298+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13 info.flags=0x0 2024-09-12T00:38:24.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.298+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13 to cache LRU end 2024-09-12T00:38:24.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6 : miss 2024-09-12T00:38:24.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:38:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6 info.flags=0x17 2024-09-12T00:38:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6 to cache LRU end 2024-09-12T00:38:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6 2024-09-12T00:38:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:38:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:38:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:38:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:38:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.306+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9df40 obj=test-client.0-r-test-small-obj-data.1:__ state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.310+0000 7f1d7a2e19c0 10 manifest: total_size = 0 2024-09-12T00:38:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.310+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2542441450330728578 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.310+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9df40 obj=test-client.0-r-test-small-obj-data.1:__ state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.310+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.310+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6.0 2024-09-12T00:38:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.314+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9df40 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.318+0000 7f1d7a2e19c0 10 manifest: total_size = 0 2024-09-12T00:38:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.318+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8853505368764003594 2024-09-12T00:38:24.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.318+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9df40 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.318+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.318+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6.0 2024-09-12T00:38:24.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.318+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:38:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.322+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9df40 obj=test-client.0-r-test-small-obj-data.1:___ state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.326+0000 7f1d7a2e19c0 10 manifest: total_size = 0 2024-09-12T00:38:24.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.326+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14390122385733250366 2024-09-12T00:38:24.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.326+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9df40 obj=test-client.0-r-test-small-obj-data.1:___ state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.326+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.326+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6.0 2024-09-12T00:38:24.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.330+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:38:24.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.330+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9df40 obj=test-client.0-r-test-small-obj-data.1:obj state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.334+0000 7f1d7a2e19c0 10 manifest: total_size = 0 2024-09-12T00:38:24.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.334+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8200311009402267970 2024-09-12T00:38:24.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.334+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7da9df40 obj=test-client.0-r-test-small-obj-data.1:obj state=0x561a7daa56b8 s->prefetch_data=0 2024-09-12T00:38:24.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.334+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa56b8 2024-09-12T00:38:24.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.334+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6.0 2024-09-12T00:38:24.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.334+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:38:24.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.338+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:24.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.338+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.342+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:38:24.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.342+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:24.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.342+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:24.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.342+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:24.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.342+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:24.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.342+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.346+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:38:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.346+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.350+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:38:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.350+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:38:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.350+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:38:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.350+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:38:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.350+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:38:24.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.354+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 94671777210784 notifier 5708 bl.length()=181 2024-09-12T00:38:24.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.358+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6 from cache 2024-09-12T00:38:24.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.358+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6, ofs0, ns] 2024-09-12T00:38:24.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.358+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94671777207008 notifier 5708 bl.length()=238 2024-09-12T00:38:24.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.362+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6 : miss 2024-09-12T00:38:24.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.362+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.362+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.362+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6 info.flags=0x0 2024-09-12T00:38:24.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.362+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6 to cache LRU end 2024-09-12T00:38:24.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7 : miss 2024-09-12T00:38:24.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:38:24.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7 info.flags=0x17 2024-09-12T00:38:24.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7 to cache LRU end 2024-09-12T00:38:24.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:24.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:24.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7 2024-09-12T00:38:24.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:38:24.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:38:24.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:38:24.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:38:24.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.370+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab2d80 obj=test-client.0-r-test-small-obj-data.2:__ state=0x561a7daa00e8 s->prefetch_data=0 2024-09-12T00:38:24.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.374+0000 7f1d7a2e19c0 10 manifest: total_size = 527 2024-09-12T00:38:24.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.374+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11731696310696778318 2024-09-12T00:38:24.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.374+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab2d80 obj=test-client.0-r-test-small-obj-data.2:__ state=0x561a7daa00e8 s->prefetch_data=0 2024-09-12T00:38:24.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.374+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa00e8 2024-09-12T00:38:24.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.374+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7.0 2024-09-12T00:38:24.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.378+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.378+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.378+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11731696310696778318 2024-09-12T00:38:24.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.378+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.378+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7__shadow_.4UrRVB6LTrdj7wsaco04Rb9zpHhHeaH_0 2024-09-12T00:38:24.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.378+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:24.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.378+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.378+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11731696310696778318 2024-09-12T00:38:24.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.382+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab2d80 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x561a7daa00e8 s->prefetch_data=0 2024-09-12T00:38:24.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.382+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:38:24.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.386+0000 7f1d7a2e19c0 10 manifest: total_size = 524288 2024-09-12T00:38:24.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.386+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14735142168636370161 2024-09-12T00:38:24.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.386+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab2d80 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x561a7daa00e8 s->prefetch_data=0 2024-09-12T00:38:24.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.386+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa00e8 2024-09-12T00:38:24.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.386+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7.0 2024-09-12T00:38:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.390+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.390+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.390+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14735142168636370161 2024-09-12T00:38:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.390+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.390+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7__shadow_.xJtmB7gR5gUIs_wSr9Lc6lhxhKCGpxl_0 2024-09-12T00:38:24.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.390+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:24.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.390+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.390+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14735142168636370161 2024-09-12T00:38:24.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.394+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:38:24.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.394+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab2d80 obj=test-client.0-r-test-small-obj-data.2:___ state=0x561a7daa00e8 s->prefetch_data=0 2024-09-12T00:38:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.398+0000 7f1d7a2e19c0 10 manifest: total_size = 524288 2024-09-12T00:38:24.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.398+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14632437925105352469 2024-09-12T00:38:24.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.398+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab2d80 obj=test-client.0-r-test-small-obj-data.2:___ state=0x561a7daa00e8 s->prefetch_data=0 2024-09-12T00:38:24.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.398+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa00e8 2024-09-12T00:38:24.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.398+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7.0 2024-09-12T00:38:24.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.402+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.402+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.402+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14632437925105352469 2024-09-12T00:38:24.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.402+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.402+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7__shadow_.Pla0T3Ue7Nz1iXTLwSS5YkuFoVWjfZ8_0 2024-09-12T00:38:24.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.402+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.402+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.402+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14632437925105352469 2024-09-12T00:38:24.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.406+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:38:24.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.406+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab2d80 obj=test-client.0-r-test-small-obj-data.2:obj state=0x561a7daa00e8 s->prefetch_data=0 2024-09-12T00:38:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.410+0000 7f1d7a2e19c0 10 manifest: total_size = 527 2024-09-12T00:38:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.410+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13020905528310279984 2024-09-12T00:38:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.410+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x561a7dab2d80 obj=test-client.0-r-test-small-obj-data.2:obj state=0x561a7daa00e8 s->prefetch_data=0 2024-09-12T00:38:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.410+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa00e8 2024-09-12T00:38:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.410+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7.0 2024-09-12T00:38:24.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.414+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.414+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.414+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13020905528310279984 2024-09-12T00:38:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.414+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.414+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7__shadow_.Ylkl7yX5ZbVSVos6FI0eJdNWbQUUog0_0 2024-09-12T00:38:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.414+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.414+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.414+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13020905528310279984 2024-09-12T00:38:24.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.418+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:38:24.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.418+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:24.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.418+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:24.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.418+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:24.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.418+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:24.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.418+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:24.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.418+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:24.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.418+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:24.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.422+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:38:24.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.422+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.426+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:38:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.426+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:38:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.426+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:38:24.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.426+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:38:24.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.426+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:38:24.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.426+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366213 cookie 94671777210784 notifier 5708 bl.length()=181 2024-09-12T00:38:24.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.434+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7 from cache 2024-09-12T00:38:24.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.434+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7, ofs0, ns] 2024-09-12T00:38:24.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.434+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94671777207008 notifier 5708 bl.length()=238 2024-09-12T00:38:24.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.438+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7 : miss 2024-09-12T00:38:24.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.438+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.438+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.438+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7 info.flags=0x0 2024-09-12T00:38:24.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.438+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7 to cache LRU end 2024-09-12T00:38:24.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8 : miss 2024-09-12T00:38:24.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:38:24.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8 info.flags=0x17 2024-09-12T00:38:24.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8 to cache LRU end 2024-09-12T00:38:24.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:24.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:24.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8 2024-09-12T00:38:24.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:38:24.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:38:24.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:38:24.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:38:24.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.446+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-small-obj-data.3:__ state=0x561a7daa8078 s->prefetch_data=0 2024-09-12T00:38:24.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.450+0000 7f1d7a2e19c0 10 manifest: total_size = 55 2024-09-12T00:38:24.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.450+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.439460983713103010 2024-09-12T00:38:24.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.450+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-small-obj-data.3:__ state=0x561a7daa8078 s->prefetch_data=0 2024-09-12T00:38:24.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.450+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa8078 2024-09-12T00:38:24.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.450+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8.0 2024-09-12T00:38:24.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.454+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.454+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.454+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.439460983713103010 2024-09-12T00:38:24.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.454+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.454+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8__shadow_.17Bf8R-3BsWghP3PgvOmRnsrNdUhOxR_0 2024-09-12T00:38:24.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.454+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-12T00:38:24.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.454+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.454+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.439460983713103010 2024-09-12T00:38:24.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.458+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:38:24.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.458+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x561a7daa8078 s->prefetch_data=0 2024-09-12T00:38:24.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.462+0000 7f1d7a2e19c0 10 manifest: total_size = 55 2024-09-12T00:38:24.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.462+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11542524997250851180 2024-09-12T00:38:24.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.462+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x561a7daa8078 s->prefetch_data=0 2024-09-12T00:38:24.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.462+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa8078 2024-09-12T00:38:24.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.462+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8.0 2024-09-12T00:38:24.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.466+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.466+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.466+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11542524997250851180 2024-09-12T00:38:24.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.466+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.466+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8__shadow_.0HRDPhXeJpDxzYiLaB8SSZIvT9vc_MO_0 2024-09-12T00:38:24.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.466+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:38:24.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.466+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.466+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11542524997250851180 2024-09-12T00:38:24.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.470+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-small-obj-data.3:___ state=0x561a7daa8078 s->prefetch_data=0 2024-09-12T00:38:24.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.470+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:38:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.474+0000 7f1d7a2e19c0 10 manifest: total_size = 49187 2024-09-12T00:38:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.474+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5763680082550506495 2024-09-12T00:38:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.474+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-small-obj-data.3:___ state=0x561a7daa8078 s->prefetch_data=0 2024-09-12T00:38:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.474+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa8078 2024-09-12T00:38:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.474+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8.0 2024-09-12T00:38:24.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.478+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.478+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.478+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5763680082550506495 2024-09-12T00:38:24.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.478+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.478+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8__shadow_.-DhJ1lMuJn5wVMTVigUiN3gMVQlvXEy_0 2024-09-12T00:38:24.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.478+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:38:24.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.478+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.478+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5763680082550506495 2024-09-12T00:38:24.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.482+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-small-obj-data.3:obj state=0x561a7daa8078 s->prefetch_data=0 2024-09-12T00:38:24.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.482+0000 7f1c56ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:38:24.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.482+0000 7f1d7a2e19c0 10 manifest: total_size = 1035 2024-09-12T00:38:24.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.482+0000 7f1d7a2e19c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285699794501358581 2024-09-12T00:38:24.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.482+0000 7f1d7a2e19c0 20 get_obj_state: octx=0x7f1d6805c970 obj=test-client.0-r-test-small-obj-data.3:obj state=0x561a7daa8078 s->prefetch_data=0 2024-09-12T00:38:24.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.482+0000 7f1d7a2e19c0 20 prepare_atomic_modification: state is not atomic. state=0x561a7daa8078 2024-09-12T00:38:24.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.482+0000 7f1d7a2e19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8.0 2024-09-12T00:38:24.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.490+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:24.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.490+0000 7f1d7a2e19c0 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T00:38:24.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.490+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285699794501358581 2024-09-12T00:38:24.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.490+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:38:24.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.490+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8__shadow_.G4xbm7NmeKxHbBdA0gbWY5WdFOsAyJh_0 2024-09-12T00:38:24.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.490+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-12T00:38:24.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.490+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:38:24.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.490+0000 7f1d7a2e19c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285699794501358581 2024-09-12T00:38:24.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.494+0000 7f1c567fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:38:24.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.494+0000 7f1d7a2e19c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:38:24.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.494+0000 7f1d7a2e19c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:38:24.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.494+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:38:24.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.494+0000 7f1d7a2e19c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:38:24.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.494+0000 7f1d7a2e19c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:38:24.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.494+0000 7f1d7a2e19c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:38:24.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.494+0000 7f1d7a2e19c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:38:24.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.498+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:38:24.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.498+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.498+0000 7f1d7a2e19c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:38:24.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.498+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:38:24.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.498+0000 7f1d7a2e19c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:38:24.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.502+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:38:24.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.502+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:38:24.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.502+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366214 cookie 94671777210784 notifier 5708 bl.length()=181 2024-09-12T00:38:24.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.506+0000 7f1d7a2e19c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8 from cache 2024-09-12T00:38:24.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.506+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8, ofs0, ns] 2024-09-12T00:38:24.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.506+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94671777207008 notifier 5708 bl.length()=238 2024-09-12T00:38:24.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.510+0000 7f1d7a2e19c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8 : miss 2024-09-12T00:38:24.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.510+0000 7f1d7a2e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.510+0000 7f1d7a2e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.510+0000 7f1d7a2e19c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8 info.flags=0x0 2024-09-12T00:38:24.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.510+0000 7f1d7a2e19c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8 to cache LRU end 2024-09-12T00:38:24.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.518+0000 7f1d7a2e19c0 10 removing key index: SGIASVAVJVQRRGYMBONH 2024-09-12T00:38:24.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.522+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:SGIASVAVJVQRRGYMBONH, ofs0, ns] 2024-09-12T00:38:24.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.522+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94671777227536 notifier 5708 bl.length()=170 2024-09-12T00:38:24.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.522+0000 7f1d7a2e19c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:38:24.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.526+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:38:24.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.530+0000 7f1c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94671777218016 notifier 5708 bl.length()=182 2024-09-12T00:38:24.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.530+0000 7f1d7a2e19c0 10 removing user buckets index 2024-09-12T00:38:24.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.534+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:38:24.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.534+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366225 cookie 94671777225040 notifier 5708 bl.length()=173 2024-09-12T00:38:24.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.534+0000 7f1d7a2e19c0 10 removing user index: ragweed.client.0 2024-09-12T00:38:24.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.538+0000 7f1d7a2e19c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:38:24.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.538+0000 7f1d7a2e19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:38:24.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.538+0000 7f1c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94671777223984 notifier 5708 bl.length()=165 2024-09-12T00:38:24.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.542+0000 7f1c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:24.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.546+0000 7f1d7a2e19c0 20 remove_watcher() i=0 2024-09-12T00:38:24.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.546+0000 7f1d7a2e19c0 2 removed watcher, disabling cache 2024-09-12T00:38:24.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.550+0000 7f1d7a2e19c0 20 remove_watcher() i=1 2024-09-12T00:38:24.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.554+0000 7f1d7a2e19c0 20 remove_watcher() i=2 2024-09-12T00:38:24.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.554+0000 7f1d7a2e19c0 20 remove_watcher() i=3 2024-09-12T00:38:24.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.558+0000 7f1d7a2e19c0 20 remove_watcher() i=4 2024-09-12T00:38:24.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.558+0000 7f1d7a2e19c0 20 remove_watcher() i=5 2024-09-12T00:38:24.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.562+0000 7f1d7a2e19c0 20 remove_watcher() i=6 2024-09-12T00:38:24.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.566+0000 7f1d7a2e19c0 20 remove_watcher() i=7 2024-09-12T00:38:24.584 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:38:24.665 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:24.665 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:24.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.710+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 realm 2024-09-12T00:38:24.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:24.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:24.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:24.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.714+0000 7fdf4bcd39c0 20 searching for the correct realm 2024-09-12T00:38:24.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.722+0000 7fdf49fda640 0 -- 172.21.15.137:0/1010591259 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fdf34077920 msgr2=0x7fdf34063010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.726+0000 7fdf497d9640 0 -- 172.21.15.137:0/1010591259 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fdf3c008050 msgr2=0x7fdf3c032950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:24.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:24.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:38:24.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:24.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:38:24.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:24.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:24.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.734+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 zone default found 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 4 Realm: () 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:38:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:38:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 zonegroup default 2024-09-12T00:38:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 started sync module instance, tier type = 2024-09-12T00:38:24.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.738+0000 7fdf4bcd39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:38:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.754+0000 7fdf4bcd39c0 20 add_watcher() i=0 2024-09-12T00:38:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.754+0000 7fdf4bcd39c0 20 add_watcher() i=1 2024-09-12T00:38:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.754+0000 7fdf4bcd39c0 20 add_watcher() i=2 2024-09-12T00:38:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.754+0000 7fdf4bcd39c0 20 add_watcher() i=3 2024-09-12T00:38:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.754+0000 7fdf4bcd39c0 20 add_watcher() i=4 2024-09-12T00:38:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.754+0000 7fdf4bcd39c0 20 add_watcher() i=5 2024-09-12T00:38:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.758+0000 7fdf4bcd39c0 20 add_watcher() i=6 2024-09-12T00:38:24.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.758+0000 7fdf4bcd39c0 20 add_watcher() i=7 2024-09-12T00:38:24.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.758+0000 7fdf4bcd39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.762+0000 7fddfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.762+0000 7fdf4bcd39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.762+0000 7fdf4bcd39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:24.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.834+0000 7fddfefe5640 20 reqs_thread_entry: start 2024-09-12T00:38:24.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:24.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 20 Filter name: none 2024-09-12T00:38:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fddfcfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:38:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:38:24.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:38:24.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:38:24.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:24.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 10 removing key index: OCJFZROXDYRBNTZRKHPN 2024-09-12T00:38:24.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.838+0000 7fdf4bcd39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:OCJFZROXDYRBNTZRKHPN, ofs0, ns] 2024-09-12T00:38:24.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.842+0000 7fde2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 93872833855504 notifier 5726 bl.length()=170 2024-09-12T00:38:24.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.842+0000 7fdf4bcd39c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:38:24.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.842+0000 7fdf4bcd39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:38:24.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.842+0000 7fde1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 93872833853296 notifier 5726 bl.length()=182 2024-09-12T00:38:24.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.846+0000 7fdf4bcd39c0 10 removing user buckets index 2024-09-12T00:38:24.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.846+0000 7fdf4bcd39c0 10 removing user index: sysuser.client.0 2024-09-12T00:38:24.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.850+0000 7fdf4bcd39c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:38:24.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.850+0000 7fdf4bcd39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:38:24.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.850+0000 7fde2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 93872833861072 notifier 5726 bl.length()=165 2024-09-12T00:38:24.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.850+0000 7fddfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:24.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.854+0000 7fdf4bcd39c0 20 remove_watcher() i=0 2024-09-12T00:38:24.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.854+0000 7fdf4bcd39c0 2 removed watcher, disabling cache 2024-09-12T00:38:24.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.858+0000 7fdf4bcd39c0 20 remove_watcher() i=1 2024-09-12T00:38:24.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.862+0000 7fdf4bcd39c0 20 remove_watcher() i=2 2024-09-12T00:38:24.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.862+0000 7fdf4bcd39c0 20 remove_watcher() i=3 2024-09-12T00:38:24.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.866+0000 7fdf4bcd39c0 20 remove_watcher() i=4 2024-09-12T00:38:24.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.866+0000 7fdf4bcd39c0 20 remove_watcher() i=5 2024-09-12T00:38:24.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.870+0000 7fdf4bcd39c0 20 remove_watcher() i=6 2024-09-12T00:38:24.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:38:24.870+0000 7fdf4bcd39c0 20 remove_watcher() i=7 2024-09-12T00:38:24.894 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:38:24.894 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:38:24.986 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:38:24.997 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:38:24.997 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:38:24.997 DEBUG:teuthology.orchestra.run.smithi137:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:38:25.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:38:25.002 INFO:teuthology.orchestra.run.smithi137.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:38:25.002 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:38:25.052 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:38:25.052 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:38:25.101 INFO:tasks.workunit:timeout=3h 2024-09-12T00:38:25.101 INFO:tasks.workunit:cleanup=True 2024-09-12T00:38:25.101 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:38:25.150 INFO:tasks.workunit.client.0.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:39:08.444 INFO:tasks.workunit.client.0.smithi137.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:39:08.444 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:08.444 INFO:tasks.workunit.client.0.smithi137.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:39:08.444 INFO:tasks.workunit.client.0.smithi137.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:39:08.444 INFO:tasks.workunit.client.0.smithi137.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr: git switch -c 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr:Or undo this operation with: 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr: git switch - 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:08.445 INFO:tasks.workunit.client.0.smithi137.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:39:08.451 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:39:08.497 INFO:tasks.workunit.client.0.smithi137.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:39:08.500 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:39:08.500 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:39:08.561 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:39:08.658 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:39:08.660 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:39:08.660 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:39:08.703 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:39:08.707 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:39:08.707 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:39:08.753 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:39:08.754 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:39:08.754 DEBUG:teuthology.orchestra.run.smithi137:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:39:08.806 INFO:tasks.workunit.client.0.smithi137.stderr:+ ulimit -c 0 2024-09-12T00:39:08.806 INFO:tasks.workunit.client.0.smithi137.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:39:08.808 INFO:tasks.workunit.client.0.smithi137.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:39:08.808 INFO:tasks.workunit.client.0.smithi137.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:++ deactivate nondestructive 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:++ hash -r 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:39:11.680 INFO:tasks.workunit.client.0.smithi137.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ export VIRTUAL_ENV 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ export PATH 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -z '' ']' 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ PS1='(rgw) ' 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ export PS1 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:39:11.681 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:39:11.682 INFO:tasks.workunit.client.0.smithi137.stderr:++ hash -r 2024-09-12T00:39:11.682 INFO:tasks.workunit.client.0.smithi137.stderr:+ pip install pip --upgrade 2024-09-12T00:39:12.037 INFO:tasks.workunit.client.0.smithi137.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:39:12.251 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting pip 2024-09-12T00:39:12.257 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:39:12.291 INFO:tasks.workunit.client.0.smithi137.stdout:Installing collected packages: pip 2024-09-12T00:39:12.292 INFO:tasks.workunit.client.0.smithi137.stdout: Attempting uninstall: pip 2024-09-12T00:39:12.292 INFO:tasks.workunit.client.0.smithi137.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:39:12.550 INFO:tasks.workunit.client.0.smithi137.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:39:12.556 INFO:tasks.workunit.client.0.smithi137.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:39:13.601 INFO:tasks.workunit.client.0.smithi137.stdout:Successfully installed pip-24.2 2024-09-12T00:39:13.677 INFO:tasks.workunit.client.0.smithi137.stderr:+ pip install boto3 2024-09-12T00:39:14.831 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting boto3 2024-09-12T00:39:14.833 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:39:15.390 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:39:15.391 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:39:15.443 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:39:15.444 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:39:15.500 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:39:15.501 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:39:15.552 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:39:15.553 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:39:15.647 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:39:15.648 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:39:15.814 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:39:15.814 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:39:15.818 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:39:15.819 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:39:15.829 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:39:15.830 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:39:15.831 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:39:15.833 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:39:15.834 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:39:15.901 INFO:tasks.workunit.client.0.smithi137.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:39:16.985 INFO:tasks.workunit.client.0.smithi137.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:39:17.165 INFO:tasks.workunit.client.0.smithi137.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:39:17.288 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:39:17.327 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:17.327 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:17.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.369+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 realm 2024-09-12T00:39:17.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:17.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:17.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.373+0000 7f915f4ab9c0 20 searching for the correct realm 2024-09-12T00:39:17.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.381+0000 7f915c7b0640 0 -- 172.21.15.137:0/1167469322 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5651dc033f70 msgr2=0x5651dc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:17.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.389+0000 7f915cfb1640 0 -- 172.21.15.137:0/1167469322 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5651dc0381c0 msgr2=0x5651dc03a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:17.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:17.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:17.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:17.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:17.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:17.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:17.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 zone default found 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 4 Realm: () 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 zonegroup default 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.393+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.397+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.397+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.397+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.397+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.397+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.397+0000 7f915f4ab9c0 20 started sync module instance, tier type = 2024-09-12T00:39:17.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.397+0000 7f915f4ab9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:17.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.413+0000 7f915f4ab9c0 20 add_watcher() i=0 2024-09-12T00:39:17.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.413+0000 7f915f4ab9c0 20 add_watcher() i=1 2024-09-12T00:39:17.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.413+0000 7f915f4ab9c0 20 add_watcher() i=2 2024-09-12T00:39:17.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.413+0000 7f915f4ab9c0 20 add_watcher() i=3 2024-09-12T00:39:17.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.413+0000 7f915f4ab9c0 20 add_watcher() i=4 2024-09-12T00:39:17.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.413+0000 7f915f4ab9c0 20 add_watcher() i=5 2024-09-12T00:39:17.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.413+0000 7f915f4ab9c0 20 add_watcher() i=6 2024-09-12T00:39:17.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.417+0000 7f915f4ab9c0 20 add_watcher() i=7 2024-09-12T00:39:17.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.417+0000 7f915f4ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:17.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f9012fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:17.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:17.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 5 note: GC not initialized 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f9011fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 20 Filter name: none 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f8f837fe640 20 reqs_thread_entry: start 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.421+0000 7f915f4ab9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.425+0000 7f915f4ab9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.425+0000 7f915f4ab9c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.425+0000 7f915f4ab9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.425+0000 7f9033fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366226 cookie 94909583592976 notifier 5744 bl.length()=569 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.425+0000 7f9033fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:39:17.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.425+0000 7f9033fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:39:17.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.429+0000 7f915f4ab9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:39:17.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.429+0000 7f915f4ab9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:39:17.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.429+0000 7f915f4ab9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:39:17.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.429+0000 7f90337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366227 cookie 94909583543456 notifier 5744 bl.length()=180 2024-09-12T00:39:17.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.429+0000 7f90337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:39:17.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.429+0000 7f90337fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:39:17.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.433+0000 7f9012fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:17.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.437+0000 7f915f4ab9c0 20 remove_watcher() i=0 2024-09-12T00:39:17.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.437+0000 7f915f4ab9c0 2 removed watcher, disabling cache 2024-09-12T00:39:17.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.437+0000 7f915f4ab9c0 20 remove_watcher() i=1 2024-09-12T00:39:17.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.441+0000 7f915f4ab9c0 20 remove_watcher() i=2 2024-09-12T00:39:17.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.441+0000 7f915f4ab9c0 20 remove_watcher() i=3 2024-09-12T00:39:17.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.441+0000 7f915f4ab9c0 20 remove_watcher() i=4 2024-09-12T00:39:17.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.445+0000 7f915f4ab9c0 20 remove_watcher() i=5 2024-09-12T00:39:17.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.449+0000 7f915f4ab9c0 20 remove_watcher() i=6 2024-09-12T00:39:17.447 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:17.449+0000 7f915f4ab9c0 20 remove_watcher() i=7 2024-09-12T00:39:33.394 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:33.394 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:33.445 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:33.445 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:33.472 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:33.472 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:33.500 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:33.500 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:33.514 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:33.514 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:33.560 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:33.560 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:33.605 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard add 2024-09-12T00:39:33.605 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:33.606 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:33.639 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:33.639 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:33.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.685+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 realm 2024-09-12T00:39:33.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:33.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:33.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.689+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.693+0000 7fa8e66ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:33.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.693+0000 7fa8e66ca9c0 20 searching for the correct realm 2024-09-12T00:39:33.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.697+0000 7fa8e49d1640 0 -- 172.21.15.137:0/2199385381 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fa8cc0c2070 msgr2=0x7fa8cc0e89c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:33.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.705+0000 7fa8e41d0640 0 -- 172.21.15.137:0/2199385381 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fa8d400e040 msgr2=0x7fa8d403a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:33.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:33.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:33.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:33.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:33.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:33.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:33.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.709+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:33.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:33.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 zone default found 2024-09-12T00:39:33.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 4 Realm: () 2024-09-12T00:39:33.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:33.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:33.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:33.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 zonegroup default 2024-09-12T00:39:33.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 started sync module instance, tier type = 2024-09-12T00:39:33.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.713+0000 7fa8e66ca9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:33.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 20 add_watcher() i=0 2024-09-12T00:39:33.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 20 add_watcher() i=1 2024-09-12T00:39:33.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 20 add_watcher() i=2 2024-09-12T00:39:33.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 20 add_watcher() i=3 2024-09-12T00:39:33.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 20 add_watcher() i=4 2024-09-12T00:39:33.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 20 add_watcher() i=5 2024-09-12T00:39:33.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 20 add_watcher() i=6 2024-09-12T00:39:33.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 20 add_watcher() i=7 2024-09-12T00:39:33.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.733+0000 7fa8e66ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:33.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa79afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:33.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:33.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:33.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 5 note: GC not initialized 2024-09-12T00:39:33.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa799fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:33.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:33.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 Filter name: none 2024-09-12T00:39:33.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa70b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:33.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:33.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:33.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:33.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.741+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.745+0000 7fa8e66ca9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:33.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.745+0000 7fa8e66ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.745+0000 7fa8e66ca9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:33.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.745+0000 7fa8e66ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:33.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.745+0000 7fa79afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:33.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.749+0000 7fa8e66ca9c0 20 remove_watcher() i=0 2024-09-12T00:39:33.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.749+0000 7fa8e66ca9c0 2 removed watcher, disabling cache 2024-09-12T00:39:33.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.753+0000 7fa8e66ca9c0 20 remove_watcher() i=1 2024-09-12T00:39:33.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.753+0000 7fa8e66ca9c0 20 remove_watcher() i=2 2024-09-12T00:39:33.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.757+0000 7fa8e66ca9c0 20 remove_watcher() i=3 2024-09-12T00:39:33.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.757+0000 7fa8e66ca9c0 20 remove_watcher() i=4 2024-09-12T00:39:33.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.761+0000 7fa8e66ca9c0 20 remove_watcher() i=5 2024-09-12T00:39:33.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.761+0000 7fa8e66ca9c0 20 remove_watcher() i=6 2024-09-12T00:39:33.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.765+0000 7fa8e66ca9c0 20 remove_watcher() i=7 2024-09-12T00:39:33.776 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:33.776 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:33.776 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: a-bucket id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:39:33.776 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:33.777 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T00:39:33.806 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:33.806 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:33.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.853+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.853+0000 7fe24f8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.853+0000 7fe24f8b69c0 20 realm 2024-09-12T00:39:33.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.853+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.853+0000 7fe24f8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.853+0000 7fe24f8b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:33.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.853+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.857+0000 7fe24f8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.857+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.857+0000 7fe24f8b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:33.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.857+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.857+0000 7fe24f8b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:33.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.857+0000 7fe24f8b69c0 20 searching for the correct realm 2024-09-12T00:39:33.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:33.861+0000 7fe24cbbb640 0 -- 172.21.15.137:0/3212841836 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fe238063120 msgr2=0x7fe23808f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.073+0000 7fe24dbbd640 0 -- 172.21.15.137:0/3212841836 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55f41c5a2cd0 msgr2=0x55f41c5a5120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:34.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:34.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:34.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:34.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:34.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:34.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.085+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:34.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 zone default found 2024-09-12T00:39:34.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 4 Realm: () 2024-09-12T00:39:34.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:34.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:34.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:34.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 zonegroup default 2024-09-12T00:39:34.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 started sync module instance, tier type = 2024-09-12T00:39:34.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.089+0000 7fe24f8b69c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:34.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.113+0000 7fe24f8b69c0 20 add_watcher() i=0 2024-09-12T00:39:34.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.113+0000 7fe24f8b69c0 20 add_watcher() i=1 2024-09-12T00:39:34.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.113+0000 7fe24f8b69c0 20 add_watcher() i=2 2024-09-12T00:39:34.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.113+0000 7fe24f8b69c0 20 add_watcher() i=3 2024-09-12T00:39:34.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.113+0000 7fe24f8b69c0 20 add_watcher() i=4 2024-09-12T00:39:34.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.113+0000 7fe24f8b69c0 20 add_watcher() i=5 2024-09-12T00:39:34.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.113+0000 7fe24f8b69c0 20 add_watcher() i=6 2024-09-12T00:39:34.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.117+0000 7fe24f8b69c0 20 add_watcher() i=7 2024-09-12T00:39:34.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.117+0000 7fe24f8b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:34.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe103fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:34.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:34.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 5 note: GC not initialized 2024-09-12T00:39:34.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe102fe5640 20 reqs_thread_entry: start 2024-09-12T00:39:34.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:34.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 20 Filter name: none 2024-09-12T00:39:34.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe100fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:34.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:34.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:34.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:34.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:34.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:39:34.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.121+0000 7fe24f8b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.125+0000 7fe24f8b69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:34.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.125+0000 7fe24f8b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:34.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.125+0000 7fe24f8b69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:34.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.125+0000 7fe24f8b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:34.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.125+0000 7fe24f8b69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:34.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.125+0000 7fe24f8b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:39:34.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.125+0000 7fe103fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.133+0000 7fe24f8b69c0 20 remove_watcher() i=0 2024-09-12T00:39:34.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.133+0000 7fe24f8b69c0 2 removed watcher, disabling cache 2024-09-12T00:39:34.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.133+0000 7fe24f8b69c0 20 remove_watcher() i=1 2024-09-12T00:39:34.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.137+0000 7fe24f8b69c0 20 remove_watcher() i=2 2024-09-12T00:39:34.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.137+0000 7fe24f8b69c0 20 remove_watcher() i=3 2024-09-12T00:39:34.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.141+0000 7fe24f8b69c0 20 remove_watcher() i=4 2024-09-12T00:39:34.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.141+0000 7fe24f8b69c0 20 remove_watcher() i=5 2024-09-12T00:39:34.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.145+0000 7fe24f8b69c0 20 remove_watcher() i=6 2024-09-12T00:39:34.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.145+0000 7fe24f8b69c0 20 remove_watcher() i=7 2024-09-12T00:39:34.166 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshard list 2024-09-12T00:39:34.192 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:34.192 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:34.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 20 realm 2024-09-12T00:39:34.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:34.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.241+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.245+0000 7fde606059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.245+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.245+0000 7fde606059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:34.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.245+0000 7fde606059c0 20 searching for the correct realm 2024-09-12T00:39:34.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.249+0000 7fde5e10b640 0 -- 172.21.15.137:0/3993728408 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fde5002a070 msgr2=0x7fde5005ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.257+0000 7fde5e10b640 0 -- 172.21.15.137:0/3993728408 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x560fa4a81bc0 msgr2=0x560fa4a83fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:34.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:34.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:34.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:34.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:34.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:34.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:34.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 zone default found 2024-09-12T00:39:34.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 4 Realm: () 2024-09-12T00:39:34.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:34.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:34.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:34.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 zonegroup default 2024-09-12T00:39:34.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 started sync module instance, tier type = 2024-09-12T00:39:34.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.265+0000 7fde606059c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:34.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.285+0000 7fde606059c0 20 add_watcher() i=0 2024-09-12T00:39:34.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.285+0000 7fde606059c0 20 add_watcher() i=1 2024-09-12T00:39:34.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.285+0000 7fde606059c0 20 add_watcher() i=2 2024-09-12T00:39:34.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.285+0000 7fde606059c0 20 add_watcher() i=3 2024-09-12T00:39:34.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.285+0000 7fde606059c0 20 add_watcher() i=4 2024-09-12T00:39:34.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.285+0000 7fde606059c0 20 add_watcher() i=5 2024-09-12T00:39:34.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.285+0000 7fde606059c0 20 add_watcher() i=6 2024-09-12T00:39:34.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.289+0000 7fde606059c0 20 add_watcher() i=7 2024-09-12T00:39:34.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.289+0000 7fde606059c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:34.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.293+0000 7fdd14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.293+0000 7fde606059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:34.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.293+0000 7fde606059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:34.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.293+0000 7fde606059c0 5 note: GC not initialized 2024-09-12T00:39:34.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.293+0000 7fdc8f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:34.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.293+0000 7fde606059c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:34.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.293+0000 7fde606059c0 20 Filter name: none 2024-09-12T00:39:34.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.293+0000 7fdc8d7fa640 20 reqs_thread_entry: start 2024-09-12T00:39:34.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.301+0000 7fdd14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.305+0000 7fde606059c0 20 remove_watcher() i=0 2024-09-12T00:39:34.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.305+0000 7fde606059c0 2 removed watcher, disabling cache 2024-09-12T00:39:34.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.309+0000 7fde606059c0 20 remove_watcher() i=1 2024-09-12T00:39:34.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.309+0000 7fde606059c0 20 remove_watcher() i=2 2024-09-12T00:39:34.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.313+0000 7fde606059c0 20 remove_watcher() i=3 2024-09-12T00:39:34.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.313+0000 7fde606059c0 20 remove_watcher() i=4 2024-09-12T00:39:34.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.317+0000 7fde606059c0 20 remove_watcher() i=5 2024-09-12T00:39:34.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.321+0000 7fde606059c0 20 remove_watcher() i=6 2024-09-12T00:39:34.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.321+0000 7fde606059c0 20 remove_watcher() i=7 2024-09-12T00:39:34.334 INFO:tasks.workunit.client.0.smithi137.stderr:bucket name a-bucket 2024-09-12T00:39:34.334 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard process 2024-09-12T00:39:34.334 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:34.334 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshard process 2024-09-12T00:39:34.359 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:34.359 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:34.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.405+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 realm 2024-09-12T00:39:34.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:34.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:34.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.409+0000 7f5bff73b9c0 20 searching for the correct realm 2024-09-12T00:39:34.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.417+0000 7f5bfca40640 0 -- 172.21.15.137:0/2789932593 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f5be8039070 msgr2=0x7f5be8066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.629+0000 7f5bfda42640 0 -- 172.21.15.137:0/2789932593 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x561595e3dc90 msgr2=0x561595e40080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:34.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:34.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:34.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:34.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:34.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:34.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.641+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:34.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 zone default found 2024-09-12T00:39:34.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 4 Realm: () 2024-09-12T00:39:34.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:34.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:34.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:34.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 zonegroup default 2024-09-12T00:39:34.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 started sync module instance, tier type = 2024-09-12T00:39:34.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.645+0000 7f5bff73b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:34.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.669+0000 7f5bff73b9c0 20 add_watcher() i=0 2024-09-12T00:39:34.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.669+0000 7f5bff73b9c0 20 add_watcher() i=1 2024-09-12T00:39:34.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.669+0000 7f5bff73b9c0 20 add_watcher() i=2 2024-09-12T00:39:34.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.669+0000 7f5bff73b9c0 20 add_watcher() i=3 2024-09-12T00:39:34.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.669+0000 7f5bff73b9c0 20 add_watcher() i=4 2024-09-12T00:39:34.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.669+0000 7f5bff73b9c0 20 add_watcher() i=5 2024-09-12T00:39:34.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.669+0000 7f5bff73b9c0 20 add_watcher() i=6 2024-09-12T00:39:34.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.673+0000 7f5bff73b9c0 20 add_watcher() i=7 2024-09-12T00:39:34.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.673+0000 7f5bff73b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:34.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5ab3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5bff73b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:34.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5bff73b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:34.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5bff73b9c0 5 note: GC not initialized 2024-09-12T00:39:34.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5ab2fe5640 20 reqs_thread_entry: start 2024-09-12T00:39:34.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5bff73b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:34.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5bff73b9c0 20 Filter name: none 2024-09-12T00:39:34.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5ab0fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:34.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.677+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:39:34.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.681+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:39:34.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.681+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:39:34.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.689+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:39:34.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.689+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:39:34.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.693+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:39:34.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.693+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:39:34.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.697+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:39:34.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.697+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:39:34.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.701+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:39:34.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.701+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:39:34.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.709+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:39:34.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.709+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:39:34.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 20 process_entry resharding a-bucket 2024-09-12T00:39:34.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:34.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:34.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:39:34.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:34.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:39:34.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:34.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:34.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:34.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:34.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:34.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.713+0000 7f5bff73b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:39:34.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5bff73b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:34.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5bff73b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:34.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5bff73b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:34.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5bff73b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:39:34.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5ae0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94650709046032 notifier 5813 bl.length()=827 2024-09-12T00:39:34.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5ae0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:34.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5ae0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:34.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5ae0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:34.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:39:34.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:39:34.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:39:34.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.725+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:39:34.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.729+0000 7f5bff73b9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.0 2024-09-12T00:39:34.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.729+0000 7f5bff73b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.0 2024-09-12T00:39:34.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.729+0000 7f5bff73b9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.1 2024-09-12T00:39:34.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.729+0000 7f5bff73b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.1 2024-09-12T00:39:34.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.729+0000 7f5bff73b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.0 2024-09-12T00:39:34.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.733+0000 7f5bff73b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:34.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.733+0000 7f5bff73b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:39:34.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5bff73b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:34.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5bff73b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:34.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5bff73b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:34.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5bff73b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:39:34.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5acffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94650709046032 notifier 5813 bl.length()=827 2024-09-12T00:39:34.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5acffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:34.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5acffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:34.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5acffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:34.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:39:34.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:39:34.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:39:34.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.737+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:39:34.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.741+0000 7f5bff73b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.0 2024-09-12T00:39:34.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.741+0000 7f5bff73b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:34.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.741+0000 7f5bff73b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:39:34.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5bff73b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:34.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5bff73b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:34.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5bff73b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:34.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5bff73b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:39:34.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5acffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94650709046032 notifier 5813 bl.length()=795 2024-09-12T00:39:34.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5acffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:34.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5acffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:34.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5acffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:34.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:39:34.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:39:34.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:39:34.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.745+0000 7f5bff73b9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:39:34.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.749+0000 7f5bff73b9c0 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T00:39:34.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.749+0000 7f5bff73b9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:39:34.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.757+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:39:34.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.757+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:39:34.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.761+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:39:34.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.761+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:39:34.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.769+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:39:34.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.769+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:39:34.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.773+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:39:34.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.773+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:39:34.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.781+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:39:34.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.781+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:39:34.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.785+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:39:34.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.785+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:39:34.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.793+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:39:34.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.793+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:39:34.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.797+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:39:34.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.797+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:39:34.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.805+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:39:34.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.805+0000 7f5bff73b9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:39:34.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.809+0000 7f5bff73b9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:39:34.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.813+0000 7f5ab3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.817+0000 7f5bff73b9c0 20 remove_watcher() i=0 2024-09-12T00:39:34.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.817+0000 7f5bff73b9c0 2 removed watcher, disabling cache 2024-09-12T00:39:34.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.821+0000 7f5bff73b9c0 20 remove_watcher() i=1 2024-09-12T00:39:34.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.821+0000 7f5bff73b9c0 20 remove_watcher() i=2 2024-09-12T00:39:34.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.825+0000 7f5bff73b9c0 20 remove_watcher() i=3 2024-09-12T00:39:34.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.825+0000 7f5bff73b9c0 20 remove_watcher() i=4 2024-09-12T00:39:34.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.829+0000 7f5bff73b9c0 20 remove_watcher() i=5 2024-09-12T00:39:34.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.833+0000 7f5bff73b9c0 20 remove_watcher() i=6 2024-09-12T00:39:34.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:34.833+0000 7f5bff73b9c0 20 remove_watcher() i=7 2024-09-12T00:39:39.855 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:39.888 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:39.888 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:39.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.932+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.936+0000 7f8e9c2819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.936+0000 7f8e9c2819c0 20 realm 2024-09-12T00:39:39.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.936+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.936+0000 7f8e9c2819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.936+0000 7f8e9c2819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:39.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.936+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.936+0000 7f8e9c2819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.936+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.940+0000 7f8e9c2819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:39.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.940+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.940+0000 7f8e9c2819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:39.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.940+0000 7f8e9c2819c0 20 searching for the correct realm 2024-09-12T00:39:39.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.944+0000 7f8e99d87640 0 -- 172.21.15.137:0/1905864259 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f8e8c008040 msgr2=0x7f8e8c087ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:39.948 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:39.948+0000 7f8e99d87640 0 -- 172.21.15.137:0/1905864259 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f8e940cf040 msgr2=0x7f8e940c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:40.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:40.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 zone default found 2024-09-12T00:39:40.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 4 Realm: () 2024-09-12T00:39:40.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:40.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:40.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:40.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 zonegroup default 2024-09-12T00:39:40.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.168+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.172+0000 7f8e9c2819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.172+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.172+0000 7f8e9c2819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.172+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.172+0000 7f8e9c2819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.172+0000 7f8e9c2819c0 20 started sync module instance, tier type = 2024-09-12T00:39:40.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.172+0000 7f8e9c2819c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:40.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.196+0000 7f8e9c2819c0 20 add_watcher() i=0 2024-09-12T00:39:40.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.196+0000 7f8e9c2819c0 20 add_watcher() i=1 2024-09-12T00:39:40.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.196+0000 7f8e9c2819c0 20 add_watcher() i=2 2024-09-12T00:39:40.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.196+0000 7f8e9c2819c0 20 add_watcher() i=3 2024-09-12T00:39:40.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.196+0000 7f8e9c2819c0 20 add_watcher() i=4 2024-09-12T00:39:40.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.196+0000 7f8e9c2819c0 20 add_watcher() i=5 2024-09-12T00:39:40.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.196+0000 7f8e9c2819c0 20 add_watcher() i=6 2024-09-12T00:39:40.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.200+0000 7f8e9c2819c0 20 add_watcher() i=7 2024-09-12T00:39:40.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.200+0000 7f8e9c2819c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:40.202 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.204+0000 7f8d4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:40.203 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.204+0000 7f8e9c2819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:40.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.204+0000 7f8e9c2819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:40.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.204+0000 7f8e9c2819c0 5 note: GC not initialized 2024-09-12T00:39:40.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.204+0000 7f8d4a7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:40.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.204+0000 7f8e9c2819c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:40.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.204+0000 7f8e9c2819c0 20 Filter name: none 2024-09-12T00:39:40.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8cbbfff640 20 reqs_thread_entry: start 2024-09-12T00:39:40.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:40.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:40.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:40.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:40.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:40.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.208+0000 7f8e9c2819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:40.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.212+0000 7f8d4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:40.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.216+0000 7f8e9c2819c0 20 remove_watcher() i=0 2024-09-12T00:39:40.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.216+0000 7f8e9c2819c0 2 removed watcher, disabling cache 2024-09-12T00:39:40.216 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.216+0000 7f8e9c2819c0 20 remove_watcher() i=1 2024-09-12T00:39:40.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.220+0000 7f8e9c2819c0 20 remove_watcher() i=2 2024-09-12T00:39:40.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.224+0000 7f8e9c2819c0 20 remove_watcher() i=3 2024-09-12T00:39:40.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.224+0000 7f8e9c2819c0 20 remove_watcher() i=4 2024-09-12T00:39:40.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.228+0000 7f8e9c2819c0 20 remove_watcher() i=5 2024-09-12T00:39:40.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.228+0000 7f8e9c2819c0 20 remove_watcher() i=6 2024-09-12T00:39:40.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.232+0000 7f8e9c2819c0 20 remove_watcher() i=7 2024-09-12T00:39:40.249 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:40.249 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:40.249 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: a-bucket id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:39:40.249 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:40.249 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard add non empty bucket 2024-09-12T00:39:40.249 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:40.252 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:40.253 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:40.266 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:40.266 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:40.281 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:40.281 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:40.295 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:40.296 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:40.308 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:40.309 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:40.322 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:40.322 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:40.337 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:40.337 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:40.350 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:40.350 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:40.362 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:40.391 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:40.392 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:40.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.436+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 realm 2024-09-12T00:39:40.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:40.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:40.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:40.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.440+0000 7fc945dea9c0 20 searching for the correct realm 2024-09-12T00:39:40.446 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.448+0000 7fc9430ef640 0 -- 172.21.15.137:0/363997997 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fc938065040 msgr2=0x7fc938076730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:40.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.452+0000 7fc9430ef640 0 -- 172.21.15.137:0/363997997 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55b68f6475e0 msgr2=0x55b68f649a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:40.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:40.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:40.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:40.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 zone default found 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 4 Realm: () 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:40.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 zonegroup default 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.460+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.464+0000 7fc945dea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.464+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.464+0000 7fc945dea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.464+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.464+0000 7fc945dea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.464+0000 7fc945dea9c0 20 started sync module instance, tier type = 2024-09-12T00:39:40.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.464+0000 7fc945dea9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.480+0000 7fc945dea9c0 20 add_watcher() i=0 2024-09-12T00:39:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.480+0000 7fc945dea9c0 20 add_watcher() i=1 2024-09-12T00:39:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.480+0000 7fc945dea9c0 20 add_watcher() i=2 2024-09-12T00:39:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.480+0000 7fc945dea9c0 20 add_watcher() i=3 2024-09-12T00:39:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.480+0000 7fc945dea9c0 20 add_watcher() i=4 2024-09-12T00:39:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.480+0000 7fc945dea9c0 20 add_watcher() i=5 2024-09-12T00:39:40.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.480+0000 7fc945dea9c0 20 add_watcher() i=6 2024-09-12T00:39:40.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.488+0000 7fc945dea9c0 20 add_watcher() i=7 2024-09-12T00:39:40.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.488+0000 7fc945dea9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:40.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc7f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 5 note: GC not initialized 2024-09-12T00:39:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc7f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 Filter name: none 2024-09-12T00:39:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc7727fc640 20 reqs_thread_entry: start 2024-09-12T00:39:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:40.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:40.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:40.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:40.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.492+0000 7fc945dea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.496+0000 7fc945dea9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:40.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.496+0000 7fc945dea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:40.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.496+0000 7fc7f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:40.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.500+0000 7fc945dea9c0 20 remove_watcher() i=0 2024-09-12T00:39:40.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.500+0000 7fc945dea9c0 2 removed watcher, disabling cache 2024-09-12T00:39:40.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.500+0000 7fc945dea9c0 20 remove_watcher() i=1 2024-09-12T00:39:40.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.504+0000 7fc945dea9c0 20 remove_watcher() i=2 2024-09-12T00:39:40.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.504+0000 7fc945dea9c0 20 remove_watcher() i=3 2024-09-12T00:39:40.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.508+0000 7fc945dea9c0 20 remove_watcher() i=4 2024-09-12T00:39:40.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.508+0000 7fc945dea9c0 20 remove_watcher() i=5 2024-09-12T00:39:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.512+0000 7fc945dea9c0 20 remove_watcher() i=6 2024-09-12T00:39:40.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.512+0000 7fc945dea9c0 20 remove_watcher() i=7 2024-09-12T00:39:40.527 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:40.527 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:40.527 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: a-bucket id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T00:39:40.527 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:40.527 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T00:39:40.556 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:40.556 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:40.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.604+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.604+0000 7f4df19ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.604+0000 7f4df19ef9c0 20 realm 2024-09-12T00:39:40.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.604+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.604+0000 7f4df19ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.604+0000 7f4df19ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:40.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.604+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.608+0000 7f4df19ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.608+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.608+0000 7f4df19ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:40.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.608+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.608+0000 7f4df19ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:40.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.608+0000 7f4df19ef9c0 20 searching for the correct realm 2024-09-12T00:39:40.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.612+0000 7f4deecf4640 0 -- 172.21.15.137:0/2279797891 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f4de4027020 msgr2=0x7f4de4083a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:40.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.824+0000 7f4defcf6640 0 -- 172.21.15.137:0/2279797891 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55fff48f5b70 msgr2=0x55fff48f7fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:40.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:40.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:40.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:40.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:40.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:40.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:40.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:40.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.836+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:40.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 zone default found 2024-09-12T00:39:40.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 4 Realm: () 2024-09-12T00:39:40.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:40.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:40.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:40.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 zonegroup default 2024-09-12T00:39:40.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 started sync module instance, tier type = 2024-09-12T00:39:40.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.840+0000 7f4df19ef9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:40.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.864+0000 7f4df19ef9c0 20 add_watcher() i=0 2024-09-12T00:39:40.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.864+0000 7f4df19ef9c0 20 add_watcher() i=1 2024-09-12T00:39:40.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.864+0000 7f4df19ef9c0 20 add_watcher() i=2 2024-09-12T00:39:40.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.864+0000 7f4df19ef9c0 20 add_watcher() i=3 2024-09-12T00:39:40.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.864+0000 7f4df19ef9c0 20 add_watcher() i=4 2024-09-12T00:39:40.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.864+0000 7f4df19ef9c0 20 add_watcher() i=5 2024-09-12T00:39:40.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.864+0000 7f4df19ef9c0 20 add_watcher() i=6 2024-09-12T00:39:40.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.868+0000 7f4df19ef9c0 20 add_watcher() i=7 2024-09-12T00:39:40.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.868+0000 7f4df19ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:40.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.872+0000 7f4ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:40.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.872+0000 7f4df19ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:40.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.872+0000 7f4df19ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:40.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.872+0000 7f4df19ef9c0 5 note: GC not initialized 2024-09-12T00:39:40.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.872+0000 7f4ca4fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:40.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.872+0000 7f4df19ef9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:40.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.872+0000 7f4df19ef9c0 20 Filter name: none 2024-09-12T00:39:40.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.872+0000 7f4c1e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:40.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:40.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:39:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:40.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:40.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:40.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:40.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:40.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.876+0000 7f4df19ef9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:39:40.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.880+0000 7f4ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:40.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.884+0000 7f4df19ef9c0 20 remove_watcher() i=0 2024-09-12T00:39:40.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.884+0000 7f4df19ef9c0 2 removed watcher, disabling cache 2024-09-12T00:39:40.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.888+0000 7f4df19ef9c0 20 remove_watcher() i=1 2024-09-12T00:39:40.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.888+0000 7f4df19ef9c0 20 remove_watcher() i=2 2024-09-12T00:39:40.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.892+0000 7f4df19ef9c0 20 remove_watcher() i=3 2024-09-12T00:39:40.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.892+0000 7f4df19ef9c0 20 remove_watcher() i=4 2024-09-12T00:39:40.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.896+0000 7f4df19ef9c0 20 remove_watcher() i=5 2024-09-12T00:39:40.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.896+0000 7f4df19ef9c0 20 remove_watcher() i=6 2024-09-12T00:39:40.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.900+0000 7f4df19ef9c0 20 remove_watcher() i=7 2024-09-12T00:39:40.916 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshard list 2024-09-12T00:39:40.941 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:40.941 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:40.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.988+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.988+0000 7fba56f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.988+0000 7fba56f539c0 20 realm 2024-09-12T00:39:40.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.988+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:40.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:40.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:40.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.992+0000 7fba56f539c0 20 searching for the correct realm 2024-09-12T00:39:40.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:40.996+0000 7fba54258640 0 -- 172.21.15.137:0/2712285046 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fba480647b0 msgr2=0x7fba4805b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:41.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.208+0000 7fba54a59640 0 -- 172.21.15.137:0/2712285046 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fba4c0b9040 msgr2=0x7fba4c0d2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:41.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:41.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:41.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:41.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:41.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:41.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:41.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:41.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.428+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:41.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 zone default found 2024-09-12T00:39:41.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 4 Realm: () 2024-09-12T00:39:41.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:41.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:41.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:41.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 zonegroup default 2024-09-12T00:39:41.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 started sync module instance, tier type = 2024-09-12T00:39:41.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.432+0000 7fba56f539c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:41.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 20 add_watcher() i=0 2024-09-12T00:39:41.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 20 add_watcher() i=1 2024-09-12T00:39:41.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 20 add_watcher() i=2 2024-09-12T00:39:41.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 20 add_watcher() i=3 2024-09-12T00:39:41.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 20 add_watcher() i=4 2024-09-12T00:39:41.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 20 add_watcher() i=5 2024-09-12T00:39:41.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 20 add_watcher() i=6 2024-09-12T00:39:41.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 20 add_watcher() i=7 2024-09-12T00:39:41.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.456+0000 7fba56f539c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:41.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.460+0000 7fb90afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:41.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.460+0000 7fba56f539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:41.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.460+0000 7fba56f539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:41.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.460+0000 7fba56f539c0 5 note: GC not initialized 2024-09-12T00:39:41.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.460+0000 7fb909fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:41.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.460+0000 7fba56f539c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:41.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.464+0000 7fba56f539c0 20 Filter name: none 2024-09-12T00:39:41.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.464+0000 7fb87b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:41.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.472+0000 7fb90afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:41.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.480+0000 7fba56f539c0 20 remove_watcher() i=0 2024-09-12T00:39:41.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.480+0000 7fba56f539c0 2 removed watcher, disabling cache 2024-09-12T00:39:41.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.480+0000 7fba56f539c0 20 remove_watcher() i=1 2024-09-12T00:39:41.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.484+0000 7fba56f539c0 20 remove_watcher() i=2 2024-09-12T00:39:41.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.484+0000 7fba56f539c0 20 remove_watcher() i=3 2024-09-12T00:39:41.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.488+0000 7fba56f539c0 20 remove_watcher() i=4 2024-09-12T00:39:41.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.488+0000 7fba56f539c0 20 remove_watcher() i=5 2024-09-12T00:39:41.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.492+0000 7fba56f539c0 20 remove_watcher() i=6 2024-09-12T00:39:41.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.496+0000 7fba56f539c0 20 remove_watcher() i=7 2024-09-12T00:39:41.509 INFO:tasks.workunit.client.0.smithi137.stderr:bucket name a-bucket 2024-09-12T00:39:41.509 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard process non empty bucket 2024-09-12T00:39:41.509 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:41.509 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshard process 2024-09-12T00:39:41.534 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:41.534 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:41.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.580+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 realm 2024-09-12T00:39:41.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:41.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:41.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:41.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.584+0000 7f734dd979c0 20 searching for the correct realm 2024-09-12T00:39:41.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.592+0000 7f734c09e640 0 -- 172.21.15.137:0/2553867643 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55ed7f754a00 msgr2=0x55ed7f756ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:41.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.600+0000 7f734c09e640 0 -- 172.21.15.137:0/2553867643 >> [v2:172.21.15.150:6800/1704738992,v1:172.21.15.150:6801/1704738992] conn(0x7f733c0772a0 msgr2=0x7f733c004000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:41.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:41.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:41.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:41.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:41.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:41.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:41.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:41.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.604+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:41.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 zone default found 2024-09-12T00:39:41.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 4 Realm: () 2024-09-12T00:39:41.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:41.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:41.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:41.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 zonegroup default 2024-09-12T00:39:41.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 started sync module instance, tier type = 2024-09-12T00:39:41.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.608+0000 7f734dd979c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:41.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 20 add_watcher() i=0 2024-09-12T00:39:41.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 20 add_watcher() i=1 2024-09-12T00:39:41.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 20 add_watcher() i=2 2024-09-12T00:39:41.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 20 add_watcher() i=3 2024-09-12T00:39:41.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 20 add_watcher() i=4 2024-09-12T00:39:41.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 20 add_watcher() i=5 2024-09-12T00:39:41.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 20 add_watcher() i=6 2024-09-12T00:39:41.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 20 add_watcher() i=7 2024-09-12T00:39:41.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.628+0000 7f734dd979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:41.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f72027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:41.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f734dd979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:41.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f734dd979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:41.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f734dd979c0 5 note: GC not initialized 2024-09-12T00:39:41.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f72017e2640 20 reqs_thread_entry: start 2024-09-12T00:39:41.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f734dd979c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:41.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f734dd979c0 20 Filter name: none 2024-09-12T00:39:41.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f71fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:41.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.632+0000 7f734dd979c0 20 processing logshard = reshard.0000000000 2024-09-12T00:39:41.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.636+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:39:41.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.636+0000 7f734dd979c0 20 processing logshard = reshard.0000000001 2024-09-12T00:39:41.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.644+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:39:41.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.644+0000 7f734dd979c0 20 processing logshard = reshard.0000000002 2024-09-12T00:39:41.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.648+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:39:41.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.648+0000 7f734dd979c0 20 processing logshard = reshard.0000000003 2024-09-12T00:39:41.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.652+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:39:41.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.652+0000 7f734dd979c0 20 processing logshard = reshard.0000000004 2024-09-12T00:39:41.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.656+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:39:41.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.656+0000 7f734dd979c0 20 processing logshard = reshard.0000000005 2024-09-12T00:39:41.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:39:41.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 20 processing logshard = reshard.0000000006 2024-09-12T00:39:41.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 20 process_entry resharding a-bucket 2024-09-12T00:39:41.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:41.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:41.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:39:41.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:41.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:39:41.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:41.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:41.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:41.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:41.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:41.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.664+0000 7f734dd979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:39:41.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f734dd979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:41.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f734dd979c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:41.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f734dd979c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:41.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f734dd979c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:39:41.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f722a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94478534007296 notifier 5897 bl.length()=827 2024-09-12T00:39:41.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f722a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:41.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f722a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:41.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f722a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:41.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:39:41.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:39:41.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:39:41.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.676+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.0 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.0 2024-09-12T00:39:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.1 2024-09-12T00:39:41.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.680+0000 7f734dd979c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.1 2024-09-12T00:39:41.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f734dd979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:41.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f734dd979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:39:41.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f734dd979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:41.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f734dd979c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:41.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f734dd979c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:41.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f734dd979c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:39:41.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f722a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 94478534007296 notifier 5897 bl.length()=827 2024-09-12T00:39:41.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f722a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:41.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f722a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:41.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.684+0000 7f722a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:41.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:39:41.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:39:41.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:39:41.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:39:41.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.0 2024-09-12T00:39:41.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.0 2024-09-12T00:39:41.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.1 2024-09-12T00:39:41.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.1.1 2024-09-12T00:39:41.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:41.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.688+0000 7f734dd979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:39:41.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f734dd979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:41.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f734dd979c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:41.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f734dd979c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:41.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f734dd979c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:39:41.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f722a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94478534007296 notifier 5897 bl.length()=795 2024-09-12T00:39:41.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f722a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:39:41.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f722a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:39:41.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f722a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:41.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:39:41.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:39:41.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:39:41.691 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.692+0000 7f734dd979c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:39:41.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.696+0000 7f734dd979c0 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T00:39:41.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.696+0000 7f734dd979c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:39:41.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.700+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:39:41.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.700+0000 7f734dd979c0 20 processing logshard = reshard.0000000007 2024-09-12T00:39:41.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.704+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:39:41.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.704+0000 7f734dd979c0 20 processing logshard = reshard.0000000008 2024-09-12T00:39:41.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.712+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:39:41.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.712+0000 7f734dd979c0 20 processing logshard = reshard.0000000009 2024-09-12T00:39:41.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.716+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:39:41.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.716+0000 7f734dd979c0 20 processing logshard = reshard.0000000010 2024-09-12T00:39:41.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.724+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:39:41.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.724+0000 7f734dd979c0 20 processing logshard = reshard.0000000011 2024-09-12T00:39:41.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.728+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:39:41.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.728+0000 7f734dd979c0 20 processing logshard = reshard.0000000012 2024-09-12T00:39:41.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.732+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:39:41.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.732+0000 7f734dd979c0 20 processing logshard = reshard.0000000013 2024-09-12T00:39:41.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.736+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:39:41.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.736+0000 7f734dd979c0 20 processing logshard = reshard.0000000014 2024-09-12T00:39:41.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.744+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:39:41.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.744+0000 7f734dd979c0 20 processing logshard = reshard.0000000015 2024-09-12T00:39:41.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.748+0000 7f734dd979c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:39:41.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.748+0000 7f72027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:41.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.752+0000 7f734dd979c0 20 remove_watcher() i=0 2024-09-12T00:39:41.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.752+0000 7f734dd979c0 2 removed watcher, disabling cache 2024-09-12T00:39:41.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.756+0000 7f734dd979c0 20 remove_watcher() i=1 2024-09-12T00:39:41.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.756+0000 7f734dd979c0 20 remove_watcher() i=2 2024-09-12T00:39:41.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.760+0000 7f734dd979c0 20 remove_watcher() i=3 2024-09-12T00:39:41.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.760+0000 7f734dd979c0 20 remove_watcher() i=4 2024-09-12T00:39:41.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.764+0000 7f734dd979c0 20 remove_watcher() i=5 2024-09-12T00:39:41.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.764+0000 7f734dd979c0 20 remove_watcher() i=6 2024-09-12T00:39:41.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.768+0000 7f734dd979c0 20 remove_watcher() i=7 2024-09-12T00:39:41.782 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:41.814 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:41.814 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:41.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 20 realm 2024-09-12T00:39:41.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:41.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.860+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.864+0000 7f9e92d339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:41.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.864+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.864+0000 7f9e92d339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:41.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.864+0000 7f9e92d339c0 20 searching for the correct realm 2024-09-12T00:39:41.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.868+0000 7f9e90839640 0 -- 172.21.15.137:0/2271739602 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f9e8001a040 msgr2=0x7f9e80082820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:41.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.872+0000 7f9e90839640 0 -- 172.21.15.137:0/2271739602 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5566bf93b470 msgr2=0x5566bf93d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:41.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:41.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:41.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:41.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:41.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:41.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:41.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:41.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:41.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 zone default found 2024-09-12T00:39:41.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 4 Realm: () 2024-09-12T00:39:41.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:41.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:41.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:41.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 zonegroup default 2024-09-12T00:39:41.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.880+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.884+0000 7f9e92d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.884+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.884+0000 7f9e92d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.884+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.884+0000 7f9e92d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.884+0000 7f9e92d339c0 20 started sync module instance, tier type = 2024-09-12T00:39:41.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.884+0000 7f9e92d339c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:41.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.900+0000 7f9e92d339c0 20 add_watcher() i=0 2024-09-12T00:39:41.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.900+0000 7f9e92d339c0 20 add_watcher() i=1 2024-09-12T00:39:41.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.900+0000 7f9e92d339c0 20 add_watcher() i=2 2024-09-12T00:39:41.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.900+0000 7f9e92d339c0 20 add_watcher() i=3 2024-09-12T00:39:41.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.900+0000 7f9e92d339c0 20 add_watcher() i=4 2024-09-12T00:39:41.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.900+0000 7f9e92d339c0 20 add_watcher() i=5 2024-09-12T00:39:41.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.900+0000 7f9e92d339c0 20 add_watcher() i=6 2024-09-12T00:39:41.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.904+0000 7f9e92d339c0 20 add_watcher() i=7 2024-09-12T00:39:41.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.904+0000 7f9e92d339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:41.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9d46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:41.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:41.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:41.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 5 note: GC not initialized 2024-09-12T00:39:41.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9d45fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:41.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:41.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 Filter name: none 2024-09-12T00:39:41.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9cb77fe640 20 reqs_thread_entry: start 2024-09-12T00:39:41.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:41.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:41.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:41.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:41.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:41.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.908+0000 7f9e92d339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:41.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.912+0000 7f9d46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:41.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.916+0000 7f9e92d339c0 20 remove_watcher() i=0 2024-09-12T00:39:41.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.916+0000 7f9e92d339c0 2 removed watcher, disabling cache 2024-09-12T00:39:41.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.916+0000 7f9e92d339c0 20 remove_watcher() i=1 2024-09-12T00:39:41.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.920+0000 7f9e92d339c0 20 remove_watcher() i=2 2024-09-12T00:39:41.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.920+0000 7f9e92d339c0 20 remove_watcher() i=3 2024-09-12T00:39:41.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.924+0000 7f9e92d339c0 20 remove_watcher() i=4 2024-09-12T00:39:41.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.924+0000 7f9e92d339c0 20 remove_watcher() i=5 2024-09-12T00:39:41.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.928+0000 7f9e92d339c0 20 remove_watcher() i=6 2024-09-12T00:39:41.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:41.928+0000 7f9e92d339c0 20 remove_watcher() i=7 2024-09-12T00:39:41.943 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:41.943 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:41.943 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: a-bucket id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:39:41.943 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:41.943 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:39:41.943 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:41.944 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:41.945 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:41.961 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:41.961 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.008 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.009 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.029 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.029 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.045 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.045 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.057 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.057 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.074 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.075 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.093 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.093 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.110 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.110 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.128 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.128 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.145 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.145 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.163 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.163 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.183 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.183 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.201 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.201 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.221 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.221 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.240 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.240 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.259 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.260 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.277 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.278 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.296 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.296 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.315 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.315 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.332 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.332 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.349 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:42.349 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:42.364 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:39:42.392 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:42.392 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:42.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.440+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 realm 2024-09-12T00:39:42.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:42.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:42.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:42.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.444+0000 7fdcb02649c0 20 searching for the correct realm 2024-09-12T00:39:42.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.448+0000 7fdcadd6a640 0 -- 172.21.15.137:0/4203057198 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fdc98092990 msgr2=0x7fdc98063790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:42.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.456+0000 7fdcadd6a640 0 -- 172.21.15.137:0/4203057198 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fdca80cf400 msgr2=0x7fdca80cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:42.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:42.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:42.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:42.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:42.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:42.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:42.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:42.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:42.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 zone default found 2024-09-12T00:39:42.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 4 Realm: () 2024-09-12T00:39:42.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:42.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:42.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:42.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 zonegroup default 2024-09-12T00:39:42.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.676+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.680+0000 7fdcb02649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.680+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.680+0000 7fdcb02649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.680+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.680+0000 7fdcb02649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.680+0000 7fdcb02649c0 20 started sync module instance, tier type = 2024-09-12T00:39:42.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.680+0000 7fdcb02649c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:42.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 20 add_watcher() i=0 2024-09-12T00:39:42.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 20 add_watcher() i=1 2024-09-12T00:39:42.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 20 add_watcher() i=2 2024-09-12T00:39:42.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 20 add_watcher() i=3 2024-09-12T00:39:42.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 20 add_watcher() i=4 2024-09-12T00:39:42.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 20 add_watcher() i=5 2024-09-12T00:39:42.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 20 add_watcher() i=6 2024-09-12T00:39:42.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 20 add_watcher() i=7 2024-09-12T00:39:42.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.704+0000 7fdcb02649c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:42.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.708+0000 7fdb5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:42.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.708+0000 7fdcb02649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:42.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.708+0000 7fdcb02649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:42.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.708+0000 7fdcb02649c0 5 note: GC not initialized 2024-09-12T00:39:42.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdb5e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:42.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:42.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 Filter name: none 2024-09-12T00:39:42.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdacffff640 20 reqs_thread_entry: start 2024-09-12T00:39:42.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:42.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:42.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:42.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.712+0000 7fdcb02649c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:42.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.716+0000 7fdcb02649c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.716+0000 7fdcb02649c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:42.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.716+0000 7fdcb02649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:42.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.716+0000 7fdb5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:42.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.724+0000 7fdcb02649c0 20 remove_watcher() i=0 2024-09-12T00:39:42.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.724+0000 7fdcb02649c0 2 removed watcher, disabling cache 2024-09-12T00:39:42.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.724+0000 7fdcb02649c0 20 remove_watcher() i=1 2024-09-12T00:39:42.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.728+0000 7fdcb02649c0 20 remove_watcher() i=2 2024-09-12T00:39:42.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.728+0000 7fdcb02649c0 20 remove_watcher() i=3 2024-09-12T00:39:42.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.732+0000 7fdcb02649c0 20 remove_watcher() i=4 2024-09-12T00:39:42.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.732+0000 7fdcb02649c0 20 remove_watcher() i=5 2024-09-12T00:39:42.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.736+0000 7fdcb02649c0 20 remove_watcher() i=6 2024-09-12T00:39:42.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.740+0000 7fdcb02649c0 20 remove_watcher() i=7 2024-09-12T00:39:42.754 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:42.754 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:42.754 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-init-index id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:39:42.754 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:42.754 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:39:42.788 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:42.788 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:42.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.832+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 realm 2024-09-12T00:39:42.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:42.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:42.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:42.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.836+0000 7f5f11aa39c0 20 searching for the correct realm 2024-09-12T00:39:42.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.844+0000 7f5f0eda8640 0 -- 172.21.15.137:0/3812438338 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f5ef80c9070 msgr2=0x7f5ef811db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:42.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.848+0000 7f5f0f5a9640 0 -- 172.21.15.137:0/3812438338 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f5f0001b040 msgr2=0x7f5f00033420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:42.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:42.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:42.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:42.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:42.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:42.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:42.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:42.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.856+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:42.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 zone default found 2024-09-12T00:39:42.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 4 Realm: () 2024-09-12T00:39:42.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:42.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:42.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:42.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 zonegroup default 2024-09-12T00:39:42.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 started sync module instance, tier type = 2024-09-12T00:39:42.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.860+0000 7f5f11aa39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:42.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.880+0000 7f5f11aa39c0 20 add_watcher() i=0 2024-09-12T00:39:42.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.880+0000 7f5f11aa39c0 20 add_watcher() i=1 2024-09-12T00:39:42.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.880+0000 7f5f11aa39c0 20 add_watcher() i=2 2024-09-12T00:39:42.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.880+0000 7f5f11aa39c0 20 add_watcher() i=3 2024-09-12T00:39:42.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.880+0000 7f5f11aa39c0 20 add_watcher() i=4 2024-09-12T00:39:42.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.880+0000 7f5f11aa39c0 20 add_watcher() i=5 2024-09-12T00:39:42.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.880+0000 7f5f11aa39c0 20 add_watcher() i=6 2024-09-12T00:39:42.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.884+0000 7f5f11aa39c0 20 add_watcher() i=7 2024-09-12T00:39:42.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.884+0000 7f5f11aa39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:42.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5dc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:42.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:42.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:42.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 5 note: GC not initialized 2024-09-12T00:39:42.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5dc57e2640 20 reqs_thread_entry: start 2024-09-12T00:39:42.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:42.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 20 Filter name: none 2024-09-12T00:39:42.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5dbe7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:42.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:39:42.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:42.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:39:42.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:39:42.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 : miss 2024-09-12T00:39:42.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:42.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 info.flags=0x17 2024-09-12T00:39:42.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 to cache LRU end 2024-09-12T00:39:42.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:42.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:42.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.888+0000 7f5f11aa39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 2024-09-12T00:39:42.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.892+0000 7f5f11aa39c0 -1 Injecting error=-5 at location=init_index 2024-09-12T00:39:42.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.892+0000 7f5f11aa39c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:39:42.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.892+0000 7f5dc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:42.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.900+0000 7f5f11aa39c0 20 remove_watcher() i=0 2024-09-12T00:39:42.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.900+0000 7f5f11aa39c0 2 removed watcher, disabling cache 2024-09-12T00:39:42.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.900+0000 7f5f11aa39c0 20 remove_watcher() i=1 2024-09-12T00:39:42.901 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.904+0000 7f5f11aa39c0 20 remove_watcher() i=2 2024-09-12T00:39:42.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.904+0000 7f5f11aa39c0 20 remove_watcher() i=3 2024-09-12T00:39:42.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.908+0000 7f5f11aa39c0 20 remove_watcher() i=4 2024-09-12T00:39:42.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.908+0000 7f5f11aa39c0 20 remove_watcher() i=5 2024-09-12T00:39:42.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.912+0000 7f5f11aa39c0 20 remove_watcher() i=6 2024-09-12T00:39:42.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:42.916+0000 7f5f11aa39c0 20 remove_watcher() i=7 2024-09-12T00:39:42.928 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:39:42.954 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:42.954 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:42.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.000+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:42.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.000+0000 7f9fc69579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:42.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.000+0000 7f9fc69579c0 20 realm 2024-09-12T00:39:43.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.000+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.000+0000 7f9fc69579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.000+0000 7f9fc69579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:43.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.000+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.004+0000 7f9fc69579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.004+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.004+0000 7f9fc69579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:43.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.004+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.004+0000 7f9fc69579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:43.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.004+0000 7f9fc69579c0 20 searching for the correct realm 2024-09-12T00:39:43.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.012+0000 7f9fc4c5e640 0 -- 172.21.15.137:0/2906494372 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x562c8eef13f0 msgr2=0x562c8eef3840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:43.015 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.016+0000 7f9fc445d640 0 -- 172.21.15.137:0/2906494372 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x562c8eef5510 msgr2=0x562c8eef79d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:43.021 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:43.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:43.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:43.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:43.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:43.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:43.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:43.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:43.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 zone default found 2024-09-12T00:39:43.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 4 Realm: () 2024-09-12T00:39:43.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:43.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:43.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:43.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 zonegroup default 2024-09-12T00:39:43.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.024+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.028+0000 7f9fc69579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.028+0000 7f9fc69579c0 20 started sync module instance, tier type = 2024-09-12T00:39:43.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.028+0000 7f9fc69579c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:43.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 20 add_watcher() i=0 2024-09-12T00:39:43.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 20 add_watcher() i=1 2024-09-12T00:39:43.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 20 add_watcher() i=2 2024-09-12T00:39:43.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 20 add_watcher() i=3 2024-09-12T00:39:43.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 20 add_watcher() i=4 2024-09-12T00:39:43.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 20 add_watcher() i=5 2024-09-12T00:39:43.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 20 add_watcher() i=6 2024-09-12T00:39:43.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 20 add_watcher() i=7 2024-09-12T00:39:43.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.048+0000 7f9fc69579c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:43.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9e7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:43.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9fc69579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:43.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9fc69579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:43.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9fc69579c0 5 note: GC not initialized 2024-09-12T00:39:43.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9e79fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:43.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9fc69579c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:43.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9fc69579c0 20 Filter name: none 2024-09-12T00:39:43.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9deb7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:43.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.052+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:43.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:43.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:43.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:43.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:43.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.056+0000 7f9fc69579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:43.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.060+0000 7f9e7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:43.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.064+0000 7f9fc69579c0 20 remove_watcher() i=0 2024-09-12T00:39:43.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.064+0000 7f9fc69579c0 2 removed watcher, disabling cache 2024-09-12T00:39:43.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.064+0000 7f9fc69579c0 20 remove_watcher() i=1 2024-09-12T00:39:43.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.068+0000 7f9fc69579c0 20 remove_watcher() i=2 2024-09-12T00:39:43.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.068+0000 7f9fc69579c0 20 remove_watcher() i=3 2024-09-12T00:39:43.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.072+0000 7f9fc69579c0 20 remove_watcher() i=4 2024-09-12T00:39:43.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.072+0000 7f9fc69579c0 20 remove_watcher() i=5 2024-09-12T00:39:43.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.076+0000 7f9fc69579c0 20 remove_watcher() i=6 2024-09-12T00:39:43.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.076+0000 7f9fc69579c0 20 remove_watcher() i=7 2024-09-12T00:39:43.089 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:43.090 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:43.090 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-init-index id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:39:43.090 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:43.091 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.091 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.104 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.104 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.150 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:43.187 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:43.187 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:43.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 20 realm 2024-09-12T00:39:43.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:43.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.236+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.240+0000 7f944bea49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:43.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.240+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.240+0000 7f944bea49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:43.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.240+0000 7f944bea49c0 20 searching for the correct realm 2024-09-12T00:39:43.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.244+0000 7f94491a9640 0 -- 172.21.15.137:0/2018684058 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f9440088230 msgr2=0x7f9440001820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:43.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.252+0000 7f94499aa640 0 -- 172.21.15.137:0/2018684058 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f9444008040 msgr2=0x7f9444031940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:43.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:43.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:43.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:43.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:43.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:43.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:43.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:43.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 zone default found 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 4 Realm: () 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 zonegroup default 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.260+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.264+0000 7f944bea49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.264+0000 7f944bea49c0 20 started sync module instance, tier type = 2024-09-12T00:39:43.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.264+0000 7f944bea49c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:43.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.280+0000 7f944bea49c0 20 add_watcher() i=0 2024-09-12T00:39:43.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.280+0000 7f944bea49c0 20 add_watcher() i=1 2024-09-12T00:39:43.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.280+0000 7f944bea49c0 20 add_watcher() i=2 2024-09-12T00:39:43.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.280+0000 7f944bea49c0 20 add_watcher() i=3 2024-09-12T00:39:43.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.280+0000 7f944bea49c0 20 add_watcher() i=4 2024-09-12T00:39:43.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.280+0000 7f944bea49c0 20 add_watcher() i=5 2024-09-12T00:39:43.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.280+0000 7f944bea49c0 20 add_watcher() i=6 2024-09-12T00:39:43.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.284+0000 7f944bea49c0 20 add_watcher() i=7 2024-09-12T00:39:43.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.284+0000 7f944bea49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:43.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f92fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 5 note: GC not initialized 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f92fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 20 Filter name: none 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f926bfff640 20 reqs_thread_entry: start 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:39:43.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:43.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:39:43.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:39:43.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 : miss 2024-09-12T00:39:43.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:43.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 info.flags=0x17 2024-09-12T00:39:43.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 to cache LRU end 2024-09-12T00:39:43.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:43.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:43.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.288+0000 7f944bea49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 2024-09-12T00:39:43.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.296+0000 7f944bea49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 info.flags=0x17 2024-09-12T00:39:43.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.296+0000 7f944bea49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 to cache LRU end 2024-09-12T00:39:43.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.296+0000 7f944bea49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:43.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.296+0000 7f944bea49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19, ofs0, ns] 2024-09-12T00:39:43.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.296+0000 7f932d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94429288276352 notifier 6231 bl.length()=911 2024-09-12T00:39:43.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.296+0000 7f932d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 info.flags=0x17 2024-09-12T00:39:43.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.296+0000 7f932d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 to cache LRU end 2024-09-12T00:39:43.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.296+0000 7f932d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:43.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.300+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): orig_sources= new_sources= 2024-09-12T00:39:43.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.300+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): potential sources added=[] removed=[] 2024-09-12T00:39:43.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.300+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): orig_dests= new_dests= 2024-09-12T00:39:43.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.300+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): potential dests added=[] removed=[] 2024-09-12T00:39:43.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.304+0000 7f944bea49c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19.1.0 2024-09-12T00:39:43.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.304+0000 7f944bea49c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19.1.0 2024-09-12T00:39:43.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.304+0000 7f944bea49c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19.1.1 2024-09-12T00:39:43.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.304+0000 7f944bea49c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19.1.1 2024-09-12T00:39:43.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.304+0000 7f944bea49c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19.0 2024-09-12T00:39:43.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f944bea49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:43.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f944bea49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 2024-09-12T00:39:43.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f944bea49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 info.flags=0x17 2024-09-12T00:39:43.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f944bea49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 to cache LRU end 2024-09-12T00:39:43.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f944bea49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:43.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f944bea49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19, ofs0, ns] 2024-09-12T00:39:43.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f932cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94429288276352 notifier 6231 bl.length()=911 2024-09-12T00:39:43.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f932cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 info.flags=0x17 2024-09-12T00:39:43.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f932cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 to cache LRU end 2024-09-12T00:39:43.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.308+0000 7f932cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:43.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.312+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): orig_sources= new_sources= 2024-09-12T00:39:43.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.312+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): potential sources added=[] removed=[] 2024-09-12T00:39:43.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.312+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): orig_dests= new_dests= 2024-09-12T00:39:43.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.312+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): potential dests added=[] removed=[] 2024-09-12T00:39:43.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.312+0000 7f944bea49c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19.0 2024-09-12T00:39:43.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.312+0000 7f944bea49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:43.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.312+0000 7f944bea49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 2024-09-12T00:39:43.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f944bea49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 info.flags=0x17 2024-09-12T00:39:43.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f944bea49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 to cache LRU end 2024-09-12T00:39:43.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f944bea49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:43.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f944bea49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19, ofs0, ns] 2024-09-12T00:39:43.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f932cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94429288276352 notifier 6231 bl.length()=879 2024-09-12T00:39:43.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f932cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 info.flags=0x17 2024-09-12T00:39:43.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f932cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 to cache LRU end 2024-09-12T00:39:43.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f932cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:43.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): orig_sources= new_sources= 2024-09-12T00:39:43.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): potential sources added=[] removed=[] 2024-09-12T00:39:43.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): orig_dests= new_dests= 2024-09-12T00:39:43.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.316+0000 7f944bea49c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19]): potential dests added=[] removed=[] 2024-09-12T00:39:43.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.320+0000 7f944bea49c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:39:43.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.324+0000 7f92fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:43.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.328+0000 7f944bea49c0 20 remove_watcher() i=0 2024-09-12T00:39:43.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.328+0000 7f944bea49c0 2 removed watcher, disabling cache 2024-09-12T00:39:43.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.328+0000 7f944bea49c0 20 remove_watcher() i=1 2024-09-12T00:39:43.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.332+0000 7f944bea49c0 20 remove_watcher() i=2 2024-09-12T00:39:43.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.332+0000 7f944bea49c0 20 remove_watcher() i=3 2024-09-12T00:39:43.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.336+0000 7f944bea49c0 20 remove_watcher() i=4 2024-09-12T00:39:43.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.336+0000 7f944bea49c0 20 remove_watcher() i=5 2024-09-12T00:39:43.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.340+0000 7f944bea49c0 20 remove_watcher() i=6 2024-09-12T00:39:43.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.344+0000 7f944bea49c0 20 remove_watcher() i=7 2024-09-12T00:39:43.356 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:39:43.383 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:43.384 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:43.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.428+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 realm 2024-09-12T00:39:43.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:43.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:43.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:43.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.432+0000 7f573ec569c0 20 searching for the correct realm 2024-09-12T00:39:43.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.440+0000 7f5733fff640 0 -- 172.21.15.137:0/2157788682 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f57240019f0 msgr2=0x7f57240d1a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:43.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.444+0000 7f573cf5d640 0 -- 172.21.15.137:0/2157788682 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x56388af42800 msgr2=0x56388af44c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:43.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:43.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:43.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:43.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:43.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:43.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:43.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:43.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.452+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 zone default found 2024-09-12T00:39:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 4 Realm: () 2024-09-12T00:39:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 zonegroup default 2024-09-12T00:39:43.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:43.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 started sync module instance, tier type = 2024-09-12T00:39:43.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.456+0000 7f573ec569c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:43.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 20 add_watcher() i=0 2024-09-12T00:39:43.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 20 add_watcher() i=1 2024-09-12T00:39:43.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 20 add_watcher() i=2 2024-09-12T00:39:43.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 20 add_watcher() i=3 2024-09-12T00:39:43.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 20 add_watcher() i=4 2024-09-12T00:39:43.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 20 add_watcher() i=5 2024-09-12T00:39:43.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 20 add_watcher() i=6 2024-09-12T00:39:43.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 20 add_watcher() i=7 2024-09-12T00:39:43.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.476+0000 7f573ec569c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:43.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.480+0000 7f55f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:43.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.480+0000 7f573ec569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:43.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.480+0000 7f573ec569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.480+0000 7f573ec569c0 5 note: GC not initialized 2024-09-12T00:39:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.480+0000 7f55f1fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.480+0000 7f573ec569c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.480+0000 7f573ec569c0 20 Filter name: none 2024-09-12T00:39:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.480+0000 7f55637fe640 20 reqs_thread_entry: start 2024-09-12T00:39:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:43.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:43.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:43.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:43.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:43.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:43.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.484+0000 7f573ec569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:43.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.488+0000 7f55f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:43.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.492+0000 7f573ec569c0 20 remove_watcher() i=0 2024-09-12T00:39:43.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.492+0000 7f573ec569c0 2 removed watcher, disabling cache 2024-09-12T00:39:43.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.492+0000 7f573ec569c0 20 remove_watcher() i=1 2024-09-12T00:39:43.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.496+0000 7f573ec569c0 20 remove_watcher() i=2 2024-09-12T00:39:43.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.496+0000 7f573ec569c0 20 remove_watcher() i=3 2024-09-12T00:39:43.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.500+0000 7f573ec569c0 20 remove_watcher() i=4 2024-09-12T00:39:43.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.500+0000 7f573ec569c0 20 remove_watcher() i=5 2024-09-12T00:39:43.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.504+0000 7f573ec569c0 20 remove_watcher() i=6 2024-09-12T00:39:43.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:43.508+0000 7f573ec569c0 20 remove_watcher() i=7 2024-09-12T00:39:43.520 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:43.520 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:43.520 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-init-index id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:39:43.520 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:43.521 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.521 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.525 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.526 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.571 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.572 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.597 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:39:43.597 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:43.597 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.598 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.613 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.614 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.658 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.658 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.675 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.676 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.694 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.694 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.715 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.716 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.734 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.734 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.754 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.754 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.772 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.773 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.792 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.792 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.811 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.811 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.830 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.830 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.851 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.851 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.870 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.870 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.890 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.890 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.909 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.910 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.930 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.930 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.949 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.950 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.969 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.969 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:43.989 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:43.989 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.010 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.010 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.030 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.030 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.050 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:39:44.082 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:44.082 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:44.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.128+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 realm 2024-09-12T00:39:44.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:44.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:44.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:44.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.132+0000 7fa3873ec9c0 20 searching for the correct realm 2024-09-12T00:39:44.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.140+0000 7fa3856f3640 0 -- 172.21.15.137:0/4196246130 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fa378003830 msgr2=0x7fa3780013e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:44.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.144+0000 7fa384ef2640 0 -- 172.21.15.137:0/4196246130 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fa37c020040 msgr2=0x7fa37c03b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:44.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:44.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:44.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:44.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:44.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:44.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:44.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:44.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:44.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 zone default found 2024-09-12T00:39:44.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 4 Realm: () 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 zonegroup default 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 started sync module instance, tier type = 2024-09-12T00:39:44.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.152+0000 7fa3873ec9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:44.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.172+0000 7fa3873ec9c0 20 add_watcher() i=0 2024-09-12T00:39:44.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.172+0000 7fa3873ec9c0 20 add_watcher() i=1 2024-09-12T00:39:44.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.172+0000 7fa3873ec9c0 20 add_watcher() i=2 2024-09-12T00:39:44.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.172+0000 7fa3873ec9c0 20 add_watcher() i=3 2024-09-12T00:39:44.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.172+0000 7fa3873ec9c0 20 add_watcher() i=4 2024-09-12T00:39:44.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.172+0000 7fa3873ec9c0 20 add_watcher() i=5 2024-09-12T00:39:44.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.172+0000 7fa3873ec9c0 20 add_watcher() i=6 2024-09-12T00:39:44.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.176+0000 7fa3873ec9c0 20 add_watcher() i=7 2024-09-12T00:39:44.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.176+0000 7fa3873ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:44.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa23b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:44.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:44.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:44.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 5 note: GC not initialized 2024-09-12T00:39:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa23a7e4640 20 reqs_thread_entry: start 2024-09-12T00:39:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 Filter name: none 2024-09-12T00:39:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa2337fe640 20 reqs_thread_entry: start 2024-09-12T00:39:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:44.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:44.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.180+0000 7fa3873ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:44.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.184+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.184+0000 7fa3873ec9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:44.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.184+0000 7fa3873ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.184+0000 7fa3873ec9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:44.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.184+0000 7fa3873ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:44.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.184+0000 7fa23b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:44.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.188+0000 7fa3873ec9c0 20 remove_watcher() i=0 2024-09-12T00:39:44.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.188+0000 7fa3873ec9c0 2 removed watcher, disabling cache 2024-09-12T00:39:44.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.192+0000 7fa3873ec9c0 20 remove_watcher() i=1 2024-09-12T00:39:44.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.192+0000 7fa3873ec9c0 20 remove_watcher() i=2 2024-09-12T00:39:44.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.196+0000 7fa3873ec9c0 20 remove_watcher() i=3 2024-09-12T00:39:44.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.196+0000 7fa3873ec9c0 20 remove_watcher() i=4 2024-09-12T00:39:44.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.200+0000 7fa3873ec9c0 20 remove_watcher() i=5 2024-09-12T00:39:44.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.200+0000 7fa3873ec9c0 20 remove_watcher() i=6 2024-09-12T00:39:44.203 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.204+0000 7fa3873ec9c0 20 remove_watcher() i=7 2024-09-12T00:39:44.218 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:44.218 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:44.218 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-init-index id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:39:44.218 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:44.218 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:39:44.253 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:44.253 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:44.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 20 realm 2024-09-12T00:39:44.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:44.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.300+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.304+0000 7ff44a2869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:44.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.304+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.304+0000 7ff44a2869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:44.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.304+0000 7ff44a2869c0 20 searching for the correct realm 2024-09-12T00:39:44.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.308+0000 7ff44758b640 0 -- 172.21.15.137:0/310182144 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7ff43011b040 msgr2=0x7ff430009d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:44.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.316+0000 7ff44858d640 0 -- 172.21.15.137:0/310182144 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5570fbf5b3a0 msgr2=0x5570fbf5d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:44.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:44.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:44.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:44.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:44.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:44.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:44.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:44.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:44.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 zone default found 2024-09-12T00:39:44.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 4 Realm: () 2024-09-12T00:39:44.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:44.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 zonegroup default 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 started sync module instance, tier type = 2024-09-12T00:39:44.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.324+0000 7ff44a2869c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:44.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.348+0000 7ff44a2869c0 20 add_watcher() i=0 2024-09-12T00:39:44.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.348+0000 7ff44a2869c0 20 add_watcher() i=1 2024-09-12T00:39:44.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.348+0000 7ff44a2869c0 20 add_watcher() i=2 2024-09-12T00:39:44.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.348+0000 7ff44a2869c0 20 add_watcher() i=3 2024-09-12T00:39:44.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.348+0000 7ff44a2869c0 20 add_watcher() i=4 2024-09-12T00:39:44.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.348+0000 7ff44a2869c0 20 add_watcher() i=5 2024-09-12T00:39:44.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.348+0000 7ff44a2869c0 20 add_watcher() i=6 2024-09-12T00:39:44.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.352+0000 7ff44a2869c0 20 add_watcher() i=7 2024-09-12T00:39:44.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.352+0000 7ff44a2869c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:44.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff2fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 5 note: GC not initialized 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff2fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 20 Filter name: none 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff2767fc640 20 reqs_thread_entry: start 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:39:44.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:44.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:39:44.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:39:44.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 : miss 2024-09-12T00:39:44.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.356+0000 7ff44a2869c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.360+0000 7ff44a2869c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:44.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.360+0000 7ff44a2869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 info.flags=0x17 2024-09-12T00:39:44.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.360+0000 7ff44a2869c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 to cache LRU end 2024-09-12T00:39:44.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.360+0000 7ff44a2869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:44.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.360+0000 7ff44a2869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:44.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.360+0000 7ff44a2869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 2024-09-12T00:39:44.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.360+0000 7ff44a2869c0 -1 Injecting error=-95 at location=init_index 2024-09-12T00:39:44.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.360+0000 7ff44a2869c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:39:44.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff44a2869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 info.flags=0x17 2024-09-12T00:39:44.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff44a2869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 to cache LRU end 2024-09-12T00:39:44.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff44a2869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:44.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff44a2869c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20, ofs0, ns] 2024-09-12T00:39:44.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff326ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 93943751939312 notifier 6285 bl.length()=911 2024-09-12T00:39:44.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff326ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 info.flags=0x17 2024-09-12T00:39:44.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff326ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 to cache LRU end 2024-09-12T00:39:44.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff326ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:44.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff44a2869c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20]): orig_sources= new_sources= 2024-09-12T00:39:44.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff44a2869c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20]): potential sources added=[] removed=[] 2024-09-12T00:39:44.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff44a2869c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20]): orig_dests= new_dests= 2024-09-12T00:39:44.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.368+0000 7ff44a2869c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20]): potential dests added=[] removed=[] 2024-09-12T00:39:44.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.372+0000 7ff44a2869c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20.1.0 2024-09-12T00:39:44.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.372+0000 7ff44a2869c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20.1.0 2024-09-12T00:39:44.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.372+0000 7ff44a2869c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20.1.1 2024-09-12T00:39:44.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.372+0000 7ff44a2869c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20.1.1 2024-09-12T00:39:44.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.372+0000 7ff44a2869c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20.0 2024-09-12T00:39:44.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.376+0000 7ff44a2869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:44.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.376+0000 7ff44a2869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 2024-09-12T00:39:44.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff44a2869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 info.flags=0x17 2024-09-12T00:39:44.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff44a2869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 to cache LRU end 2024-09-12T00:39:44.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff44a2869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:44.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff44a2869c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20, ofs0, ns] 2024-09-12T00:39:44.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff326ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 93943751939312 notifier 6285 bl.length()=879 2024-09-12T00:39:44.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff326ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 info.flags=0x17 2024-09-12T00:39:44.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff326ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 to cache LRU end 2024-09-12T00:39:44.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff326ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:44.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff44a2869c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20]): orig_sources= new_sources= 2024-09-12T00:39:44.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff44a2869c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20]): potential sources added=[] removed=[] 2024-09-12T00:39:44.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff44a2869c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20]): orig_dests= new_dests= 2024-09-12T00:39:44.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.380+0000 7ff44a2869c0 20 handle_bi_update(): bucket=:error-at-init-index[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20]): potential dests added=[] removed=[] 2024-09-12T00:39:44.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.384+0000 7ff44a2869c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:39:44.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.388+0000 7ff2fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:44.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.392+0000 7ff44a2869c0 20 remove_watcher() i=0 2024-09-12T00:39:44.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.392+0000 7ff44a2869c0 2 removed watcher, disabling cache 2024-09-12T00:39:44.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.396+0000 7ff44a2869c0 20 remove_watcher() i=1 2024-09-12T00:39:44.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.396+0000 7ff44a2869c0 20 remove_watcher() i=2 2024-09-12T00:39:44.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.400+0000 7ff44a2869c0 20 remove_watcher() i=3 2024-09-12T00:39:44.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.404+0000 7ff44a2869c0 20 remove_watcher() i=4 2024-09-12T00:39:44.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.404+0000 7ff44a2869c0 20 remove_watcher() i=5 2024-09-12T00:39:44.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.408+0000 7ff44a2869c0 20 remove_watcher() i=6 2024-09-12T00:39:44.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.412+0000 7ff44a2869c0 20 remove_watcher() i=7 2024-09-12T00:39:44.426 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:39:44.453 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:44.453 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:44.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.500+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.500+0000 7f538ce7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.500+0000 7f538ce7d9c0 20 realm 2024-09-12T00:39:44.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.500+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:44.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:44.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:44.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.504+0000 7f538ce7d9c0 20 searching for the correct realm 2024-09-12T00:39:44.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.512+0000 7f538a182640 0 -- 172.21.15.137:0/1138459758 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f5380064760 msgr2=0x7f538005afd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:44.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.516+0000 7f538a983640 0 -- 172.21.15.137:0/1138459758 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f5384095040 msgr2=0x7f538405f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:44.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:44.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:44.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:44.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:44.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:44.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:44.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:44.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 zone default found 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 4 Realm: () 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 zonegroup default 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.524+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.528+0000 7f538ce7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:44.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.528+0000 7f538ce7d9c0 20 started sync module instance, tier type = 2024-09-12T00:39:44.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.528+0000 7f538ce7d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:44.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.556+0000 7f538ce7d9c0 20 add_watcher() i=0 2024-09-12T00:39:44.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.556+0000 7f538ce7d9c0 20 add_watcher() i=1 2024-09-12T00:39:44.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.556+0000 7f538ce7d9c0 20 add_watcher() i=2 2024-09-12T00:39:44.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.556+0000 7f538ce7d9c0 20 add_watcher() i=3 2024-09-12T00:39:44.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.556+0000 7f538ce7d9c0 20 add_watcher() i=4 2024-09-12T00:39:44.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.556+0000 7f538ce7d9c0 20 add_watcher() i=5 2024-09-12T00:39:44.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.556+0000 7f538ce7d9c0 20 add_watcher() i=6 2024-09-12T00:39:44.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.560+0000 7f538ce7d9c0 20 add_watcher() i=7 2024-09-12T00:39:44.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.560+0000 7f538ce7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:44.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f52417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 5 note: GC not initialized 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f51bbfff640 20 reqs_thread_entry: start 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 Filter name: none 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f51b9ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:44.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:44.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:44.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:44.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.564+0000 7f538ce7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:44.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.568+0000 7f538ce7d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:44.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.568+0000 7f538ce7d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:44.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.568+0000 7f52417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:44.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.572+0000 7f538ce7d9c0 20 remove_watcher() i=0 2024-09-12T00:39:44.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.572+0000 7f538ce7d9c0 2 removed watcher, disabling cache 2024-09-12T00:39:44.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.576+0000 7f538ce7d9c0 20 remove_watcher() i=1 2024-09-12T00:39:44.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.576+0000 7f538ce7d9c0 20 remove_watcher() i=2 2024-09-12T00:39:44.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.580+0000 7f538ce7d9c0 20 remove_watcher() i=3 2024-09-12T00:39:44.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.580+0000 7f538ce7d9c0 20 remove_watcher() i=4 2024-09-12T00:39:44.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.584+0000 7f538ce7d9c0 20 remove_watcher() i=5 2024-09-12T00:39:44.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.584+0000 7f538ce7d9c0 20 remove_watcher() i=6 2024-09-12T00:39:44.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:44.588+0000 7f538ce7d9c0 20 remove_watcher() i=7 2024-09-12T00:39:44.601 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:44.602 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:44.602 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-init-index id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:39:44.602 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:44.603 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.603 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.606 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.606 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.659 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.659 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.685 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:39:44.686 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:44.687 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.687 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.704 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.704 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.752 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.752 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.773 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.774 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.794 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.794 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.814 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.814 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.834 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.834 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.854 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.854 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.874 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.874 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.894 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.894 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.915 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.915 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.935 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.935 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.955 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.956 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.978 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.978 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:44.999 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:44.999 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.019 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.019 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.040 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.040 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.061 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.061 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.080 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.081 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.101 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.101 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.122 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.122 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.143 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.143 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.161 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:39:45.194 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:45.194 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:45.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.240+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.240+0000 7f11033c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 realm 2024-09-12T00:39:45.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:45.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:45.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.244+0000 7f11033c89c0 20 searching for the correct realm 2024-09-12T00:39:45.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.252+0000 7f11016cf640 0 -- 172.21.15.137:0/186626493 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f10e8008070 msgr2=0x7f10e8094fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.256+0000 7f1100ece640 0 -- 172.21.15.137:0/186626493 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f10f802b430 msgr2=0x7f10f802b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:45.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:45.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:45.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:45.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:45.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:45.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 zone default found 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 4 Realm: () 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 zonegroup default 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.264+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.268+0000 7f11033c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.268+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.268+0000 7f11033c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.268+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.268+0000 7f11033c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.268+0000 7f11033c89c0 20 started sync module instance, tier type = 2024-09-12T00:39:45.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.268+0000 7f11033c89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:45.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.284+0000 7f11033c89c0 20 add_watcher() i=0 2024-09-12T00:39:45.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.284+0000 7f11033c89c0 20 add_watcher() i=1 2024-09-12T00:39:45.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.284+0000 7f11033c89c0 20 add_watcher() i=2 2024-09-12T00:39:45.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.284+0000 7f11033c89c0 20 add_watcher() i=3 2024-09-12T00:39:45.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.284+0000 7f11033c89c0 20 add_watcher() i=4 2024-09-12T00:39:45.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.284+0000 7f11033c89c0 20 add_watcher() i=5 2024-09-12T00:39:45.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.284+0000 7f11033c89c0 20 add_watcher() i=6 2024-09-12T00:39:45.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.288+0000 7f11033c89c0 20 add_watcher() i=7 2024-09-12T00:39:45.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.288+0000 7f11033c89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:45.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f0fb6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f11033c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:45.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f11033c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:45.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f11033c89c0 5 note: GC not initialized 2024-09-12T00:39:45.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f0fb5fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:45.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f11033c89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:45.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f11033c89c0 20 Filter name: none 2024-09-12T00:39:45.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f0f277fe640 20 reqs_thread_entry: start 2024-09-12T00:39:45.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.292+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.296+0000 7f11033c89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:39:45.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.296+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.296+0000 7f11033c89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:39:45.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.296+0000 7f11033c89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:45.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.296+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.296+0000 7f11033c89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:39:45.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.296+0000 7f11033c89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.300+0000 7f11033c89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:39:45.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.300+0000 7f11033c89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:45.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.300+0000 7f0fb6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.304+0000 7f11033c89c0 20 remove_watcher() i=0 2024-09-12T00:39:45.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.304+0000 7f11033c89c0 2 removed watcher, disabling cache 2024-09-12T00:39:45.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.308+0000 7f11033c89c0 20 remove_watcher() i=1 2024-09-12T00:39:45.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.308+0000 7f11033c89c0 20 remove_watcher() i=2 2024-09-12T00:39:45.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.312+0000 7f11033c89c0 20 remove_watcher() i=3 2024-09-12T00:39:45.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.312+0000 7f11033c89c0 20 remove_watcher() i=4 2024-09-12T00:39:45.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.316+0000 7f11033c89c0 20 remove_watcher() i=5 2024-09-12T00:39:45.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.316+0000 7f11033c89c0 20 remove_watcher() i=6 2024-09-12T00:39:45.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.320+0000 7f11033c89c0 20 remove_watcher() i=7 2024-09-12T00:39:45.332 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.332 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:45.332 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-init-indext id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:39:45.332 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.332 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:39:45.364 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:45.364 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:45.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.408+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 realm 2024-09-12T00:39:45.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:45.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:45.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.412+0000 7f17222f89c0 20 searching for the correct realm 2024-09-12T00:39:45.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.420+0000 7f17205ff640 0 -- 172.21.15.137:0/4072958582 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f1714108770 msgr2=0x7f1714106380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.424+0000 7f171fdfe640 0 -- 172.21.15.137:0/4072958582 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1718091040 msgr2=0x7f171805b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:45.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:45.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:45.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:45.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:45.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:45.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.428+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:45.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 zone default found 2024-09-12T00:39:45.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 4 Realm: () 2024-09-12T00:39:45.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:45.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:45.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:45.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 zonegroup default 2024-09-12T00:39:45.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 started sync module instance, tier type = 2024-09-12T00:39:45.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.432+0000 7f17222f89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:45.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=0 2024-09-12T00:39:45.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=1 2024-09-12T00:39:45.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=2 2024-09-12T00:39:45.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=3 2024-09-12T00:39:45.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=4 2024-09-12T00:39:45.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=5 2024-09-12T00:39:45.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=6 2024-09-12T00:39:45.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f17222f89c0 20 add_watcher() i=7 2024-09-12T00:39:45.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f17222f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:45.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f15d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f17222f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:45.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f17222f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:45.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f17222f89c0 5 note: GC not initialized 2024-09-12T00:39:45.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f15d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:45.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f17222f89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:45.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.456+0000 7f17222f89c0 20 Filter name: none 2024-09-12T00:39:45.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f154e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:45.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:39:45.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 : miss 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:39:45.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:45.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:45.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.460+0000 7f17222f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 2024-09-12T00:39:45.460 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f17222f89c0 time 2024-09-12T00:39:45.466781+0000 2024-09-12T00:39:45.460 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:45.461 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1725bd22eb] 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1725bd249f] 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b965c2ccc1] 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1421f32) [0x55b966689f32] 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b965c41ced] 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1724a38d90] 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.464+0000 7f17222f89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f17222f89c0 time 2024-09-12T00:39:45.466781+0000 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:45.462 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1725bd22eb] 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1725bd249f] 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b965c2ccc1] 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1421f32) [0x55b966689f32] 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b965c41ced] 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1724a38d90] 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:39:45.463 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f17222f89c0 thread_name:radosgw-admin 2024-09-12T00:39:45.488 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:45.488 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1724a51520] 2024-09-12T00:39:45.488 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:39:45.488 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:39:45.488 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:39:45.489 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1725bd2345] 2024-09-12T00:39:45.489 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1725bd249f] 2024-09-12T00:39:45.489 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b965c2ccc1] 2024-09-12T00:39:45.489 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1421f32) [0x55b966689f32] 2024-09-12T00:39:45.489 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b965c41ced] 2024-09-12T00:39:45.489 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:39:45.490 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1724a38d90] 2024-09-12T00:39:45.490 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:39:45.490 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:39:45.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.464+0000 7f17222f89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:45.490 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f17222f89c0 thread_name:radosgw-admin 2024-09-12T00:39:45.490 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.491 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:45.491 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1724a51520] 2024-09-12T00:39:45.491 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:39:45.491 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:39:45.491 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:39:45.491 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1725bd2345] 2024-09-12T00:39:45.492 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1725bd249f] 2024-09-12T00:39:45.492 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b965c2ccc1] 2024-09-12T00:39:45.492 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1421f32) [0x55b966689f32] 2024-09-12T00:39:45.492 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b965c41ced] 2024-09-12T00:39:45.492 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:39:45.493 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1724a38d90] 2024-09-12T00:39:45.493 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:39:45.493 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:39:45.493 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:45.493 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.493 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:39:45.494 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.494 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.494 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.520205s 2024-09-12T00:39:45.494 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): get_auth_request con 0x55b968668e30 auth_method 0 2024-09-12T00:39:45.494 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.495 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.495 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.495 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): get_auth_request con 0x55b96866fc60 auth_method 0 2024-09-12T00:39:45.495 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.495 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.495 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.496 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.496 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.496 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.496 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.496 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.497 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.497 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_done global_id 6074 payload 274 2024-09-12T00:39:45.497 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.497 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:39:45.388+0000 7f171f5fd640 1 monclient: found mon.noname-c 2024-09-12T00:39:45.497 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.497 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.498 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:45.498 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: dump: 2024-09-12T00:39:45.498 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.498 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.498 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.498 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.498 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.499 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.499 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.499 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.499 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.499 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.499 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.499 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.500 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.500 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.500 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:45.500 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: dump: 2024-09-12T00:39:45.500 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.500 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.500 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.501 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.501 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.501 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.501 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.501 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.501 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.501 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.501 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6074 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:39:45.388+0000 7f17222f89c0 4 set_mon_vals no callback set 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: shutdown 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 asok(0x55b9685182b0) unregister_commands rotate-key 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: build_initial_monmap 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: monmap: 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:39:45.502 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding auth protocol: cephx 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding auth protocol: cephx 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding auth protocol: cephx 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.503 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.504 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.504 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.504 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.504 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.504 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.504 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.505 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.505 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.505 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.505 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.505 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:39:45.388+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.505 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 librados: starting msgr at 2024-09-12T00:39:45.505 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 librados: starting objecter 2024-09-12T00:39:45.505 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command objecter_requests hook 0x55b96866d000 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 librados: setting wanted keys 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 librados: calling monclient init 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: init 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding auth protocol: cephx 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding auth protocol: cephx 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding auth protocol: cephx 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.506 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:39:45.388+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:39:45.388+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command rotate-key hook 0x55b968722d28 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:45.507 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-b con 0x55b9685d3410 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-c con 0x55b968668e30 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-a con 0x55b96866fc60 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.523170s 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): get_auth_request con 0x55b968668e30 auth_method 0 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): get_auth_request con 0x55b96866fc60 auth_method 0 2024-09-12T00:39:45.508 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_done global_id 6330 payload 824 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:39:45.388+0000 7f17205ff640 1 monclient: found mon.noname-a 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:39:45.509 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: dump: 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.510 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: dump: 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.511 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.512 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.512 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:39:45.388+0000 7f160de0b640 4 set_mon_vals no callback set 2024-09-12T00:39:45.512 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:39:45.392+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6330 2024-09-12T00:39:45.512 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:39:45.392+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.512 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:39:45.392+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:39:45.512 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:39:45.392+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.512 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:39:45.392+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:39:45.392+0000 7f17222f89c0 1 librados: init done 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:39:45.392+0000 7f1607fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:39:45.392+0000 7f1607fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:39:45.392+0000 7f1607fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:39:45.392+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f1608070b10 auth_method 0 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:39:45.392+0000 7f171f5fd640 10 monclient: get_auth_request con 0x55b96876aab0 auth_method 0 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:39:45.396+0000 7f171fdfe640 10 monclient: get_auth_request con 0x55b96876d8f0 auth_method 0 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:39:45.396+0000 7f171f5fd640 10 monclient: get_auth_request con 0x55b968772980 auth_method 0 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:39:45.396+0000 7f17222f89c0 10 monclient: build_initial_monmap 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:39:45.396+0000 7f17222f89c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:39:45.396+0000 7f17222f89c0 10 monclient: monmap: 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:39:45.513 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:45.514 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:39:45.514 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:39:45.514 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:45.514 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.514 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:39:45.514 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:39:45.514 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:39:45.514 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.515 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding auth protocol: cephx 2024-09-12T00:39:45.515 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding auth protocol: cephx 2024-09-12T00:39:45.515 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding auth protocol: cephx 2024-09-12T00:39:45.515 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.515 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.515 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.515 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.516 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.516 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.516 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.516 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.516 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.516 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.516 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.516 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.517 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:39:45.396+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.517 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b96877a350 EEXIST 2024-09-12T00:39:45.517 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:39:45.396+0000 7f17222f89c0 10 monclient: init 2024-09-12T00:39:45.517 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding auth protocol: cephx 2024-09-12T00:39:45.517 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding auth protocol: cephx 2024-09-12T00:39:45.517 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding auth protocol: cephx 2024-09-12T00:39:45.517 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.518 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.518 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.518 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.518 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.518 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.518 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.518 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.518 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:39:45.400+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:39:45.400+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command rotate-key cmddesc rotate-key hook 0x55b968775a90 EEXIST 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:39:45.519 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-a con 0x55b96879e500 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:39:45.520 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-c con 0x55b96879de30 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:39:45.520 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-b con 0x55b96879c810 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:39:45.520 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.520 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.520 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.520 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.520 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.532364s 2024-09-12T00:39:45.520 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): get_auth_request con 0x55b96879e500 auth_method 0 2024-09-12T00:39:45.521 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.521 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.521 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.521 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): get_auth_request con 0x55b96879de30 auth_method 0 2024-09-12T00:39:45.521 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.521 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.521 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.521 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): handle_auth_done global_id 6080 payload 824 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:39:45.400+0000 7f171f5fd640 1 monclient: found mon.noname-c 2024-09-12T00:39:45.522 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.523 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:39:45.400+0000 7f17205ff640 10 monclient: get_auth_request con 0x55b96879c810 auth_method 0 2024-09-12T00:39:45.523 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.523 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:45.523 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: dump: 2024-09-12T00:39:45.523 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.523 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.523 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.523 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.524 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.524 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.524 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.524 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.524 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.524 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.524 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.524 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.525 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.525 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.525 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:45.525 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: dump: 2024-09-12T00:39:45.525 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.525 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.525 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.525 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.526 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.526 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.526 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.526 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.526 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.526 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.526 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6080 2024-09-12T00:39:45.526 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.527 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:39:45.400+0000 7f1720e00640 4 set_mon_vals no callback set 2024-09-12T00:39:45.527 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.527 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.527 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.527 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:39:45.400+0000 7f16057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:45.527 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:39:45.400+0000 7f16057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.527 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:39:45.400+0000 7f16057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.527 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f15f8070a20 auth_method 0 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: build_initial_monmap 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:39:45.400+0000 7f17222f89c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: monmap: 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:39:45.528 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:45.529 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.529 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:39:45.529 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:39:45.529 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:39:45.529 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.529 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding auth protocol: cephx 2024-09-12T00:39:45.529 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding auth protocol: cephx 2024-09-12T00:39:45.530 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding auth protocol: cephx 2024-09-12T00:39:45.530 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.530 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.530 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.530 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.530 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:39:45.400+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: init 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding auth protocol: cephx 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding auth protocol: cephx 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding auth protocol: cephx 2024-09-12T00:39:45.531 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.532 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd5b5732b8 EEXIST 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-a con 0x55b9687f2180 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-b con 0x55b9687ed5c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-c con 0x55b9687e3c90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.536527s 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): get_auth_request con 0x55b9687f2180 auth_method 0 2024-09-12T00:39:45.533 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): get_auth_request con 0x55b9687e3c90 auth_method 0 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_done global_id 6336 payload 274 2024-09-12T00:39:45.534 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:39:45.404+0000 7f171fdfe640 1 monclient: found mon.noname-a 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: dump: 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.535 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: dump: 2024-09-12T00:39:45.536 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6336 2024-09-12T00:39:45.537 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:39:45.404+0000 7f17222f89c0 4 set_mon_vals no callback set 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: shutdown 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: build_initial_monmap 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: monmap: 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:39:45.538 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding auth protocol: cephx 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding auth protocol: cephx 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding auth protocol: cephx 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.539 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 librados: starting msgr at 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 librados: starting objecter 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b968764760 EEXIST 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 librados: setting wanted keys 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 librados: calling monclient init 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: init 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding auth protocol: cephx 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding auth protocol: cephx 2024-09-12T00:39:45.540 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding auth protocol: cephx 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.541 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command rotate-key cmddesc rotate-key hook 0x55b9687a0468 EEXIST 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-c con 0x55b9687e3c90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-a con 0x55b9687ed5c0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-b con 0x55b9687f2180 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.539146s 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): get_auth_request con 0x55b9687e3c90 auth_method 0 2024-09-12T00:39:45.542 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): get_auth_request con 0x55b9687ed5c0 auth_method 0 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_done global_id 6086 payload 824 2024-09-12T00:39:45.543 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:39:45.404+0000 7f171fdfe640 1 monclient: found mon.noname-c 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient: get_auth_request con 0x55b9687f2180 auth_method 0 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: dump: 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.544 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:45.545 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: dump: 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:39:45.404+0000 7f15feffd640 4 set_mon_vals no callback set 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6086 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.546 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:39:45.408+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:39:45.408+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:39:45.408+0000 7f17222f89c0 1 librados: init done 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:39:45.408+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cr dump hook 0x7f171001b388 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:39:45.408+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:39:45.408+0000 7f15fd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:39:45.408+0000 7f15fd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:39:45.408+0000 7f15fd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:39:45.408+0000 7f171f5fd640 10 monclient: get_auth_request con 0x7f15e8070ae0 auth_method 0 2024-09-12T00:39:45.547 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:39:45.408+0000 7f17205ff640 10 monclient: get_auth_request con 0x55b96880be30 auth_method 0 2024-09-12T00:39:45.548 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.548 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 realm 2024-09-12T00:39:45.548 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.548 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.548 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:39:45.412+0000 7f17222f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:45.548 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.548 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:39:45.412+0000 7f171fdfe640 10 monclient: get_auth_request con 0x55b968810160 auth_method 0 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 searching for the correct realm 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:39:45.412+0000 7f171f5fd640 10 monclient: get_auth_request con 0x55b9688152a0 auth_method 0 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:39:45.412+0000 7f17205ff640 10 monclient: get_auth_request con 0x7f1714108770 auth_method 0 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:39:45.416+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f1710048060 auth_method 0 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:39:45.416+0000 7f171f5fd640 10 monclient: get_auth_request con 0x7f1714120bc0 auth_method 0 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:39:45.420+0000 7f17205ff640 0 -- 172.21.15.137:0/4072958582 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f1714108770 msgr2=0x7f1714106380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.549 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:39:45.420+0000 7f15fd7fa640 1 client.6086.objecter ms_handle_reset 0x7f1714108770 session 0x7f17140c9040 osd.2 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:39:45.420+0000 7f15fd7fa640 10 monclient: _renew_subs 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:39:45.420+0000 7f15fd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:39:45.420+0000 7f17205ff640 10 monclient: get_auth_request con 0x7f15e8080e90 auth_method 0 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:39:45.420+0000 7f17205ff640 10 monclient: get_auth_request con 0x7f171003e070 auth_method 0 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:39:45.420+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f1718091040 auth_method 0 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:39:45.424+0000 7f171fdfe640 0 -- 172.21.15.137:0/4072958582 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1718091040 msgr2=0x7f171805b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:39:45.424+0000 7f15fd7fa640 1 client.6086.objecter ms_handle_reset 0x7f1718091040 session 0x7f171805c800 osd.3 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:39:45.424+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f1714108770 auth_method 0 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:45.550 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 zone default found 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:39:45.432+0000 7f17222f89c0 4 Realm: () 2024-09-12T00:39:45.551 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:39:45.432+0000 7f17222f89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:39:45.432+0000 7f17222f89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:39:45.432+0000 7f17222f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 zonegroup default 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 started sync module instance, tier type = 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:45.552 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=0 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=1 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=2 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=3 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=4 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=5 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=6 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 add_watcher() i=7 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:39:45.456+0000 7f17222f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding auth protocol: cephx 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding auth protocol: cephx 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding auth protocol: cephx 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.553 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:39:45.456+0000 7f15d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:39:45.456+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.554 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cache list hook 0x55b9687e5ba0 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cache inspect hook 0x55b9687e5ba0 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cache erase hook 0x55b9687e5ba0 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cache zap hook 0x55b9687e5ba0 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 note: GC not initialized 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:39:45.456+0000 7f15d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command sync trace show hook 0x7f1710006e90 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command sync trace history hook 0x7f1710006e90 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command sync trace active hook 0x7f1710006e90 2024-09-12T00:39:45.555 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command sync trace active_short hook 0x7f1710006e90 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 Filter name: none 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:39:45.460+0000 7f154e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 : miss 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.556 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:39:45.464+0000 7f17222f89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f17222f89c0 time 2024-09-12T00:39:45.466781+0000 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:45.557 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1725bd22eb] 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1725bd249f] 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b965c2ccc1] 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1421f32) [0x55b966689f32] 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b965c41ced] 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1724a38d90] 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:39:45.464+0000 7f17222f89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f17222f89c0 thread_name:radosgw-admin 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.558 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1724a51520] 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1725bd2345] 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1725bd249f] 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b965c2ccc1] 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1421f32) [0x55b966689f32] 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b965c41ced] 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1724a38d90] 2024-09-12T00:39:45.559 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:45.560 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:39:45.561 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:39:45.562 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:45.563 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:39:45.564 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:45.565 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:39:45.566 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 7f154e7fc640 / http_manager 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 7f15d4fe1640 / http_manager 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 7f15d5fe3640 / rgw_dt_lg_renew 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 7f15fd7fa640 / ms_dispatch 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 7f15feffd640 / io_context_pool 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 7f16057fa640 / ms_dispatch 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1607fff640 / ms_dispatch 2024-09-12T00:39:45.567 INFO:tasks.workunit.client.0.smithi137.stderr: 7f160de0b640 / io_context_pool 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: 7f171f5fd640 / msgr-worker-2 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: 7f171fdfe640 / msgr-worker-1 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: 7f17205ff640 / msgr-worker-0 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1720e00640 / io_context_pool 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: 7f17222f89c0 / radosgw-admin 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.83588.log 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.568 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.520205s 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): get_auth_request con 0x55b968668e30 auth_method 0 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): get_auth_request con 0x55b96866fc60 auth_method 0 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.569 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_done global_id 6074 payload 274 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:39:45.388+0000 7f171f5fd640 1 monclient: found mon.noname-c 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: dump: 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.570 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:39:45.388+0000 7f160de0b640 10 monclient: dump: 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.571 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.572 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.572 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.572 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.572 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.572 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.572 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.572 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6074 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:39:45.388+0000 7f17222f89c0 4 set_mon_vals no callback set 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: shutdown 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 asok(0x55b9685182b0) unregister_commands rotate-key 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: build_initial_monmap 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: monmap: 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:39:45.573 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding auth protocol: cephx 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding auth protocol: cephx 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding auth protocol: cephx 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.574 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: crc 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b9687249d0) adding con mode: secure 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:39:45.388+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 librados: starting msgr at 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 librados: starting objecter 2024-09-12T00:39:45.575 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command objecter_requests hook 0x55b96866d000 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 librados: setting wanted keys 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:39:45.388+0000 7f17222f89c0 1 librados: calling monclient init 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: init 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding auth protocol: cephx 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding auth protocol: cephx 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding auth protocol: cephx 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.576 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: crc 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 AuthRegistry(0x55b968722be0) adding con mode: secure 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:39:45.388+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:39:45.388+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:39:45.388+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command rotate-key hook 0x55b968722d28 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-b con 0x55b9685d3410 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-c con 0x55b968668e30 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:39:45.577 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-a con 0x55b96866fc60 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:39:45.388+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.523170s 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): get_auth_request con 0x55b968668e30 auth_method 0 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): get_auth_request con 0x55b96866fc60 auth_method 0 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.578 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:39:45.388+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient(hunting): handle_auth_done global_id 6330 payload 824 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:39:45.388+0000 7f17205ff640 1 monclient: found mon.noname-a 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:39:45.388+0000 7f17205ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: dump: 2024-09-12T00:39:45.579 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.580 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:39:45.388+0000 7f1607fff640 10 monclient: dump: 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:39:45.388+0000 7f160de0b640 4 set_mon_vals no callback set 2024-09-12T00:39:45.581 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:39:45.392+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6330 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:39:45.392+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:39:45.392+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:39:45.392+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:39:45.392+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:39:45.392+0000 7f17222f89c0 1 librados: init done 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:39:45.392+0000 7f1607fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:39:45.392+0000 7f1607fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:39:45.392+0000 7f1607fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:39:45.392+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f1608070b10 auth_method 0 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:39:45.392+0000 7f171f5fd640 10 monclient: get_auth_request con 0x55b96876aab0 auth_method 0 2024-09-12T00:39:45.582 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:39:45.396+0000 7f171fdfe640 10 monclient: get_auth_request con 0x55b96876d8f0 auth_method 0 2024-09-12T00:39:45.584 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:39:45.396+0000 7f171f5fd640 10 monclient: get_auth_request con 0x55b968772980 auth_method 0 2024-09-12T00:39:45.584 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:39:45.396+0000 7f17222f89c0 10 monclient: build_initial_monmap 2024-09-12T00:39:45.584 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:39:45.396+0000 7f17222f89c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:45.584 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:39:45.396+0000 7f17222f89c0 10 monclient: monmap: 2024-09-12T00:39:45.584 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.585 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding auth protocol: cephx 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding auth protocol: cephx 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding auth protocol: cephx 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.586 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: crc 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968776a50) adding con mode: secure 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:39:45.396+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b96877a350 EEXIST 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:39:45.396+0000 7f17222f89c0 10 monclient: init 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding auth protocol: cephx 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding auth protocol: cephx 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding auth protocol: cephx 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.587 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: crc 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:39:45.396+0000 7f17222f89c0 5 AuthRegistry(0x55b968775948) adding con mode: secure 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:39:45.400+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:39:45.400+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command rotate-key cmddesc rotate-key hook 0x55b968775a90 EEXIST 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:39:45.588 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-a con 0x55b96879e500 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-c con 0x55b96879de30 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-b con 0x55b96879c810 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.532364s 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): get_auth_request con 0x55b96879e500 auth_method 0 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.589 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): get_auth_request con 0x55b96879de30 auth_method 0 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.590 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient(hunting): handle_auth_done global_id 6080 payload 824 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:39:45.400+0000 7f171f5fd640 1 monclient: found mon.noname-c 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:39:45.400+0000 7f171f5fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:39:45.400+0000 7f17205ff640 10 monclient: get_auth_request con 0x55b96879c810 auth_method 0 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: dump: 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.591 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:39:45.400+0000 7f16057fa640 10 monclient: dump: 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.592 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6080 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:39:45.400+0000 7f1720e00640 4 set_mon_vals no callback set 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.593 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:39:45.400+0000 7f16057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:39:45.400+0000 7f16057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:39:45.400+0000 7f16057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:39:45.400+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f15f8070a20 auth_method 0 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: build_initial_monmap 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:39:45.400+0000 7f17222f89c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: monmap: 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:39:45.594 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding auth protocol: cephx 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding auth protocol: cephx 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding auth protocol: cephx 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.595 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: crc 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x55b9687bdc80) adding con mode: secure 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:39:45.400+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:39:45.400+0000 7f17222f89c0 10 monclient: init 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding auth protocol: cephx 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding auth protocol: cephx 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding auth protocol: cephx 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.596 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: crc 2024-09-12T00:39:45.597 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:39:45.400+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573170) adding con mode: secure 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd5b5732b8 EEXIST 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-a con 0x55b9687f2180 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-b con 0x55b9687ed5c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-c con 0x55b9687e3c90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.598 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.536527s 2024-09-12T00:39:45.599 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): get_auth_request con 0x55b9687f2180 auth_method 0 2024-09-12T00:39:45.599 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.599 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.599 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.599 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): get_auth_request con 0x55b9687e3c90 auth_method 0 2024-09-12T00:39:45.599 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.600 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.600 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.600 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.600 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.600 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.600 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.600 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.600 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_done global_id 6336 payload 274 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:39:45.404+0000 7f171fdfe640 1 monclient: found mon.noname-a 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: dump: 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.601 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.602 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.602 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.602 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.602 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.602 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.602 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.602 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.603 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.603 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.603 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:45.603 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:39:45.404+0000 7f15feffd640 10 monclient: dump: 2024-09-12T00:39:45.603 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.603 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.605 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.605 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.605 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6336 2024-09-12T00:39:45.605 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:45.605 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:39:45.404+0000 7f17222f89c0 4 set_mon_vals no callback set 2024-09-12T00:39:45.605 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: shutdown 2024-09-12T00:39:45.606 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: build_initial_monmap 2024-09-12T00:39:45.606 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:45.606 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: monmap: 2024-09-12T00:39:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:39:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:39:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:39:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:39:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:39:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:39:45.608 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.608 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding auth protocol: cephx 2024-09-12T00:39:45.608 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding auth protocol: cephx 2024-09-12T00:39:45.608 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding auth protocol: cephx 2024-09-12T00:39:45.608 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.608 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.609 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.609 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.609 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.609 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.609 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.610 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.610 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.610 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.610 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: crc 2024-09-12T00:39:45.610 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687e4750) adding con mode: secure 2024-09-12T00:39:45.610 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.611 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 librados: starting msgr at 2024-09-12T00:39:45.611 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 librados: starting objecter 2024-09-12T00:39:45.611 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b968764760 EEXIST 2024-09-12T00:39:45.611 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 librados: setting wanted keys 2024-09-12T00:39:45.611 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:39:45.404+0000 7f17222f89c0 1 librados: calling monclient init 2024-09-12T00:39:45.611 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: init 2024-09-12T00:39:45.612 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding auth protocol: cephx 2024-09-12T00:39:45.612 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding auth protocol: cephx 2024-09-12T00:39:45.612 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding auth protocol: cephx 2024-09-12T00:39:45.612 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.612 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.612 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.613 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.613 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.613 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.613 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.613 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.613 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.614 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.614 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: crc 2024-09-12T00:39:45.614 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 AuthRegistry(0x55b9687a0320) adding con mode: secure 2024-09-12T00:39:45.614 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.614 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:39:45.404+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.614 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command rotate-key cmddesc rotate-key hook 0x55b9687a0468 EEXIST 2024-09-12T00:39:45.615 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:45.615 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:45.615 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-c con 0x55b9687e3c90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:39:45.615 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-a con 0x55b9687ed5c0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:39:45.615 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): picked mon.noname-b con 0x55b9687f2180 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:39:45.616 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.616 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.616 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:45.616 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:45.616 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient(hunting): authenticate will time out at 2086.539146s 2024-09-12T00:39:45.616 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): get_auth_request con 0x55b9687e3c90 auth_method 0 2024-09-12T00:39:45.617 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.617 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.617 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.617 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): get_auth_request con 0x55b9687ed5c0 auth_method 0 2024-09-12T00:39:45.617 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:45.618 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:45.618 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:45.618 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.618 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.618 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.618 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:45.618 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:45.619 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:39:45.404+0000 7f171f5fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:45.619 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient(hunting): handle_auth_done global_id 6086 payload 824 2024-09-12T00:39:45.619 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient: _finish_hunting 0 2024-09-12T00:39:45.619 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:39:45.404+0000 7f171fdfe640 1 monclient: found mon.noname-c 2024-09-12T00:39:45.619 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:39:45.404+0000 7f171fdfe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.619 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:39:45.404+0000 7f17205ff640 10 monclient: get_auth_request con 0x55b9687f2180 auth_method 0 2024-09-12T00:39:45.619 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.620 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:45.620 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: dump: 2024-09-12T00:39:45.620 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.620 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.620 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.620 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.620 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: _finish_auth 0 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:39:45.404+0000 7f15fd7fa640 10 monclient: dump: 2024-09-12T00:39:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:39:45.404+0000 7f15feffd640 4 set_mon_vals no callback set 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:39:45.404+0000 7f17222f89c0 5 monclient: authenticate success, global_id 6086 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:39:45.404+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.622 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:39:45.408+0000 7f17222f89c0 10 monclient: _renew_subs 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:39:45.408+0000 7f17222f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:39:45.408+0000 7f17222f89c0 1 librados: init done 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:39:45.408+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cr dump hook 0x7f171001b388 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:39:45.408+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:39:45.408+0000 7f15fd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:39:45.408+0000 7f15fd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:39:45.408+0000 7f15fd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:39:45.408+0000 7f171f5fd640 10 monclient: get_auth_request con 0x7f15e8070ae0 auth_method 0 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:39:45.408+0000 7f17205ff640 10 monclient: get_auth_request con 0x55b96880be30 auth_method 0 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 realm 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.623 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:39:45.412+0000 7f17222f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:39:45.412+0000 7f171fdfe640 10 monclient: get_auth_request con 0x55b968810160 auth_method 0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:39:45.412+0000 7f17222f89c0 20 searching for the correct realm 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:39:45.412+0000 7f171f5fd640 10 monclient: get_auth_request con 0x55b9688152a0 auth_method 0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:39:45.412+0000 7f17205ff640 10 monclient: get_auth_request con 0x7f1714108770 auth_method 0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:39:45.416+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f1710048060 auth_method 0 2024-09-12T00:39:45.624 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:39:45.416+0000 7f171f5fd640 10 monclient: get_auth_request con 0x7f1714120bc0 auth_method 0 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:39:45.420+0000 7f17205ff640 0 -- 172.21.15.137:0/4072958582 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f1714108770 msgr2=0x7f1714106380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:39:45.420+0000 7f15fd7fa640 1 client.6086.objecter ms_handle_reset 0x7f1714108770 session 0x7f17140c9040 osd.2 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:39:45.420+0000 7f15fd7fa640 10 monclient: _renew_subs 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:39:45.420+0000 7f15fd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:39:45.420+0000 7f17205ff640 10 monclient: get_auth_request con 0x7f15e8080e90 auth_method 0 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:39:45.420+0000 7f17205ff640 10 monclient: get_auth_request con 0x7f171003e070 auth_method 0 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:39:45.420+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f1718091040 auth_method 0 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:39:45.424+0000 7f171fdfe640 0 -- 172.21.15.137:0/4072958582 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1718091040 msgr2=0x7f171805b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:39:45.424+0000 7f15fd7fa640 1 client.6086.objecter ms_handle_reset 0x7f1718091040 session 0x7f171805c800 osd.3 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:39:45.424+0000 7f171fdfe640 10 monclient: get_auth_request con 0x7f1714108770 auth_method 0 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:45.625 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:39:45.428+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 zone default found 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:39:45.432+0000 7f17222f89c0 4 Realm: () 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:39:45.432+0000 7f17222f89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:45.626 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:39:45.432+0000 7f17222f89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:39:45.432+0000 7f17222f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 zonegroup default 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 started sync module instance, tier type = 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:39:45.432+0000 7f17222f89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=0 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=1 2024-09-12T00:39:45.627 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=2 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=3 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=4 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=5 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:39:45.452+0000 7f17222f89c0 20 add_watcher() i=6 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 add_watcher() i=7 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:39:45.456+0000 7f17222f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding auth protocol: cephx 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding auth protocol: cephx 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding auth protocol: cephx 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.628 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: crc 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 AuthRegistry(0x7ffd5b573650) adding con mode: secure 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:39:45.456+0000 7f15d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.629 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:39:45.456+0000 7f17222f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cache list hook 0x55b9687e5ba0 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cache inspect hook 0x55b9687e5ba0 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cache erase hook 0x55b9687e5ba0 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command cache zap hook 0x55b9687e5ba0 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 note: GC not initialized 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:39:45.456+0000 7f15d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command sync trace show hook 0x7f1710006e90 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command sync trace history hook 0x7f1710006e90 2024-09-12T00:39:45.630 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command sync trace active hook 0x7f1710006e90 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:39:45.456+0000 7f17222f89c0 5 asok(0x55b9685182b0) register_command sync trace active_short hook 0x7f1710006e90 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:39:45.456+0000 7f17222f89c0 20 Filter name: none 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:39:45.460+0000 7f154e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 : miss 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:39:45.460+0000 7f17222f89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:39:45.631 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:39:45.460+0000 7f17222f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:39:45.464+0000 7f17222f89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f17222f89c0 time 2024-09-12T00:39:45.466781+0000 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1725bd22eb] 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1725bd249f] 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b965c2ccc1] 2024-09-12T00:39:45.632 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1421f32) [0x55b966689f32] 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b965c41ced] 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1724a38d90] 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:39:45.464+0000 7f17222f89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f17222f89c0 thread_name:radosgw-admin 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1724a51520] 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:39:45.633 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1725bd2345] 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1725bd249f] 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b965c2ccc1] 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1421f32) [0x55b966689f32] 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b965c41ced] 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1724a38d90] 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:39:45.634 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:39:45.635 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:39:45.636 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:39:45.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:39:45.638 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:45.639 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:45.640 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 7f154e7fc640 / http_manager 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 7f15d4fe1640 / http_manager 2024-09-12T00:39:45.641 INFO:tasks.workunit.client.0.smithi137.stderr: 7f15d5fe3640 / rgw_dt_lg_renew 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f15fd7fa640 / ms_dispatch 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f15feffd640 / io_context_pool 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f16057fa640 / ms_dispatch 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1607fff640 / ms_dispatch 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f160de0b640 / io_context_pool 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f171f5fd640 / msgr-worker-2 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f171fdfe640 / msgr-worker-1 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f17205ff640 / msgr-worker-0 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1720e00640 / io_context_pool 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: 7f17222f89c0 / radosgw-admin 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:39:45.469218Z_537f78fe-b275-4f2e-99fb-381be2d4b6ef/log 2024-09-12T00:39:45.642 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:39:45.643 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:39:45.643 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:39:45.648 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:45.648 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:45.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.544+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.544+0000 7f20fb1049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.544+0000 7f20fb1049c0 20 realm 2024-09-12T00:39:45.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.544+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.548+0000 7f20fb1049c0 20 searching for the correct realm 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.556+0000 7f20f3fff640 0 -- 172.21.15.137:0/2642437152 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x559668a6c950 msgr2=0x559668a6ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.560+0000 7f20f8c0a640 0 -- 172.21.15.137:0/2642437152 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x559668a70c60 msgr2=0x559668a73050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 zone default found 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 4 Realm: () 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 zonegroup default 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.568+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.572+0000 7f20fb1049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.572+0000 7f20fb1049c0 20 started sync module instance, tier type = 2024-09-12T00:39:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.572+0000 7f20fb1049c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.588+0000 7f20fb1049c0 20 add_watcher() i=0 2024-09-12T00:39:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.588+0000 7f20fb1049c0 20 add_watcher() i=1 2024-09-12T00:39:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.588+0000 7f20fb1049c0 20 add_watcher() i=2 2024-09-12T00:39:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.588+0000 7f20fb1049c0 20 add_watcher() i=3 2024-09-12T00:39:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.588+0000 7f20fb1049c0 20 add_watcher() i=4 2024-09-12T00:39:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.588+0000 7f20fb1049c0 20 add_watcher() i=5 2024-09-12T00:39:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.588+0000 7f20fb1049c0 20 add_watcher() i=6 2024-09-12T00:39:45.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.592+0000 7f20fb1049c0 20 add_watcher() i=7 2024-09-12T00:39:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.592+0000 7f20fb1049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.592+0000 7f1faf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 5 note: GC not initialized 2024-09-12T00:39:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f1fae7e4640 20 reqs_thread_entry: start 2024-09-12T00:39:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 Filter name: none 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f1fa77fe640 20 reqs_thread_entry: start 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:39:45.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.596+0000 7f20fb1049c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.600+0000 7f20fb1049c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.600+0000 7f20fb1049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.600+0000 7f1faf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.604+0000 7f20fb1049c0 20 remove_watcher() i=0 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.604+0000 7f20fb1049c0 2 removed watcher, disabling cache 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.608+0000 7f20fb1049c0 20 remove_watcher() i=1 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.608+0000 7f20fb1049c0 20 remove_watcher() i=2 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.612+0000 7f20fb1049c0 20 remove_watcher() i=3 2024-09-12T00:39:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.612+0000 7f20fb1049c0 20 remove_watcher() i=4 2024-09-12T00:39:45.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.616+0000 7f20fb1049c0 20 remove_watcher() i=5 2024-09-12T00:39:45.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.616+0000 7f20fb1049c0 20 remove_watcher() i=6 2024-09-12T00:39:45.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.620+0000 7f20fb1049c0 20 remove_watcher() i=7 2024-09-12T00:39:45.656 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.656 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:39:45.656 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-init-indext id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:39:45.656 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:39:45.656 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.657 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.657 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:45.657 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:39:45.690 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:45.721 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:45.721 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:45.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.768+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.768+0000 7fb278d709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.768+0000 7fb278d709c0 20 realm 2024-09-12T00:39:45.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.768+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:45.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.772+0000 7fb278d709c0 20 searching for the correct realm 2024-09-12T00:39:45.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.780+0000 7fb276075640 0 -- 172.21.15.137:0/3960381223 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fb26c0d1450 msgr2=0x7fb26c0d18b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.784+0000 7fb277077640 0 -- 172.21.15.137:0/3960381223 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55d3327b8b90 msgr2=0x55d3327bb020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.792+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 zone default found 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 4 Realm: () 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 zonegroup default 2024-09-12T00:39:45.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 started sync module instance, tier type = 2024-09-12T00:39:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.796+0000 7fb278d709c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:39:45.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.812+0000 7fb278d709c0 20 add_watcher() i=0 2024-09-12T00:39:45.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.812+0000 7fb278d709c0 20 add_watcher() i=1 2024-09-12T00:39:45.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.812+0000 7fb278d709c0 20 add_watcher() i=2 2024-09-12T00:39:45.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.812+0000 7fb278d709c0 20 add_watcher() i=3 2024-09-12T00:39:45.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.812+0000 7fb278d709c0 20 add_watcher() i=4 2024-09-12T00:39:45.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.812+0000 7fb278d709c0 20 add_watcher() i=5 2024-09-12T00:39:45.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.812+0000 7fb278d709c0 20 add_watcher() i=6 2024-09-12T00:39:45.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.816+0000 7fb278d709c0 20 add_watcher() i=7 2024-09-12T00:39:45.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.816+0000 7fb278d709c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:45.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb12d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:45.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:45.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 5 note: GC not initialized 2024-09-12T00:39:45.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb0a7fff640 20 reqs_thread_entry: start 2024-09-12T00:39:45.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 20 init_complete bucket index max shards: 1 2024-09-12T00:39:45.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 20 Filter name: none 2024-09-12T00:39:45.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb0a5ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:45.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:39:45.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:39:45.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:39:45.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:39:45.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 : miss 2024-09-12T00:39:45.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.820+0000 7fb278d709c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:45.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.824+0000 7fb278d709c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:39:45.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.824+0000 7fb278d709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:39:45.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.824+0000 7fb278d709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:39:45.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.824+0000 7fb278d709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:45.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.824+0000 7fb278d709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:45.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.824+0000 7fb278d709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 2024-09-12T00:39:45.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.824+0000 7fb278d709c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to be held by another RGW process; skipping for now 2024-09-12T00:39:45.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.828+0000 7fb12d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:45.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.832+0000 7fb278d709c0 20 remove_watcher() i=0 2024-09-12T00:39:45.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.832+0000 7fb278d709c0 2 removed watcher, disabling cache 2024-09-12T00:39:45.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.832+0000 7fb278d709c0 20 remove_watcher() i=1 2024-09-12T00:39:45.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.836+0000 7fb278d709c0 20 remove_watcher() i=2 2024-09-12T00:39:45.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.836+0000 7fb278d709c0 20 remove_watcher() i=3 2024-09-12T00:39:45.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.840+0000 7fb278d709c0 20 remove_watcher() i=4 2024-09-12T00:39:45.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.840+0000 7fb278d709c0 20 remove_watcher() i=5 2024-09-12T00:39:45.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.844+0000 7fb278d709c0 20 remove_watcher() i=6 2024-09-12T00:39:45.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:39:45.844+0000 7fb278d709c0 20 remove_watcher() i=7 2024-09-12T00:39:45.858 INFO:tasks.workunit.client.0.smithi137.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:40:15.890 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:15.926 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:15.926 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:15.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.972+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:15.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:15.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 realm 2024-09-12T00:40:15.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:15.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:15.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:15.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:15.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:15.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:15.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:15.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:15.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:15.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.976+0000 7fe562cf39c0 20 searching for the correct realm 2024-09-12T00:40:15.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:15.984+0000 7fe55fff8640 0 -- 172.21.15.137:0/3525606894 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fe5540911a0 msgr2=0x7fe554067a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:16.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.196+0000 7fe560ffa640 0 -- 172.21.15.137:0/3525606894 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x564b498021c0 msgr2=0x564b49804680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:16.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:16.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:16.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:16.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:16.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:16.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:16.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:16.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:16.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 zone default found 2024-09-12T00:40:16.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 4 Realm: () 2024-09-12T00:40:16.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:16.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:16.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:16.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 zonegroup default 2024-09-12T00:40:16.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.212+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.216+0000 7fe562cf39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.216+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.216+0000 7fe562cf39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.216+0000 7fe562cf39c0 20 started sync module instance, tier type = 2024-09-12T00:40:16.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.216+0000 7fe562cf39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:16.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.236+0000 7fe562cf39c0 20 add_watcher() i=0 2024-09-12T00:40:16.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.236+0000 7fe562cf39c0 20 add_watcher() i=1 2024-09-12T00:40:16.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.236+0000 7fe562cf39c0 20 add_watcher() i=2 2024-09-12T00:40:16.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.236+0000 7fe562cf39c0 20 add_watcher() i=3 2024-09-12T00:40:16.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.236+0000 7fe562cf39c0 20 add_watcher() i=4 2024-09-12T00:40:16.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.236+0000 7fe562cf39c0 20 add_watcher() i=5 2024-09-12T00:40:16.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.236+0000 7fe562cf39c0 20 add_watcher() i=6 2024-09-12T00:40:16.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.240+0000 7fe562cf39c0 20 add_watcher() i=7 2024-09-12T00:40:16.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.240+0000 7fe562cf39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:16.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.244+0000 7fe416fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:16.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.244+0000 7fe562cf39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:16.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.244+0000 7fe562cf39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:16.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.244+0000 7fe562cf39c0 5 note: GC not initialized 2024-09-12T00:40:16.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe415fdb640 20 reqs_thread_entry: start 2024-09-12T00:40:16.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:16.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 20 Filter name: none 2024-09-12T00:40:16.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe3877fe640 20 reqs_thread_entry: start 2024-09-12T00:40:16.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:40:16.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:40:16.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:40:16.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:40:16.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 : miss 2024-09-12T00:40:16.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:40:16.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:40:16.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:40:16.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:16.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:16.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.248+0000 7fe562cf39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 2024-09-12T00:40:16.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.256+0000 7fe562cf39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:40:16.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.256+0000 7fe562cf39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:40:16.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.256+0000 7fe562cf39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:16.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.256+0000 7fe562cf39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21, ofs0, ns] 2024-09-12T00:40:16.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.260+0000 7fe4377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94881355722912 notifier 6134 bl.length()=913 2024-09-12T00:40:16.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.260+0000 7fe4377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:40:16.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.260+0000 7fe4377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:40:16.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.260+0000 7fe4377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:16.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.260+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): orig_sources= new_sources= 2024-09-12T00:40:16.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.260+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): potential sources added=[] removed=[] 2024-09-12T00:40:16.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.260+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): orig_dests= new_dests= 2024-09-12T00:40:16.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.260+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): potential dests added=[] removed=[] 2024-09-12T00:40:16.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.268+0000 7fe562cf39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21.1.0 2024-09-12T00:40:16.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.268+0000 7fe562cf39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21.1.0 2024-09-12T00:40:16.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.268+0000 7fe562cf39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21.1.1 2024-09-12T00:40:16.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.268+0000 7fe562cf39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21.1.1 2024-09-12T00:40:16.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.268+0000 7fe562cf39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21.0 2024-09-12T00:40:16.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.272+0000 7fe562cf39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:16.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.272+0000 7fe562cf39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 2024-09-12T00:40:16.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe562cf39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:40:16.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe562cf39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:40:16.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe562cf39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:16.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe562cf39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21, ofs0, ns] 2024-09-12T00:40:16.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe436ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94881355722912 notifier 6134 bl.length()=913 2024-09-12T00:40:16.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe436ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:40:16.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe436ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:40:16.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe436ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:16.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): orig_sources= new_sources= 2024-09-12T00:40:16.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): potential sources added=[] removed=[] 2024-09-12T00:40:16.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): orig_dests= new_dests= 2024-09-12T00:40:16.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.276+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): potential dests added=[] removed=[] 2024-09-12T00:40:16.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.280+0000 7fe562cf39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21.0 2024-09-12T00:40:16.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.280+0000 7fe562cf39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:16.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.280+0000 7fe562cf39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 2024-09-12T00:40:16.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.284+0000 7fe562cf39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:40:16.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.284+0000 7fe562cf39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:40:16.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.284+0000 7fe562cf39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:16.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.284+0000 7fe562cf39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21, ofs0, ns] 2024-09-12T00:40:16.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.284+0000 7fe4377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94881355722912 notifier 6134 bl.length()=881 2024-09-12T00:40:16.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.284+0000 7fe4377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 info.flags=0x17 2024-09-12T00:40:16.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.284+0000 7fe4377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 to cache LRU end 2024-09-12T00:40:16.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.284+0000 7fe4377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:16.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.288+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): orig_sources= new_sources= 2024-09-12T00:40:16.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.288+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): potential sources added=[] removed=[] 2024-09-12T00:40:16.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.288+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): orig_dests= new_dests= 2024-09-12T00:40:16.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.288+0000 7fe562cf39c0 20 handle_bi_update(): bucket=:abort-at-init-indext[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21]): potential dests added=[] removed=[] 2024-09-12T00:40:16.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.288+0000 7fe562cf39c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T00:40:16.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.292+0000 7fe416fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:16.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.300+0000 7fe562cf39c0 20 remove_watcher() i=0 2024-09-12T00:40:16.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.300+0000 7fe562cf39c0 2 removed watcher, disabling cache 2024-09-12T00:40:16.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.300+0000 7fe562cf39c0 20 remove_watcher() i=1 2024-09-12T00:40:16.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.304+0000 7fe562cf39c0 20 remove_watcher() i=2 2024-09-12T00:40:16.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.304+0000 7fe562cf39c0 20 remove_watcher() i=3 2024-09-12T00:40:16.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.308+0000 7fe562cf39c0 20 remove_watcher() i=4 2024-09-12T00:40:16.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.312+0000 7fe562cf39c0 20 remove_watcher() i=5 2024-09-12T00:40:16.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.312+0000 7fe562cf39c0 20 remove_watcher() i=6 2024-09-12T00:40:16.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.316+0000 7fe562cf39c0 20 remove_watcher() i=7 2024-09-12T00:40:16.332 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:40:16.364 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:16.364 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:16.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.408+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.412+0000 7f1724c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.412+0000 7f1724c8e9c0 20 realm 2024-09-12T00:40:16.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.412+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.412+0000 7f1724c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.412+0000 7f1724c8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:16.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.412+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.412+0000 7f1724c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.412+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.416+0000 7f1724c8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:16.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.416+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.414 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.416+0000 7f1724c8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:16.414 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.416+0000 7f1724c8e9c0 20 searching for the correct realm 2024-09-12T00:40:16.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.420+0000 7f1722794640 0 -- 172.21.15.137:0/3897553362 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f170c0023a0 msgr2=0x7f171408a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:16.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.631+0000 7f1722794640 0 -- 172.21.15.137:0/3897553362 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f171c028050 msgr2=0x7f171c061e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:16.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:16.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:16.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:16.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:16.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:16.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:16.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:16.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.851+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:16.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 zone default found 2024-09-12T00:40:16.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 4 Realm: () 2024-09-12T00:40:16.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:16.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:16.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:16.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 zonegroup default 2024-09-12T00:40:16.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:16.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 started sync module instance, tier type = 2024-09-12T00:40:16.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.855+0000 7f1724c8e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:16.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 20 add_watcher() i=0 2024-09-12T00:40:16.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 20 add_watcher() i=1 2024-09-12T00:40:16.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 20 add_watcher() i=2 2024-09-12T00:40:16.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 20 add_watcher() i=3 2024-09-12T00:40:16.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 20 add_watcher() i=4 2024-09-12T00:40:16.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 20 add_watcher() i=5 2024-09-12T00:40:16.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 20 add_watcher() i=6 2024-09-12T00:40:16.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 20 add_watcher() i=7 2024-09-12T00:40:16.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.879+0000 7f1724c8e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:16.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.883+0000 7f15d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:16.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f1724c8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:16.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f1724c8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:16.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f1724c8e9c0 5 note: GC not initialized 2024-09-12T00:40:16.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f15537fe640 20 reqs_thread_entry: start 2024-09-12T00:40:16.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f1724c8e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:16.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f1724c8e9c0 20 Filter name: none 2024-09-12T00:40:16.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f15517fa640 20 reqs_thread_entry: start 2024-09-12T00:40:16.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f1724c8e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:40:16.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.887+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.891+0000 7f1724c8e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:40:16.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.891+0000 7f1724c8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:16.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.891+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.891+0000 7f1724c8e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:40:16.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.891+0000 7f1724c8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:16.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.891+0000 7f1724c8e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:40:16.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.891+0000 7f1724c8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:16.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.895+0000 7f15d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:16.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.899+0000 7f1724c8e9c0 20 remove_watcher() i=0 2024-09-12T00:40:16.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.899+0000 7f1724c8e9c0 2 removed watcher, disabling cache 2024-09-12T00:40:16.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.899+0000 7f1724c8e9c0 20 remove_watcher() i=1 2024-09-12T00:40:16.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.903+0000 7f1724c8e9c0 20 remove_watcher() i=2 2024-09-12T00:40:16.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.903+0000 7f1724c8e9c0 20 remove_watcher() i=3 2024-09-12T00:40:16.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.907+0000 7f1724c8e9c0 20 remove_watcher() i=4 2024-09-12T00:40:16.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.907+0000 7f1724c8e9c0 20 remove_watcher() i=5 2024-09-12T00:40:16.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.911+0000 7f1724c8e9c0 20 remove_watcher() i=6 2024-09-12T00:40:16.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:16.915+0000 7f1724c8e9c0 20 remove_watcher() i=7 2024-09-12T00:40:16.930 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:16.930 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:16.930 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-init-indext id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:40:16.930 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:16.931 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:16.931 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:16.935 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:16.935 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:16.983 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:16.983 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.009 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:40:17.009 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:17.010 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.011 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.029 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.029 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.077 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.077 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.098 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.098 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.120 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.120 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.140 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.140 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.164 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.164 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.185 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.185 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.207 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.207 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.227 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.228 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.247 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.247 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.270 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.270 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.290 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.290 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.310 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.310 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.331 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.331 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.352 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.352 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.372 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.372 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.392 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.393 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.414 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.414 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.435 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.435 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.457 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.458 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.480 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:17.480 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:17.498 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:40:17.530 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:17.530 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:17.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.575+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 realm 2024-09-12T00:40:17.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:17.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:17.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:17.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.579+0000 7fcb22e379c0 20 searching for the correct realm 2024-09-12T00:40:17.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.587+0000 7fcb2113e640 0 -- 172.21.15.137:0/1415612273 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fcb1411a350 msgr2=0x7fcb140f7110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:17.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.591+0000 7fcb2093d640 0 -- 172.21.15.137:0/1415612273 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fcb18079040 msgr2=0x7fcb1805f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:17.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:17.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:17.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:17.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:17.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:17.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:17.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.599+0000 7fcb22e379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:17.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:17.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 zone default found 2024-09-12T00:40:17.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 4 Realm: () 2024-09-12T00:40:17.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:17.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:17.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:17.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 zonegroup default 2024-09-12T00:40:17.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 started sync module instance, tier type = 2024-09-12T00:40:17.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.603+0000 7fcb22e379c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:17.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 20 add_watcher() i=0 2024-09-12T00:40:17.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 20 add_watcher() i=1 2024-09-12T00:40:17.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 20 add_watcher() i=2 2024-09-12T00:40:17.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 20 add_watcher() i=3 2024-09-12T00:40:17.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 20 add_watcher() i=4 2024-09-12T00:40:17.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 20 add_watcher() i=5 2024-09-12T00:40:17.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 20 add_watcher() i=6 2024-09-12T00:40:17.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 20 add_watcher() i=7 2024-09-12T00:40:17.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.623+0000 7fcb22e379c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:17.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fc9d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:17.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fcb22e379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:17.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fcb22e379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:17.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fcb22e379c0 5 note: GC not initialized 2024-09-12T00:40:17.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fc9d5fe3640 20 reqs_thread_entry: start 2024-09-12T00:40:17.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fcb22e379c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:17.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fcb22e379c0 20 Filter name: none 2024-09-12T00:40:17.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fc9477fe640 20 reqs_thread_entry: start 2024-09-12T00:40:17.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.627+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:17.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:17.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:17.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:17.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:17.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.631+0000 7fcb22e379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:17.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.635+0000 7fc9d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:17.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.639+0000 7fcb22e379c0 20 remove_watcher() i=0 2024-09-12T00:40:17.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.639+0000 7fcb22e379c0 2 removed watcher, disabling cache 2024-09-12T00:40:17.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.639+0000 7fcb22e379c0 20 remove_watcher() i=1 2024-09-12T00:40:17.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.643+0000 7fcb22e379c0 20 remove_watcher() i=2 2024-09-12T00:40:17.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.643+0000 7fcb22e379c0 20 remove_watcher() i=3 2024-09-12T00:40:17.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.647+0000 7fcb22e379c0 20 remove_watcher() i=4 2024-09-12T00:40:17.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.647+0000 7fcb22e379c0 20 remove_watcher() i=5 2024-09-12T00:40:17.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.651+0000 7fcb22e379c0 20 remove_watcher() i=6 2024-09-12T00:40:17.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.651+0000 7fcb22e379c0 20 remove_watcher() i=7 2024-09-12T00:40:17.666 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:17.667 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:17.667 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-set-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:17.667 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:17.667 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:40:17.700 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:17.700 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:17.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.743+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 realm 2024-09-12T00:40:17.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:17.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:17.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:17.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.747+0000 7f82476cf9c0 20 searching for the correct realm 2024-09-12T00:40:17.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.755+0000 7f82459d6640 0 -- 172.21.15.137:0/1613342812 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f823c063040 msgr2=0x7f823c05b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:17.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.759+0000 7f82451d5640 0 -- 172.21.15.137:0/1613342812 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f824002e040 msgr2=0x7f824001f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:17.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:17.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:17.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:17.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:17.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:17.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:17.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 zone default found 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 4 Realm: () 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:17.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:17.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:17.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 zonegroup default 2024-09-12T00:40:17.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.767+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.771+0000 7f82476cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.771+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.771+0000 7f82476cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.771+0000 7f82476cf9c0 20 started sync module instance, tier type = 2024-09-12T00:40:17.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.771+0000 7f82476cf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:17.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.787+0000 7f82476cf9c0 20 add_watcher() i=0 2024-09-12T00:40:17.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.787+0000 7f82476cf9c0 20 add_watcher() i=1 2024-09-12T00:40:17.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.787+0000 7f82476cf9c0 20 add_watcher() i=2 2024-09-12T00:40:17.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.787+0000 7f82476cf9c0 20 add_watcher() i=3 2024-09-12T00:40:17.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.787+0000 7f82476cf9c0 20 add_watcher() i=4 2024-09-12T00:40:17.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.787+0000 7f82476cf9c0 20 add_watcher() i=5 2024-09-12T00:40:17.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.787+0000 7f82476cf9c0 20 add_watcher() i=6 2024-09-12T00:40:17.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.791+0000 7f82476cf9c0 20 add_watcher() i=7 2024-09-12T00:40:17.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.791+0000 7f82476cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:17.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f80fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 5 note: GC not initialized 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f80fafe5640 20 reqs_thread_entry: start 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 20 Filter name: none 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f80f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:40:17.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:17.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:40:17.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:40:17.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 : miss 2024-09-12T00:40:17.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:17.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 info.flags=0x17 2024-09-12T00:40:17.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 to cache LRU end 2024-09-12T00:40:17.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:17.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:17.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.795+0000 7f82476cf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 2024-09-12T00:40:17.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.799+0000 7f82476cf9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:40:17.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.799+0000 7f82476cf9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:40:17.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.807+0000 7f80fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:17.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.811+0000 7f82476cf9c0 20 remove_watcher() i=0 2024-09-12T00:40:17.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.811+0000 7f82476cf9c0 2 removed watcher, disabling cache 2024-09-12T00:40:17.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.811+0000 7f82476cf9c0 20 remove_watcher() i=1 2024-09-12T00:40:17.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.811+0000 7f82476cf9c0 20 remove_watcher() i=2 2024-09-12T00:40:17.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.815+0000 7f82476cf9c0 20 remove_watcher() i=3 2024-09-12T00:40:17.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.819+0000 7f82476cf9c0 20 remove_watcher() i=4 2024-09-12T00:40:17.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.819+0000 7f82476cf9c0 20 remove_watcher() i=5 2024-09-12T00:40:17.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.823+0000 7f82476cf9c0 20 remove_watcher() i=6 2024-09-12T00:40:17.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.823+0000 7f82476cf9c0 20 remove_watcher() i=7 2024-09-12T00:40:17.839 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:40:17.866 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:17.866 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:17.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.911+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.911+0000 7fbcc516b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.911+0000 7fbcc516b9c0 20 realm 2024-09-12T00:40:17.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.911+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:17.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:17.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:17.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:17.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:17.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.915+0000 7fbcc516b9c0 20 searching for the correct realm 2024-09-12T00:40:17.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.923+0000 7fbcc2c71640 0 -- 172.21.15.137:0/1795257083 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fbcb40f3610 msgr2=0x7fbcb40c86f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:17.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:17.927+0000 7fbcc2c71640 0 -- 172.21.15.137:0/1795257083 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55f8c8fc9bd0 msgr2=0x55f8c8fcbfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:18.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:18.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:18.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:18.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:18.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:18.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:18.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.139+0000 7fbcc516b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:18.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:18.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 zone default found 2024-09-12T00:40:18.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 4 Realm: () 2024-09-12T00:40:18.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:18.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:18.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:18.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 zonegroup default 2024-09-12T00:40:18.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 started sync module instance, tier type = 2024-09-12T00:40:18.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.143+0000 7fbcc516b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:18.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.167+0000 7fbcc516b9c0 20 add_watcher() i=0 2024-09-12T00:40:18.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.167+0000 7fbcc516b9c0 20 add_watcher() i=1 2024-09-12T00:40:18.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.167+0000 7fbcc516b9c0 20 add_watcher() i=2 2024-09-12T00:40:18.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.167+0000 7fbcc516b9c0 20 add_watcher() i=3 2024-09-12T00:40:18.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.167+0000 7fbcc516b9c0 20 add_watcher() i=4 2024-09-12T00:40:18.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.167+0000 7fbcc516b9c0 20 add_watcher() i=5 2024-09-12T00:40:18.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.167+0000 7fbcc516b9c0 20 add_watcher() i=6 2024-09-12T00:40:18.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.171+0000 7fbcc516b9c0 20 add_watcher() i=7 2024-09-12T00:40:18.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.171+0000 7fbcc516b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:18.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.171+0000 7fbb797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:18.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbcc516b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:18.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbcc516b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:18.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbcc516b9c0 5 note: GC not initialized 2024-09-12T00:40:18.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbaf3fff640 20 reqs_thread_entry: start 2024-09-12T00:40:18.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbcc516b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:18.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbcc516b9c0 20 Filter name: none 2024-09-12T00:40:18.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbaf1ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:18.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbcc516b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:18.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.175+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.179+0000 7fbcc516b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:18.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.179+0000 7fbcc516b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:18.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.179+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.179+0000 7fbcc516b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:18.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.179+0000 7fbcc516b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.179+0000 7fbcc516b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:18.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.179+0000 7fbcc516b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:18.181 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.183+0000 7fbb797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:18.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.187+0000 7fbcc516b9c0 20 remove_watcher() i=0 2024-09-12T00:40:18.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.187+0000 7fbcc516b9c0 2 removed watcher, disabling cache 2024-09-12T00:40:18.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.187+0000 7fbcc516b9c0 20 remove_watcher() i=1 2024-09-12T00:40:18.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.191+0000 7fbcc516b9c0 20 remove_watcher() i=2 2024-09-12T00:40:18.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.195+0000 7fbcc516b9c0 20 remove_watcher() i=3 2024-09-12T00:40:18.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.195+0000 7fbcc516b9c0 20 remove_watcher() i=4 2024-09-12T00:40:18.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.199+0000 7fbcc516b9c0 20 remove_watcher() i=5 2024-09-12T00:40:18.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.199+0000 7fbcc516b9c0 20 remove_watcher() i=6 2024-09-12T00:40:18.203 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.203+0000 7fbcc516b9c0 20 remove_watcher() i=7 2024-09-12T00:40:18.222 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:18.222 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:18.222 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-set-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:18.222 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:18.223 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.223 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.235 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.235 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.278 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:18.314 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:18.314 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:18.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.359+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.359+0000 7f0e14e679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.359+0000 7f0e14e679c0 20 realm 2024-09-12T00:40:18.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.359+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.359+0000 7f0e14e679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.359+0000 7f0e14e679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:18.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.359+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.363+0000 7f0e14e679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.363+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.363+0000 7f0e14e679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:18.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.363+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.363+0000 7f0e14e679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:18.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.363+0000 7f0e14e679c0 20 searching for the correct realm 2024-09-12T00:40:18.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.367+0000 7f0e1316e640 0 -- 172.21.15.137:0/2800161703 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f0e0805ec20 msgr2=0x7f0e0805c5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:18.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.375+0000 7f0e1296d640 0 -- 172.21.15.137:0/2800161703 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f0e0c0fa3a0 msgr2=0x7f0e0c0f8e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:18.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:18.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:18.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:18.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:18.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:18.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:18.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:18.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:18.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 zone default found 2024-09-12T00:40:18.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 4 Realm: () 2024-09-12T00:40:18.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:18.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:18.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:18.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 zonegroup default 2024-09-12T00:40:18.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 started sync module instance, tier type = 2024-09-12T00:40:18.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.383+0000 7f0e14e679c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:18.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.403+0000 7f0e14e679c0 20 add_watcher() i=0 2024-09-12T00:40:18.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.403+0000 7f0e14e679c0 20 add_watcher() i=1 2024-09-12T00:40:18.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.403+0000 7f0e14e679c0 20 add_watcher() i=2 2024-09-12T00:40:18.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.403+0000 7f0e14e679c0 20 add_watcher() i=3 2024-09-12T00:40:18.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.403+0000 7f0e14e679c0 20 add_watcher() i=4 2024-09-12T00:40:18.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.403+0000 7f0e14e679c0 20 add_watcher() i=5 2024-09-12T00:40:18.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.403+0000 7f0e14e679c0 20 add_watcher() i=6 2024-09-12T00:40:18.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.407+0000 7f0e14e679c0 20 add_watcher() i=7 2024-09-12T00:40:18.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.407+0000 7f0e14e679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:18.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0cc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:18.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:18.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:18.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 5 note: GC not initialized 2024-09-12T00:40:18.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0c43fff640 20 reqs_thread_entry: start 2024-09-12T00:40:18.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 20 Filter name: none 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0c41ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 : miss 2024-09-12T00:40:18.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:18.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 info.flags=0x17 2024-09-12T00:40:18.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 to cache LRU end 2024-09-12T00:40:18.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:18.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:18.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.411+0000 7f0e14e679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0e14e679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 info.flags=0x17 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0e14e679c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 to cache LRU end 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0e14e679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0e14e679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22, ofs0, ns] 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0cf67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366228 cookie 94506135239040 notifier 6221 bl.length()=925 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0cf67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 info.flags=0x17 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0cf67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 to cache LRU end 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0cf67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:18.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): orig_sources= new_sources= 2024-09-12T00:40:18.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): potential sources added=[] removed=[] 2024-09-12T00:40:18.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): orig_dests= new_dests= 2024-09-12T00:40:18.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.419+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): potential dests added=[] removed=[] 2024-09-12T00:40:18.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.423+0000 7f0e14e679c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22.1.0 2024-09-12T00:40:18.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.423+0000 7f0e14e679c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22.1.0 2024-09-12T00:40:18.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.423+0000 7f0e14e679c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22.1.1 2024-09-12T00:40:18.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.423+0000 7f0e14e679c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22.1.1 2024-09-12T00:40:18.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.423+0000 7f0e14e679c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22.0 2024-09-12T00:40:18.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.427+0000 7f0e14e679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:18.427 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.427+0000 7f0e14e679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 info.flags=0x17 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 to cache LRU end 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22, ofs0, ns] 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0cf67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366229 cookie 94506135239040 notifier 6221 bl.length()=925 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0cf67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 info.flags=0x17 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0cf67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 to cache LRU end 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0cf67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:18.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): orig_sources= new_sources= 2024-09-12T00:40:18.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): potential sources added=[] removed=[] 2024-09-12T00:40:18.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): orig_dests= new_dests= 2024-09-12T00:40:18.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): potential dests added=[] removed=[] 2024-09-12T00:40:18.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.431+0000 7f0e14e679c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22.0 2024-09-12T00:40:18.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:18.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 2024-09-12T00:40:18.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 info.flags=0x17 2024-09-12T00:40:18.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 to cache LRU end 2024-09-12T00:40:18.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:18.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22, ofs0, ns] 2024-09-12T00:40:18.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0cf5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366230 cookie 94506135239040 notifier 6221 bl.length()=893 2024-09-12T00:40:18.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0cf5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 info.flags=0x17 2024-09-12T00:40:18.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0cf5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 to cache LRU end 2024-09-12T00:40:18.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0cf5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:18.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): orig_sources= new_sources= 2024-09-12T00:40:18.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): potential sources added=[] removed=[] 2024-09-12T00:40:18.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): orig_dests= new_dests= 2024-09-12T00:40:18.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.435+0000 7f0e14e679c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22]): potential dests added=[] removed=[] 2024-09-12T00:40:18.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.439+0000 7f0e14e679c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:40:18.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.439+0000 7f0cc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:18.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.443+0000 7f0e14e679c0 20 remove_watcher() i=0 2024-09-12T00:40:18.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.443+0000 7f0e14e679c0 2 removed watcher, disabling cache 2024-09-12T00:40:18.446 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.447+0000 7f0e14e679c0 20 remove_watcher() i=1 2024-09-12T00:40:18.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.447+0000 7f0e14e679c0 20 remove_watcher() i=2 2024-09-12T00:40:18.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.451+0000 7f0e14e679c0 20 remove_watcher() i=3 2024-09-12T00:40:18.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.455+0000 7f0e14e679c0 20 remove_watcher() i=4 2024-09-12T00:40:18.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.455+0000 7f0e14e679c0 20 remove_watcher() i=5 2024-09-12T00:40:18.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.459+0000 7f0e14e679c0 20 remove_watcher() i=6 2024-09-12T00:40:18.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.459+0000 7f0e14e679c0 20 remove_watcher() i=7 2024-09-12T00:40:18.474 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:40:18.503 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:18.503 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:18.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.547+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.547+0000 7f0a277fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.547+0000 7f0a277fb9c0 20 realm 2024-09-12T00:40:18.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.547+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:18.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:18.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:18.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.551+0000 7f0a277fb9c0 20 searching for the correct realm 2024-09-12T00:40:18.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.555+0000 7f0a25b02640 0 -- 172.21.15.137:0/2891140015 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f0a10016040 msgr2=0x7f0a10035400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:18.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.563+0000 7f0a25301640 0 -- 172.21.15.137:0/2891140015 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f0a200e1040 msgr2=0x7f0a200e2940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:18.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:18.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:18.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:18.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:18.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:18.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:18.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:18.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:18.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 zone default found 2024-09-12T00:40:18.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 4 Realm: () 2024-09-12T00:40:18.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:18.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:18.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:18.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 zonegroup default 2024-09-12T00:40:18.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:18.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 started sync module instance, tier type = 2024-09-12T00:40:18.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.571+0000 7f0a277fb9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.591+0000 7f0a277fb9c0 20 add_watcher() i=0 2024-09-12T00:40:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.591+0000 7f0a277fb9c0 20 add_watcher() i=1 2024-09-12T00:40:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.591+0000 7f0a277fb9c0 20 add_watcher() i=2 2024-09-12T00:40:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.591+0000 7f0a277fb9c0 20 add_watcher() i=3 2024-09-12T00:40:18.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.591+0000 7f0a277fb9c0 20 add_watcher() i=4 2024-09-12T00:40:18.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.591+0000 7f0a277fb9c0 20 add_watcher() i=5 2024-09-12T00:40:18.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.591+0000 7f0a277fb9c0 20 add_watcher() i=6 2024-09-12T00:40:18.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.595+0000 7f0a277fb9c0 20 add_watcher() i=7 2024-09-12T00:40:18.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.595+0000 7f0a277fb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:18.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.595+0000 7f08db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:18.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.595+0000 7f0a277fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:18.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.595+0000 7f0a277fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:18.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.595+0000 7f0a277fb9c0 5 note: GC not initialized 2024-09-12T00:40:18.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f08da7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:18.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:18.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 Filter name: none 2024-09-12T00:40:18.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f084bfff640 20 reqs_thread_entry: start 2024-09-12T00:40:18.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:18.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:18.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:18.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:18.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:18.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:18.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.599+0000 7f0a277fb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:18.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.603+0000 7f08db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:18.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.607+0000 7f0a277fb9c0 20 remove_watcher() i=0 2024-09-12T00:40:18.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.607+0000 7f0a277fb9c0 2 removed watcher, disabling cache 2024-09-12T00:40:18.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.607+0000 7f0a277fb9c0 20 remove_watcher() i=1 2024-09-12T00:40:18.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.611+0000 7f0a277fb9c0 20 remove_watcher() i=2 2024-09-12T00:40:18.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.611+0000 7f0a277fb9c0 20 remove_watcher() i=3 2024-09-12T00:40:18.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.615+0000 7f0a277fb9c0 20 remove_watcher() i=4 2024-09-12T00:40:18.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.615+0000 7f0a277fb9c0 20 remove_watcher() i=5 2024-09-12T00:40:18.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.619+0000 7f0a277fb9c0 20 remove_watcher() i=6 2024-09-12T00:40:18.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:18.623+0000 7f0a277fb9c0 20 remove_watcher() i=7 2024-09-12T00:40:18.635 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:18.635 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:18.635 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-set-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:40:18.635 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:18.636 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.636 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.639 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.640 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.686 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.687 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.707 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:40:18.707 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:18.708 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.708 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.721 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.721 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.771 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.771 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.792 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.792 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.811 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.812 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.831 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.831 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.850 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.850 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.870 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.870 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.889 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.889 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.908 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.908 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.928 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.928 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.949 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.949 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.969 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.969 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:18.989 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:18.989 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.009 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.010 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.029 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.029 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.047 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.048 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.067 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.067 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.086 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.087 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.106 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.107 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.128 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.128 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.149 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.149 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.167 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:40:19.199 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:19.199 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:19.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.243+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 realm 2024-09-12T00:40:19.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:19.247 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:19.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:19.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.247+0000 7fc6a66cf9c0 20 searching for the correct realm 2024-09-12T00:40:19.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.255+0000 7fc6a39d4640 0 -- 172.21.15.137:0/3178320571 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fc698084a30 msgr2=0x7fc6980881e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:19.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.259+0000 7fc6a49d6640 0 -- 172.21.15.137:0/3178320571 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x559ae04b3a10 msgr2=0x559ae04b5e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:19.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:19.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:19.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:19.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:19.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:19.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:19.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:19.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.267+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:19.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 zone default found 2024-09-12T00:40:19.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 4 Realm: () 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 zonegroup default 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 started sync module instance, tier type = 2024-09-12T00:40:19.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.271+0000 7fc6a66cf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:19.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.287+0000 7fc6a66cf9c0 20 add_watcher() i=0 2024-09-12T00:40:19.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.287+0000 7fc6a66cf9c0 20 add_watcher() i=1 2024-09-12T00:40:19.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.287+0000 7fc6a66cf9c0 20 add_watcher() i=2 2024-09-12T00:40:19.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.287+0000 7fc6a66cf9c0 20 add_watcher() i=3 2024-09-12T00:40:19.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.287+0000 7fc6a66cf9c0 20 add_watcher() i=4 2024-09-12T00:40:19.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.287+0000 7fc6a66cf9c0 20 add_watcher() i=5 2024-09-12T00:40:19.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.291+0000 7fc6a66cf9c0 20 add_watcher() i=6 2024-09-12T00:40:19.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.291+0000 7fc6a66cf9c0 20 add_watcher() i=7 2024-09-12T00:40:19.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.291+0000 7fc6a66cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:19.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc55a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:19.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc6a66cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:19.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc6a66cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:19.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc6a66cf9c0 5 note: GC not initialized 2024-09-12T00:40:19.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc5597e2640 20 reqs_thread_entry: start 2024-09-12T00:40:19.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc6a66cf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:19.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc6a66cf9c0 20 Filter name: none 2024-09-12T00:40:19.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc4caffd640 20 reqs_thread_entry: start 2024-09-12T00:40:19.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.295+0000 7fc6a66cf9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:19.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.299+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.299+0000 7fc6a66cf9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:19.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.299+0000 7fc6a66cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:19.298 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.299+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.299+0000 7fc6a66cf9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:19.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.299+0000 7fc6a66cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.299+0000 7fc6a66cf9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:19.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.299+0000 7fc6a66cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:19.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.303+0000 7fc55a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:19.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.307+0000 7fc6a66cf9c0 20 remove_watcher() i=0 2024-09-12T00:40:19.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.307+0000 7fc6a66cf9c0 2 removed watcher, disabling cache 2024-09-12T00:40:19.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.307+0000 7fc6a66cf9c0 20 remove_watcher() i=1 2024-09-12T00:40:19.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.311+0000 7fc6a66cf9c0 20 remove_watcher() i=2 2024-09-12T00:40:19.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.311+0000 7fc6a66cf9c0 20 remove_watcher() i=3 2024-09-12T00:40:19.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.315+0000 7fc6a66cf9c0 20 remove_watcher() i=4 2024-09-12T00:40:19.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.319+0000 7fc6a66cf9c0 20 remove_watcher() i=5 2024-09-12T00:40:19.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.319+0000 7fc6a66cf9c0 20 remove_watcher() i=6 2024-09-12T00:40:19.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.323+0000 7fc6a66cf9c0 20 remove_watcher() i=7 2024-09-12T00:40:19.336 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:19.337 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:19.337 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-set-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:19.337 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:19.337 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:40:19.371 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:19.371 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:19.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 20 realm 2024-09-12T00:40:19.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:19.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.415+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.419+0000 7fab14fe69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:19.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.419+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.419+0000 7fab14fe69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:19.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.419+0000 7fab14fe69c0 20 searching for the correct realm 2024-09-12T00:40:19.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.423+0000 7fab132ed640 0 -- 172.21.15.137:0/2018175962 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55da4a19aac0 msgr2=0x55da4a19ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:19.429 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.431+0000 7fab122eb640 0 -- 172.21.15.137:0/2018175962 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x55da4a1a3eb0 msgr2=0x55da4a1a6370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:19.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:19.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:19.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:19.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:19.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:19.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:19.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:19.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:19.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 zone default found 2024-09-12T00:40:19.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 4 Realm: () 2024-09-12T00:40:19.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:19.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:19.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:19.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 zonegroup default 2024-09-12T00:40:19.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.435+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.439+0000 7fab14fe69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.439+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.439+0000 7fab14fe69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.439+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.439+0000 7fab14fe69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.439+0000 7fab14fe69c0 20 started sync module instance, tier type = 2024-09-12T00:40:19.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.439+0000 7fab14fe69c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:19.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.455+0000 7fab14fe69c0 20 add_watcher() i=0 2024-09-12T00:40:19.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.455+0000 7fab14fe69c0 20 add_watcher() i=1 2024-09-12T00:40:19.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.455+0000 7fab14fe69c0 20 add_watcher() i=2 2024-09-12T00:40:19.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.455+0000 7fab14fe69c0 20 add_watcher() i=3 2024-09-12T00:40:19.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.455+0000 7fab14fe69c0 20 add_watcher() i=4 2024-09-12T00:40:19.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.455+0000 7fab14fe69c0 20 add_watcher() i=5 2024-09-12T00:40:19.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.455+0000 7fab14fe69c0 20 add_watcher() i=6 2024-09-12T00:40:19.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.459+0000 7fab14fe69c0 20 add_watcher() i=7 2024-09-12T00:40:19.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.459+0000 7fab14fe69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:19.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fa9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:19.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:19.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:19.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 5 note: GC not initialized 2024-09-12T00:40:19.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fa943fff640 20 reqs_thread_entry: start 2024-09-12T00:40:19.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:19.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 20 Filter name: none 2024-09-12T00:40:19.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fa941ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:19.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:40:19.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:19.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:40:19.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:40:19.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 : miss 2024-09-12T00:40:19.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:19.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 info.flags=0x17 2024-09-12T00:40:19.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 to cache LRU end 2024-09-12T00:40:19.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:19.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:19.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.463+0000 7fab14fe69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 2024-09-12T00:40:19.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fab14fe69c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:40:19.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fab14fe69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 info.flags=0x17 2024-09-12T00:40:19.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fab14fe69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 to cache LRU end 2024-09-12T00:40:19.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fab14fe69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:19.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fab14fe69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23, ofs0, ns] 2024-09-12T00:40:19.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fa9f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94396034431920 notifier 6540 bl.length()=925 2024-09-12T00:40:19.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fa9f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 info.flags=0x17 2024-09-12T00:40:19.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fa9f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 to cache LRU end 2024-09-12T00:40:19.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.471+0000 7fa9f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:19.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.475+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): orig_sources= new_sources= 2024-09-12T00:40:19.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.475+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): potential sources added=[] removed=[] 2024-09-12T00:40:19.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.475+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): orig_dests= new_dests= 2024-09-12T00:40:19.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.475+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): potential dests added=[] removed=[] 2024-09-12T00:40:19.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.479+0000 7fab14fe69c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23.1.0 2024-09-12T00:40:19.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.479+0000 7fab14fe69c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23.1.0 2024-09-12T00:40:19.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.479+0000 7fab14fe69c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23.1.1 2024-09-12T00:40:19.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.479+0000 7fab14fe69c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23.1.1 2024-09-12T00:40:19.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.479+0000 7fab14fe69c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23.0 2024-09-12T00:40:19.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.483+0000 7fab14fe69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:19.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.483+0000 7fab14fe69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 2024-09-12T00:40:19.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fab14fe69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 info.flags=0x17 2024-09-12T00:40:19.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fab14fe69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 to cache LRU end 2024-09-12T00:40:19.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fab14fe69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:19.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fab14fe69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23, ofs0, ns] 2024-09-12T00:40:19.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fa9f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366234 cookie 94396034431920 notifier 6540 bl.length()=925 2024-09-12T00:40:19.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fa9f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 info.flags=0x17 2024-09-12T00:40:19.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fa9f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 to cache LRU end 2024-09-12T00:40:19.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fa9f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:19.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): orig_sources= new_sources= 2024-09-12T00:40:19.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): potential sources added=[] removed=[] 2024-09-12T00:40:19.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): orig_dests= new_dests= 2024-09-12T00:40:19.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.487+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): potential dests added=[] removed=[] 2024-09-12T00:40:19.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.491+0000 7fab14fe69c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23.0 2024-09-12T00:40:19.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.491+0000 7fab14fe69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:19.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.491+0000 7fab14fe69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 2024-09-12T00:40:19.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fab14fe69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 info.flags=0x17 2024-09-12T00:40:19.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fab14fe69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 to cache LRU end 2024-09-12T00:40:19.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fab14fe69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:19.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fab14fe69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23, ofs0, ns] 2024-09-12T00:40:19.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fa9f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366235 cookie 94396034431920 notifier 6540 bl.length()=893 2024-09-12T00:40:19.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fa9f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 info.flags=0x17 2024-09-12T00:40:19.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fa9f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 to cache LRU end 2024-09-12T00:40:19.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fa9f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:19.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): orig_sources= new_sources= 2024-09-12T00:40:19.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): potential sources added=[] removed=[] 2024-09-12T00:40:19.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): orig_dests= new_dests= 2024-09-12T00:40:19.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.495+0000 7fab14fe69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23]): potential dests added=[] removed=[] 2024-09-12T00:40:19.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.499+0000 7fab14fe69c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:40:19.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.503+0000 7fa9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:19.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.507+0000 7fab14fe69c0 20 remove_watcher() i=0 2024-09-12T00:40:19.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.507+0000 7fab14fe69c0 2 removed watcher, disabling cache 2024-09-12T00:40:19.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.507+0000 7fab14fe69c0 20 remove_watcher() i=1 2024-09-12T00:40:19.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.511+0000 7fab14fe69c0 20 remove_watcher() i=2 2024-09-12T00:40:19.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.511+0000 7fab14fe69c0 20 remove_watcher() i=3 2024-09-12T00:40:19.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.515+0000 7fab14fe69c0 20 remove_watcher() i=4 2024-09-12T00:40:19.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.515+0000 7fab14fe69c0 20 remove_watcher() i=5 2024-09-12T00:40:19.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.519+0000 7fab14fe69c0 20 remove_watcher() i=6 2024-09-12T00:40:19.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.519+0000 7fab14fe69c0 20 remove_watcher() i=7 2024-09-12T00:40:19.535 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:40:19.562 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:19.562 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:19.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.607+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.607+0000 7f0c45dd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.607+0000 7f0c45dd29c0 20 realm 2024-09-12T00:40:19.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.607+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:19.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:19.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:19.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.611+0000 7f0c45dd29c0 20 searching for the correct realm 2024-09-12T00:40:19.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.619+0000 7f0c440d9640 0 -- 172.21.15.137:0/3900889038 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f0c380c0eb0 msgr2=0x7f0c380093d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:19.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.623+0000 7f0c438d8640 0 -- 172.21.15.137:0/3900889038 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f0c3c037040 msgr2=0x7f0c3c0089f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:19.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:19.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:19.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:19.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 zone default found 2024-09-12T00:40:19.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 4 Realm: () 2024-09-12T00:40:19.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:19.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:19.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:19.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 zonegroup default 2024-09-12T00:40:19.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:19.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 started sync module instance, tier type = 2024-09-12T00:40:19.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.631+0000 7f0c45dd29c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.651+0000 7f0c45dd29c0 20 add_watcher() i=0 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.651+0000 7f0c45dd29c0 20 add_watcher() i=1 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.651+0000 7f0c45dd29c0 20 add_watcher() i=2 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.651+0000 7f0c45dd29c0 20 add_watcher() i=3 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.651+0000 7f0c45dd29c0 20 add_watcher() i=4 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.651+0000 7f0c45dd29c0 20 add_watcher() i=5 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.651+0000 7f0c45dd29c0 20 add_watcher() i=6 2024-09-12T00:40:19.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.655+0000 7f0c45dd29c0 20 add_watcher() i=7 2024-09-12T00:40:19.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.655+0000 7f0c45dd29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:19.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0af9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:19.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:19.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:19.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 5 note: GC not initialized 2024-09-12T00:40:19.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0af8fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:19.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:19.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 Filter name: none 2024-09-12T00:40:19.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0a727fc640 20 reqs_thread_entry: start 2024-09-12T00:40:19.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:19.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:19.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:19.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.659+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.663+0000 7f0c45dd29c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:19.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.663+0000 7f0c45dd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:19.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.663+0000 7f0c45dd29c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:19.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.663+0000 7f0c45dd29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:19.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.663+0000 7f0af9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:19.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.667+0000 7f0c45dd29c0 20 remove_watcher() i=0 2024-09-12T00:40:19.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.667+0000 7f0c45dd29c0 2 removed watcher, disabling cache 2024-09-12T00:40:19.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.671+0000 7f0c45dd29c0 20 remove_watcher() i=1 2024-09-12T00:40:19.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.671+0000 7f0c45dd29c0 20 remove_watcher() i=2 2024-09-12T00:40:19.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.675+0000 7f0c45dd29c0 20 remove_watcher() i=3 2024-09-12T00:40:19.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.675+0000 7f0c45dd29c0 20 remove_watcher() i=4 2024-09-12T00:40:19.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.679+0000 7f0c45dd29c0 20 remove_watcher() i=5 2024-09-12T00:40:19.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.679+0000 7f0c45dd29c0 20 remove_watcher() i=6 2024-09-12T00:40:19.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:19.683+0000 7f0c45dd29c0 20 remove_watcher() i=7 2024-09-12T00:40:19.697 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:19.697 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:19.697 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-set-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:40:19.697 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:19.698 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.698 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.701 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.701 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.751 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.751 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.775 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:40:19.775 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:19.776 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.776 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.792 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.792 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.841 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.841 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.862 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.862 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.882 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.882 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.903 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.903 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.923 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.924 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.945 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.945 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.968 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.968 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:19.988 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:19.988 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.006 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.007 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.025 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.025 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.044 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.044 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.064 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.064 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.083 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.084 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.103 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.103 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.126 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.126 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.149 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.149 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.169 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.169 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.190 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.191 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.211 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.211 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.231 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:20.231 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:20.249 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:40:20.282 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:20.282 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:20.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.327+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.327+0000 7f12389509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.327+0000 7f12389509c0 20 realm 2024-09-12T00:40:20.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.327+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:20.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:20.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.331+0000 7f12389509c0 20 searching for the correct realm 2024-09-12T00:40:20.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.339+0000 7f1235c55640 0 -- 172.21.15.137:0/2224106367 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f122c068310 msgr2=0x7f122c069950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:20.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.343+0000 7f1236c57640 0 -- 172.21.15.137:0/2224106367 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x560b1e9afa60 msgr2=0x560b1e9b1e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:20.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:20.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:20.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:20.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:20.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:20.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:20.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:20.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 zone default found 2024-09-12T00:40:20.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 4 Realm: () 2024-09-12T00:40:20.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:20.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:20.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:20.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 zonegroup default 2024-09-12T00:40:20.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 started sync module instance, tier type = 2024-09-12T00:40:20.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.351+0000 7f12389509c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:20.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.371+0000 7f12389509c0 20 add_watcher() i=0 2024-09-12T00:40:20.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.371+0000 7f12389509c0 20 add_watcher() i=1 2024-09-12T00:40:20.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.371+0000 7f12389509c0 20 add_watcher() i=2 2024-09-12T00:40:20.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.371+0000 7f12389509c0 20 add_watcher() i=3 2024-09-12T00:40:20.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.371+0000 7f12389509c0 20 add_watcher() i=4 2024-09-12T00:40:20.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.371+0000 7f12389509c0 20 add_watcher() i=5 2024-09-12T00:40:20.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.371+0000 7f12389509c0 20 add_watcher() i=6 2024-09-12T00:40:20.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.375+0000 7f12389509c0 20 add_watcher() i=7 2024-09-12T00:40:20.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.375+0000 7f12389509c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:20.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f10ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:20.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:20.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:20.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 5 note: GC not initialized 2024-09-12T00:40:20.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f10677fe640 20 reqs_thread_entry: start 2024-09-12T00:40:20.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:20.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 Filter name: none 2024-09-12T00:40:20.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f10657fa640 20 reqs_thread_entry: start 2024-09-12T00:40:20.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:20.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:20.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:20.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:20.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:20.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.379+0000 7f12389509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:20.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.383+0000 7f10ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:20.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.387+0000 7f12389509c0 20 remove_watcher() i=0 2024-09-12T00:40:20.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.387+0000 7f12389509c0 2 removed watcher, disabling cache 2024-09-12T00:40:20.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.387+0000 7f12389509c0 20 remove_watcher() i=1 2024-09-12T00:40:20.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.391+0000 7f12389509c0 20 remove_watcher() i=2 2024-09-12T00:40:20.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.395+0000 7f12389509c0 20 remove_watcher() i=3 2024-09-12T00:40:20.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.395+0000 7f12389509c0 20 remove_watcher() i=4 2024-09-12T00:40:20.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.399+0000 7f12389509c0 20 remove_watcher() i=5 2024-09-12T00:40:20.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.399+0000 7f12389509c0 20 remove_watcher() i=6 2024-09-12T00:40:20.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.403+0000 7f12389509c0 20 remove_watcher() i=7 2024-09-12T00:40:20.417 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.417 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:20.417 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-set-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:20.417 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.417 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:40:20.450 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:20.450 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:20.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 realm 2024-09-12T00:40:20.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:20.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:20.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 searching for the correct realm 2024-09-12T00:40:20.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.503+0000 7f195cb54640 0 -- 172.21.15.137:0/2093158788 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f1954008040 msgr2=0x7f195407d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:20.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.511+0000 7f195d355640 0 -- 172.21.15.137:0/2093158788 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1958020040 msgr2=0x7f1958002ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:20.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:20.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:20.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:20.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:20.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:20.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:20.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:20.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 zone default found 2024-09-12T00:40:20.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 Realm: () 2024-09-12T00:40:20.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:20.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:20.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:20.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 zonegroup default 2024-09-12T00:40:20.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 started sync module instance, tier type = 2024-09-12T00:40:20.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=0 2024-09-12T00:40:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=1 2024-09-12T00:40:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=2 2024-09-12T00:40:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=3 2024-09-12T00:40:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=4 2024-09-12T00:40:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=5 2024-09-12T00:40:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=6 2024-09-12T00:40:20.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.543+0000 7f195f84f9c0 20 add_watcher() i=7 2024-09-12T00:40:20.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.543+0000 7f195f84f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:20.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f18137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 note: GC not initialized 2024-09-12T00:40:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f18127e4640 20 reqs_thread_entry: start 2024-09-12T00:40:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 Filter name: none 2024-09-12T00:40:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f1783fff640 20 reqs_thread_entry: start 2024-09-12T00:40:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:40:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 : miss 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 2024-09-12T00:40:20.554 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f195f84f9c0 time 2024-09-12T00:40:20.559706+0000 2024-09-12T00:40:20.554 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:20.555 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:20.555 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f19631292eb] 2024-09-12T00:40:20.555 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f196312949f] 2024-09-12T00:40:20.555 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c4f8ecc1] 2024-09-12T00:40:20.555 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422078) [0x55a4c59ec078] 2024-09-12T00:40:20.555 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c4fa3ced] 2024-09-12T00:40:20.555 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1961f8fd90] 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f195f84f9c0 thread_name:radosgw-admin 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.555+0000 7f195f84f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f195f84f9c0 time 2024-09-12T00:40:20.559706+0000 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:20.556 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f19631292eb] 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f196312949f] 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c4f8ecc1] 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422078) [0x55a4c59ec078] 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c4fa3ced] 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1961f8fd90] 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:40:20.557 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.578 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:20.578 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1961fa8520] 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1963129345] 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f196312949f] 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c4f8ecc1] 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422078) [0x55a4c59ec078] 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c4fa3ced] 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1961f8fd90] 2024-09-12T00:40:20.579 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.555+0000 7f195f84f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f195f84f9c0 thread_name:radosgw-admin 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1961fa8520] 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1963129345] 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f196312949f] 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c4f8ecc1] 2024-09-12T00:40:20.580 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422078) [0x55a4c59ec078] 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c4fa3ced] 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1961f8fd90] 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:40:20.471+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.606350s 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c769bb90 auth_method 0 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.581 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): get_auth_request con 0x55a4c76bd110 auth_method 0 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): handle_auth_done global_id 6308 payload 274 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:40:20.471+0000 7f195d355640 1 monclient: found mon.noname-c 2024-09-12T00:40:20.582 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: dump: 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.583 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:40:20.471+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6308 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:40:20.471+0000 7f195f84f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:40:20.471+0000 7f195f84f9c0 4 set_mon_vals no callback set 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:20.584 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: dump: 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.585 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.586 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.586 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: shutdown 2024-09-12T00:40:20.586 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) unregister_commands rotate-key 2024-09-12T00:40:20.586 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:20.586 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:20.586 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: monmap: 2024-09-12T00:40:20.586 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:20.587 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:20.587 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:20.587 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:20.587 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:20.587 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.587 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:20.588 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:20.588 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:20.588 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.588 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding auth protocol: cephx 2024-09-12T00:40:20.588 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding auth protocol: cephx 2024-09-12T00:40:20.588 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding auth protocol: cephx 2024-09-12T00:40:20.589 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.589 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.589 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.589 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.589 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.589 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.589 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.590 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.590 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.590 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.590 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.590 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.590 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.590 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: starting msgr at 2024-09-12T00:40:20.590 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: starting objecter 2024-09-12T00:40:20.591 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command objecter_requests hook 0x55a4c75aacf0 2024-09-12T00:40:20.591 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: setting wanted keys 2024-09-12T00:40:20.591 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: calling monclient init 2024-09-12T00:40:20.591 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: init 2024-09-12T00:40:20.591 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding auth protocol: cephx 2024-09-12T00:40:20.591 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding auth protocol: cephx 2024-09-12T00:40:20.591 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding auth protocol: cephx 2024-09-12T00:40:20.591 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.592 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.592 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.592 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.592 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.592 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.592 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.592 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.592 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.593 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.593 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.593 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.593 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.593 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.593 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command rotate-key hook 0x55a4c780e528 2024-09-12T00:40:20.593 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:20.593 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:40:20.594 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c769bb90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:20.594 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c76bd110 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:20.594 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c76bda60 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:20.594 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.594 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.595 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.595 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:20.595 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.609372s 2024-09-12T00:40:20.595 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c769bb90 auth_method 0 2024-09-12T00:40:20.595 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.595 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.595 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): get_auth_request con 0x55a4c76bda60 auth_method 0 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.596 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): handle_auth_done global_id 6311 payload 824 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:40:20.475+0000 7f195d355640 1 monclient: found mon.noname-c 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: dump: 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.597 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: dump: 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.598 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6311 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:40:20.475+0000 7f184b606640 4 set_mon_vals no callback set 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.599 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: init done 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:40:20.479+0000 7f1849e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:40:20.479+0000 7f1849e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:40:20.479+0000 7f1849e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:40:20.479+0000 7f195cb54640 10 monclient: get_auth_request con 0x7f1844070ae0 auth_method 0 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:40:20.479+0000 7f195db56640 10 monclient: get_auth_request con 0x55a4c7835e40 auth_method 0 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:40:20.479+0000 7f195d355640 10 monclient: get_auth_request con 0x55a4c7858ed0 auth_method 0 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient: get_auth_request con 0x55a4c785c5c0 auth_method 0 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: monmap: 2024-09-12T00:40:20.600 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding auth protocol: cephx 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding auth protocol: cephx 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding auth protocol: cephx 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.601 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a4c78653b0 EEXIST 2024-09-12T00:40:20.602 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: init 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding auth protocol: cephx 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding auth protocol: cephx 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding auth protocol: cephx 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.603 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command rotate-key cmddesc rotate-key hook 0x55a4c7860a40 EEXIST 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c7889560 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c7888e90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:20.604 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c7887870 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.619134s 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c7889560 auth_method 0 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.605 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): get_auth_request con 0x55a4c7888e90 auth_method 0 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): handle_auth_done global_id 6585 payload 824 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.606 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:40:20.483+0000 7f195d355640 1 monclient: found mon.noname-a 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: dump: 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.607 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: dump: 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.608 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6585 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:40:20.483+0000 7f195e357640 4 set_mon_vals no callback set 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:40:20.487+0000 7f1842ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:20.609 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:40:20.487+0000 7f1842ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:40:20.487+0000 7f1842ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:40:20.487+0000 7f195cb54640 10 monclient: get_auth_request con 0x7f1838070a20 auth_method 0 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: monmap: 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:20.610 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding auth protocol: cephx 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding auth protocol: cephx 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding auth protocol: cephx 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.611 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: init 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding auth protocol: cephx 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding auth protocol: cephx 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding auth protocol: cephx 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.612 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe86e34a58 EEXIST 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c78dcf50 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c78acac0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:20.613 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c78cd9d0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.623371s 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c78dcf50 auth_method 0 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): get_auth_request con 0x55a4c78cd9d0 auth_method 0 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.614 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): handle_auth_done global_id 6317 payload 274 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:40:20.487+0000 7f195d355640 1 monclient: found mon.noname-c 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:20.615 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: dump: 2024-09-12T00:40:20.616 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.616 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.616 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.616 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.616 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.616 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.616 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.616 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6317 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 4 set_mon_vals no callback set 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:20.617 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: dump: 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.618 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: shutdown 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: monmap: 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:20.619 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding auth protocol: cephx 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding auth protocol: cephx 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding auth protocol: cephx 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.620 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: starting msgr at 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: starting objecter 2024-09-12T00:40:20.621 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a4c78cfe80 EEXIST 2024-09-12T00:40:20.622 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: setting wanted keys 2024-09-12T00:40:20.622 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: calling monclient init 2024-09-12T00:40:20.622 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: init 2024-09-12T00:40:20.622 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding auth protocol: cephx 2024-09-12T00:40:20.622 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding auth protocol: cephx 2024-09-12T00:40:20.622 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding auth protocol: cephx 2024-09-12T00:40:20.622 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.622 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command rotate-key cmddesc rotate-key hook 0x55a4c788b4c8 EEXIST 2024-09-12T00:40:20.623 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c78acac0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c78cd9d0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c78dcf50 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.625952s 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): get_auth_request con 0x55a4c78cd9d0 auth_method 0 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.624 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): get_auth_request con 0x55a4c78dcf50 auth_method 0 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:40:20.491+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c78acac0 auth_method 0 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:40:20.491+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.625 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:40:20.491+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:40:20.491+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): handle_auth_done global_id 6320 payload 824 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:40:20.491+0000 7f195cb54640 1 monclient: found mon.noname-c 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: dump: 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.626 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:20.627 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: dump: 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.628 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6320 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:40:20.491+0000 7f1840ff9640 4 set_mon_vals no callback set 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: init done 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cr dump hook 0x55a4c78d5168 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.629 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:40:20.495+0000 7f182effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:40:20.495+0000 7f182effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:40:20.495+0000 7f182effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:40:20.495+0000 7f195d355640 10 monclient: get_auth_request con 0x7f1828070bd0 auth_method 0 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:40:20.495+0000 7f195db56640 10 monclient: get_auth_request con 0x55a4c78f6d20 auth_method 0 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 realm 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.630 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:40:20.495+0000 7f195d355640 10 monclient: get_auth_request con 0x55a4c78fb000 auth_method 0 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 searching for the correct realm 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:40:20.499+0000 7f195cb54640 10 monclient: get_auth_request con 0x55a4c7900110 auth_method 0 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:40:20.499+0000 7f195db56640 10 monclient: get_auth_request con 0x7f195402b070 auth_method 0 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:40:20.503+0000 7f195d355640 10 monclient: get_auth_request con 0x7f19500cb070 auth_method 0 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:40:20.503+0000 7f195cb54640 10 monclient: get_auth_request con 0x7f1954008040 auth_method 0 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:40:20.503+0000 7f195cb54640 0 -- 172.21.15.137:0/2093158788 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f1954008040 msgr2=0x7f195407d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:20.631 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:40:20.503+0000 7f182effd640 1 client.6320.objecter ms_handle_reset 0x7f1954008040 session 0x7f1954067f30 osd.5 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:40:20.503+0000 7f182effd640 10 monclient: _renew_subs 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:40:20.503+0000 7f182effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:40:20.503+0000 7f195cb54640 10 monclient: get_auth_request con 0x7f1828080f80 auth_method 0 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:40:20.507+0000 7f195db56640 10 monclient: get_auth_request con 0x7f19500f4400 auth_method 0 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:40:20.507+0000 7f195d355640 10 monclient: get_auth_request con 0x7f1958020040 auth_method 0 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:40:20.511+0000 7f195d355640 0 -- 172.21.15.137:0/2093158788 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1958020040 msgr2=0x7f1958002ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:40:20.511+0000 7f182effd640 1 client.6320.objecter ms_handle_reset 0x7f1958020040 session 0x7f1958017040 osd.3 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:40:20.511+0000 7f195d355640 10 monclient: get_auth_request con 0x7f1954008040 auth_method 0 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:20.632 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:20.633 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:20.633 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:20.633 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:20.633 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:20.633 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.633 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.633 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.634 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.634 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.634 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:20.634 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 zone default found 2024-09-12T00:40:20.634 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 Realm: () 2024-09-12T00:40:20.634 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:20.634 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:20.635 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:20.635 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 zonegroup default 2024-09-12T00:40:20.635 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.635 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.635 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.635 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.636 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.636 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.636 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 started sync module instance, tier type = 2024-09-12T00:40:20.636 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:20.636 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=0 2024-09-12T00:40:20.636 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=1 2024-09-12T00:40:20.637 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=2 2024-09-12T00:40:20.637 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=3 2024-09-12T00:40:20.637 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=4 2024-09-12T00:40:20.637 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=5 2024-09-12T00:40:20.637 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=6 2024-09-12T00:40:20.637 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:40:20.543+0000 7f195f84f9c0 20 add_watcher() i=7 2024-09-12T00:40:20.638 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:40:20.543+0000 7f195f84f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:20.638 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding auth protocol: cephx 2024-09-12T00:40:20.638 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding auth protocol: cephx 2024-09-12T00:40:20.638 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding auth protocol: cephx 2024-09-12T00:40:20.638 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.638 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.639 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.639 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.639 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.639 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.639 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.639 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.639 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:40:20.547+0000 7f18137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:20.640 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.640 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.640 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.640 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.640 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.641 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:20.641 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:20.641 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cache list hook 0x55a4c78d4000 2024-09-12T00:40:20.641 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cache inspect hook 0x55a4c78d4000 2024-09-12T00:40:20.641 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cache erase hook 0x55a4c78d4000 2024-09-12T00:40:20.641 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cache zap hook 0x55a4c78d4000 2024-09-12T00:40:20.642 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 note: GC not initialized 2024-09-12T00:40:20.642 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:40:20.547+0000 7f18127e4640 20 reqs_thread_entry: start 2024-09-12T00:40:20.642 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command sync trace show hook 0x7f195400b5b0 2024-09-12T00:40:20.642 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command sync trace history hook 0x7f195400b5b0 2024-09-12T00:40:20.642 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command sync trace active hook 0x7f195400b5b0 2024-09-12T00:40:20.642 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command sync trace active_short hook 0x7f195400b5b0 2024-09-12T00:40:20.643 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:20.643 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 Filter name: none 2024-09-12T00:40:20.643 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:40:20.547+0000 7f1783fff640 20 reqs_thread_entry: start 2024-09-12T00:40:20.643 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:40:20.643 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.643 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:20.644 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:40:20.644 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:40:20.644 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 : miss 2024-09-12T00:40:20.644 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.644 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:20.645 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:20.645 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:20.645 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:20.645 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:20.645 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 2024-09-12T00:40:20.645 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:40:20.555+0000 7f195f84f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f195f84f9c0 time 2024-09-12T00:40:20.559706+0000 2024-09-12T00:40:20.646 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:20.646 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.646 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:20.646 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f19631292eb] 2024-09-12T00:40:20.646 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f196312949f] 2024-09-12T00:40:20.647 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c4f8ecc1] 2024-09-12T00:40:20.647 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422078) [0x55a4c59ec078] 2024-09-12T00:40:20.647 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c4fa3ced] 2024-09-12T00:40:20.647 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:40:20.647 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1961f8fd90] 2024-09-12T00:40:20.647 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:40:20.648 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:40:20.648 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.648 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:40:20.555+0000 7f195f84f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:20.648 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f195f84f9c0 thread_name:radosgw-admin 2024-09-12T00:40:20.648 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.648 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:20.649 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1961fa8520] 2024-09-12T00:40:20.649 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:40:20.649 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:40:20.649 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:40:20.649 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1963129345] 2024-09-12T00:40:20.649 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f196312949f] 2024-09-12T00:40:20.650 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c4f8ecc1] 2024-09-12T00:40:20.650 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422078) [0x55a4c59ec078] 2024-09-12T00:40:20.650 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c4fa3ced] 2024-09-12T00:40:20.650 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:40:20.650 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1961f8fd90] 2024-09-12T00:40:20.650 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:40:20.651 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:40:20.651 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:20.651 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.651 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:40:20.651 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:40:20.651 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:40:20.651 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:40:20.652 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:40:20.652 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:40:20.652 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:20.652 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:40:20.652 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:40:20.653 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:40:20.654 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:20.655 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:40:20.656 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:20.657 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:40:20.658 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:20.658 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:20.658 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:20.658 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:20.658 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:40:20.658 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:20.658 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:20.658 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:20.659 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1783fff640 / http_manager 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f18127e4640 / http_manager 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f18137e6640 / rgw_dt_lg_renew 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f182effd640 / ms_dispatch 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1840ff9640 / io_context_pool 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1842ffd640 / ms_dispatch 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1849e03640 / ms_dispatch 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f184b606640 / io_context_pool 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195cb54640 / msgr-worker-2 2024-09-12T00:40:20.660 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195d355640 / msgr-worker-1 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195db56640 / msgr-worker-0 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195e357640 / io_context_pool 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195f84f9c0 / radosgw-admin 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.91852.log 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:40:20.471+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.606350s 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c769bb90 auth_method 0 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.661 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): get_auth_request con 0x55a4c76bd110 auth_method 0 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.662 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:40:20.471+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient(hunting): handle_auth_done global_id 6308 payload 274 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:40:20.471+0000 7f195d355640 1 monclient: found mon.noname-c 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:40:20.471+0000 7f195d355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: dump: 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.663 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:40:20.471+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6308 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:40:20.471+0000 7f195f84f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:40:20.471+0000 7f195f84f9c0 4 set_mon_vals no callback set 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:20.664 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:40:20.471+0000 7f184b606640 10 monclient: dump: 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.665 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: shutdown 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) unregister_commands rotate-key 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: monmap: 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:20.666 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding auth protocol: cephx 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding auth protocol: cephx 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding auth protocol: cephx 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.667 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: crc 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78137b0) adding con mode: secure 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: starting msgr at 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: starting objecter 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command objecter_requests hook 0x55a4c75aacf0 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: setting wanted keys 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: calling monclient init 2024-09-12T00:40:20.668 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: init 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding auth protocol: cephx 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding auth protocol: cephx 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding auth protocol: cephx 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.669 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: crc 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c780e3e0) adding con mode: secure 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command rotate-key hook 0x55a4c780e528 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:20.670 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c769bb90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c76bd110 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c76bda60 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.609372s 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c769bb90 auth_method 0 2024-09-12T00:40:20.671 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): get_auth_request con 0x55a4c76bda60 auth_method 0 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:40:20.475+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.672 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient(hunting): handle_auth_done global_id 6311 payload 824 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:40:20.475+0000 7f195d355640 1 monclient: found mon.noname-c 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:40:20.475+0000 7f195d355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: dump: 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.674 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:20.675 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:40:20.475+0000 7f1849e03640 10 monclient: dump: 2024-09-12T00:40:20.675 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.675 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.675 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.675 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.675 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.676 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.676 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.676 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.676 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.676 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.676 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6311 2024-09-12T00:40:20.677 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:40:20.475+0000 7f184b606640 4 set_mon_vals no callback set 2024-09-12T00:40:20.677 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.677 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.677 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.677 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.677 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:40:20.475+0000 7f195f84f9c0 1 librados: init done 2024-09-12T00:40:20.677 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:40:20.479+0000 7f1849e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:20.678 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:40:20.479+0000 7f1849e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.678 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:40:20.479+0000 7f1849e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.678 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:40:20.479+0000 7f195cb54640 10 monclient: get_auth_request con 0x7f1844070ae0 auth_method 0 2024-09-12T00:40:20.678 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:40:20.479+0000 7f195db56640 10 monclient: get_auth_request con 0x55a4c7835e40 auth_method 0 2024-09-12T00:40:20.678 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:40:20.479+0000 7f195d355640 10 monclient: get_auth_request con 0x55a4c7858ed0 auth_method 0 2024-09-12T00:40:20.678 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient: get_auth_request con 0x55a4c785c5c0 auth_method 0 2024-09-12T00:40:20.679 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:20.679 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:20.679 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: monmap: 2024-09-12T00:40:20.679 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:20.679 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:20.679 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding auth protocol: cephx 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding auth protocol: cephx 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding auth protocol: cephx 2024-09-12T00:40:20.680 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: crc 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c7861960) adding con mode: secure 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.681 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a4c78653b0 EEXIST 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: init 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding auth protocol: cephx 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding auth protocol: cephx 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding auth protocol: cephx 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.682 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: crc 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78608f8) adding con mode: secure 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command rotate-key cmddesc rotate-key hook 0x55a4c7860a40 EEXIST 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c7889560 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c7888e90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c7887870 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.683 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.619134s 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c7889560 auth_method 0 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): get_auth_request con 0x55a4c7888e90 auth_method 0 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.684 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:40:20.483+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient(hunting): handle_auth_done global_id 6585 payload 824 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:40:20.483+0000 7f195d355640 1 monclient: found mon.noname-a 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:40:20.483+0000 7f195d355640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: dump: 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.685 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:40:20.483+0000 7f1842ffd640 10 monclient: dump: 2024-09-12T00:40:20.686 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6585 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:40:20.483+0000 7f195e357640 4 set_mon_vals no callback set 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:40:20.483+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:20.687 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:40:20.487+0000 7f1842ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:40:20.487+0000 7f1842ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:40:20.487+0000 7f1842ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:40:20.487+0000 7f195cb54640 10 monclient: get_auth_request con 0x7f1838070a20 auth_method 0 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: monmap: 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:20.688 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding auth protocol: cephx 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding auth protocol: cephx 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding auth protocol: cephx 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.689 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: crc 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78a8a70) adding con mode: secure 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: init 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding auth protocol: cephx 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding auth protocol: cephx 2024-09-12T00:40:20.690 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding auth protocol: cephx 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: crc 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34910) adding con mode: secure 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.691 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe86e34a58 EEXIST 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c78dcf50 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c78acac0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c78cd9d0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:40:20.487+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.623371s 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c78dcf50 auth_method 0 2024-09-12T00:40:20.692 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): get_auth_request con 0x55a4c78cd9d0 auth_method 0 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.693 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:40:20.487+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient(hunting): handle_auth_done global_id 6317 payload 274 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:40:20.487+0000 7f195d355640 1 monclient: found mon.noname-c 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:40:20.487+0000 7f195d355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: dump: 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.694 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6317 2024-09-12T00:40:20.695 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 4 set_mon_vals no callback set 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:40:20.491+0000 7f1840ff9640 10 monclient: dump: 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.696 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: shutdown 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: monmap: 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:20.697 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding auth protocol: cephx 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding auth protocol: cephx 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding auth protocol: cephx 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.698 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: crc 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c78cdf30) adding con mode: secure 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.699 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: starting msgr at 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: starting objecter 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a4c78cfe80 EEXIST 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: setting wanted keys 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: calling monclient init 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: init 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding auth protocol: cephx 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding auth protocol: cephx 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding auth protocol: cephx 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.700 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: crc 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 AuthRegistry(0x55a4c788b380) adding con mode: secure 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command rotate-key cmddesc rotate-key hook 0x55a4c788b4c8 EEXIST 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:40:20.701 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c78acac0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c78cd9d0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c78dcf50 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient(hunting): authenticate will time out at 2121.625952s 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): get_auth_request con 0x55a4c78cd9d0 auth_method 0 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.702 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): get_auth_request con 0x55a4c78dcf50 auth_method 0 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:40:20.491+0000 7f195db56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:20.703 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:40:20.491+0000 7f195d355640 10 monclient(hunting): get_auth_request con 0x55a4c78acac0 auth_method 0 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:40:20.491+0000 7f195d355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:40:20.491+0000 7f195d355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:40:20.491+0000 7f195d355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient(hunting): handle_auth_done global_id 6320 payload 824 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient: _finish_hunting 0 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:40:20.491+0000 7f195cb54640 1 monclient: found mon.noname-c 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:40:20.491+0000 7f195cb54640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: dump: 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.704 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: _finish_auth 0 2024-09-12T00:40:20.705 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: _check_auth_tickets 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:40:20.491+0000 7f182effd640 10 monclient: dump: 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:20.706 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 monclient: authenticate success, global_id 6320 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:40:20.491+0000 7f1840ff9640 4 set_mon_vals no callback set 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _renew_subs 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 1 librados: init done 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:40:20.491+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cr dump hook 0x55a4c78d5168 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:40:20.495+0000 7f182effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:40:20.495+0000 7f182effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:40:20.495+0000 7f182effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:40:20.495+0000 7f195d355640 10 monclient: get_auth_request con 0x7f1828070bd0 auth_method 0 2024-09-12T00:40:20.707 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:40:20.495+0000 7f195db56640 10 monclient: get_auth_request con 0x55a4c78f6d20 auth_method 0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 realm 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:40:20.495+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:40:20.495+0000 7f195d355640 10 monclient: get_auth_request con 0x55a4c78fb000 auth_method 0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.708 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:40:20.499+0000 7f195f84f9c0 20 searching for the correct realm 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:40:20.499+0000 7f195cb54640 10 monclient: get_auth_request con 0x55a4c7900110 auth_method 0 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:40:20.499+0000 7f195db56640 10 monclient: get_auth_request con 0x7f195402b070 auth_method 0 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:40:20.503+0000 7f195d355640 10 monclient: get_auth_request con 0x7f19500cb070 auth_method 0 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:40:20.503+0000 7f195cb54640 10 monclient: get_auth_request con 0x7f1954008040 auth_method 0 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:40:20.503+0000 7f195cb54640 0 -- 172.21.15.137:0/2093158788 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f1954008040 msgr2=0x7f195407d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:40:20.503+0000 7f182effd640 1 client.6320.objecter ms_handle_reset 0x7f1954008040 session 0x7f1954067f30 osd.5 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:40:20.503+0000 7f182effd640 10 monclient: _renew_subs 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:40:20.503+0000 7f182effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:20.709 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:40:20.503+0000 7f195cb54640 10 monclient: get_auth_request con 0x7f1828080f80 auth_method 0 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:40:20.507+0000 7f195db56640 10 monclient: get_auth_request con 0x7f19500f4400 auth_method 0 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:40:20.507+0000 7f195d355640 10 monclient: get_auth_request con 0x7f1958020040 auth_method 0 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:40:20.511+0000 7f195d355640 0 -- 172.21.15.137:0/2093158788 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1958020040 msgr2=0x7f1958002ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:40:20.511+0000 7f182effd640 1 client.6320.objecter ms_handle_reset 0x7f1958020040 session 0x7f1958017040 osd.3 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:40:20.511+0000 7f195d355640 10 monclient: get_auth_request con 0x7f1954008040 auth_method 0 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.710 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 zone default found 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 Realm: () 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 zonegroup default 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.711 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:40:20.519+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 started sync module instance, tier type = 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:40:20.523+0000 7f195f84f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=0 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=1 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=2 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=3 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=4 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=5 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:40:20.539+0000 7f195f84f9c0 20 add_watcher() i=6 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:40:20.543+0000 7f195f84f9c0 20 add_watcher() i=7 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:40:20.543+0000 7f195f84f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding auth protocol: cephx 2024-09-12T00:40:20.712 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding auth protocol: cephx 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding auth protocol: cephx 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:40:20.547+0000 7f18137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: crc 2024-09-12T00:40:20.713 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 AuthRegistry(0x7ffe86e34df0) adding con mode: secure 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cache list hook 0x55a4c78d4000 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cache inspect hook 0x55a4c78d4000 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cache erase hook 0x55a4c78d4000 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command cache zap hook 0x55a4c78d4000 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 note: GC not initialized 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:40:20.547+0000 7f18127e4640 20 reqs_thread_entry: start 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command sync trace show hook 0x7f195400b5b0 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command sync trace history hook 0x7f195400b5b0 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command sync trace active hook 0x7f195400b5b0 2024-09-12T00:40:20.714 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 5 asok(0x55a4c76032b0) register_command sync trace active_short hook 0x7f195400b5b0 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 Filter name: none 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:40:20.547+0000 7f1783fff640 20 reqs_thread_entry: start 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 : miss 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:20.715 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:40:20.547+0000 7f195f84f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:40:20.555+0000 7f195f84f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f195f84f9c0 time 2024-09-12T00:40:20.559706+0000 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f19631292eb] 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f196312949f] 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c4f8ecc1] 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422078) [0x55a4c59ec078] 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c4fa3ced] 2024-09-12T00:40:20.716 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1961f8fd90] 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:40:20.555+0000 7f195f84f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f195f84f9c0 thread_name:radosgw-admin 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1961fa8520] 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1963129345] 2024-09-12T00:40:20.717 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f196312949f] 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c4f8ecc1] 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422078) [0x55a4c59ec078] 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c4fa3ced] 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1961f8fd90] 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:40:20.718 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:40:20.719 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:40:20.720 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:20.721 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:40:20.722 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:40:20.724 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1783fff640 / http_manager 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 7f18127e4640 / http_manager 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 7f18137e6640 / rgw_dt_lg_renew 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 7f182effd640 / ms_dispatch 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1840ff9640 / io_context_pool 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1842ffd640 / ms_dispatch 2024-09-12T00:40:20.725 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1849e03640 / ms_dispatch 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: 7f184b606640 / io_context_pool 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195cb54640 / msgr-worker-2 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195d355640 / msgr-worker-1 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195db56640 / msgr-worker-0 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195e357640 / io_context_pool 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: 7f195f84f9c0 / radosgw-admin 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:40:20.562194Z_34a68a4d-dda5-4cc7-9fca-e26b2941b77f/log 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:40:20.726 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:40:20.727 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:20.727 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:20.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.839+0000 7f0c6af4f640 0 --2- 172.21.15.137:0/3514319531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55805402a120 0x558054058ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:40:20.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.843+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.843+0000 7f0c6d4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.843+0000 7f0c6d4499c0 20 realm 2024-09-12T00:40:20.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.843+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:20.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:20.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:20.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:20.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:20.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.847+0000 7f0c6d4499c0 20 searching for the correct realm 2024-09-12T00:40:20.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:20.855+0000 7f0c6a74e640 0 -- 172.21.15.137:0/3514319531 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f0c6003b920 msgr2=0x7f0c60024410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:21.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.067+0000 7f0c6b750640 0 -- 172.21.15.137:0/3514319531 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55805406c930 msgr2=0x55805406eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:21.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.079+0000 7f0c6d4499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:21.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.079+0000 7f0c6d4499c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:21.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.079+0000 7f0c6d4499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:21.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.079+0000 7f0c6d4499c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:21.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.079+0000 7f0c6d4499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:21.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.079+0000 7f0c6d4499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:21.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.079+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:21.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:21.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 zone default found 2024-09-12T00:40:21.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 4 Realm: () 2024-09-12T00:40:21.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:21.084 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:21.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:21.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 zonegroup default 2024-09-12T00:40:21.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.083+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.087+0000 7f0c6d4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.087+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.087+0000 7f0c6d4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.087+0000 7f0c6d4499c0 20 started sync module instance, tier type = 2024-09-12T00:40:21.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.087+0000 7f0c6d4499c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 20 add_watcher() i=0 2024-09-12T00:40:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 20 add_watcher() i=1 2024-09-12T00:40:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 20 add_watcher() i=2 2024-09-12T00:40:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 20 add_watcher() i=3 2024-09-12T00:40:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 20 add_watcher() i=4 2024-09-12T00:40:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 20 add_watcher() i=5 2024-09-12T00:40:21.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 20 add_watcher() i=6 2024-09-12T00:40:21.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 20 add_watcher() i=7 2024-09-12T00:40:21.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.111+0000 7f0c6d4499c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:21.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0b217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:21.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:21.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:21.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 5 note: GC not initialized 2024-09-12T00:40:21.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0a9bfff640 20 reqs_thread_entry: start 2024-09-12T00:40:21.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:21.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 Filter name: none 2024-09-12T00:40:21.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0a99ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:21.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:21.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:21.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:21.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.119+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.123+0000 7f0c6d4499c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:21.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.123+0000 7f0c6d4499c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.123+0000 7f0c6d4499c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:21.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.123+0000 7f0c6d4499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:21.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.123+0000 7f0b217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:21.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.127+0000 7f0c6d4499c0 20 remove_watcher() i=0 2024-09-12T00:40:21.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.127+0000 7f0c6d4499c0 2 removed watcher, disabling cache 2024-09-12T00:40:21.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.131+0000 7f0c6d4499c0 20 remove_watcher() i=1 2024-09-12T00:40:21.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.131+0000 7f0c6d4499c0 20 remove_watcher() i=2 2024-09-12T00:40:21.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.135+0000 7f0c6d4499c0 20 remove_watcher() i=3 2024-09-12T00:40:21.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.135+0000 7f0c6d4499c0 20 remove_watcher() i=4 2024-09-12T00:40:21.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.139+0000 7f0c6d4499c0 20 remove_watcher() i=5 2024-09-12T00:40:21.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.143+0000 7f0c6d4499c0 20 remove_watcher() i=6 2024-09-12T00:40:21.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.143+0000 7f0c6d4499c0 20 remove_watcher() i=7 2024-09-12T00:40:21.158 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:21.158 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:21.158 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-set-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:21.158 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:21.159 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:21.159 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:21.173 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:21.173 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:21.218 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:21.257 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:21.257 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:21.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.299+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 realm 2024-09-12T00:40:21.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:21.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:21.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:21.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.303+0000 7fea5820b9c0 20 searching for the correct realm 2024-09-12T00:40:21.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.315+0000 7fea56512640 0 -- 172.21.15.137:0/3144294502 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55b99932e660 msgr2=0x55b999330b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:21.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.319+0000 7fea55510640 0 -- 172.21.15.137:0/3144294502 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x55b999337b30 msgr2=0x55b999339ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:21.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.323+0000 7fea5820b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:21.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.323+0000 7fea5820b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:21.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.323+0000 7fea5820b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:21.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.323+0000 7fea5820b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:21.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.323+0000 7fea5820b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:21.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.323+0000 7fea5820b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:21.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.323+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:21.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 zone default found 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 4 Realm: () 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 zonegroup default 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:21.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 started sync module instance, tier type = 2024-09-12T00:40:21.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.327+0000 7fea5820b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:21.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 20 add_watcher() i=0 2024-09-12T00:40:21.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 20 add_watcher() i=1 2024-09-12T00:40:21.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 20 add_watcher() i=2 2024-09-12T00:40:21.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 20 add_watcher() i=3 2024-09-12T00:40:21.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 20 add_watcher() i=4 2024-09-12T00:40:21.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 20 add_watcher() i=5 2024-09-12T00:40:21.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 20 add_watcher() i=6 2024-09-12T00:40:21.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 20 add_watcher() i=7 2024-09-12T00:40:21.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.347+0000 7fea5820b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:21.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fe90bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:21.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:21.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:21.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 5 note: GC not initialized 2024-09-12T00:40:21.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fe90afe5640 20 reqs_thread_entry: start 2024-09-12T00:40:21.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:21.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 20 Filter name: none 2024-09-12T00:40:21.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fe908fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:21.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:40:21.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:21.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:40:21.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:40:21.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 : miss 2024-09-12T00:40:21.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.351+0000 7fea5820b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:21.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.355+0000 7fea5820b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:21.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.355+0000 7fea5820b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:21.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.355+0000 7fea5820b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:21.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.355+0000 7fea5820b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:21.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.355+0000 7fea5820b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:21.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.355+0000 7fea5820b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 2024-09-12T00:40:21.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.355+0000 7fea5820b9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to be held by another RGW process; skipping for now 2024-09-12T00:40:21.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.355+0000 7fe90bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:21.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.359+0000 7fea5820b9c0 20 remove_watcher() i=0 2024-09-12T00:40:21.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.359+0000 7fea5820b9c0 2 removed watcher, disabling cache 2024-09-12T00:40:21.362 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.363+0000 7fea5820b9c0 20 remove_watcher() i=1 2024-09-12T00:40:21.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.363+0000 7fea5820b9c0 20 remove_watcher() i=2 2024-09-12T00:40:21.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.367+0000 7fea5820b9c0 20 remove_watcher() i=3 2024-09-12T00:40:21.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.367+0000 7fea5820b9c0 20 remove_watcher() i=4 2024-09-12T00:40:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.371+0000 7fea5820b9c0 20 remove_watcher() i=5 2024-09-12T00:40:21.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.375+0000 7fea5820b9c0 20 remove_watcher() i=6 2024-09-12T00:40:21.376 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:21.375+0000 7fea5820b9c0 20 remove_watcher() i=7 2024-09-12T00:40:21.390 INFO:tasks.workunit.client.0.smithi137.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:40:51.396 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:51.431 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:51.431 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:51.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.475+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 realm 2024-09-12T00:40:51.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:51.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:51.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:51.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.479+0000 7f5bbf0149c0 20 searching for the correct realm 2024-09-12T00:40:51.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.487+0000 7f5bbcb1a640 0 -- 172.21.15.137:0/1483646070 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f5bac120070 msgr2=0x7f5bac12c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:51.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.491+0000 7f5bbcb1a640 0 -- 172.21.15.137:0/1483646070 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x562d318ab240 msgr2=0x562d318ad630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:51.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 zone default found 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 4 Realm: () 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.499+0000 7f5bbf0149c0 20 zonegroup default 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.503+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.503+0000 7f5bbf0149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.503+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.503+0000 7f5bbf0149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.503+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.503+0000 7f5bbf0149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.503+0000 7f5bbf0149c0 20 started sync module instance, tier type = 2024-09-12T00:40:51.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.503+0000 7f5bbf0149c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:51.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 20 add_watcher() i=0 2024-09-12T00:40:51.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 20 add_watcher() i=1 2024-09-12T00:40:51.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 20 add_watcher() i=2 2024-09-12T00:40:51.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 20 add_watcher() i=3 2024-09-12T00:40:51.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 20 add_watcher() i=4 2024-09-12T00:40:51.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 20 add_watcher() i=5 2024-09-12T00:40:51.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 20 add_watcher() i=6 2024-09-12T00:40:51.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 20 add_watcher() i=7 2024-09-12T00:40:51.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.523+0000 7f5bbf0149c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:51.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5a72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:51.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 5 note: GC not initialized 2024-09-12T00:40:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5a71fe3640 20 reqs_thread_entry: start 2024-09-12T00:40:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 20 Filter name: none 2024-09-12T00:40:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f59e37fe640 20 reqs_thread_entry: start 2024-09-12T00:40:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:40:51.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:51.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:40:51.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:40:51.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 : miss 2024-09-12T00:40:51.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:51.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:51.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:51.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:51.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:51.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.527+0000 7f5bbf0149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 2024-09-12T00:40:51.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.535+0000 7f5bbf0149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:51.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.535+0000 7f5bbf0149c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:51.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.535+0000 7f5bbf0149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:51.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.535+0000 7f5bbf0149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24, ofs0, ns] 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.535+0000 7f5a93fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94752104733728 notifier 6642 bl.length()=925 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.535+0000 7f5a93fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.535+0000 7f5a93fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.535+0000 7f5a93fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.539+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): orig_sources= new_sources= 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.539+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): potential sources added=[] removed=[] 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.539+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): orig_dests= new_dests= 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.539+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): potential dests added=[] removed=[] 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.543+0000 7f5bbf0149c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24.1.0 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.543+0000 7f5bbf0149c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24.1.0 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.543+0000 7f5bbf0149c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24.1.1 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.543+0000 7f5bbf0149c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24.1.1 2024-09-12T00:40:51.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.543+0000 7f5bbf0149c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24.0 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.547+0000 7f5bbf0149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.547+0000 7f5bbf0149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5bbf0149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5bbf0149c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5bbf0149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5bbf0149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24, ofs0, ns] 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5a937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366234 cookie 94752104733728 notifier 6642 bl.length()=925 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5a937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5a937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5a937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): orig_sources= new_sources= 2024-09-12T00:40:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): potential sources added=[] removed=[] 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): orig_dests= new_dests= 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.551+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): potential dests added=[] removed=[] 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.555+0000 7f5bbf0149c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24.0 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.555+0000 7f5bbf0149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.555+0000 7f5bbf0149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.555+0000 7f5bbf0149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5bbf0149c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5bbf0149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5bbf0149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24, ofs0, ns] 2024-09-12T00:40:51.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5a937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366235 cookie 94752104733728 notifier 6642 bl.length()=893 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5a937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 info.flags=0x17 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5a937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 to cache LRU end 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5a937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): orig_sources= new_sources= 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): potential sources added=[] removed=[] 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): orig_dests= new_dests= 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.559+0000 7f5bbf0149c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24]): potential dests added=[] removed=[] 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.563+0000 7f5bbf0149c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.563+0000 7f5a72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.571+0000 7f5bbf0149c0 20 remove_watcher() i=0 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.571+0000 7f5bbf0149c0 2 removed watcher, disabling cache 2024-09-12T00:40:51.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.571+0000 7f5bbf0149c0 20 remove_watcher() i=1 2024-09-12T00:40:51.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.575+0000 7f5bbf0149c0 20 remove_watcher() i=2 2024-09-12T00:40:51.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.575+0000 7f5bbf0149c0 20 remove_watcher() i=3 2024-09-12T00:40:51.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.579+0000 7f5bbf0149c0 20 remove_watcher() i=4 2024-09-12T00:40:51.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.579+0000 7f5bbf0149c0 20 remove_watcher() i=5 2024-09-12T00:40:51.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.583+0000 7f5bbf0149c0 20 remove_watcher() i=6 2024-09-12T00:40:51.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.587+0000 7f5bbf0149c0 20 remove_watcher() i=7 2024-09-12T00:40:51.601 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:40:51.627 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:51.628 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:51.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.671+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 realm 2024-09-12T00:40:51.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:51.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:51.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:51.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.675+0000 7f140de039c0 20 searching for the correct realm 2024-09-12T00:40:51.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.683+0000 7f140b909640 0 -- 172.21.15.137:0/111693168 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f1404008040 msgr2=0x7f14040730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:51.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.687+0000 7f140b909640 0 -- 172.21.15.137:0/111693168 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x558a20338b50 msgr2=0x558a2033af40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:51.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:51.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:51.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:51.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:51.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:51.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:51.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:51.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 zone default found 2024-09-12T00:40:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 4 Realm: () 2024-09-12T00:40:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 zonegroup default 2024-09-12T00:40:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.695+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.699+0000 7f140de039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.699+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.699+0000 7f140de039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.699+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.699+0000 7f140de039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.699+0000 7f140de039c0 20 started sync module instance, tier type = 2024-09-12T00:40:51.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.699+0000 7f140de039c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:51.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.715+0000 7f140de039c0 20 add_watcher() i=0 2024-09-12T00:40:51.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.715+0000 7f140de039c0 20 add_watcher() i=1 2024-09-12T00:40:51.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.715+0000 7f140de039c0 20 add_watcher() i=2 2024-09-12T00:40:51.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.715+0000 7f140de039c0 20 add_watcher() i=3 2024-09-12T00:40:51.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.715+0000 7f140de039c0 20 add_watcher() i=4 2024-09-12T00:40:51.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.715+0000 7f140de039c0 20 add_watcher() i=5 2024-09-12T00:40:51.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.715+0000 7f140de039c0 20 add_watcher() i=6 2024-09-12T00:40:51.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.719+0000 7f140de039c0 20 add_watcher() i=7 2024-09-12T00:40:51.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.719+0000 7f140de039c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:51.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f12c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 5 note: GC not initialized 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f12c0fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 Filter name: none 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f123a7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:51.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.723+0000 7f140de039c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:51.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.727+0000 7f12c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:51.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.731+0000 7f140de039c0 20 remove_watcher() i=0 2024-09-12T00:40:51.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.731+0000 7f140de039c0 2 removed watcher, disabling cache 2024-09-12T00:40:51.732 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.731+0000 7f140de039c0 20 remove_watcher() i=1 2024-09-12T00:40:51.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.735+0000 7f140de039c0 20 remove_watcher() i=2 2024-09-12T00:40:51.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.735+0000 7f140de039c0 20 remove_watcher() i=3 2024-09-12T00:40:51.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.739+0000 7f140de039c0 20 remove_watcher() i=4 2024-09-12T00:40:51.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.739+0000 7f140de039c0 20 remove_watcher() i=5 2024-09-12T00:40:51.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.743+0000 7f140de039c0 20 remove_watcher() i=6 2024-09-12T00:40:51.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:51.747+0000 7f140de039c0 20 remove_watcher() i=7 2024-09-12T00:40:51.759 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:51.759 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:51.759 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-set-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:40:51.759 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:51.761 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.761 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:51.764 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.764 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:51.833 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.833 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:51.868 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:40:51.868 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:51.869 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.869 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:51.891 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.891 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:51.937 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.937 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:51.956 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.957 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:51.977 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.977 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:51.998 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.998 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.017 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.017 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.038 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.038 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.058 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.058 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.078 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.078 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.097 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.098 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.117 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.117 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.138 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.138 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.158 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.158 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.178 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.178 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.199 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.199 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.222 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.222 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.295 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.295 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.314 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.314 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.334 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.334 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.354 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.354 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.374 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.374 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.391 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:40:52.423 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:52.423 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:52.468 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.467+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 realm 2024-09-12T00:40:52.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:52.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.471+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.475+0000 7f0b294109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:52.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.475+0000 7f0b294109c0 20 searching for the correct realm 2024-09-12T00:40:52.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.479+0000 7f0b26715640 0 -- 172.21.15.137:0/74601198 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f0b1c0b63f0 msgr2=0x7f0b1c0b6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.487+0000 7f0b26f16640 0 -- 172.21.15.137:0/74601198 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f0b20034060 msgr2=0x7f0b2005fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:52.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:52.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:52.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:52.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:52.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:52.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.494 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:52.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 zone default found 2024-09-12T00:40:52.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 4 Realm: () 2024-09-12T00:40:52.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:52.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:52.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:52.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 zonegroup default 2024-09-12T00:40:52.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 started sync module instance, tier type = 2024-09-12T00:40:52.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.495+0000 7f0b294109c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:52.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.515+0000 7f0b294109c0 20 add_watcher() i=0 2024-09-12T00:40:52.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.515+0000 7f0b294109c0 20 add_watcher() i=1 2024-09-12T00:40:52.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.515+0000 7f0b294109c0 20 add_watcher() i=2 2024-09-12T00:40:52.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.515+0000 7f0b294109c0 20 add_watcher() i=3 2024-09-12T00:40:52.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.515+0000 7f0b294109c0 20 add_watcher() i=4 2024-09-12T00:40:52.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.515+0000 7f0b294109c0 20 add_watcher() i=5 2024-09-12T00:40:52.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.515+0000 7f0b294109c0 20 add_watcher() i=6 2024-09-12T00:40:52.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.519+0000 7f0b294109c0 20 add_watcher() i=7 2024-09-12T00:40:52.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.519+0000 7f0b294109c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:52.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f09dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:52.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:52.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 5 note: GC not initialized 2024-09-12T00:40:52.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0957fff640 20 reqs_thread_entry: start 2024-09-12T00:40:52.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:52.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 Filter name: none 2024-09-12T00:40:52.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0955ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:52.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:52.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:52.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:52.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:52.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.523+0000 7f0b294109c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.527+0000 7f0b294109c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:52.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.527+0000 7f0b294109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:52.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.527+0000 7f09dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.531+0000 7f0b294109c0 20 remove_watcher() i=0 2024-09-12T00:40:52.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.531+0000 7f0b294109c0 2 removed watcher, disabling cache 2024-09-12T00:40:52.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.535+0000 7f0b294109c0 20 remove_watcher() i=1 2024-09-12T00:40:52.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.535+0000 7f0b294109c0 20 remove_watcher() i=2 2024-09-12T00:40:52.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.539+0000 7f0b294109c0 20 remove_watcher() i=3 2024-09-12T00:40:52.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.539+0000 7f0b294109c0 20 remove_watcher() i=4 2024-09-12T00:40:52.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.543+0000 7f0b294109c0 20 remove_watcher() i=5 2024-09-12T00:40:52.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.543+0000 7f0b294109c0 20 remove_watcher() i=6 2024-09-12T00:40:52.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.547+0000 7f0b294109c0 20 remove_watcher() i=7 2024-09-12T00:40:52.565 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:52.565 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:52.565 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-trim-reshard-log-entries id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:52.565 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:52.565 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:40:52.596 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:52.596 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:52.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.639+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 realm 2024-09-12T00:40:52.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:52.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:52.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.643+0000 7ff4445099c0 20 searching for the correct realm 2024-09-12T00:40:52.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.651+0000 7ff44180e640 0 -- 172.21.15.137:0/196265778 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7ff438008040 msgr2=0x7ff43802c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.655+0000 7ff44200f640 0 -- 172.21.15.137:0/196265778 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7ff43c091c20 msgr2=0x7ff43c089980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:52.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:52.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:52.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:52.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:52.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:52.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:52.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.665 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.663+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:52.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 zone default found 2024-09-12T00:40:52.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 4 Realm: () 2024-09-12T00:40:52.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 zonegroup default 2024-09-12T00:40:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 started sync module instance, tier type = 2024-09-12T00:40:52.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.667+0000 7ff4445099c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:52.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 20 add_watcher() i=0 2024-09-12T00:40:52.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 20 add_watcher() i=1 2024-09-12T00:40:52.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 20 add_watcher() i=2 2024-09-12T00:40:52.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 20 add_watcher() i=3 2024-09-12T00:40:52.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 20 add_watcher() i=4 2024-09-12T00:40:52.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 20 add_watcher() i=5 2024-09-12T00:40:52.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 20 add_watcher() i=6 2024-09-12T00:40:52.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 20 add_watcher() i=7 2024-09-12T00:40:52.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.687+0000 7ff4445099c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:52.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.691+0000 7ff2f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.691+0000 7ff4445099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.691+0000 7ff4445099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.691+0000 7ff4445099c0 5 note: GC not initialized 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.691+0000 7ff2737fe640 20 reqs_thread_entry: start 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.691+0000 7ff4445099c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.691+0000 7ff4445099c0 20 Filter name: none 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.691+0000 7ff2717fa640 20 reqs_thread_entry: start 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:40:52.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:52.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:40:52.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:40:52.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 : miss 2024-09-12T00:40:52.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:52.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:52.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:52.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:52.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:52.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.695+0000 7ff4445099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 2024-09-12T00:40:52.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:52.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:52.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:52.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25, ofs0, ns] 2024-09-12T00:40:52.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff325ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366238 cookie 94468651096016 notifier 6416 bl.length()=939 2024-09-12T00:40:52.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff325ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:52.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff325ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:52.703 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff325ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:52.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): orig_sources= new_sources= 2024-09-12T00:40:52.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): potential sources added=[] removed=[] 2024-09-12T00:40:52.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): orig_dests= new_dests= 2024-09-12T00:40:52.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): potential dests added=[] removed=[] 2024-09-12T00:40:52.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:40:52.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.703+0000 7ff4445099c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:40:52.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.707+0000 7ff2f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.711+0000 7ff4445099c0 20 remove_watcher() i=0 2024-09-12T00:40:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.711+0000 7ff4445099c0 2 removed watcher, disabling cache 2024-09-12T00:40:52.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.711+0000 7ff4445099c0 20 remove_watcher() i=1 2024-09-12T00:40:52.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.715+0000 7ff4445099c0 20 remove_watcher() i=2 2024-09-12T00:40:52.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.719+0000 7ff4445099c0 20 remove_watcher() i=3 2024-09-12T00:40:52.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.719+0000 7ff4445099c0 20 remove_watcher() i=4 2024-09-12T00:40:52.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.723+0000 7ff4445099c0 20 remove_watcher() i=5 2024-09-12T00:40:52.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.723+0000 7ff4445099c0 20 remove_watcher() i=6 2024-09-12T00:40:52.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.727+0000 7ff4445099c0 20 remove_watcher() i=7 2024-09-12T00:40:52.741 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:40:52.768 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:52.768 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:52.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.811+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 realm 2024-09-12T00:40:52.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:52.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.815+0000 7f454428c9c0 20 searching for the correct realm 2024-09-12T00:40:52.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.823+0000 7f4542593640 0 -- 172.21.15.137:0/1341905479 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f453805c020 msgr2=0x7f4538089040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.827+0000 7f4541d92640 0 -- 172.21.15.137:0/1341905479 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f453c02e070 msgr2=0x7f453c02ead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:52.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:52.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:52.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:52.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:52.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:52.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:52.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 zone default found 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 4 Realm: () 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 zonegroup default 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.835+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.839+0000 7f454428c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.839+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.839+0000 7f454428c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.839+0000 7f454428c9c0 20 started sync module instance, tier type = 2024-09-12T00:40:52.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.839+0000 7f454428c9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:52.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.855+0000 7f454428c9c0 20 add_watcher() i=0 2024-09-12T00:40:52.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.855+0000 7f454428c9c0 20 add_watcher() i=1 2024-09-12T00:40:52.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.855+0000 7f454428c9c0 20 add_watcher() i=2 2024-09-12T00:40:52.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.855+0000 7f454428c9c0 20 add_watcher() i=3 2024-09-12T00:40:52.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.855+0000 7f454428c9c0 20 add_watcher() i=4 2024-09-12T00:40:52.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.855+0000 7f454428c9c0 20 add_watcher() i=5 2024-09-12T00:40:52.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.855+0000 7f454428c9c0 20 add_watcher() i=6 2024-09-12T00:40:52.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.859+0000 7f454428c9c0 20 add_watcher() i=7 2024-09-12T00:40:52.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.859+0000 7f454428c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:52.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f43f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:52.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:52.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 5 note: GC not initialized 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f43f27fc640 20 reqs_thread_entry: start 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 Filter name: none 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f4363fff640 20 reqs_thread_entry: start 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.863+0000 7f454428c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.867+0000 7f454428c9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.867+0000 7f454428c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.867+0000 7f43f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.871+0000 7f454428c9c0 20 remove_watcher() i=0 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.871+0000 7f454428c9c0 2 removed watcher, disabling cache 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.875+0000 7f454428c9c0 20 remove_watcher() i=1 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.875+0000 7f454428c9c0 20 remove_watcher() i=2 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.875+0000 7f454428c9c0 20 remove_watcher() i=3 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.879+0000 7f454428c9c0 20 remove_watcher() i=4 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.883+0000 7f454428c9c0 20 remove_watcher() i=5 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.883+0000 7f454428c9c0 20 remove_watcher() i=6 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:52.887+0000 7f454428c9c0 20 remove_watcher() i=7 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-trim-reshard-log-entries id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:52.990 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:52.990 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:53.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.035+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.035+0000 7f1fbbfc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.035+0000 7f1fbbfc59c0 20 realm 2024-09-12T00:40:53.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.035+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:53.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:53.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.039+0000 7f1fbbfc59c0 20 searching for the correct realm 2024-09-12T00:40:53.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.047+0000 7f1fba2cc640 0 -- 172.21.15.137:0/2365746534 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f1fb00d8420 msgr2=0x7f1fb00d88a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:53.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.051+0000 7f1fb9acb640 0 -- 172.21.15.137:0/2365746534 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1fb4079b80 msgr2=0x7f1fb40785f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:53.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:53.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:53.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:53.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:53.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:53.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:53.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 zone default found 2024-09-12T00:40:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 4 Realm: () 2024-09-12T00:40:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 zonegroup default 2024-09-12T00:40:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.059+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.063+0000 7f1fbbfc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.063+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.063+0000 7f1fbbfc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.063+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.063+0000 7f1fbbfc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.063+0000 7f1fbbfc59c0 20 started sync module instance, tier type = 2024-09-12T00:40:53.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.063+0000 7f1fbbfc59c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:53.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.079+0000 7f1fbbfc59c0 20 add_watcher() i=0 2024-09-12T00:40:53.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.079+0000 7f1fbbfc59c0 20 add_watcher() i=1 2024-09-12T00:40:53.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.079+0000 7f1fbbfc59c0 20 add_watcher() i=2 2024-09-12T00:40:53.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.079+0000 7f1fbbfc59c0 20 add_watcher() i=3 2024-09-12T00:40:53.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.079+0000 7f1fbbfc59c0 20 add_watcher() i=4 2024-09-12T00:40:53.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.079+0000 7f1fbbfc59c0 20 add_watcher() i=5 2024-09-12T00:40:53.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.079+0000 7f1fbbfc59c0 20 add_watcher() i=6 2024-09-12T00:40:53.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.083+0000 7f1fbbfc59c0 20 add_watcher() i=7 2024-09-12T00:40:53.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.083+0000 7f1fbbfc59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:53.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1e6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:53.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:53.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:53.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 5 note: GC not initialized 2024-09-12T00:40:53.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1e6a7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:53.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:53.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 20 Filter name: none 2024-09-12T00:40:53.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:40:53.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1ddbfff640 20 reqs_thread_entry: start 2024-09-12T00:40:53.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:53.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:40:53.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:40:53.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 : miss 2024-09-12T00:40:53.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:40:53.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:53.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:53.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:53.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:53.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.087+0000 7f1fbbfc59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 2024-09-12T00:40:53.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.091+0000 7f1fbbfc59c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:40:53.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.099+0000 7f1fbbfc59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:53.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.099+0000 7f1fbbfc59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:53.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.099+0000 7f1fbbfc59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:53.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.099+0000 7f1fbbfc59c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25, ofs0, ns] 2024-09-12T00:40:53.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.103+0000 7f1e9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366239 cookie 94747487207552 notifier 6452 bl.length()=939 2024-09-12T00:40:53.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.103+0000 7f1e9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:53.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.103+0000 7f1e9d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:53.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.103+0000 7f1e9d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:53.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.103+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): orig_sources= new_sources= 2024-09-12T00:40:53.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.103+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): potential sources added=[] removed=[] 2024-09-12T00:40:53.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.103+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): orig_dests= new_dests= 2024-09-12T00:40:53.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.103+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): potential dests added=[] removed=[] 2024-09-12T00:40:53.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.107+0000 7f1fbbfc59c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25.2.0 2024-09-12T00:40:53.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.107+0000 7f1fbbfc59c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25.2.0 2024-09-12T00:40:53.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.107+0000 7f1fbbfc59c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25.2.1 2024-09-12T00:40:53.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.107+0000 7f1fbbfc59c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25.2.1 2024-09-12T00:40:53.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.107+0000 7f1fbbfc59c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25.0 2024-09-12T00:40:53.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.111+0000 7f1fbbfc59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:53.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.111+0000 7f1fbbfc59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 2024-09-12T00:40:53.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1fbbfc59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:53.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1fbbfc59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:53.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1fbbfc59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:53.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1fbbfc59c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25, ofs0, ns] 2024-09-12T00:40:53.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1e9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366240 cookie 94747487207552 notifier 6452 bl.length()=939 2024-09-12T00:40:53.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1e9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:53.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1e9cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:53.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1e9cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:53.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): orig_sources= new_sources= 2024-09-12T00:40:53.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): potential sources added=[] removed=[] 2024-09-12T00:40:53.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): orig_dests= new_dests= 2024-09-12T00:40:53.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.115+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): potential dests added=[] removed=[] 2024-09-12T00:40:53.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.119+0000 7f1fbbfc59c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25.0 2024-09-12T00:40:53.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.119+0000 7f1fbbfc59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:53.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.119+0000 7f1fbbfc59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 2024-09-12T00:40:53.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1fbbfc59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:53.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1fbbfc59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:53.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1fbbfc59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:53.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1fbbfc59c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25, ofs0, ns] 2024-09-12T00:40:53.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1e9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366241 cookie 94747487207552 notifier 6452 bl.length()=907 2024-09-12T00:40:53.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1e9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 info.flags=0x17 2024-09-12T00:40:53.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1e9d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 to cache LRU end 2024-09-12T00:40:53.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1e9d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:53.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): orig_sources= new_sources= 2024-09-12T00:40:53.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): potential sources added=[] removed=[] 2024-09-12T00:40:53.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): orig_dests= new_dests= 2024-09-12T00:40:53.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.123+0000 7f1fbbfc59c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25]): potential dests added=[] removed=[] 2024-09-12T00:40:53.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.127+0000 7f1fbbfc59c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:40:53.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.127+0000 7f1e6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:53.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.131+0000 7f1fbbfc59c0 20 remove_watcher() i=0 2024-09-12T00:40:53.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.131+0000 7f1fbbfc59c0 2 removed watcher, disabling cache 2024-09-12T00:40:53.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.135+0000 7f1fbbfc59c0 20 remove_watcher() i=1 2024-09-12T00:40:53.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.139+0000 7f1fbbfc59c0 20 remove_watcher() i=2 2024-09-12T00:40:53.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.139+0000 7f1fbbfc59c0 20 remove_watcher() i=3 2024-09-12T00:40:53.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.143+0000 7f1fbbfc59c0 20 remove_watcher() i=4 2024-09-12T00:40:53.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.143+0000 7f1fbbfc59c0 20 remove_watcher() i=5 2024-09-12T00:40:53.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.147+0000 7f1fbbfc59c0 20 remove_watcher() i=6 2024-09-12T00:40:53.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.151+0000 7f1fbbfc59c0 20 remove_watcher() i=7 2024-09-12T00:40:53.164 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:40:53.192 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:53.192 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:53.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.239+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 realm 2024-09-12T00:40:53.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:53.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:53.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.243+0000 7fca18e399c0 20 searching for the correct realm 2024-09-12T00:40:53.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.251+0000 7fca0ffff640 0 -- 172.21.15.137:0/353313425 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fca000460b0 msgr2=0x7fca00071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:53.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.255+0000 7fca17140640 0 -- 172.21.15.137:0/353313425 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x559bac89ca90 msgr2=0x559bac89eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:53.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:53.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:53.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:53.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:53.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:53.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:53.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:53.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 zone default found 2024-09-12T00:40:53.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 4 Realm: () 2024-09-12T00:40:53.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:53.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:53.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:53.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 zonegroup default 2024-09-12T00:40:53.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.263+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.267+0000 7fca18e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.267+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.267+0000 7fca18e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.267+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.267+0000 7fca18e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.267+0000 7fca18e399c0 20 started sync module instance, tier type = 2024-09-12T00:40:53.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.267+0000 7fca18e399c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:53.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.283+0000 7fca18e399c0 20 add_watcher() i=0 2024-09-12T00:40:53.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.283+0000 7fca18e399c0 20 add_watcher() i=1 2024-09-12T00:40:53.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.283+0000 7fca18e399c0 20 add_watcher() i=2 2024-09-12T00:40:53.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.283+0000 7fca18e399c0 20 add_watcher() i=3 2024-09-12T00:40:53.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.283+0000 7fca18e399c0 20 add_watcher() i=4 2024-09-12T00:40:53.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.283+0000 7fca18e399c0 20 add_watcher() i=5 2024-09-12T00:40:53.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.283+0000 7fca18e399c0 20 add_watcher() i=6 2024-09-12T00:40:53.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.287+0000 7fca18e399c0 20 add_watcher() i=7 2024-09-12T00:40:53.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.287+0000 7fca18e399c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:53.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fc8cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:53.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fca18e399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:53.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fca18e399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:53.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fca18e399c0 5 note: GC not initialized 2024-09-12T00:40:53.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fc847fff640 20 reqs_thread_entry: start 2024-09-12T00:40:53.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fca18e399c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:53.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fca18e399c0 20 Filter name: none 2024-09-12T00:40:53.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fc845ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:53.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fca18e399c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:53.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.291+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.295+0000 7fca18e399c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:53.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.295+0000 7fca18e399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:53.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.295+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.295+0000 7fca18e399c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:53.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.295+0000 7fca18e399c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.295+0000 7fca18e399c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:53.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.295+0000 7fca18e399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:53.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.299+0000 7fc8cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:53.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.303+0000 7fca18e399c0 20 remove_watcher() i=0 2024-09-12T00:40:53.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.303+0000 7fca18e399c0 2 removed watcher, disabling cache 2024-09-12T00:40:53.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.307+0000 7fca18e399c0 20 remove_watcher() i=1 2024-09-12T00:40:53.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.307+0000 7fca18e399c0 20 remove_watcher() i=2 2024-09-12T00:40:53.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.311+0000 7fca18e399c0 20 remove_watcher() i=3 2024-09-12T00:40:53.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.311+0000 7fca18e399c0 20 remove_watcher() i=4 2024-09-12T00:40:53.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.315+0000 7fca18e399c0 20 remove_watcher() i=5 2024-09-12T00:40:53.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.319+0000 7fca18e399c0 20 remove_watcher() i=6 2024-09-12T00:40:53.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.319+0000 7fca18e399c0 20 remove_watcher() i=7 2024-09-12T00:40:53.335 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:53.335 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:53.335 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-trim-reshard-log-entries id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:40:53.335 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:53.336 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.337 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.340 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.340 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.394 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.394 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.421 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:40:53.422 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:53.422 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.423 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.438 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.438 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.484 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.484 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.503 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.504 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.524 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.524 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.544 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.544 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.564 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.564 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.585 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.585 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.604 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.604 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.624 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.624 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.646 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.646 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.666 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.666 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.684 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.685 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.704 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.704 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.723 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.724 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.743 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.744 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.763 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.763 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.782 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.782 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.802 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.802 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.821 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.821 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.842 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.861 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:53.878 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:40:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:53.954 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.955+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.955+0000 7f70701af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.955+0000 7f70701af9c0 20 realm 2024-09-12T00:40:53.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.955+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:53.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.959+0000 7f70701af9c0 20 searching for the correct realm 2024-09-12T00:40:53.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.967+0000 7f706e4b6640 0 -- 172.21.15.137:0/740403725 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f70640d0040 msgr2=0x7f70640f3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:53.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.971+0000 7f706dcb5640 0 -- 172.21.15.137:0/740403725 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f70680103e0 msgr2=0x7f7068010860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:53.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 zone default found 2024-09-12T00:40:53.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 4 Realm: () 2024-09-12T00:40:53.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:53.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:53.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:53.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 zonegroup default 2024-09-12T00:40:53.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.979+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.983+0000 7f70701af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.983+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.983+0000 7f70701af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.983+0000 7f70701af9c0 20 started sync module instance, tier type = 2024-09-12T00:40:53.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.983+0000 7f70701af9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:54.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.999+0000 7f70701af9c0 20 add_watcher() i=0 2024-09-12T00:40:54.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.999+0000 7f70701af9c0 20 add_watcher() i=1 2024-09-12T00:40:54.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.999+0000 7f70701af9c0 20 add_watcher() i=2 2024-09-12T00:40:54.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.999+0000 7f70701af9c0 20 add_watcher() i=3 2024-09-12T00:40:54.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.999+0000 7f70701af9c0 20 add_watcher() i=4 2024-09-12T00:40:54.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.999+0000 7f70701af9c0 20 add_watcher() i=5 2024-09-12T00:40:54.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:53.999+0000 7f70701af9c0 20 add_watcher() i=6 2024-09-12T00:40:54.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.003+0000 7f70701af9c0 20 add_watcher() i=7 2024-09-12T00:40:54.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.003+0000 7f70701af9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:54.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f6f1ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:54.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:54.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 5 note: GC not initialized 2024-09-12T00:40:54.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f6f1effd640 20 reqs_thread_entry: start 2024-09-12T00:40:54.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:54.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 Filter name: none 2024-09-12T00:40:54.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f6f1cff9640 20 reqs_thread_entry: start 2024-09-12T00:40:54.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:54.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:54.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:54.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:54.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.007+0000 7f70701af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.011+0000 7f70701af9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:54.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.011+0000 7f70701af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:54.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.011+0000 7f6f1ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.015+0000 7f70701af9c0 20 remove_watcher() i=0 2024-09-12T00:40:54.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.015+0000 7f70701af9c0 2 removed watcher, disabling cache 2024-09-12T00:40:54.018 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.019+0000 7f70701af9c0 20 remove_watcher() i=1 2024-09-12T00:40:54.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.019+0000 7f70701af9c0 20 remove_watcher() i=2 2024-09-12T00:40:54.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.023+0000 7f70701af9c0 20 remove_watcher() i=3 2024-09-12T00:40:54.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.023+0000 7f70701af9c0 20 remove_watcher() i=4 2024-09-12T00:40:54.026 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.027+0000 7f70701af9c0 20 remove_watcher() i=5 2024-09-12T00:40:54.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.027+0000 7f70701af9c0 20 remove_watcher() i=6 2024-09-12T00:40:54.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.031+0000 7f70701af9c0 20 remove_watcher() i=7 2024-09-12T00:40:54.045 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:54.045 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:54.045 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-trim-reshard-log-entries id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:54.045 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:54.045 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:40:54.080 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:54.080 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:54.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 20 realm 2024-09-12T00:40:54.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:54.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.123+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.127+0000 7f9b2101c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.127+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.127+0000 7f9b2101c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:54.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.127+0000 7f9b2101c9c0 20 searching for the correct realm 2024-09-12T00:40:54.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.131+0000 7f9b1f323640 0 -- 172.21.15.137:0/3190315324 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f9b140d1410 msgr2=0x7f9b140d1890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.139+0000 7f9b1eb22640 0 -- 172.21.15.137:0/3190315324 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f9b18094020 msgr2=0x7f9b18024040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:54.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:54.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:54.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:54.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:54.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:54.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:54.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 zone default found 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 4 Realm: () 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 zonegroup default 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 started sync module instance, tier type = 2024-09-12T00:40:54.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.147+0000 7f9b2101c9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:54.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.167+0000 7f9b2101c9c0 20 add_watcher() i=0 2024-09-12T00:40:54.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.167+0000 7f9b2101c9c0 20 add_watcher() i=1 2024-09-12T00:40:54.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.167+0000 7f9b2101c9c0 20 add_watcher() i=2 2024-09-12T00:40:54.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.167+0000 7f9b2101c9c0 20 add_watcher() i=3 2024-09-12T00:40:54.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.167+0000 7f9b2101c9c0 20 add_watcher() i=4 2024-09-12T00:40:54.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.167+0000 7f9b2101c9c0 20 add_watcher() i=5 2024-09-12T00:40:54.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.167+0000 7f9b2101c9c0 20 add_watcher() i=6 2024-09-12T00:40:54.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.171+0000 7f9b2101c9c0 20 add_watcher() i=7 2024-09-12T00:40:54.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.171+0000 7f9b2101c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:54.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.171+0000 7f99d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 5 note: GC not initialized 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f994ffff640 20 reqs_thread_entry: start 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 20 Filter name: none 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f994dffb640 20 reqs_thread_entry: start 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:40:54.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:54.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 : miss 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 info.flags=0x17 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 to cache LRU end 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.175+0000 7f9b2101c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 info.flags=0x17 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 to cache LRU end 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26, ofs0, ns] 2024-09-12T00:40:54.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9a01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 94383253203856 notifier 6503 bl.length()=939 2024-09-12T00:40:54.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9a01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 info.flags=0x17 2024-09-12T00:40:54.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9a01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 to cache LRU end 2024-09-12T00:40:54.183 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9a01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26]): orig_sources= new_sources= 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26]): potential sources added=[] removed=[] 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26]): orig_dests= new_dests= 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26]): potential dests added=[] removed=[] 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.183+0000 7f9b2101c9c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:40:54.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.187+0000 7f9b2101c9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26.1.0 2024-09-12T00:40:54.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.187+0000 7f9b2101c9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26.1.0 2024-09-12T00:40:54.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.187+0000 7f9b2101c9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26.1.1 2024-09-12T00:40:54.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.187+0000 7f9b2101c9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26.1.1 2024-09-12T00:40:54.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.187+0000 7f9b2101c9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26.0 2024-09-12T00:40:54.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9b2101c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:54.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9b2101c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 2024-09-12T00:40:54.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9b2101c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 info.flags=0x17 2024-09-12T00:40:54.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9b2101c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 to cache LRU end 2024-09-12T00:40:54.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9b2101c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:54.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9b2101c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26, ofs0, ns] 2024-09-12T00:40:54.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9a027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94383253203856 notifier 6503 bl.length()=907 2024-09-12T00:40:54.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9a027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 info.flags=0x17 2024-09-12T00:40:54.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9a027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 to cache LRU end 2024-09-12T00:40:54.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.191+0000 7f9a027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:54.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.195+0000 7f9b2101c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26]): orig_sources= new_sources= 2024-09-12T00:40:54.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.195+0000 7f9b2101c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26]): potential sources added=[] removed=[] 2024-09-12T00:40:54.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.195+0000 7f9b2101c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26]): orig_dests= new_dests= 2024-09-12T00:40:54.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.195+0000 7f9b2101c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26]): potential dests added=[] removed=[] 2024-09-12T00:40:54.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.195+0000 7f9b2101c9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:40:54.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.199+0000 7f99d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.203+0000 7f9b2101c9c0 20 remove_watcher() i=0 2024-09-12T00:40:54.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.203+0000 7f9b2101c9c0 2 removed watcher, disabling cache 2024-09-12T00:40:54.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.207+0000 7f9b2101c9c0 20 remove_watcher() i=1 2024-09-12T00:40:54.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.207+0000 7f9b2101c9c0 20 remove_watcher() i=2 2024-09-12T00:40:54.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.211+0000 7f9b2101c9c0 20 remove_watcher() i=3 2024-09-12T00:40:54.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.211+0000 7f9b2101c9c0 20 remove_watcher() i=4 2024-09-12T00:40:54.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.215+0000 7f9b2101c9c0 20 remove_watcher() i=5 2024-09-12T00:40:54.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.219+0000 7f9b2101c9c0 20 remove_watcher() i=6 2024-09-12T00:40:54.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.219+0000 7f9b2101c9c0 20 remove_watcher() i=7 2024-09-12T00:40:54.236 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:40:54.268 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:54.268 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:54.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.311+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 realm 2024-09-12T00:40:54.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:54.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.315+0000 7f14f1f9e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.319+0000 7f14f1f9e9c0 20 searching for the correct realm 2024-09-12T00:40:54.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.323+0000 7f14ef2a3640 0 -- 172.21.15.137:0/3813129670 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f14e40c6040 msgr2=0x7f14e40fd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.539+0000 7f14f02a5640 0 -- 172.21.15.137:0/3813129670 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55bee42bd2a0 msgr2=0x55bee42bf6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:54.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:54.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:54.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:54.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:54.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:54.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:54.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 zone default found 2024-09-12T00:40:54.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 4 Realm: () 2024-09-12T00:40:54.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:54.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:54.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:54.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 zonegroup default 2024-09-12T00:40:54.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.551+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.555+0000 7f14f1f9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.555+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.555+0000 7f14f1f9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.555+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.555+0000 7f14f1f9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.555+0000 7f14f1f9e9c0 20 started sync module instance, tier type = 2024-09-12T00:40:54.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.555+0000 7f14f1f9e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:54.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.579+0000 7f14f1f9e9c0 20 add_watcher() i=0 2024-09-12T00:40:54.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.579+0000 7f14f1f9e9c0 20 add_watcher() i=1 2024-09-12T00:40:54.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.579+0000 7f14f1f9e9c0 20 add_watcher() i=2 2024-09-12T00:40:54.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.579+0000 7f14f1f9e9c0 20 add_watcher() i=3 2024-09-12T00:40:54.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.579+0000 7f14f1f9e9c0 20 add_watcher() i=4 2024-09-12T00:40:54.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.579+0000 7f14f1f9e9c0 20 add_watcher() i=5 2024-09-12T00:40:54.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.579+0000 7f14f1f9e9c0 20 add_watcher() i=6 2024-09-12T00:40:54.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.583+0000 7f14f1f9e9c0 20 add_watcher() i=7 2024-09-12T00:40:54.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.583+0000 7f14f1f9e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:54.585 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f13a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f14f1f9e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:54.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f14f1f9e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:54.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f14f1f9e9c0 5 note: GC not initialized 2024-09-12T00:40:54.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f13a4fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:54.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f14f1f9e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:54.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f14f1f9e9c0 20 Filter name: none 2024-09-12T00:40:54.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f131e7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:54.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f14f1f9e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:54.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.587+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.591+0000 7f14f1f9e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:54.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.591+0000 7f14f1f9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:54.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.591+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.591+0000 7f14f1f9e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:54.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.591+0000 7f14f1f9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.591+0000 7f14f1f9e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:54.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.591+0000 7f14f1f9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:54.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.595+0000 7f13a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.599+0000 7f14f1f9e9c0 20 remove_watcher() i=0 2024-09-12T00:40:54.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.599+0000 7f14f1f9e9c0 2 removed watcher, disabling cache 2024-09-12T00:40:54.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.599+0000 7f14f1f9e9c0 20 remove_watcher() i=1 2024-09-12T00:40:54.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.603+0000 7f14f1f9e9c0 20 remove_watcher() i=2 2024-09-12T00:40:54.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.603+0000 7f14f1f9e9c0 20 remove_watcher() i=3 2024-09-12T00:40:54.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.607+0000 7f14f1f9e9c0 20 remove_watcher() i=4 2024-09-12T00:40:54.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.607+0000 7f14f1f9e9c0 20 remove_watcher() i=5 2024-09-12T00:40:54.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.611+0000 7f14f1f9e9c0 20 remove_watcher() i=6 2024-09-12T00:40:54.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:54.615+0000 7f14f1f9e9c0 20 remove_watcher() i=7 2024-09-12T00:40:54.628 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:54.629 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:54.629 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-trim-reshard-log-entries id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:40:54.629 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:54.630 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.630 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.633 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.633 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.679 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.679 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.701 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:40:54.701 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:54.702 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.702 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.718 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.718 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.765 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.765 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.789 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.789 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.809 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.809 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.830 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.830 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.850 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.850 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.920 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.920 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.942 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.942 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.964 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.964 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:54.985 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.985 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.005 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.005 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.027 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.027 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.048 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.048 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.068 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.068 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.089 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.090 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.110 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.111 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.131 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.131 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.153 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.153 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.176 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.196 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.219 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.237 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:40:55.270 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.270 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:55.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.315+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.315+0000 7f475b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.315+0000 7f475b5c19c0 20 realm 2024-09-12T00:40:55.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.315+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.315+0000 7f475b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.315+0000 7f475b5c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.315+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.319+0000 7f475b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.319+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.319+0000 7f475b5c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.319+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.319+0000 7f475b5c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.319+0000 7f475b5c19c0 20 searching for the correct realm 2024-09-12T00:40:55.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.327+0000 7f47598c8640 0 -- 172.21.15.137:0/4005703040 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f4750038040 msgr2=0x7f475001f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.331+0000 7f47590c7640 0 -- 172.21.15.137:0/4005703040 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f4754060830 msgr2=0x7f475405f2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:55.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:55.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 zone default found 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 4 Realm: () 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 zonegroup default 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.339+0000 7f475b5c19c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:55.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.359+0000 7f475b5c19c0 20 add_watcher() i=0 2024-09-12T00:40:55.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.359+0000 7f475b5c19c0 20 add_watcher() i=1 2024-09-12T00:40:55.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.359+0000 7f475b5c19c0 20 add_watcher() i=2 2024-09-12T00:40:55.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.359+0000 7f475b5c19c0 20 add_watcher() i=3 2024-09-12T00:40:55.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.359+0000 7f475b5c19c0 20 add_watcher() i=4 2024-09-12T00:40:55.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.359+0000 7f475b5c19c0 20 add_watcher() i=5 2024-09-12T00:40:55.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.359+0000 7f475b5c19c0 20 add_watcher() i=6 2024-09-12T00:40:55.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.363+0000 7f475b5c19c0 20 add_watcher() i=7 2024-09-12T00:40:55.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.363+0000 7f475b5c19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.363+0000 7f460f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.363+0000 7f475b5c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.363+0000 7f475b5c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.363+0000 7f475b5c19c0 5 note: GC not initialized 2024-09-12T00:40:55.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f460e7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:55.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:55.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 Filter name: none 2024-09-12T00:40:55.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f457ffff640 20 reqs_thread_entry: start 2024-09-12T00:40:55.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:55.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:55.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:55.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:55.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:55.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.367+0000 7f475b5c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:55.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.371+0000 7f460f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.375+0000 7f475b5c19c0 20 remove_watcher() i=0 2024-09-12T00:40:55.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.375+0000 7f475b5c19c0 2 removed watcher, disabling cache 2024-09-12T00:40:55.376 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.375+0000 7f475b5c19c0 20 remove_watcher() i=1 2024-09-12T00:40:55.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.379+0000 7f475b5c19c0 20 remove_watcher() i=2 2024-09-12T00:40:55.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.379+0000 7f475b5c19c0 20 remove_watcher() i=3 2024-09-12T00:40:55.382 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.383+0000 7f475b5c19c0 20 remove_watcher() i=4 2024-09-12T00:40:55.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.383+0000 7f475b5c19c0 20 remove_watcher() i=5 2024-09-12T00:40:55.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.387+0000 7f475b5c19c0 20 remove_watcher() i=6 2024-09-12T00:40:55.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.391+0000 7f475b5c19c0 20 remove_watcher() i=7 2024-09-12T00:40:55.403 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.403 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:55.403 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-trim-reshard-log-entries id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:55.404 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.404 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:40:55.436 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.436 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:55.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.479+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 realm 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 searching for the correct realm 2024-09-12T00:40:55.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.491+0000 7fba33fff640 0 -- 172.21.15.137:0/336907368 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fba240e5900 msgr2=0x7fba240c13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.495+0000 7fba38c14640 0 -- 172.21.15.137:0/336907368 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fba34084040 msgr2=0x7fba3405cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:55.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:55.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:55.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 zone default found 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 Realm: () 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 zonegroup default 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:55.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=0 2024-09-12T00:40:55.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=1 2024-09-12T00:40:55.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=2 2024-09-12T00:40:55.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=3 2024-09-12T00:40:55.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=4 2024-09-12T00:40:55.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=5 2024-09-12T00:40:55.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=6 2024-09-12T00:40:55.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.527+0000 7fba3b10e9c0 20 add_watcher() i=7 2024-09-12T00:40:55.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.527+0000 7fba3b10e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fb8ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 note: GC not initialized 2024-09-12T00:40:55.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fb8ee7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:55.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:55.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 Filter name: none 2024-09-12T00:40:55.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:40:55.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fb8e7fff640 20 reqs_thread_entry: start 2024-09-12T00:40:55.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:55.534 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:40:55.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:40:55.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 : miss 2024-09-12T00:40:55.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:55.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:55.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 2024-09-12T00:40:55.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27, ofs0, ns] 2024-09-12T00:40:55.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366248 cookie 94277368663552 notifier 6846 bl.length()=939 2024-09-12T00:40:55.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_sources= new_sources= 2024-09-12T00:40:55.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential sources added=[] removed=[] 2024-09-12T00:40:55.542 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba3b10e9c0 time 2024-09-12T00:40:55.547440+0000 2024-09-12T00:40:55.543 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:55.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_dests= new_dests= 2024-09-12T00:40:55.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential dests added=[] removed=[] 2024-09-12T00:40:55.543 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:55.543 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fba3e9e82eb] 2024-09-12T00:40:55.543 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba3e9e849f] 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bea6af7cc1] 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422a3e) [0x55bea7555a3e] 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bea6b0cced] 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba3d84ed90] 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.543+0000 7fba3b10e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba3b10e9c0 time 2024-09-12T00:40:55.547440+0000 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:55.544 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fba3e9e82eb] 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba3e9e849f] 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bea6af7cc1] 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422a3e) [0x55bea7555a3e] 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bea6b0cced] 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba3d84ed90] 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:40:55.545 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.546 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:40:55.546 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7fba3b10e9c0 thread_name:radosgw-admin 2024-09-12T00:40:55.567 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:55.567 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fba3d867520] 2024-09-12T00:40:55.567 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:40:55.567 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:40:55.567 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fba3e9e8345] 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba3e9e849f] 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bea6af7cc1] 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422a3e) [0x55bea7555a3e] 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bea6b0cced] 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba3d84ed90] 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.543+0000 7fba3b10e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7fba3b10e9c0 thread_name:radosgw-admin 2024-09-12T00:40:55.568 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.569 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:55.569 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fba3d867520] 2024-09-12T00:40:55.569 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:40:55.569 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:40:55.569 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:40:55.569 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fba3e9e8345] 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba3e9e849f] 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bea6af7cc1] 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422a3e) [0x55bea7555a3e] 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bea6b0cced] 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba3d84ed90] 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:40:55.459+0000 7fba39415640 1 monclient: found mon.noname-a 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient: get_auth_request con 0x55bea8eafb90 auth_method 0 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: dump: 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.571 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: dump: 2024-09-12T00:40:55.572 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.573 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.573 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.573 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.573 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.573 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.573 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.573 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.573 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6834 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 4 set_mon_vals no callback set 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: shutdown 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) unregister_commands rotate-key 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: monmap: 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:55.574 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding auth protocol: cephx 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding auth protocol: cephx 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding auth protocol: cephx 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.575 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 librados: starting msgr at 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 librados: starting objecter 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command objecter_requests hook 0x55bea9053970 2024-09-12T00:40:55.576 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 librados: setting wanted keys 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 librados: calling monclient init 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: init 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding auth protocol: cephx 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding auth protocol: cephx 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding auth protocol: cephx 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.577 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command rotate-key hook 0x55bea9022948 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-a con 0x55bea8eafb90 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-b con 0x55bea8ed1110 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-c con 0x55bea8ed1a60 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.578 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): authenticate will time out at 2156.595423s 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): get_auth_request con 0x55bea8ed1a60 auth_method 0 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): get_auth_request con 0x55bea8eafb90 auth_method 0 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.579 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): handle_auth_done global_id 6548 payload 824 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient: _finish_hunting 0 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:40:55.459+0000 7fba39415640 1 monclient: found mon.noname-c 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: dump: 2024-09-12T00:40:55.580 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6548 2024-09-12T00:40:55.581 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: dump: 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.582 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:40:55.463+0000 7fb926e05640 4 set_mon_vals no callback set 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 1 librados: init done 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:40:55.463+0000 7fb925602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:40:55.463+0000 7fb925602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.583 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:40:55.463+0000 7fb925602640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:40:55.463+0000 7fba38c14640 10 monclient: get_auth_request con 0x7fb920070ae0 auth_method 0 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:40:55.463+0000 7fba33fff640 10 monclient: get_auth_request con 0x55bea904c290 auth_method 0 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:40:55.467+0000 7fba38c14640 10 monclient: get_auth_request con 0x55bea906d1f0 auth_method 0 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:40:55.467+0000 7fba33fff640 10 monclient: get_auth_request con 0x55bea9072280 auth_method 0 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 10 monclient: monmap: 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:55.584 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding auth protocol: cephx 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding auth protocol: cephx 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding auth protocol: cephx 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.585 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bea9079bc0 EEXIST 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: init 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding auth protocol: cephx 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding auth protocol: cephx 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding auth protocol: cephx 2024-09-12T00:40:55.586 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command rotate-key cmddesc rotate-key hook 0x55bea90752b0 EEXIST 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:55.587 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-c con 0x55bea909dd70 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-a con 0x55bea909d6a0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-b con 0x55bea909c080 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): authenticate will time out at 2156.604718s 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): get_auth_request con 0x55bea909d6a0 auth_method 0 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.588 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): get_auth_request con 0x55bea909dd70 auth_method 0 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.589 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:40:55.471+0000 7fba39415640 10 monclient(hunting): get_auth_request con 0x55bea909c080 auth_method 0 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:40:55.471+0000 7fba39415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:40:55.471+0000 7fba39415640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:40:55.471+0000 7fba39415640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): handle_auth_done global_id 6551 payload 824 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient: _finish_hunting 0 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:40:55.471+0000 7fba38c14640 1 monclient: found mon.noname-c 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: dump: 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.590 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: dump: 2024-09-12T00:40:55.591 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:40:55.471+0000 7fba39c16640 4 set_mon_vals no callback set 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6551 2024-09-12T00:40:55.592 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:40:55.475+0000 7fb91e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:40:55.475+0000 7fb91e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:40:55.475+0000 7fb91e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fb910070a20 auth_method 0 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:55.593 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: monmap: 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:55.594 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:55.595 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.595 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding auth protocol: cephx 2024-09-12T00:40:55.595 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding auth protocol: cephx 2024-09-12T00:40:55.595 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding auth protocol: cephx 2024-09-12T00:40:55.595 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.596 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: init 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding auth protocol: cephx 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding auth protocol: cephx 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding auth protocol: cephx 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.597 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1efb3cf8 EEXIST 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-b con 0x55bea90ebc80 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-c con 0x55bea90ec060 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-a con 0x55bea90ed520 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.598 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): authenticate will time out at 2156.609468s 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): get_auth_request con 0x55bea90ec060 auth_method 0 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): get_auth_request con 0x55bea90ed520 auth_method 0 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.599 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:40:55.475+0000 7fba38c14640 10 monclient(hunting): get_auth_request con 0x55bea90ebc80 auth_method 0 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:40:55.475+0000 7fba38c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:40:55.475+0000 7fba38c14640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:40:55.475+0000 7fba38c14640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): handle_auth_done global_id 6554 payload 274 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient: _finish_hunting 0 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:40:55.475+0000 7fba33fff640 1 monclient: found mon.noname-c 2024-09-12T00:40:55.600 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: dump: 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.601 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6554 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 4 set_mon_vals no callback set 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: dump: 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.602 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: shutdown 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: monmap: 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:55.603 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding auth protocol: cephx 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding auth protocol: cephx 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding auth protocol: cephx 2024-09-12T00:40:55.604 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.605 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 librados: starting msgr at 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 librados: starting objecter 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bea90a2980 EEXIST 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 librados: setting wanted keys 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 librados: calling monclient init 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: init 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding auth protocol: cephx 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding auth protocol: cephx 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding auth protocol: cephx 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.606 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.607 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.608 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command rotate-key cmddesc rotate-key hook 0x55bea909fcd8 EEXIST 2024-09-12T00:40:55.608 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:55.608 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:40:55.608 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-a con 0x55bea90ebc80 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:55.608 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-b con 0x55bea90ed520 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:55.608 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-c con 0x55bea90e0b80 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:55.608 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.609 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.609 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.609 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:55.609 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): authenticate will time out at 2156.612145s 2024-09-12T00:40:55.609 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): get_auth_request con 0x55bea90ebc80 auth_method 0 2024-09-12T00:40:55.609 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.609 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): get_auth_request con 0x55bea90e0b80 auth_method 0 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): handle_auth_done global_id 6846 payload 824 2024-09-12T00:40:55.610 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient: _finish_hunting 0 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:40:55.479+0000 7fba38c14640 1 monclient: found mon.noname-a 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: dump: 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.611 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: dump: 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.612 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:40:55.479+0000 7fb90ffff640 4 set_mon_vals no callback set 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6846 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 1 librados: init done 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cr dump hook 0x55bea90e1908 2024-09-12T00:40:55.613 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.614 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:55.614 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.614 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.614 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:40:55.479+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fb904070b10 auth_method 0 2024-09-12T00:40:55.614 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient: get_auth_request con 0x55bea910bfc0 auth_method 0 2024-09-12T00:40:55.614 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.614 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 realm 2024-09-12T00:40:55.614 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:40:55.483+0000 7fba38c14640 10 monclient: get_auth_request con 0x55bea91101b0 auth_method 0 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 searching for the correct realm 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:40:55.483+0000 7fba33fff640 10 monclient: get_auth_request con 0x55bea9115430 auth_method 0 2024-09-12T00:40:55.615 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:40:55.487+0000 7fba39415640 10 monclient: get_auth_request con 0x7fba240cf050 auth_method 0 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:40:55.487+0000 7fba38c14640 10 monclient: get_auth_request con 0x7fba2c090260 auth_method 0 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:40:55.487+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fba240e5900 auth_method 0 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:40:55.491+0000 7fba33fff640 0 -- 172.21.15.137:0/336907368 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fba240e5900 msgr2=0x7fba240c13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:40:55.491+0000 7fb90e7fc640 1 client.6846.objecter ms_handle_reset 0x7fba240e5900 session 0x7fba240b3040 osd.5 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:40:55.491+0000 7fb90e7fc640 10 monclient: _renew_subs 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:40:55.491+0000 7fb90e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:40:55.491+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fb904080ec0 auth_method 0 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:40:55.491+0000 7fba39415640 10 monclient: get_auth_request con 0x7fba2c09fbd0 auth_method 0 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:40:55.495+0000 7fba38c14640 10 monclient: get_auth_request con 0x7fba34084040 auth_method 0 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:40:55.495+0000 7fba38c14640 0 -- 172.21.15.137:0/336907368 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fba34084040 msgr2=0x7fba3405cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:40:55.495+0000 7fb90e7fc640 1 client.6846.objecter ms_handle_reset 0x7fba34084040 session 0x7fba34062b50 osd.3 2024-09-12T00:40:55.616 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:40:55.495+0000 7fba38c14640 10 monclient: get_auth_request con 0x7fba240e5900 auth_method 0 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.617 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 zone default found 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 Realm: () 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 zonegroup default 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.618 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=0 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=1 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=2 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=3 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=4 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=5 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=6 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:40:55.527+0000 7fba3b10e9c0 20 add_watcher() i=7 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:40:55.527+0000 7fba3b10e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding auth protocol: cephx 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding auth protocol: cephx 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding auth protocol: cephx 2024-09-12T00:40:55.619 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:40:55.531+0000 7fb8ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.620 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cache list hook 0x55bea90e0fa0 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cache inspect hook 0x55bea90e0fa0 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cache erase hook 0x55bea90e0fa0 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cache zap hook 0x55bea90e0fa0 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 note: GC not initialized 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:40:55.531+0000 7fb8ee7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command sync trace show hook 0x7fba24004e80 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command sync trace history hook 0x7fba24004e80 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command sync trace active hook 0x7fba24004e80 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command sync trace active_short hook 0x7fba24004e80 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 Filter name: none 2024-09-12T00:40:55.621 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:40:55.531+0000 7fb8e7fff640 20 reqs_thread_entry: start 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 : miss 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.622 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27, ofs0, ns] 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366248 cookie 94277368663552 notifier 6846 bl.length()=939 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_sources= new_sources= 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential sources added=[] removed=[] 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_dests= new_dests= 2024-09-12T00:40:55.623 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential dests added=[] removed=[] 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba3b10e9c0 time 2024-09-12T00:40:55.547440+0000 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fba3e9e82eb] 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba3e9e849f] 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bea6af7cc1] 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422a3e) [0x55bea7555a3e] 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bea6b0cced] 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba3d84ed90] 2024-09-12T00:40:55.624 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7fba3b10e9c0 thread_name:radosgw-admin 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fba3d867520] 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fba3e9e8345] 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba3e9e849f] 2024-09-12T00:40:55.625 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bea6af7cc1] 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422a3e) [0x55bea7555a3e] 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bea6b0cced] 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba3d84ed90] 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:40:55.626 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:40:55.627 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:40:55.628 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:40:55.629 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:40:55.630 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:40:55.631 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:55.632 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:55.633 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:40:55.634 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:40:55.634 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:40:55.634 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:55.636 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb8e7fff640 / http_manager 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb8ee7e4640 / http_manager 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb8ef7e6640 / rgw_dt_lg_renew 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb90e7fc640 / ms_dispatch 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb90ffff640 / io_context_pool 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb91e7fc640 / ms_dispatch 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb925602640 / ms_dispatch 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb926e05640 / io_context_pool 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba33fff640 / msgr-worker-2 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba38c14640 / msgr-worker-1 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba39415640 / msgr-worker-0 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba39c16640 / io_context_pool 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba3b10e9c0 / radosgw-admin 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.100113.log 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:40:55.459+0000 7fba39415640 1 monclient: found mon.noname-a 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient: get_auth_request con 0x55bea8eafb90 auth_method 0 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: dump: 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:40:55.459+0000 7fb926e05640 10 monclient: dump: 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6834 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 4 set_mon_vals no callback set 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: shutdown 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) unregister_commands rotate-key 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: monmap: 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:55.642 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding auth protocol: cephx 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding auth protocol: cephx 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding auth protocol: cephx 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.643 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: crc 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9027c40) adding con mode: secure 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 librados: starting msgr at 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 librados: starting objecter 2024-09-12T00:40:55.644 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command objecter_requests hook 0x55bea9053970 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 librados: setting wanted keys 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 1 librados: calling monclient init 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: init 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding auth protocol: cephx 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding auth protocol: cephx 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding auth protocol: cephx 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.645 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: crc 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9022800) adding con mode: secure 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command rotate-key hook 0x55bea9022948 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-a con 0x55bea8eafb90 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-b con 0x55bea8ed1110 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-c con 0x55bea8ed1a60 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:40:55.459+0000 7fba3b10e9c0 10 monclient(hunting): authenticate will time out at 2156.595423s 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): get_auth_request con 0x55bea8ed1a60 auth_method 0 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): get_auth_request con 0x55bea8eafb90 auth_method 0 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.647 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:40:55.459+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient(hunting): handle_auth_done global_id 6548 payload 824 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient: _finish_hunting 0 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:40:55.459+0000 7fba39415640 1 monclient: found mon.noname-c 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:40:55.459+0000 7fba39415640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: dump: 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.648 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.649 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6548 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:40:55.463+0000 7fb925602640 10 monclient: dump: 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.650 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:40:55.463+0000 7fb926e05640 4 set_mon_vals no callback set 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:40:55.463+0000 7fba3b10e9c0 1 librados: init done 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:40:55.463+0000 7fb925602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:40:55.463+0000 7fb925602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:40:55.463+0000 7fb925602640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:40:55.463+0000 7fba38c14640 10 monclient: get_auth_request con 0x7fb920070ae0 auth_method 0 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:40:55.463+0000 7fba33fff640 10 monclient: get_auth_request con 0x55bea904c290 auth_method 0 2024-09-12T00:40:55.651 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:40:55.467+0000 7fba38c14640 10 monclient: get_auth_request con 0x55bea906d1f0 auth_method 0 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:40:55.467+0000 7fba33fff640 10 monclient: get_auth_request con 0x55bea9072280 auth_method 0 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 10 monclient: monmap: 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:55.652 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding auth protocol: cephx 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding auth protocol: cephx 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding auth protocol: cephx 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.653 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: crc 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90761b0) adding con mode: secure 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:40:55.467+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bea9079bc0 EEXIST 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: init 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding auth protocol: cephx 2024-09-12T00:40:55.654 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding auth protocol: cephx 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding auth protocol: cephx 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: crc 2024-09-12T00:40:55.655 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea9075168) adding con mode: secure 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command rotate-key cmddesc rotate-key hook 0x55bea90752b0 EEXIST 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-c con 0x55bea909dd70 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-a con 0x55bea909d6a0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-b con 0x55bea909c080 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:55.656 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient(hunting): authenticate will time out at 2156.604718s 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): get_auth_request con 0x55bea909d6a0 auth_method 0 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): get_auth_request con 0x55bea909dd70 auth_method 0 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.657 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:40:55.471+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:40:55.471+0000 7fba39415640 10 monclient(hunting): get_auth_request con 0x55bea909c080 auth_method 0 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:40:55.471+0000 7fba39415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:40:55.471+0000 7fba39415640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:40:55.471+0000 7fba39415640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient(hunting): handle_auth_done global_id 6551 payload 824 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient: _finish_hunting 0 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:40:55.471+0000 7fba38c14640 1 monclient: found mon.noname-c 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:40:55.471+0000 7fba38c14640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.658 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: dump: 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.659 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:40:55.471+0000 7fb91e7fc640 10 monclient: dump: 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.660 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:40:55.471+0000 7fba39c16640 4 set_mon_vals no callback set 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6551 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:40:55.471+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:40:55.475+0000 7fb91e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:40:55.475+0000 7fb91e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:40:55.475+0000 7fb91e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fb910070a20 auth_method 0 2024-09-12T00:40:55.661 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: monmap: 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:55.662 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding auth protocol: cephx 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding auth protocol: cephx 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding auth protocol: cephx 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.663 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: crc 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90bd6c0) adding con mode: secure 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: init 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding auth protocol: cephx 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding auth protocol: cephx 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding auth protocol: cephx 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.664 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: crc 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb3bb0) adding con mode: secure 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.665 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1efb3cf8 EEXIST 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-b con 0x55bea90ebc80 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-c con 0x55bea90ec060 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-a con 0x55bea90ed520 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient(hunting): authenticate will time out at 2156.609468s 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): get_auth_request con 0x55bea90ec060 auth_method 0 2024-09-12T00:40:55.666 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): get_auth_request con 0x55bea90ed520 auth_method 0 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.667 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:40:55.475+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.668 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:40:55.475+0000 7fba38c14640 10 monclient(hunting): get_auth_request con 0x55bea90ebc80 auth_method 0 2024-09-12T00:40:55.668 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:40:55.475+0000 7fba38c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.668 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:40:55.475+0000 7fba38c14640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.668 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:40:55.475+0000 7fba38c14640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.668 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient(hunting): handle_auth_done global_id 6554 payload 274 2024-09-12T00:40:55.668 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient: _finish_hunting 0 2024-09-12T00:40:55.668 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:40:55.475+0000 7fba33fff640 1 monclient: found mon.noname-c 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:40:55.475+0000 7fba33fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: dump: 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.669 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6554 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 4 set_mon_vals no callback set 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:40:55.475+0000 7fb90ffff640 10 monclient: dump: 2024-09-12T00:40:55.670 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: shutdown 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:55.671 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: monmap: 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:40:55.672 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding auth protocol: cephx 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding auth protocol: cephx 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding auth protocol: cephx 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.673 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: crc 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea90e4200) adding con mode: secure 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 librados: starting msgr at 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 librados: starting objecter 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bea90a2980 EEXIST 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 librados: setting wanted keys 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 1 librados: calling monclient init 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 10 monclient: init 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding auth protocol: cephx 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding auth protocol: cephx 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding auth protocol: cephx 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.674 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: crc 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 5 AuthRegistry(0x55bea909fb90) adding con mode: secure 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:40:55.475+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.675 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command rotate-key cmddesc rotate-key hook 0x55bea909fcd8 EEXIST 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-a con 0x55bea90ebc80 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-b con 0x55bea90ed520 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): picked mon.noname-c con 0x55bea90e0b80 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient(hunting): authenticate will time out at 2156.612145s 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): get_auth_request con 0x55bea90ebc80 auth_method 0 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.676 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): get_auth_request con 0x55bea90e0b80 auth_method 0 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient(hunting): handle_auth_done global_id 6846 payload 824 2024-09-12T00:40:55.677 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient: _finish_hunting 0 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:40:55.479+0000 7fba38c14640 1 monclient: found mon.noname-a 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:40:55.479+0000 7fba38c14640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: dump: 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.678 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 10 monclient: dump: 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:55.679 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:40:55.479+0000 7fb90ffff640 4 set_mon_vals no callback set 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 5 monclient: authenticate success, global_id 6846 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _renew_subs 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.680 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 1 librados: init done 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cr dump hook 0x55bea90e1908 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:40:55.479+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:40:55.479+0000 7fb90e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:40:55.479+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fb904070b10 auth_method 0 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:40:55.479+0000 7fba39415640 10 monclient: get_auth_request con 0x55bea910bfc0 auth_method 0 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.681 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 realm 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:40:55.483+0000 7fba38c14640 10 monclient: get_auth_request con 0x55bea91101b0 auth_method 0 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:40:55.483+0000 7fba3b10e9c0 20 searching for the correct realm 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:40:55.483+0000 7fba33fff640 10 monclient: get_auth_request con 0x55bea9115430 auth_method 0 2024-09-12T00:40:55.682 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:40:55.487+0000 7fba39415640 10 monclient: get_auth_request con 0x7fba240cf050 auth_method 0 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:40:55.487+0000 7fba38c14640 10 monclient: get_auth_request con 0x7fba2c090260 auth_method 0 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:40:55.487+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fba240e5900 auth_method 0 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:40:55.491+0000 7fba33fff640 0 -- 172.21.15.137:0/336907368 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fba240e5900 msgr2=0x7fba240c13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:40:55.491+0000 7fb90e7fc640 1 client.6846.objecter ms_handle_reset 0x7fba240e5900 session 0x7fba240b3040 osd.5 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:40:55.491+0000 7fb90e7fc640 10 monclient: _renew_subs 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:40:55.491+0000 7fb90e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:40:55.491+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fb904080ec0 auth_method 0 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:40:55.491+0000 7fba39415640 10 monclient: get_auth_request con 0x7fba2c09fbd0 auth_method 0 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:40:55.495+0000 7fba38c14640 10 monclient: get_auth_request con 0x7fba34084040 auth_method 0 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:40:55.495+0000 7fba38c14640 0 -- 172.21.15.137:0/336907368 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fba34084040 msgr2=0x7fba3405cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:40:55.495+0000 7fb90e7fc640 1 client.6846.objecter ms_handle_reset 0x7fba34084040 session 0x7fba34062b50 osd.3 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:40:55.495+0000 7fba38c14640 10 monclient: get_auth_request con 0x7fba240e5900 auth_method 0 2024-09-12T00:40:55.683 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 zone default found 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 Realm: () 2024-09-12T00:40:55.684 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 zonegroup default 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:40:55.503+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:40:55.507+0000 7fba3b10e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=0 2024-09-12T00:40:55.685 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=1 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=2 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=3 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=4 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=5 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:40:55.523+0000 7fba3b10e9c0 20 add_watcher() i=6 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:40:55.527+0000 7fba3b10e9c0 20 add_watcher() i=7 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:40:55.527+0000 7fba3b10e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding auth protocol: cephx 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding auth protocol: cephx 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding auth protocol: cephx 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.686 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:40:55.531+0000 7fb8ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: crc 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 AuthRegistry(0x7fff1efb4090) adding con mode: secure 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.687 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cache list hook 0x55bea90e0fa0 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cache inspect hook 0x55bea90e0fa0 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cache erase hook 0x55bea90e0fa0 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command cache zap hook 0x55bea90e0fa0 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 note: GC not initialized 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:40:55.531+0000 7fb8ee7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command sync trace show hook 0x7fba24004e80 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command sync trace history hook 0x7fba24004e80 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command sync trace active hook 0x7fba24004e80 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 5 asok(0x55bea8e172b0) register_command sync trace active_short hook 0x7fba24004e80 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 Filter name: none 2024-09-12T00:40:55.688 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:40:55.531+0000 7fb8e7fff640 20 reqs_thread_entry: start 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 : miss 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:40:55.689 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:40:55.531+0000 7fba3b10e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:40:55.539+0000 7fba3b10e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27, ofs0, ns] 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366248 cookie 94277368663552 notifier 6846 bl.length()=939 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:40:55.539+0000 7fb90ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.690 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_sources= new_sources= 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential sources added=[] removed=[] 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_dests= new_dests= 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential dests added=[] removed=[] 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba3b10e9c0 time 2024-09-12T00:40:55.547440+0000 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fba3e9e82eb] 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba3e9e849f] 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bea6af7cc1] 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422a3e) [0x55bea7555a3e] 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bea6b0cced] 2024-09-12T00:40:55.691 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba3d84ed90] 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:40:55.543+0000 7fba3b10e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7fba3b10e9c0 thread_name:radosgw-admin 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fba3d867520] 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:40:55.692 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fba3e9e8345] 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba3e9e849f] 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bea6af7cc1] 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422a3e) [0x55bea7555a3e] 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bea6b0cced] 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba3d84ed90] 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:40:55.693 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:55.694 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:40:55.695 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:40:55.695 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:40:55.695 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:40:55.695 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:40:55.695 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:40:55.695 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:40:55.696 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:40:55.697 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:40:55.698 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:55.699 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:55.700 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb8e7fff640 / http_manager 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb8ee7e4640 / http_manager 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb8ef7e6640 / rgw_dt_lg_renew 2024-09-12T00:40:55.701 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb90e7fc640 / ms_dispatch 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb90ffff640 / io_context_pool 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb91e7fc640 / ms_dispatch 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb925602640 / ms_dispatch 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fb926e05640 / io_context_pool 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba33fff640 / msgr-worker-2 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba38c14640 / msgr-worker-1 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba39415640 / msgr-worker-0 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba39c16640 / io_context_pool 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: 7fba3b10e9c0 / radosgw-admin 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:40:55.549903Z_9e30d055-729e-4a9b-b6be-4e74c38d5b96/log 2024-09-12T00:40:55.702 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:40:55.703 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:40:55.703 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.623+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 realm 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.627+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.631+0000 7ff9b96279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.631+0000 7ff9b96279c0 20 searching for the correct realm 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.635+0000 7ff9b692c640 0 -- 172.21.15.137:0/263794587 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7ff9ac090120 msgr2=0x7ff9ac05bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.639+0000 7ff9b792e640 0 -- 172.21.15.137:0/263794587 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x563eb1e851b0 msgr2=0x563eb1e87670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.647+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 zone default found 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 4 Realm: () 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 zonegroup default 2024-09-12T00:40:55.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.651+0000 7ff9b96279c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.671+0000 7ff9b96279c0 20 add_watcher() i=0 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.671+0000 7ff9b96279c0 20 add_watcher() i=1 2024-09-12T00:40:55.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.671+0000 7ff9b96279c0 20 add_watcher() i=2 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.671+0000 7ff9b96279c0 20 add_watcher() i=3 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.671+0000 7ff9b96279c0 20 add_watcher() i=4 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.671+0000 7ff9b96279c0 20 add_watcher() i=5 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.671+0000 7ff9b96279c0 20 add_watcher() i=6 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.675+0000 7ff9b96279c0 20 add_watcher() i=7 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.675+0000 7ff9b96279c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff86dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 5 note: GC not initialized 2024-09-12T00:40:55.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff86cfe1640 20 reqs_thread_entry: start 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 Filter name: none 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff7e67fc640 20 reqs_thread_entry: start 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.679+0000 7ff9b96279c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.683+0000 7ff9b96279c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.683+0000 7ff9b96279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:55.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.683+0000 7ff86dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.687+0000 7ff9b96279c0 20 remove_watcher() i=0 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.687+0000 7ff9b96279c0 2 removed watcher, disabling cache 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.691+0000 7ff9b96279c0 20 remove_watcher() i=1 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.691+0000 7ff9b96279c0 20 remove_watcher() i=2 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.691+0000 7ff9b96279c0 20 remove_watcher() i=3 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.695+0000 7ff9b96279c0 20 remove_watcher() i=4 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.695+0000 7ff9b96279c0 20 remove_watcher() i=5 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.699+0000 7ff9b96279c0 20 remove_watcher() i=6 2024-09-12T00:40:55.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.703+0000 7ff9b96279c0 20 remove_watcher() i=7 2024-09-12T00:40:55.716 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.716 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:40:55.716 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-trim-reshard-log-entries id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:40:55.716 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:40:55.717 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.717 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.728 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.728 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:40:55.775 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:55.810 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.810 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:55.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.855+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.855+0000 7fc1ece569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.855+0000 7fc1ece569c0 20 realm 2024-09-12T00:40:55.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.855+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.859+0000 7fc1ece569c0 20 searching for the correct realm 2024-09-12T00:40:55.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.867+0000 7fc1eb15d640 0 -- 172.21.15.137:0/100527980 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fc1e00c0020 msgr2=0x7fc1e00f9ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.871+0000 7fc1ea95c640 0 -- 172.21.15.137:0/100527980 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fc1e00c0020 msgr2=0x7fc0b4085bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:40:55.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:40:55.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.879+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 zone default found 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 4 Realm: () 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 zonegroup default 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.883+0000 7fc1ece569c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:40:55.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 20 add_watcher() i=0 2024-09-12T00:40:55.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 20 add_watcher() i=1 2024-09-12T00:40:55.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 20 add_watcher() i=2 2024-09-12T00:40:55.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 20 add_watcher() i=3 2024-09-12T00:40:55.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 20 add_watcher() i=4 2024-09-12T00:40:55.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 20 add_watcher() i=5 2024-09-12T00:40:55.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 20 add_watcher() i=6 2024-09-12T00:40:55.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 20 add_watcher() i=7 2024-09-12T00:40:55.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.903+0000 7fc1ece569c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.907+0000 7fc0a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.907+0000 7fc1ece569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.907+0000 7fc1ece569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 5 note: GC not initialized 2024-09-12T00:40:55.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc01bfff640 20 reqs_thread_entry: start 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 20 init_complete bucket index max shards: 1 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 20 Filter name: none 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc019ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 : miss 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.911+0000 7fc1ece569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 2024-09-12T00:40:55.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.915+0000 7fc1ece569c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to be held by another RGW process; skipping for now 2024-09-12T00:40:55.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.915+0000 7fc0a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.919+0000 7fc1ece569c0 20 remove_watcher() i=0 2024-09-12T00:40:55.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.919+0000 7fc1ece569c0 2 removed watcher, disabling cache 2024-09-12T00:40:55.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.923+0000 7fc1ece569c0 20 remove_watcher() i=1 2024-09-12T00:40:55.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.923+0000 7fc1ece569c0 20 remove_watcher() i=2 2024-09-12T00:40:55.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.927+0000 7fc1ece569c0 20 remove_watcher() i=3 2024-09-12T00:40:55.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.931+0000 7fc1ece569c0 20 remove_watcher() i=4 2024-09-12T00:40:55.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.931+0000 7fc1ece569c0 20 remove_watcher() i=5 2024-09-12T00:40:55.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.935+0000 7fc1ece569c0 20 remove_watcher() i=6 2024-09-12T00:40:55.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:40:55.935+0000 7fc1ece569c0 20 remove_watcher() i=7 2024-09-12T00:40:55.952 INFO:tasks.workunit.client.0.smithi137.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:41:25.983 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:41:26.020 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:26.020 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:26.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.070+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.070+0000 7f90a1c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.070+0000 7f90a1c319c0 20 realm 2024-09-12T00:41:26.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.070+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:26.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:26.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:26.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.074+0000 7f90a1c319c0 20 searching for the correct realm 2024-09-12T00:41:26.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.082+0000 7f909f737640 0 -- 172.21.15.137:0/2167861154 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x5576e88a4910 msgr2=0x7f90980f0950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:26.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.086+0000 7f909f737640 0 -- 172.21.15.137:0/2167861154 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f909001a040 msgr2=0x7f909005d7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:26.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:26.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:26.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:26.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:26.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:26.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:26.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:26.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:26.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 zone default found 2024-09-12T00:41:26.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 4 Realm: () 2024-09-12T00:41:26.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:26.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:26.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:26.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 zonegroup default 2024-09-12T00:41:26.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 started sync module instance, tier type = 2024-09-12T00:41:26.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.094+0000 7f90a1c319c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:26.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 20 add_watcher() i=0 2024-09-12T00:41:26.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 20 add_watcher() i=1 2024-09-12T00:41:26.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 20 add_watcher() i=2 2024-09-12T00:41:26.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 20 add_watcher() i=3 2024-09-12T00:41:26.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 20 add_watcher() i=4 2024-09-12T00:41:26.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 20 add_watcher() i=5 2024-09-12T00:41:26.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 20 add_watcher() i=6 2024-09-12T00:41:26.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 20 add_watcher() i=7 2024-09-12T00:41:26.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.130+0000 7f90a1c319c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:26.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.134+0000 7f8f55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:26.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.134+0000 7f90a1c319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:26.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.134+0000 7f90a1c319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:26.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 5 note: GC not initialized 2024-09-12T00:41:26.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f8f54fe1640 20 reqs_thread_entry: start 2024-09-12T00:41:26.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:26.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 20 Filter name: none 2024-09-12T00:41:26.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f8ece7fc640 20 reqs_thread_entry: start 2024-09-12T00:41:26.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:41:26.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:41:26.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:41:26.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:41:26.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 : miss 2024-09-12T00:41:26.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:41:26.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:41:26.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:41:26.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:26.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:26.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.138+0000 7f90a1c319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 2024-09-12T00:41:26.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.142+0000 7f90a1c319c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:41:26.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f90a1c319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:41:26.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f90a1c319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:41:26.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f90a1c319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:26.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f90a1c319c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27, ofs0, ns] 2024-09-12T00:41:26.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f8f82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366249 cookie 93969198283648 notifier 6608 bl.length()=939 2024-09-12T00:41:26.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f8f82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:41:26.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f8f82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:41:26.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f8f82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:26.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_sources= new_sources= 2024-09-12T00:41:26.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential sources added=[] removed=[] 2024-09-12T00:41:26.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_dests= new_dests= 2024-09-12T00:41:26.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.150+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential dests added=[] removed=[] 2024-09-12T00:41:26.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.154+0000 7f90a1c319c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27.2.0 2024-09-12T00:41:26.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.154+0000 7f90a1c319c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27.2.0 2024-09-12T00:41:26.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.154+0000 7f90a1c319c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27.2.1 2024-09-12T00:41:26.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.154+0000 7f90a1c319c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27.2.1 2024-09-12T00:41:26.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.154+0000 7f90a1c319c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27.0 2024-09-12T00:41:26.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.158+0000 7f90a1c319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:26.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.158+0000 7f90a1c319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 2024-09-12T00:41:26.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f90a1c319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:41:26.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f90a1c319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:41:26.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f90a1c319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:26.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f90a1c319c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27, ofs0, ns] 2024-09-12T00:41:26.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f8f827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 93969198283648 notifier 6608 bl.length()=939 2024-09-12T00:41:26.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f8f827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:41:26.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f8f827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:41:26.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f8f827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:26.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_sources= new_sources= 2024-09-12T00:41:26.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential sources added=[] removed=[] 2024-09-12T00:41:26.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_dests= new_dests= 2024-09-12T00:41:26.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.162+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential dests added=[] removed=[] 2024-09-12T00:41:26.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.166+0000 7f90a1c319c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27.0 2024-09-12T00:41:26.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.166+0000 7f90a1c319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:26.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.166+0000 7f90a1c319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 2024-09-12T00:41:26.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f90a1c319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:41:26.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f90a1c319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:41:26.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f90a1c319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:26.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f90a1c319c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27, ofs0, ns] 2024-09-12T00:41:26.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f8f827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366251 cookie 93969198283648 notifier 6608 bl.length()=907 2024-09-12T00:41:26.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f8f827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 info.flags=0x17 2024-09-12T00:41:26.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f8f827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 to cache LRU end 2024-09-12T00:41:26.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f8f827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:26.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_sources= new_sources= 2024-09-12T00:41:26.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential sources added=[] removed=[] 2024-09-12T00:41:26.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): orig_dests= new_dests= 2024-09-12T00:41:26.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.170+0000 7f90a1c319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27]): potential dests added=[] removed=[] 2024-09-12T00:41:26.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.174+0000 7f90a1c319c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:41:26.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.178+0000 7f8f55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:26.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.182+0000 7f90a1c319c0 20 remove_watcher() i=0 2024-09-12T00:41:26.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.182+0000 7f90a1c319c0 2 removed watcher, disabling cache 2024-09-12T00:41:26.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.182+0000 7f90a1c319c0 20 remove_watcher() i=1 2024-09-12T00:41:26.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.186+0000 7f90a1c319c0 20 remove_watcher() i=2 2024-09-12T00:41:26.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.186+0000 7f90a1c319c0 20 remove_watcher() i=3 2024-09-12T00:41:26.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.190+0000 7f90a1c319c0 20 remove_watcher() i=4 2024-09-12T00:41:26.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.194+0000 7f90a1c319c0 20 remove_watcher() i=5 2024-09-12T00:41:26.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.194+0000 7f90a1c319c0 20 remove_watcher() i=6 2024-09-12T00:41:26.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.198+0000 7f90a1c319c0 20 remove_watcher() i=7 2024-09-12T00:41:26.212 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:41:26.244 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:26.244 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:26.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.290+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 realm 2024-09-12T00:41:26.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:26.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:26.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:26.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.294+0000 7f1e15e339c0 20 searching for the correct realm 2024-09-12T00:41:26.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.302+0000 7f1e0b138640 0 -- 172.21.15.137:0/1813914176 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f1dfc0c8910 msgr2=0x7f1dfc0bf3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:26.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.518+0000 7f1e0b138640 0 -- 172.21.15.137:0/1813914176 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5646d09a4290 msgr2=0x5646d09a6720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:26.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.526+0000 7f1e15e339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:26.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.526+0000 7f1e15e339c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:26.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.526+0000 7f1e15e339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:26.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.526+0000 7f1e15e339c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:26.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.526+0000 7f1e15e339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:26.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.526+0000 7f1e15e339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:26.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.526+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:26.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:26.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 zone default found 2024-09-12T00:41:26.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 4 Realm: () 2024-09-12T00:41:26.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:26.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:26.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:26.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 zonegroup default 2024-09-12T00:41:26.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.530+0000 7f1e15e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.534+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.534+0000 7f1e15e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.534+0000 7f1e15e339c0 20 started sync module instance, tier type = 2024-09-12T00:41:26.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.534+0000 7f1e15e339c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:26.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.558+0000 7f1e15e339c0 20 add_watcher() i=0 2024-09-12T00:41:26.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.558+0000 7f1e15e339c0 20 add_watcher() i=1 2024-09-12T00:41:26.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.558+0000 7f1e15e339c0 20 add_watcher() i=2 2024-09-12T00:41:26.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.558+0000 7f1e15e339c0 20 add_watcher() i=3 2024-09-12T00:41:26.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.558+0000 7f1e15e339c0 20 add_watcher() i=4 2024-09-12T00:41:26.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.558+0000 7f1e15e339c0 20 add_watcher() i=5 2024-09-12T00:41:26.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.558+0000 7f1e15e339c0 20 add_watcher() i=6 2024-09-12T00:41:26.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.562+0000 7f1e15e339c0 20 add_watcher() i=7 2024-09-12T00:41:26.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.562+0000 7f1e15e339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:26.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1cc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:26.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1e15e339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:26.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1e15e339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:26.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1e15e339c0 5 note: GC not initialized 2024-09-12T00:41:26.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1cc8fe1640 20 reqs_thread_entry: start 2024-09-12T00:41:26.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1e15e339c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:26.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1e15e339c0 20 Filter name: none 2024-09-12T00:41:26.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1c427fc640 20 reqs_thread_entry: start 2024-09-12T00:41:26.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1e15e339c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:41:26.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.566+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.570+0000 7f1e15e339c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.570+0000 7f1e15e339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.570+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.570+0000 7f1e15e339c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.570+0000 7f1e15e339c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.570+0000 7f1e15e339c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:41:26.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.570+0000 7f1e15e339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:26.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.574+0000 7f1cc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:26.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.578+0000 7f1e15e339c0 20 remove_watcher() i=0 2024-09-12T00:41:26.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.578+0000 7f1e15e339c0 2 removed watcher, disabling cache 2024-09-12T00:41:26.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.578+0000 7f1e15e339c0 20 remove_watcher() i=1 2024-09-12T00:41:26.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.582+0000 7f1e15e339c0 20 remove_watcher() i=2 2024-09-12T00:41:26.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.582+0000 7f1e15e339c0 20 remove_watcher() i=3 2024-09-12T00:41:26.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.586+0000 7f1e15e339c0 20 remove_watcher() i=4 2024-09-12T00:41:26.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.586+0000 7f1e15e339c0 20 remove_watcher() i=5 2024-09-12T00:41:26.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.590+0000 7f1e15e339c0 20 remove_watcher() i=6 2024-09-12T00:41:26.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:26.594+0000 7f1e15e339c0 20 remove_watcher() i=7 2024-09-12T00:41:26.605 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:26.605 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:41:26.605 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-trim-reshard-log-entries id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:41:26.605 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:26.606 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.607 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.610 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.610 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.659 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.659 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.684 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:41:26.684 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:26.685 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.685 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.705 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.705 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.753 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.753 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.773 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.773 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.793 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.793 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.814 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.814 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.833 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.834 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.853 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.854 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.873 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.873 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.893 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.893 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.912 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.912 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.933 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.933 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.955 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.956 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.976 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.976 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:26.997 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:26.997 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:27.016 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:27.017 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:27.037 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:27.037 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:27.058 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:27.058 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:27.078 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:27.078 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:27.099 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:27.099 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:27.119 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:27.119 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:27.140 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:27.140 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:27.158 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:41:27.191 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:27.191 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:27.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.238+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 realm 2024-09-12T00:41:27.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:27.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:27.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.242+0000 7fec13a9e9c0 20 searching for the correct realm 2024-09-12T00:41:27.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.250+0000 7fec115a4640 0 -- 172.21.15.137:0/2058446657 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fec04017030 msgr2=0x7fec040496c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:27.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.466+0000 7fec115a4640 0 -- 172.21.15.137:0/2058446657 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fec0c007c20 msgr2=0x7fec0c0a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:27.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:27.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:27.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:27.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:27.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:27.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:27.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 zone default found 2024-09-12T00:41:27.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 4 Realm: () 2024-09-12T00:41:27.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:27.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:27.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:27.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 zonegroup default 2024-09-12T00:41:27.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.686+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.690+0000 7fec13a9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.690+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.690+0000 7fec13a9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.690+0000 7fec13a9e9c0 20 started sync module instance, tier type = 2024-09-12T00:41:27.687 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.690+0000 7fec13a9e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:27.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 20 add_watcher() i=0 2024-09-12T00:41:27.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 20 add_watcher() i=1 2024-09-12T00:41:27.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 20 add_watcher() i=2 2024-09-12T00:41:27.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 20 add_watcher() i=3 2024-09-12T00:41:27.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 20 add_watcher() i=4 2024-09-12T00:41:27.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 20 add_watcher() i=5 2024-09-12T00:41:27.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 20 add_watcher() i=6 2024-09-12T00:41:27.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 20 add_watcher() i=7 2024-09-12T00:41:27.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.714+0000 7fec13a9e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:27.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7feac77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fec13a9e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:27.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fec13a9e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:27.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fec13a9e9c0 5 note: GC not initialized 2024-09-12T00:41:27.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7feac67e4640 20 reqs_thread_entry: start 2024-09-12T00:41:27.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fec13a9e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:27.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fec13a9e9c0 20 Filter name: none 2024-09-12T00:41:27.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fea37fff640 20 reqs_thread_entry: start 2024-09-12T00:41:27.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fec13a9e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:27.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.722+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.726+0000 7fec13a9e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:27.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.726+0000 7fec13a9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:27.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.726+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.726+0000 7fec13a9e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:27.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.726+0000 7fec13a9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.726+0000 7fec13a9e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:27.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.726+0000 7fec13a9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:27.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.730+0000 7feac77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.734+0000 7fec13a9e9c0 20 remove_watcher() i=0 2024-09-12T00:41:27.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.734+0000 7fec13a9e9c0 2 removed watcher, disabling cache 2024-09-12T00:41:27.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.734+0000 7fec13a9e9c0 20 remove_watcher() i=1 2024-09-12T00:41:27.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.738+0000 7fec13a9e9c0 20 remove_watcher() i=2 2024-09-12T00:41:27.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.742+0000 7fec13a9e9c0 20 remove_watcher() i=3 2024-09-12T00:41:27.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.742+0000 7fec13a9e9c0 20 remove_watcher() i=4 2024-09-12T00:41:27.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.746+0000 7fec13a9e9c0 20 remove_watcher() i=5 2024-09-12T00:41:27.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.746+0000 7fec13a9e9c0 20 remove_watcher() i=6 2024-09-12T00:41:27.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.750+0000 7fec13a9e9c0 20 remove_watcher() i=7 2024-09-12T00:41:27.761 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:27.762 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:41:27.762 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-block-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:41:27.762 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:27.762 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:41:27.800 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:27.800 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:27.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.846+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.846+0000 7f34797379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.846+0000 7f34797379c0 20 realm 2024-09-12T00:41:27.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.846+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.846+0000 7f34797379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.846+0000 7f34797379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:27.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.846+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.850+0000 7f34797379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.850+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.850+0000 7f34797379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.850+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.850+0000 7f34797379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:27.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.850+0000 7f34797379c0 20 searching for the correct realm 2024-09-12T00:41:27.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.858+0000 7f3477a3e640 0 -- 172.21.15.137:0/3835316505 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f346c0c3440 msgr2=0x7f346c0c3880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.862+0000 7f347723d640 0 -- 172.21.15.137:0/3835316505 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f347002d040 msgr2=0x7f347001d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 zone default found 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 4 Realm: () 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 zonegroup default 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 started sync module instance, tier type = 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.870+0000 7f34797379c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 20 add_watcher() i=0 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 20 add_watcher() i=1 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 20 add_watcher() i=2 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 20 add_watcher() i=3 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 20 add_watcher() i=4 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 20 add_watcher() i=5 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 20 add_watcher() i=6 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 20 add_watcher() i=7 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.890+0000 7f34797379c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.894+0000 7f332dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.894+0000 7f34797379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.894+0000 7f34797379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.894+0000 7f34797379c0 5 note: GC not initialized 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.894+0000 7f332cfe1640 20 reqs_thread_entry: start 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.894+0000 7f34797379c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 20 Filter name: none 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f32a67fc640 20 reqs_thread_entry: start 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 : miss 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.898+0000 7f34797379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f34797379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f34797379c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f34797379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f34797379c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28, ofs0, ns] 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f335affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 93851484621760 notifier 6659 bl.length()=915 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f335affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f335affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f335affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_sources= new_sources= 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential sources added=[] removed=[] 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_dests= new_dests= 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.906+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential dests added=[] removed=[] 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.914+0000 7f34797379c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.1.0 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.914+0000 7f34797379c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.1.0 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.914+0000 7f34797379c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.1.1 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.914+0000 7f34797379c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.1.1 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.914+0000 7f34797379c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.0 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.918+0000 7f34797379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.918+0000 7f34797379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.918+0000 7f34797379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.918+0000 7f34797379c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.918+0000 7f34797379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.918+0000 7f34797379c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28, ofs0, ns] 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f335affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366255 cookie 93851484621760 notifier 6659 bl.length()=915 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f335affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f335affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f335affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_sources= new_sources= 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential sources added=[] removed=[] 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_dests= new_dests= 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential dests added=[] removed=[] 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f34797379c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.922+0000 7f34797379c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.926+0000 7f34797379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.926+0000 7f34797379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.930+0000 7f34797379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.930+0000 7f34797379c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.930+0000 7f34797379c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.930+0000 7f34797379c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28, ofs0, ns] 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.930+0000 7f335affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366256 cookie 93851484621760 notifier 6659 bl.length()=883 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.930+0000 7f335affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.930+0000 7f335affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.930+0000 7f335affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.934+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_sources= new_sources= 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.934+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential sources added=[] removed=[] 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.934+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_dests= new_dests= 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.934+0000 7f34797379c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential dests added=[] removed=[] 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.934+0000 7f34797379c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.938+0000 7f332dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.942+0000 7f34797379c0 20 remove_watcher() i=0 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.942+0000 7f34797379c0 2 removed watcher, disabling cache 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.946+0000 7f34797379c0 20 remove_watcher() i=1 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.950+0000 7f34797379c0 20 remove_watcher() i=2 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.950+0000 7f34797379c0 20 remove_watcher() i=3 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.954+0000 7f34797379c0 20 remove_watcher() i=4 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.954+0000 7f34797379c0 20 remove_watcher() i=5 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.958+0000 7f34797379c0 20 remove_watcher() i=6 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:27.962+0000 7f34797379c0 20 remove_watcher() i=7 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:41:28.006 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:28.006 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:28.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.054+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.054+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.054+0000 7f6aa8d0e9c0 20 realm 2024-09-12T00:41:28.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.054+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.054+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.054+0000 7f6aa8d0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:28.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.054+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.058+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.058+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.058+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:28.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.058+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.058+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:28.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.058+0000 7f6aa8d0e9c0 20 searching for the correct realm 2024-09-12T00:41:28.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.066+0000 7f6aa7015640 0 -- 172.21.15.137:0/3464726424 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f6a9c0ce040 msgr2=0x7f6a9c0e4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:28.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.070+0000 7f6aa6814640 0 -- 172.21.15.137:0/3464726424 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f6aa0017420 msgr2=0x7f6aa00178a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:28.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:28.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:28.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:28.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:28.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:28.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:28.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:28.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:28.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 zone default found 2024-09-12T00:41:28.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 4 Realm: () 2024-09-12T00:41:28.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 zonegroup default 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.078+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.082+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.082+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.082+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.082+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.082+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.082+0000 7f6aa8d0e9c0 20 started sync module instance, tier type = 2024-09-12T00:41:28.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.082+0000 7f6aa8d0e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:28.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.098+0000 7f6aa8d0e9c0 20 add_watcher() i=0 2024-09-12T00:41:28.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.098+0000 7f6aa8d0e9c0 20 add_watcher() i=1 2024-09-12T00:41:28.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.098+0000 7f6aa8d0e9c0 20 add_watcher() i=2 2024-09-12T00:41:28.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.098+0000 7f6aa8d0e9c0 20 add_watcher() i=3 2024-09-12T00:41:28.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.098+0000 7f6aa8d0e9c0 20 add_watcher() i=4 2024-09-12T00:41:28.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.098+0000 7f6aa8d0e9c0 20 add_watcher() i=5 2024-09-12T00:41:28.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.098+0000 7f6aa8d0e9c0 20 add_watcher() i=6 2024-09-12T00:41:28.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.102+0000 7f6aa8d0e9c0 20 add_watcher() i=7 2024-09-12T00:41:28.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.102+0000 7f6aa8d0e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:28.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f695d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 5 note: GC not initialized 2024-09-12T00:41:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f68d7fff640 20 reqs_thread_entry: start 2024-09-12T00:41:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 Filter name: none 2024-09-12T00:41:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f68d5ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:28.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.106+0000 7f6aa8d0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:28.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.110+0000 7f695d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:28.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.114+0000 7f6aa8d0e9c0 20 remove_watcher() i=0 2024-09-12T00:41:28.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.114+0000 7f6aa8d0e9c0 2 removed watcher, disabling cache 2024-09-12T00:41:28.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.114+0000 7f6aa8d0e9c0 20 remove_watcher() i=1 2024-09-12T00:41:28.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.118+0000 7f6aa8d0e9c0 20 remove_watcher() i=2 2024-09-12T00:41:28.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.118+0000 7f6aa8d0e9c0 20 remove_watcher() i=3 2024-09-12T00:41:28.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.122+0000 7f6aa8d0e9c0 20 remove_watcher() i=4 2024-09-12T00:41:28.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.122+0000 7f6aa8d0e9c0 20 remove_watcher() i=5 2024-09-12T00:41:28.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.126+0000 7f6aa8d0e9c0 20 remove_watcher() i=6 2024-09-12T00:41:28.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.130+0000 7f6aa8d0e9c0 20 remove_watcher() i=7 2024-09-12T00:41:28.139 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:28.139 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:41:28.139 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-block-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:41:28.139 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:28.140 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:28.140 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:28.152 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:28.152 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:28.194 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:41:28.225 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:28.226 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:28.470 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.474+0000 7f127eee6640 0 --2- 172.21.15.137:0/491409294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x555b4c136450 0x555b4c154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:41:28.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.478+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.482+0000 7f1280bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.482+0000 7f1280bdf9c0 20 realm 2024-09-12T00:41:28.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.482+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.482+0000 7f1280bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.482+0000 7f1280bdf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:28.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.482+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.482+0000 7f1280bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.482+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.686+0000 7f1280bdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:28.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.686+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.686+0000 7f1280bdf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:28.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.686+0000 7f1280bdf9c0 20 searching for the correct realm 2024-09-12T00:41:28.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.694+0000 7f127e6e5640 0 -- 172.21.15.137:0/491409294 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f1270034060 msgr2=0x7f127000b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:28.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:28.910+0000 7f127e6e5640 0 -- 172.21.15.137:0/491409294 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1278038900 msgr2=0x7f127802c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:29.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.126+0000 7f1280bdf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:29.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.126+0000 7f1280bdf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:29.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.126+0000 7f1280bdf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:29.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.126+0000 7f1280bdf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:29.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.126+0000 7f1280bdf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:29.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.126+0000 7f1280bdf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:29.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.126+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:29.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:29.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 zone default found 2024-09-12T00:41:29.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 4 Realm: () 2024-09-12T00:41:29.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:29.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:29.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:29.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 zonegroup default 2024-09-12T00:41:29.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.130+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.134+0000 7f1280bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.134+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.134+0000 7f1280bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.134+0000 7f1280bdf9c0 20 started sync module instance, tier type = 2024-09-12T00:41:29.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.134+0000 7f1280bdf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:29.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 20 add_watcher() i=0 2024-09-12T00:41:29.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 20 add_watcher() i=1 2024-09-12T00:41:29.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 20 add_watcher() i=2 2024-09-12T00:41:29.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 20 add_watcher() i=3 2024-09-12T00:41:29.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 20 add_watcher() i=4 2024-09-12T00:41:29.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 20 add_watcher() i=5 2024-09-12T00:41:29.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 20 add_watcher() i=6 2024-09-12T00:41:29.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 20 add_watcher() i=7 2024-09-12T00:41:29.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.158+0000 7f1280bdf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:29.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.162+0000 7f11357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:29.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.162+0000 7f1280bdf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:29.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.162+0000 7f1280bdf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:29.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 5 note: GC not initialized 2024-09-12T00:41:29.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f112f7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:29.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:29.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 20 Filter name: none 2024-09-12T00:41:29.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f112d7fa640 20 reqs_thread_entry: start 2024-09-12T00:41:29.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:41:29.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:29.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:41:29.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:41:29.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 : miss 2024-09-12T00:41:29.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:29.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:29.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:29.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:29.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:29.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.166+0000 7f1280bdf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 2024-09-12T00:41:29.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.174+0000 7f1280bdf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:29.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.174+0000 7f1280bdf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:29.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.174+0000 7f1280bdf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:29.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.174+0000 7f1280bdf9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28, ofs0, ns] 2024-09-12T00:41:29.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.174+0000 7f1161ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366257 cookie 93850606950992 notifier 6692 bl.length()=915 2024-09-12T00:41:29.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.174+0000 7f1161ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:29.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.174+0000 7f1161ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:29.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.174+0000 7f1161ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:29.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.178+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_sources= new_sources= 2024-09-12T00:41:29.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.178+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential sources added=[] removed=[] 2024-09-12T00:41:29.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.178+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_dests= new_dests= 2024-09-12T00:41:29.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.178+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential dests added=[] removed=[] 2024-09-12T00:41:29.179 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.182+0000 7f1280bdf9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.1.0 2024-09-12T00:41:29.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.182+0000 7f1280bdf9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.1.0 2024-09-12T00:41:29.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.182+0000 7f1280bdf9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.1.1 2024-09-12T00:41:29.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.182+0000 7f1280bdf9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.1.1 2024-09-12T00:41:29.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.182+0000 7f1280bdf9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.0 2024-09-12T00:41:29.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.186+0000 7f1280bdf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:29.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.186+0000 7f1280bdf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 2024-09-12T00:41:29.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.190+0000 7f1280bdf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:29.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.190+0000 7f1280bdf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:29.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.190+0000 7f1280bdf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:29.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.190+0000 7f1280bdf9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28, ofs0, ns] 2024-09-12T00:41:29.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.190+0000 7f1161ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366258 cookie 93850606950992 notifier 6692 bl.length()=915 2024-09-12T00:41:29.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.190+0000 7f1161ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:29.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.190+0000 7f1161ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:29.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.190+0000 7f1161ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:29.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.194+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_sources= new_sources= 2024-09-12T00:41:29.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.194+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential sources added=[] removed=[] 2024-09-12T00:41:29.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.194+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_dests= new_dests= 2024-09-12T00:41:29.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.194+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential dests added=[] removed=[] 2024-09-12T00:41:29.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.194+0000 7f1280bdf9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28.0 2024-09-12T00:41:29.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.194+0000 7f1280bdf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:29.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.194+0000 7f1280bdf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 2024-09-12T00:41:29.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1280bdf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:29.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1280bdf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:29.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1280bdf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:29.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1280bdf9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28, ofs0, ns] 2024-09-12T00:41:29.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1161ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366259 cookie 93850606950992 notifier 6692 bl.length()=883 2024-09-12T00:41:29.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1161ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 info.flags=0x17 2024-09-12T00:41:29.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1161ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 to cache LRU end 2024-09-12T00:41:29.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1161ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:29.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_sources= new_sources= 2024-09-12T00:41:29.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential sources added=[] removed=[] 2024-09-12T00:41:29.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): orig_dests= new_dests= 2024-09-12T00:41:29.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.198+0000 7f1280bdf9c0 20 handle_bi_update(): bucket=:error-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28]): potential dests added=[] removed=[] 2024-09-12T00:41:29.200 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.202+0000 7f1280bdf9c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:41:29.204 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.206+0000 7f11357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:29.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.214+0000 7f1280bdf9c0 20 remove_watcher() i=0 2024-09-12T00:41:29.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.214+0000 7f1280bdf9c0 2 removed watcher, disabling cache 2024-09-12T00:41:29.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.214+0000 7f1280bdf9c0 20 remove_watcher() i=1 2024-09-12T00:41:29.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.218+0000 7f1280bdf9c0 20 remove_watcher() i=2 2024-09-12T00:41:29.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.218+0000 7f1280bdf9c0 20 remove_watcher() i=3 2024-09-12T00:41:29.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.222+0000 7f1280bdf9c0 20 remove_watcher() i=4 2024-09-12T00:41:29.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.222+0000 7f1280bdf9c0 20 remove_watcher() i=5 2024-09-12T00:41:29.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.226+0000 7f1280bdf9c0 20 remove_watcher() i=6 2024-09-12T00:41:29.225 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.226+0000 7f1280bdf9c0 20 remove_watcher() i=7 2024-09-12T00:41:29.241 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:41:29.273 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:29.273 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:29.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.322+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.322+0000 7f0084d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.322+0000 7f0084d309c0 20 realm 2024-09-12T00:41:29.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.322+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.322+0000 7f0084d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.322+0000 7f0084d309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:29.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.322+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.326+0000 7f0084d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.326+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.326+0000 7f0084d309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:29.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.326+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.326+0000 7f0084d309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:29.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.326+0000 7f0084d309c0 20 searching for the correct realm 2024-09-12T00:41:29.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.330+0000 7f0082035640 0 -- 172.21.15.137:0/4032171388 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f00780810d0 msgr2=0x7f007808f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:29.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.338+0000 7f0083037640 0 -- 172.21.15.137:0/4032171388 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5600d4aadbe0 msgr2=0x5600d4ab0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:29.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:29.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:29.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:29.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:29.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:29.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:29.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:29.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:29.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 zone default found 2024-09-12T00:41:29.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 4 Realm: () 2024-09-12T00:41:29.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:29.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:29.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:29.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 zonegroup default 2024-09-12T00:41:29.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.346+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.350+0000 7f0084d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.350+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.350+0000 7f0084d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.350+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.350+0000 7f0084d309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:29.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.350+0000 7f0084d309c0 20 started sync module instance, tier type = 2024-09-12T00:41:29.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.350+0000 7f0084d309c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:29.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.366+0000 7f0084d309c0 20 add_watcher() i=0 2024-09-12T00:41:29.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.366+0000 7f0084d309c0 20 add_watcher() i=1 2024-09-12T00:41:29.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.366+0000 7f0084d309c0 20 add_watcher() i=2 2024-09-12T00:41:29.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.366+0000 7f0084d309c0 20 add_watcher() i=3 2024-09-12T00:41:29.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.366+0000 7f0084d309c0 20 add_watcher() i=4 2024-09-12T00:41:29.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.366+0000 7f0084d309c0 20 add_watcher() i=5 2024-09-12T00:41:29.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.366+0000 7f0084d309c0 20 add_watcher() i=6 2024-09-12T00:41:29.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.370+0000 7f0084d309c0 20 add_watcher() i=7 2024-09-12T00:41:29.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.370+0000 7f0084d309c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:29.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7eff397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:29.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:29.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:29.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 5 note: GC not initialized 2024-09-12T00:41:29.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7efeb3fff640 20 reqs_thread_entry: start 2024-09-12T00:41:29.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:29.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 Filter name: none 2024-09-12T00:41:29.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7efeb1ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:29.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:29.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:29.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:29.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:29.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.374+0000 7f0084d309c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:29.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.378+0000 7f0084d309c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:29.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.378+0000 7f0084d309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:29.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.378+0000 7eff397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:29.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.382+0000 7f0084d309c0 20 remove_watcher() i=0 2024-09-12T00:41:29.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.382+0000 7f0084d309c0 2 removed watcher, disabling cache 2024-09-12T00:41:29.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.382+0000 7f0084d309c0 20 remove_watcher() i=1 2024-09-12T00:41:29.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.386+0000 7f0084d309c0 20 remove_watcher() i=2 2024-09-12T00:41:29.385 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.386+0000 7f0084d309c0 20 remove_watcher() i=3 2024-09-12T00:41:29.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.390+0000 7f0084d309c0 20 remove_watcher() i=4 2024-09-12T00:41:29.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.390+0000 7f0084d309c0 20 remove_watcher() i=5 2024-09-12T00:41:29.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.394+0000 7f0084d309c0 20 remove_watcher() i=6 2024-09-12T00:41:29.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:29.398+0000 7f0084d309c0 20 remove_watcher() i=7 2024-09-12T00:41:29.408 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:29.408 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:41:29.408 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-block-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:41:29.409 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:29.410 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.410 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.413 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.413 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.459 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.460 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.484 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:41:29.484 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:29.489 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.489 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.503 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.503 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.549 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.550 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.571 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.571 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.592 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.593 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.616 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.616 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.636 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.636 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.656 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.656 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.676 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.676 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.697 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.697 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.716 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.716 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.736 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.736 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.756 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.756 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.775 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.775 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.796 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.796 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.817 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.817 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.838 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.838 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.858 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.858 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.877 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.878 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.897 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.898 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.920 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.920 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.940 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:29.940 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:29.957 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:41:29.990 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:29.990 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:30.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 20 realm 2024-09-12T00:41:30.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:30.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.038+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.042+0000 7fe6ce6149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.042+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.042+0000 7fe6ce6149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:30.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.042+0000 7fe6ce6149c0 20 searching for the correct realm 2024-09-12T00:41:30.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.050+0000 7fe6cc11a640 0 -- 172.21.15.137:0/4121031749 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fe6bc0bf020 msgr2=0x7fe6bc0f8aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.054+0000 7fe6cc11a640 0 -- 172.21.15.137:0/4121031749 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55906e512ec0 msgr2=0x55906e5152b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:30.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:30.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:30.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:30.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:30.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:30.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:30.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 zone default found 2024-09-12T00:41:30.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 4 Realm: () 2024-09-12T00:41:30.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:30.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:30.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:30.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 zonegroup default 2024-09-12T00:41:30.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 started sync module instance, tier type = 2024-09-12T00:41:30.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.062+0000 7fe6ce6149c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:30.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.082+0000 7fe6ce6149c0 20 add_watcher() i=0 2024-09-12T00:41:30.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.082+0000 7fe6ce6149c0 20 add_watcher() i=1 2024-09-12T00:41:30.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.082+0000 7fe6ce6149c0 20 add_watcher() i=2 2024-09-12T00:41:30.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.082+0000 7fe6ce6149c0 20 add_watcher() i=3 2024-09-12T00:41:30.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.082+0000 7fe6ce6149c0 20 add_watcher() i=4 2024-09-12T00:41:30.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.082+0000 7fe6ce6149c0 20 add_watcher() i=5 2024-09-12T00:41:30.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.082+0000 7fe6ce6149c0 20 add_watcher() i=6 2024-09-12T00:41:30.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.086+0000 7fe6ce6149c0 20 add_watcher() i=7 2024-09-12T00:41:30.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.086+0000 7fe6ce6149c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:30.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe582fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:30.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:30.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 5 note: GC not initialized 2024-09-12T00:41:30.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe581fdb640 20 reqs_thread_entry: start 2024-09-12T00:41:30.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:30.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 Filter name: none 2024-09-12T00:41:30.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe4f37fe640 20 reqs_thread_entry: start 2024-09-12T00:41:30.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:30.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:30.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:30.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.090+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.094+0000 7fe6ce6149c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:30.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.094+0000 7fe6ce6149c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.094+0000 7fe6ce6149c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:30.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.094+0000 7fe6ce6149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:30.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.094+0000 7fe582fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.098+0000 7fe6ce6149c0 20 remove_watcher() i=0 2024-09-12T00:41:30.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.098+0000 7fe6ce6149c0 2 removed watcher, disabling cache 2024-09-12T00:41:30.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.102+0000 7fe6ce6149c0 20 remove_watcher() i=1 2024-09-12T00:41:30.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.106+0000 7fe6ce6149c0 20 remove_watcher() i=2 2024-09-12T00:41:30.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.106+0000 7fe6ce6149c0 20 remove_watcher() i=3 2024-09-12T00:41:30.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.110+0000 7fe6ce6149c0 20 remove_watcher() i=4 2024-09-12T00:41:30.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.110+0000 7fe6ce6149c0 20 remove_watcher() i=5 2024-09-12T00:41:30.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.114+0000 7fe6ce6149c0 20 remove_watcher() i=6 2024-09-12T00:41:30.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.114+0000 7fe6ce6149c0 20 remove_watcher() i=7 2024-09-12T00:41:30.126 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.126 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:41:30.127 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-block-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:41:30.127 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.127 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:41:30.160 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:30.160 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:30.203 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 realm 2024-09-12T00:41:30.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:30.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:30.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 searching for the correct realm 2024-09-12T00:41:30.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.218+0000 7f9e3a5c8640 0 -- 172.21.15.137:0/2028395654 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f9e240ff1f0 msgr2=0x7f9e240aba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.222+0000 7f9e3b5ca640 0 -- 172.21.15.137:0/2028395654 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x558f56baaae0 msgr2=0x558f56bacfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:30.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:30.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:30.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:30.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:30.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:30.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:30.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 zone default found 2024-09-12T00:41:30.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 Realm: () 2024-09-12T00:41:30.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:30.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:30.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:30.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 zonegroup default 2024-09-12T00:41:30.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 started sync module instance, tier type = 2024-09-12T00:41:30.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:30.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=0 2024-09-12T00:41:30.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=1 2024-09-12T00:41:30.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=2 2024-09-12T00:41:30.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=3 2024-09-12T00:41:30.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=4 2024-09-12T00:41:30.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=5 2024-09-12T00:41:30.249 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=6 2024-09-12T00:41:30.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.254+0000 7f9e3d2c39c0 20 add_watcher() i=7 2024-09-12T00:41:30.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.254+0000 7f9e3d2c39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:30.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9cf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:30.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:30.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 note: GC not initialized 2024-09-12T00:41:30.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9c6bfff640 20 reqs_thread_entry: start 2024-09-12T00:41:30.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:30.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 Filter name: none 2024-09-12T00:41:30.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9c69ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:30.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:41:30.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:30.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:41:30.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:41:30.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : miss 2024-09-12T00:41:30.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:30.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:30.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:41:30.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:41:30.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94074123824208 notifier 7044 bl.length()=915 2024-09-12T00:41:30.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:41:30.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:41:30.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:41:30.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:41:30.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.0 2024-09-12T00:41:30.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.0 2024-09-12T00:41:30.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.1 2024-09-12T00:41:30.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.1 2024-09-12T00:41:30.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.0 2024-09-12T00:41:30.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:30.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:41:30.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:41:30.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94074123824208 notifier 7044 bl.length()=915 2024-09-12T00:41:30.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:41:30.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:41:30.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:41:30.279 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9e3d2c39c0 time 2024-09-12T00:41:30.283292+0000 2024-09-12T00:41:30.279 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:30.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:41:30.296 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:30.296 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9e40b9d2eb] 2024-09-12T00:41:30.296 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9e40b9d49f] 2024-09-12T00:41:30.300 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558f551c6cc1] 2024-09-12T00:41:30.301 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x558f551db086] 2024-09-12T00:41:30.301 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558f551dc6a4] 2024-09-12T00:41:30.301 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:41:30.301 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9e3fa03d90] 2024-09-12T00:41:30.301 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:41:30.301 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:41:30.302 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:41:30.302 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f9e3d2c39c0 thread_name:radosgw-admin 2024-09-12T00:41:30.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9e3d2c39c0 time 2024-09-12T00:41:30.283292+0000 2024-09-12T00:41:30.302 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:30.302 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.303 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:30.303 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9e40b9d2eb] 2024-09-12T00:41:30.303 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9e40b9d49f] 2024-09-12T00:41:30.303 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558f551c6cc1] 2024-09-12T00:41:30.303 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x558f551db086] 2024-09-12T00:41:30.303 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558f551dc6a4] 2024-09-12T00:41:30.304 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:41:30.304 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9e3fa03d90] 2024-09-12T00:41:30.304 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:41:30.304 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:41:30.304 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.304 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:30.305 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9e3fa1c520] 2024-09-12T00:41:30.305 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:41:30.305 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:41:30.305 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:41:30.305 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9e40b9d345] 2024-09-12T00:41:30.305 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9e40b9d49f] 2024-09-12T00:41:30.305 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558f551c6cc1] 2024-09-12T00:41:30.306 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x558f551db086] 2024-09-12T00:41:30.306 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558f551dc6a4] 2024-09-12T00:41:30.306 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:41:30.306 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9e3fa03d90] 2024-09-12T00:41:30.306 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f9e3d2c39c0 thread_name:radosgw-admin 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9e3fa1c520] 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9e40b9d345] 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9e40b9d49f] 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558f551c6cc1] 2024-09-12T00:41:30.307 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x558f551db086] 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558f551dc6a4] 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9e3fa03d90] 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:41:30.308 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: shutdown 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) unregister_commands rotate-key 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: build_initial_monmap 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: monmap: 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:41:30.309 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding auth protocol: cephx 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding auth protocol: cephx 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding auth protocol: cephx 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.310 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: starting msgr at 2024-09-12T00:41:30.311 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: starting objecter 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command objecter_requests hook 0x558f56ac1300 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: setting wanted keys 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: calling monclient init 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: init 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding auth protocol: cephx 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding auth protocol: cephx 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding auth protocol: cephx 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.312 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command rotate-key hook 0x558f56abe7f8 2024-09-12T00:41:30.313 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-a con 0x558f5694f4d0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-b con 0x558f56a06b00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-c con 0x558f56a07450 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): authenticate will time out at 2191.318579s 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request con 0x558f5694f4d0 auth_method 0 2024-09-12T00:41:30.314 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.315 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.315 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.315 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request con 0x558f56a07450 auth_method 0 2024-09-12T00:41:30.315 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.315 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.315 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_done global_id 7035 payload 824 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient: _finish_hunting 0 2024-09-12T00:41:30.316 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 1 monclient: found mon.noname-a 2024-09-12T00:41:30.317 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.317 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.317 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:30.317 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: dump: 2024-09-12T00:41:30.317 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.317 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.317 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: _finish_auth 0 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: _check_auth_tickets 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:30.318 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: dump: 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.319 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 monclient: authenticate success, global_id 7035 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:41:30.186+0000 7f9d28e09640 4 set_mon_vals no callback set 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: init done 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:41:30.190+0000 7f9d27606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:41:30.190+0000 7f9d27606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.320 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:41:30.190+0000 7f9d27606640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.321 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:41:30.190+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x7f9d20070ae0 auth_method 0 2024-09-12T00:41:30.321 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:41:30.190+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x558f56aeb320 auth_method 0 2024-09-12T00:41:30.321 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:41:30.190+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x558f56b08c40 auth_method 0 2024-09-12T00:41:30.321 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:41:30.194+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x558f56b0c470 auth_method 0 2024-09-12T00:41:30.321 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: build_initial_monmap 2024-09-12T00:41:30.321 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:30.321 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: monmap: 2024-09-12T00:41:30.321 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding auth protocol: cephx 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding auth protocol: cephx 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding auth protocol: cephx 2024-09-12T00:41:30.322 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.323 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command objecter_requests cmddesc objecter_requests hook 0x558f56b14700 EEXIST 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: init 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding auth protocol: cephx 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding auth protocol: cephx 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding auth protocol: cephx 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.324 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command rotate-key cmddesc rotate-key hook 0x558f56b10f00 EEXIST 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-b con 0x558f56b3c7e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-a con 0x558f56b3d3b0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:41:30.325 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-c con 0x558f56b3cbc0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): authenticate will time out at 2191.327911s 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): get_auth_request con 0x558f56b3d3b0 auth_method 0 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.326 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request con 0x558f56b3cbc0 auth_method 0 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request con 0x558f56b3c7e0 auth_method 0 2024-09-12T00:41:30.327 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_done global_id 7038 payload 824 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient: _finish_hunting 0 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 1 monclient: found mon.noname-a 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: dump: 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.328 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: _finish_auth 0 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: _check_auth_tickets 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: dump: 2024-09-12T00:41:30.329 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.330 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 monclient: authenticate success, global_id 7038 2024-09-12T00:41:30.331 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:41:30.198+0000 7f9e3bdcb640 4 set_mon_vals no callback set 2024-09-12T00:41:30.331 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.331 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.331 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.331 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.331 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:41:30.198+0000 7f9d24e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:30.331 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:41:30.198+0000 7f9d24e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.331 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:41:30.198+0000 7f9d24e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x7f9d140709f0 auth_method 0 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: get_monmap_and_config 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: build_initial_monmap 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: monmap: 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:41:30.332 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:41:30.333 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:30.333 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.333 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:41:30.333 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:41:30.333 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:41:30.333 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.333 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding auth protocol: cephx 2024-09-12T00:41:30.334 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding auth protocol: cephx 2024-09-12T00:41:30.334 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding auth protocol: cephx 2024-09-12T00:41:30.334 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.334 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.334 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.334 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.334 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.334 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: init 2024-09-12T00:41:30.335 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding auth protocol: cephx 2024-09-12T00:41:30.336 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding auth protocol: cephx 2024-09-12T00:41:30.336 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding auth protocol: cephx 2024-09-12T00:41:30.336 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.336 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.336 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.336 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.336 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.337 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.337 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.337 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.337 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.337 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.337 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.338 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.338 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.338 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.338 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc108a34b8 EEXIST 2024-09-12T00:41:30.338 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:30.338 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:41:30.338 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-b con 0x558f56b8a7d0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:41:30.338 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-a con 0x558f56b8abb0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:41:30.339 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-c con 0x558f56b90440 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:41:30.339 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.339 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.339 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.339 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:30.339 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): authenticate will time out at 2191.332267s 2024-09-12T00:41:30.339 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request con 0x558f56b90440 auth_method 0 2024-09-12T00:41:30.340 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.340 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.340 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.340 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): get_auth_request con 0x558f56b8abb0 auth_method 0 2024-09-12T00:41:30.340 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.340 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.341 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.341 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.341 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.341 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.341 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.342 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.342 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.342 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_done global_id 6740 payload 274 2024-09-12T00:41:30.342 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient: _finish_hunting 0 2024-09-12T00:41:30.342 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 1 monclient: found mon.noname-c 2024-09-12T00:41:30.342 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:41:30.342 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.343 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:30.343 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: dump: 2024-09-12T00:41:30.343 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.343 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.343 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.343 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.343 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.344 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.344 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.344 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.344 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.344 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.344 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:41:30.344 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:41:30.345 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 monclient: authenticate success, global_id 6740 2024-09-12T00:41:30.345 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:30.345 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.345 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:30.345 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: dump: 2024-09-12T00:41:30.345 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.345 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.346 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.346 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.346 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.346 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.346 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.346 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.346 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.347 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.347 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:30.347 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 4 set_mon_vals no callback set 2024-09-12T00:41:30.347 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: shutdown 2024-09-12T00:41:30.347 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: build_initial_monmap 2024-09-12T00:41:30.347 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:30.347 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: monmap: 2024-09-12T00:41:30.347 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:41:30.348 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:30.348 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:41:30.348 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:41:30.348 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:30.348 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.348 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:41:30.348 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:41:30.349 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:41:30.349 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.349 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding auth protocol: cephx 2024-09-12T00:41:30.349 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding auth protocol: cephx 2024-09-12T00:41:30.349 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding auth protocol: cephx 2024-09-12T00:41:30.349 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.349 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.350 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.350 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.350 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.350 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.350 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.350 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.350 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.350 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.351 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.351 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.351 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.351 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 librados: starting msgr at 2024-09-12T00:41:30.351 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 librados: starting objecter 2024-09-12T00:41:30.351 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command objecter_requests cmddesc objecter_requests hook 0x558f56b3b8e0 EEXIST 2024-09-12T00:41:30.351 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 librados: setting wanted keys 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 librados: calling monclient init 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: init 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding auth protocol: cephx 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding auth protocol: cephx 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding auth protocol: cephx 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.352 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.353 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command rotate-key cmddesc rotate-key hook 0x558f56b3ecc8 EEXIST 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-a con 0x558f56b8a7d0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-b con 0x558f56b90440 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-c con 0x558f56b890a0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): authenticate will time out at 2191.334944s 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request con 0x558f56b8a7d0 auth_method 0 2024-09-12T00:41:30.354 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request con 0x558f56b890a0 auth_method 0 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.355 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_done global_id 7044 payload 824 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient: _finish_hunting 0 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 1 monclient: found mon.noname-a 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: dump: 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.356 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: _finish_auth 0 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: dump: 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.357 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 4 set_mon_vals no callback set 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 5 monclient: authenticate success, global_id 7044 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.358 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 1 librados: init done 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cr dump hook 0x558f56b95918 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:41:30.206+0000 7f9d1cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:41:30.206+0000 7f9d1cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:41:30.206+0000 7f9d1cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:41:30.206+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x7f9d04070ae0 auth_method 0 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:41:30.206+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x558f56baaae0 auth_method 0 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 realm 2024-09-12T00:41:30.359 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.360 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.360 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:30.360 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.360 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.360 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.360 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:41:30.210+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x558f56baed70 auth_method 0 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 searching for the correct realm 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:41:30.210+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x558f56bb3ff0 auth_method 0 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:41:30.210+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x7f9e24108d90 auth_method 0 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:41:30.214+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x7f9e3401f060 auth_method 0 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:41:30.214+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x7f9e240ff1f0 auth_method 0 2024-09-12T00:41:30.361 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:41:30.218+0000 7f9e3a5c8640 0 -- 172.21.15.137:0/2028395654 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f9e240ff1f0 msgr2=0x7f9e240aba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:41:30.218+0000 7f9d1cff9640 1 client.7044.objecter ms_handle_reset 0x7f9e240ff1f0 session 0x7f9e24104800 osd.5 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:41:30.218+0000 7f9d1cff9640 10 monclient: _renew_subs 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:41:30.218+0000 7f9d1cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:41:30.218+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x7f9d04080e10 auth_method 0 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:41:30.218+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x7f9e3409a020 auth_method 0 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:41:30.222+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x7f9e2c028940 auth_method 0 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:41:30.222+0000 7f9e3b5ca640 0 -- 172.21.15.137:0/2028395654 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x558f56baaae0 msgr2=0x558f56bacfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:41:30.222+0000 7f9d1cff9640 1 client.7044.objecter ms_handle_reset 0x558f56baaae0 session 0x558f56baa3d0 osd.6 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:41:30.222+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x7f9e240ff1f0 auth_method 0 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:30.362 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 zone default found 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 Realm: () 2024-09-12T00:41:30.363 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 zonegroup default 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 started sync module instance, tier type = 2024-09-12T00:41:30.364 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=0 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=1 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=2 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=3 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=4 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=5 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=6 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:41:30.254+0000 7f9e3d2c39c0 20 add_watcher() i=7 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:41:30.254+0000 7f9e3d2c39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding auth protocol: cephx 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding auth protocol: cephx 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding auth protocol: cephx 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.365 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:41:30.258+0000 7f9cf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.366 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cache list hook 0x558f56b84d80 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cache inspect hook 0x558f56b84d80 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cache erase hook 0x558f56b84d80 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cache zap hook 0x558f56b84d80 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 note: GC not initialized 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:41:30.258+0000 7f9c6bfff640 20 reqs_thread_entry: start 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command sync trace show hook 0x7f9e2c004680 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command sync trace history hook 0x7f9e2c004680 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command sync trace active hook 0x7f9e2c004680 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command sync trace active_short hook 0x7f9e2c004680 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:30.367 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 Filter name: none 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:41:30.258+0000 7f9c69ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : miss 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:30.368 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94074123824208 notifier 7044 bl.length()=915 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:41:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:41:30.370 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:41:30.370 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:41:30.370 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.0 2024-09-12T00:41:30.370 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.0 2024-09-12T00:41:30.370 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.1 2024-09-12T00:41:30.370 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.1 2024-09-12T00:41:30.371 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.0 2024-09-12T00:41:30.371 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:30.371 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:41:30.371 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.371 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.371 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.372 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:41:30.372 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94074123824208 notifier 7044 bl.length()=915 2024-09-12T00:41:30.372 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.372 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.372 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.373 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:41:30.373 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:41:30.373 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:41:30.373 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:41:30.373 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9e3d2c39c0 time 2024-09-12T00:41:30.283292+0000 2024-09-12T00:41:30.373 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:30.374 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.374 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:30.374 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9e40b9d2eb] 2024-09-12T00:41:30.374 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9e40b9d49f] 2024-09-12T00:41:30.374 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558f551c6cc1] 2024-09-12T00:41:30.374 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x558f551db086] 2024-09-12T00:41:30.375 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558f551dc6a4] 2024-09-12T00:41:30.375 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:41:30.375 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9e3fa03d90] 2024-09-12T00:41:30.375 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:41:30.375 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:41:30.375 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.376 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:30.376 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f9e3d2c39c0 thread_name:radosgw-admin 2024-09-12T00:41:30.376 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.376 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:30.376 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9e3fa1c520] 2024-09-12T00:41:30.377 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:41:30.377 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:41:30.377 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:41:30.377 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9e40b9d345] 2024-09-12T00:41:30.377 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9e40b9d49f] 2024-09-12T00:41:30.377 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558f551c6cc1] 2024-09-12T00:41:30.378 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x558f551db086] 2024-09-12T00:41:30.378 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558f551dc6a4] 2024-09-12T00:41:30.378 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:41:30.378 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9e3fa03d90] 2024-09-12T00:41:30.378 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:41:30.379 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:41:30.379 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:30.379 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.379 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:41:30.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:41:30.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:41:30.380 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:41:30.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:41:30.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:41:30.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:41:30.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:41:30.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:41:30.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:41:30.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:41:30.381 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:41:30.381 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:41:30.381 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:41:30.381 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:41:30.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:41:30.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:41:30.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:41:30.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:41:30.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:41:30.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:41:30.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:41:30.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:41:30.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:41:30.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:41:30.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:41:30.383 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:41:30.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:41:30.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:41:30.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:41:30.386 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:41:30.387 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:41:30.388 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9c69ffb640 / http_manager 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9c6bfff640 / http_manager 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9cf17e2640 / rgw_dt_lg_renew 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d1cff9640 / ms_dispatch 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d1dffb640 / io_context_pool 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d1e7fc640 / io_context_pool 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d24e01640 / ms_dispatch 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d27606640 / ms_dispatch 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d28e09640 / io_context_pool 2024-09-12T00:41:30.389 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3a5c8640 / msgr-worker-2 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3adc9640 / msgr-worker-1 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3b5ca640 / msgr-worker-0 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3bdcb640 / io_context_pool 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3d2c39c0 / radosgw-admin 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.106603.log 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: shutdown 2024-09-12T00:41:30.390 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) unregister_commands rotate-key 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: build_initial_monmap 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: monmap: 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.391 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding auth protocol: cephx 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding auth protocol: cephx 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding auth protocol: cephx 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.392 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: crc 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56ac4450) adding con mode: secure 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: starting msgr at 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: starting objecter 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command objecter_requests hook 0x558f56ac1300 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: setting wanted keys 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: calling monclient init 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: init 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding auth protocol: cephx 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding auth protocol: cephx 2024-09-12T00:41:30.393 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding auth protocol: cephx 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: crc 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56abe6b0) adding con mode: secure 2024-09-12T00:41:30.394 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command rotate-key hook 0x558f56abe7f8 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-a con 0x558f5694f4d0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-b con 0x558f56a06b00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-c con 0x558f56a07450 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient(hunting): authenticate will time out at 2191.318579s 2024-09-12T00:41:30.395 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request con 0x558f5694f4d0 auth_method 0 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request con 0x558f56a07450 auth_method 0 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.396 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:41:30.186+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_done global_id 7035 payload 824 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient: _finish_hunting 0 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 1 monclient: found mon.noname-a 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:41:30.186+0000 7f9e3adc9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: dump: 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.397 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: _finish_auth 0 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: _check_auth_tickets 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:41:30.186+0000 7f9d27606640 10 monclient: dump: 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.398 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 5 monclient: authenticate success, global_id 7035 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:41:30.186+0000 7f9d28e09640 4 set_mon_vals no callback set 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:41:30.186+0000 7f9e3d2c39c0 1 librados: init done 2024-09-12T00:41:30.399 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:41:30.190+0000 7f9d27606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:41:30.190+0000 7f9d27606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:41:30.190+0000 7f9d27606640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:41:30.190+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x7f9d20070ae0 auth_method 0 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:41:30.190+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x558f56aeb320 auth_method 0 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:41:30.190+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x558f56b08c40 auth_method 0 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:41:30.194+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x558f56b0c470 auth_method 0 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: build_initial_monmap 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: monmap: 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:30.400 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding auth protocol: cephx 2024-09-12T00:41:30.401 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding auth protocol: cephx 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding auth protocol: cephx 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.402 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: crc 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b11e00) adding con mode: secure 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command objecter_requests cmddesc objecter_requests hook 0x558f56b14700 EEXIST 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: init 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding auth protocol: cephx 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding auth protocol: cephx 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding auth protocol: cephx 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.403 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: crc 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b10db8) adding con mode: secure 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command rotate-key cmddesc rotate-key hook 0x558f56b10f00 EEXIST 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:41:30.404 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-b con 0x558f56b3c7e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-a con 0x558f56b3d3b0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-c con 0x558f56b3cbc0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:41:30.194+0000 7f9e3d2c39c0 10 monclient(hunting): authenticate will time out at 2191.327911s 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): get_auth_request con 0x558f56b3d3b0 auth_method 0 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.405 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request con 0x558f56b3cbc0 auth_method 0 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:41:30.198+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request con 0x558f56b3c7e0 auth_method 0 2024-09-12T00:41:30.406 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_done global_id 7038 payload 824 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient: _finish_hunting 0 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 1 monclient: found mon.noname-a 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:41:30.198+0000 7f9e3a5c8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: dump: 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.407 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: _finish_auth 0 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: _check_auth_tickets 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:41:30.198+0000 7f9d24e01640 10 monclient: dump: 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.408 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 monclient: authenticate success, global_id 7038 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:41:30.198+0000 7f9e3bdcb640 4 set_mon_vals no callback set 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.409 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:41:30.198+0000 7f9d24e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:41:30.198+0000 7f9d24e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:41:30.198+0000 7f9d24e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:41:30.198+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x7f9d140709f0 auth_method 0 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: get_monmap_and_config 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: build_initial_monmap 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: monmap: 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:41:30.410 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding auth protocol: cephx 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding auth protocol: cephx 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding auth protocol: cephx 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.411 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: crc 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b5c160) adding con mode: secure 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 10 monclient: init 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding auth protocol: cephx 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding auth protocol: cephx 2024-09-12T00:41:30.412 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding auth protocol: cephx 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: crc 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3370) adding con mode: secure 2024-09-12T00:41:30.413 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:41:30.198+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc108a34b8 EEXIST 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-b con 0x558f56b8a7d0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-a con 0x558f56b8abb0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-c con 0x558f56b90440 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.414 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): authenticate will time out at 2191.332267s 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request con 0x558f56b90440 auth_method 0 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): get_auth_request con 0x558f56b8abb0 auth_method 0 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.415 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:41:30.202+0000 7f9e3a5c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_done global_id 6740 payload 274 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient: _finish_hunting 0 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 1 monclient: found mon.noname-c 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:30.416 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: dump: 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.417 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 monclient: authenticate success, global_id 6740 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 10 monclient: dump: 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.418 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 4 set_mon_vals no callback set 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: shutdown 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: build_initial_monmap 2024-09-12T00:41:30.419 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: monmap: 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.420 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding auth protocol: cephx 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding auth protocol: cephx 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding auth protocol: cephx 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.421 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: crc 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b82330) adding con mode: secure 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 librados: starting msgr at 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 librados: starting objecter 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command objecter_requests cmddesc objecter_requests hook 0x558f56b3b8e0 EEXIST 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 librados: setting wanted keys 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 1 librados: calling monclient init 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: init 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding auth protocol: cephx 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding auth protocol: cephx 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding auth protocol: cephx 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.422 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: crc 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 AuthRegistry(0x558f56b3eb80) adding con mode: secure 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command rotate-key cmddesc rotate-key hook 0x558f56b3ecc8 EEXIST 2024-09-12T00:41:30.423 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-a con 0x558f56b8a7d0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-b con 0x558f56b90440 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): picked mon.noname-c con 0x558f56b890a0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:41:30.202+0000 7f9e3d2c39c0 10 monclient(hunting): authenticate will time out at 2191.334944s 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request con 0x558f56b8a7d0 auth_method 0 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.424 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request con 0x558f56b890a0 auth_method 0 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:41:30.202+0000 7f9e3b5ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient(hunting): handle_auth_done global_id 7044 payload 824 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient: _finish_hunting 0 2024-09-12T00:41:30.425 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 1 monclient: found mon.noname-a 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:41:30.202+0000 7f9e3adc9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: dump: 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.427 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.427 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.427 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: _finish_auth 0 2024-09-12T00:41:30.427 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:41:30.427 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:30.427 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:30.428 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:30.428 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:41:30.202+0000 7f9d1cff9640 10 monclient: dump: 2024-09-12T00:41:30.428 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:41:30.428 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:41:30.428 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.428 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:41:30.429 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:30.429 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:41:30.429 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:41:30.429 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:41:30.429 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:41:30.429 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.430 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:41:30.202+0000 7f9d1e7fc640 4 set_mon_vals no callback set 2024-09-12T00:41:30.430 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 5 monclient: authenticate success, global_id 7044 2024-09-12T00:41:30.430 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.430 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.430 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 10 monclient: _renew_subs 2024-09-12T00:41:30.430 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.430 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 1 librados: init done 2024-09-12T00:41:30.431 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cr dump hook 0x558f56b95918 2024-09-12T00:41:30.431 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.431 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:41:30.206+0000 7f9d1cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:30.431 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:41:30.206+0000 7f9d1cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.431 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:41:30.206+0000 7f9d1cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:41:30.431 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:41:30.206+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x7f9d04070ae0 auth_method 0 2024-09-12T00:41:30.431 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:41:30.206+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x558f56baaae0 auth_method 0 2024-09-12T00:41:30.431 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.432 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 realm 2024-09-12T00:41:30.432 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:41:30.206+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.432 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.432 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:30.432 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.432 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.432 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.433 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:41:30.210+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x558f56baed70 auth_method 0 2024-09-12T00:41:30.433 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.433 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.433 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:30.433 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:41:30.210+0000 7f9e3d2c39c0 20 searching for the correct realm 2024-09-12T00:41:30.433 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:41:30.210+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x558f56bb3ff0 auth_method 0 2024-09-12T00:41:30.434 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:41:30.210+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x7f9e24108d90 auth_method 0 2024-09-12T00:41:30.434 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:41:30.214+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x7f9e3401f060 auth_method 0 2024-09-12T00:41:30.434 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:41:30.214+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x7f9e240ff1f0 auth_method 0 2024-09-12T00:41:30.434 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:41:30.218+0000 7f9e3a5c8640 0 -- 172.21.15.137:0/2028395654 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f9e240ff1f0 msgr2=0x7f9e240aba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.434 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:41:30.218+0000 7f9d1cff9640 1 client.7044.objecter ms_handle_reset 0x7f9e240ff1f0 session 0x7f9e24104800 osd.5 2024-09-12T00:41:30.434 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:41:30.218+0000 7f9d1cff9640 10 monclient: _renew_subs 2024-09-12T00:41:30.435 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:41:30.218+0000 7f9d1cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:41:30.435 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:41:30.218+0000 7f9e3a5c8640 10 monclient: get_auth_request con 0x7f9d04080e10 auth_method 0 2024-09-12T00:41:30.435 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:41:30.218+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x7f9e3409a020 auth_method 0 2024-09-12T00:41:30.435 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:41:30.222+0000 7f9e3adc9640 10 monclient: get_auth_request con 0x7f9e2c028940 auth_method 0 2024-09-12T00:41:30.435 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:41:30.222+0000 7f9e3b5ca640 0 -- 172.21.15.137:0/2028395654 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x558f56baaae0 msgr2=0x558f56bacfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.435 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:41:30.222+0000 7f9d1cff9640 1 client.7044.objecter ms_handle_reset 0x558f56baaae0 session 0x558f56baa3d0 osd.6 2024-09-12T00:41:30.435 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:41:30.222+0000 7f9e3b5ca640 10 monclient: get_auth_request con 0x7f9e240ff1f0 auth_method 0 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.436 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 zone default found 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 Realm: () 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 zonegroup default 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:41:30.230+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.437 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 started sync module instance, tier type = 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:41:30.234+0000 7f9e3d2c39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=0 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=1 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=2 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=3 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=4 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=5 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:41:30.250+0000 7f9e3d2c39c0 20 add_watcher() i=6 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:41:30.254+0000 7f9e3d2c39c0 20 add_watcher() i=7 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:41:30.254+0000 7f9e3d2c39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding auth protocol: cephx 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding auth protocol: cephx 2024-09-12T00:41:30.438 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding auth protocol: cephx 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: crc 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 AuthRegistry(0x7ffc108a3850) adding con mode: secure 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:41:30.258+0000 7f9cf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.439 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cache list hook 0x558f56b84d80 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cache inspect hook 0x558f56b84d80 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cache erase hook 0x558f56b84d80 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command cache zap hook 0x558f56b84d80 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 note: GC not initialized 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:41:30.258+0000 7f9c6bfff640 20 reqs_thread_entry: start 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command sync trace show hook 0x7f9e2c004680 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command sync trace history hook 0x7f9e2c004680 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command sync trace active hook 0x7f9e2c004680 2024-09-12T00:41:30.440 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 5 asok(0x558f568b42b0) register_command sync trace active_short hook 0x7f9e2c004680 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 Filter name: none 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:41:30.258+0000 7f9c69ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : miss 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.441 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:41:30.258+0000 7f9e3d2c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94074123824208 notifier 7044 bl.length()=915 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:41:30.266+0000 7f9d1e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.442 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:41:30.266+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.0 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.0 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.1 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.1.1 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:41:30.274+0000 7f9e3d2c39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.0 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:41:30.443 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:41:30.278+0000 7f9e3d2c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94074123824208 notifier 7044 bl.length()=915 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:41:30.278+0000 7f9d1dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:41:30.444 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9e3d2c39c0 time 2024-09-12T00:41:30.283292+0000 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9e40b9d2eb] 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9e40b9d49f] 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558f551c6cc1] 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x558f551db086] 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558f551dc6a4] 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9e3fa03d90] 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:41:30.445 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:41:30.282+0000 7f9e3d2c39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f9e3d2c39c0 thread_name:radosgw-admin 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9e3fa1c520] 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9e40b9d345] 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9e40b9d49f] 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558f551c6cc1] 2024-09-12T00:41:30.446 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x558f551db086] 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558f551dc6a4] 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9e3fa03d90] 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:41:30.447 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:41:30.448 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:41:30.449 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:41:30.450 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:41:30.451 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:41:30.452 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:41:30.452 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:41:30.452 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:41:30.452 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:41:30.452 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:41:30.452 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:41:30.453 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:41:30.453 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:41:30.453 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:41:30.453 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:41:30.453 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:41:30.453 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:41:30.454 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:41:30.454 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:41:30.454 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:41:30.454 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:41:30.454 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:41:30.454 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:41:30.455 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:41:30.455 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:41:30.455 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:41:30.455 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:41:30.455 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:41:30.455 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:41:30.456 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:41:30.456 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:41:30.456 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:41:30.456 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:41:30.456 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:41:30.456 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:41:30.457 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:41:30.457 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:41:30.457 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:41:30.457 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:41:30.457 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:41:30.458 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:41:30.458 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:41:30.458 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:41:30.458 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:41:30.458 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:41:30.458 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:41:30.459 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9c69ffb640 / http_manager 2024-09-12T00:41:30.459 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9c6bfff640 / http_manager 2024-09-12T00:41:30.459 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9cf17e2640 / rgw_dt_lg_renew 2024-09-12T00:41:30.459 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d1cff9640 / ms_dispatch 2024-09-12T00:41:30.459 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d1dffb640 / io_context_pool 2024-09-12T00:41:30.459 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d1e7fc640 / io_context_pool 2024-09-12T00:41:30.460 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d24e01640 / ms_dispatch 2024-09-12T00:41:30.460 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d27606640 / ms_dispatch 2024-09-12T00:41:30.460 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9d28e09640 / io_context_pool 2024-09-12T00:41:30.460 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3a5c8640 / msgr-worker-2 2024-09-12T00:41:30.460 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3adc9640 / msgr-worker-1 2024-09-12T00:41:30.460 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3b5ca640 / msgr-worker-0 2024-09-12T00:41:30.461 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3bdcb640 / io_context_pool 2024-09-12T00:41:30.461 INFO:tasks.workunit.client.0.smithi137.stderr: 7f9e3d2c39c0 / radosgw-admin 2024-09-12T00:41:30.461 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:41:30.461 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:41:30.461 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:41:30.285883Z_652da6f4-9dfb-4a68-81c3-fa71e39937e3/log 2024-09-12T00:41:30.462 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:41:30.462 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:41:30.462 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:41:30.472 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:30.472 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.366+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.366+0000 7fad2ea4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.366+0000 7fad2ea4a9c0 20 realm 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.366+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.366+0000 7fad2ea4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.366+0000 7fad2ea4a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.366+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.370+0000 7fad2ea4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.370+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.370+0000 7fad2ea4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.370+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.370+0000 7fad2ea4a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.370+0000 7fad2ea4a9c0 20 searching for the correct realm 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.374+0000 7fad2c550640 0 -- 172.21.15.137:0/559930400 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fad1c0f8130 msgr2=0x7fad1c12ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.382+0000 7fad2c550640 0 -- 172.21.15.137:0/559930400 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fad24085170 msgr2=0x7fad2408cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.386+0000 7fad2ea4a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.386+0000 7fad2ea4a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.386+0000 7fad2ea4a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.386+0000 7fad2ea4a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.386+0000 7fad2ea4a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.386+0000 7fad2ea4a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.386+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 zone default found 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 4 Realm: () 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 zonegroup default 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 started sync module instance, tier type = 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.390+0000 7fad2ea4a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 20 add_watcher() i=0 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 20 add_watcher() i=1 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 20 add_watcher() i=2 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 20 add_watcher() i=3 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 20 add_watcher() i=4 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 20 add_watcher() i=5 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 20 add_watcher() i=6 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 20 add_watcher() i=7 2024-09-12T00:41:30.476 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.410+0000 7fad2ea4a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fabe2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fad2ea4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fad2ea4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fad2ea4a9c0 5 note: GC not initialized 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fabe1fdb640 20 reqs_thread_entry: start 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fad2ea4a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fad2ea4a9c0 20 Filter name: none 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fab537fe640 20 reqs_thread_entry: start 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.414+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.418+0000 7fad2ea4a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.422+0000 7fabe2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.426+0000 7fad2ea4a9c0 20 remove_watcher() i=0 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.426+0000 7fad2ea4a9c0 2 removed watcher, disabling cache 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.426+0000 7fad2ea4a9c0 20 remove_watcher() i=1 2024-09-12T00:41:30.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.430+0000 7fad2ea4a9c0 20 remove_watcher() i=2 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.430+0000 7fad2ea4a9c0 20 remove_watcher() i=3 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.430+0000 7fad2ea4a9c0 20 remove_watcher() i=4 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.434+0000 7fad2ea4a9c0 20 remove_watcher() i=5 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.438+0000 7fad2ea4a9c0 20 remove_watcher() i=6 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.438+0000 7fad2ea4a9c0 20 remove_watcher() i=7 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-block-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:30.479 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:30.480 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:41:30.507 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:41:30.540 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:30.540 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:30.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.586+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 realm 2024-09-12T00:41:30.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:30.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:30.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.590+0000 7f009358b9c0 20 searching for the correct realm 2024-09-12T00:41:30.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.598+0000 7f0090890640 0 -- 172.21.15.137:0/2253373418 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f00880e5400 msgr2=0x7f00880e5880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.602+0000 7f0091892640 0 -- 172.21.15.137:0/2253373418 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55d724aca9d0 msgr2=0x55d724accdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:30.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:30.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:41:30.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:30.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:41:30.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:30.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:30.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.609 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:30.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.610+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:30.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 zone default found 2024-09-12T00:41:30.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 4 Realm: () 2024-09-12T00:41:30.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:41:30.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:41:30.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:30.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 zonegroup default 2024-09-12T00:41:30.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:30.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 started sync module instance, tier type = 2024-09-12T00:41:30.612 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.614+0000 7f009358b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:41:30.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.630+0000 7f009358b9c0 20 add_watcher() i=0 2024-09-12T00:41:30.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.630+0000 7f009358b9c0 20 add_watcher() i=1 2024-09-12T00:41:30.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.630+0000 7f009358b9c0 20 add_watcher() i=2 2024-09-12T00:41:30.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.630+0000 7f009358b9c0 20 add_watcher() i=3 2024-09-12T00:41:30.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.630+0000 7f009358b9c0 20 add_watcher() i=4 2024-09-12T00:41:30.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.630+0000 7f009358b9c0 20 add_watcher() i=5 2024-09-12T00:41:30.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.630+0000 7f009358b9c0 20 add_watcher() i=6 2024-09-12T00:41:30.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.634+0000 7f009358b9c0 20 add_watcher() i=7 2024-09-12T00:41:30.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.634+0000 7f009358b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:30.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7eff477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 5 note: GC not initialized 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7eff467e4640 20 reqs_thread_entry: start 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 20 Filter name: none 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7efeb7fff640 20 reqs_thread_entry: start 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:41:30.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : miss 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:30.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.638+0000 7f009358b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:41:30.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.642+0000 7f009358b9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to be held by another RGW process; skipping for now 2024-09-12T00:41:30.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.642+0000 7eff477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:30.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.646+0000 7f009358b9c0 20 remove_watcher() i=0 2024-09-12T00:41:30.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.646+0000 7f009358b9c0 2 removed watcher, disabling cache 2024-09-12T00:41:30.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.650+0000 7f009358b9c0 20 remove_watcher() i=1 2024-09-12T00:41:30.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.650+0000 7f009358b9c0 20 remove_watcher() i=2 2024-09-12T00:41:30.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.654+0000 7f009358b9c0 20 remove_watcher() i=3 2024-09-12T00:41:30.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.654+0000 7f009358b9c0 20 remove_watcher() i=4 2024-09-12T00:41:30.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.658+0000 7f009358b9c0 20 remove_watcher() i=5 2024-09-12T00:41:30.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.658+0000 7f009358b9c0 20 remove_watcher() i=6 2024-09-12T00:41:30.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:41:30.662+0000 7f009358b9c0 20 remove_watcher() i=7 2024-09-12T00:41:30.673 INFO:tasks.workunit.client.0.smithi137.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:42:00.695 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:42:00.731 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:00.731 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:00.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.777+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 realm 2024-09-12T00:42:00.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:00.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:00.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.781+0000 7fad7e9d39c0 20 searching for the correct realm 2024-09-12T00:42:00.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.789+0000 7fad7ccda640 0 -- 172.21.15.137:0/3119090611 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fad640e5060 msgr2=0x7fad64109740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:00.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.793+0000 7fad7c4d9640 0 -- 172.21.15.137:0/3119090611 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fad74008030 msgr2=0x7fad7405b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:00.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:00.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:00.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:00.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:00.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:00.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:00.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:00.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:00.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 zone default found 2024-09-12T00:42:00.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 4 Realm: () 2024-09-12T00:42:00.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:00.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:00.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:00.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 zonegroup default 2024-09-12T00:42:00.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.801+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.805+0000 7fad7e9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.805+0000 7fad7e9d39c0 20 started sync module instance, tier type = 2024-09-12T00:42:00.803 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.805+0000 7fad7e9d39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:00.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.821+0000 7fad7e9d39c0 20 add_watcher() i=0 2024-09-12T00:42:00.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.821+0000 7fad7e9d39c0 20 add_watcher() i=1 2024-09-12T00:42:00.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.821+0000 7fad7e9d39c0 20 add_watcher() i=2 2024-09-12T00:42:00.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.821+0000 7fad7e9d39c0 20 add_watcher() i=3 2024-09-12T00:42:00.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.821+0000 7fad7e9d39c0 20 add_watcher() i=4 2024-09-12T00:42:00.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.821+0000 7fad7e9d39c0 20 add_watcher() i=5 2024-09-12T00:42:00.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.821+0000 7fad7e9d39c0 20 add_watcher() i=6 2024-09-12T00:42:00.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.825+0000 7fad7e9d39c0 20 add_watcher() i=7 2024-09-12T00:42:00.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.825+0000 7fad7e9d39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:00.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fac32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:00.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:00.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:00.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 5 note: GC not initialized 2024-09-12T00:42:00.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fac31fdb640 20 reqs_thread_entry: start 2024-09-12T00:42:00.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:00.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 20 Filter name: none 2024-09-12T00:42:00.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:42:00.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7faba37fe640 20 reqs_thread_entry: start 2024-09-12T00:42:00.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:42:00.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:42:00.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:42:00.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : miss 2024-09-12T00:42:00.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:42:00.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:42:00.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:42:00.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:00.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:00.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.829+0000 7fad7e9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:42:00.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.833+0000 7fad7e9d39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:00.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.837+0000 7fad7e9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:42:00.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.837+0000 7fad7e9d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:42:00.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.837+0000 7fad7e9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:00.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.837+0000 7fad7e9d39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:42:00.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.841+0000 7fac537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366264 cookie 94190093592928 notifier 6788 bl.length()=915 2024-09-12T00:42:00.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.841+0000 7fac537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:42:00.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.841+0000 7fac537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:42:00.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.841+0000 7fac537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:00.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.841+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:42:00.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.841+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:42:00.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.841+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:42:00.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.841+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:42:00.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.849+0000 7fad7e9d39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.2.0 2024-09-12T00:42:00.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.849+0000 7fad7e9d39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.2.0 2024-09-12T00:42:00.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.849+0000 7fad7e9d39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.2.1 2024-09-12T00:42:00.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.849+0000 7fad7e9d39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.2.1 2024-09-12T00:42:00.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.849+0000 7fad7e9d39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.0 2024-09-12T00:42:00.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.853+0000 7fad7e9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:00.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.853+0000 7fad7e9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:42:00.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fad7e9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:42:00.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fad7e9d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:42:00.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fad7e9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:00.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fad7e9d39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:42:00.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fac52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366265 cookie 94190093592928 notifier 6788 bl.length()=915 2024-09-12T00:42:00.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fac52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:42:00.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fac52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:42:00.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fac52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:00.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:42:00.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:42:00.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:42:00.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.857+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:42:00.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.861+0000 7fad7e9d39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29.0 2024-09-12T00:42:00.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.861+0000 7fad7e9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:00.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.861+0000 7fad7e9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 2024-09-12T00:42:00.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fad7e9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:42:00.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fad7e9d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:42:00.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fad7e9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:00.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fad7e9d39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29, ofs0, ns] 2024-09-12T00:42:00.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fac537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366266 cookie 94190093592928 notifier 6788 bl.length()=883 2024-09-12T00:42:00.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fac537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 info.flags=0x17 2024-09-12T00:42:00.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fac537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 to cache LRU end 2024-09-12T00:42:00.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fac537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:00.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_sources= new_sources= 2024-09-12T00:42:00.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential sources added=[] removed=[] 2024-09-12T00:42:00.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): orig_dests= new_dests= 2024-09-12T00:42:00.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.865+0000 7fad7e9d39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29]): potential dests added=[] removed=[] 2024-09-12T00:42:00.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.869+0000 7fad7e9d39c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:42:00.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.873+0000 7fac32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:00.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.877+0000 7fad7e9d39c0 20 remove_watcher() i=0 2024-09-12T00:42:00.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.877+0000 7fad7e9d39c0 2 removed watcher, disabling cache 2024-09-12T00:42:00.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.877+0000 7fad7e9d39c0 20 remove_watcher() i=1 2024-09-12T00:42:00.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.881+0000 7fad7e9d39c0 20 remove_watcher() i=2 2024-09-12T00:42:00.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.881+0000 7fad7e9d39c0 20 remove_watcher() i=3 2024-09-12T00:42:00.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.885+0000 7fad7e9d39c0 20 remove_watcher() i=4 2024-09-12T00:42:00.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.885+0000 7fad7e9d39c0 20 remove_watcher() i=5 2024-09-12T00:42:00.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.889+0000 7fad7e9d39c0 20 remove_watcher() i=6 2024-09-12T00:42:00.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.893+0000 7fad7e9d39c0 20 remove_watcher() i=7 2024-09-12T00:42:00.906 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:42:00.933 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:00.933 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:00.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.977+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 realm 2024-09-12T00:42:00.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:00.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:00.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:00.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.981+0000 7f9ec8f5e9c0 20 searching for the correct realm 2024-09-12T00:42:00.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.989+0000 7f9ec6263640 0 -- 172.21.15.137:0/376358319 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f9ebc047400 msgr2=0x7f9ebc047860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:00.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:00.993+0000 7f9ec6263640 0 -- 172.21.15.137:0/376358319 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5583026e9b20 msgr2=0x5583026ebf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:00.999 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.000 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:01.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 zone default found 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 4 Realm: () 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 zonegroup default 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.001+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.005+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.005+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.005+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.005+0000 7f9ec8f5e9c0 20 started sync module instance, tier type = 2024-09-12T00:42:01.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.005+0000 7f9ec8f5e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:01.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.021+0000 7f9ec8f5e9c0 20 add_watcher() i=0 2024-09-12T00:42:01.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.021+0000 7f9ec8f5e9c0 20 add_watcher() i=1 2024-09-12T00:42:01.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.021+0000 7f9ec8f5e9c0 20 add_watcher() i=2 2024-09-12T00:42:01.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.021+0000 7f9ec8f5e9c0 20 add_watcher() i=3 2024-09-12T00:42:01.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.021+0000 7f9ec8f5e9c0 20 add_watcher() i=4 2024-09-12T00:42:01.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.021+0000 7f9ec8f5e9c0 20 add_watcher() i=5 2024-09-12T00:42:01.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.021+0000 7f9ec8f5e9c0 20 add_watcher() i=6 2024-09-12T00:42:01.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.025+0000 7f9ec8f5e9c0 20 add_watcher() i=7 2024-09-12T00:42:01.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.025+0000 7f9ec8f5e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:01.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9d7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:01.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:01.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 5 note: GC not initialized 2024-09-12T00:42:01.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9cf7fff640 20 reqs_thread_entry: start 2024-09-12T00:42:01.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:01.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 Filter name: none 2024-09-12T00:42:01.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9cf5ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:01.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:42:01.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:42:01.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:01.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:42:01.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:42:01.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.029+0000 7f9ec8f5e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:01.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.033+0000 7f9d7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.037+0000 7f9ec8f5e9c0 20 remove_watcher() i=0 2024-09-12T00:42:01.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.037+0000 7f9ec8f5e9c0 2 removed watcher, disabling cache 2024-09-12T00:42:01.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.037+0000 7f9ec8f5e9c0 20 remove_watcher() i=1 2024-09-12T00:42:01.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.041+0000 7f9ec8f5e9c0 20 remove_watcher() i=2 2024-09-12T00:42:01.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.045+0000 7f9ec8f5e9c0 20 remove_watcher() i=3 2024-09-12T00:42:01.043 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.045+0000 7f9ec8f5e9c0 20 remove_watcher() i=4 2024-09-12T00:42:01.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.049+0000 7f9ec8f5e9c0 20 remove_watcher() i=5 2024-09-12T00:42:01.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.049+0000 7f9ec8f5e9c0 20 remove_watcher() i=6 2024-09-12T00:42:01.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.053+0000 7f9ec8f5e9c0 20 remove_watcher() i=7 2024-09-12T00:42:01.066 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:01.066 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:01.066 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-block-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:42:01.066 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:01.067 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.067 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.070 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.070 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.123 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.123 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.147 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:42:01.147 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:01.149 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.149 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.164 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.164 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.209 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.209 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.231 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.231 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.252 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.252 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.273 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.273 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.293 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.293 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.314 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.315 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.334 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.334 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.356 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.356 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.376 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.376 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.396 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.396 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.417 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.417 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.565 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.565 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.586 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.586 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.607 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:01.607 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:01.624 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:42:01.656 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:01.656 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:01.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.705+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.705+0000 7f07befb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.705+0000 7f07befb19c0 20 realm 2024-09-12T00:42:01.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.705+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.705+0000 7f07befb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.705+0000 7f07befb19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:01.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.705+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.709+0000 7f07befb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.709+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.709+0000 7f07befb19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.709+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.709+0000 7f07befb19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:01.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.709+0000 7f07befb19c0 20 searching for the correct realm 2024-09-12T00:42:01.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.717+0000 7f07bcab7640 0 -- 172.21.15.137:0/821319189 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f07b0003740 msgr2=0x7f07b0001a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.721+0000 7f07bcab7640 0 -- 172.21.15.137:0/821319189 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55c606c377e0 msgr2=0x55c606c39bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:01.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:01.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:01.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:01.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:01.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:01.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 zone default found 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 4 Realm: () 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 zonegroup default 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 started sync module instance, tier type = 2024-09-12T00:42:01.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.729+0000 7f07befb19c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:01.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 20 add_watcher() i=0 2024-09-12T00:42:01.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 20 add_watcher() i=1 2024-09-12T00:42:01.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 20 add_watcher() i=2 2024-09-12T00:42:01.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 20 add_watcher() i=3 2024-09-12T00:42:01.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 20 add_watcher() i=4 2024-09-12T00:42:01.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 20 add_watcher() i=5 2024-09-12T00:42:01.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 20 add_watcher() i=6 2024-09-12T00:42:01.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 20 add_watcher() i=7 2024-09-12T00:42:01.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.749+0000 7f07befb19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:01.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.753+0000 7f06737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.753+0000 7f07befb19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:01.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.753+0000 7f07befb19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:01.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.753+0000 7f07befb19c0 5 note: GC not initialized 2024-09-12T00:42:01.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f06727e4640 20 reqs_thread_entry: start 2024-09-12T00:42:01.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:01.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 Filter name: none 2024-09-12T00:42:01.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f066b7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:01.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:01.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:01.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:01.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:01.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:01.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.757+0000 7f07befb19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:01.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.761+0000 7f06737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.765+0000 7f07befb19c0 20 remove_watcher() i=0 2024-09-12T00:42:01.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.765+0000 7f07befb19c0 2 removed watcher, disabling cache 2024-09-12T00:42:01.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.765+0000 7f07befb19c0 20 remove_watcher() i=1 2024-09-12T00:42:01.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.769+0000 7f07befb19c0 20 remove_watcher() i=2 2024-09-12T00:42:01.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.769+0000 7f07befb19c0 20 remove_watcher() i=3 2024-09-12T00:42:01.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.773+0000 7f07befb19c0 20 remove_watcher() i=4 2024-09-12T00:42:01.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.773+0000 7f07befb19c0 20 remove_watcher() i=5 2024-09-12T00:42:01.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.777+0000 7f07befb19c0 20 remove_watcher() i=6 2024-09-12T00:42:01.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.781+0000 7f07befb19c0 20 remove_watcher() i=7 2024-09-12T00:42:01.792 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:01.792 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:01.793 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-commit-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:01.793 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:01.793 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:42:01.826 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:01.826 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:01.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.869+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.873+0000 7f64bd88b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.873+0000 7f64bd88b9c0 20 realm 2024-09-12T00:42:01.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.873+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.873+0000 7f64bd88b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.873+0000 7f64bd88b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:01.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.873+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.873+0000 7f64bd88b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.873+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.877+0000 7f64bd88b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.877+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.877+0000 7f64bd88b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:01.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.877+0000 7f64bd88b9c0 20 searching for the correct realm 2024-09-12T00:42:01.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.881+0000 7f64bab90640 0 -- 172.21.15.137:0/334278546 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f64b007a0c0 msgr2=0x7f64b001aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.889+0000 7f64bab90640 0 -- 172.21.15.137:0/334278546 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55a6f4766ff0 msgr2=0x55a6f4769460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:01.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:01.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:01.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:01.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:01.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:01.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:01.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 zone default found 2024-09-12T00:42:01.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 4 Realm: () 2024-09-12T00:42:01.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:01.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 zonegroup default 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 started sync module instance, tier type = 2024-09-12T00:42:01.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.897+0000 7f64bd88b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:01.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 20 add_watcher() i=0 2024-09-12T00:42:01.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 20 add_watcher() i=1 2024-09-12T00:42:01.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 20 add_watcher() i=2 2024-09-12T00:42:01.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 20 add_watcher() i=3 2024-09-12T00:42:01.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 20 add_watcher() i=4 2024-09-12T00:42:01.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 20 add_watcher() i=5 2024-09-12T00:42:01.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 20 add_watcher() i=6 2024-09-12T00:42:01.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 20 add_watcher() i=7 2024-09-12T00:42:01.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.917+0000 7f64bd88b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:01.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f6371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 5 note: GC not initialized 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f6370fe1640 20 reqs_thread_entry: start 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 20 Filter name: none 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f62ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:42:01.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:01.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:42:01.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:42:01.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 : miss 2024-09-12T00:42:01.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.921+0000 7f64bd88b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.925+0000 7f64bd88b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:01.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.925+0000 7f64bd88b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:01.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.925+0000 7f64bd88b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:01.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.925+0000 7f64bd88b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:01.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.925+0000 7f64bd88b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:01.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.925+0000 7f64bd88b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 2024-09-12T00:42:01.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f64bd88b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:01.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f64bd88b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:01.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f64bd88b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:01.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f64bd88b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30, ofs0, ns] 2024-09-12T00:42:01.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f639effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 94175554388416 notifier 7152 bl.length()=931 2024-09-12T00:42:01.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f639effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:01.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f639effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:01.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f639effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:01.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f64bd88b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_sources= new_sources= 2024-09-12T00:42:01.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f64bd88b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential sources added=[] removed=[] 2024-09-12T00:42:01.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f64bd88b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_dests= new_dests= 2024-09-12T00:42:01.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.933+0000 7f64bd88b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential dests added=[] removed=[] 2024-09-12T00:42:01.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.937+0000 7f64bd88b9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.1.0 2024-09-12T00:42:01.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.937+0000 7f64bd88b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.1.0 2024-09-12T00:42:01.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.937+0000 7f64bd88b9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.1.1 2024-09-12T00:42:01.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.937+0000 7f64bd88b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.1.1 2024-09-12T00:42:01.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.937+0000 7f64bd88b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.0 2024-09-12T00:42:01.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.941+0000 7f64bd88b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:01.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.941+0000 7f64bd88b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 2024-09-12T00:42:01.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:01.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:01.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:01.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30, ofs0, ns] 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f639effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94175554388416 notifier 7152 bl.length()=931 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f639effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f639effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f639effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_sources= new_sources= 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential sources added=[] removed=[] 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_dests= new_dests= 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential dests added=[] removed=[] 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.0 2024-09-12T00:42:01.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:42:01.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.945+0000 7f64bd88b9c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:42:01.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.949+0000 7f6371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.953+0000 7f64bd88b9c0 20 remove_watcher() i=0 2024-09-12T00:42:01.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.953+0000 7f64bd88b9c0 2 removed watcher, disabling cache 2024-09-12T00:42:01.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.957+0000 7f64bd88b9c0 20 remove_watcher() i=1 2024-09-12T00:42:01.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.961+0000 7f64bd88b9c0 20 remove_watcher() i=2 2024-09-12T00:42:01.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.961+0000 7f64bd88b9c0 20 remove_watcher() i=3 2024-09-12T00:42:01.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.965+0000 7f64bd88b9c0 20 remove_watcher() i=4 2024-09-12T00:42:01.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.965+0000 7f64bd88b9c0 20 remove_watcher() i=5 2024-09-12T00:42:01.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.969+0000 7f64bd88b9c0 20 remove_watcher() i=6 2024-09-12T00:42:01.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:01.973+0000 7f64bd88b9c0 20 remove_watcher() i=7 2024-09-12T00:42:01.984 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:42:02.010 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:02.011 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:02.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.057+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.057+0000 7f95d7b7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.057+0000 7f95d7b7e9c0 20 realm 2024-09-12T00:42:02.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.057+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.057+0000 7f95d7b7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.057+0000 7f95d7b7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:02.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.057+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.057 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.061+0000 7f95d7b7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.061+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.061+0000 7f95d7b7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:02.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.061+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.061+0000 7f95d7b7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:02.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.061+0000 7f95d7b7e9c0 20 searching for the correct realm 2024-09-12T00:42:02.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.069+0000 7f95d4e83640 0 -- 172.21.15.137:0/3343847636 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x555da7e56c70 msgr2=0x555da7e59060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:02.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.073+0000 7f95d4e83640 0 -- 172.21.15.137:0/3343847636 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x555da7e600d0 msgr2=0x555da7e62500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:02.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:02.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:02.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:02.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:02.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:02.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:02.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:02.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 zone default found 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 4 Realm: () 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 zonegroup default 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.081+0000 7f95d7b7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.085+0000 7f95d7b7e9c0 20 started sync module instance, tier type = 2024-09-12T00:42:02.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.085+0000 7f95d7b7e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:02.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.101+0000 7f95d7b7e9c0 20 add_watcher() i=0 2024-09-12T00:42:02.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.101+0000 7f95d7b7e9c0 20 add_watcher() i=1 2024-09-12T00:42:02.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.101+0000 7f95d7b7e9c0 20 add_watcher() i=2 2024-09-12T00:42:02.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.101+0000 7f95d7b7e9c0 20 add_watcher() i=3 2024-09-12T00:42:02.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.101+0000 7f95d7b7e9c0 20 add_watcher() i=4 2024-09-12T00:42:02.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.101+0000 7f95d7b7e9c0 20 add_watcher() i=5 2024-09-12T00:42:02.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.101+0000 7f95d7b7e9c0 20 add_watcher() i=6 2024-09-12T00:42:02.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.105+0000 7f95d7b7e9c0 20 add_watcher() i=7 2024-09-12T00:42:02.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.105+0000 7f95d7b7e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:02.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.105+0000 7f948b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:02.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.105+0000 7f95d7b7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:02.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.105+0000 7f95d7b7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:02.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.105+0000 7f95d7b7e9c0 5 note: GC not initialized 2024-09-12T00:42:02.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.105+0000 7f948a7e4640 20 reqs_thread_entry: start 2024-09-12T00:42:02.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:02.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 Filter name: none 2024-09-12T00:42:02.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f93fbfff640 20 reqs_thread_entry: start 2024-09-12T00:42:02.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:02.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:42:02.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:02.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:02.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:42:02.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.109+0000 7f95d7b7e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:02.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.113+0000 7f948b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:02.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.117+0000 7f95d7b7e9c0 20 remove_watcher() i=0 2024-09-12T00:42:02.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.117+0000 7f95d7b7e9c0 2 removed watcher, disabling cache 2024-09-12T00:42:02.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.117+0000 7f95d7b7e9c0 20 remove_watcher() i=1 2024-09-12T00:42:02.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.121+0000 7f95d7b7e9c0 20 remove_watcher() i=2 2024-09-12T00:42:02.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.121+0000 7f95d7b7e9c0 20 remove_watcher() i=3 2024-09-12T00:42:02.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.125+0000 7f95d7b7e9c0 20 remove_watcher() i=4 2024-09-12T00:42:02.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.125+0000 7f95d7b7e9c0 20 remove_watcher() i=5 2024-09-12T00:42:02.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.129+0000 7f95d7b7e9c0 20 remove_watcher() i=6 2024-09-12T00:42:02.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.133+0000 7f95d7b7e9c0 20 remove_watcher() i=7 2024-09-12T00:42:02.143 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:02.143 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:02.143 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-commit-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:02.143 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:02.144 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:02.145 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:02.155 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:02.156 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:02.198 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:42:02.234 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:02.234 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:02.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.281+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 realm 2024-09-12T00:42:02.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:02.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:02.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:02.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.285+0000 7f8f034589c0 20 searching for the correct realm 2024-09-12T00:42:02.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.289+0000 7f8f00f5e640 0 -- 172.21.15.137:0/3324260109 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f8ef0089a20 msgr2=0x7f8ef005e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:02.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.501+0000 7f8f00f5e640 0 -- 172.21.15.137:0/3324260109 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f8ef80b8070 msgr2=0x7f8ef80ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:02.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.717+0000 7f8f034589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:02.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.717+0000 7f8f034589c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:02.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.717+0000 7f8f034589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:02.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.717+0000 7f8f034589c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:02.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.717+0000 7f8f034589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:02.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.717+0000 7f8f034589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:02.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.717+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:02.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:02.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 zone default found 2024-09-12T00:42:02.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 4 Realm: () 2024-09-12T00:42:02.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:02.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:02.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:02.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 zonegroup default 2024-09-12T00:42:02.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.721+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.725+0000 7f8f034589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.725+0000 7f8f034589c0 20 started sync module instance, tier type = 2024-09-12T00:42:02.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.725+0000 7f8f034589c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:02.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.745+0000 7f8f034589c0 20 add_watcher() i=0 2024-09-12T00:42:02.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.745+0000 7f8f034589c0 20 add_watcher() i=1 2024-09-12T00:42:02.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.745+0000 7f8f034589c0 20 add_watcher() i=2 2024-09-12T00:42:02.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.745+0000 7f8f034589c0 20 add_watcher() i=3 2024-09-12T00:42:02.744 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.745+0000 7f8f034589c0 20 add_watcher() i=4 2024-09-12T00:42:02.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.745+0000 7f8f034589c0 20 add_watcher() i=5 2024-09-12T00:42:02.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.745+0000 7f8f034589c0 20 add_watcher() i=6 2024-09-12T00:42:02.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.749+0000 7f8f034589c0 20 add_watcher() i=7 2024-09-12T00:42:02.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.749+0000 7f8f034589c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:02.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8db77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:02.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:02.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:02.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 5 note: GC not initialized 2024-09-12T00:42:02.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8db67e4640 20 reqs_thread_entry: start 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 20 Filter name: none 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8daf7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 : miss 2024-09-12T00:42:02.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:42:02.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:02.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:02.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:02.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:02.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.753+0000 7f8f034589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 2024-09-12T00:42:02.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.757+0000 7f8f034589c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:02.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.765+0000 7f8f034589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.765+0000 7f8f034589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.765+0000 7f8f034589c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.765+0000 7f8f034589c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30, ofs0, ns] 2024-09-12T00:42:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.765+0000 7f8dd7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94135546661760 notifier 6869 bl.length()=931 2024-09-12T00:42:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.765+0000 7f8dd7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.765+0000 7f8dd7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:02.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.765+0000 7f8dd7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:02.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_sources= new_sources= 2024-09-12T00:42:02.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential sources added=[] removed=[] 2024-09-12T00:42:02.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_dests= new_dests= 2024-09-12T00:42:02.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential dests added=[] removed=[] 2024-09-12T00:42:02.768 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.2.0 2024-09-12T00:42:02.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.2.0 2024-09-12T00:42:02.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.2.1 2024-09-12T00:42:02.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.2.1 2024-09-12T00:42:02.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.769+0000 7f8f034589c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.0 2024-09-12T00:42:02.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.773+0000 7f8f034589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:02.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.773+0000 7f8f034589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 2024-09-12T00:42:02.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.777+0000 7f8f034589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:02.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.777+0000 7f8f034589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:02.776 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.777+0000 7f8f034589c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:02.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.777+0000 7f8f034589c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30, ofs0, ns] 2024-09-12T00:42:02.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.777+0000 7f8dd7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94135546661760 notifier 6869 bl.length()=931 2024-09-12T00:42:02.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.777+0000 7f8dd7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:02.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.777+0000 7f8dd7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:02.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.777+0000 7f8dd7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:02.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.781+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_sources= new_sources= 2024-09-12T00:42:02.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.781+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential sources added=[] removed=[] 2024-09-12T00:42:02.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.781+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_dests= new_dests= 2024-09-12T00:42:02.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.781+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential dests added=[] removed=[] 2024-09-12T00:42:02.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.781+0000 7f8f034589c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30.0 2024-09-12T00:42:02.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.781+0000 7f8f034589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:02.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.781+0000 7f8f034589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 2024-09-12T00:42:02.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:02.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:02.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:02.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30, ofs0, ns] 2024-09-12T00:42:02.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8dd77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94135546661760 notifier 6869 bl.length()=899 2024-09-12T00:42:02.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8dd77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 info.flags=0x17 2024-09-12T00:42:02.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8dd77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 to cache LRU end 2024-09-12T00:42:02.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8dd77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:02.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_sources= new_sources= 2024-09-12T00:42:02.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential sources added=[] removed=[] 2024-09-12T00:42:02.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): orig_dests= new_dests= 2024-09-12T00:42:02.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30]): potential dests added=[] removed=[] 2024-09-12T00:42:02.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.785+0000 7f8f034589c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:42:02.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.789+0000 7f8db77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:02.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.793+0000 7f8f034589c0 20 remove_watcher() i=0 2024-09-12T00:42:02.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.793+0000 7f8f034589c0 2 removed watcher, disabling cache 2024-09-12T00:42:02.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.797+0000 7f8f034589c0 20 remove_watcher() i=1 2024-09-12T00:42:02.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.797+0000 7f8f034589c0 20 remove_watcher() i=2 2024-09-12T00:42:02.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.801+0000 7f8f034589c0 20 remove_watcher() i=3 2024-09-12T00:42:02.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.805+0000 7f8f034589c0 20 remove_watcher() i=4 2024-09-12T00:42:02.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.805+0000 7f8f034589c0 20 remove_watcher() i=5 2024-09-12T00:42:02.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.809+0000 7f8f034589c0 20 remove_watcher() i=6 2024-09-12T00:42:02.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.813+0000 7f8f034589c0 20 remove_watcher() i=7 2024-09-12T00:42:02.824 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:42:02.855 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:02.855 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:02.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.901+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 realm 2024-09-12T00:42:02.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:02.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:02.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:02.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.905+0000 7f95dbb2a9c0 20 searching for the correct realm 2024-09-12T00:42:02.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.913+0000 7f95d9e31640 0 -- 172.21.15.137:0/2946782919 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f95d001a040 msgr2=0x7f95d005d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:02.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.917+0000 7f95d9630640 0 -- 172.21.15.137:0/2946782919 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f95d40ce060 msgr2=0x7f95d40cf040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:02.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:02.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:02.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:02.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:02.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:02.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:02.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:02.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 zone default found 2024-09-12T00:42:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 4 Realm: () 2024-09-12T00:42:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 zonegroup default 2024-09-12T00:42:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.925+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.929+0000 7f95dbb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.929+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.929+0000 7f95dbb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.929+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.929+0000 7f95dbb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.929+0000 7f95dbb2a9c0 20 started sync module instance, tier type = 2024-09-12T00:42:02.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.929+0000 7f95dbb2a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:02.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.945+0000 7f95dbb2a9c0 20 add_watcher() i=0 2024-09-12T00:42:02.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.945+0000 7f95dbb2a9c0 20 add_watcher() i=1 2024-09-12T00:42:02.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.945+0000 7f95dbb2a9c0 20 add_watcher() i=2 2024-09-12T00:42:02.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.945+0000 7f95dbb2a9c0 20 add_watcher() i=3 2024-09-12T00:42:02.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.945+0000 7f95dbb2a9c0 20 add_watcher() i=4 2024-09-12T00:42:02.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.945+0000 7f95dbb2a9c0 20 add_watcher() i=5 2024-09-12T00:42:02.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.945+0000 7f95dbb2a9c0 20 add_watcher() i=6 2024-09-12T00:42:02.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.949+0000 7f95dbb2a9c0 20 add_watcher() i=7 2024-09-12T00:42:02.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.949+0000 7f95dbb2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:02.950 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f948f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 5 note: GC not initialized 2024-09-12T00:42:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f948e7e4640 20 reqs_thread_entry: start 2024-09-12T00:42:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 Filter name: none 2024-09-12T00:42:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f93fffff640 20 reqs_thread_entry: start 2024-09-12T00:42:02.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:02.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.952 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:02.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:02.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:02.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.953+0000 7f95dbb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.954 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.957+0000 7f95dbb2a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:02.954 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.957+0000 7f95dbb2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:02.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.957+0000 7f948f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:02.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.961+0000 7f95dbb2a9c0 20 remove_watcher() i=0 2024-09-12T00:42:02.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.961+0000 7f95dbb2a9c0 2 removed watcher, disabling cache 2024-09-12T00:42:02.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.965+0000 7f95dbb2a9c0 20 remove_watcher() i=1 2024-09-12T00:42:02.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.965+0000 7f95dbb2a9c0 20 remove_watcher() i=2 2024-09-12T00:42:02.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.969+0000 7f95dbb2a9c0 20 remove_watcher() i=3 2024-09-12T00:42:02.968 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.969+0000 7f95dbb2a9c0 20 remove_watcher() i=4 2024-09-12T00:42:02.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.973+0000 7f95dbb2a9c0 20 remove_watcher() i=5 2024-09-12T00:42:02.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.973+0000 7f95dbb2a9c0 20 remove_watcher() i=6 2024-09-12T00:42:02.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:02.977+0000 7f95dbb2a9c0 20 remove_watcher() i=7 2024-09-12T00:42:02.990 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:02.990 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:02.990 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-commit-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:42:02.990 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:02.991 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:02.992 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:02.995 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:02.995 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.051 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.052 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.080 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:42:03.080 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:03.082 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.082 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.100 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.101 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.148 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.148 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.168 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.168 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.188 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.188 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.208 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.208 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.229 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.229 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.252 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.252 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.272 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.272 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.292 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.292 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.313 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.313 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.334 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.334 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.353 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.354 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.374 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.374 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.393 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.393 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.412 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.412 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.433 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.433 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.452 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.452 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.472 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.472 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.490 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.491 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.509 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.509 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.529 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:03.529 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:03.549 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:42:03.581 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:03.582 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:03.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.629+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:03.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 realm 2024-09-12T00:42:03.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:03.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:03.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:03.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:03.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:03.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.633+0000 7fdaf9af79c0 20 searching for the correct realm 2024-09-12T00:42:03.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.637+0000 7fdaf6dfc640 0 -- 172.21.15.137:0/2950566680 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fdaec0fe830 msgr2=0x7fdaec0fb980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:03.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.849+0000 7fdaf6dfc640 0 -- 172.21.15.137:0/2950566680 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x563d1b9580d0 msgr2=0x563d1b95a550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:03.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.861+0000 7fdaf9af79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:03.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.861+0000 7fdaf9af79c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:03.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.861+0000 7fdaf9af79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:03.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.861+0000 7fdaf9af79c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:03.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.861+0000 7fdaf9af79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:03.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.861+0000 7fdaf9af79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:03.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.861+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:03.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:03.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:03.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 zone default found 2024-09-12T00:42:03.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 4 Realm: () 2024-09-12T00:42:03.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:03.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:03.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:03.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 zonegroup default 2024-09-12T00:42:03.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:03.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:03.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.865+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.869+0000 7fdaf9af79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:03.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.869+0000 7fdaf9af79c0 20 started sync module instance, tier type = 2024-09-12T00:42:03.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.869+0000 7fdaf9af79c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:03.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.889+0000 7fdaf9af79c0 20 add_watcher() i=0 2024-09-12T00:42:03.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.889+0000 7fdaf9af79c0 20 add_watcher() i=1 2024-09-12T00:42:03.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.889+0000 7fdaf9af79c0 20 add_watcher() i=2 2024-09-12T00:42:03.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.889+0000 7fdaf9af79c0 20 add_watcher() i=3 2024-09-12T00:42:03.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.889+0000 7fdaf9af79c0 20 add_watcher() i=4 2024-09-12T00:42:03.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.889+0000 7fdaf9af79c0 20 add_watcher() i=5 2024-09-12T00:42:03.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.889+0000 7fdaf9af79c0 20 add_watcher() i=6 2024-09-12T00:42:03.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.893+0000 7fdaf9af79c0 20 add_watcher() i=7 2024-09-12T00:42:03.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.893+0000 7fdaf9af79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:03.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fd9adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:03.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fdaf9af79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:03.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fdaf9af79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:03.895 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fdaf9af79c0 5 note: GC not initialized 2024-09-12T00:42:03.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fd9acfe1640 20 reqs_thread_entry: start 2024-09-12T00:42:03.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fdaf9af79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:03.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fdaf9af79c0 20 Filter name: none 2024-09-12T00:42:03.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fd9267fc640 20 reqs_thread_entry: start 2024-09-12T00:42:03.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fdaf9af79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:03.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.897+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.901+0000 7fdaf9af79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:03.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.901+0000 7fdaf9af79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:03.898 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.901+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.901+0000 7fdaf9af79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:03.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.901+0000 7fdaf9af79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:03.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.901+0000 7fdaf9af79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:03.900 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.901+0000 7fdaf9af79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:03.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.905+0000 7fd9adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:03.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.909+0000 7fdaf9af79c0 20 remove_watcher() i=0 2024-09-12T00:42:03.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.909+0000 7fdaf9af79c0 2 removed watcher, disabling cache 2024-09-12T00:42:03.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.909+0000 7fdaf9af79c0 20 remove_watcher() i=1 2024-09-12T00:42:03.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.913+0000 7fdaf9af79c0 20 remove_watcher() i=2 2024-09-12T00:42:03.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.913+0000 7fdaf9af79c0 20 remove_watcher() i=3 2024-09-12T00:42:03.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.917+0000 7fdaf9af79c0 20 remove_watcher() i=4 2024-09-12T00:42:03.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.917+0000 7fdaf9af79c0 20 remove_watcher() i=5 2024-09-12T00:42:03.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.921+0000 7fdaf9af79c0 20 remove_watcher() i=6 2024-09-12T00:42:03.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:03.925+0000 7fdaf9af79c0 20 remove_watcher() i=7 2024-09-12T00:42:03.943 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:03.943 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:03.943 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-commit-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:03.943 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:03.943 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:42:03.983 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:03.983 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:04.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.225+0000 7f9de74d6640 0 --2- 172.21.15.137:0/2526080377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de435d1810 0x55de435d1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:42:04.237 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 20 realm 2024-09-12T00:42:04.239 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:04.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.241+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.245+0000 7f9de91cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:04.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.245+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.245+0000 7f9de91cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:04.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.245+0000 7f9de91cf9c0 20 searching for the correct realm 2024-09-12T00:42:04.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.249+0000 7f9de6cd5640 0 -- 172.21.15.137:0/3304386067 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f9dd80ec910 msgr2=0x7f9dd80c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:04.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.461+0000 7f9de6cd5640 0 -- 172.21.15.137:0/3304386067 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f9de0079020 msgr2=0x7f9de0060810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:04.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:04.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:04.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 zone default found 2024-09-12T00:42:04.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 4 Realm: () 2024-09-12T00:42:04.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:04.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:04.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:04.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 zonegroup default 2024-09-12T00:42:04.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.681+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.685+0000 7f9de91cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.685+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.685+0000 7f9de91cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.685+0000 7f9de91cf9c0 20 started sync module instance, tier type = 2024-09-12T00:42:04.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.685+0000 7f9de91cf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:04.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.705+0000 7f9de91cf9c0 20 add_watcher() i=0 2024-09-12T00:42:04.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.705+0000 7f9de91cf9c0 20 add_watcher() i=1 2024-09-12T00:42:04.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.705+0000 7f9de91cf9c0 20 add_watcher() i=2 2024-09-12T00:42:04.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.705+0000 7f9de91cf9c0 20 add_watcher() i=3 2024-09-12T00:42:04.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.705+0000 7f9de91cf9c0 20 add_watcher() i=4 2024-09-12T00:42:04.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.705+0000 7f9de91cf9c0 20 add_watcher() i=5 2024-09-12T00:42:04.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.705+0000 7f9de91cf9c0 20 add_watcher() i=6 2024-09-12T00:42:04.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.709+0000 7f9de91cf9c0 20 add_watcher() i=7 2024-09-12T00:42:04.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.709+0000 7f9de91cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:04.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9c9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:04.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9de91cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:04.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9de91cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:04.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9de91cf9c0 5 note: GC not initialized 2024-09-12T00:42:04.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9c17fff640 20 reqs_thread_entry: start 2024-09-12T00:42:04.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9de91cf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:04.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9de91cf9c0 20 Filter name: none 2024-09-12T00:42:04.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9c15ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:04.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9de91cf9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:42:04.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.713+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:04.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:42:04.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:42:04.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 : miss 2024-09-12T00:42:04.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:04.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 info.flags=0x17 2024-09-12T00:42:04.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 to cache LRU end 2024-09-12T00:42:04.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:04.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:04.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.717+0000 7f9de91cf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 2024-09-12T00:42:04.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9de91cf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 info.flags=0x17 2024-09-12T00:42:04.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9de91cf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 to cache LRU end 2024-09-12T00:42:04.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9de91cf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:04.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9de91cf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31, ofs0, ns] 2024-09-12T00:42:04.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9cca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94413101761008 notifier 7239 bl.length()=931 2024-09-12T00:42:04.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9cca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 info.flags=0x17 2024-09-12T00:42:04.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9cca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 to cache LRU end 2024-09-12T00:42:04.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9cca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:04.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): orig_sources= new_sources= 2024-09-12T00:42:04.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): potential sources added=[] removed=[] 2024-09-12T00:42:04.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): orig_dests= new_dests= 2024-09-12T00:42:04.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.725+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): potential dests added=[] removed=[] 2024-09-12T00:42:04.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.729+0000 7f9de91cf9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31.1.0 2024-09-12T00:42:04.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.729+0000 7f9de91cf9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31.1.0 2024-09-12T00:42:04.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.729+0000 7f9de91cf9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31.1.1 2024-09-12T00:42:04.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.729+0000 7f9de91cf9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31.1.1 2024-09-12T00:42:04.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.729+0000 7f9de91cf9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31.0 2024-09-12T00:42:04.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:04.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 2024-09-12T00:42:04.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 info.flags=0x17 2024-09-12T00:42:04.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 to cache LRU end 2024-09-12T00:42:04.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:04.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31, ofs0, ns] 2024-09-12T00:42:04.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9cca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94413101761008 notifier 7239 bl.length()=931 2024-09-12T00:42:04.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9cca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 info.flags=0x17 2024-09-12T00:42:04.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9cca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 to cache LRU end 2024-09-12T00:42:04.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9cca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:04.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): orig_sources= new_sources= 2024-09-12T00:42:04.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): potential sources added=[] removed=[] 2024-09-12T00:42:04.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): orig_dests= new_dests= 2024-09-12T00:42:04.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.737+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): potential dests added=[] removed=[] 2024-09-12T00:42:04.738 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.741+0000 7f9de91cf9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31.0 2024-09-12T00:42:04.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.741+0000 7f9de91cf9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:42:04.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.741+0000 7f9de91cf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:04.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.741+0000 7f9de91cf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 2024-09-12T00:42:04.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.741+0000 7f9de91cf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 info.flags=0x17 2024-09-12T00:42:04.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.741+0000 7f9de91cf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 to cache LRU end 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.741+0000 7f9de91cf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.741+0000 7f9de91cf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31, ofs0, ns] 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9cca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94413101761008 notifier 7239 bl.length()=899 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9cca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 info.flags=0x17 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9cca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 to cache LRU end 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9cca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): orig_sources= new_sources= 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): potential sources added=[] removed=[] 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): orig_dests= new_dests= 2024-09-12T00:42:04.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9de91cf9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31]): potential dests added=[] removed=[] 2024-09-12T00:42:04.743 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.745+0000 7f9de91cf9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:42:04.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.749+0000 7f9c9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:04.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.753+0000 7f9de91cf9c0 20 remove_watcher() i=0 2024-09-12T00:42:04.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.753+0000 7f9de91cf9c0 2 removed watcher, disabling cache 2024-09-12T00:42:04.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.757+0000 7f9de91cf9c0 20 remove_watcher() i=1 2024-09-12T00:42:04.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.757+0000 7f9de91cf9c0 20 remove_watcher() i=2 2024-09-12T00:42:04.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.761+0000 7f9de91cf9c0 20 remove_watcher() i=3 2024-09-12T00:42:04.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.761+0000 7f9de91cf9c0 20 remove_watcher() i=4 2024-09-12T00:42:04.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.765+0000 7f9de91cf9c0 20 remove_watcher() i=5 2024-09-12T00:42:04.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.765+0000 7f9de91cf9c0 20 remove_watcher() i=6 2024-09-12T00:42:04.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.769+0000 7f9de91cf9c0 20 remove_watcher() i=7 2024-09-12T00:42:04.785 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:42:04.817 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:04.817 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:04.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.865+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.865+0000 7f4cea5b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.865+0000 7f4cea5b89c0 20 realm 2024-09-12T00:42:04.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.865+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.865+0000 7f4cea5b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.865+0000 7f4cea5b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:04.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.865+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.869+0000 7f4cea5b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.869+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.869+0000 7f4cea5b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:04.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.869+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.869+0000 7f4cea5b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:04.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.869+0000 7f4cea5b89c0 20 searching for the correct realm 2024-09-12T00:42:04.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.873+0000 7f4cdffff640 0 -- 172.21.15.137:0/2992304085 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f4cd0021950 msgr2=0x7f4cd0038400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:04.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.881+0000 7f4ce88bf640 0 -- 172.21.15.137:0/2992304085 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55c94f356e20 msgr2=0x55c94f359210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:04.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.885+0000 7f4cea5b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:04.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.885+0000 7f4cea5b89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:04.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.885+0000 7f4cea5b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:04.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.885+0000 7f4cea5b89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:04.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.885+0000 7f4cea5b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:04.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.885+0000 7f4cea5b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:04.885 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.885+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:04.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:04.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 zone default found 2024-09-12T00:42:04.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 4 Realm: () 2024-09-12T00:42:04.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:04.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:04.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:04.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 zonegroup default 2024-09-12T00:42:04.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:04.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 started sync module instance, tier type = 2024-09-12T00:42:04.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.889+0000 7f4cea5b89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:04.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 20 add_watcher() i=0 2024-09-12T00:42:04.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 20 add_watcher() i=1 2024-09-12T00:42:04.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 20 add_watcher() i=2 2024-09-12T00:42:04.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 20 add_watcher() i=3 2024-09-12T00:42:04.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 20 add_watcher() i=4 2024-09-12T00:42:04.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 20 add_watcher() i=5 2024-09-12T00:42:04.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 20 add_watcher() i=6 2024-09-12T00:42:04.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 20 add_watcher() i=7 2024-09-12T00:42:04.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.909+0000 7f4cea5b89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:04.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4b9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:04.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4cea5b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:04.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4cea5b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:04.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4cea5b89c0 5 note: GC not initialized 2024-09-12T00:42:04.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4b9dfdb640 20 reqs_thread_entry: start 2024-09-12T00:42:04.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4cea5b89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:04.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4cea5b89c0 20 Filter name: none 2024-09-12T00:42:04.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4b0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:04.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.913+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:04.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:04.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:04.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:04.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:04.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:04.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.917+0000 7f4cea5b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:04.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.921+0000 7f4b9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:04.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.925+0000 7f4cea5b89c0 20 remove_watcher() i=0 2024-09-12T00:42:04.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.925+0000 7f4cea5b89c0 2 removed watcher, disabling cache 2024-09-12T00:42:04.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.925+0000 7f4cea5b89c0 20 remove_watcher() i=1 2024-09-12T00:42:04.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.929+0000 7f4cea5b89c0 20 remove_watcher() i=2 2024-09-12T00:42:04.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.929+0000 7f4cea5b89c0 20 remove_watcher() i=3 2024-09-12T00:42:04.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.933+0000 7f4cea5b89c0 20 remove_watcher() i=4 2024-09-12T00:42:04.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.933+0000 7f4cea5b89c0 20 remove_watcher() i=5 2024-09-12T00:42:04.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.937+0000 7f4cea5b89c0 20 remove_watcher() i=6 2024-09-12T00:42:04.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:04.941+0000 7f4cea5b89c0 20 remove_watcher() i=7 2024-09-12T00:42:04.952 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:04.952 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:04.952 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-commit-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:42:04.952 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:04.954 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:04.954 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:04.957 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:04.957 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.014 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.015 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.041 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:42:05.042 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:05.043 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.043 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.059 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.059 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.105 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.105 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.125 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.125 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.147 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.147 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.167 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.167 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.189 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.190 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.210 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.210 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.233 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.233 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.254 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.254 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.274 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.275 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.295 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.295 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.316 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.316 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.337 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.337 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.358 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.358 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.380 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.381 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.400 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.401 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.420 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.421 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.441 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.441 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.462 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.462 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.483 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.483 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.503 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:05.503 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:05.522 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:42:05.555 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:05.555 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:05.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.601+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 realm 2024-09-12T00:42:05.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:05.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:05.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.605+0000 7efda91ba9c0 20 searching for the correct realm 2024-09-12T00:42:05.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.613+0000 7efda64bf640 0 -- 172.21.15.137:0/1700747548 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7efd9c0f61d0 msgr2=0x7efd9c11c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:05.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.617+0000 7efda74c1640 0 -- 172.21.15.137:0/1700747548 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55eac02d57d0 msgr2=0x55eac02d7c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:05.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:05.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:05.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:05.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:05.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:05.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:05.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:05.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.625+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:05.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 zone default found 2024-09-12T00:42:05.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 4 Realm: () 2024-09-12T00:42:05.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:05.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:05.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:05.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 zonegroup default 2024-09-12T00:42:05.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 started sync module instance, tier type = 2024-09-12T00:42:05.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.629+0000 7efda91ba9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:05.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 20 add_watcher() i=0 2024-09-12T00:42:05.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 20 add_watcher() i=1 2024-09-12T00:42:05.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 20 add_watcher() i=2 2024-09-12T00:42:05.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 20 add_watcher() i=3 2024-09-12T00:42:05.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 20 add_watcher() i=4 2024-09-12T00:42:05.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 20 add_watcher() i=5 2024-09-12T00:42:05.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 20 add_watcher() i=6 2024-09-12T00:42:05.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 20 add_watcher() i=7 2024-09-12T00:42:05.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.649+0000 7efda91ba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:05.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efc5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:05.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efda91ba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:05.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efda91ba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:05.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efda91ba9c0 5 note: GC not initialized 2024-09-12T00:42:05.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efbd7fff640 20 reqs_thread_entry: start 2024-09-12T00:42:05.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efda91ba9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:05.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efda91ba9c0 20 Filter name: none 2024-09-12T00:42:05.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efbd5ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:05.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.653+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:05.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:05.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:05.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:05.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:05.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.657+0000 7efda91ba9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:05.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.661+0000 7efc5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:05.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.665+0000 7efda91ba9c0 20 remove_watcher() i=0 2024-09-12T00:42:05.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.665+0000 7efda91ba9c0 2 removed watcher, disabling cache 2024-09-12T00:42:05.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.665+0000 7efda91ba9c0 20 remove_watcher() i=1 2024-09-12T00:42:05.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.669+0000 7efda91ba9c0 20 remove_watcher() i=2 2024-09-12T00:42:05.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.669+0000 7efda91ba9c0 20 remove_watcher() i=3 2024-09-12T00:42:05.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.673+0000 7efda91ba9c0 20 remove_watcher() i=4 2024-09-12T00:42:05.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.677+0000 7efda91ba9c0 20 remove_watcher() i=5 2024-09-12T00:42:05.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.677+0000 7efda91ba9c0 20 remove_watcher() i=6 2024-09-12T00:42:05.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.681+0000 7efda91ba9c0 20 remove_watcher() i=7 2024-09-12T00:42:05.692 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:05.692 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:05.693 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-commit-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:05.693 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:05.693 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:42:05.725 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:05.726 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:05.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 realm 2024-09-12T00:42:05.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:05.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:05.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:05.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:05.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:05.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 searching for the correct realm 2024-09-12T00:42:05.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:05.989+0000 7f71d011f640 0 -- 172.21.15.137:0/2562099916 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f71c40675a0 msgr2=0x7f71c40651b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:06.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.205+0000 7f71d011f640 0 -- 172.21.15.137:0/2562099916 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x557c92937c50 msgr2=0x557c9293a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:06.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:06.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:06.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:06.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:06.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:06.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:06.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:06.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:06.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 zone default found 2024-09-12T00:42:06.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 Realm: () 2024-09-12T00:42:06.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:06.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:06.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:06.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 zonegroup default 2024-09-12T00:42:06.221 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 started sync module instance, tier type = 2024-09-12T00:42:06.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:06.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=0 2024-09-12T00:42:06.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=1 2024-09-12T00:42:06.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=2 2024-09-12T00:42:06.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=3 2024-09-12T00:42:06.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=4 2024-09-12T00:42:06.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=5 2024-09-12T00:42:06.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=6 2024-09-12T00:42:06.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=7 2024-09-12T00:42:06.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:06.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.253+0000 7f70877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:06.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:06.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:06.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 note: GC not initialized 2024-09-12T00:42:06.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.253+0000 7f70867e4640 20 reqs_thread_entry: start 2024-09-12T00:42:06.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:06.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 Filter name: none 2024-09-12T00:42:06.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f707ffff640 20 reqs_thread_entry: start 2024-09-12T00:42:06.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:42:06.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:06.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:42:06.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:42:06.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : miss 2024-09-12T00:42:06.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:06.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:06.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:06.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:06.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 93993523495104 notifier 7293 bl.length()=931 2024-09-12T00:42:06.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:06.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:06.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:06.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:06.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.0 2024-09-12T00:42:06.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.0 2024-09-12T00:42:06.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.1 2024-09-12T00:42:06.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.1 2024-09-12T00:42:06.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.0 2024-09-12T00:42:06.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:06.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:06.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:06.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 93993523495104 notifier 7293 bl.length()=931 2024-09-12T00:42:06.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:06.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:06.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:06.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:06.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.0 2024-09-12T00:42:06.281 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f71d2e1a9c0 time 2024-09-12T00:42:06.285683+0000 2024-09-12T00:42:06.281 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:06.282 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:06.282 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f71d66f42eb] 2024-09-12T00:42:06.282 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f71d66f449f] 2024-09-12T00:42:06.282 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c90acfcc1] 2024-09-12T00:42:06.282 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x557c90ae4fc7] 2024-09-12T00:42:06.283 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:42:06.283 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f71d555ad90] 2024-09-12T00:42:06.283 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:42:06.283 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:42:06.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.285+0000 7f71d2e1a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f71d2e1a9c0 time 2024-09-12T00:42:06.285683+0000 2024-09-12T00:42:06.284 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:06.284 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.284 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:06.284 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f71d66f42eb] 2024-09-12T00:42:06.284 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f71d66f449f] 2024-09-12T00:42:06.285 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c90acfcc1] 2024-09-12T00:42:06.285 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x557c90ae4fc7] 2024-09-12T00:42:06.285 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:42:06.285 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f71d555ad90] 2024-09-12T00:42:06.285 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:42:06.285 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:42:06.286 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.286 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:42:06.286 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f71d2e1a9c0 thread_name:radosgw-admin 2024-09-12T00:42:06.308 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:06.308 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f71d5573520] 2024-09-12T00:42:06.308 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:42:06.308 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:42:06.308 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:42:06.308 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f71d66f4345] 2024-09-12T00:42:06.308 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f71d66f449f] 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c90acfcc1] 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x557c90ae4fc7] 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f71d555ad90] 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.285+0000 7f71d2e1a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f71d2e1a9c0 thread_name:radosgw-admin 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f71d5573520] 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:42:06.309 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f71d66f4345] 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f71d66f449f] 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c90acfcc1] 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x557c90ae4fc7] 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f71d555ad90] 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.310 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: starting msgr at 2024-09-12T00:42:06.311 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: starting objecter 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command objecter_requests hook 0x557c9266df40 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: setting wanted keys 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: calling monclient init 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: init 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding auth protocol: cephx 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding auth protocol: cephx 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding auth protocol: cephx 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.312 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command rotate-key hook 0x557c9284f638 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-b con 0x557c926da920 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-a con 0x557c926dce00 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-c con 0x557c926ff920 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:06.313 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): authenticate will time out at 2226.885098s 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): get_auth_request con 0x557c926dce00 auth_method 0 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): get_auth_request con 0x557c926ff920 auth_method 0 2024-09-12T00:42:06.314 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): handle_auth_done global_id 7284 payload 824 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient: _finish_hunting 0 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:42:05.753+0000 7f71d011f640 1 monclient: found mon.noname-a 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.315 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: dump: 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.316 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: _finish_auth 0 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: _check_auth_tickets 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: dump: 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.317 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 monclient: authenticate success, global_id 7284 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:42:05.753+0000 7f70bee0d640 4 set_mon_vals no callback set 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.318 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: init done 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:42:05.753+0000 7f70bd60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:42:05.753+0000 7f70bd60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:42:05.753+0000 7f70bd60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:42:05.757+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f70b8070ae0 auth_method 0 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:42:05.961+0000 7f71d1121640 10 monclient: get_auth_request con 0x557c92877870 auth_method 0 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:42:05.961+0000 7f71d0920640 10 monclient: get_auth_request con 0x557c92899760 auth_method 0 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:42:05.965+0000 7f71d011f640 10 monclient: get_auth_request con 0x557c9289e860 auth_method 0 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 10 monclient: monmap: 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:06.319 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding auth protocol: cephx 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding auth protocol: cephx 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding auth protocol: cephx 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.320 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command objecter_requests cmddesc objecter_requests hook 0x557c928a6310 EEXIST 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: init 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding auth protocol: cephx 2024-09-12T00:42:06.321 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding auth protocol: cephx 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding auth protocol: cephx 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.322 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command rotate-key cmddesc rotate-key hook 0x557c928a19e0 EEXIST 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-b con 0x557c928ca4c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-a con 0x557c928c9df0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-c con 0x557c928c87d0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.323 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): authenticate will time out at 2227.101131s 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): get_auth_request con 0x557c928c87d0 auth_method 0 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): get_auth_request con 0x557c928c9df0 auth_method 0 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.324 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.325 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): get_auth_request con 0x557c928ca4c0 auth_method 0 2024-09-12T00:42:06.325 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.325 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.325 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.325 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.325 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.325 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): handle_auth_done global_id 6965 payload 824 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient: _finish_hunting 0 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:42:05.969+0000 7f71d1121640 1 monclient: found mon.noname-c 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: dump: 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.326 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.327 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: dump: 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:42:05.969+0000 7f71d1922640 4 set_mon_vals no callback set 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 monclient: authenticate success, global_id 6965 2024-09-12T00:42:06.328 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:42:05.973+0000 7f70b67fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:42:05.973+0000 7f70b67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:42:05.973+0000 7f70b67fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:42:05.973+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f70a8070a20 auth_method 0 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: monmap: 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:06.329 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding auth protocol: cephx 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding auth protocol: cephx 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding auth protocol: cephx 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.330 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: init 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding auth protocol: cephx 2024-09-12T00:42:06.331 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding auth protocol: cephx 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding auth protocol: cephx 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.332 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.333 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.333 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.333 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.333 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.333 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe94005638 EEXIST 2024-09-12T00:42:06.333 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:06.333 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:42:06.333 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-b con 0x557c9291e2f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-c con 0x557c929196e0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-a con 0x557c9291a060 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): authenticate will time out at 2227.107132s 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): get_auth_request con 0x557c9291a060 auth_method 0 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.334 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): get_auth_request con 0x557c929196e0 auth_method 0 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.335 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.336 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): handle_auth_done global_id 7290 payload 274 2024-09-12T00:42:06.336 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient: _finish_hunting 0 2024-09-12T00:42:06.336 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:42:05.973+0000 7f71d1121640 1 monclient: found mon.noname-a 2024-09-12T00:42:06.336 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.336 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:42:05.973+0000 7f71d0920640 10 monclient: get_auth_request con 0x557c9291e2f0 auth_method 0 2024-09-12T00:42:06.336 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:42:05.973+0000 7f70a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.337 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:06.337 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: dump: 2024-09-12T00:42:06.337 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.337 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.338 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.338 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.338 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.339 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.339 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.339 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.339 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.339 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.339 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: _finish_auth 0 2024-09-12T00:42:06.340 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:42:06.340 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:06.340 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 monclient: authenticate success, global_id 7290 2024-09-12T00:42:06.341 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:06.341 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 4 set_mon_vals no callback set 2024-09-12T00:42:06.341 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.341 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:06.341 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: dump: 2024-09-12T00:42:06.341 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.342 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.342 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.342 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.342 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.342 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.343 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.343 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.343 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.343 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.343 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: shutdown 2024-09-12T00:42:06.344 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:06.344 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:06.344 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: monmap: 2024-09-12T00:42:06.344 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:06.344 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:06.344 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:06.345 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:06.345 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:06.345 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.345 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:06.345 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:06.346 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:06.346 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.346 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding auth protocol: cephx 2024-09-12T00:42:06.346 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding auth protocol: cephx 2024-09-12T00:42:06.346 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding auth protocol: cephx 2024-09-12T00:42:06.346 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.347 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.347 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.347 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.347 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.347 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.348 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.348 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.348 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.348 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.348 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.349 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.349 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.349 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: starting msgr at 2024-09-12T00:42:06.349 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: starting objecter 2024-09-12T00:42:06.349 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command objecter_requests cmddesc objecter_requests hook 0x557c92919660 EEXIST 2024-09-12T00:42:06.349 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: setting wanted keys 2024-09-12T00:42:06.350 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: calling monclient init 2024-09-12T00:42:06.350 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: init 2024-09-12T00:42:06.350 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding auth protocol: cephx 2024-09-12T00:42:06.350 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding auth protocol: cephx 2024-09-12T00:42:06.350 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding auth protocol: cephx 2024-09-12T00:42:06.351 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.351 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.351 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.351 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.351 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.351 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.352 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.352 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.352 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.352 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.352 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.353 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.353 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.353 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.353 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command rotate-key cmddesc rotate-key hook 0x557c928cc428 EEXIST 2024-09-12T00:42:06.353 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:06.353 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:42:06.354 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-b con 0x557c929196e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:06.354 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-c con 0x557c9291a060 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:06.354 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-a con 0x557c9291e2f0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:06.354 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.354 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.355 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.355 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:06.355 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): authenticate will time out at 2227.110225s 2024-09-12T00:42:06.355 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): get_auth_request con 0x557c9291e2f0 auth_method 0 2024-09-12T00:42:06.355 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.355 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.356 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.356 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): get_auth_request con 0x557c9291a060 auth_method 0 2024-09-12T00:42:06.356 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.356 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.356 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.357 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.357 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.357 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.357 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.357 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.358 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.358 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:42:05.977+0000 7f71d0920640 10 monclient(hunting): get_auth_request con 0x557c929196e0 auth_method 0 2024-09-12T00:42:06.358 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:42:05.977+0000 7f71d0920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.358 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:42:05.977+0000 7f71d0920640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.358 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:42:05.977+0000 7f71d0920640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.358 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): handle_auth_done global_id 7293 payload 824 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient: _finish_hunting 0 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:42:05.977+0000 7f71d1121640 1 monclient: found mon.noname-a 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: dump: 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.359 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:06.360 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: dump: 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:42:05.977+0000 7f70a7fff640 4 set_mon_vals no callback set 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 monclient: authenticate success, global_id 7293 2024-09-12T00:42:06.361 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: init done 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cr dump hook 0x557c9292ba68 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:42:05.981+0000 7f70a67fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:42:05.981+0000 7f70a67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:42:05.981+0000 7f70a67fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:42:05.981+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f709c070ae0 auth_method 0 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:42:05.981+0000 7f71d011f640 10 monclient: get_auth_request con 0x557c92937c50 auth_method 0 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.362 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 realm 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:42:05.985+0000 7f71d0920640 10 monclient: get_auth_request con 0x557c9293bed0 auth_method 0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 searching for the correct realm 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:42:05.985+0000 7f71d011f640 10 monclient: get_auth_request con 0x557c92941140 auth_method 0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:42:05.985+0000 7f71d1121640 10 monclient: get_auth_request con 0x7f71c4008070 auth_method 0 2024-09-12T00:42:06.363 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:42:05.989+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f71c00d0930 auth_method 0 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:42:05.989+0000 7f71d011f640 10 monclient: get_auth_request con 0x7f71c40675a0 auth_method 0 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:42:05.989+0000 7f71d011f640 0 -- 172.21.15.137:0/2562099916 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f71c40675a0 msgr2=0x7f71c40651b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:42:06.197+0000 7f71d011f640 10 monclient: get_auth_request con 0x7f71c40675a0 auth_method 0 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:42:06.201+0000 7f71d1121640 10 monclient: get_auth_request con 0x7f71c00f8410 auth_method 0 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:42:06.205+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f71c808adc0 auth_method 0 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:42:06.205+0000 7f71d011f640 0 -- 172.21.15.137:0/2562099916 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x557c92937c50 msgr2=0x557c9293a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:42:06.205+0000 7f70a67fc640 1 client.7293.objecter ms_handle_reset 0x557c92937c50 session 0x557c929375d0 osd.6 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:42:06.205+0000 7f70a67fc640 10 monclient: _renew_subs 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:42:06.205+0000 7f70a67fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:42:06.205+0000 7f71d011f640 10 monclient: get_auth_request con 0x7f709c080e90 auth_method 0 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:06.364 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 zone default found 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 Realm: () 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:06.365 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 zonegroup default 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 started sync module instance, tier type = 2024-09-12T00:42:06.366 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=0 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=1 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=2 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=3 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=4 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=5 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=6 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=7 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:06.368 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding auth protocol: cephx 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding auth protocol: cephx 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding auth protocol: cephx 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:42:06.253+0000 7f70877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.369 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cache list hook 0x557c9290e890 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cache inspect hook 0x557c9290e890 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cache erase hook 0x557c9290e890 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cache zap hook 0x557c9290e890 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 note: GC not initialized 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:42:06.253+0000 7f70867e4640 20 reqs_thread_entry: start 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command sync trace show hook 0x7f71c4094040 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command sync trace history hook 0x7f71c4094040 2024-09-12T00:42:06.370 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command sync trace active hook 0x7f71c4094040 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command sync trace active_short hook 0x7f71c4094040 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 Filter name: none 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:42:06.257+0000 7f707ffff640 20 reqs_thread_entry: start 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : miss 2024-09-12T00:42:06.371 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:06.372 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 93993523495104 notifier 7293 bl.length()=931 2024-09-12T00:42:06.373 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.373 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.373 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.373 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:06.373 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:06.373 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:06.373 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:06.373 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.0 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.0 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.1 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.1 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.0 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 93993523495104 notifier 7293 bl.length()=931 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.374 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.0 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:42:06.285+0000 7f71d2e1a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f71d2e1a9c0 time 2024-09-12T00:42:06.285683+0000 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f71d66f42eb] 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f71d66f449f] 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c90acfcc1] 2024-09-12T00:42:06.375 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x557c90ae4fc7] 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f71d555ad90] 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:42:06.285+0000 7f71d2e1a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f71d2e1a9c0 thread_name:radosgw-admin 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f71d5573520] 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:42:06.376 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f71d66f4345] 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f71d66f449f] 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c90acfcc1] 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x557c90ae4fc7] 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f71d555ad90] 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:42:06.377 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:42:06.378 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:42:06.379 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:06.380 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:42:06.381 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:42:06.382 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:06.383 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:06.384 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f707ffff640 / http_manager 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70867e4640 / http_manager 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70877e6640 / rgw_dt_lg_renew 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70a67fc640 / ms_dispatch 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70a77fe640 / io_context_pool 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70a7fff640 / io_context_pool 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70b67fc640 / ms_dispatch 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70bd60a640 / ms_dispatch 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70bee0d640 / io_context_pool 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d011f640 / msgr-worker-2 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d0920640 / msgr-worker-1 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d1121640 / msgr-worker-0 2024-09-12T00:42:06.385 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d1922640 / io_context_pool 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d2e1a9c0 / radosgw-admin 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.114863.log 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.386 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: crc 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:42:05.749+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928524b0) adding con mode: secure 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: starting msgr at 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: starting objecter 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command objecter_requests hook 0x557c9266df40 2024-09-12T00:42:06.387 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: setting wanted keys 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: calling monclient init 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: init 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding auth protocol: cephx 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding auth protocol: cephx 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding auth protocol: cephx 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.388 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: crc 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c9284f4f0) adding con mode: secure 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command rotate-key hook 0x557c9284f638 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-b con 0x557c926da920 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-a con 0x557c926dce00 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-c con 0x557c926ff920 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:06.389 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient(hunting): authenticate will time out at 2226.885098s 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): get_auth_request con 0x557c926dce00 auth_method 0 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): get_auth_request con 0x557c926ff920 auth_method 0 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:42:05.753+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient(hunting): handle_auth_done global_id 7284 payload 824 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient: _finish_hunting 0 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:42:05.753+0000 7f71d011f640 1 monclient: found mon.noname-a 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:42:05.753+0000 7f71d011f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: dump: 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.391 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: _finish_auth 0 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: _check_auth_tickets 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:06.392 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:42:05.753+0000 7f70bd60a640 10 monclient: dump: 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 5 monclient: authenticate success, global_id 7284 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:42:05.753+0000 7f70bee0d640 4 set_mon_vals no callback set 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.393 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:42:05.753+0000 7f71d2e1a9c0 1 librados: init done 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:42:05.753+0000 7f70bd60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:42:05.753+0000 7f70bd60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:42:05.753+0000 7f70bd60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:42:05.757+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f70b8070ae0 auth_method 0 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:42:05.961+0000 7f71d1121640 10 monclient: get_auth_request con 0x557c92877870 auth_method 0 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:42:05.961+0000 7f71d0920640 10 monclient: get_auth_request con 0x557c92899760 auth_method 0 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:42:05.965+0000 7f71d011f640 10 monclient: get_auth_request con 0x557c9289e860 auth_method 0 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 10 monclient: monmap: 2024-09-12T00:42:06.394 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding auth protocol: cephx 2024-09-12T00:42:06.395 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding auth protocol: cephx 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding auth protocol: cephx 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.396 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: crc 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a2900) adding con mode: secure 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:42:05.965+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command objecter_requests cmddesc objecter_requests hook 0x557c928a6310 EEXIST 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: init 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding auth protocol: cephx 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding auth protocol: cephx 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding auth protocol: cephx 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.397 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: crc 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928a1898) adding con mode: secure 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.398 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command rotate-key cmddesc rotate-key hook 0x557c928a19e0 EEXIST 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-b con 0x557c928ca4c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-a con 0x557c928c9df0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-c con 0x557c928c87d0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient(hunting): authenticate will time out at 2227.101131s 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): get_auth_request con 0x557c928c87d0 auth_method 0 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.399 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): get_auth_request con 0x557c928c9df0 auth_method 0 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): get_auth_request con 0x557c928ca4c0 auth_method 0 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.400 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:42:05.969+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:42:05.969+0000 7f71d0920640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient(hunting): handle_auth_done global_id 6965 payload 824 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient: _finish_hunting 0 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:42:05.969+0000 7f71d1121640 1 monclient: found mon.noname-c 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:42:05.969+0000 7f71d1121640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: dump: 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.401 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:42:05.969+0000 7f70b67fc640 10 monclient: dump: 2024-09-12T00:42:06.402 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:42:05.969+0000 7f71d1922640 4 set_mon_vals no callback set 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 5 monclient: authenticate success, global_id 6965 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:42:06.403 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:42:05.969+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:42:05.973+0000 7f70b67fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:42:05.973+0000 7f70b67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:42:05.973+0000 7f70b67fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:42:05.973+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f70a8070a20 auth_method 0 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: monmap: 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:06.404 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding auth protocol: cephx 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding auth protocol: cephx 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding auth protocol: cephx 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.405 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: crc 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928e9dd0) adding con mode: secure 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: init 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding auth protocol: cephx 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding auth protocol: cephx 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding auth protocol: cephx 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.406 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: crc 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940054f0) adding con mode: secure 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe94005638 EEXIST 2024-09-12T00:42:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-b con 0x557c9291e2f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-c con 0x557c929196e0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-a con 0x557c9291a060 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:42:05.973+0000 7f71d2e1a9c0 10 monclient(hunting): authenticate will time out at 2227.107132s 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): get_auth_request con 0x557c9291a060 auth_method 0 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.408 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): get_auth_request con 0x557c929196e0 auth_method 0 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:42:05.973+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient(hunting): handle_auth_done global_id 7290 payload 274 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient: _finish_hunting 0 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:42:05.973+0000 7f71d1121640 1 monclient: found mon.noname-a 2024-09-12T00:42:06.409 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:42:05.973+0000 7f71d1121640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:42:05.973+0000 7f71d0920640 10 monclient: get_auth_request con 0x557c9291e2f0 auth_method 0 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:42:05.973+0000 7f70a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: dump: 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.410 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: _finish_auth 0 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 monclient: authenticate success, global_id 7290 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 4 set_mon_vals no callback set 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:42:05.977+0000 7f70a7fff640 10 monclient: dump: 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.411 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: shutdown 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: monmap: 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding auth protocol: cephx 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding auth protocol: cephx 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding auth protocol: cephx 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.413 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: crc 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c92910970) adding con mode: secure 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: starting msgr at 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: starting objecter 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command objecter_requests cmddesc objecter_requests hook 0x557c92919660 EEXIST 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: setting wanted keys 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: calling monclient init 2024-09-12T00:42:06.414 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: init 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding auth protocol: cephx 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding auth protocol: cephx 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding auth protocol: cephx 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.415 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: crc 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 AuthRegistry(0x557c928cc2e0) adding con mode: secure 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command rotate-key cmddesc rotate-key hook 0x557c928cc428 EEXIST 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-b con 0x557c929196e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-c con 0x557c9291a060 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): picked mon.noname-a con 0x557c9291e2f0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:06.416 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient(hunting): authenticate will time out at 2227.110225s 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): get_auth_request con 0x557c9291e2f0 auth_method 0 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): get_auth_request con 0x557c9291a060 auth_method 0 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:06.417 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:42:05.977+0000 7f71d011f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:42:05.977+0000 7f71d0920640 10 monclient(hunting): get_auth_request con 0x557c929196e0 auth_method 0 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:42:05.977+0000 7f71d0920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:42:05.977+0000 7f71d0920640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:42:05.977+0000 7f71d0920640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient(hunting): handle_auth_done global_id 7293 payload 824 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient: _finish_hunting 0 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:42:05.977+0000 7f71d1121640 1 monclient: found mon.noname-a 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:42:05.977+0000 7f71d1121640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.418 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: dump: 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:06.419 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:42:05.977+0000 7f70a67fc640 10 monclient: dump: 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:06.420 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:42:05.977+0000 7f70a7fff640 4 set_mon_vals no callback set 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 monclient: authenticate success, global_id 7293 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _renew_subs 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 1 librados: init done 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:42:05.977+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cr dump hook 0x557c9292ba68 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:42:05.981+0000 7f70a67fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:42:05.981+0000 7f70a67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:42:05.981+0000 7f70a67fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:06.421 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:42:05.981+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f709c070ae0 auth_method 0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:42:05.981+0000 7f71d011f640 10 monclient: get_auth_request con 0x557c92937c50 auth_method 0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 realm 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:42:05.981+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:42:05.985+0000 7f71d0920640 10 monclient: get_auth_request con 0x557c9293bed0 auth_method 0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:06.422 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:42:05.985+0000 7f71d2e1a9c0 20 searching for the correct realm 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:42:05.985+0000 7f71d011f640 10 monclient: get_auth_request con 0x557c92941140 auth_method 0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:42:05.985+0000 7f71d1121640 10 monclient: get_auth_request con 0x7f71c4008070 auth_method 0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:42:05.989+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f71c00d0930 auth_method 0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:42:05.989+0000 7f71d011f640 10 monclient: get_auth_request con 0x7f71c40675a0 auth_method 0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:42:05.989+0000 7f71d011f640 0 -- 172.21.15.137:0/2562099916 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f71c40675a0 msgr2=0x7f71c40651b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:42:06.197+0000 7f71d011f640 10 monclient: get_auth_request con 0x7f71c40675a0 auth_method 0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:42:06.201+0000 7f71d1121640 10 monclient: get_auth_request con 0x7f71c00f8410 auth_method 0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:42:06.205+0000 7f71d0920640 10 monclient: get_auth_request con 0x7f71c808adc0 auth_method 0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:42:06.205+0000 7f71d011f640 0 -- 172.21.15.137:0/2562099916 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x557c92937c50 msgr2=0x557c9293a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:42:06.205+0000 7f70a67fc640 1 client.7293.objecter ms_handle_reset 0x557c92937c50 session 0x557c929375d0 osd.6 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:42:06.205+0000 7f70a67fc640 10 monclient: _renew_subs 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:42:06.205+0000 7f70a67fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:42:06.205+0000 7f71d011f640 10 monclient: get_auth_request con 0x7f709c080e90 auth_method 0 2024-09-12T00:42:06.423 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:42:06.217+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 zone default found 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 Realm: () 2024-09-12T00:42:06.424 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 zonegroup default 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:42:06.221+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 started sync module instance, tier type = 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:42:06.225+0000 7f71d2e1a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=0 2024-09-12T00:42:06.425 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=1 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=2 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=3 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=4 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=5 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=6 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 20 add_watcher() i=7 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:42:06.249+0000 7f71d2e1a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding auth protocol: cephx 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding auth protocol: cephx 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding auth protocol: cephx 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.426 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:42:06.253+0000 7f70877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: crc 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 AuthRegistry(0x7ffe940059d0) adding con mode: secure 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cache list hook 0x557c9290e890 2024-09-12T00:42:06.427 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cache inspect hook 0x557c9290e890 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cache erase hook 0x557c9290e890 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command cache zap hook 0x557c9290e890 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 note: GC not initialized 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:42:06.253+0000 7f70867e4640 20 reqs_thread_entry: start 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command sync trace show hook 0x7f71c4094040 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command sync trace history hook 0x7f71c4094040 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command sync trace active hook 0x7f71c4094040 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 5 asok(0x557c926422b0) register_command sync trace active_short hook 0x7f71c4094040 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:42:06.253+0000 7f71d2e1a9c0 20 Filter name: none 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:42:06.257+0000 7f707ffff640 20 reqs_thread_entry: start 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:42:06.428 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : miss 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:42:06.257+0000 7f71d2e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.429 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 93993523495104 notifier 7293 bl.length()=931 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:42:06.265+0000 7f70a7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:42:06.265+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.0 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.0 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.1 2024-09-12T00:42:06.430 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.1 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:42:06.273+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.0 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:42:06.277+0000 7f71d2e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 93993523495104 notifier 7293 bl.length()=931 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:42:06.281+0000 7f70a77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:06.431 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:42:06.281+0000 7f71d2e1a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.0 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:42:06.285+0000 7f71d2e1a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f71d2e1a9c0 time 2024-09-12T00:42:06.285683+0000 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f71d66f42eb] 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f71d66f449f] 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c90acfcc1] 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x557c90ae4fc7] 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f71d555ad90] 2024-09-12T00:42:06.432 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:42:06.285+0000 7f71d2e1a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f71d2e1a9c0 thread_name:radosgw-admin 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f71d5573520] 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:42:06.433 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f71d66f4345] 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f71d66f449f] 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c90acfcc1] 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x557c90ae4fc7] 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f71d555ad90] 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:42:06.434 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:42:06.435 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:42:06.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:06.437 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:42:06.438 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:06.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:42:06.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 7f707ffff640 / http_manager 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70867e4640 / http_manager 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70877e6640 / rgw_dt_lg_renew 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70a67fc640 / ms_dispatch 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70a77fe640 / io_context_pool 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70a7fff640 / io_context_pool 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70b67fc640 / ms_dispatch 2024-09-12T00:42:06.441 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70bd60a640 / ms_dispatch 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: 7f70bee0d640 / io_context_pool 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d011f640 / msgr-worker-2 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d0920640 / msgr-worker-1 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d1121640 / msgr-worker-0 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d1922640 / io_context_pool 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: 7f71d2e1a9c0 / radosgw-admin 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:42:06.288285Z_de3e94e3-8231-427f-a81f-b370f0cde090/log 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:42:06.442 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.373+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.373+0000 7fbb37f779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.373+0000 7fbb37f779c0 20 realm 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.373+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:06.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:06.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.377+0000 7fbb37f779c0 20 searching for the correct realm 2024-09-12T00:42:06.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.381+0000 7fbb35a7d640 0 -- 172.21.15.137:0/1640114495 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fbb280018b0 msgr2=0x7fbb28130a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:06.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.593+0000 7fbb35a7d640 0 -- 172.21.15.137:0/1640114495 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fbb30017020 msgr2=0x7fbb300908b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:06.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:06.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:06.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:06.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:06.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:06.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:06.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:06.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 zone default found 2024-09-12T00:42:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 4 Realm: () 2024-09-12T00:42:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 zonegroup default 2024-09-12T00:42:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.813+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.817+0000 7fbb37f779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.817+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.817+0000 7fbb37f779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.817+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.817+0000 7fbb37f779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:06.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.817+0000 7fbb37f779c0 20 started sync module instance, tier type = 2024-09-12T00:42:06.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.817+0000 7fbb37f779c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:06.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 20 add_watcher() i=0 2024-09-12T00:42:06.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 20 add_watcher() i=1 2024-09-12T00:42:06.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 20 add_watcher() i=2 2024-09-12T00:42:06.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 20 add_watcher() i=3 2024-09-12T00:42:06.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 20 add_watcher() i=4 2024-09-12T00:42:06.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 20 add_watcher() i=5 2024-09-12T00:42:06.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 20 add_watcher() i=6 2024-09-12T00:42:06.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 20 add_watcher() i=7 2024-09-12T00:42:06.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.841+0000 7fbb37f779c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:06.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fb9e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:06.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fbb37f779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:06.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fbb37f779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:06.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fbb37f779c0 5 note: GC not initialized 2024-09-12T00:42:06.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fb9e27fc640 20 reqs_thread_entry: start 2024-09-12T00:42:06.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fbb37f779c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:06.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fbb37f779c0 20 Filter name: none 2024-09-12T00:42:06.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fb953fff640 20 reqs_thread_entry: start 2024-09-12T00:42:06.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fbb37f779c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:06.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.849+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.853+0000 7fbb37f779c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:42:06.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.853+0000 7fbb37f779c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:06.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.853+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.853+0000 7fbb37f779c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:06.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.853+0000 7fbb37f779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:06.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.853+0000 7fbb37f779c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:42:06.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.853+0000 7fbb37f779c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:06.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.853+0000 7fb9e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:06.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.857+0000 7fbb37f779c0 20 remove_watcher() i=0 2024-09-12T00:42:06.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.857+0000 7fbb37f779c0 2 removed watcher, disabling cache 2024-09-12T00:42:06.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.861+0000 7fbb37f779c0 20 remove_watcher() i=1 2024-09-12T00:42:06.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.865+0000 7fbb37f779c0 20 remove_watcher() i=2 2024-09-12T00:42:06.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.865+0000 7fbb37f779c0 20 remove_watcher() i=3 2024-09-12T00:42:06.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.869+0000 7fbb37f779c0 20 remove_watcher() i=4 2024-09-12T00:42:06.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.869+0000 7fbb37f779c0 20 remove_watcher() i=5 2024-09-12T00:42:06.871 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.873+0000 7fbb37f779c0 20 remove_watcher() i=6 2024-09-12T00:42:06.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:06.877+0000 7fbb37f779c0 20 remove_watcher() i=7 2024-09-12T00:42:06.889 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.889 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:06.889 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-commit-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:06.889 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:06.891 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:06.891 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:36.960 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:36.961 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.007 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:42:37.043 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:37.043 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:37.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.088+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 realm 2024-09-12T00:42:37.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:37.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:37.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:37.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.092+0000 7f088b1769c0 20 searching for the correct realm 2024-09-12T00:42:37.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.100+0000 7f088947d640 0 -- 172.21.15.137:0/2397799806 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f0870026040 msgr2=0x7f087003e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:37.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.104+0000 7f0888c7c640 0 -- 172.21.15.137:0/2397799806 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f08780c3950 msgr2=0x7f08780d0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:37.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:37.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:37.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:37.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:37.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:37.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:37.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:37.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:37.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 zone default found 2024-09-12T00:42:37.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 4 Realm: () 2024-09-12T00:42:37.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:37.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:37.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:37.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 zonegroup default 2024-09-12T00:42:37.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.112+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.116+0000 7f088b1769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.116+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.116+0000 7f088b1769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.116+0000 7f088b1769c0 20 started sync module instance, tier type = 2024-09-12T00:42:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.116+0000 7f088b1769c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:37.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.132+0000 7f088b1769c0 20 add_watcher() i=0 2024-09-12T00:42:37.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.132+0000 7f088b1769c0 20 add_watcher() i=1 2024-09-12T00:42:37.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.132+0000 7f088b1769c0 20 add_watcher() i=2 2024-09-12T00:42:37.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.132+0000 7f088b1769c0 20 add_watcher() i=3 2024-09-12T00:42:37.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.132+0000 7f088b1769c0 20 add_watcher() i=4 2024-09-12T00:42:37.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.132+0000 7f088b1769c0 20 add_watcher() i=5 2024-09-12T00:42:37.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.132+0000 7f088b1769c0 20 add_watcher() i=6 2024-09-12T00:42:37.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.136+0000 7f088b1769c0 20 add_watcher() i=7 2024-09-12T00:42:37.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.136+0000 7f088b1769c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:37.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f073efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:37.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:37.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:37.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 5 note: GC not initialized 2024-09-12T00:42:37.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f073dfe3640 20 reqs_thread_entry: start 2024-09-12T00:42:37.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:37.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 20 Filter name: none 2024-09-12T00:42:37.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f06af7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:37.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:42:37.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:37.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:42:37.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:42:37.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : miss 2024-09-12T00:42:37.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.140+0000 7f088b1769c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.144+0000 7f088b1769c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:37.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.144+0000 7f088b1769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:37.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.144+0000 7f088b1769c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:37.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.144+0000 7f088b1769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:37.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.144+0000 7f088b1769c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:37.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.144+0000 7f088b1769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:37.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.148+0000 7f088b1769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:37.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.148+0000 7f088b1769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:37.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.148+0000 7f088b1769c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:37.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.148+0000 7f088b1769c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:37.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.148+0000 7f075ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366246 cookie 94346875820912 notifier 7329 bl.length()=931 2024-09-12T00:42:37.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.148+0000 7f075ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:37.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.148+0000 7f075ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:37.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.148+0000 7f075ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:37.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.152+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:37.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.152+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:37.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.152+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:37.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.152+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:37.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.156+0000 7f088b1769c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.0 2024-09-12T00:42:37.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.156+0000 7f088b1769c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.0 2024-09-12T00:42:37.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.156+0000 7f088b1769c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.1 2024-09-12T00:42:37.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.156+0000 7f088b1769c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.1.1 2024-09-12T00:42:37.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.156+0000 7f088b1769c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.0 2024-09-12T00:42:37.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:37.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:37.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:37.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:37.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:37.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:37.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f075ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366247 cookie 94346875820912 notifier 7329 bl.length()=931 2024-09-12T00:42:37.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f075ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:37.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f075ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:37.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f075ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:37.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:37.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:37.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:37.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.160+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:37.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.164+0000 7f088b1769c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32.0 2024-09-12T00:42:37.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.164+0000 7f088b1769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:37.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.164+0000 7f088b1769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 2024-09-12T00:42:37.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:37.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:37.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:37.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32, ofs0, ns] 2024-09-12T00:42:37.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f075ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366248 cookie 94346875820912 notifier 7329 bl.length()=899 2024-09-12T00:42:37.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f075ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 info.flags=0x17 2024-09-12T00:42:37.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f075ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 to cache LRU end 2024-09-12T00:42:37.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f075ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:37.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_sources= new_sources= 2024-09-12T00:42:37.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential sources added=[] removed=[] 2024-09-12T00:42:37.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): orig_dests= new_dests= 2024-09-12T00:42:37.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32]): potential dests added=[] removed=[] 2024-09-12T00:42:37.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.168+0000 7f088b1769c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:42:37.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.172+0000 7f073efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:37.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.176+0000 7f088b1769c0 20 remove_watcher() i=0 2024-09-12T00:42:37.176 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.176+0000 7f088b1769c0 2 removed watcher, disabling cache 2024-09-12T00:42:37.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.180+0000 7f088b1769c0 20 remove_watcher() i=1 2024-09-12T00:42:37.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.180+0000 7f088b1769c0 20 remove_watcher() i=2 2024-09-12T00:42:37.182 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.184+0000 7f088b1769c0 20 remove_watcher() i=3 2024-09-12T00:42:37.184 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.184+0000 7f088b1769c0 20 remove_watcher() i=4 2024-09-12T00:42:37.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.188+0000 7f088b1769c0 20 remove_watcher() i=5 2024-09-12T00:42:37.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.188+0000 7f088b1769c0 20 remove_watcher() i=6 2024-09-12T00:42:37.191 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.192+0000 7f088b1769c0 20 remove_watcher() i=7 2024-09-12T00:42:37.206 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:42:37.234 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:37.234 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:37.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.280+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.280+0000 7f6ab8bc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.280+0000 7f6ab8bc99c0 20 realm 2024-09-12T00:42:37.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.280+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:37.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:37.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:37.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.284+0000 7f6ab8bc99c0 20 searching for the correct realm 2024-09-12T00:42:37.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.292+0000 7f6ab6ed0640 0 -- 172.21.15.137:0/1942328199 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f6aac023020 msgr2=0x7f6aac05ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:37.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.296+0000 7f6ab66cf640 0 -- 172.21.15.137:0/1942328199 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f6ab00fe350 msgr2=0x7f6ab00f8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:37.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:37.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:37.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:37.303 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:37.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:37.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:37.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:37.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:37.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 zone default found 2024-09-12T00:42:37.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 4 Realm: () 2024-09-12T00:42:37.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:37.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:37.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:37.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 zonegroup default 2024-09-12T00:42:37.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.304+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.308+0000 7f6ab8bc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.308+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.308+0000 7f6ab8bc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.308+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.308+0000 7f6ab8bc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:37.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.308+0000 7f6ab8bc99c0 20 started sync module instance, tier type = 2024-09-12T00:42:37.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.308+0000 7f6ab8bc99c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:37.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.324+0000 7f6ab8bc99c0 20 add_watcher() i=0 2024-09-12T00:42:37.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.324+0000 7f6ab8bc99c0 20 add_watcher() i=1 2024-09-12T00:42:37.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.324+0000 7f6ab8bc99c0 20 add_watcher() i=2 2024-09-12T00:42:37.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.324+0000 7f6ab8bc99c0 20 add_watcher() i=3 2024-09-12T00:42:37.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.324+0000 7f6ab8bc99c0 20 add_watcher() i=4 2024-09-12T00:42:37.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.324+0000 7f6ab8bc99c0 20 add_watcher() i=5 2024-09-12T00:42:37.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.324+0000 7f6ab8bc99c0 20 add_watcher() i=6 2024-09-12T00:42:37.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.328+0000 7f6ab8bc99c0 20 add_watcher() i=7 2024-09-12T00:42:37.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.328+0000 7f6ab8bc99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:37.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f696cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:37.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f6ab8bc99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:37.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f6ab8bc99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:37.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f6ab8bc99c0 5 note: GC not initialized 2024-09-12T00:42:37.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f68e77fe640 20 reqs_thread_entry: start 2024-09-12T00:42:37.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f6ab8bc99c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:37.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f6ab8bc99c0 20 Filter name: none 2024-09-12T00:42:37.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f68e57fa640 20 reqs_thread_entry: start 2024-09-12T00:42:37.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.332+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:37.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:37.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:37.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:42:37.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:37.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:42:37.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.336+0000 7f6ab8bc99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:37.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.340+0000 7f696cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:37.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.344+0000 7f6ab8bc99c0 20 remove_watcher() i=0 2024-09-12T00:42:37.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.344+0000 7f6ab8bc99c0 2 removed watcher, disabling cache 2024-09-12T00:42:37.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.344+0000 7f6ab8bc99c0 20 remove_watcher() i=1 2024-09-12T00:42:37.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.348+0000 7f6ab8bc99c0 20 remove_watcher() i=2 2024-09-12T00:42:37.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.348+0000 7f6ab8bc99c0 20 remove_watcher() i=3 2024-09-12T00:42:37.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.348+0000 7f6ab8bc99c0 20 remove_watcher() i=4 2024-09-12T00:42:37.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.352+0000 7f6ab8bc99c0 20 remove_watcher() i=5 2024-09-12T00:42:37.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.356+0000 7f6ab8bc99c0 20 remove_watcher() i=6 2024-09-12T00:42:37.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:37.356+0000 7f6ab8bc99c0 20 remove_watcher() i=7 2024-09-12T00:42:37.371 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:37.371 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:37.371 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-commit-target-layout id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:42:37.371 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:37.372 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.372 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.376 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.376 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.435 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.435 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.461 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:42:37.461 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:37.462 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.463 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.481 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.481 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.529 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.529 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.550 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.550 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.571 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.571 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.592 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.593 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.613 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.613 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.633 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.634 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.655 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.655 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.676 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.676 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.755 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.755 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.775 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.775 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.795 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.795 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.814 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.814 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.834 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.834 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.854 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.854 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.873 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.873 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.894 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.894 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.913 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.913 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.934 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.934 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.954 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.955 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.974 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:37.974 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:37.991 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:42:38.023 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:38.023 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:38.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 20 realm 2024-09-12T00:42:38.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:38.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.072+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.076+0000 7f15f73319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:38.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.076+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.076+0000 7f15f73319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:38.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.076+0000 7f15f73319c0 20 searching for the correct realm 2024-09-12T00:42:38.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.080+0000 7f15f4e37640 0 -- 172.21.15.137:0/1051487698 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f15e402b070 msgr2=0x7f15e40383d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:38.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.292+0000 7f15f4e37640 0 -- 172.21.15.137:0/1051487698 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x5623f009fa10 msgr2=0x7f15ec128370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:38.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:38.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:38.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:38.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:38.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:38.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:38.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:38.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:38.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 zone default found 2024-09-12T00:42:38.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 4 Realm: () 2024-09-12T00:42:38.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:38.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:38.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:38.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 zonegroup default 2024-09-12T00:42:38.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.512+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.516+0000 7f15f73319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.516+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.516+0000 7f15f73319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.516+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.516+0000 7f15f73319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.516+0000 7f15f73319c0 20 started sync module instance, tier type = 2024-09-12T00:42:38.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.516+0000 7f15f73319c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:38.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.540+0000 7f15f73319c0 20 add_watcher() i=0 2024-09-12T00:42:38.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.540+0000 7f15f73319c0 20 add_watcher() i=1 2024-09-12T00:42:38.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.540+0000 7f15f73319c0 20 add_watcher() i=2 2024-09-12T00:42:38.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.540+0000 7f15f73319c0 20 add_watcher() i=3 2024-09-12T00:42:38.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.540+0000 7f15f73319c0 20 add_watcher() i=4 2024-09-12T00:42:38.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.540+0000 7f15f73319c0 20 add_watcher() i=5 2024-09-12T00:42:38.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.540+0000 7f15f73319c0 20 add_watcher() i=6 2024-09-12T00:42:38.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.544+0000 7f15f73319c0 20 add_watcher() i=7 2024-09-12T00:42:38.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.544+0000 7f15f73319c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:38.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.548+0000 7f14aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:38.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.548+0000 7f15f73319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:38.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.548+0000 7f15f73319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:38.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.548+0000 7f15f73319c0 5 note: GC not initialized 2024-09-12T00:42:38.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.548+0000 7f14a9fe3640 20 reqs_thread_entry: start 2024-09-12T00:42:38.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.548+0000 7f15f73319c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:38.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 Filter name: none 2024-09-12T00:42:38.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f141b7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:38.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:38.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:38.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:38.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:38.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.552+0000 7f15f73319c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.556+0000 7f15f73319c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:38.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.556+0000 7f15f73319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:38.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.556+0000 7f14aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:38.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.560+0000 7f15f73319c0 20 remove_watcher() i=0 2024-09-12T00:42:38.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.560+0000 7f15f73319c0 2 removed watcher, disabling cache 2024-09-12T00:42:38.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.564+0000 7f15f73319c0 20 remove_watcher() i=1 2024-09-12T00:42:38.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.564+0000 7f15f73319c0 20 remove_watcher() i=2 2024-09-12T00:42:38.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.568+0000 7f15f73319c0 20 remove_watcher() i=3 2024-09-12T00:42:38.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.572+0000 7f15f73319c0 20 remove_watcher() i=4 2024-09-12T00:42:38.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.572+0000 7f15f73319c0 20 remove_watcher() i=5 2024-09-12T00:42:38.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.576+0000 7f15f73319c0 20 remove_watcher() i=6 2024-09-12T00:42:38.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.580+0000 7f15f73319c0 20 remove_watcher() i=7 2024-09-12T00:42:38.594 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:38.594 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:38.594 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-do-reshard id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:38.595 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:38.595 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:42:38.631 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:38.631 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:38.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.676+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.676+0000 7fdd7f3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.676+0000 7fdd7f3429c0 20 realm 2024-09-12T00:42:38.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.676+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:38.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:38.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:38.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.680+0000 7fdd7f3429c0 20 searching for the correct realm 2024-09-12T00:42:38.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.688+0000 7fdd7ce48640 0 -- 172.21.15.137:0/3797359938 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55b58db3b6f0 msgr2=0x55b58db3db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:38.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.692+0000 7fdd7d649640 0 -- 172.21.15.137:0/3797359938 >> [v2:172.21.15.150:6800/1704738992,v1:172.21.15.150:6801/1704738992] conn(0x7fdd6c01f040 msgr2=0x7fdd6c013410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:38.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:38.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:38.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:38.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:38.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:38.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:38.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:38.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:38.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 zone default found 2024-09-12T00:42:38.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 4 Realm: () 2024-09-12T00:42:38.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:38.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:38.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:38.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 zonegroup default 2024-09-12T00:42:38.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.700+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.704+0000 7fdd7f3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.704+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.704+0000 7fdd7f3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.704+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.704+0000 7fdd7f3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:38.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.704+0000 7fdd7f3429c0 20 started sync module instance, tier type = 2024-09-12T00:42:38.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.704+0000 7fdd7f3429c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:38.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.720+0000 7fdd7f3429c0 20 add_watcher() i=0 2024-09-12T00:42:38.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.720+0000 7fdd7f3429c0 20 add_watcher() i=1 2024-09-12T00:42:38.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.720+0000 7fdd7f3429c0 20 add_watcher() i=2 2024-09-12T00:42:38.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.720+0000 7fdd7f3429c0 20 add_watcher() i=3 2024-09-12T00:42:38.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.720+0000 7fdd7f3429c0 20 add_watcher() i=4 2024-09-12T00:42:38.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.720+0000 7fdd7f3429c0 20 add_watcher() i=5 2024-09-12T00:42:38.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.720+0000 7fdd7f3429c0 20 add_watcher() i=6 2024-09-12T00:42:38.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.724+0000 7fdd7f3429c0 20 add_watcher() i=7 2024-09-12T00:42:38.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.724+0000 7fdd7f3429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:38.726 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdc337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:38.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:38.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:38.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 5 note: GC not initialized 2024-09-12T00:42:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdc327e4640 20 reqs_thread_entry: start 2024-09-12T00:42:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 20 Filter name: none 2024-09-12T00:42:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdc2bfff640 20 reqs_thread_entry: start 2024-09-12T00:42:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:42:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:38.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:42:38.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:42:38.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 : miss 2024-09-12T00:42:38.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.728+0000 7fdd7f3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:38.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.732+0000 7fdd7f3429c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:38.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.732+0000 7fdd7f3429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:38.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.732+0000 7fdd7f3429c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:38.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.732+0000 7fdd7f3429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:38.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.732+0000 7fdd7f3429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:38.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.732+0000 7fdd7f3429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 2024-09-12T00:42:38.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.740+0000 7fdd7f3429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:38.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.740+0000 7fdd7f3429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:38.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.740+0000 7fdd7f3429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:38.739 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.740+0000 7fdd7f3429c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33, ofs0, ns] 2024-09-12T00:42:38.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.740+0000 7fdc53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366269 cookie 94238254847392 notifier 7383 bl.length()=911 2024-09-12T00:42:38.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.740+0000 7fdc53fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:38.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.740+0000 7fdc53fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:38.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.740+0000 7fdc53fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:38.741 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.744+0000 7fdd7f3429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_sources= new_sources= 2024-09-12T00:42:38.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.744+0000 7fdd7f3429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential sources added=[] removed=[] 2024-09-12T00:42:38.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.744+0000 7fdd7f3429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_dests= new_dests= 2024-09-12T00:42:38.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.744+0000 7fdd7f3429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential dests added=[] removed=[] 2024-09-12T00:42:38.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.748+0000 7fdd7f3429c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:42:38.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.752+0000 7fdd7f3429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:38.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.752+0000 7fdd7f3429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 2024-09-12T00:42:38.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:38.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:38.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:38.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33, ofs0, ns] 2024-09-12T00:42:38.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdc537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366270 cookie 94238254847392 notifier 7383 bl.length()=879 2024-09-12T00:42:38.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdc537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:38.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdc537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:38.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdc537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:38.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_sources= new_sources= 2024-09-12T00:42:38.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential sources added=[] removed=[] 2024-09-12T00:42:38.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_dests= new_dests= 2024-09-12T00:42:38.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential dests added=[] removed=[] 2024-09-12T00:42:38.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.756+0000 7fdd7f3429c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:42:38.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.760+0000 7fdc337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:38.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.764+0000 7fdd7f3429c0 20 remove_watcher() i=0 2024-09-12T00:42:38.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.764+0000 7fdd7f3429c0 2 removed watcher, disabling cache 2024-09-12T00:42:38.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.768+0000 7fdd7f3429c0 20 remove_watcher() i=1 2024-09-12T00:42:38.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.768+0000 7fdd7f3429c0 20 remove_watcher() i=2 2024-09-12T00:42:38.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.772+0000 7fdd7f3429c0 20 remove_watcher() i=3 2024-09-12T00:42:38.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.772+0000 7fdd7f3429c0 20 remove_watcher() i=4 2024-09-12T00:42:38.775 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.776+0000 7fdd7f3429c0 20 remove_watcher() i=5 2024-09-12T00:42:38.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.780+0000 7fdd7f3429c0 20 remove_watcher() i=6 2024-09-12T00:42:38.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:38.780+0000 7fdd7f3429c0 20 remove_watcher() i=7 2024-09-12T00:42:38.796 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:42:38.823 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:38.823 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:39.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.076+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 realm 2024-09-12T00:42:39.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:39.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:39.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:39.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.080+0000 7f6ab55169c0 20 searching for the correct realm 2024-09-12T00:42:39.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.088+0000 7f6ab281b640 0 -- 172.21.15.137:0/850890883 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f6a9c00e040 msgr2=0x7f6a9c00d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:39.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.304+0000 7f6ab281b640 0 -- 172.21.15.137:0/850890883 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x562d4856a560 msgr2=0x562d4856c9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:39.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:39.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:39.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 zone default found 2024-09-12T00:42:39.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 4 Realm: () 2024-09-12T00:42:39.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:39.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:39.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:39.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 zonegroup default 2024-09-12T00:42:39.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.316+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.320+0000 7f6ab55169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.320+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.320+0000 7f6ab55169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.320+0000 7f6ab55169c0 20 started sync module instance, tier type = 2024-09-12T00:42:39.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.320+0000 7f6ab55169c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:39.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.344+0000 7f6ab55169c0 20 add_watcher() i=0 2024-09-12T00:42:39.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.344+0000 7f6ab55169c0 20 add_watcher() i=1 2024-09-12T00:42:39.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.344+0000 7f6ab55169c0 20 add_watcher() i=2 2024-09-12T00:42:39.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.344+0000 7f6ab55169c0 20 add_watcher() i=3 2024-09-12T00:42:39.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.344+0000 7f6ab55169c0 20 add_watcher() i=4 2024-09-12T00:42:39.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.344+0000 7f6ab55169c0 20 add_watcher() i=5 2024-09-12T00:42:39.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.344+0000 7f6ab55169c0 20 add_watcher() i=6 2024-09-12T00:42:39.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.348+0000 7f6ab55169c0 20 add_watcher() i=7 2024-09-12T00:42:39.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.348+0000 7f6ab55169c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:39.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.352+0000 7f6969fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:39.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.352+0000 7f6ab55169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:39.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.352+0000 7f6ab55169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:39.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.352+0000 7f6ab55169c0 5 note: GC not initialized 2024-09-12T00:42:39.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6968fe1640 20 reqs_thread_entry: start 2024-09-12T00:42:39.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6ab55169c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:39.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6ab55169c0 20 Filter name: none 2024-09-12T00:42:39.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f68e27fc640 20 reqs_thread_entry: start 2024-09-12T00:42:39.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6ab55169c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:39.355 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6ab55169c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:39.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6ab55169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:39.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.356+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.360+0000 7f6ab55169c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:39.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.360+0000 7f6ab55169c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.360+0000 7f6ab55169c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:39.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.360+0000 7f6ab55169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:39.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.360+0000 7f6969fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:39.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.364+0000 7f6ab55169c0 20 remove_watcher() i=0 2024-09-12T00:42:39.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.364+0000 7f6ab55169c0 2 removed watcher, disabling cache 2024-09-12T00:42:39.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.368+0000 7f6ab55169c0 20 remove_watcher() i=1 2024-09-12T00:42:39.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.368+0000 7f6ab55169c0 20 remove_watcher() i=2 2024-09-12T00:42:39.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.372+0000 7f6ab55169c0 20 remove_watcher() i=3 2024-09-12T00:42:39.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.372+0000 7f6ab55169c0 20 remove_watcher() i=4 2024-09-12T00:42:39.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.376+0000 7f6ab55169c0 20 remove_watcher() i=5 2024-09-12T00:42:39.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.380+0000 7f6ab55169c0 20 remove_watcher() i=6 2024-09-12T00:42:39.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.380+0000 7f6ab55169c0 20 remove_watcher() i=7 2024-09-12T00:42:39.395 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:39.395 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:39.395 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-do-reshard id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:39.395 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:39.396 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:39.396 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:39.410 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:39.410 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:39.455 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:42:39.491 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:39.492 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:39.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.536+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 realm 2024-09-12T00:42:39.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:39.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:39.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:39.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.540+0000 7efd0b44a9c0 20 searching for the correct realm 2024-09-12T00:42:39.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.548+0000 7efd08f50640 0 -- 172.21.15.137:0/2607028488 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7efcfc008040 msgr2=0x7efcfc062f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:39.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.552+0000 7efd08f50640 0 -- 172.21.15.137:0/2607028488 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7efd0402c040 msgr2=0x7efd04021430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:39.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 zone default found 2024-09-12T00:42:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 4 Realm: () 2024-09-12T00:42:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 zonegroup default 2024-09-12T00:42:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.560+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.564+0000 7efd0b44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.564+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.564+0000 7efd0b44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.564+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.564+0000 7efd0b44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.564+0000 7efd0b44a9c0 20 started sync module instance, tier type = 2024-09-12T00:42:39.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.564+0000 7efd0b44a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:39.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.580+0000 7efd0b44a9c0 20 add_watcher() i=0 2024-09-12T00:42:39.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.580+0000 7efd0b44a9c0 20 add_watcher() i=1 2024-09-12T00:42:39.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.580+0000 7efd0b44a9c0 20 add_watcher() i=2 2024-09-12T00:42:39.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.580+0000 7efd0b44a9c0 20 add_watcher() i=3 2024-09-12T00:42:39.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.580+0000 7efd0b44a9c0 20 add_watcher() i=4 2024-09-12T00:42:39.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.580+0000 7efd0b44a9c0 20 add_watcher() i=5 2024-09-12T00:42:39.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.584+0000 7efd0b44a9c0 20 add_watcher() i=6 2024-09-12T00:42:39.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.584+0000 7efd0b44a9c0 20 add_watcher() i=7 2024-09-12T00:42:39.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.584+0000 7efd0b44a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:39.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efbbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 5 note: GC not initialized 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efbbdfe3640 20 reqs_thread_entry: start 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 20 Filter name: none 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efb2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:42:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:39.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:42:39.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:42:39.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 : miss 2024-09-12T00:42:39.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.588+0000 7efd0b44a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.592+0000 7efd0b44a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:39.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.592+0000 7efd0b44a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:39.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.592+0000 7efd0b44a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:39.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.592+0000 7efd0b44a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:39.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.592+0000 7efd0b44a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:39.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.592+0000 7efd0b44a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 2024-09-12T00:42:39.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efd0b44a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:39.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efd0b44a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:39.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efd0b44a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:39.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efd0b44a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33, ofs0, ns] 2024-09-12T00:42:39.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efbdf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366271 cookie 94426435836064 notifier 7085 bl.length()=911 2024-09-12T00:42:39.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efbdf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:39.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efbdf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:39.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efbdf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:39.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_sources= new_sources= 2024-09-12T00:42:39.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential sources added=[] removed=[] 2024-09-12T00:42:39.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_dests= new_dests= 2024-09-12T00:42:39.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.600+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential dests added=[] removed=[] 2024-09-12T00:42:39.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.604+0000 7efd0b44a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33.1.0 2024-09-12T00:42:39.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.604+0000 7efd0b44a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33.1.0 2024-09-12T00:42:39.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.604+0000 7efd0b44a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33.1.1 2024-09-12T00:42:39.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.604+0000 7efd0b44a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33.1.1 2024-09-12T00:42:39.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.604+0000 7efd0b44a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33.0 2024-09-12T00:42:39.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.612+0000 7efd0b44a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:39.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.612+0000 7efd0b44a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 2024-09-12T00:42:39.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.612+0000 7efd0b44a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:39.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.612+0000 7efd0b44a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:39.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.612+0000 7efd0b44a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:39.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.612+0000 7efd0b44a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33, ofs0, ns] 2024-09-12T00:42:39.613 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efbdf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366272 cookie 94426435836064 notifier 7085 bl.length()=911 2024-09-12T00:42:39.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efbdf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:39.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efbdf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:39.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efbdf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:39.614 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_sources= new_sources= 2024-09-12T00:42:39.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential sources added=[] removed=[] 2024-09-12T00:42:39.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_dests= new_dests= 2024-09-12T00:42:39.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential dests added=[] removed=[] 2024-09-12T00:42:39.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efd0b44a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33.0 2024-09-12T00:42:39.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efd0b44a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:42:39.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.616+0000 7efd0b44a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 2024-09-12T00:42:39.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.620+0000 7efd0b44a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:39.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.620+0000 7efd0b44a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:39.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.620+0000 7efd0b44a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:39.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.620+0000 7efd0b44a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33, ofs0, ns] 2024-09-12T00:42:39.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efbdffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366273 cookie 94426435836064 notifier 7085 bl.length()=879 2024-09-12T00:42:39.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efbdffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 info.flags=0x17 2024-09-12T00:42:39.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efbdffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 to cache LRU end 2024-09-12T00:42:39.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efbdffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:39.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_sources= new_sources= 2024-09-12T00:42:39.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential sources added=[] removed=[] 2024-09-12T00:42:39.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): orig_dests= new_dests= 2024-09-12T00:42:39.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efd0b44a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33]): potential dests added=[] removed=[] 2024-09-12T00:42:39.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.624+0000 7efd0b44a9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:42:39.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.628+0000 7efbbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:39.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.632+0000 7efd0b44a9c0 20 remove_watcher() i=0 2024-09-12T00:42:39.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.632+0000 7efd0b44a9c0 2 removed watcher, disabling cache 2024-09-12T00:42:39.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.636+0000 7efd0b44a9c0 20 remove_watcher() i=1 2024-09-12T00:42:39.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.640+0000 7efd0b44a9c0 20 remove_watcher() i=2 2024-09-12T00:42:39.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.640+0000 7efd0b44a9c0 20 remove_watcher() i=3 2024-09-12T00:42:39.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.644+0000 7efd0b44a9c0 20 remove_watcher() i=4 2024-09-12T00:42:39.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.644+0000 7efd0b44a9c0 20 remove_watcher() i=5 2024-09-12T00:42:39.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.648+0000 7efd0b44a9c0 20 remove_watcher() i=6 2024-09-12T00:42:39.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.652+0000 7efd0b44a9c0 20 remove_watcher() i=7 2024-09-12T00:42:39.667 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:42:39.693 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:39.693 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:39.736 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.736+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 realm 2024-09-12T00:42:39.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:39.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.744+0000 7f36045139c0 20 searching for the correct realm 2024-09-12T00:42:39.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.752+0000 7f360281a640 0 -- 172.21.15.137:0/3621690400 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f35f8043070 msgr2=0x7f35f804d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:39.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.756+0000 7f3602019640 0 -- 172.21.15.137:0/3621690400 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f35fc017070 msgr2=0x7f35fc05c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:39.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:39.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:39.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:39.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:39.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:39.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:39.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.764+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 zone default found 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 4 Realm: () 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 zonegroup default 2024-09-12T00:42:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:39.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 started sync module instance, tier type = 2024-09-12T00:42:39.767 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.768+0000 7f36045139c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:39.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 20 add_watcher() i=0 2024-09-12T00:42:39.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 20 add_watcher() i=1 2024-09-12T00:42:39.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 20 add_watcher() i=2 2024-09-12T00:42:39.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 20 add_watcher() i=3 2024-09-12T00:42:39.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 20 add_watcher() i=4 2024-09-12T00:42:39.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 20 add_watcher() i=5 2024-09-12T00:42:39.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 20 add_watcher() i=6 2024-09-12T00:42:39.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 20 add_watcher() i=7 2024-09-12T00:42:39.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.788+0000 7f36045139c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:39.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f34b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:39.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f36045139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:39.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f36045139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f36045139c0 5 note: GC not initialized 2024-09-12T00:42:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f34337fe640 20 reqs_thread_entry: start 2024-09-12T00:42:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f36045139c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f36045139c0 20 Filter name: none 2024-09-12T00:42:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f34317fa640 20 reqs_thread_entry: start 2024-09-12T00:42:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.792+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:39.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:39.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:39.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:39.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:39.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:39.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.796+0000 7f36045139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:39.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.800+0000 7f34b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:39.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.804+0000 7f36045139c0 20 remove_watcher() i=0 2024-09-12T00:42:39.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.804+0000 7f36045139c0 2 removed watcher, disabling cache 2024-09-12T00:42:39.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.804+0000 7f36045139c0 20 remove_watcher() i=1 2024-09-12T00:42:39.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.808+0000 7f36045139c0 20 remove_watcher() i=2 2024-09-12T00:42:39.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.808+0000 7f36045139c0 20 remove_watcher() i=3 2024-09-12T00:42:39.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.812+0000 7f36045139c0 20 remove_watcher() i=4 2024-09-12T00:42:39.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.812+0000 7f36045139c0 20 remove_watcher() i=5 2024-09-12T00:42:39.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.816+0000 7f36045139c0 20 remove_watcher() i=6 2024-09-12T00:42:39.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:39.816+0000 7f36045139c0 20 remove_watcher() i=7 2024-09-12T00:42:39.831 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:39.831 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:39.831 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-do-reshard id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:42:39.831 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:39.832 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:39.832 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:39.836 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:39.836 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:39.890 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:39.890 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:39.916 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:42:39.916 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:39.919 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:39.919 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:39.945 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:39.945 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:39.993 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:39.993 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.017 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.017 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.038 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.038 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.057 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.058 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.077 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.078 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.098 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.098 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.118 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.118 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.138 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.138 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.159 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.160 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.180 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.180 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.199 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.200 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.220 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.220 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.240 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.240 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.261 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.261 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.281 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.282 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.302 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.302 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.325 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.325 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.345 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.346 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.366 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.366 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.386 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:40.386 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:40.405 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:42:40.438 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:40.438 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:40.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.484+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.484+0000 7f99bf0b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.484+0000 7f99bf0b09c0 20 realm 2024-09-12T00:42:40.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.484+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.484+0000 7f99bf0b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.484+0000 7f99bf0b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:40.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.484+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.488+0000 7f99bf0b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.488+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.488+0000 7f99bf0b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:40.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.488+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.488+0000 7f99bf0b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:40.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.488+0000 7f99bf0b09c0 20 searching for the correct realm 2024-09-12T00:42:40.492 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.492+0000 7f99bc3b5640 0 -- 172.21.15.137:0/442878061 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f99b00cf040 msgr2=0x7f99b0007cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:40.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.500+0000 7f99bd3b7640 0 -- 172.21.15.137:0/442878061 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5619e4a4dcd0 msgr2=0x5619e4a50160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:40.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:40.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:40.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:40.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:40.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:40.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:40.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:40.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 zone default found 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 4 Realm: () 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 zonegroup default 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.508+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.512+0000 7f99bf0b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.512+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.512+0000 7f99bf0b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.512+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.512+0000 7f99bf0b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.512+0000 7f99bf0b09c0 20 started sync module instance, tier type = 2024-09-12T00:42:40.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.512+0000 7f99bf0b09c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:40.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 20 add_watcher() i=0 2024-09-12T00:42:40.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 20 add_watcher() i=1 2024-09-12T00:42:40.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 20 add_watcher() i=2 2024-09-12T00:42:40.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 20 add_watcher() i=3 2024-09-12T00:42:40.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 20 add_watcher() i=4 2024-09-12T00:42:40.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 20 add_watcher() i=5 2024-09-12T00:42:40.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 20 add_watcher() i=6 2024-09-12T00:42:40.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 20 add_watcher() i=7 2024-09-12T00:42:40.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.532+0000 7f99bf0b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:40.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f9872fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f99bf0b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f99bf0b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f99bf0b09c0 5 note: GC not initialized 2024-09-12T00:42:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f9871fe3640 20 reqs_thread_entry: start 2024-09-12T00:42:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f99bf0b09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f99bf0b09c0 20 Filter name: none 2024-09-12T00:42:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f97e37fe640 20 reqs_thread_entry: start 2024-09-12T00:42:40.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.536+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:40.538 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:40.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:40.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:40.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:40.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.540+0000 7f99bf0b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:40.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.544+0000 7f9872fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:40.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.548+0000 7f99bf0b09c0 20 remove_watcher() i=0 2024-09-12T00:42:40.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.548+0000 7f99bf0b09c0 2 removed watcher, disabling cache 2024-09-12T00:42:40.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.548+0000 7f99bf0b09c0 20 remove_watcher() i=1 2024-09-12T00:42:40.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.548+0000 7f99bf0b09c0 20 remove_watcher() i=2 2024-09-12T00:42:40.551 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.552+0000 7f99bf0b09c0 20 remove_watcher() i=3 2024-09-12T00:42:40.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.556+0000 7f99bf0b09c0 20 remove_watcher() i=4 2024-09-12T00:42:40.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.556+0000 7f99bf0b09c0 20 remove_watcher() i=5 2024-09-12T00:42:40.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.560+0000 7f99bf0b09c0 20 remove_watcher() i=6 2024-09-12T00:42:40.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.564+0000 7f99bf0b09c0 20 remove_watcher() i=7 2024-09-12T00:42:40.576 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.576 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:40.576 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-do-reshard id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:40.576 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.576 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:42:40.609 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:40.609 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:40.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 realm 2024-09-12T00:42:40.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:40.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:40.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.660+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:40.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.660+0000 7f1aa4ddf9c0 20 searching for the correct realm 2024-09-12T00:42:40.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.664+0000 7f1aa28e5640 0 -- 172.21.15.137:0/3831066792 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f1a94116c20 msgr2=0x7f1a940fbcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:40.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.668+0000 7f1aa28e5640 0 -- 172.21.15.137:0/3831066792 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1a8c003cc0 msgr2=0x7f1a9c05dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:40.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:40.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:40.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:40.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:40.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:40.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:40.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:40.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 zone default found 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 Realm: () 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 zonegroup default 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:40.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 started sync module instance, tier type = 2024-09-12T00:42:40.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:40.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=0 2024-09-12T00:42:40.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=1 2024-09-12T00:42:40.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=2 2024-09-12T00:42:40.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=3 2024-09-12T00:42:40.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=4 2024-09-12T00:42:40.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=5 2024-09-12T00:42:40.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=6 2024-09-12T00:42:40.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.920+0000 7f1aa4ddf9c0 20 add_watcher() i=7 2024-09-12T00:42:40.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.920+0000 7f1aa4ddf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:40.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f19597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:40.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:40.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:40.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 note: GC not initialized 2024-09-12T00:42:40.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f18d3fff640 20 reqs_thread_entry: start 2024-09-12T00:42:40.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:40.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 Filter name: none 2024-09-12T00:42:40.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f18d1ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:40.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:42:40.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:40.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 : miss 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:40.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 2024-09-12T00:42:40.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:40.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:40.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:40.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34, ofs0, ns] 2024-09-12T00:42:40.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 94554944257936 notifier 7476 bl.length()=911 2024-09-12T00:42:40.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:40.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:40.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:40.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_sources= new_sources= 2024-09-12T00:42:40.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential sources added=[] removed=[] 2024-09-12T00:42:40.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_dests= new_dests= 2024-09-12T00:42:40.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential dests added=[] removed=[] 2024-09-12T00:42:40.944 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1aa4ddf9c0 time 2024-09-12T00:42:40.949283+0000 2024-09-12T00:42:40.944 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:40.946 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1aa86b92eb] 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1aa86b949f] 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff4819dcc1] 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff481b2d5a] 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1aa751fd90] 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f1aa4ddf9c0 thread_name:radosgw-admin 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.948+0000 7f1aa4ddf9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1aa4ddf9c0 time 2024-09-12T00:42:40.949283+0000 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:40.947 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1aa86b92eb] 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1aa86b949f] 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff4819dcc1] 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff481b2d5a] 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1aa751fd90] 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:42:40.948 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1aa7538520] 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1aa86b9345] 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1aa86b949f] 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff4819dcc1] 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff481b2d5a] 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:42:40.950 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1aa751fd90] 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:40.952+0000 7f1aa4ddf9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f1aa4ddf9c0 thread_name:radosgw-admin 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1aa7538520] 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:42:40.951 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1aa86b9345] 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1aa86b949f] 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff4819dcc1] 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff481b2d5a] 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1aa751fd90] 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.952 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:42:40.632+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:42:40.632+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:42:40.632+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:42:40.632+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_done global_id 7464 payload 274 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:42:40.632+0000 7f1aa20e4640 10 monclient: _finish_hunting 0 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:42:40.632+0000 7f1aa20e4640 1 monclient: found mon.noname-a 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:42:40.632+0000 7f1aa20e4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:42:40.632+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1a8c002380 auth_method 0 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:40.992 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: dump: 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: _finish_auth 0 2024-09-12T00:42:40.993 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: _check_auth_tickets 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: dump: 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:40.994 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7464 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 4 set_mon_vals no callback set 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: shutdown 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) unregister_commands rotate-key 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: monmap: 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:40.995 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding auth protocol: cephx 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding auth protocol: cephx 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding auth protocol: cephx 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:40.996 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 librados: starting msgr at 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 librados: starting objecter 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command objecter_requests hook 0x55ff49af2c00 2024-09-12T00:42:40.997 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 librados: setting wanted keys 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 librados: calling monclient init 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: init 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding auth protocol: cephx 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding auth protocol: cephx 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding auth protocol: cephx 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:40.998 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command rotate-key hook 0x55ff49cda728 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:40.999 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff49ce05b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff49d0ec30 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-c con 0x7f1a8c002380 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): authenticate will time out at 2261.768518s 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request con 0x7f1a8c002380 auth_method 0 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request con 0x55ff49d0ec30 auth_method 0 2024-09-12T00:42:41.000 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_done global_id 7127 payload 824 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 1 monclient: found mon.noname-c 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:42:41.001 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: dump: 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.002 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: dump: 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.003 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7127 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:42:40.636+0000 7f1990e09640 4 set_mon_vals no callback set 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 1 librados: init done 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:42:40.636+0000 7f198f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:42:40.636+0000 7f198f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:42:40.636+0000 7f198f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:42:40.636+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1988070ae0 auth_method 0 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:42:40.640+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x55ff49d10260 auth_method 0 2024-09-12T00:42:41.004 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:42:40.640+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x55ff49d26710 auth_method 0 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:42:40.640+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x55ff49d2b7a0 auth_method 0 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: monmap: 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:41.005 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding auth protocol: cephx 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding auth protocol: cephx 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding auth protocol: cephx 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.006 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ff49d32ff0 EEXIST 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: init 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding auth protocol: cephx 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding auth protocol: cephx 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding auth protocol: cephx 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.007 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command rotate-key cmddesc rotate-key hook 0x55ff49d2e6e0 EEXIST 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.008 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff49d571a0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff49d56ad0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff49d554b0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): authenticate will time out at 2261.777968s 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request con 0x55ff49d571a0 auth_method 0 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.009 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request con 0x55ff49d554b0 auth_method 0 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:42:40.644+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request con 0x55ff49d56ad0 auth_method 0 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:42:40.644+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.010 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:42:40.644+0000 7f1aa20e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:42:40.644+0000 7f1aa20e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_done global_id 7470 payload 824 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: dump: 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.011 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7470 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.012 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: dump: 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:42:40.644+0000 7f1aa38e7640 4 set_mon_vals no callback set 2024-09-12T00:42:41.013 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:42:40.648+0000 7f198ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:42:40.648+0000 7f198ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:42:40.648+0000 7f198ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:42:40.648+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x7f197c070a20 auth_method 0 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: monmap: 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:41.014 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding auth protocol: cephx 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding auth protocol: cephx 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding auth protocol: cephx 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.015 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: init 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding auth protocol: cephx 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding auth protocol: cephx 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding auth protocol: cephx 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.016 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.017 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc67ec5658 EEXIST 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff49daaee0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff49da62d0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff49da6c50 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): authenticate will time out at 2261.782140s 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request con 0x55ff49daaee0 auth_method 0 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.018 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request con 0x55ff49da6c50 auth_method 0 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_done global_id 7133 payload 274 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.019 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 1 monclient: found mon.noname-c 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: dump: 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.020 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7133 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: dump: 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.021 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 4 set_mon_vals no callback set 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: shutdown 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: monmap: 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:41.022 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding auth protocol: cephx 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding auth protocol: cephx 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding auth protocol: cephx 2024-09-12T00:42:41.023 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.024 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 1 librados: starting msgr at 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 1 librados: starting objecter 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ff49d766e0 EEXIST 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 1 librados: setting wanted keys 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 1 librados: calling monclient init 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: init 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding auth protocol: cephx 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding auth protocol: cephx 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding auth protocol: cephx 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.025 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command rotate-key cmddesc rotate-key hook 0x55ff49d59108 EEXIST 2024-09-12T00:42:41.026 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff49da62d0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff49da6c50 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff49daaee0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): authenticate will time out at 2261.784679s 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request con 0x55ff49da62d0 auth_method 0 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.027 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request con 0x55ff49da6c50 auth_method 0 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_done global_id 7476 payload 824 2024-09-12T00:42:41.028 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: dump: 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.029 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: dump: 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.030 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7476 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:42:40.652+0000 7f19867fc640 4 set_mon_vals no callback set 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 1 librados: init done 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cr dump hook 0x55ff49dab2d8 2024-09-12T00:42:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:42:40.652+0000 7f1984ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:42:40.652+0000 7f1984ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:42:40.652+0000 7f1984ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:42:40.656+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x7f196c070b10 auth_method 0 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:42:40.656+0000 7f1aa30e6640 10 monclient: get_auth_request con 0x55ff49dc3eb0 auth_method 0 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 realm 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.032 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:42:40.656+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x55ff49dc8240 auth_method 0 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:42:40.660+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:42:40.660+0000 7f1aa4ddf9c0 20 searching for the correct realm 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:42:40.660+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x55ff49dcd3b0 auth_method 0 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:42:40.660+0000 7f1aa30e6640 10 monclient: get_auth_request con 0x7f1a98008050 auth_method 0 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:42:40.660+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1a94116c20 auth_method 0 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:42:40.664+0000 7f1aa28e5640 0 -- 172.21.15.137:0/3831066792 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f1a94116c20 msgr2=0x7f1a940fbcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:42:40.664+0000 7f1984ff9640 1 client.7476.objecter ms_handle_reset 0x7f1a94116c20 session 0x7f1a940a7070 osd.0 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:42:40.664+0000 7f1984ff9640 10 monclient: _renew_subs 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:42:40.664+0000 7f1984ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.033 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:42:40.664+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f196c080ec0 auth_method 0 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:42:40.664+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x7f1a8c003100 auth_method 0 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:42:40.668+0000 7f1aa30e6640 10 monclient: get_auth_request con 0x7f1a94123040 auth_method 0 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:42:40.668+0000 7f1aa28e5640 0 -- 172.21.15.137:0/3831066792 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1a8c003cc0 msgr2=0x7f1a9c05dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:42:40.668+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1a8c003cc0 auth_method 0 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:42:40.872+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1a8c003cc0 auth_method 0 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.034 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 zone default found 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 Realm: () 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 zonegroup default 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.035 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=0 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=1 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=2 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=3 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=4 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=5 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=6 2024-09-12T00:42:41.036 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:42:40.920+0000 7f1aa4ddf9c0 20 add_watcher() i=7 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:42:40.920+0000 7f1aa4ddf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding auth protocol: cephx 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding auth protocol: cephx 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding auth protocol: cephx 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.037 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:42:40.924+0000 7f19597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cache list hook 0x55ff49d98890 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cache inspect hook 0x55ff49d98890 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cache erase hook 0x55ff49d98890 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cache zap hook 0x55ff49d98890 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 note: GC not initialized 2024-09-12T00:42:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:42:40.924+0000 7f18d3fff640 20 reqs_thread_entry: start 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command sync trace show hook 0x7f1a98004550 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command sync trace history hook 0x7f1a98004550 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command sync trace active hook 0x7f1a98004550 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command sync trace active_short hook 0x7f1a98004550 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 Filter name: none 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:42:40.924+0000 7f18d1ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:42:41.039 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 : miss 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34, ofs0, ns] 2024-09-12T00:42:41.040 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 94554944257936 notifier 7476 bl.length()=911 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_sources= new_sources= 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential sources added=[] removed=[] 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_dests= new_dests= 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential dests added=[] removed=[] 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:42:40.948+0000 7f1aa4ddf9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1aa4ddf9c0 time 2024-09-12T00:42:40.949283+0000 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1aa86b92eb] 2024-09-12T00:42:41.041 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1aa86b949f] 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff4819dcc1] 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff481b2d5a] 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1aa751fd90] 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:42:40.952+0000 7f1aa4ddf9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f1aa4ddf9c0 thread_name:radosgw-admin 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.042 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1aa7538520] 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1aa86b9345] 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1aa86b949f] 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff4819dcc1] 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff481b2d5a] 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1aa751fd90] 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:41.043 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:42:41.044 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:41.045 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:42:41.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:42:41.047 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:42:41.048 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:41.049 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:41.050 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f18d1ffb640 / http_manager 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f18d3fff640 / http_manager 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f19597e2640 / rgw_dt_lg_renew 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1984ff9640 / ms_dispatch 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f19867fc640 / io_context_pool 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f198ce01640 / ms_dispatch 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f198f606640 / ms_dispatch 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1990e09640 / io_context_pool 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa20e4640 / msgr-worker-2 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa28e5640 / msgr-worker-1 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa30e6640 / msgr-worker-0 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa38e7640 / io_context_pool 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa4ddf9c0 / radosgw-admin 2024-09-12T00:42:41.051 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.120763.log 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:42:40.632+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:42:40.632+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:42:40.632+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:42:40.632+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_done global_id 7464 payload 274 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:42:40.632+0000 7f1aa20e4640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:42:40.632+0000 7f1aa20e4640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:42:40.632+0000 7f1aa20e4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.052 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:42:40.632+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1a8c002380 auth_method 0 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: dump: 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.053 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:42:40.632+0000 7f1990e09640 10 monclient: dump: 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.054 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7464 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 4 set_mon_vals no callback set 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: shutdown 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) unregister_commands rotate-key 2024-09-12T00:42:41.055 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: monmap: 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding auth protocol: cephx 2024-09-12T00:42:41.056 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding auth protocol: cephx 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding auth protocol: cephx 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:41.057 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: crc 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49ce0a60) adding con mode: secure 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 librados: starting msgr at 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 librados: starting objecter 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command objecter_requests hook 0x55ff49af2c00 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 librados: setting wanted keys 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 1 librados: calling monclient init 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 10 monclient: init 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding auth protocol: cephx 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding auth protocol: cephx 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding auth protocol: cephx 2024-09-12T00:42:41.058 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: crc 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:42:40.632+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49cda5e0) adding con mode: secure 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.059 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command rotate-key hook 0x55ff49cda728 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff49ce05b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff49d0ec30 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-c con 0x7f1a8c002380 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient(hunting): authenticate will time out at 2261.768518s 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request con 0x7f1a8c002380 auth_method 0 2024-09-12T00:42:41.060 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request con 0x55ff49d0ec30 auth_method 0 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:42:40.636+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.061 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_done global_id 7127 payload 824 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 1 monclient: found mon.noname-c 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:42:40.636+0000 7f1aa30e6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: dump: 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.062 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:42:40.636+0000 7f198f606640 10 monclient: dump: 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.063 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7127 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:42:40.636+0000 7f1990e09640 4 set_mon_vals no callback set 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:42:40.636+0000 7f1aa4ddf9c0 1 librados: init done 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:42:40.636+0000 7f198f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:42:40.636+0000 7f198f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:42:40.636+0000 7f198f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:42:40.636+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1988070ae0 auth_method 0 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:42:40.640+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x55ff49d10260 auth_method 0 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:42:40.640+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x55ff49d26710 auth_method 0 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:42:40.640+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x55ff49d2b7a0 auth_method 0 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: monmap: 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:41.065 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding auth protocol: cephx 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding auth protocol: cephx 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding auth protocol: cephx 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.066 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: crc 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2f5e0) adding con mode: secure 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ff49d32ff0 EEXIST 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: init 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding auth protocol: cephx 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding auth protocol: cephx 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding auth protocol: cephx 2024-09-12T00:42:41.067 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: crc 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d2e598) adding con mode: secure 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.068 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command rotate-key cmddesc rotate-key hook 0x55ff49d2e6e0 EEXIST 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff49d571a0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff49d56ad0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff49d554b0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient(hunting): authenticate will time out at 2261.777968s 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request con 0x55ff49d571a0 auth_method 0 2024-09-12T00:42:41.069 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request con 0x55ff49d554b0 auth_method 0 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:42:40.644+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.070 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:42:40.644+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request con 0x55ff49d56ad0 auth_method 0 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:42:40.644+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:42:40.644+0000 7f1aa20e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:42:40.644+0000 7f1aa20e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_done global_id 7470 payload 824 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:42:40.644+0000 7f1aa28e5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: dump: 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.071 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.072 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.072 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.072 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7470 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.073 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:42:40.644+0000 7f198ce01640 10 monclient: dump: 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.074 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:42:40.644+0000 7f1aa38e7640 4 set_mon_vals no callback set 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:42:40.644+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:42:40.648+0000 7f198ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:42:40.648+0000 7f198ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:42:40.648+0000 7f198ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:42:40.648+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x7f197c070a20 auth_method 0 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: monmap: 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:41.075 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding auth protocol: cephx 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding auth protocol: cephx 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding auth protocol: cephx 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.076 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: crc 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d769f0) adding con mode: secure 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: init 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding auth protocol: cephx 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding auth protocol: cephx 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding auth protocol: cephx 2024-09-12T00:42:41.077 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: crc 2024-09-12T00:42:41.078 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec5510) adding con mode: secure 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc67ec5658 EEXIST 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff49daaee0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff49da62d0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff49da6c50 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient(hunting): authenticate will time out at 2261.782140s 2024-09-12T00:42:41.079 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request con 0x55ff49daaee0 auth_method 0 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request con 0x55ff49da6c50 auth_method 0 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.080 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:42:40.648+0000 7f1aa30e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_done global_id 7133 payload 274 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 1 monclient: found mon.noname-c 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:42:40.648+0000 7f1aa28e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: dump: 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.081 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7133 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:42:40.648+0000 7f19867fc640 10 monclient: dump: 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.082 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 4 set_mon_vals no callback set 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: shutdown 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 10 monclient: monmap: 2024-09-12T00:42:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding auth protocol: cephx 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding auth protocol: cephx 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding auth protocol: cephx 2024-09-12T00:42:41.084 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: crc 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49da7140) adding con mode: secure 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.085 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 1 librados: starting msgr at 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:42:40.648+0000 7f1aa4ddf9c0 1 librados: starting objecter 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ff49d766e0 EEXIST 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 1 librados: setting wanted keys 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 1 librados: calling monclient init 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: init 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding auth protocol: cephx 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding auth protocol: cephx 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding auth protocol: cephx 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.086 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: crc 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 AuthRegistry(0x55ff49d58fc0) adding con mode: secure 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command rotate-key cmddesc rotate-key hook 0x55ff49d59108 EEXIST 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff49da62d0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:42:41.087 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff49da6c50 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff49daaee0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient(hunting): authenticate will time out at 2261.784679s 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request con 0x55ff49da62d0 auth_method 0 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request con 0x55ff49da6c50 auth_method 0 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.088 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:42:40.652+0000 7f1aa20e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient(hunting): handle_auth_done global_id 7476 payload 824 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:42:40.652+0000 7f1aa28e5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.089 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: dump: 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.090 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:42:40.652+0000 7f1984ff9640 10 monclient: dump: 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.091 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 monclient: authenticate success, global_id 7476 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:42:40.652+0000 7f19867fc640 4 set_mon_vals no callback set 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _renew_subs 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 1 librados: init done 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cr dump hook 0x55ff49dab2d8 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:42:40.652+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:42:40.652+0000 7f1984ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:42:40.652+0000 7f1984ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:42:40.652+0000 7f1984ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:42:40.656+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x7f196c070b10 auth_method 0 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:42:40.656+0000 7f1aa30e6640 10 monclient: get_auth_request con 0x55ff49dc3eb0 auth_method 0 2024-09-12T00:42:41.092 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 realm 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:42:40.656+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x55ff49dc8240 auth_method 0 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:42:40.656+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:42:40.660+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:42:40.660+0000 7f1aa4ddf9c0 20 searching for the correct realm 2024-09-12T00:42:41.093 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:42:40.660+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x55ff49dcd3b0 auth_method 0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:42:40.660+0000 7f1aa30e6640 10 monclient: get_auth_request con 0x7f1a98008050 auth_method 0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:42:40.660+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1a94116c20 auth_method 0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:42:40.664+0000 7f1aa28e5640 0 -- 172.21.15.137:0/3831066792 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f1a94116c20 msgr2=0x7f1a940fbcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:42:40.664+0000 7f1984ff9640 1 client.7476.objecter ms_handle_reset 0x7f1a94116c20 session 0x7f1a940a7070 osd.0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:42:40.664+0000 7f1984ff9640 10 monclient: _renew_subs 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:42:40.664+0000 7f1984ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:42:40.664+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f196c080ec0 auth_method 0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:42:40.664+0000 7f1aa20e4640 10 monclient: get_auth_request con 0x7f1a8c003100 auth_method 0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:42:40.668+0000 7f1aa30e6640 10 monclient: get_auth_request con 0x7f1a94123040 auth_method 0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:42:40.668+0000 7f1aa28e5640 0 -- 172.21.15.137:0/3831066792 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1a8c003cc0 msgr2=0x7f1a9c05dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:42:40.668+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1a8c003cc0 auth_method 0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:42:40.872+0000 7f1aa28e5640 10 monclient: get_auth_request con 0x7f1a8c003cc0 auth_method 0 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.094 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:42:40.888+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 zone default found 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 Realm: () 2024-09-12T00:42:41.095 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 zonegroup default 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:42:40.892+0000 7f1aa4ddf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=0 2024-09-12T00:42:41.096 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=1 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=2 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=3 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=4 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=5 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:42:40.916+0000 7f1aa4ddf9c0 20 add_watcher() i=6 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:42:40.920+0000 7f1aa4ddf9c0 20 add_watcher() i=7 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:42:40.920+0000 7f1aa4ddf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding auth protocol: cephx 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding auth protocol: cephx 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding auth protocol: cephx 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.097 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: crc 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 AuthRegistry(0x7ffc67ec59f0) adding con mode: secure 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:42:40.924+0000 7f19597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cache list hook 0x55ff49d98890 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cache inspect hook 0x55ff49d98890 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cache erase hook 0x55ff49d98890 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command cache zap hook 0x55ff49d98890 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 note: GC not initialized 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:42:40.924+0000 7f18d3fff640 20 reqs_thread_entry: start 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command sync trace show hook 0x7f1a98004550 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command sync trace history hook 0x7f1a98004550 2024-09-12T00:42:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command sync trace active hook 0x7f1a98004550 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 5 asok(0x55ff49ad02b0) register_command sync trace active_short hook 0x7f1a98004550 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 Filter name: none 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:42:40.924+0000 7f18d1ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:42:40.924+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 : miss 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:42:41.100 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:42:40.928+0000 7f1aa4ddf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:42:40.936+0000 7f1aa4ddf9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34, ofs0, ns] 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 94554944257936 notifier 7476 bl.length()=911 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:42:40.936+0000 7f19867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:41.101 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_sources= new_sources= 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential sources added=[] removed=[] 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_dests= new_dests= 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:42:40.940+0000 7f1aa4ddf9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential dests added=[] removed=[] 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:42:40.948+0000 7f1aa4ddf9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1aa4ddf9c0 time 2024-09-12T00:42:40.949283+0000 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1aa86b92eb] 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1aa86b949f] 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff4819dcc1] 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff481b2d5a] 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1aa751fd90] 2024-09-12T00:42:41.102 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:42:40.952+0000 7f1aa4ddf9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f1aa4ddf9c0 thread_name:radosgw-admin 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1aa7538520] 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1aa86b9345] 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1aa86b949f] 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff4819dcc1] 2024-09-12T00:42:41.103 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff481b2d5a] 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1aa751fd90] 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:42:41.104 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:42:41.105 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:42:41.106 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:41.107 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:42:41.108 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:41.109 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:42:41.110 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f18d1ffb640 / http_manager 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f18d3fff640 / http_manager 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f19597e2640 / rgw_dt_lg_renew 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1984ff9640 / ms_dispatch 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f19867fc640 / io_context_pool 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f198ce01640 / ms_dispatch 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f198f606640 / ms_dispatch 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1990e09640 / io_context_pool 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa20e4640 / msgr-worker-2 2024-09-12T00:42:41.111 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa28e5640 / msgr-worker-1 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa30e6640 / msgr-worker-0 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa38e7640 / io_context_pool 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr: 7f1aa4ddf9c0 / radosgw-admin 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:42:40.954848Z_6c376eb5-a7cb-4f1b-a21b-c72f461a4e85/log 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:42:41.112 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:42:41.115 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:41.115 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:41.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.036+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 realm 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.040+0000 7f666ecee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.044+0000 7f666ecee9c0 20 searching for the correct realm 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.048+0000 7f666cff5640 0 -- 172.21.15.137:0/3782620201 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x558dfb35a160 msgr2=0x558dfb35c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.056+0000 7f666c7f4640 0 -- 172.21.15.137:0/3782620201 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x558dfb35e550 msgr2=0x558dfb360940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.060+0000 7f666ecee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.060+0000 7f666ecee9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.060+0000 7f666ecee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.060+0000 7f666ecee9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.060+0000 7f666ecee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.060+0000 7f666ecee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.060+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 zone default found 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 4 Realm: () 2024-09-12T00:42:41.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 zonegroup default 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.064+0000 7f666ecee9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.112+0000 7f666ecee9c0 20 add_watcher() i=0 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.112+0000 7f666ecee9c0 20 add_watcher() i=1 2024-09-12T00:42:41.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.112+0000 7f666ecee9c0 20 add_watcher() i=2 2024-09-12T00:42:41.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.112+0000 7f666ecee9c0 20 add_watcher() i=3 2024-09-12T00:42:41.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.112+0000 7f666ecee9c0 20 add_watcher() i=4 2024-09-12T00:42:41.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.112+0000 7f666ecee9c0 20 add_watcher() i=5 2024-09-12T00:42:41.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.116+0000 7f666ecee9c0 20 add_watcher() i=6 2024-09-12T00:42:41.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.116+0000 7f666ecee9c0 20 add_watcher() i=7 2024-09-12T00:42:41.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.116+0000 7f666ecee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.120+0000 7f65227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.120+0000 7f666ecee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.120+0000 7f666ecee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.121 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.120+0000 7f666ecee9c0 5 note: GC not initialized 2024-09-12T00:42:41.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.120+0000 7f65217e2640 20 reqs_thread_entry: start 2024-09-12T00:42:41.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.120+0000 7f666ecee9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:41.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 Filter name: none 2024-09-12T00:42:41.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f6492ffd640 20 reqs_thread_entry: start 2024-09-12T00:42:41.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:41.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:42:41.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:41.123 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:41.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:42:41.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.124+0000 7f666ecee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:41.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.128+0000 7f65227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.132+0000 7f666ecee9c0 20 remove_watcher() i=0 2024-09-12T00:42:41.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.132+0000 7f666ecee9c0 2 removed watcher, disabling cache 2024-09-12T00:42:41.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.132+0000 7f666ecee9c0 20 remove_watcher() i=1 2024-09-12T00:42:41.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.136+0000 7f666ecee9c0 20 remove_watcher() i=2 2024-09-12T00:42:41.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.136+0000 7f666ecee9c0 20 remove_watcher() i=3 2024-09-12T00:42:41.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.140+0000 7f666ecee9c0 20 remove_watcher() i=4 2024-09-12T00:42:41.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.140+0000 7f666ecee9c0 20 remove_watcher() i=5 2024-09-12T00:42:41.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.144+0000 7f666ecee9c0 20 remove_watcher() i=6 2024-09-12T00:42:41.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.148+0000 7f666ecee9c0 20 remove_watcher() i=7 2024-09-12T00:42:41.160 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.161 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:42:41.161 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-do-reshard id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:42:41.161 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:42:41.162 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:41.162 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:41.175 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:41.175 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:42:41.219 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:42:41.252 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:41.252 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:41.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.296+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 realm 2024-09-12T00:42:41.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.300+0000 7ff3863e79c0 20 searching for the correct realm 2024-09-12T00:42:41.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.308+0000 7ff3836ec640 0 -- 172.21.15.137:0/2944480237 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7ff37806d640 msgr2=0x7ff378089990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.312+0000 7ff3846ee640 0 -- 172.21.15.137:0/2944480237 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x559f1505bab0 msgr2=0x559f1505df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.320+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 zone default found 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 4 Realm: () 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 zonegroup default 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.324+0000 7ff3863e79c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:42:41.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.340+0000 7ff3863e79c0 20 add_watcher() i=0 2024-09-12T00:42:41.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.340+0000 7ff3863e79c0 20 add_watcher() i=1 2024-09-12T00:42:41.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.340+0000 7ff3863e79c0 20 add_watcher() i=2 2024-09-12T00:42:41.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.340+0000 7ff3863e79c0 20 add_watcher() i=3 2024-09-12T00:42:41.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.340+0000 7ff3863e79c0 20 add_watcher() i=4 2024-09-12T00:42:41.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.340+0000 7ff3863e79c0 20 add_watcher() i=5 2024-09-12T00:42:41.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.340+0000 7ff3863e79c0 20 add_watcher() i=6 2024-09-12T00:42:41.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.344+0000 7ff3863e79c0 20 add_watcher() i=7 2024-09-12T00:42:41.343 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.344+0000 7ff3863e79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 5 note: GC not initialized 2024-09-12T00:42:41.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff238fe1640 20 reqs_thread_entry: start 2024-09-12T00:42:41.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:42:41.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 20 Filter name: none 2024-09-12T00:42:41.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff1b27fc640 20 reqs_thread_entry: start 2024-09-12T00:42:41.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:42:41.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:42:41.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:42:41.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:42:41.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 : miss 2024-09-12T00:42:41.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:42:41.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:42:41.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:42:41.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:41.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:42:41.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.348+0000 7ff3863e79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 2024-09-12T00:42:41.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.352+0000 7ff3863e79c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to be held by another RGW process; skipping for now 2024-09-12T00:42:41.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.352+0000 7ff239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.356+0000 7ff3863e79c0 20 remove_watcher() i=0 2024-09-12T00:42:41.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.356+0000 7ff3863e79c0 2 removed watcher, disabling cache 2024-09-12T00:42:41.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.360+0000 7ff3863e79c0 20 remove_watcher() i=1 2024-09-12T00:42:41.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.364+0000 7ff3863e79c0 20 remove_watcher() i=2 2024-09-12T00:42:41.363 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.364+0000 7ff3863e79c0 20 remove_watcher() i=3 2024-09-12T00:42:41.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.368+0000 7ff3863e79c0 20 remove_watcher() i=4 2024-09-12T00:42:41.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.368+0000 7ff3863e79c0 20 remove_watcher() i=5 2024-09-12T00:42:41.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.372+0000 7ff3863e79c0 20 remove_watcher() i=6 2024-09-12T00:42:41.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:42:41.372+0000 7ff3863e79c0 20 remove_watcher() i=7 2024-09-12T00:42:41.389 INFO:tasks.workunit.client.0.smithi137.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:43:11.396 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:43:11.432 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:11.432 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:11.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.476+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 realm 2024-09-12T00:43:11.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:11.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:11.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:11.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.480+0000 7fef08d189c0 20 searching for the correct realm 2024-09-12T00:43:11.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.488+0000 7fef0601d640 0 -- 172.21.15.137:0/1062872764 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7feefc06d6c0 msgr2=0x7feefc0890c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:11.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.496+0000 7fef0601d640 0 -- 172.21.15.137:0/1062872764 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x563b5763c510 msgr2=0x563b5763e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:11.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:11.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:11.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:11.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:11.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:11.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:11.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:11.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 zone default found 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 4 Realm: () 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 zonegroup default 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 started sync module instance, tier type = 2024-09-12T00:43:11.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.504+0000 7fef08d189c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:11.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.524+0000 7fef08d189c0 20 add_watcher() i=0 2024-09-12T00:43:11.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.524+0000 7fef08d189c0 20 add_watcher() i=1 2024-09-12T00:43:11.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.524+0000 7fef08d189c0 20 add_watcher() i=2 2024-09-12T00:43:11.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.524+0000 7fef08d189c0 20 add_watcher() i=3 2024-09-12T00:43:11.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.524+0000 7fef08d189c0 20 add_watcher() i=4 2024-09-12T00:43:11.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.524+0000 7fef08d189c0 20 add_watcher() i=5 2024-09-12T00:43:11.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.524+0000 7fef08d189c0 20 add_watcher() i=6 2024-09-12T00:43:11.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.528+0000 7fef08d189c0 20 add_watcher() i=7 2024-09-12T00:43:11.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.528+0000 7fef08d189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:11.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fedbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:11.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:11.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:11.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 5 note: GC not initialized 2024-09-12T00:43:11.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fedbcfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:11.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:11.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 20 Filter name: none 2024-09-12T00:43:11.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fedb5ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:11.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:43:11.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:43:11.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:43:11.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:43:11.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 : miss 2024-09-12T00:43:11.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:43:11.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:43:11.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:43:11.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:11.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:11.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.532+0000 7fef08d189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 2024-09-12T00:43:11.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.536+0000 7fef08d189c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:43:11.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.544+0000 7fef08d189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:43:11.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.544+0000 7fef08d189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:43:11.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.544+0000 7fef08d189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:11.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.544+0000 7fef08d189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34, ofs0, ns] 2024-09-12T00:43:11.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.544+0000 7fedea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94812869275808 notifier 7533 bl.length()=911 2024-09-12T00:43:11.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.544+0000 7fedea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:43:11.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.544+0000 7fedea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:43:11.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.544+0000 7fedea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:11.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.548+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_sources= new_sources= 2024-09-12T00:43:11.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.548+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential sources added=[] removed=[] 2024-09-12T00:43:11.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.548+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_dests= new_dests= 2024-09-12T00:43:11.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.548+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential dests added=[] removed=[] 2024-09-12T00:43:11.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.552+0000 7fef08d189c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34.2.0 2024-09-12T00:43:11.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.552+0000 7fef08d189c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34.2.0 2024-09-12T00:43:11.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.552+0000 7fef08d189c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34.2.1 2024-09-12T00:43:11.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.552+0000 7fef08d189c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34.2.1 2024-09-12T00:43:11.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.552+0000 7fef08d189c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34.0 2024-09-12T00:43:11.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fef08d189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:11.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fef08d189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 2024-09-12T00:43:11.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fef08d189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:43:11.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fef08d189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:43:11.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fef08d189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:11.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fef08d189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34, ofs0, ns] 2024-09-12T00:43:11.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fede9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94812869275808 notifier 7533 bl.length()=911 2024-09-12T00:43:11.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fede9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:43:11.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fede9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:43:11.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.560+0000 7fede9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:11.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.564+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_sources= new_sources= 2024-09-12T00:43:11.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.564+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential sources added=[] removed=[] 2024-09-12T00:43:11.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.564+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_dests= new_dests= 2024-09-12T00:43:11.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.564+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential dests added=[] removed=[] 2024-09-12T00:43:11.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.564+0000 7fef08d189c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34.0 2024-09-12T00:43:11.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.568+0000 7fef08d189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:11.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.568+0000 7fef08d189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 2024-09-12T00:43:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.568+0000 7fef08d189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:43:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.568+0000 7fef08d189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:43:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.568+0000 7fef08d189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.568+0000 7fef08d189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34, ofs0, ns] 2024-09-12T00:43:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fede9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94812869275808 notifier 7533 bl.length()=879 2024-09-12T00:43:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fede9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 info.flags=0x17 2024-09-12T00:43:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fede9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 to cache LRU end 2024-09-12T00:43:11.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fede9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:11.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_sources= new_sources= 2024-09-12T00:43:11.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential sources added=[] removed=[] 2024-09-12T00:43:11.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): orig_dests= new_dests= 2024-09-12T00:43:11.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fef08d189c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34]): potential dests added=[] removed=[] 2024-09-12T00:43:11.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.572+0000 7fef08d189c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:43:11.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.576+0000 7fedbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:11.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.580+0000 7fef08d189c0 20 remove_watcher() i=0 2024-09-12T00:43:11.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.580+0000 7fef08d189c0 2 removed watcher, disabling cache 2024-09-12T00:43:11.583 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.584+0000 7fef08d189c0 20 remove_watcher() i=1 2024-09-12T00:43:11.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.588+0000 7fef08d189c0 20 remove_watcher() i=2 2024-09-12T00:43:11.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.588+0000 7fef08d189c0 20 remove_watcher() i=3 2024-09-12T00:43:11.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.592+0000 7fef08d189c0 20 remove_watcher() i=4 2024-09-12T00:43:11.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.592+0000 7fef08d189c0 20 remove_watcher() i=5 2024-09-12T00:43:11.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.596+0000 7fef08d189c0 20 remove_watcher() i=6 2024-09-12T00:43:11.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.600+0000 7fef08d189c0 20 remove_watcher() i=7 2024-09-12T00:43:11.616 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:43:11.648 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:11.648 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:11.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.696+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.696+0000 7f32aca439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.696+0000 7f32aca439c0 20 realm 2024-09-12T00:43:11.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.696+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.696+0000 7f32aca439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.696+0000 7f32aca439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:11.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.696+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.700+0000 7f32aca439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.700+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.700+0000 7f32aca439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:11.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.700+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.700+0000 7f32aca439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:11.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.700+0000 7f32aca439c0 20 searching for the correct realm 2024-09-12T00:43:11.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.704+0000 7f32a9d48640 0 -- 172.21.15.137:0/1056766518 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f32a0108ee0 msgr2=0x7f32a01336d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:11.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.920+0000 7f32aa549640 0 -- 172.21.15.137:0/1056766518 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f32a4036060 msgr2=0x7f32a4060870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:11.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:11.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:11.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:11.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:11.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:11.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:11.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:11.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.932+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 zone default found 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 4 Realm: () 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 zonegroup default 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:11.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 started sync module instance, tier type = 2024-09-12T00:43:11.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.936+0000 7f32aca439c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:11.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.960+0000 7f32aca439c0 20 add_watcher() i=0 2024-09-12T00:43:11.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.960+0000 7f32aca439c0 20 add_watcher() i=1 2024-09-12T00:43:11.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.960+0000 7f32aca439c0 20 add_watcher() i=2 2024-09-12T00:43:11.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.960+0000 7f32aca439c0 20 add_watcher() i=3 2024-09-12T00:43:11.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.960+0000 7f32aca439c0 20 add_watcher() i=4 2024-09-12T00:43:11.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.960+0000 7f32aca439c0 20 add_watcher() i=5 2024-09-12T00:43:11.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.960+0000 7f32aca439c0 20 add_watcher() i=6 2024-09-12T00:43:11.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.964+0000 7f32aca439c0 20 add_watcher() i=7 2024-09-12T00:43:11.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.964+0000 7f32aca439c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:11.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f3160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:11.968 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f32aca439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:11.968 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f32aca439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:11.968 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f32aca439c0 5 note: GC not initialized 2024-09-12T00:43:11.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f30db7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:11.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f32aca439c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:11.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f32aca439c0 20 Filter name: none 2024-09-12T00:43:11.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f30d97fa640 20 reqs_thread_entry: start 2024-09-12T00:43:11.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.968+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:43:11.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:43:11.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:11.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:43:11.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:11.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:43:11.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.972+0000 7f32aca439c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:11.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.976+0000 7f3160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:11.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.980+0000 7f32aca439c0 20 remove_watcher() i=0 2024-09-12T00:43:11.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.980+0000 7f32aca439c0 2 removed watcher, disabling cache 2024-09-12T00:43:11.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.980+0000 7f32aca439c0 20 remove_watcher() i=1 2024-09-12T00:43:11.983 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.984+0000 7f32aca439c0 20 remove_watcher() i=2 2024-09-12T00:43:11.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.988+0000 7f32aca439c0 20 remove_watcher() i=3 2024-09-12T00:43:11.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.988+0000 7f32aca439c0 20 remove_watcher() i=4 2024-09-12T00:43:11.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.992+0000 7f32aca439c0 20 remove_watcher() i=5 2024-09-12T00:43:11.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.992+0000 7f32aca439c0 20 remove_watcher() i=6 2024-09-12T00:43:11.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:11.996+0000 7f32aca439c0 20 remove_watcher() i=7 2024-09-12T00:43:12.012 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:12.013 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:12.013 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-do-reshard id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:43:12.013 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:12.014 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.014 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.018 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.018 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.064 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.064 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.091 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:43:12.091 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:12.092 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.092 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.111 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.111 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.157 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.158 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.179 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.179 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.199 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.199 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.219 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.219 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.239 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.239 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.258 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.259 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.278 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.278 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.298 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.298 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.317 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.317 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.340 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.340 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.359 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.359 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.378 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.379 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.398 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.398 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.419 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.419 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.440 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.440 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.460 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.460 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.480 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.481 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.500 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.500 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.519 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.519 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.541 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:12.542 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:12.560 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:43:12.593 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:12.594 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:12.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.640+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.640+0000 7fddb96249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.640+0000 7fddb96249c0 20 realm 2024-09-12T00:43:12.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.640+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.640+0000 7fddb96249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.640+0000 7fddb96249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:12.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.640+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.644+0000 7fddb96249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.644+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.644+0000 7fddb96249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:12.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.644+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.644+0000 7fddb96249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:12.643 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.644+0000 7fddb96249c0 20 searching for the correct realm 2024-09-12T00:43:12.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.648+0000 7fddb792b640 0 -- 172.21.15.137:0/929508430 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fddac001480 msgr2=0x7fddac001860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:12.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.856+0000 7fddb712a640 0 -- 172.21.15.137:0/929508430 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fddb0121b80 msgr2=0x7fddb00e2940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:12.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.872+0000 7fddb96249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:12.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.872+0000 7fddb96249c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:12.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.872+0000 7fddb96249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:12.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.872+0000 7fddb96249c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:12.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.872+0000 7fddb96249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:12.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.872+0000 7fddb96249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:12.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.872+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:12.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:12.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 zone default found 2024-09-12T00:43:12.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 4 Realm: () 2024-09-12T00:43:12.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:12.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:12.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:12.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 zonegroup default 2024-09-12T00:43:12.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.876+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.880+0000 7fddb96249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.880+0000 7fddb96249c0 20 started sync module instance, tier type = 2024-09-12T00:43:12.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.880+0000 7fddb96249c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:12.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 20 add_watcher() i=0 2024-09-12T00:43:12.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 20 add_watcher() i=1 2024-09-12T00:43:12.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 20 add_watcher() i=2 2024-09-12T00:43:12.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 20 add_watcher() i=3 2024-09-12T00:43:12.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 20 add_watcher() i=4 2024-09-12T00:43:12.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 20 add_watcher() i=5 2024-09-12T00:43:12.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 20 add_watcher() i=6 2024-09-12T00:43:12.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 20 add_watcher() i=7 2024-09-12T00:43:12.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.904+0000 7fddb96249c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:12.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.908+0000 7fdc6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:12.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.908+0000 7fddb96249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:12.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.908+0000 7fddb96249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:12.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.908+0000 7fddb96249c0 5 note: GC not initialized 2024-09-12T00:43:12.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.908+0000 7fdc6cfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:12.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.908+0000 7fddb96249c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:12.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 Filter name: none 2024-09-12T00:43:12.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fdbe67fc640 20 reqs_thread_entry: start 2024-09-12T00:43:12.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:12.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:12.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:12.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:12.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:12.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.912+0000 7fddb96249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:12.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.916+0000 7fdc6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:12.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.920+0000 7fddb96249c0 20 remove_watcher() i=0 2024-09-12T00:43:12.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.920+0000 7fddb96249c0 2 removed watcher, disabling cache 2024-09-12T00:43:12.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.924+0000 7fddb96249c0 20 remove_watcher() i=1 2024-09-12T00:43:12.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.924+0000 7fddb96249c0 20 remove_watcher() i=2 2024-09-12T00:43:12.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.928+0000 7fddb96249c0 20 remove_watcher() i=3 2024-09-12T00:43:12.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.928+0000 7fddb96249c0 20 remove_watcher() i=4 2024-09-12T00:43:12.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.932+0000 7fddb96249c0 20 remove_watcher() i=5 2024-09-12T00:43:12.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.932+0000 7fddb96249c0 20 remove_watcher() i=6 2024-09-12T00:43:12.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:12.936+0000 7fddb96249c0 20 remove_watcher() i=7 2024-09-12T00:43:12.951 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-logrecord-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:12.952 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:12.952 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:43:12.985 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:12.985 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:13.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.028+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 realm 2024-09-12T00:43:13.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:13.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:13.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.032+0000 7f8e9c2909c0 20 searching for the correct realm 2024-09-12T00:43:13.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.040+0000 7f8e9a597640 0 -- 172.21.15.137:0/2783095441 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f8e900df020 msgr2=0x7f8e9010b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:13.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.044+0000 7f8e99d96640 0 -- 172.21.15.137:0/2783095441 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f8e9407fc20 msgr2=0x7f8e9408ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:13.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:13.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:13.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:13.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:13.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:13.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:13.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 zone default found 2024-09-12T00:43:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 4 Realm: () 2024-09-12T00:43:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:13.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:13.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:13.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 zonegroup default 2024-09-12T00:43:13.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.052+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.056+0000 7f8e9c2909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.056+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.056+0000 7f8e9c2909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.056+0000 7f8e9c2909c0 20 started sync module instance, tier type = 2024-09-12T00:43:13.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.056+0000 7f8e9c2909c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:13.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.072+0000 7f8e9c2909c0 20 add_watcher() i=0 2024-09-12T00:43:13.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.072+0000 7f8e9c2909c0 20 add_watcher() i=1 2024-09-12T00:43:13.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.072+0000 7f8e9c2909c0 20 add_watcher() i=2 2024-09-12T00:43:13.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.072+0000 7f8e9c2909c0 20 add_watcher() i=3 2024-09-12T00:43:13.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.072+0000 7f8e9c2909c0 20 add_watcher() i=4 2024-09-12T00:43:13.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.072+0000 7f8e9c2909c0 20 add_watcher() i=5 2024-09-12T00:43:13.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.072+0000 7f8e9c2909c0 20 add_watcher() i=6 2024-09-12T00:43:13.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.076+0000 7f8e9c2909c0 20 add_watcher() i=7 2024-09-12T00:43:13.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.076+0000 7f8e9c2909c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:13.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8d4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:13.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:13.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 5 note: GC not initialized 2024-09-12T00:43:13.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8d4a7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:13.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:13.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 20 Filter name: none 2024-09-12T00:43:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8cbbfff640 20 reqs_thread_entry: start 2024-09-12T00:43:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:43:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:43:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:43:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 : miss 2024-09-12T00:43:13.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.080+0000 7f8e9c2909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 2024-09-12T00:43:13.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8e9c2909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8e9c2909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8e9c2909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8e9c2909c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35, ofs0, ns] 2024-09-12T00:43:13.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8d7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 94163212936096 notifier 7593 bl.length()=923 2024-09-12T00:43:13.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8d7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8d7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8d7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8e9c2909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_sources= new_sources= 2024-09-12T00:43:13.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8e9c2909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential sources added=[] removed=[] 2024-09-12T00:43:13.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8e9c2909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_dests= new_dests= 2024-09-12T00:43:13.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.088+0000 7f8e9c2909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential dests added=[] removed=[] 2024-09-12T00:43:13.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.092+0000 7f8e9c2909c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:43:13.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.092+0000 7f8e9c2909c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:43:13.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.096+0000 7f8e9c2909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:13.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.096+0000 7f8e9c2909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 2024-09-12T00:43:13.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8e9c2909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8e9c2909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8e9c2909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8e9c2909c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35, ofs0, ns] 2024-09-12T00:43:13.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8d7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 94163212936096 notifier 7593 bl.length()=891 2024-09-12T00:43:13.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8d7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8d7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.098 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8d7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8e9c2909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_sources= new_sources= 2024-09-12T00:43:13.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8e9c2909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential sources added=[] removed=[] 2024-09-12T00:43:13.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8e9c2909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_dests= new_dests= 2024-09-12T00:43:13.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.100+0000 7f8e9c2909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential dests added=[] removed=[] 2024-09-12T00:43:13.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.104+0000 7f8d4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.104+0000 7f8e9c2909c0 20 remove_watcher() i=0 2024-09-12T00:43:13.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.104+0000 7f8e9c2909c0 2 removed watcher, disabling cache 2024-09-12T00:43:13.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.108+0000 7f8e9c2909c0 20 remove_watcher() i=1 2024-09-12T00:43:13.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.108+0000 7f8e9c2909c0 20 remove_watcher() i=2 2024-09-12T00:43:13.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.112+0000 7f8e9c2909c0 20 remove_watcher() i=3 2024-09-12T00:43:13.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.112+0000 7f8e9c2909c0 20 remove_watcher() i=4 2024-09-12T00:43:13.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.116+0000 7f8e9c2909c0 20 remove_watcher() i=5 2024-09-12T00:43:13.118 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.120+0000 7f8e9c2909c0 20 remove_watcher() i=6 2024-09-12T00:43:13.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.120+0000 7f8e9c2909c0 20 remove_watcher() i=7 2024-09-12T00:43:13.135 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:43:13.162 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:13.162 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:13.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.208+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.208+0000 7f9b270079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.208+0000 7f9b270079c0 20 realm 2024-09-12T00:43:13.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.208+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:13.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:13.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.212+0000 7f9b270079c0 20 searching for the correct realm 2024-09-12T00:43:13.218 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.220+0000 7f9b2530e640 0 -- 172.21.15.137:0/525261402 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x559c0cda3ef0 msgr2=0x559c0cda6300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:13.224 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.224+0000 7f9b24b0d640 0 -- 172.21.15.137:0/525261402 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x559c0cda8010 msgr2=0x559c0cdaa400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:13.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:13.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:13.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:13.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:13.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:13.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:13.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 zone default found 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 4 Realm: () 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:13.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:13.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 zonegroup default 2024-09-12T00:43:13.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 started sync module instance, tier type = 2024-09-12T00:43:13.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.232+0000 7f9b270079c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:13.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 20 add_watcher() i=0 2024-09-12T00:43:13.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 20 add_watcher() i=1 2024-09-12T00:43:13.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 20 add_watcher() i=2 2024-09-12T00:43:13.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 20 add_watcher() i=3 2024-09-12T00:43:13.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 20 add_watcher() i=4 2024-09-12T00:43:13.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 20 add_watcher() i=5 2024-09-12T00:43:13.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 20 add_watcher() i=6 2024-09-12T00:43:13.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 20 add_watcher() i=7 2024-09-12T00:43:13.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.252+0000 7f9b270079c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:13.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f99dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f9b270079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:13.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f9b270079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:13.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f9b270079c0 5 note: GC not initialized 2024-09-12T00:43:13.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f99d9fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:13.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f9b270079c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:13.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f9b270079c0 20 Filter name: none 2024-09-12T00:43:13.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f994b7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:13.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.256+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:13.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:13.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:13.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:13.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:13.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f9b270079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:13.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.260+0000 7f99dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.268+0000 7f9b270079c0 20 remove_watcher() i=0 2024-09-12T00:43:13.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.268+0000 7f9b270079c0 2 removed watcher, disabling cache 2024-09-12T00:43:13.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.268+0000 7f9b270079c0 20 remove_watcher() i=1 2024-09-12T00:43:13.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.272+0000 7f9b270079c0 20 remove_watcher() i=2 2024-09-12T00:43:13.272 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.272+0000 7f9b270079c0 20 remove_watcher() i=3 2024-09-12T00:43:13.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.276+0000 7f9b270079c0 20 remove_watcher() i=4 2024-09-12T00:43:13.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.276+0000 7f9b270079c0 20 remove_watcher() i=5 2024-09-12T00:43:13.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.280+0000 7f9b270079c0 20 remove_watcher() i=6 2024-09-12T00:43:13.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.280+0000 7f9b270079c0 20 remove_watcher() i=7 2024-09-12T00:43:13.295 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:13.295 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:13.295 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-logrecord-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:13.295 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:13.296 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:13.296 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:13.311 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:13.311 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:13.355 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:43:13.392 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:13.392 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:13.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.436+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 20 realm 2024-09-12T00:43:13.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:13.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.440+0000 7f9c72b1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.444+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.444+0000 7f9c72b1b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:13.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.444+0000 7f9c72b1b9c0 20 searching for the correct realm 2024-09-12T00:43:13.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.444+0000 7f9c70621640 0 -- 172.21.15.137:0/3604953512 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f9c6001b040 msgr2=0x7f9c60071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:13.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.656+0000 7f9c70621640 0 -- 172.21.15.137:0/3604953512 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f9c68085c20 msgr2=0x7f9c6805f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:13.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.872+0000 7f9c72b1b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:13.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.872+0000 7f9c72b1b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:13.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.872+0000 7f9c72b1b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:13.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.872+0000 7f9c72b1b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:13.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.872+0000 7f9c72b1b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:13.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.872+0000 7f9c72b1b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:13.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.872+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 zone default found 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 4 Realm: () 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 zonegroup default 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.877 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.876+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.880+0000 7f9c72b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.880+0000 7f9c72b1b9c0 20 started sync module instance, tier type = 2024-09-12T00:43:13.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.880+0000 7f9c72b1b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:13.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 20 add_watcher() i=0 2024-09-12T00:43:13.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 20 add_watcher() i=1 2024-09-12T00:43:13.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 20 add_watcher() i=2 2024-09-12T00:43:13.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 20 add_watcher() i=3 2024-09-12T00:43:13.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 20 add_watcher() i=4 2024-09-12T00:43:13.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 20 add_watcher() i=5 2024-09-12T00:43:13.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 20 add_watcher() i=6 2024-09-12T00:43:13.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 20 add_watcher() i=7 2024-09-12T00:43:13.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.904+0000 7f9c72b1b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:13.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.908+0000 7f9b277de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.908+0000 7f9c72b1b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:13.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.908+0000 7f9c72b1b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:13.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.908+0000 7f9c72b1b9c0 5 note: GC not initialized 2024-09-12T00:43:13.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.908+0000 7f9b267dc640 20 reqs_thread_entry: start 2024-09-12T00:43:13.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.908+0000 7f9c72b1b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:13.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 20 Filter name: none 2024-09-12T00:43:13.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9b1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:13.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:43:13.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 : miss 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.912+0000 7f9c72b1b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 2024-09-12T00:43:13.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9c72b1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9c72b1b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9c72b1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9c72b1b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35, ofs0, ns] 2024-09-12T00:43:13.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9b477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366255 cookie 94401348052592 notifier 7632 bl.length()=923 2024-09-12T00:43:13.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9b477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9b477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9b477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_sources= new_sources= 2024-09-12T00:43:13.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential sources added=[] removed=[] 2024-09-12T00:43:13.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_dests= new_dests= 2024-09-12T00:43:13.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.920+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential dests added=[] removed=[] 2024-09-12T00:43:13.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.928+0000 7f9c72b1b9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35.1.0 2024-09-12T00:43:13.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.928+0000 7f9c72b1b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35.1.0 2024-09-12T00:43:13.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.928+0000 7f9c72b1b9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35.1.1 2024-09-12T00:43:13.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.928+0000 7f9c72b1b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35.1.1 2024-09-12T00:43:13.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.928+0000 7f9c72b1b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35.0 2024-09-12T00:43:13.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.932+0000 7f9c72b1b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:13.933 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.932+0000 7f9c72b1b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 2024-09-12T00:43:13.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9c72b1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9c72b1b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9c72b1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9c72b1b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35, ofs0, ns] 2024-09-12T00:43:13.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9b477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366256 cookie 94401348052592 notifier 7632 bl.length()=923 2024-09-12T00:43:13.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9b477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9b477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.935 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9b477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_sources= new_sources= 2024-09-12T00:43:13.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential sources added=[] removed=[] 2024-09-12T00:43:13.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_dests= new_dests= 2024-09-12T00:43:13.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.936+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential dests added=[] removed=[] 2024-09-12T00:43:13.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.940+0000 7f9c72b1b9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35.0 2024-09-12T00:43:13.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.940+0000 7f9c72b1b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:13.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.940+0000 7f9c72b1b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 2024-09-12T00:43:13.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.940+0000 7f9c72b1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.940+0000 7f9c72b1b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.940+0000 7f9c72b1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.940+0000 7f9c72b1b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35, ofs0, ns] 2024-09-12T00:43:13.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9b46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366257 cookie 94401348052592 notifier 7632 bl.length()=891 2024-09-12T00:43:13.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9b46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 info.flags=0x17 2024-09-12T00:43:13.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9b46ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 to cache LRU end 2024-09-12T00:43:13.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9b46ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:13.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_sources= new_sources= 2024-09-12T00:43:13.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential sources added=[] removed=[] 2024-09-12T00:43:13.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): orig_dests= new_dests= 2024-09-12T00:43:13.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9c72b1b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35]): potential dests added=[] removed=[] 2024-09-12T00:43:13.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.944+0000 7f9c72b1b9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:43:13.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.948+0000 7f9b277de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.953 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.956+0000 7f9c72b1b9c0 20 remove_watcher() i=0 2024-09-12T00:43:13.954 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.956+0000 7f9c72b1b9c0 2 removed watcher, disabling cache 2024-09-12T00:43:13.955 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.956+0000 7f9c72b1b9c0 20 remove_watcher() i=1 2024-09-12T00:43:13.957 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.960+0000 7f9c72b1b9c0 20 remove_watcher() i=2 2024-09-12T00:43:13.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.960+0000 7f9c72b1b9c0 20 remove_watcher() i=3 2024-09-12T00:43:13.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.964+0000 7f9c72b1b9c0 20 remove_watcher() i=4 2024-09-12T00:43:13.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.964+0000 7f9c72b1b9c0 20 remove_watcher() i=5 2024-09-12T00:43:13.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.968+0000 7f9c72b1b9c0 20 remove_watcher() i=6 2024-09-12T00:43:13.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:13.972+0000 7f9c72b1b9c0 20 remove_watcher() i=7 2024-09-12T00:43:13.986 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:43:14.017 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:14.018 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:14.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.060+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 realm 2024-09-12T00:43:14.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:14.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:14.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.064+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.068+0000 7efeee8a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:14.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.068+0000 7efeee8a19c0 20 searching for the correct realm 2024-09-12T00:43:14.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.072+0000 7efeebba6640 0 -- 172.21.15.137:0/542963314 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7efed4036060 msgr2=0x7efed4062d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:14.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.076+0000 7efeec3a7640 0 -- 172.21.15.137:0/542963314 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7efee4022930 msgr2=0x7efee402f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:14.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:14.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:14.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:14.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:14.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:14.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:14.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.084+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:14.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:14.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 zone default found 2024-09-12T00:43:14.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 4 Realm: () 2024-09-12T00:43:14.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:14.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:14.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:14.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 zonegroup default 2024-09-12T00:43:14.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 started sync module instance, tier type = 2024-09-12T00:43:14.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.088+0000 7efeee8a19c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:14.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 20 add_watcher() i=0 2024-09-12T00:43:14.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 20 add_watcher() i=1 2024-09-12T00:43:14.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 20 add_watcher() i=2 2024-09-12T00:43:14.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 20 add_watcher() i=3 2024-09-12T00:43:14.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 20 add_watcher() i=4 2024-09-12T00:43:14.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 20 add_watcher() i=5 2024-09-12T00:43:14.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 20 add_watcher() i=6 2024-09-12T00:43:14.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 20 add_watcher() i=7 2024-09-12T00:43:14.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.108+0000 7efeee8a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:14.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efda2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:14.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:14.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:14.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 5 note: GC not initialized 2024-09-12T00:43:14.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efda1fdb640 20 reqs_thread_entry: start 2024-09-12T00:43:14.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:14.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 Filter name: none 2024-09-12T00:43:14.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efd137fe640 20 reqs_thread_entry: start 2024-09-12T00:43:14.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:14.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:14.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:14.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.112+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.116+0000 7efeee8a19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:14.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.116+0000 7efeee8a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.116+0000 7efeee8a19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:14.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.116+0000 7efeee8a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:14.116 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.116+0000 7efda2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:14.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.120+0000 7efeee8a19c0 20 remove_watcher() i=0 2024-09-12T00:43:14.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.120+0000 7efeee8a19c0 2 removed watcher, disabling cache 2024-09-12T00:43:14.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.124+0000 7efeee8a19c0 20 remove_watcher() i=1 2024-09-12T00:43:14.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.124+0000 7efeee8a19c0 20 remove_watcher() i=2 2024-09-12T00:43:14.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.128+0000 7efeee8a19c0 20 remove_watcher() i=3 2024-09-12T00:43:14.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.128+0000 7efeee8a19c0 20 remove_watcher() i=4 2024-09-12T00:43:14.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.132+0000 7efeee8a19c0 20 remove_watcher() i=5 2024-09-12T00:43:14.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.136+0000 7efeee8a19c0 20 remove_watcher() i=6 2024-09-12T00:43:14.136 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.136+0000 7efeee8a19c0 20 remove_watcher() i=7 2024-09-12T00:43:14.149 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:14.150 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:14.150 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-logrecord-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:43:14.150 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:14.151 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.151 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.154 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.155 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.219 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.219 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.242 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:43:14.242 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:14.243 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.243 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.257 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.257 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.305 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.305 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.326 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.326 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.347 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.347 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.372 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.372 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.394 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.394 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.414 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.414 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.435 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.435 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.455 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.455 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.476 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.476 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.498 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.498 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.519 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.519 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.540 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.540 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.563 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.563 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.583 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.583 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.605 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.605 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.625 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.625 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.646 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.646 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.668 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.668 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.691 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.692 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.713 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:14.713 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:14.731 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:43:14.762 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:14.763 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:14.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.808+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.808+0000 7fe0e49da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.808+0000 7fe0e49da9c0 20 realm 2024-09-12T00:43:14.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.808+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.812+0000 7fe0e49da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.812+0000 7fe0e49da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:14.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.812+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.812+0000 7fe0e49da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.812+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.816+0000 7fe0e49da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:14.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.816+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.816+0000 7fe0e49da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:14.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.816+0000 7fe0e49da9c0 20 searching for the correct realm 2024-09-12T00:43:14.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.820+0000 7fe0e2ce1640 0 -- 172.21.15.137:0/3966257757 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fe0d80e6040 msgr2=0x7fe0d80e7940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:14.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.828+0000 7fe0e24e0640 0 -- 172.21.15.137:0/3966257757 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fe0dc03a040 msgr2=0x7fe0dc02a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:14.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:14.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:14.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:14.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:14.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:14.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:14.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 zone default found 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 4 Realm: () 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:14.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:14.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:14.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 zonegroup default 2024-09-12T00:43:14.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 started sync module instance, tier type = 2024-09-12T00:43:14.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.836+0000 7fe0e49da9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:14.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.856+0000 7fe0e49da9c0 20 add_watcher() i=0 2024-09-12T00:43:14.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.856+0000 7fe0e49da9c0 20 add_watcher() i=1 2024-09-12T00:43:14.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.856+0000 7fe0e49da9c0 20 add_watcher() i=2 2024-09-12T00:43:14.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.856+0000 7fe0e49da9c0 20 add_watcher() i=3 2024-09-12T00:43:14.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.856+0000 7fe0e49da9c0 20 add_watcher() i=4 2024-09-12T00:43:14.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.856+0000 7fe0e49da9c0 20 add_watcher() i=5 2024-09-12T00:43:14.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.856+0000 7fe0e49da9c0 20 add_watcher() i=6 2024-09-12T00:43:14.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.860+0000 7fe0e49da9c0 20 add_watcher() i=7 2024-09-12T00:43:14.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.860+0000 7fe0e49da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:14.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.860+0000 7fdf98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:14.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.860+0000 7fe0e49da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:14.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.860+0000 7fe0e49da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:14.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.860+0000 7fe0e49da9c0 5 note: GC not initialized 2024-09-12T00:43:14.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fdf137fe640 20 reqs_thread_entry: start 2024-09-12T00:43:14.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:14.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 Filter name: none 2024-09-12T00:43:14.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fdf117fa640 20 reqs_thread_entry: start 2024-09-12T00:43:14.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:14.863 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:14.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:14.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:14.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.864+0000 7fe0e49da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.868+0000 7fe0e49da9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:14.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.868+0000 7fe0e49da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:14.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.868+0000 7fdf98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:14.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.872+0000 7fe0e49da9c0 20 remove_watcher() i=0 2024-09-12T00:43:14.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.872+0000 7fe0e49da9c0 2 removed watcher, disabling cache 2024-09-12T00:43:14.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.876+0000 7fe0e49da9c0 20 remove_watcher() i=1 2024-09-12T00:43:14.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.876+0000 7fe0e49da9c0 20 remove_watcher() i=2 2024-09-12T00:43:14.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.880+0000 7fe0e49da9c0 20 remove_watcher() i=3 2024-09-12T00:43:14.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.880+0000 7fe0e49da9c0 20 remove_watcher() i=4 2024-09-12T00:43:14.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.884+0000 7fe0e49da9c0 20 remove_watcher() i=5 2024-09-12T00:43:14.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.884+0000 7fe0e49da9c0 20 remove_watcher() i=6 2024-09-12T00:43:14.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.888+0000 7fe0e49da9c0 20 remove_watcher() i=7 2024-09-12T00:43:14.901 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:14.901 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:14.901 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-logrecord-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:14.901 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:14.901 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:43:14.933 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:14.934 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:14.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.976+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 realm 2024-09-12T00:43:14.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:14.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:14.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:14.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 searching for the correct realm 2024-09-12T00:43:14.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.988+0000 7f503db51640 0 -- 172.21.15.137:0/876913333 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f5034024040 msgr2=0x7f5034035970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:14.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:14.992+0000 7f503d350640 0 -- 172.21.15.137:0/876913333 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f503806d8c0 msgr2=0x7f503807b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:15.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:15.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.002 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 zone default found 2024-09-12T00:43:15.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 Realm: () 2024-09-12T00:43:15.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:15.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:15.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 zonegroup default 2024-09-12T00:43:15.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:15.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=0 2024-09-12T00:43:15.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=1 2024-09-12T00:43:15.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=2 2024-09-12T00:43:15.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=3 2024-09-12T00:43:15.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=4 2024-09-12T00:43:15.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=5 2024-09-12T00:43:15.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=6 2024-09-12T00:43:15.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=7 2024-09-12T00:43:15.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.024+0000 7f503f84a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:15.028 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f4ef37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:15.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:15.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 note: GC not initialized 2024-09-12T00:43:15.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f4ef27e4640 20 reqs_thread_entry: start 2024-09-12T00:43:15.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:15.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 Filter name: none 2024-09-12T00:43:15.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f4e63fff640 20 reqs_thread_entry: start 2024-09-12T00:43:15.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f503f84a9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:43:15.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:15.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 : miss 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 2024-09-12T00:43:15.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.039 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36, ofs0, ns] 2024-09-12T00:43:15.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94402413018208 notifier 7689 bl.length()=923 2024-09-12T00:43:15.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.040 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_sources= new_sources= 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential sources added=[] removed=[] 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_dests= new_dests= 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential dests added=[] removed=[] 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f503f84a9c0 time 2024-09-12T00:43:15.046471+0000 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:15.043 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:15.043 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f50431242eb] 2024-09-12T00:43:15.043 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f504312449f] 2024-09-12T00:43:15.044 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbc4031cc1] 2024-09-12T00:43:15.044 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422aac) [0x55dbc4a8faac] 2024-09-12T00:43:15.044 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbc4046ced] 2024-09-12T00:43:15.044 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:43:15.044 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5041f8ad90] 2024-09-12T00:43:15.045 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:43:15.045 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:43:15.045 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:43:15.045 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f503f84a9c0 thread_name:radosgw-admin 2024-09-12T00:43:15.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.044+0000 7f503f84a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f503f84a9c0 time 2024-09-12T00:43:15.046471+0000 2024-09-12T00:43:15.046 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:15.046 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.046 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:15.046 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f50431242eb] 2024-09-12T00:43:15.046 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f504312449f] 2024-09-12T00:43:15.046 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbc4031cc1] 2024-09-12T00:43:15.047 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422aac) [0x55dbc4a8faac] 2024-09-12T00:43:15.047 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbc4046ced] 2024-09-12T00:43:15.047 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:43:15.047 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5041f8ad90] 2024-09-12T00:43:15.047 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:43:15.048 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:43:15.048 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.073 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:15.073 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5041fa3520] 2024-09-12T00:43:15.073 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:43:15.073 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:43:15.073 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:43:15.073 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5043124345] 2024-09-12T00:43:15.073 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f504312449f] 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbc4031cc1] 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422aac) [0x55dbc4a8faac] 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbc4046ced] 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5041f8ad90] 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.044+0000 7f503f84a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f503f84a9c0 thread_name:radosgw-admin 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5041fa3520] 2024-09-12T00:43:15.074 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5043124345] 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f504312449f] 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbc4031cc1] 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422aac) [0x55dbc4a8faac] 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbc4046ced] 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5041f8ad90] 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:15.075 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:43:14.956+0000 7f503cb4f640 1 monclient: found mon.noname-a 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: dump: 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.076 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: dump: 2024-09-12T00:43:15.077 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7677 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 4 set_mon_vals no callback set 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: shutdown 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) unregister_commands rotate-key 2024-09-12T00:43:15.080 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:15.080 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:15.080 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: monmap: 2024-09-12T00:43:15.080 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:15.080 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:15.081 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:15.081 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:15.081 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:15.081 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.081 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:15.081 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:15.081 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding auth protocol: cephx 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding auth protocol: cephx 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding auth protocol: cephx 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 librados: starting msgr at 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 librados: starting objecter 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command objecter_requests hook 0x55dbc63a4a10 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 librados: setting wanted keys 2024-09-12T00:43:15.084 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 librados: calling monclient init 2024-09-12T00:43:15.084 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: init 2024-09-12T00:43:15.084 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding auth protocol: cephx 2024-09-12T00:43:15.084 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding auth protocol: cephx 2024-09-12T00:43:15.084 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding auth protocol: cephx 2024-09-12T00:43:15.084 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.085 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.085 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.085 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.085 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.085 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.085 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.086 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.086 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.086 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.086 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.086 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.086 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.086 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command rotate-key hook 0x55dbc63bcf38 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-b con 0x55dbc626d410 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-c con 0x55dbc6302e30 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-a con 0x55dbc6309120 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:15.088 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.088 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.088 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.088 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:15.088 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): authenticate will time out at 2296.091721s 2024-09-12T00:43:15.088 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): get_auth_request con 0x55dbc6302e30 auth_method 0 2024-09-12T00:43:15.089 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.089 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.089 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.089 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): get_auth_request con 0x55dbc6309120 auth_method 0 2024-09-12T00:43:15.089 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.089 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.089 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:43:14.960+0000 7f503db51640 10 monclient(hunting): handle_auth_done global_id 7680 payload 824 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:43:14.960+0000 7f503db51640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:43:14.960+0000 7f503db51640 1 monclient: found mon.noname-a 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:43:14.960+0000 7f503db51640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:15.092 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: dump: 2024-09-12T00:43:15.092 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.092 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.092 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.093 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.093 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.093 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.093 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: dump: 2024-09-12T00:43:15.094 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:43:14.960+0000 7f4f2b606640 4 set_mon_vals no callback set 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7680 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.095 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 1 librados: init done 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:43:14.960+0000 7f4f29e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:43:14.960+0000 7f4f29e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:43:14.960+0000 7f4f29e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:43:14.960+0000 7f503d350640 10 monclient: get_auth_request con 0x7f4f24070b10 auth_method 0 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:43:14.960+0000 7f503cb4f640 10 monclient: get_auth_request con 0x55dbc63e7470 auth_method 0 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:43:14.964+0000 7f503d350640 10 monclient: get_auth_request con 0x55dbc6408080 auth_method 0 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:43:14.964+0000 7f503cb4f640 10 monclient: get_auth_request con 0x55dbc640d110 auth_method 0 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: monmap: 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding auth protocol: cephx 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding auth protocol: cephx 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding auth protocol: cephx 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command objecter_requests cmddesc objecter_requests hook 0x55dbc6414910 EEXIST 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: init 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding auth protocol: cephx 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding auth protocol: cephx 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding auth protocol: cephx 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command rotate-key cmddesc rotate-key hook 0x55dbc6410030 EEXIST 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-a con 0x55dbc6438ac0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-c con 0x55dbc64383f0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-b con 0x55dbc6436dd0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): authenticate will time out at 2296.101659s 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): get_auth_request con 0x55dbc6438ac0 auth_method 0 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): get_auth_request con 0x55dbc64383f0 auth_method 0 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:43:14.968+0000 7f503db51640 10 monclient(hunting): get_auth_request con 0x55dbc6436dd0 auth_method 0 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:43:14.968+0000 7f503db51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:43:14.968+0000 7f503db51640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:43:14.968+0000 7f503db51640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): handle_auth_done global_id 7683 payload 824 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:43:14.968+0000 7f503d350640 1 monclient: found mon.noname-a 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: dump: 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: dump: 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7683 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:43:14.968+0000 7f503e352640 4 set_mon_vals no callback set 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.105 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:43:14.972+0000 7f4f22ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:43:14.972+0000 7f4f22ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:43:14.972+0000 7f4f22ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:43:14.972+0000 7f503cb4f640 10 monclient: get_auth_request con 0x7f4f18070a20 auth_method 0 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: get_monmap_and_config 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: monmap: 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.106 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding auth protocol: cephx 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding auth protocol: cephx 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding auth protocol: cephx 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: init 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding auth protocol: cephx 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding auth protocol: cephx 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding auth protocol: cephx 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command rotate-key cmddesc rotate-key hook 0x7fffec009c18 EEXIST 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-a con 0x55dbc6486a20 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-b con 0x55dbc6486e00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-c con 0x55dbc64882c0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): authenticate will time out at 2296.105856s 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): get_auth_request con 0x55dbc64882c0 auth_method 0 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.110 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): get_auth_request con 0x55dbc6486a20 auth_method 0 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): handle_auth_done global_id 7310 payload 274 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:43:14.972+0000 7f503db51640 1 monclient: found mon.noname-c 2024-09-12T00:43:15.111 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: dump: 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.112 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: dump: 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.113 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7310 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 4 set_mon_vals no callback set 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: shutdown 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: monmap: 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding auth protocol: cephx 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding auth protocol: cephx 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding auth protocol: cephx 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.115 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 librados: starting msgr at 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 librados: starting objecter 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command objecter_requests cmddesc objecter_requests hook 0x55dbc645e520 EEXIST 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 librados: setting wanted keys 2024-09-12T00:43:15.116 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 librados: calling monclient init 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: init 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding auth protocol: cephx 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding auth protocol: cephx 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding auth protocol: cephx 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.117 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command rotate-key cmddesc rotate-key hook 0x55dbc643aa28 EEXIST 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-b con 0x55dbc6486a20 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-c con 0x55dbc64882c0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-a con 0x55dbc64838e0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): authenticate will time out at 2296.108405s 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): get_auth_request con 0x55dbc64882c0 auth_method 0 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): get_auth_request con 0x55dbc64838e0 auth_method 0 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.119 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient(hunting): get_auth_request con 0x55dbc6486a20 auth_method 0 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): handle_auth_done global_id 7689 payload 824 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:43:14.976+0000 7f503db51640 1 monclient: found mon.noname-a 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:15.120 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: dump: 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.121 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7689 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: dump: 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.122 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:43:14.976+0000 7f4f20ff9640 4 set_mon_vals no callback set 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 1 librados: init done 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cr dump hook 0x55dbc647d148 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:43:14.976+0000 7f4f0effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:43:14.976+0000 7f4f0effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:43:14.976+0000 7f4f0effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient: get_auth_request con 0x7f4f08070ae0 auth_method 0 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:43:14.980+0000 7f503cb4f640 10 monclient: get_auth_request con 0x55dbc64a6890 auth_method 0 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 realm 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:43:14.980+0000 7f503d350640 10 monclient: get_auth_request con 0x55dbc64aac00 auth_method 0 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 searching for the correct realm 2024-09-12T00:43:15.124 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:43:14.984+0000 7f503cb4f640 10 monclient: get_auth_request con 0x55dbc64af610 auth_method 0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:43:14.984+0000 7f503db51640 10 monclient: get_auth_request con 0x7f5034024040 auth_method 0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:43:14.984+0000 7f503d350640 10 monclient: get_auth_request con 0x7f50300b6070 auth_method 0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:43:14.988+0000 7f503cb4f640 10 monclient: get_auth_request con 0x7f5034015070 auth_method 0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:43:14.988+0000 7f503db51640 0 -- 172.21.15.137:0/876913333 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f5034024040 msgr2=0x7f5034035970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:43:14.988+0000 7f4f0effd640 1 client.7689.objecter ms_handle_reset 0x7f5034024040 session 0x7f503403c040 osd.2 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:43:14.988+0000 7f4f0effd640 10 monclient: _renew_subs 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:43:14.988+0000 7f4f0effd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:43:14.988+0000 7f503db51640 10 monclient: get_auth_request con 0x7f4f08080e10 auth_method 0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:43:14.992+0000 7f503db51640 10 monclient: get_auth_request con 0x7f5030107030 auth_method 0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:43:14.992+0000 7f503d350640 10 monclient: get_auth_request con 0x7f503806d8c0 auth_method 0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:43:14.992+0000 7f503d350640 0 -- 172.21.15.137:0/876913333 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f503806d8c0 msgr2=0x7f503807b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:43:14.992+0000 7f4f0effd640 1 client.7689.objecter ms_handle_reset 0x7f503806d8c0 session 0x7f503807c250 osd.3 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:43:14.992+0000 7f503d350640 10 monclient: get_auth_request con 0x7f5034024040 auth_method 0 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 zone default found 2024-09-12T00:43:15.126 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 Realm: () 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 zonegroup default 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=0 2024-09-12T00:43:15.127 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=1 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=2 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=3 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=4 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=5 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=6 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=7 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding auth protocol: cephx 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding auth protocol: cephx 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding auth protocol: cephx 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:43:15.028+0000 7f4ef37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:15.129 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cache list hook 0x55dbc6484d60 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cache inspect hook 0x55dbc6484d60 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cache erase hook 0x55dbc6484d60 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cache zap hook 0x55dbc6484d60 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 note: GC not initialized 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:43:15.028+0000 7f4ef27e4640 20 reqs_thread_entry: start 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command sync trace show hook 0x7f5038001f20 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command sync trace history hook 0x7f5038001f20 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command sync trace active hook 0x7f5038001f20 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command sync trace active_short hook 0x7f5038001f20 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 Filter name: none 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:43:15.028+0000 7f4e63fff640 20 reqs_thread_entry: start 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 : miss 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.131 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36, ofs0, ns] 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94402413018208 notifier 7689 bl.length()=923 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_sources= new_sources= 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential sources added=[] removed=[] 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_dests= new_dests= 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential dests added=[] removed=[] 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:43:15.044+0000 7f503f84a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f503f84a9c0 time 2024-09-12T00:43:15.046471+0000 2024-09-12T00:43:15.132 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f50431242eb] 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f504312449f] 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbc4031cc1] 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422aac) [0x55dbc4a8faac] 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbc4046ced] 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5041f8ad90] 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:43:15.044+0000 7f503f84a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f503f84a9c0 thread_name:radosgw-admin 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5041fa3520] 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5043124345] 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f504312449f] 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbc4031cc1] 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422aac) [0x55dbc4a8faac] 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbc4046ced] 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5041f8ad90] 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:43:15.135 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:43:15.138 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:43:15.139 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:43:15.140 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:43:15.141 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:43:15.142 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4e63fff640 / http_manager 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4ef27e4640 / http_manager 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4ef37e6640 / rgw_dt_lg_renew 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f0effd640 / ms_dispatch 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f20ff9640 / io_context_pool 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f22ffd640 / ms_dispatch 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f29e03640 / ms_dispatch 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f2b606640 / io_context_pool 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503cb4f640 / msgr-worker-2 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503d350640 / msgr-worker-1 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503db51640 / msgr-worker-0 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503e352640 / io_context_pool 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503f84a9c0 / radosgw-admin 2024-09-12T00:43:15.143 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.127253.log 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:43:14.956+0000 7f503cb4f640 1 monclient: found mon.noname-a 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: dump: 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.144 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:15.145 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:43:14.956+0000 7f4f2b606640 10 monclient: dump: 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7677 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:15.146 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 4 set_mon_vals no callback set 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: shutdown 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) unregister_commands rotate-key 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: monmap: 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:15.147 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding auth protocol: cephx 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding auth protocol: cephx 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding auth protocol: cephx 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.148 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: crc 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63f6930) adding con mode: secure 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 librados: starting msgr at 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 librados: starting objecter 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command objecter_requests hook 0x55dbc63a4a10 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 librados: setting wanted keys 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 1 librados: calling monclient init 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: init 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding auth protocol: cephx 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding auth protocol: cephx 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding auth protocol: cephx 2024-09-12T00:43:15.149 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: crc 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc63bcdf0) adding con mode: secure 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.150 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command rotate-key hook 0x55dbc63bcf38 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-b con 0x55dbc626d410 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-c con 0x55dbc6302e30 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-a con 0x55dbc6309120 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:43:14.956+0000 7f503f84a9c0 10 monclient(hunting): authenticate will time out at 2296.091721s 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): get_auth_request con 0x55dbc6302e30 auth_method 0 2024-09-12T00:43:15.151 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): get_auth_request con 0x55dbc6309120 auth_method 0 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:43:14.956+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:43:14.956+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:43:14.960+0000 7f503db51640 10 monclient(hunting): handle_auth_done global_id 7680 payload 824 2024-09-12T00:43:15.152 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:43:14.960+0000 7f503db51640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:43:14.960+0000 7f503db51640 1 monclient: found mon.noname-a 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:43:14.960+0000 7f503db51640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: dump: 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.153 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:43:14.960+0000 7f4f29e03640 10 monclient: dump: 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.154 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:43:14.960+0000 7f4f2b606640 4 set_mon_vals no callback set 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7680 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:43:14.960+0000 7f503f84a9c0 1 librados: init done 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:43:14.960+0000 7f4f29e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:43:14.960+0000 7f4f29e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:43:14.960+0000 7f4f29e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:43:14.960+0000 7f503d350640 10 monclient: get_auth_request con 0x7f4f24070b10 auth_method 0 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:43:14.960+0000 7f503cb4f640 10 monclient: get_auth_request con 0x55dbc63e7470 auth_method 0 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:43:14.964+0000 7f503d350640 10 monclient: get_auth_request con 0x55dbc6408080 auth_method 0 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:43:14.964+0000 7f503cb4f640 10 monclient: get_auth_request con 0x55dbc640d110 auth_method 0 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: monmap: 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:15.156 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding auth protocol: cephx 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding auth protocol: cephx 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding auth protocol: cephx 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.157 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: crc 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6410ee0) adding con mode: secure 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command objecter_requests cmddesc objecter_requests hook 0x55dbc6414910 EEXIST 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: init 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding auth protocol: cephx 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding auth protocol: cephx 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding auth protocol: cephx 2024-09-12T00:43:15.158 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: crc 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc640fee8) adding con mode: secure 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.159 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command rotate-key cmddesc rotate-key hook 0x55dbc6410030 EEXIST 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-a con 0x55dbc6438ac0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-c con 0x55dbc64383f0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-b con 0x55dbc6436dd0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient(hunting): authenticate will time out at 2296.101659s 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): get_auth_request con 0x55dbc6438ac0 auth_method 0 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.160 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): get_auth_request con 0x55dbc64383f0 auth_method 0 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:43:14.968+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:43:14.968+0000 7f503db51640 10 monclient(hunting): get_auth_request con 0x55dbc6436dd0 auth_method 0 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:43:14.968+0000 7f503db51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.161 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:43:14.968+0000 7f503db51640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:43:14.968+0000 7f503db51640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient(hunting): handle_auth_done global_id 7683 payload 824 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:43:14.968+0000 7f503d350640 1 monclient: found mon.noname-a 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:43:14.968+0000 7f503d350640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: dump: 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.162 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:43:14.968+0000 7f4f22ffd640 10 monclient: dump: 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.163 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7683 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:43:14.968+0000 7f503e352640 4 set_mon_vals no callback set 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.164 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:43:14.968+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:43:14.972+0000 7f4f22ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:43:14.972+0000 7f4f22ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:43:14.972+0000 7f4f22ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:43:14.972+0000 7f503cb4f640 10 monclient: get_auth_request con 0x7f4f18070a20 auth_method 0 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: get_monmap_and_config 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: monmap: 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:15.165 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding auth protocol: cephx 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding auth protocol: cephx 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding auth protocol: cephx 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.166 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: crc 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc6458430) adding con mode: secure 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: init 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding auth protocol: cephx 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding auth protocol: cephx 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding auth protocol: cephx 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.167 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: crc 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009ad0) adding con mode: secure 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command rotate-key cmddesc rotate-key hook 0x7fffec009c18 EEXIST 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:15.168 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-a con 0x55dbc6486a20 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-b con 0x55dbc6486e00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-c con 0x55dbc64882c0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient(hunting): authenticate will time out at 2296.105856s 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): get_auth_request con 0x55dbc64882c0 auth_method 0 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.169 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): get_auth_request con 0x55dbc6486a20 auth_method 0 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:43:14.972+0000 7f503d350640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient(hunting): handle_auth_done global_id 7310 payload 274 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:43:14.972+0000 7f503db51640 1 monclient: found mon.noname-c 2024-09-12T00:43:15.170 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:43:14.972+0000 7f503db51640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: dump: 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.171 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:43:14.972+0000 7f4f20ff9640 10 monclient: dump: 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.172 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7310 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 4 set_mon_vals no callback set 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: shutdown 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: monmap: 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:15.173 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding auth protocol: cephx 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding auth protocol: cephx 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding auth protocol: cephx 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.174 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: crc 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc647ef50) adding con mode: secure 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 librados: starting msgr at 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 librados: starting objecter 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command objecter_requests cmddesc objecter_requests hook 0x55dbc645e520 EEXIST 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 librados: setting wanted keys 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 1 librados: calling monclient init 2024-09-12T00:43:15.175 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 10 monclient: init 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding auth protocol: cephx 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding auth protocol: cephx 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding auth protocol: cephx 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.176 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: crc 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:43:14.972+0000 7f503f84a9c0 5 AuthRegistry(0x55dbc643a8e0) adding con mode: secure 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command rotate-key cmddesc rotate-key hook 0x55dbc643aa28 EEXIST 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-b con 0x55dbc6486a20 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-c con 0x55dbc64882c0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): picked mon.noname-a con 0x55dbc64838e0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.177 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient(hunting): authenticate will time out at 2296.108405s 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): get_auth_request con 0x55dbc64882c0 auth_method 0 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): get_auth_request con 0x55dbc64838e0 auth_method 0 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.178 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:43:14.976+0000 7f503cb4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient(hunting): get_auth_request con 0x55dbc6486a20 auth_method 0 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient(hunting): handle_auth_done global_id 7689 payload 824 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient: _finish_hunting 0 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:43:14.976+0000 7f503db51640 1 monclient: found mon.noname-a 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:43:14.976+0000 7f503db51640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.179 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: dump: 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: _finish_auth 0 2024-09-12T00:43:15.180 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: _check_auth_tickets 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 5 monclient: authenticate success, global_id 7689 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:43:14.976+0000 7f4f0effd640 10 monclient: dump: 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:15.181 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:43:14.976+0000 7f4f20ff9640 4 set_mon_vals no callback set 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _renew_subs 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 1 librados: init done 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cr dump hook 0x55dbc647d148 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:43:14.976+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:43:14.976+0000 7f4f0effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:43:14.976+0000 7f4f0effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:43:14.976+0000 7f4f0effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:15.182 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:43:14.976+0000 7f503d350640 10 monclient: get_auth_request con 0x7f4f08070ae0 auth_method 0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:43:14.980+0000 7f503cb4f640 10 monclient: get_auth_request con 0x55dbc64a6890 auth_method 0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 realm 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:43:14.980+0000 7f503d350640 10 monclient: get_auth_request con 0x55dbc64aac00 auth_method 0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:43:14.980+0000 7f503f84a9c0 20 searching for the correct realm 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:43:14.984+0000 7f503cb4f640 10 monclient: get_auth_request con 0x55dbc64af610 auth_method 0 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:43:14.984+0000 7f503db51640 10 monclient: get_auth_request con 0x7f5034024040 auth_method 0 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:43:14.984+0000 7f503d350640 10 monclient: get_auth_request con 0x7f50300b6070 auth_method 0 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:43:14.988+0000 7f503cb4f640 10 monclient: get_auth_request con 0x7f5034015070 auth_method 0 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:43:14.988+0000 7f503db51640 0 -- 172.21.15.137:0/876913333 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f5034024040 msgr2=0x7f5034035970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:43:14.988+0000 7f4f0effd640 1 client.7689.objecter ms_handle_reset 0x7f5034024040 session 0x7f503403c040 osd.2 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:43:14.988+0000 7f4f0effd640 10 monclient: _renew_subs 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:43:14.988+0000 7f4f0effd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:43:14.988+0000 7f503db51640 10 monclient: get_auth_request con 0x7f4f08080e10 auth_method 0 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:43:14.992+0000 7f503db51640 10 monclient: get_auth_request con 0x7f5030107030 auth_method 0 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:43:14.992+0000 7f503d350640 10 monclient: get_auth_request con 0x7f503806d8c0 auth_method 0 2024-09-12T00:43:15.184 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:43:14.992+0000 7f503d350640 0 -- 172.21.15.137:0/876913333 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f503806d8c0 msgr2=0x7f503807b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:43:14.992+0000 7f4f0effd640 1 client.7689.objecter ms_handle_reset 0x7f503806d8c0 session 0x7f503807c250 osd.3 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:43:14.992+0000 7f503d350640 10 monclient: get_auth_request con 0x7f5034024040 auth_method 0 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.185 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:43:15.000+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 zone default found 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 Realm: () 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 zonegroup default 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.186 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:43:15.004+0000 7f503f84a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=0 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=1 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=2 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=3 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=4 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=5 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=6 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 20 add_watcher() i=7 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:43:15.024+0000 7f503f84a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding auth protocol: cephx 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding auth protocol: cephx 2024-09-12T00:43:15.187 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding auth protocol: cephx 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: crc 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 AuthRegistry(0x7fffec009fb0) adding con mode: secure 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:43:15.028+0000 7f4ef37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.188 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cache list hook 0x55dbc6484d60 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cache inspect hook 0x55dbc6484d60 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cache erase hook 0x55dbc6484d60 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command cache zap hook 0x55dbc6484d60 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 note: GC not initialized 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:43:15.028+0000 7f4ef27e4640 20 reqs_thread_entry: start 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command sync trace show hook 0x7f5038001f20 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command sync trace history hook 0x7f5038001f20 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command sync trace active hook 0x7f5038001f20 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 5 asok(0x55dbc61b22b0) register_command sync trace active_short hook 0x7f5038001f20 2024-09-12T00:43:15.189 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 Filter name: none 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:43:15.028+0000 7f4e63fff640 20 reqs_thread_entry: start 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:43:15.028+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 : miss 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:15.190 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.191 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:43:15.032+0000 7f503f84a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 2024-09-12T00:43:15.191 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.191 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.191 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.192 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36, ofs0, ns] 2024-09-12T00:43:15.192 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94402413018208 notifier 7689 bl.length()=923 2024-09-12T00:43:15.192 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.192 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:43:15.040+0000 7f4f20ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_sources= new_sources= 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential sources added=[] removed=[] 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_dests= new_dests= 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:43:15.040+0000 7f503f84a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential dests added=[] removed=[] 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:43:15.044+0000 7f503f84a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f503f84a9c0 time 2024-09-12T00:43:15.046471+0000 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f50431242eb] 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f504312449f] 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbc4031cc1] 2024-09-12T00:43:15.193 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422aac) [0x55dbc4a8faac] 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbc4046ced] 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5041f8ad90] 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:43:15.044+0000 7f503f84a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f503f84a9c0 thread_name:radosgw-admin 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5041fa3520] 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:43:15.194 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5043124345] 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f504312449f] 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbc4031cc1] 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422aac) [0x55dbc4a8faac] 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbc4046ced] 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5041f8ad90] 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.195 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:43:15.196 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:43:15.197 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:43:15.198 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:43:15.199 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:43:15.200 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:43:15.201 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4e63fff640 / http_manager 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4ef27e4640 / http_manager 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4ef37e6640 / rgw_dt_lg_renew 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f0effd640 / ms_dispatch 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f20ff9640 / io_context_pool 2024-09-12T00:43:15.202 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f22ffd640 / ms_dispatch 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f29e03640 / ms_dispatch 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: 7f4f2b606640 / io_context_pool 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503cb4f640 / msgr-worker-2 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503d350640 / msgr-worker-1 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503db51640 / msgr-worker-0 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503e352640 / io_context_pool 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: 7f503f84a9c0 / radosgw-admin 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:43:15.048940Z_151bd4ea-1264-440c-9e2a-49a3ddef4353/log 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:43:15.203 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:43:15.208 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:15.208 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:15.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.124+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.124+0000 7f62348a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.124+0000 7f62348a59c0 20 realm 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.124+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.128+0000 7f62348a59c0 20 searching for the correct realm 2024-09-12T00:43:15.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.136+0000 7f6232bac640 0 -- 172.21.15.137:0/976366429 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55bf8f991c30 msgr2=0x55bf8f9940f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.140+0000 7f62323ab640 0 -- 172.21.15.137:0/976366429 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55bf8f995ec0 msgr2=0x55bf8f9982b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 zone default found 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 4 Realm: () 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 zonegroup default 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.148+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.152+0000 7f62348a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.152+0000 7f62348a59c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.152+0000 7f62348a59c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.168+0000 7f62348a59c0 20 add_watcher() i=0 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.168+0000 7f62348a59c0 20 add_watcher() i=1 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.168+0000 7f62348a59c0 20 add_watcher() i=2 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.168+0000 7f62348a59c0 20 add_watcher() i=3 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.168+0000 7f62348a59c0 20 add_watcher() i=4 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.168+0000 7f62348a59c0 20 add_watcher() i=5 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.168+0000 7f62348a59c0 20 add_watcher() i=6 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.172+0000 7f62348a59c0 20 add_watcher() i=7 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.172+0000 7f62348a59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.172+0000 7f60e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 5 note: GC not initialized 2024-09-12T00:43:15.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f60637fe640 20 reqs_thread_entry: start 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 Filter name: none 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f60617fa640 20 reqs_thread_entry: start 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.176+0000 7f62348a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.180+0000 7f62348a59c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.180+0000 7f62348a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:15.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.180+0000 7f60e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.184+0000 7f62348a59c0 20 remove_watcher() i=0 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.184+0000 7f62348a59c0 2 removed watcher, disabling cache 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.184+0000 7f62348a59c0 20 remove_watcher() i=1 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.188+0000 7f62348a59c0 20 remove_watcher() i=2 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.188+0000 7f62348a59c0 20 remove_watcher() i=3 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.192+0000 7f62348a59c0 20 remove_watcher() i=4 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.192+0000 7f62348a59c0 20 remove_watcher() i=5 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.196+0000 7f62348a59c0 20 remove_watcher() i=6 2024-09-12T00:43:15.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.200+0000 7f62348a59c0 20 remove_watcher() i=7 2024-09-12T00:43:15.215 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.215 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:15.215 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-logrecord-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:15.215 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:15.215 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:15.215 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:15.222 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:15.222 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:15.270 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:15.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 realm 2024-09-12T00:43:15.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:15.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.348+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.352+0000 7f19198ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:15.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.352+0000 7f19198ab9c0 20 searching for the correct realm 2024-09-12T00:43:15.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.356+0000 7f1917bb2640 0 -- 172.21.15.137:0/1470875599 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f190c038480 msgr2=0x7f190c0388e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.364+0000 7f19173b1640 0 -- 172.21.15.137:0/1470875599 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f191002a960 msgr2=0x7f19100373f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:15.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:15.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.368+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 zone default found 2024-09-12T00:43:15.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 4 Realm: () 2024-09-12T00:43:15.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:15.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:15.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 zonegroup default 2024-09-12T00:43:15.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.372+0000 7f19198ab9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:15.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 20 add_watcher() i=0 2024-09-12T00:43:15.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 20 add_watcher() i=1 2024-09-12T00:43:15.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 20 add_watcher() i=2 2024-09-12T00:43:15.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 20 add_watcher() i=3 2024-09-12T00:43:15.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 20 add_watcher() i=4 2024-09-12T00:43:15.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 20 add_watcher() i=5 2024-09-12T00:43:15.391 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 20 add_watcher() i=6 2024-09-12T00:43:15.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 20 add_watcher() i=7 2024-09-12T00:43:15.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.392+0000 7f19198ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:15.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.396+0000 7f17cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.396+0000 7f19198ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.396+0000 7f19198ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.396+0000 7f19198ab9c0 5 note: GC not initialized 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.396+0000 7f17ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 20 Filter name: none 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f17467fc640 20 reqs_thread_entry: start 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:43:15.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:15.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:43:15.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:43:15.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 : miss 2024-09-12T00:43:15.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:43:15.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:15.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:15.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:15.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:15.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.400+0000 7f19198ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 2024-09-12T00:43:15.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.404+0000 7f19198ab9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to be held by another RGW process; skipping for now 2024-09-12T00:43:15.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.404+0000 7f17cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.408+0000 7f19198ab9c0 20 remove_watcher() i=0 2024-09-12T00:43:15.406 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.408+0000 7f19198ab9c0 2 removed watcher, disabling cache 2024-09-12T00:43:15.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.408+0000 7f19198ab9c0 20 remove_watcher() i=1 2024-09-12T00:43:15.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.412+0000 7f19198ab9c0 20 remove_watcher() i=2 2024-09-12T00:43:15.412 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.412+0000 7f19198ab9c0 20 remove_watcher() i=3 2024-09-12T00:43:15.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.416+0000 7f19198ab9c0 20 remove_watcher() i=4 2024-09-12T00:43:15.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.416+0000 7f19198ab9c0 20 remove_watcher() i=5 2024-09-12T00:43:15.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.420+0000 7f19198ab9c0 20 remove_watcher() i=6 2024-09-12T00:43:15.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:15.424+0000 7f19198ab9c0 20 remove_watcher() i=7 2024-09-12T00:43:15.436 INFO:tasks.workunit.client.0.smithi137.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:43:45.468 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:43:45.505 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:45.505 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:45.550 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 20 realm 2024-09-12T00:43:45.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:45.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.553 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.551+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.555+0000 7ffa9b0e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:45.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.555+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.555+0000 7ffa9b0e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:45.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.555+0000 7ffa9b0e29c0 20 searching for the correct realm 2024-09-12T00:43:45.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.559+0000 7ffa983e7640 0 -- 172.21.15.137:0/606567089 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7ffa800b6900 msgr2=0x7ffa800cb3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:45.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.567+0000 7ffa993e9640 0 -- 172.21.15.137:0/606567089 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55ef48dfd770 msgr2=0x55ef48dffc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:45.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:45.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:45.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:45.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:45.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:45.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:45.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:45.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:45.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 zone default found 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 4 Realm: () 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 zonegroup default 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.575+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.579+0000 7ffa9b0e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.579+0000 7ffa9b0e29c0 20 started sync module instance, tier type = 2024-09-12T00:43:45.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.579+0000 7ffa9b0e29c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:45.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.595+0000 7ffa9b0e29c0 20 add_watcher() i=0 2024-09-12T00:43:45.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.595+0000 7ffa9b0e29c0 20 add_watcher() i=1 2024-09-12T00:43:45.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.595+0000 7ffa9b0e29c0 20 add_watcher() i=2 2024-09-12T00:43:45.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.595+0000 7ffa9b0e29c0 20 add_watcher() i=3 2024-09-12T00:43:45.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.595+0000 7ffa9b0e29c0 20 add_watcher() i=4 2024-09-12T00:43:45.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.595+0000 7ffa9b0e29c0 20 add_watcher() i=5 2024-09-12T00:43:45.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.595+0000 7ffa9b0e29c0 20 add_watcher() i=6 2024-09-12T00:43:45.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.599+0000 7ffa9b0e29c0 20 add_watcher() i=7 2024-09-12T00:43:45.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.599+0000 7ffa9b0e29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:45.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ff94efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 5 note: GC not initialized 2024-09-12T00:43:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ff94dfe3640 20 reqs_thread_entry: start 2024-09-12T00:43:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 20 Filter name: none 2024-09-12T00:43:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ff8bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:45.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:43:45.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:43:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:43:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 : miss 2024-09-12T00:43:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.603+0000 7ffa9b0e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.607+0000 7ffa9b0e29c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:43:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.607+0000 7ffa9b0e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.607+0000 7ffa9b0e29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.607+0000 7ffa9b0e29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.607+0000 7ffa9b0e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:45.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.607+0000 7ffa9b0e29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 2024-09-12T00:43:45.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.607+0000 7ffa9b0e29c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:43:45.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.615+0000 7ffa9b0e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:45.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.615+0000 7ffa9b0e29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:45.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.615+0000 7ffa9b0e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:45.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.615+0000 7ffa9b0e29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36, ofs0, ns] 2024-09-12T00:43:45.618 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ff96ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94486208183072 notifier 7361 bl.length()=923 2024-09-12T00:43:45.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ff96ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:45.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ff96ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:45.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ff96ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:45.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_sources= new_sources= 2024-09-12T00:43:45.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential sources added=[] removed=[] 2024-09-12T00:43:45.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_dests= new_dests= 2024-09-12T00:43:45.620 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential dests added=[] removed=[] 2024-09-12T00:43:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36.2.0 2024-09-12T00:43:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36.2.0 2024-09-12T00:43:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36.2.1 2024-09-12T00:43:45.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36.2.1 2024-09-12T00:43:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.619+0000 7ffa9b0e29c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36.0 2024-09-12T00:43:45.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.623+0000 7ffa9b0e29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:45.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.623+0000 7ffa9b0e29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 2024-09-12T00:43:45.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ffa9b0e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:45.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ffa9b0e29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:45.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ffa9b0e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:45.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ffa9b0e29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36, ofs0, ns] 2024-09-12T00:43:45.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ff96f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94486208183072 notifier 7361 bl.length()=923 2024-09-12T00:43:45.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ff96f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:45.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ff96f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:45.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ff96f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:45.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.627+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_sources= new_sources= 2024-09-12T00:43:45.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.631+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential sources added=[] removed=[] 2024-09-12T00:43:45.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.631+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_dests= new_dests= 2024-09-12T00:43:45.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.631+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential dests added=[] removed=[] 2024-09-12T00:43:45.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.631+0000 7ffa9b0e29c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36.0 2024-09-12T00:43:45.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.631+0000 7ffa9b0e29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:45.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.631+0000 7ffa9b0e29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 2024-09-12T00:43:45.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:45.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:45.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:45.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36, ofs0, ns] 2024-09-12T00:43:45.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ff96ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94486208183072 notifier 7361 bl.length()=891 2024-09-12T00:43:45.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ff96ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 info.flags=0x17 2024-09-12T00:43:45.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ff96ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 to cache LRU end 2024-09-12T00:43:45.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ff96ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:45.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_sources= new_sources= 2024-09-12T00:43:45.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential sources added=[] removed=[] 2024-09-12T00:43:45.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): orig_dests= new_dests= 2024-09-12T00:43:45.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36]): potential dests added=[] removed=[] 2024-09-12T00:43:45.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.635+0000 7ffa9b0e29c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:43:45.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.639+0000 7ff94efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:45.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.643+0000 7ffa9b0e29c0 20 remove_watcher() i=0 2024-09-12T00:43:45.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.643+0000 7ffa9b0e29c0 2 removed watcher, disabling cache 2024-09-12T00:43:45.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.647+0000 7ffa9b0e29c0 20 remove_watcher() i=1 2024-09-12T00:43:45.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.647+0000 7ffa9b0e29c0 20 remove_watcher() i=2 2024-09-12T00:43:45.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.651+0000 7ffa9b0e29c0 20 remove_watcher() i=3 2024-09-12T00:43:45.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.651+0000 7ffa9b0e29c0 20 remove_watcher() i=4 2024-09-12T00:43:45.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.655+0000 7ffa9b0e29c0 20 remove_watcher() i=5 2024-09-12T00:43:45.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.659+0000 7ffa9b0e29c0 20 remove_watcher() i=6 2024-09-12T00:43:45.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.659+0000 7ffa9b0e29c0 20 remove_watcher() i=7 2024-09-12T00:43:45.675 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:43:45.703 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:45.704 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:45.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.747+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.747+0000 7fd13b1969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.747+0000 7fd13b1969c0 20 realm 2024-09-12T00:43:45.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.747+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:45.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:45.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:45.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.751+0000 7fd13b1969c0 20 searching for the correct realm 2024-09-12T00:43:45.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.759+0000 7fd13949d640 0 -- 172.21.15.137:0/2047664895 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fd12c122bc0 msgr2=0x7fd12c0fb790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:45.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.763+0000 7fd138c9c640 0 -- 172.21.15.137:0/2047664895 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fd130069080 msgr2=0x7fd13005ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:45.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:45.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:45.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:45.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 zone default found 2024-09-12T00:43:45.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 4 Realm: () 2024-09-12T00:43:45.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:45.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:45.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:45.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 zonegroup default 2024-09-12T00:43:45.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.771+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.775+0000 7fd13b1969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.775+0000 7fd13b1969c0 20 started sync module instance, tier type = 2024-09-12T00:43:45.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.775+0000 7fd13b1969c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:45.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.791+0000 7fd13b1969c0 20 add_watcher() i=0 2024-09-12T00:43:45.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.791+0000 7fd13b1969c0 20 add_watcher() i=1 2024-09-12T00:43:45.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.791+0000 7fd13b1969c0 20 add_watcher() i=2 2024-09-12T00:43:45.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.791+0000 7fd13b1969c0 20 add_watcher() i=3 2024-09-12T00:43:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.791+0000 7fd13b1969c0 20 add_watcher() i=4 2024-09-12T00:43:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.791+0000 7fd13b1969c0 20 add_watcher() i=5 2024-09-12T00:43:45.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.791+0000 7fd13b1969c0 20 add_watcher() i=6 2024-09-12T00:43:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.795+0000 7fd13b1969c0 20 add_watcher() i=7 2024-09-12T00:43:45.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.795+0000 7fd13b1969c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:45.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fcfeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 5 note: GC not initialized 2024-09-12T00:43:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fcfedfe3640 20 reqs_thread_entry: start 2024-09-12T00:43:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 Filter name: none 2024-09-12T00:43:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fcf5f7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:45.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:45.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:45.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:45.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:43:45.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.799+0000 7fd13b1969c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.803+0000 7fd13b1969c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:43:45.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.803+0000 7fd13b1969c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:45.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.803+0000 7fcfeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:45.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.807+0000 7fd13b1969c0 20 remove_watcher() i=0 2024-09-12T00:43:45.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.807+0000 7fd13b1969c0 2 removed watcher, disabling cache 2024-09-12T00:43:45.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.807+0000 7fd13b1969c0 20 remove_watcher() i=1 2024-09-12T00:43:45.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.811+0000 7fd13b1969c0 20 remove_watcher() i=2 2024-09-12T00:43:45.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.811+0000 7fd13b1969c0 20 remove_watcher() i=3 2024-09-12T00:43:45.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.815+0000 7fd13b1969c0 20 remove_watcher() i=4 2024-09-12T00:43:45.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.815+0000 7fd13b1969c0 20 remove_watcher() i=5 2024-09-12T00:43:45.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.819+0000 7fd13b1969c0 20 remove_watcher() i=6 2024-09-12T00:43:45.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:45.823+0000 7fd13b1969c0 20 remove_watcher() i=7 2024-09-12T00:43:45.835 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:45.835 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:45.835 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-logrecord-writes id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:43:45.835 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:45.837 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:45.837 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:45.840 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:45.840 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:45.888 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:45.888 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:45.912 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:43:45.912 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:45.913 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:45.914 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:45.928 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:45.928 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:45.973 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:45.974 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:45.993 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:45.993 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.013 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.014 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.034 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.034 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.055 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.055 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.075 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.075 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.095 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.095 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.116 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.116 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.136 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.136 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.156 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.156 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.177 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.177 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.200 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.200 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.219 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.220 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.239 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.239 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.259 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.259 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.279 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.279 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.300 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.300 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.320 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.321 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.340 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.340 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.359 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.359 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.377 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:43:46.408 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:46.409 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:46.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.451+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 realm 2024-09-12T00:43:46.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:46.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:46.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.455+0000 7f572ce229c0 20 searching for the correct realm 2024-09-12T00:43:46.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.463+0000 7f572a127640 0 -- 172.21.15.137:0/2456546777 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f57200e4900 msgr2=0x7f57200ec3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:46.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.467+0000 7f572b129640 0 -- 172.21.15.137:0/2456546777 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5606d0e58500 msgr2=0x5606d0e5a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.477 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.475+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 zone default found 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 4 Realm: () 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 zonegroup default 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 started sync module instance, tier type = 2024-09-12T00:43:46.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.479+0000 7f572ce229c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:46.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 20 add_watcher() i=0 2024-09-12T00:43:46.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 20 add_watcher() i=1 2024-09-12T00:43:46.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 20 add_watcher() i=2 2024-09-12T00:43:46.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 20 add_watcher() i=3 2024-09-12T00:43:46.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 20 add_watcher() i=4 2024-09-12T00:43:46.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 20 add_watcher() i=5 2024-09-12T00:43:46.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 20 add_watcher() i=6 2024-09-12T00:43:46.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 20 add_watcher() i=7 2024-09-12T00:43:46.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.499+0000 7f572ce229c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:46.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f55e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f572ce229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:46.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f572ce229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:46.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f572ce229c0 5 note: GC not initialized 2024-09-12T00:43:46.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f555bfff640 20 reqs_thread_entry: start 2024-09-12T00:43:46.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f572ce229c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:46.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f572ce229c0 20 Filter name: none 2024-09-12T00:43:46.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f5559ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:46.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.503+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:46.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:46.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:46.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:46.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:46.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f572ce229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:46.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.507+0000 7f55e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.515+0000 7f572ce229c0 20 remove_watcher() i=0 2024-09-12T00:43:46.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.515+0000 7f572ce229c0 2 removed watcher, disabling cache 2024-09-12T00:43:46.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.515+0000 7f572ce229c0 20 remove_watcher() i=1 2024-09-12T00:43:46.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.515+0000 7f572ce229c0 20 remove_watcher() i=2 2024-09-12T00:43:46.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.519+0000 7f572ce229c0 20 remove_watcher() i=3 2024-09-12T00:43:46.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.519+0000 7f572ce229c0 20 remove_watcher() i=4 2024-09-12T00:43:46.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.523+0000 7f572ce229c0 20 remove_watcher() i=5 2024-09-12T00:43:46.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.527+0000 7f572ce229c0 20 remove_watcher() i=6 2024-09-12T00:43:46.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.527+0000 7f572ce229c0 20 remove_watcher() i=7 2024-09-12T00:43:46.543 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:46.543 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:46.543 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-change-reshard-state id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:46.543 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:46.544 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:43:46.577 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:46.577 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:46.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.619+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 realm 2024-09-12T00:43:46.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:46.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.623+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.627+0000 7f580c4909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:46.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.627+0000 7f580c4909c0 20 searching for the correct realm 2024-09-12T00:43:46.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.631+0000 7f580a797640 0 -- 172.21.15.137:0/950356609 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f58000d2040 msgr2=0x7f58000d2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:46.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.635+0000 7f5809f96640 0 -- 172.21.15.137:0/950356609 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f580408be20 msgr2=0x7f580408a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:46.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.643+0000 7f580c4909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:46.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.643+0000 7f580c4909c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:46.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.643+0000 7f580c4909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:46.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.643+0000 7f580c4909c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:46.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.643+0000 7f580c4909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:46.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.643+0000 7f580c4909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:46.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.643+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:46.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 zone default found 2024-09-12T00:43:46.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 4 Realm: () 2024-09-12T00:43:46.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:46.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:46.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:46.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 zonegroup default 2024-09-12T00:43:46.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 started sync module instance, tier type = 2024-09-12T00:43:46.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.647+0000 7f580c4909c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:46.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 20 add_watcher() i=0 2024-09-12T00:43:46.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 20 add_watcher() i=1 2024-09-12T00:43:46.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 20 add_watcher() i=2 2024-09-12T00:43:46.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 20 add_watcher() i=3 2024-09-12T00:43:46.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 20 add_watcher() i=4 2024-09-12T00:43:46.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 20 add_watcher() i=5 2024-09-12T00:43:46.667 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 20 add_watcher() i=6 2024-09-12T00:43:46.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 20 add_watcher() i=7 2024-09-12T00:43:46.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.667+0000 7f580c4909c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:46.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f56bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 5 note: GC not initialized 2024-09-12T00:43:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f56ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 20 Filter name: none 2024-09-12T00:43:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f562bfff640 20 reqs_thread_entry: start 2024-09-12T00:43:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:43:46.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 : miss 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.671+0000 7f580c4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.675+0000 7f580c4909c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.675+0000 7f580c4909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.675+0000 7f580c4909c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:46.674 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.675+0000 7f580c4909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:46.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.675+0000 7f580c4909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:46.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.675+0000 7f580c4909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 2024-09-12T00:43:46.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f580c4909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:46.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f580c4909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:46.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f580c4909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:46.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f580c4909c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37, ofs0, ns] 2024-09-12T00:43:46.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f56ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94304065573888 notifier 7409 bl.length()=931 2024-09-12T00:43:46.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f56ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:46.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f56ed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:46.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f56ed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:46.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f580c4909c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_sources= new_sources= 2024-09-12T00:43:46.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f580c4909c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential sources added=[] removed=[] 2024-09-12T00:43:46.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f580c4909c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_dests= new_dests= 2024-09-12T00:43:46.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.679+0000 7f580c4909c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential dests added=[] removed=[] 2024-09-12T00:43:46.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.687+0000 7f580c4909c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.1.0 2024-09-12T00:43:46.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.687+0000 7f580c4909c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.1.0 2024-09-12T00:43:46.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.687+0000 7f580c4909c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.1.1 2024-09-12T00:43:46.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.687+0000 7f580c4909c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.1.1 2024-09-12T00:43:46.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.687+0000 7f580c4909c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.0 2024-09-12T00:43:46.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.691+0000 7f580c4909c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:43:46.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.691+0000 7f580c4909c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:43:46.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.699+0000 7f580c4909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:46.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.699+0000 7f580c4909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 2024-09-12T00:43:46.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37, ofs0, ns] 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f56ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94304065573888 notifier 7409 bl.length()=899 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f56ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f56ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f56ecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_sources= new_sources= 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential sources added=[] removed=[] 2024-09-12T00:43:46.705 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_dests= new_dests= 2024-09-12T00:43:46.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential dests added=[] removed=[] 2024-09-12T00:43:46.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.703+0000 7f580c4909c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:43:46.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.707+0000 7f56bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.711+0000 7f580c4909c0 20 remove_watcher() i=0 2024-09-12T00:43:46.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.711+0000 7f580c4909c0 2 removed watcher, disabling cache 2024-09-12T00:43:46.712 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.711+0000 7f580c4909c0 20 remove_watcher() i=1 2024-09-12T00:43:46.714 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.715+0000 7f580c4909c0 20 remove_watcher() i=2 2024-09-12T00:43:46.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.715+0000 7f580c4909c0 20 remove_watcher() i=3 2024-09-12T00:43:46.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.719+0000 7f580c4909c0 20 remove_watcher() i=4 2024-09-12T00:43:46.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.719+0000 7f580c4909c0 20 remove_watcher() i=5 2024-09-12T00:43:46.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.723+0000 7f580c4909c0 20 remove_watcher() i=6 2024-09-12T00:43:46.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.723+0000 7f580c4909c0 20 remove_watcher() i=7 2024-09-12T00:43:46.739 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:43:46.765 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:46.765 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:46.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.807+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 realm 2024-09-12T00:43:46.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.810 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:46.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:46.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.811+0000 7fe64e2e09c0 20 searching for the correct realm 2024-09-12T00:43:46.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.819+0000 7fe64c5e7640 0 -- 172.21.15.137:0/1853326160 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fe6400d1420 msgr2=0x7fe6400d1880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:46.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.823+0000 7fe64bde6640 0 -- 172.21.15.137:0/1853326160 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fe644078040 msgr2=0x7fe644060800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:46.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:46.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:46.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:46.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:46.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:46.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:46.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 zone default found 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 4 Realm: () 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 zonegroup default 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.831+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.835+0000 7fe64e2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.835+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.835+0000 7fe64e2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.835+0000 7fe64e2e09c0 20 started sync module instance, tier type = 2024-09-12T00:43:46.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.835+0000 7fe64e2e09c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:46.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.851+0000 7fe64e2e09c0 20 add_watcher() i=0 2024-09-12T00:43:46.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.851+0000 7fe64e2e09c0 20 add_watcher() i=1 2024-09-12T00:43:46.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.851+0000 7fe64e2e09c0 20 add_watcher() i=2 2024-09-12T00:43:46.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.851+0000 7fe64e2e09c0 20 add_watcher() i=3 2024-09-12T00:43:46.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.851+0000 7fe64e2e09c0 20 add_watcher() i=4 2024-09-12T00:43:46.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.851+0000 7fe64e2e09c0 20 add_watcher() i=5 2024-09-12T00:43:46.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.851+0000 7fe64e2e09c0 20 add_watcher() i=6 2024-09-12T00:43:46.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.855+0000 7fe64e2e09c0 20 add_watcher() i=7 2024-09-12T00:43:46.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.855+0000 7fe64e2e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:46.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe501fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:46.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:46.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 5 note: GC not initialized 2024-09-12T00:43:46.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe500fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:46.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:46.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 Filter name: none 2024-09-12T00:43:46.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe47a7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:46.859 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:46.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:46.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:46.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:46.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:46.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.859+0000 7fe64e2e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:46.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.863+0000 7fe501fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.867+0000 7fe64e2e09c0 20 remove_watcher() i=0 2024-09-12T00:43:46.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.867+0000 7fe64e2e09c0 2 removed watcher, disabling cache 2024-09-12T00:43:46.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.867+0000 7fe64e2e09c0 20 remove_watcher() i=1 2024-09-12T00:43:46.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.871+0000 7fe64e2e09c0 20 remove_watcher() i=2 2024-09-12T00:43:46.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.871+0000 7fe64e2e09c0 20 remove_watcher() i=3 2024-09-12T00:43:46.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.875+0000 7fe64e2e09c0 20 remove_watcher() i=4 2024-09-12T00:43:46.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.875+0000 7fe64e2e09c0 20 remove_watcher() i=5 2024-09-12T00:43:46.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.879+0000 7fe64e2e09c0 20 remove_watcher() i=6 2024-09-12T00:43:46.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:46.883+0000 7fe64e2e09c0 20 remove_watcher() i=7 2024-09-12T00:43:46.895 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:46.895 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:46.895 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-change-reshard-state id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:46.895 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:46.896 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.896 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.911 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:46.911 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:46.955 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:43:46.988 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:46.988 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:47.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.031+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.035+0000 7f05211019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.036 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.035+0000 7f05211019c0 20 realm 2024-09-12T00:43:47.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.035+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.035+0000 7f05211019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.035+0000 7f05211019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:47.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.035+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.035+0000 7f05211019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.035+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.039+0000 7f05211019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:47.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.039+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.039+0000 7f05211019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:47.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.039+0000 7f05211019c0 20 searching for the correct realm 2024-09-12T00:43:47.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.043+0000 7f051e406640 0 -- 172.21.15.137:0/1909457955 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f0514015070 msgr2=0x7f0514077170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:47.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.051+0000 7f051f408640 0 -- 172.21.15.137:0/1909457955 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55cadefb9670 msgr2=0x55cadefbbaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:47.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:47.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:47.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:47.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:47.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:47.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:47.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:47.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:47.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 zone default found 2024-09-12T00:43:47.059 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 4 Realm: () 2024-09-12T00:43:47.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:47.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:47.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:47.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 zonegroup default 2024-09-12T00:43:47.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 started sync module instance, tier type = 2024-09-12T00:43:47.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.059+0000 7f05211019c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:47.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.079+0000 7f05211019c0 20 add_watcher() i=0 2024-09-12T00:43:47.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.079+0000 7f05211019c0 20 add_watcher() i=1 2024-09-12T00:43:47.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.079+0000 7f05211019c0 20 add_watcher() i=2 2024-09-12T00:43:47.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.079+0000 7f05211019c0 20 add_watcher() i=3 2024-09-12T00:43:47.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.079+0000 7f05211019c0 20 add_watcher() i=4 2024-09-12T00:43:47.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.079+0000 7f05211019c0 20 add_watcher() i=5 2024-09-12T00:43:47.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.079+0000 7f05211019c0 20 add_watcher() i=6 2024-09-12T00:43:47.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.083+0000 7f05211019c0 20 add_watcher() i=7 2024-09-12T00:43:47.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.083+0000 7f05211019c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:47.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f03d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:47.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:47.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:47.086 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 5 note: GC not initialized 2024-09-12T00:43:47.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f034ffff640 20 reqs_thread_entry: start 2024-09-12T00:43:47.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:47.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 20 Filter name: none 2024-09-12T00:43:47.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f034dffb640 20 reqs_thread_entry: start 2024-09-12T00:43:47.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:43:47.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:47.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:43:47.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:43:47.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 : miss 2024-09-12T00:43:47.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:47.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:47.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:47.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:47.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:47.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.087+0000 7f05211019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 2024-09-12T00:43:47.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f05211019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:47.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f05211019c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:47.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f05211019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:47.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f05211019c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37, ofs0, ns] 2024-09-12T00:43:47.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f04027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366264 cookie 94329812790544 notifier 7442 bl.length()=931 2024-09-12T00:43:47.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f04027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:47.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f04027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:47.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f04027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:47.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_sources= new_sources= 2024-09-12T00:43:47.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential sources added=[] removed=[] 2024-09-12T00:43:47.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_dests= new_dests= 2024-09-12T00:43:47.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.095+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential dests added=[] removed=[] 2024-09-12T00:43:47.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.099+0000 7f05211019c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.1.0 2024-09-12T00:43:47.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.099+0000 7f05211019c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.1.0 2024-09-12T00:43:47.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.099+0000 7f05211019c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.1.1 2024-09-12T00:43:47.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.099+0000 7f05211019c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.1.1 2024-09-12T00:43:47.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.099+0000 7f05211019c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.0 2024-09-12T00:43:47.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.103+0000 7f05211019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:47.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.103+0000 7f05211019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 2024-09-12T00:43:47.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f05211019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:47.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f05211019c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:47.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f05211019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:47.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f05211019c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37, ofs0, ns] 2024-09-12T00:43:47.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f04027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366265 cookie 94329812790544 notifier 7442 bl.length()=931 2024-09-12T00:43:47.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f04027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:47.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f04027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:47.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f04027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:47.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_sources= new_sources= 2024-09-12T00:43:47.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential sources added=[] removed=[] 2024-09-12T00:43:47.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_dests= new_dests= 2024-09-12T00:43:47.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.107+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential dests added=[] removed=[] 2024-09-12T00:43:47.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f05211019c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37.0 2024-09-12T00:43:47.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f05211019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:47.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f05211019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 2024-09-12T00:43:47.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f05211019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:47.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f05211019c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:47.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f05211019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:47.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f05211019c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37, ofs0, ns] 2024-09-12T00:43:47.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f04027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366266 cookie 94329812790544 notifier 7442 bl.length()=899 2024-09-12T00:43:47.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f04027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 info.flags=0x17 2024-09-12T00:43:47.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f04027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 to cache LRU end 2024-09-12T00:43:47.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.111+0000 7f04027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:47.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.115+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_sources= new_sources= 2024-09-12T00:43:47.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.115+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential sources added=[] removed=[] 2024-09-12T00:43:47.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.115+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): orig_dests= new_dests= 2024-09-12T00:43:47.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.115+0000 7f05211019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37]): potential dests added=[] removed=[] 2024-09-12T00:43:47.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.115+0000 7f05211019c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:43:47.120 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.119+0000 7f03d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:47.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.123+0000 7f05211019c0 20 remove_watcher() i=0 2024-09-12T00:43:47.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.123+0000 7f05211019c0 2 removed watcher, disabling cache 2024-09-12T00:43:47.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.127+0000 7f05211019c0 20 remove_watcher() i=1 2024-09-12T00:43:47.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.127+0000 7f05211019c0 20 remove_watcher() i=2 2024-09-12T00:43:47.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.131+0000 7f05211019c0 20 remove_watcher() i=3 2024-09-12T00:43:47.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.131+0000 7f05211019c0 20 remove_watcher() i=4 2024-09-12T00:43:47.135 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.135+0000 7f05211019c0 20 remove_watcher() i=5 2024-09-12T00:43:47.138 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.139+0000 7f05211019c0 20 remove_watcher() i=6 2024-09-12T00:43:47.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.139+0000 7f05211019c0 20 remove_watcher() i=7 2024-09-12T00:43:47.156 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:43:47.183 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:47.183 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:47.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.227+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.227+0000 7f42d9a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.227+0000 7f42d9a4c9c0 20 realm 2024-09-12T00:43:47.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.227+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:47.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:47.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:47.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.231+0000 7f42d9a4c9c0 20 searching for the correct realm 2024-09-12T00:43:47.238 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.239+0000 7f42d7552640 0 -- 172.21.15.137:0/1646689530 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f42d000c340 msgr2=0x7f42d00699f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:47.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.243+0000 7f42d7552640 0 -- 172.21.15.137:0/1646689530 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x56032cf59400 msgr2=0x56032cf5b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:47.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:47.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:47.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:47.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:47.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:47.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:47.251 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 zone default found 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 4 Realm: () 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:47.252 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:47.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:47.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 zonegroup default 2024-09-12T00:43:47.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 started sync module instance, tier type = 2024-09-12T00:43:47.254 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.251+0000 7f42d9a4c9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:47.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.271+0000 7f42d9a4c9c0 20 add_watcher() i=0 2024-09-12T00:43:47.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.271+0000 7f42d9a4c9c0 20 add_watcher() i=1 2024-09-12T00:43:47.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.271+0000 7f42d9a4c9c0 20 add_watcher() i=2 2024-09-12T00:43:47.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.271+0000 7f42d9a4c9c0 20 add_watcher() i=3 2024-09-12T00:43:47.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.271+0000 7f42d9a4c9c0 20 add_watcher() i=4 2024-09-12T00:43:47.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.271+0000 7f42d9a4c9c0 20 add_watcher() i=5 2024-09-12T00:43:47.274 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.271+0000 7f42d9a4c9c0 20 add_watcher() i=6 2024-09-12T00:43:47.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.275+0000 7f42d9a4c9c0 20 add_watcher() i=7 2024-09-12T00:43:47.275 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.275+0000 7f42d9a4c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:47.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f418dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:47.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:47.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:47.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 5 note: GC not initialized 2024-09-12T00:43:47.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f418cfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:47.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:47.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 Filter name: none 2024-09-12T00:43:47.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f41067fc640 20 reqs_thread_entry: start 2024-09-12T00:43:47.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:47.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:47.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:47.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:47.281 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:47.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.279+0000 7f42d9a4c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:47.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.283+0000 7f418dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:47.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.287+0000 7f42d9a4c9c0 20 remove_watcher() i=0 2024-09-12T00:43:47.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.287+0000 7f42d9a4c9c0 2 removed watcher, disabling cache 2024-09-12T00:43:47.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.287+0000 7f42d9a4c9c0 20 remove_watcher() i=1 2024-09-12T00:43:47.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.291+0000 7f42d9a4c9c0 20 remove_watcher() i=2 2024-09-12T00:43:47.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.291+0000 7f42d9a4c9c0 20 remove_watcher() i=3 2024-09-12T00:43:47.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.295+0000 7f42d9a4c9c0 20 remove_watcher() i=4 2024-09-12T00:43:47.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.295+0000 7f42d9a4c9c0 20 remove_watcher() i=5 2024-09-12T00:43:47.300 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.299+0000 7f42d9a4c9c0 20 remove_watcher() i=6 2024-09-12T00:43:47.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.303+0000 7f42d9a4c9c0 20 remove_watcher() i=7 2024-09-12T00:43:47.316 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:47.316 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:47.316 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-change-reshard-state id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:43:47.316 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:47.317 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.317 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.321 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.321 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.367 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.367 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.390 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:43:47.390 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:47.390 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.390 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.406 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.406 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.452 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.452 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.470 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.471 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.490 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.490 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.511 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.511 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.532 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.532 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.551 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.551 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.570 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.570 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.590 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.590 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.609 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.610 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.629 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.630 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.648 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.649 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.668 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.668 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.689 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.689 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.708 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.708 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.727 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.727 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.747 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.747 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.767 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.767 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.787 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.787 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.806 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.806 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.827 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:47.827 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:47.844 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:43:47.876 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:47.876 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:47.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.919+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.923+0000 7ffaef1a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.923+0000 7ffaef1a09c0 20 realm 2024-09-12T00:43:47.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.923+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.923+0000 7ffaef1a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.923+0000 7ffaef1a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:47.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.923+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.923+0000 7ffaef1a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:47.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.923+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.927+0000 7ffaef1a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:47.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.927+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:47.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.927+0000 7ffaef1a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:47.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.927+0000 7ffaef1a09c0 20 searching for the correct realm 2024-09-12T00:43:47.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:47.931+0000 7ffaec4a5640 0 -- 172.21.15.137:0/2788273452 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7ffae006d950 msgr2=0x7ffae006d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:48.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.147+0000 7ffaec4a5640 0 -- 172.21.15.137:0/2788273452 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x56431d815420 msgr2=0x56431d8178e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:48.157 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.155+0000 7ffaef1a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:48.157 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.155+0000 7ffaef1a09c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:48.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.155+0000 7ffaef1a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:48.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.155+0000 7ffaef1a09c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:48.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.155+0000 7ffaef1a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:48.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.155+0000 7ffaef1a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:48.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.155+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:48.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:48.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 zone default found 2024-09-12T00:43:48.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 4 Realm: () 2024-09-12T00:43:48.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:48.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:48.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:48.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 zonegroup default 2024-09-12T00:43:48.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.159+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.163+0000 7ffaef1a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.163+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.163+0000 7ffaef1a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.163+0000 7ffaef1a09c0 20 started sync module instance, tier type = 2024-09-12T00:43:48.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.163+0000 7ffaef1a09c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 20 add_watcher() i=0 2024-09-12T00:43:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 20 add_watcher() i=1 2024-09-12T00:43:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 20 add_watcher() i=2 2024-09-12T00:43:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 20 add_watcher() i=3 2024-09-12T00:43:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 20 add_watcher() i=4 2024-09-12T00:43:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 20 add_watcher() i=5 2024-09-12T00:43:48.187 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 20 add_watcher() i=6 2024-09-12T00:43:48.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 20 add_watcher() i=7 2024-09-12T00:43:48.189 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.187+0000 7ffaef1a09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:48.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.191+0000 7ff9a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:48.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:48.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 5 note: GC not initialized 2024-09-12T00:43:48.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ff9a1fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:48.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:48.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 Filter name: none 2024-09-12T00:43:48.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ff9137fe640 20 reqs_thread_entry: start 2024-09-12T00:43:48.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:48.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:48.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:48.197 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.195+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.199+0000 7ffaef1a09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:48.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.199+0000 7ffaef1a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.199+0000 7ffaef1a09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:48.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.199+0000 7ffaef1a09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:48.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.199+0000 7ff9a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.207+0000 7ffaef1a09c0 20 remove_watcher() i=0 2024-09-12T00:43:48.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.207+0000 7ffaef1a09c0 2 removed watcher, disabling cache 2024-09-12T00:43:48.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.207+0000 7ffaef1a09c0 20 remove_watcher() i=1 2024-09-12T00:43:48.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.211+0000 7ffaef1a09c0 20 remove_watcher() i=2 2024-09-12T00:43:48.213 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.211+0000 7ffaef1a09c0 20 remove_watcher() i=3 2024-09-12T00:43:48.215 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.215+0000 7ffaef1a09c0 20 remove_watcher() i=4 2024-09-12T00:43:48.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.215+0000 7ffaef1a09c0 20 remove_watcher() i=5 2024-09-12T00:43:48.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.219+0000 7ffaef1a09c0 20 remove_watcher() i=6 2024-09-12T00:43:48.223 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.223+0000 7ffaef1a09c0 20 remove_watcher() i=7 2024-09-12T00:43:48.243 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:48.243 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:48.243 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-change-reshard-state id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:48.243 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:48.244 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:43:48.284 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:48.284 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:48.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.327+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.327+0000 7f30ee9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.327+0000 7f30ee9d39c0 20 realm 2024-09-12T00:43:48.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.327+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:48.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:48.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:48.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.331+0000 7f30ee9d39c0 20 searching for the correct realm 2024-09-12T00:43:48.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.339+0000 7f30eccda640 0 -- 172.21.15.137:0/3805673875 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f30d4069040 msgr2=0x7f30d4063860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:48.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.343+0000 7f30ec4d9640 0 -- 172.21.15.137:0/3805673875 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f30dc01a040 msgr2=0x7f30dc029410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:48.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:48.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:48.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:48.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:48.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:48.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:48.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:48.352 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 zone default found 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 4 Realm: () 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 zonegroup default 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.353 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 started sync module instance, tier type = 2024-09-12T00:43:48.354 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.351+0000 7f30ee9d39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:48.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.371+0000 7f30ee9d39c0 20 add_watcher() i=0 2024-09-12T00:43:48.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.371+0000 7f30ee9d39c0 20 add_watcher() i=1 2024-09-12T00:43:48.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.371+0000 7f30ee9d39c0 20 add_watcher() i=2 2024-09-12T00:43:48.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.371+0000 7f30ee9d39c0 20 add_watcher() i=3 2024-09-12T00:43:48.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.371+0000 7f30ee9d39c0 20 add_watcher() i=4 2024-09-12T00:43:48.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.371+0000 7f30ee9d39c0 20 add_watcher() i=5 2024-09-12T00:43:48.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.371+0000 7f30ee9d39c0 20 add_watcher() i=6 2024-09-12T00:43:48.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.375+0000 7f30ee9d39c0 20 add_watcher() i=7 2024-09-12T00:43:48.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.375+0000 7f30ee9d39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:48.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f2fa2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:48.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:48.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 5 note: GC not initialized 2024-09-12T00:43:48.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f2fa1fdb640 20 reqs_thread_entry: start 2024-09-12T00:43:48.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:48.379 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 20 Filter name: none 2024-09-12T00:43:48.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f2f137fe640 20 reqs_thread_entry: start 2024-09-12T00:43:48.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:43:48.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 : miss 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 info.flags=0x17 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 to cache LRU end 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:48.381 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.379+0000 7f30ee9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 2024-09-12T00:43:48.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f30ee9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 info.flags=0x17 2024-09-12T00:43:48.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f30ee9d39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 to cache LRU end 2024-09-12T00:43:48.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f30ee9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:48.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f30ee9d39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38, ofs0, ns] 2024-09-12T00:43:48.387 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f2fc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366271 cookie 94838582082192 notifier 7887 bl.length()=931 2024-09-12T00:43:48.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f2fc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 info.flags=0x17 2024-09-12T00:43:48.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f2fc37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 to cache LRU end 2024-09-12T00:43:48.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f2fc37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:48.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): orig_sources= new_sources= 2024-09-12T00:43:48.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): potential sources added=[] removed=[] 2024-09-12T00:43:48.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): orig_dests= new_dests= 2024-09-12T00:43:48.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.387+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): potential dests added=[] removed=[] 2024-09-12T00:43:48.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.391+0000 7f30ee9d39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38.1.0 2024-09-12T00:43:48.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.391+0000 7f30ee9d39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38.1.0 2024-09-12T00:43:48.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.391+0000 7f30ee9d39c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38.1.1 2024-09-12T00:43:48.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.391+0000 7f30ee9d39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38.1.1 2024-09-12T00:43:48.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.391+0000 7f30ee9d39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38.0 2024-09-12T00:43:48.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.399+0000 7f30ee9d39c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:43:48.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.399+0000 7f30ee9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:48.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.399+0000 7f30ee9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 2024-09-12T00:43:48.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.399+0000 7f30ee9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 info.flags=0x17 2024-09-12T00:43:48.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.399+0000 7f30ee9d39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 to cache LRU end 2024-09-12T00:43:48.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.399+0000 7f30ee9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:48.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.399+0000 7f30ee9d39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38, ofs0, ns] 2024-09-12T00:43:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f2fc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366272 cookie 94838582082192 notifier 7887 bl.length()=931 2024-09-12T00:43:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f2fc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 info.flags=0x17 2024-09-12T00:43:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f2fc37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 to cache LRU end 2024-09-12T00:43:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f2fc37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): orig_sources= new_sources= 2024-09-12T00:43:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): potential sources added=[] removed=[] 2024-09-12T00:43:48.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): orig_dests= new_dests= 2024-09-12T00:43:48.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): potential dests added=[] removed=[] 2024-09-12T00:43:48.404 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f30ee9d39c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38.0 2024-09-12T00:43:48.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f30ee9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:48.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.403+0000 7f30ee9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 2024-09-12T00:43:48.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 info.flags=0x17 2024-09-12T00:43:48.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 to cache LRU end 2024-09-12T00:43:48.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:48.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38, ofs0, ns] 2024-09-12T00:43:48.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f2fc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366273 cookie 94838582082192 notifier 7887 bl.length()=899 2024-09-12T00:43:48.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f2fc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 info.flags=0x17 2024-09-12T00:43:48.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f2fc37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 to cache LRU end 2024-09-12T00:43:48.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f2fc37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:48.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): orig_sources= new_sources= 2024-09-12T00:43:48.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): potential sources added=[] removed=[] 2024-09-12T00:43:48.408 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): orig_dests= new_dests= 2024-09-12T00:43:48.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38]): potential dests added=[] removed=[] 2024-09-12T00:43:48.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.407+0000 7f30ee9d39c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:43:48.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.411+0000 7f2fa2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.415+0000 7f30ee9d39c0 20 remove_watcher() i=0 2024-09-12T00:43:48.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.415+0000 7f30ee9d39c0 2 removed watcher, disabling cache 2024-09-12T00:43:48.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.419+0000 7f30ee9d39c0 20 remove_watcher() i=1 2024-09-12T00:43:48.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.419+0000 7f30ee9d39c0 20 remove_watcher() i=2 2024-09-12T00:43:48.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.423+0000 7f30ee9d39c0 20 remove_watcher() i=3 2024-09-12T00:43:48.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.427+0000 7f30ee9d39c0 20 remove_watcher() i=4 2024-09-12T00:43:48.428 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.427+0000 7f30ee9d39c0 20 remove_watcher() i=5 2024-09-12T00:43:48.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.431+0000 7f30ee9d39c0 20 remove_watcher() i=6 2024-09-12T00:43:48.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.435+0000 7f30ee9d39c0 20 remove_watcher() i=7 2024-09-12T00:43:48.449 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:43:48.479 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:48.479 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:48.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.523+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.523+0000 7f0e27f989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.523+0000 7f0e27f989c0 20 realm 2024-09-12T00:43:48.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.523+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:48.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:48.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:48.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.527+0000 7f0e27f989c0 20 searching for the correct realm 2024-09-12T00:43:48.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.531+0000 7f0e2529d640 0 -- 172.21.15.137:0/1867875240 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f0e1c0c8070 msgr2=0x7f0e1c113910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:48.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.747+0000 7f0e2529d640 0 -- 172.21.15.137:0/1867875240 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x564879d625d0 msgr2=0x564879d649c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:48.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:48.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:48.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:48.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:48.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:48.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:48.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:48.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:48.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 zone default found 2024-09-12T00:43:48.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 4 Realm: () 2024-09-12T00:43:48.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:48.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:48.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:48.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 zonegroup default 2024-09-12T00:43:48.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.759+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.763+0000 7f0e27f989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.763+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.763+0000 7f0e27f989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.763+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.763+0000 7f0e27f989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.763+0000 7f0e27f989c0 20 started sync module instance, tier type = 2024-09-12T00:43:48.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.763+0000 7f0e27f989c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:48.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.783+0000 7f0e27f989c0 20 add_watcher() i=0 2024-09-12T00:43:48.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.783+0000 7f0e27f989c0 20 add_watcher() i=1 2024-09-12T00:43:48.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.783+0000 7f0e27f989c0 20 add_watcher() i=2 2024-09-12T00:43:48.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.783+0000 7f0e27f989c0 20 add_watcher() i=3 2024-09-12T00:43:48.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.783+0000 7f0e27f989c0 20 add_watcher() i=4 2024-09-12T00:43:48.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.783+0000 7f0e27f989c0 20 add_watcher() i=5 2024-09-12T00:43:48.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.783+0000 7f0e27f989c0 20 add_watcher() i=6 2024-09-12T00:43:48.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.787+0000 7f0e27f989c0 20 add_watcher() i=7 2024-09-12T00:43:48.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.787+0000 7f0e27f989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:48.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.791+0000 7f0cd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.791+0000 7f0e27f989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:48.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.791+0000 7f0e27f989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:48.793 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.791+0000 7f0e27f989c0 5 note: GC not initialized 2024-09-12T00:43:48.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.791+0000 7f0cd67fc640 20 reqs_thread_entry: start 2024-09-12T00:43:48.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:48.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 Filter name: none 2024-09-12T00:43:48.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0c47fff640 20 reqs_thread_entry: start 2024-09-12T00:43:48.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:48.795 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:48.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:48.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:48.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.795+0000 7f0e27f989c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.799+0000 7f0e27f989c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:48.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.799+0000 7f0e27f989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:48.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.799+0000 7f0cd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.803+0000 7f0e27f989c0 20 remove_watcher() i=0 2024-09-12T00:43:48.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.803+0000 7f0e27f989c0 2 removed watcher, disabling cache 2024-09-12T00:43:48.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.807+0000 7f0e27f989c0 20 remove_watcher() i=1 2024-09-12T00:43:48.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.807+0000 7f0e27f989c0 20 remove_watcher() i=2 2024-09-12T00:43:48.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.811+0000 7f0e27f989c0 20 remove_watcher() i=3 2024-09-12T00:43:48.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.811+0000 7f0e27f989c0 20 remove_watcher() i=4 2024-09-12T00:43:48.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.815+0000 7f0e27f989c0 20 remove_watcher() i=5 2024-09-12T00:43:48.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.819+0000 7f0e27f989c0 20 remove_watcher() i=6 2024-09-12T00:43:48.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:48.819+0000 7f0e27f989c0 20 remove_watcher() i=7 2024-09-12T00:43:48.836 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:48.837 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:48.837 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: error-at-change-reshard-state id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:43:48.837 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:48.838 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.838 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:48.841 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.841 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:48.887 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.888 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:48.908 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:43:48.908 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:48.909 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.909 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:48.925 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.925 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:48.973 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.974 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:48.993 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.994 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.014 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.014 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.035 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.035 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.055 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.055 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.075 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.075 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.095 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.095 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.115 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.116 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.136 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.137 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.157 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.157 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.178 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.178 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.198 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.199 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.221 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.221 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.241 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.242 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.263 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.263 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.285 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.285 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.305 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.305 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.325 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.326 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.345 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.345 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.365 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:49.365 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:49.383 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:43:49.415 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.416 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.460 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.459+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 realm 2024-09-12T00:43:49.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.463+0000 7fc5bfa4d9c0 20 searching for the correct realm 2024-09-12T00:43:49.472 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.471+0000 7fc5bd553640 0 -- 172.21.15.137:0/1309483353 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fc5b0101050 msgr2=0x7fc5b012b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.478 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.479+0000 7fc5bd553640 0 -- 172.21.15.137:0/1309483353 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x56440b878150 msgr2=0x56440b87a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.483+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 zone default found 2024-09-12T00:43:49.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 4 Realm: () 2024-09-12T00:43:49.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:49.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:49.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 zonegroup default 2024-09-12T00:43:49.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 started sync module instance, tier type = 2024-09-12T00:43:49.488 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.487+0000 7fc5bfa4d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:49.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 20 add_watcher() i=0 2024-09-12T00:43:49.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 20 add_watcher() i=1 2024-09-12T00:43:49.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 20 add_watcher() i=2 2024-09-12T00:43:49.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 20 add_watcher() i=3 2024-09-12T00:43:49.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 20 add_watcher() i=4 2024-09-12T00:43:49.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 20 add_watcher() i=5 2024-09-12T00:43:49.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 20 add_watcher() i=6 2024-09-12T00:43:49.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 20 add_watcher() i=7 2024-09-12T00:43:49.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.507+0000 7fc5bfa4d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.511+0000 7fc4737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.511+0000 7fc5bfa4d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.511+0000 7fc5bfa4d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.511+0000 7fc5bfa4d9c0 5 note: GC not initialized 2024-09-12T00:43:49.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.511+0000 7fc4727e4640 20 reqs_thread_entry: start 2024-09-12T00:43:49.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.511+0000 7fc5bfa4d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:49.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.511+0000 7fc5bfa4d9c0 20 Filter name: none 2024-09-12T00:43:49.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc3e3fff640 20 reqs_thread_entry: start 2024-09-12T00:43:49.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:49.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:49.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc5bfa4d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:49.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:49.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.515+0000 7fc5bfa4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.519+0000 7fc5bfa4d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:49.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.519+0000 7fc5bfa4d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:49.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.519+0000 7fc4737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.523+0000 7fc5bfa4d9c0 20 remove_watcher() i=0 2024-09-12T00:43:49.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.523+0000 7fc5bfa4d9c0 2 removed watcher, disabling cache 2024-09-12T00:43:49.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.527+0000 7fc5bfa4d9c0 20 remove_watcher() i=1 2024-09-12T00:43:49.528 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.527+0000 7fc5bfa4d9c0 20 remove_watcher() i=2 2024-09-12T00:43:49.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.531+0000 7fc5bfa4d9c0 20 remove_watcher() i=3 2024-09-12T00:43:49.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.531+0000 7fc5bfa4d9c0 20 remove_watcher() i=4 2024-09-12T00:43:49.535 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.535+0000 7fc5bfa4d9c0 20 remove_watcher() i=5 2024-09-12T00:43:49.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.535+0000 7fc5bfa4d9c0 20 remove_watcher() i=6 2024-09-12T00:43:49.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.539+0000 7fc5bfa4d9c0 20 remove_watcher() i=7 2024-09-12T00:43:49.553 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.554 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:49.554 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-change-reshard-state id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:49.554 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.554 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:43:49.587 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.587 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 realm 2024-09-12T00:43:49.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.636 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 searching for the correct realm 2024-09-12T00:43:49.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.643+0000 7f33a3496640 0 -- 172.21.15.137:0/3393439453 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5650f77d9c60 msgr2=0x5650f77dc0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:49.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.647+0000 7f33a2c95640 0 -- 172.21.15.137:0/3393439453 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5650f77ddee0 msgr2=0x5650f77e02f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:49.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:49.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 zone default found 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 Realm: () 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:49.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 zonegroup default 2024-09-12T00:43:49.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 started sync module instance, tier type = 2024-09-12T00:43:49.660 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:49.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=0 2024-09-12T00:43:49.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=1 2024-09-12T00:43:49.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=2 2024-09-12T00:43:49.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=3 2024-09-12T00:43:49.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=4 2024-09-12T00:43:49.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=5 2024-09-12T00:43:49.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=6 2024-09-12T00:43:49.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.679+0000 7f33a518f9c0 20 add_watcher() i=7 2024-09-12T00:43:49.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.679+0000 7f33a518f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f32597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 note: GC not initialized 2024-09-12T00:43:49.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f31d3fff640 20 reqs_thread_entry: start 2024-09-12T00:43:49.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:49.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 Filter name: none 2024-09-12T00:43:49.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f31d1ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:49.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:43:49.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:49.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:43:49.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:43:49.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 : miss 2024-09-12T00:43:49.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:49.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:49.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.685 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 2024-09-12T00:43:49.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39, ofs0, ns] 2024-09-12T00:43:49.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94905749601696 notifier 7941 bl.length()=931 2024-09-12T00:43:49.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_sources= new_sources= 2024-09-12T00:43:49.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential sources added=[] removed=[] 2024-09-12T00:43:49.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_dests= new_dests= 2024-09-12T00:43:49.695 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential dests added=[] removed=[] 2024-09-12T00:43:49.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.699+0000 7f33a518f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.0 2024-09-12T00:43:49.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.0 2024-09-12T00:43:49.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.699+0000 7f33a518f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.1 2024-09-12T00:43:49.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.1 2024-09-12T00:43:49.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.0 2024-09-12T00:43:49.706 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f33a518f9c0 time 2024-09-12T00:43:49.711131+0000 2024-09-12T00:43:49.706 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:49.707 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:49.707 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f33a8a692eb] 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f33a8a6949f] 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650f4f9ccc1] 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5650f4fb101c] 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5650f4fb26a4] 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f33a78cfd90] 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f33a518f9c0 thread_name:radosgw-admin 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.707+0000 7f33a518f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f33a518f9c0 time 2024-09-12T00:43:49.711131+0000 2024-09-12T00:43:49.708 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f33a8a692eb] 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f33a8a6949f] 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650f4f9ccc1] 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5650f4fb101c] 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5650f4fb26a4] 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f33a78cfd90] 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:43:49.709 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.725 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:49.725 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f33a78e8520] 2024-09-12T00:43:49.725 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:43:49.725 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:43:49.725 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:43:49.725 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f33a8a69345] 2024-09-12T00:43:49.728 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f33a8a6949f] 2024-09-12T00:43:49.728 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650f4f9ccc1] 2024-09-12T00:43:49.728 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5650f4fb101c] 2024-09-12T00:43:49.728 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5650f4fb26a4] 2024-09-12T00:43:49.728 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:43:49.728 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f33a78cfd90] 2024-09-12T00:43:49.728 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.707+0000 7f33a518f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f33a518f9c0 thread_name:radosgw-admin 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f33a78e8520] 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f33a8a69345] 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f33a8a6949f] 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650f4f9ccc1] 2024-09-12T00:43:49.729 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5650f4fb101c] 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5650f4fb26a4] 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f33a78cfd90] 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:43:49.607+0000 7f33a3496640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: dump: 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.730 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.731 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: dump: 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:43:49.607+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7929 2024-09-12T00:43:49.732 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:43:49.607+0000 7f33a518f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:43:49.607+0000 7f33a518f9c0 4 set_mon_vals no callback set 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: shutdown 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) unregister_commands rotate-key 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: monmap: 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:49.733 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding auth protocol: cephx 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding auth protocol: cephx 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding auth protocol: cephx 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.734 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: starting msgr at 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: starting objecter 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command objecter_requests hook 0x5650f76f65f0 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: setting wanted keys 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: calling monclient init 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: init 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding auth protocol: cephx 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding auth protocol: cephx 2024-09-12T00:43:49.735 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding auth protocol: cephx 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.736 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command rotate-key hook 0x5650f76ef288 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-b con 0x5650f759f2a0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-a con 0x5650f7634d00 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-c con 0x5650f76f5680 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): authenticate will time out at 2330.745920s 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): get_auth_request con 0x5650f7634d00 auth_method 0 2024-09-12T00:43:49.737 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): get_auth_request con 0x5650f76f5680 auth_method 0 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): handle_auth_done global_id 7932 payload 824 2024-09-12T00:43:49.738 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient: _finish_hunting 0 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:43:49.611+0000 7f33a2494640 1 monclient: found mon.noname-a 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: dump: 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.739 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: dump: 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.740 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:43:49.611+0000 7f3290e09640 4 set_mon_vals no callback set 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7932 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: init done 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:43:49.615+0000 7f328f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:43:49.615+0000 7f328f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.741 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:43:49.615+0000 7f328f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:43:49.615+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f3288070ae0 auth_method 0 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:43:49.615+0000 7f33a3496640 10 monclient: get_auth_request con 0x5650f77175b0 auth_method 0 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:43:49.615+0000 7f33a2c95640 10 monclient: get_auth_request con 0x5650f773a020 auth_method 0 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient: get_auth_request con 0x5650f773f560 auth_method 0 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: monmap: 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.742 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding auth protocol: cephx 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding auth protocol: cephx 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding auth protocol: cephx 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.743 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command objecter_requests cmddesc objecter_requests hook 0x5650f7746e40 EEXIST 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: init 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding auth protocol: cephx 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding auth protocol: cephx 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding auth protocol: cephx 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.744 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command rotate-key cmddesc rotate-key hook 0x5650f7742530 EEXIST 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:49.745 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-b con 0x5650f776aff0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-a con 0x5650f776a920 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-c con 0x5650f7769300 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): authenticate will time out at 2330.755627s 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): get_auth_request con 0x5650f776a920 auth_method 0 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): get_auth_request con 0x5650f7769300 auth_method 0 2024-09-12T00:43:49.746 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:43:49.619+0000 7f33a2c95640 10 monclient(hunting): get_auth_request con 0x5650f776aff0 auth_method 0 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:43:49.619+0000 7f33a2c95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:43:49.619+0000 7f33a2c95640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:43:49.619+0000 7f33a2c95640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.747 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:43:49.623+0000 7f33a3496640 10 monclient(hunting): handle_auth_done global_id 7541 payload 824 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:43:49.623+0000 7f33a3496640 10 monclient: _finish_hunting 0 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:43:49.623+0000 7f33a3496640 1 monclient: found mon.noname-c 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:43:49.623+0000 7f33a3496640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: dump: 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.748 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7541 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: dump: 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.749 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:43:49.623+0000 7f33a3c97640 4 set_mon_vals no callback set 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:43:49.623+0000 7f328ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:43:49.623+0000 7f328ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:43:49.623+0000 7f328ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.750 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:43:49.623+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f327c070a20 auth_method 0 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: get_monmap_and_config 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: monmap: 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:49.751 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding auth protocol: cephx 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding auth protocol: cephx 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding auth protocol: cephx 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.752 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: init 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding auth protocol: cephx 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding auth protocol: cephx 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding auth protocol: cephx 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.753 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command rotate-key cmddesc rotate-key hook 0x7ffda6551548 EEXIST 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-a con 0x5650f778fa40 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-c con 0x5650f77c50d0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-b con 0x5650f77ba410 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:49.754 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): authenticate will time out at 2330.759979s 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): get_auth_request con 0x5650f778fa40 auth_method 0 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): get_auth_request con 0x5650f77c50d0 auth_method 0 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.755 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): handle_auth_done global_id 7938 payload 274 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient: _finish_hunting 0 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:43:49.627+0000 7f33a2c95640 1 monclient: found mon.noname-a 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient: get_auth_request con 0x5650f77ba410 auth_method 0 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: dump: 2024-09-12T00:43:49.756 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.757 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: dump: 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7938 2024-09-12T00:43:49.758 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 4 set_mon_vals no callback set 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: shutdown 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: monmap: 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding auth protocol: cephx 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding auth protocol: cephx 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding auth protocol: cephx 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.760 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: starting msgr at 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: starting objecter 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command objecter_requests cmddesc objecter_requests hook 0x5650f77900f0 EEXIST 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: setting wanted keys 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: calling monclient init 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: init 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding auth protocol: cephx 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding auth protocol: cephx 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding auth protocol: cephx 2024-09-12T00:43:49.761 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.762 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command rotate-key cmddesc rotate-key hook 0x5650f776cf58 EEXIST 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-b con 0x5650f778fa40 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-a con 0x5650f77ba410 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-c con 0x5650f77c50d0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): authenticate will time out at 2330.762705s 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): get_auth_request con 0x5650f77ba410 auth_method 0 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.763 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): get_auth_request con 0x5650f77c50d0 auth_method 0 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_done global_id 7941 payload 824 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient: _finish_hunting 0 2024-09-12T00:43:49.764 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:43:49.627+0000 7f33a2494640 1 monclient: found mon.noname-a 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: dump: 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: dump: 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.766 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:43:49.627+0000 7f32867fc640 4 set_mon_vals no callback set 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7941 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: init done 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cr dump hook 0x5650f77b9498 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:43:49.631+0000 7f3284ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:49.767 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:43:49.631+0000 7f3284ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:43:49.631+0000 7f3284ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:43:49.631+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f326c070ae0 auth_method 0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:43:49.631+0000 7f33a3496640 10 monclient: get_auth_request con 0x5650f77d9c60 auth_method 0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 realm 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:43:49.635+0000 7f33a2c95640 10 monclient: get_auth_request con 0x5650f77ddee0 auth_method 0 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.768 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 searching for the correct realm 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:43:49.635+0000 7f33a2494640 10 monclient: get_auth_request con 0x5650f77e3110 auth_method 0 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:43:49.635+0000 7f33a3496640 10 monclient: get_auth_request con 0x7f33980bf070 auth_method 0 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:43:49.639+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f3394038070 auth_method 0 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:43:49.639+0000 7f33a2494640 10 monclient: get_auth_request con 0x5650f757ea30 auth_method 0 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:43:49.643+0000 7f33a3496640 0 -- 172.21.15.137:0/3393439453 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5650f77d9c60 msgr2=0x5650f77dc0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:43:49.643+0000 7f3284ff9640 1 client.7941.objecter ms_handle_reset 0x5650f77d9c60 session 0x5650f77d95e0 osd.6 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:43:49.643+0000 7f3284ff9640 10 monclient: _renew_subs 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:43:49.643+0000 7f3284ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:43:49.643+0000 7f33a3496640 10 monclient: get_auth_request con 0x7f326c080e90 auth_method 0 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:43:49.643+0000 7f33a3496640 10 monclient: get_auth_request con 0x7f339400f940 auth_method 0 2024-09-12T00:43:49.769 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:43:49.647+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f339c017020 auth_method 0 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:43:49.647+0000 7f33a2c95640 0 -- 172.21.15.137:0/3393439453 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5650f77ddee0 msgr2=0x5650f77e02f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:43:49.647+0000 7f3284ff9640 1 client.7941.objecter ms_handle_reset 0x5650f77ddee0 session 0x5650f77dd860 osd.1 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:43:49.647+0000 7f33a2c95640 10 monclient: get_auth_request con 0x5650f77d9c60 auth_method 0 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.770 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 zone default found 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 Realm: () 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 zonegroup default 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.771 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 started sync module instance, tier type = 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=0 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=1 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=2 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=3 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=4 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=5 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=6 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:43:49.679+0000 7f33a518f9c0 20 add_watcher() i=7 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:43:49.679+0000 7f33a518f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.772 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding auth protocol: cephx 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding auth protocol: cephx 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding auth protocol: cephx 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.773 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:43:49.683+0000 7f32597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cache list hook 0x5650f77b8380 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cache inspect hook 0x5650f77b8380 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cache erase hook 0x5650f77b8380 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cache zap hook 0x5650f77b8380 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 note: GC not initialized 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:43:49.683+0000 7f31d3fff640 20 reqs_thread_entry: start 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command sync trace show hook 0x7f339400dbc0 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command sync trace history hook 0x7f339400dbc0 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command sync trace active hook 0x7f339400dbc0 2024-09-12T00:43:49.774 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command sync trace active_short hook 0x7f339400dbc0 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 Filter name: none 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:43:49.683+0000 7f31d1ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 : miss 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.775 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39, ofs0, ns] 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94905749601696 notifier 7941 bl.length()=931 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_sources= new_sources= 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential sources added=[] removed=[] 2024-09-12T00:43:49.776 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_dests= new_dests= 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential dests added=[] removed=[] 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.0 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.0 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.1 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.1 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.0 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:43:49.707+0000 7f33a518f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f33a518f9c0 time 2024-09-12T00:43:49.711131+0000 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f33a8a692eb] 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f33a8a6949f] 2024-09-12T00:43:49.777 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650f4f9ccc1] 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5650f4fb101c] 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5650f4fb26a4] 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f33a78cfd90] 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:43:49.707+0000 7f33a518f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f33a518f9c0 thread_name:radosgw-admin 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f33a78e8520] 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:43:49.778 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f33a8a69345] 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f33a8a6949f] 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650f4f9ccc1] 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5650f4fb101c] 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5650f4fb26a4] 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f33a78cfd90] 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.779 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:43:49.780 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:43:49.781 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:43:49.782 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:43:49.783 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:43:49.784 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:43:49.785 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 7f31d1ffb640 / http_manager 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 7f31d3fff640 / http_manager 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 7f32597e2640 / rgw_dt_lg_renew 2024-09-12T00:43:49.786 INFO:tasks.workunit.client.0.smithi137.stderr: 7f3284ff9640 / ms_dispatch 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f32867fc640 / io_context_pool 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f328ce01640 / ms_dispatch 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f328f606640 / ms_dispatch 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f3290e09640 / io_context_pool 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a2494640 / msgr-worker-2 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a2c95640 / msgr-worker-1 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a3496640 / msgr-worker-0 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a3c97640 / io_context_pool 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a518f9c0 / radosgw-admin 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.135513.log 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:43:49.787 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:43:49.607+0000 7f33a3496640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: dump: 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.788 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:43:49.607+0000 7f3290e09640 10 monclient: dump: 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.789 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.790 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.790 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.790 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.790 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.790 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:43:49.607+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7929 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:43:49.607+0000 7f33a518f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:43:49.607+0000 7f33a518f9c0 4 set_mon_vals no callback set 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: shutdown 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) unregister_commands rotate-key 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: monmap: 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.791 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding auth protocol: cephx 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding auth protocol: cephx 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding auth protocol: cephx 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.792 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: crc 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76f4690) adding con mode: secure 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: starting msgr at 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: starting objecter 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command objecter_requests hook 0x5650f76f65f0 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: setting wanted keys 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: calling monclient init 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: init 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding auth protocol: cephx 2024-09-12T00:43:49.793 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding auth protocol: cephx 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding auth protocol: cephx 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: crc 2024-09-12T00:43:49.794 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 AuthRegistry(0x5650f76ef140) adding con mode: secure 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command rotate-key hook 0x5650f76ef288 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-b con 0x5650f759f2a0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-a con 0x5650f7634d00 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-c con 0x5650f76f5680 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient(hunting): authenticate will time out at 2330.745920s 2024-09-12T00:43:49.795 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): get_auth_request con 0x5650f7634d00 auth_method 0 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): get_auth_request con 0x5650f76f5680 auth_method 0 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.796 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:43:49.611+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient(hunting): handle_auth_done global_id 7932 payload 824 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient: _finish_hunting 0 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:43:49.611+0000 7f33a2494640 1 monclient: found mon.noname-a 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:43:49.611+0000 7f33a2494640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: dump: 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.797 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.798 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:43:49.611+0000 7f328f606640 10 monclient: dump: 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:43:49.611+0000 7f3290e09640 4 set_mon_vals no callback set 2024-09-12T00:43:49.799 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7932 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:43:49.611+0000 7f33a518f9c0 1 librados: init done 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:43:49.615+0000 7f328f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:43:49.615+0000 7f328f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:43:49.615+0000 7f328f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:43:49.615+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f3288070ae0 auth_method 0 2024-09-12T00:43:49.800 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:43:49.615+0000 7f33a3496640 10 monclient: get_auth_request con 0x5650f77175b0 auth_method 0 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:43:49.615+0000 7f33a2c95640 10 monclient: get_auth_request con 0x5650f773a020 auth_method 0 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient: get_auth_request con 0x5650f773f560 auth_method 0 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: monmap: 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:49.801 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding auth protocol: cephx 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding auth protocol: cephx 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding auth protocol: cephx 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.802 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: crc 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f7743450) adding con mode: secure 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command objecter_requests cmddesc objecter_requests hook 0x5650f7746e40 EEXIST 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: init 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding auth protocol: cephx 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding auth protocol: cephx 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding auth protocol: cephx 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.803 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: crc 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 AuthRegistry(0x5650f77423e8) adding con mode: secure 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command rotate-key cmddesc rotate-key hook 0x5650f7742530 EEXIST 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:49.804 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-b con 0x5650f776aff0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-a con 0x5650f776a920 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-c con 0x5650f7769300 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:43:49.619+0000 7f33a518f9c0 10 monclient(hunting): authenticate will time out at 2330.755627s 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): get_auth_request con 0x5650f776a920 auth_method 0 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.805 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): get_auth_request con 0x5650f7769300 auth_method 0 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:43:49.619+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:43:49.619+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:43:49.619+0000 7f33a2c95640 10 monclient(hunting): get_auth_request con 0x5650f776aff0 auth_method 0 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:43:49.619+0000 7f33a2c95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:43:49.619+0000 7f33a2c95640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:43:49.619+0000 7f33a2c95640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.806 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:43:49.623+0000 7f33a3496640 10 monclient(hunting): handle_auth_done global_id 7541 payload 824 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:43:49.623+0000 7f33a3496640 10 monclient: _finish_hunting 0 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:43:49.623+0000 7f33a3496640 1 monclient: found mon.noname-c 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:43:49.623+0000 7f33a3496640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: dump: 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.807 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7541 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:43:49.623+0000 7f328ce01640 10 monclient: dump: 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.808 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:43:49.623+0000 7f33a3c97640 4 set_mon_vals no callback set 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:43:49.623+0000 7f328ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:43:49.623+0000 7f328ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.809 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:43:49.623+0000 7f328ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:43:49.623+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f327c070a20 auth_method 0 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: get_monmap_and_config 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: monmap: 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:49.810 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding auth protocol: cephx 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding auth protocol: cephx 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding auth protocol: cephx 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.811 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: crc 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x5650f778a7e0) adding con mode: secure 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: init 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding auth protocol: cephx 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding auth protocol: cephx 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding auth protocol: cephx 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.812 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: crc 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda6551400) adding con mode: secure 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command rotate-key cmddesc rotate-key hook 0x7ffda6551548 EEXIST 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-a con 0x5650f778fa40 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-c con 0x5650f77c50d0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:49.813 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-b con 0x5650f77ba410 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:43:49.623+0000 7f33a518f9c0 10 monclient(hunting): authenticate will time out at 2330.759979s 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): get_auth_request con 0x5650f778fa40 auth_method 0 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): get_auth_request con 0x5650f77c50d0 auth_method 0 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.814 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient(hunting): handle_auth_done global_id 7938 payload 274 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient: _finish_hunting 0 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:43:49.627+0000 7f33a2c95640 1 monclient: found mon.noname-a 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:43:49.627+0000 7f33a2c95640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient: get_auth_request con 0x5650f77ba410 auth_method 0 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:49.815 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: dump: 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.816 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:43:49.627+0000 7f32867fc640 10 monclient: dump: 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.817 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7938 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 4 set_mon_vals no callback set 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: shutdown 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: build_initial_monmap 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: monmap: 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:43:49.818 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding auth protocol: cephx 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding auth protocol: cephx 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding auth protocol: cephx 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.819 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: crc 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f757d9f0) adding con mode: secure 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: starting msgr at 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: starting objecter 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command objecter_requests cmddesc objecter_requests hook 0x5650f77900f0 EEXIST 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: setting wanted keys 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: calling monclient init 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: init 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding auth protocol: cephx 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding auth protocol: cephx 2024-09-12T00:43:49.820 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding auth protocol: cephx 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: crc 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 AuthRegistry(0x5650f776ce10) adding con mode: secure 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.821 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command rotate-key cmddesc rotate-key hook 0x5650f776cf58 EEXIST 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-b con 0x5650f778fa40 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-a con 0x5650f77ba410 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): picked mon.noname-c con 0x5650f77c50d0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient(hunting): authenticate will time out at 2330.762705s 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): get_auth_request con 0x5650f77ba410 auth_method 0 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.822 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): get_auth_request con 0x5650f77c50d0 auth_method 0 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:43:49.627+0000 7f33a3496640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient(hunting): handle_auth_done global_id 7941 payload 824 2024-09-12T00:43:49.823 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient: _finish_hunting 0 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:43:49.627+0000 7f33a2494640 1 monclient: found mon.noname-a 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:43:49.627+0000 7f33a2494640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: dump: 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.824 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: _finish_auth 0 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:43:49.627+0000 7f3284ff9640 10 monclient: dump: 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:43:49.825 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:43:49.627+0000 7f32867fc640 4 set_mon_vals no callback set 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 monclient: authenticate success, global_id 7941 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _renew_subs 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 1 librados: init done 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:43:49.627+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cr dump hook 0x5650f77b9498 2024-09-12T00:43:49.826 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:43:49.631+0000 7f3284ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:43:49.631+0000 7f3284ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:43:49.631+0000 7f3284ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:43:49.631+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f326c070ae0 auth_method 0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:43:49.631+0000 7f33a3496640 10 monclient: get_auth_request con 0x5650f77d9c60 auth_method 0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 realm 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:43:49.631+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.827 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:43:49.635+0000 7f33a2c95640 10 monclient: get_auth_request con 0x5650f77ddee0 auth_method 0 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:43:49.635+0000 7f33a518f9c0 20 searching for the correct realm 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:43:49.635+0000 7f33a2494640 10 monclient: get_auth_request con 0x5650f77e3110 auth_method 0 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:43:49.635+0000 7f33a3496640 10 monclient: get_auth_request con 0x7f33980bf070 auth_method 0 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:43:49.639+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f3394038070 auth_method 0 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:43:49.639+0000 7f33a2494640 10 monclient: get_auth_request con 0x5650f757ea30 auth_method 0 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:43:49.643+0000 7f33a3496640 0 -- 172.21.15.137:0/3393439453 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5650f77d9c60 msgr2=0x5650f77dc0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:43:49.643+0000 7f3284ff9640 1 client.7941.objecter ms_handle_reset 0x5650f77d9c60 session 0x5650f77d95e0 osd.6 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:43:49.643+0000 7f3284ff9640 10 monclient: _renew_subs 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:43:49.643+0000 7f3284ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:43:49.828 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:43:49.643+0000 7f33a3496640 10 monclient: get_auth_request con 0x7f326c080e90 auth_method 0 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:43:49.643+0000 7f33a3496640 10 monclient: get_auth_request con 0x7f339400f940 auth_method 0 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:43:49.647+0000 7f33a2c95640 10 monclient: get_auth_request con 0x7f339c017020 auth_method 0 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:43:49.647+0000 7f33a2c95640 0 -- 172.21.15.137:0/3393439453 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5650f77ddee0 msgr2=0x5650f77e02f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:43:49.647+0000 7f3284ff9640 1 client.7941.objecter ms_handle_reset 0x5650f77ddee0 session 0x5650f77dd860 osd.1 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:43:49.647+0000 7f33a2c95640 10 monclient: get_auth_request con 0x5650f77d9c60 auth_method 0 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.829 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 zone default found 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 Realm: () 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 zonegroup default 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:43:49.655+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.830 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 started sync module instance, tier type = 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:43:49.659+0000 7f33a518f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=0 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=1 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=2 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=3 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=4 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=5 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:43:49.675+0000 7f33a518f9c0 20 add_watcher() i=6 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:43:49.679+0000 7f33a518f9c0 20 add_watcher() i=7 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:43:49.679+0000 7f33a518f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.831 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding auth protocol: cephx 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding auth protocol: cephx 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding auth protocol: cephx 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.832 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: crc 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 AuthRegistry(0x7ffda65518e0) adding con mode: secure 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:43:49.683+0000 7f32597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cache list hook 0x5650f77b8380 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cache inspect hook 0x5650f77b8380 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cache erase hook 0x5650f77b8380 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command cache zap hook 0x5650f77b8380 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 note: GC not initialized 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:43:49.683+0000 7f31d3fff640 20 reqs_thread_entry: start 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command sync trace show hook 0x7f339400dbc0 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command sync trace history hook 0x7f339400dbc0 2024-09-12T00:43:49.833 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command sync trace active hook 0x7f339400dbc0 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 5 asok(0x5650f74e52b0) register_command sync trace active_short hook 0x7f339400dbc0 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 Filter name: none 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:43:49.683+0000 7f31d1ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 : miss 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:49.834 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:43:49.683+0000 7f33a518f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:43:49.691+0000 7f33a518f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39, ofs0, ns] 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94905749601696 notifier 7941 bl.length()=931 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:43:49.695+0000 7f32867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_sources= new_sources= 2024-09-12T00:43:49.835 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential sources added=[] removed=[] 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_dests= new_dests= 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:43:49.695+0000 7f33a518f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential dests added=[] removed=[] 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.0 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.0 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.1 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.1.1 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:43:49.699+0000 7f33a518f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.0 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:43:49.707+0000 7f33a518f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f33a518f9c0 time 2024-09-12T00:43:49.711131+0000 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f33a8a692eb] 2024-09-12T00:43:49.836 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f33a8a6949f] 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650f4f9ccc1] 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5650f4fb101c] 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5650f4fb26a4] 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f33a78cfd90] 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:43:49.707+0000 7f33a518f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f33a518f9c0 thread_name:radosgw-admin 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f33a78e8520] 2024-09-12T00:43:49.837 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f33a8a69345] 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f33a8a6949f] 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650f4f9ccc1] 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5650f4fb101c] 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5650f4fb26a4] 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f33a78cfd90] 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:49.838 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:43:49.839 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:43:49.840 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:43:49.841 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:43:49.842 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:43:49.843 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:43:49.844 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 7f31d1ffb640 / http_manager 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 7f31d3fff640 / http_manager 2024-09-12T00:43:49.845 INFO:tasks.workunit.client.0.smithi137.stderr: 7f32597e2640 / rgw_dt_lg_renew 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f3284ff9640 / ms_dispatch 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f32867fc640 / io_context_pool 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f328ce01640 / ms_dispatch 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f328f606640 / ms_dispatch 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f3290e09640 / io_context_pool 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a2494640 / msgr-worker-2 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a2c95640 / msgr-worker-1 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a3496640 / msgr-worker-0 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a3c97640 / io_context_pool 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: 7f33a518f9c0 / radosgw-admin 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:43:49.713651Z_5945b0ff-66c7-492d-98a1-1e13031a8350/log 2024-09-12T00:43:49.846 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:43:49.847 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:43:49.847 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:43:49.848 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.848 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.795+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.795+0000 7f2090ede9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.795+0000 7f2090ede9c0 20 realm 2024-09-12T00:43:49.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.795+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.799+0000 7f2090ede9c0 20 searching for the correct realm 2024-09-12T00:43:49.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:49.803+0000 7f208e1e3640 0 -- 172.21.15.137:0/1199782510 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f208405ea70 msgr2=0x7f2084083960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:50.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.015+0000 7f208f1e5640 0 -- 172.21.15.137:0/1199782510 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x563e43903aa0 msgr2=0x563e43905eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:50.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.027+0000 7f2090ede9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:50.029 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.027+0000 7f2090ede9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:50.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.027+0000 7f2090ede9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:50.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.027+0000 7f2090ede9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:50.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.027+0000 7f2090ede9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:50.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.027+0000 7f2090ede9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:50.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.027+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:50.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 zone default found 2024-09-12T00:43:50.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 4 Realm: () 2024-09-12T00:43:50.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:50.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:50.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:50.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 zonegroup default 2024-09-12T00:43:50.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.031+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.035+0000 7f2090ede9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.035+0000 7f2090ede9c0 20 started sync module instance, tier type = 2024-09-12T00:43:50.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.035+0000 7f2090ede9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:50.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.055+0000 7f2090ede9c0 20 add_watcher() i=0 2024-09-12T00:43:50.055 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.055+0000 7f2090ede9c0 20 add_watcher() i=1 2024-09-12T00:43:50.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.055+0000 7f2090ede9c0 20 add_watcher() i=2 2024-09-12T00:43:50.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.055+0000 7f2090ede9c0 20 add_watcher() i=3 2024-09-12T00:43:50.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.055+0000 7f2090ede9c0 20 add_watcher() i=4 2024-09-12T00:43:50.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.055+0000 7f2090ede9c0 20 add_watcher() i=5 2024-09-12T00:43:50.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.055+0000 7f2090ede9c0 20 add_watcher() i=6 2024-09-12T00:43:50.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.059+0000 7f2090ede9c0 20 add_watcher() i=7 2024-09-12T00:43:50.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.059+0000 7f2090ede9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:50.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f1f457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f2090ede9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:50.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f2090ede9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:50.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f2090ede9c0 5 note: GC not initialized 2024-09-12T00:43:50.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f1ebffff640 20 reqs_thread_entry: start 2024-09-12T00:43:50.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f2090ede9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:50.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f2090ede9c0 20 Filter name: none 2024-09-12T00:43:50.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f1ebdffb640 20 reqs_thread_entry: start 2024-09-12T00:43:50.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.063+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:50.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:43:50.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:50.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:50.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:43:50.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.067+0000 7f2090ede9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:50.072 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.071+0000 7f1f457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.075+0000 7f2090ede9c0 20 remove_watcher() i=0 2024-09-12T00:43:50.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.075+0000 7f2090ede9c0 2 removed watcher, disabling cache 2024-09-12T00:43:50.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.079+0000 7f2090ede9c0 20 remove_watcher() i=1 2024-09-12T00:43:50.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.079+0000 7f2090ede9c0 20 remove_watcher() i=2 2024-09-12T00:43:50.083 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.083+0000 7f2090ede9c0 20 remove_watcher() i=3 2024-09-12T00:43:50.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.083+0000 7f2090ede9c0 20 remove_watcher() i=4 2024-09-12T00:43:50.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.087+0000 7f2090ede9c0 20 remove_watcher() i=5 2024-09-12T00:43:50.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.091+0000 7f2090ede9c0 20 remove_watcher() i=6 2024-09-12T00:43:50.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.091+0000 7f2090ede9c0 20 remove_watcher() i=7 2024-09-12T00:43:50.110 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:50.110 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:43:50.110 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-change-reshard-state id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:43:50.110 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:43:50.111 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:50.111 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:50.125 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:50.126 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:43:50.172 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:43:50.209 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:50.209 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:50.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.251+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 realm 2024-09-12T00:43:50.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:50.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:50.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.255+0000 7f63c14359c0 20 searching for the correct realm 2024-09-12T00:43:50.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.263+0000 7f63bef3b640 0 -- 172.21.15.137:0/2631050736 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f63b0048070 msgr2=0x7f63b004a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:50.270 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.271+0000 7f63bef3b640 0 -- 172.21.15.137:0/2631050736 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f63b8014030 msgr2=0x7f63b8078370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:50.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:50.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:43:50.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:43:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.275+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:50.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 zone default found 2024-09-12T00:43:50.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 4 Realm: () 2024-09-12T00:43:50.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:43:50.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:43:50.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:50.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 zonegroup default 2024-09-12T00:43:50.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.279 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 started sync module instance, tier type = 2024-09-12T00:43:50.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.279+0000 7f63c14359c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:43:50.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 20 add_watcher() i=0 2024-09-12T00:43:50.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 20 add_watcher() i=1 2024-09-12T00:43:50.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 20 add_watcher() i=2 2024-09-12T00:43:50.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 20 add_watcher() i=3 2024-09-12T00:43:50.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 20 add_watcher() i=4 2024-09-12T00:43:50.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 20 add_watcher() i=5 2024-09-12T00:43:50.299 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 20 add_watcher() i=6 2024-09-12T00:43:50.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 20 add_watcher() i=7 2024-09-12T00:43:50.302 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.299+0000 7f63c14359c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:50.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.303+0000 7f6275fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:50.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:50.306 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 5 note: GC not initialized 2024-09-12T00:43:50.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f6274fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:50.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 20 init_complete bucket index max shards: 1 2024-09-12T00:43:50.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 20 Filter name: none 2024-09-12T00:43:50.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f626dffb640 20 reqs_thread_entry: start 2024-09-12T00:43:50.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:43:50.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:50.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:43:50.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:43:50.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 : miss 2024-09-12T00:43:50.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.308 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:43:50.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:43:50.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:43:50.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:50.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:43:50.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.307+0000 7f63c14359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 2024-09-12T00:43:50.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.311+0000 7f63c14359c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to be held by another RGW process; skipping for now 2024-09-12T00:43:50.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.311+0000 7f6275fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.315+0000 7f63c14359c0 20 remove_watcher() i=0 2024-09-12T00:43:50.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.315+0000 7f63c14359c0 2 removed watcher, disabling cache 2024-09-12T00:43:50.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.315+0000 7f63c14359c0 20 remove_watcher() i=1 2024-09-12T00:43:50.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.319+0000 7f63c14359c0 20 remove_watcher() i=2 2024-09-12T00:43:50.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.319+0000 7f63c14359c0 20 remove_watcher() i=3 2024-09-12T00:43:50.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.323+0000 7f63c14359c0 20 remove_watcher() i=4 2024-09-12T00:43:50.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.323+0000 7f63c14359c0 20 remove_watcher() i=5 2024-09-12T00:43:50.328 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.327+0000 7f63c14359c0 20 remove_watcher() i=6 2024-09-12T00:43:50.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:43:50.331+0000 7f63c14359c0 20 remove_watcher() i=7 2024-09-12T00:43:50.344 INFO:tasks.workunit.client.0.smithi137.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:44:20.371 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:44:20.408 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:20.408 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:20.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.454+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.458+0000 7f718442d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.458+0000 7f718442d9c0 20 realm 2024-09-12T00:44:20.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.458+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.458+0000 7f718442d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.458+0000 7f718442d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:20.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.458+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.458+0000 7f718442d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.458+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.462+0000 7f718442d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:20.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.462+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.462+0000 7f718442d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:20.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.462+0000 7f718442d9c0 20 searching for the correct realm 2024-09-12T00:44:20.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.466+0000 7f7182734640 0 -- 172.21.15.137:0/817296011 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f7178015070 msgr2=0x7f7178083730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:20.470 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.474+0000 7f7181f33640 0 -- 172.21.15.137:0/817296011 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f717c0f99c0 msgr2=0x7f717c0f9430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:20.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:20.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:20.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:20.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:20.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:20.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:20.479 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:20.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:20.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 zone default found 2024-09-12T00:44:20.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 4 Realm: () 2024-09-12T00:44:20.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:20.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:20.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:20.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 zonegroup default 2024-09-12T00:44:20.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.482+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.486+0000 7f718442d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.486+0000 7f718442d9c0 20 started sync module instance, tier type = 2024-09-12T00:44:20.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.486+0000 7f718442d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:20.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.502+0000 7f718442d9c0 20 add_watcher() i=0 2024-09-12T00:44:20.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.502+0000 7f718442d9c0 20 add_watcher() i=1 2024-09-12T00:44:20.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.502+0000 7f718442d9c0 20 add_watcher() i=2 2024-09-12T00:44:20.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.502+0000 7f718442d9c0 20 add_watcher() i=3 2024-09-12T00:44:20.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.502+0000 7f718442d9c0 20 add_watcher() i=4 2024-09-12T00:44:20.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.502+0000 7f718442d9c0 20 add_watcher() i=5 2024-09-12T00:44:20.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.502+0000 7f718442d9c0 20 add_watcher() i=6 2024-09-12T00:44:20.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.506+0000 7f718442d9c0 20 add_watcher() i=7 2024-09-12T00:44:20.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.506+0000 7f718442d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:20.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f7037fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:20.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:20.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:20.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 5 note: GC not initialized 2024-09-12T00:44:20.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f7036fe5640 20 reqs_thread_entry: start 2024-09-12T00:44:20.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:20.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 20 Filter name: none 2024-09-12T00:44:20.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f7034fe1640 20 reqs_thread_entry: start 2024-09-12T00:44:20.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:44:20.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:44:20.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:44:20.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:44:20.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 : miss 2024-09-12T00:44:20.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.510+0000 7f718442d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.514+0000 7f718442d9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:44:20.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.514+0000 7f718442d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:44:20.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.514+0000 7f718442d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:44:20.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.514+0000 7f718442d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:20.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.514+0000 7f718442d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:44:20.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.514+0000 7f718442d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 2024-09-12T00:44:20.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.514+0000 7f718442d9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:44:20.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.522+0000 7f718442d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:44:20.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.522+0000 7f718442d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:44:20.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.522+0000 7f718442d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:44:20.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.522+0000 7f718442d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39, ofs0, ns] 2024-09-12T00:44:20.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.526+0000 7f70657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94221067725376 notifier 7989 bl.length()=931 2024-09-12T00:44:20.522 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.526+0000 7f70657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:44:20.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.526+0000 7f70657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:44:20.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.526+0000 7f70657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:44:20.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.526+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_sources= new_sources= 2024-09-12T00:44:20.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.526+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential sources added=[] removed=[] 2024-09-12T00:44:20.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.526+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_dests= new_dests= 2024-09-12T00:44:20.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.526+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential dests added=[] removed=[] 2024-09-12T00:44:20.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.534+0000 7f718442d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.2.0 2024-09-12T00:44:20.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.534+0000 7f718442d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.2.0 2024-09-12T00:44:20.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.534+0000 7f718442d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.2.1 2024-09-12T00:44:20.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.534+0000 7f718442d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.2.1 2024-09-12T00:44:20.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.534+0000 7f718442d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.0 2024-09-12T00:44:20.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.538+0000 7f718442d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:44:20.536 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.538+0000 7f718442d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 2024-09-12T00:44:20.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f718442d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:44:20.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f718442d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:44:20.539 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f718442d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:44:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f718442d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39, ofs0, ns] 2024-09-12T00:44:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f7064ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94221067725376 notifier 7989 bl.length()=931 2024-09-12T00:44:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f7064ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:44:20.540 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f7064ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:44:20.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f7064ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:44:20.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_sources= new_sources= 2024-09-12T00:44:20.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential sources added=[] removed=[] 2024-09-12T00:44:20.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_dests= new_dests= 2024-09-12T00:44:20.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.542+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential dests added=[] removed=[] 2024-09-12T00:44:20.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.546+0000 7f718442d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39.0 2024-09-12T00:44:20.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.546+0000 7f718442d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:44:20.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.546+0000 7f718442d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 2024-09-12T00:44:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f718442d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:44:20.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f718442d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:44:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f718442d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:44:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f718442d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39, ofs0, ns] 2024-09-12T00:44:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f70657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94221067725376 notifier 7989 bl.length()=899 2024-09-12T00:44:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f70657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 info.flags=0x17 2024-09-12T00:44:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f70657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 to cache LRU end 2024-09-12T00:44:20.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f70657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:44:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_sources= new_sources= 2024-09-12T00:44:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential sources added=[] removed=[] 2024-09-12T00:44:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): orig_dests= new_dests= 2024-09-12T00:44:20.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.550+0000 7f718442d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39]): potential dests added=[] removed=[] 2024-09-12T00:44:20.552 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.554+0000 7f718442d9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:44:20.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.558+0000 7f7037fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:20.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.562+0000 7f718442d9c0 20 remove_watcher() i=0 2024-09-12T00:44:20.559 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.562+0000 7f718442d9c0 2 removed watcher, disabling cache 2024-09-12T00:44:20.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.562+0000 7f718442d9c0 20 remove_watcher() i=1 2024-09-12T00:44:20.563 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.566+0000 7f718442d9c0 20 remove_watcher() i=2 2024-09-12T00:44:20.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.566+0000 7f718442d9c0 20 remove_watcher() i=3 2024-09-12T00:44:20.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.570+0000 7f718442d9c0 20 remove_watcher() i=4 2024-09-12T00:44:20.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.570+0000 7f718442d9c0 20 remove_watcher() i=5 2024-09-12T00:44:20.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.574+0000 7f718442d9c0 20 remove_watcher() i=6 2024-09-12T00:44:20.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.578+0000 7f718442d9c0 20 remove_watcher() i=7 2024-09-12T00:44:20.592 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:44:20.622 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:20.623 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:20.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.670+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 realm 2024-09-12T00:44:20.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:20.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.672 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:20.673 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.674+0000 7f2c2689c9c0 20 searching for the correct realm 2024-09-12T00:44:20.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.678+0000 7f2c243a2640 0 -- 172.21.15.137:0/640500412 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f2c14015030 msgr2=0x7f2c14074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:20.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:20.890+0000 7f2c243a2640 0 -- 172.21.15.137:0/640500412 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f2c1c008040 msgr2=0x7f2c1c024910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:21.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:21.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:21.107 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:21.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:21.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:21.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:21.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:21.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 zone default found 2024-09-12T00:44:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 4 Realm: () 2024-09-12T00:44:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 zonegroup default 2024-09-12T00:44:21.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.110+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.114+0000 7f2c2689c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.114+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.114+0000 7f2c2689c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.114+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.114+0000 7f2c2689c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.114+0000 7f2c2689c9c0 20 started sync module instance, tier type = 2024-09-12T00:44:21.112 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.114+0000 7f2c2689c9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:21.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.138+0000 7f2c2689c9c0 20 add_watcher() i=0 2024-09-12T00:44:21.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.138+0000 7f2c2689c9c0 20 add_watcher() i=1 2024-09-12T00:44:21.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.138+0000 7f2c2689c9c0 20 add_watcher() i=2 2024-09-12T00:44:21.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.138+0000 7f2c2689c9c0 20 add_watcher() i=3 2024-09-12T00:44:21.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.138+0000 7f2c2689c9c0 20 add_watcher() i=4 2024-09-12T00:44:21.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.138+0000 7f2c2689c9c0 20 add_watcher() i=5 2024-09-12T00:44:21.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.138+0000 7f2c2689c9c0 20 add_watcher() i=6 2024-09-12T00:44:21.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.142+0000 7f2c2689c9c0 20 add_watcher() i=7 2024-09-12T00:44:21.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.142+0000 7f2c2689c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:21.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.146+0000 7f2adafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:21.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.146+0000 7f2c2689c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:21.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.146+0000 7f2c2689c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:21.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.146+0000 7f2c2689c9c0 5 note: GC not initialized 2024-09-12T00:44:21.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.146+0000 7f2ad9fdb640 20 reqs_thread_entry: start 2024-09-12T00:44:21.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.146+0000 7f2c2689c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:21.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.150+0000 7f2c2689c9c0 20 Filter name: none 2024-09-12T00:44:21.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.150+0000 7f2a4b7fe640 20 reqs_thread_entry: start 2024-09-12T00:44:21.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.150+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.150+0000 7f2c2689c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:44:21.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.150+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.150+0000 7f2c2689c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:44:21.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.150+0000 7f2c2689c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:21.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.150+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.154+0000 7f2c2689c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:44:21.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.154+0000 7f2c2689c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.154+0000 7f2c2689c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:44:21.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.154+0000 7f2c2689c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:21.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.154+0000 7f2adafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:21.157 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.158+0000 7f2c2689c9c0 20 remove_watcher() i=0 2024-09-12T00:44:21.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.158+0000 7f2c2689c9c0 2 removed watcher, disabling cache 2024-09-12T00:44:21.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.162+0000 7f2c2689c9c0 20 remove_watcher() i=1 2024-09-12T00:44:21.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.166+0000 7f2c2689c9c0 20 remove_watcher() i=2 2024-09-12T00:44:21.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.166+0000 7f2c2689c9c0 20 remove_watcher() i=3 2024-09-12T00:44:21.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.170+0000 7f2c2689c9c0 20 remove_watcher() i=4 2024-09-12T00:44:21.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.170+0000 7f2c2689c9c0 20 remove_watcher() i=5 2024-09-12T00:44:21.171 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.174+0000 7f2c2689c9c0 20 remove_watcher() i=6 2024-09-12T00:44:21.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.178+0000 7f2c2689c9c0 20 remove_watcher() i=7 2024-09-12T00:44:21.191 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:21.192 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:44:21.192 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: abort-at-change-reshard-state id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:44:21.192 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:21.193 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:44:21.193 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:44:21.197 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:44:21.197 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:44:21.250 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:44:21.250 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:44:21.275 INFO:tasks.workunit.client.0.smithi137.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:44:21.275 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:44:21.303 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:21.303 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:21.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.346+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 realm 2024-09-12T00:44:21.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:21.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:21.349 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.350+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.354+0000 7fa8fe5da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:21.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.354+0000 7fa8fe5da9c0 20 searching for the correct realm 2024-09-12T00:44:21.356 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.358+0000 7fa8fb8df640 0 -- 172.21.15.137:0/3903520611 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fa8f0031c10 msgr2=0x7fa8f0026400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:21.361 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.362+0000 7fa8fc0e0640 0 -- 172.21.15.137:0/3903520611 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fa8f40aa030 msgr2=0x7fa8f40fd920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:21.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:21.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:21.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:21.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:21.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:21.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:21.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.370+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:21.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 zone default found 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 4 Realm: () 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 zonegroup default 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 started sync module instance, tier type = 2024-09-12T00:44:21.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.374+0000 7fa8fe5da9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:21.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.390+0000 7fa8fe5da9c0 20 add_watcher() i=0 2024-09-12T00:44:21.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.390+0000 7fa8fe5da9c0 20 add_watcher() i=1 2024-09-12T00:44:21.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.390+0000 7fa8fe5da9c0 20 add_watcher() i=2 2024-09-12T00:44:21.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.390+0000 7fa8fe5da9c0 20 add_watcher() i=3 2024-09-12T00:44:21.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.390+0000 7fa8fe5da9c0 20 add_watcher() i=4 2024-09-12T00:44:21.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.390+0000 7fa8fe5da9c0 20 add_watcher() i=5 2024-09-12T00:44:21.390 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.390+0000 7fa8fe5da9c0 20 add_watcher() i=6 2024-09-12T00:44:21.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.394+0000 7fa8fe5da9c0 20 add_watcher() i=7 2024-09-12T00:44:21.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.394+0000 7fa8fe5da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:21.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa7b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:21.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:21.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:21.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 5 note: GC not initialized 2024-09-12T00:44:21.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa7b1fdb640 20 reqs_thread_entry: start 2024-09-12T00:44:21.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:21.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 Filter name: none 2024-09-12T00:44:21.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa7237fe640 20 reqs_thread_entry: start 2024-09-12T00:44:21.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:21.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:21.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:21.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:21.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:21.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.398+0000 7fa8fe5da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:21.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.402+0000 7fa7b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:21.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.406+0000 7fa8fe5da9c0 20 remove_watcher() i=0 2024-09-12T00:44:21.403 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.406+0000 7fa8fe5da9c0 2 removed watcher, disabling cache 2024-09-12T00:44:21.405 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.406+0000 7fa8fe5da9c0 20 remove_watcher() i=1 2024-09-12T00:44:21.407 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.410+0000 7fa8fe5da9c0 20 remove_watcher() i=2 2024-09-12T00:44:21.409 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.410+0000 7fa8fe5da9c0 20 remove_watcher() i=3 2024-09-12T00:44:21.411 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.414+0000 7fa8fe5da9c0 20 remove_watcher() i=4 2024-09-12T00:44:21.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.414+0000 7fa8fe5da9c0 20 remove_watcher() i=5 2024-09-12T00:44:21.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.418+0000 7fa8fe5da9c0 20 remove_watcher() i=6 2024-09-12T00:44:21.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.422+0000 7fa8fe5da9c0 20 remove_watcher() i=7 2024-09-12T00:44:21.432 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:21.433 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:44:21.433 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: a-bucket id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:44:21.433 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:21.433 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:44:21.459 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:21.460 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:21.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.506+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.506+0000 7f549d16b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.506+0000 7f549d16b9c0 20 realm 2024-09-12T00:44:21.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.506+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.506+0000 7f549d16b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.506+0000 7f549d16b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:21.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.506+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.510+0000 7f549d16b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.510+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.510+0000 7f549d16b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:21.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.510+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.510+0000 7f549d16b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:21.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.510+0000 7f549d16b9c0 20 searching for the correct realm 2024-09-12T00:44:21.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.514+0000 7f549ac71640 0 -- 172.21.15.137:0/3239014767 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f548c03c070 msgr2=0x7f548c087980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:21.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.726+0000 7f549ac71640 0 -- 172.21.15.137:0/3239014767 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x5647eb63e340 msgr2=0x7f54940c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:21.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:21.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 zone default found 2024-09-12T00:44:21.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 4 Realm: () 2024-09-12T00:44:21.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:21.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:21.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:21.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 zonegroup default 2024-09-12T00:44:21.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.946+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.950+0000 7f549d16b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.950+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.950+0000 7f549d16b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:21.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.950+0000 7f549d16b9c0 20 started sync module instance, tier type = 2024-09-12T00:44:21.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.950+0000 7f549d16b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:21.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 20 add_watcher() i=0 2024-09-12T00:44:21.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 20 add_watcher() i=1 2024-09-12T00:44:21.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 20 add_watcher() i=2 2024-09-12T00:44:21.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 20 add_watcher() i=3 2024-09-12T00:44:21.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 20 add_watcher() i=4 2024-09-12T00:44:21.970 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 20 add_watcher() i=5 2024-09-12T00:44:21.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 20 add_watcher() i=6 2024-09-12T00:44:21.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 20 add_watcher() i=7 2024-09-12T00:44:21.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.974+0000 7f549d16b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:21.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.978+0000 7f53517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:21.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.978+0000 7f549d16b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:21.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.978+0000 7f549d16b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:21.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.978+0000 7f549d16b9c0 5 note: GC not initialized 2024-09-12T00:44:21.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f52cbfff640 20 reqs_thread_entry: start 2024-09-12T00:44:21.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:21.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 Filter name: none 2024-09-12T00:44:21.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f52c9ffb640 20 reqs_thread_entry: start 2024-09-12T00:44:21.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:21.979 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:21.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:21.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:21.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:21.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:21.981 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.982+0000 7f549d16b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:21.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.986+0000 7f53517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:21.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.994+0000 7f549d16b9c0 20 remove_watcher() i=0 2024-09-12T00:44:21.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.994+0000 7f549d16b9c0 2 removed watcher, disabling cache 2024-09-12T00:44:21.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.994+0000 7f549d16b9c0 20 remove_watcher() i=1 2024-09-12T00:44:21.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.998+0000 7f549d16b9c0 20 remove_watcher() i=2 2024-09-12T00:44:21.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:21.998+0000 7f549d16b9c0 20 remove_watcher() i=3 2024-09-12T00:44:21.998 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.002+0000 7f549d16b9c0 20 remove_watcher() i=4 2024-09-12T00:44:22.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.002+0000 7f549d16b9c0 20 remove_watcher() i=5 2024-09-12T00:44:22.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.006+0000 7f549d16b9c0 20 remove_watcher() i=6 2024-09-12T00:44:22.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.010+0000 7f549d16b9c0 20 remove_watcher() i=7 2024-09-12T00:44:22.022 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:44:22.059 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:22.059 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:22.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 realm 2024-09-12T00:44:22.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:22.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.110+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:22.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.110+0000 7f2bc3b2d9c0 20 searching for the correct realm 2024-09-12T00:44:22.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.114+0000 7f2bc1633640 0 -- 172.21.15.137:0/2646439599 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f2bb403e060 msgr2=0x7f2bb4079b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:22.119 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.122+0000 7f2bc1633640 0 -- 172.21.15.137:0/2646439599 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f2bbc018040 msgr2=0x7f2bbc029430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:22.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:22.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:22.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:22.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:22.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:22.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:22.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:22.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 zone default found 2024-09-12T00:44:22.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 Realm: () 2024-09-12T00:44:22.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:22.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:22.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:22.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 zonegroup default 2024-09-12T00:44:22.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.129 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 started sync module instance, tier type = 2024-09-12T00:44:22.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:22.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=0 2024-09-12T00:44:22.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=1 2024-09-12T00:44:22.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=2 2024-09-12T00:44:22.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=3 2024-09-12T00:44:22.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=4 2024-09-12T00:44:22.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=5 2024-09-12T00:44:22.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=6 2024-09-12T00:44:22.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=7 2024-09-12T00:44:22.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:22.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2a777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:22.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:22.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:22.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 note: GC not initialized 2024-09-12T00:44:22.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2a767e4640 20 reqs_thread_entry: start 2024-09-12T00:44:22.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:22.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 Filter name: none 2024-09-12T00:44:22.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f29e7fff640 20 reqs_thread_entry: start 2024-09-12T00:44:22.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:22.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:22.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:22.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.162 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94732427583104 notifier 7664 bl.length()=827 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:44:22.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:44:22.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:44:22.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:44:22.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.1 2024-09-12T00:44:22.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.1 2024-09-12T00:44:22.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.2 2024-09-12T00:44:22.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.2 2024-09-12T00:44:22.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.3 2024-09-12T00:44:22.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.3 2024-09-12T00:44:22.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:22.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:22.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:22.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:22.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:22.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:22.172 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2bc3b2d9c0 time 2024-09-12T00:44:22.176969+0000 2024-09-12T00:44:22.172 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:44:22.174 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:22.174 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2bc74072eb] 2024-09-12T00:44:22.174 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2bc740749f] 2024-09-12T00:44:22.174 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56289b174cc1] 2024-09-12T00:44:22.174 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x56289b18901c] 2024-09-12T00:44:22.174 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56289b18a6a4] 2024-09-12T00:44:22.174 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bc626dd90] 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f2bc3b2d9c0 thread_name:radosgw-admin 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.174+0000 7f2bc3b2d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2bc3b2d9c0 time 2024-09-12T00:44:22.176969+0000 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2bc74072eb] 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2bc740749f] 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56289b174cc1] 2024-09-12T00:44:22.175 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x56289b18901c] 2024-09-12T00:44:22.176 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56289b18a6a4] 2024-09-12T00:44:22.176 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:44:22.176 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bc626dd90] 2024-09-12T00:44:22.176 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:44:22.176 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:44:22.176 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.195 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:22.195 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2bc6286520] 2024-09-12T00:44:22.195 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:44:22.195 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2bc7407345] 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2bc740749f] 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56289b174cc1] 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x56289b18901c] 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56289b18a6a4] 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bc626dd90] 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.178+0000 7f2bc3b2d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:44:22.196 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f2bc3b2d9c0 thread_name:radosgw-admin 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2bc6286520] 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2bc7407345] 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2bc740749f] 2024-09-12T00:44:22.197 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56289b174cc1] 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x56289b18901c] 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56289b18a6a4] 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bc626dd90] 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 4 set_mon_vals no callback set 2024-09-12T00:44:22.198 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:44:22.082+0000 7f2aaf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:44:22.082+0000 7f2aaf606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:44:22.082+0000 7f2aaf606640 10 monclient: dump: 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.199 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 10 monclient: shutdown 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) unregister_commands rotate-key 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 10 monclient: build_initial_monmap 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 10 monclient: monmap: 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:22.200 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.201 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding auth protocol: cephx 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding auth protocol: cephx 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding auth protocol: cephx 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.202 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: starting msgr at 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: starting objecter 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command objecter_requests hook 0x56289c7fc670 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: setting wanted keys 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: calling monclient init 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: init 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding auth protocol: cephx 2024-09-12T00:44:22.203 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding auth protocol: cephx 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding auth protocol: cephx 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.204 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command rotate-key hook 0x56289ca26b38 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:44:22.205 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x56289c8b3e00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x56289c8d6920 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x56289c96ece0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): authenticate will time out at 2363.217055s 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request con 0x56289c8d6920 auth_method 0 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request con 0x56289c96ece0 auth_method 0 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.206 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_done global_id 7655 payload 824 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient: _finish_hunting 0 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 1 monclient: found mon.noname-c 2024-09-12T00:44:22.207 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: dump: 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.208 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: _finish_auth 0 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: _check_auth_tickets 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 monclient: authenticate success, global_id 7655 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.209 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: dump: 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.210 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:44:22.086+0000 7f2aaf606640 4 set_mon_vals no callback set 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: init done 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:44:22.086+0000 7f2aade03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:44:22.086+0000 7f2aade03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:44:22.086+0000 7f2aade03640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:44:22.090+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2aa8070ae0 auth_method 0 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:44:22.090+0000 7f2bc1e34640 10 monclient: get_auth_request con 0x56289ca653c0 auth_method 0 2024-09-12T00:44:22.211 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:44:22.090+0000 7f2bc1633640 10 monclient: get_auth_request con 0x56289ca71650 auth_method 0 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x56289ca74e80 auth_method 0 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: build_initial_monmap 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: monmap: 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:22.212 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding auth protocol: cephx 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding auth protocol: cephx 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding auth protocol: cephx 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.213 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command objecter_requests cmddesc objecter_requests hook 0x56289ca7e0e0 EEXIST 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: init 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding auth protocol: cephx 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding auth protocol: cephx 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding auth protocol: cephx 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.214 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command rotate-key cmddesc rotate-key hook 0x56289ca79790 EEXIST 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x56289caa2290 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x56289caa1bc0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:22.215 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x56289caa05a0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): authenticate will time out at 2363.226522s 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): get_auth_request con 0x56289caa2290 auth_method 0 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request con 0x56289caa05a0 auth_method 0 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.216 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request con 0x56289caa1bc0 auth_method 0 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): handle_auth_done global_id 7658 payload 824 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient: _finish_hunting 0 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:44:22.094+0000 7f2bc1633640 1 monclient: found mon.noname-c 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.217 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: dump: 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:44:22.218 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: dump: 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.219 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:44:22.094+0000 7f2bc2635640 4 set_mon_vals no callback set 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 monclient: authenticate success, global_id 7658 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:44:22.098+0000 7f2aa6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:44:22.098+0000 7f2aa6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:44:22.098+0000 7f2aa6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x7f2a98070a20 auth_method 0 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: get_monmap_and_config 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: build_initial_monmap 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:22.220 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: monmap: 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding auth protocol: cephx 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding auth protocol: cephx 2024-09-12T00:44:22.221 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding auth protocol: cephx 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.222 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: init 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding auth protocol: cephx 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding auth protocol: cephx 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding auth protocol: cephx 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.223 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff23d1318 EEXIST 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x56289cac5af0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x56289cac5ed0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x56289caf5eb0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.224 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): authenticate will time out at 2363.230800s 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request con 0x56289cac5ed0 auth_method 0 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request con 0x56289caf5eb0 auth_method 0 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.225 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_done global_id 8058 payload 274 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient: _finish_hunting 0 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 1 monclient: found mon.noname-a 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: dump: 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.226 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:22.227 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 monclient: authenticate success, global_id 8058 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 4 set_mon_vals no callback set 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: dump: 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.228 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: shutdown 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: build_initial_monmap 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: monmap: 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:22.229 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding auth protocol: cephx 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding auth protocol: cephx 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding auth protocol: cephx 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.230 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: starting msgr at 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: starting objecter 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command objecter_requests cmddesc objecter_requests hook 0x56289caf31d0 EEXIST 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: setting wanted keys 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: calling monclient init 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: init 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding auth protocol: cephx 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding auth protocol: cephx 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding auth protocol: cephx 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.231 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.232 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command rotate-key cmddesc rotate-key hook 0x56289caa41f8 EEXIST 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x56289cac5af0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x56289caf5eb0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x56289caeead0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.233 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): authenticate will time out at 2363.233352s 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): get_auth_request con 0x56289cac5af0 auth_method 0 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request con 0x56289caf5eb0 auth_method 0 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.234 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient: _finish_hunting 0 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:44:22.102+0000 7f2bc1633640 1 monclient: found mon.noname-c 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: dump: 2024-09-12T00:44:22.235 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.236 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: _finish_auth 0 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 monclient: authenticate success, global_id 7664 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: dump: 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.237 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:44:22.102+0000 7f2aa4ff9640 4 set_mon_vals no callback set 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: init done 2024-09-12T00:44:22.238 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cr dump hook 0x56289caeef48 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:44:22.106+0000 7f2a96ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:44:22.106+0000 7f2a96ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:44:22.106+0000 7f2a96ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:44:22.106+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x7f2a8c070ae0 auth_method 0 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:44:22.106+0000 7f2bc1e34640 10 monclient: get_auth_request con 0x56289cb0ffa0 auth_method 0 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 realm 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:22.239 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:44:22.106+0000 7f2bc1633640 10 monclient: get_auth_request con 0x56289cb14230 auth_method 0 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:44:22.110+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:44:22.110+0000 7f2bc3b2d9c0 20 searching for the correct realm 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:44:22.110+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x56289cb194e0 auth_method 0 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:44:22.110+0000 7f2bc1e34640 10 monclient: get_auth_request con 0x7f2bb80f3c60 auth_method 0 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:44:22.114+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2bb403e060 auth_method 0 2024-09-12T00:44:22.240 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:44:22.114+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x7f2bb80f6610 auth_method 0 2024-09-12T00:44:22.241 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:44:22.114+0000 7f2bc1633640 0 -- 172.21.15.137:0/2646439599 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f2bb403e060 msgr2=0x7f2bb4079b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:22.241 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:44:22.114+0000 7f2a96ffd640 1 client.7664.objecter ms_handle_reset 0x7f2bb403e060 session 0x7f2bb401e070 osd.0 2024-09-12T00:44:22.241 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:44:22.114+0000 7f2a96ffd640 10 monclient: _renew_subs 2024-09-12T00:44:22.241 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:44:22.114+0000 7f2a96ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.241 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:44:22.114+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2a8c080e10 auth_method 0 2024-09-12T00:44:22.241 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:44:22.118+0000 7f2bc1e34640 10 monclient: get_auth_request con 0x7f2bb4027040 auth_method 0 2024-09-12T00:44:22.242 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:44:22.118+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2bbc018040 auth_method 0 2024-09-12T00:44:22.242 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:44:22.122+0000 7f2bc1633640 0 -- 172.21.15.137:0/2646439599 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f2bbc018040 msgr2=0x7f2bbc029430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:22.242 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:44:22.122+0000 7f2a96ffd640 1 client.7664.objecter ms_handle_reset 0x7f2bbc018040 session 0x7f2bbc02f040 osd.3 2024-09-12T00:44:22.242 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:44:22.122+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2bb403e060 auth_method 0 2024-09-12T00:44:22.242 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:22.243 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:22.243 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:22.243 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:22.243 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:22.243 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:22.243 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.243 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 zone default found 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 Realm: () 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:22.244 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 zonegroup default 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 started sync module instance, tier type = 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=0 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=1 2024-09-12T00:44:22.245 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=2 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=3 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=4 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=5 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=6 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=7 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding auth protocol: cephx 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding auth protocol: cephx 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding auth protocol: cephx 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.246 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:44:22.154+0000 7f2a777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cache list hook 0x56289caeeef0 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cache inspect hook 0x56289caeeef0 2024-09-12T00:44:22.247 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cache erase hook 0x56289caeeef0 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cache zap hook 0x56289caeeef0 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 note: GC not initialized 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:44:22.154+0000 7f2a767e4640 20 reqs_thread_entry: start 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command sync trace show hook 0x7f2bb80f79b0 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command sync trace history hook 0x7f2bb80f79b0 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command sync trace active hook 0x7f2bb80f79b0 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command sync trace active_short hook 0x7f2bb80f79b0 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 Filter name: none 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:44:22.154+0000 7f29e7fff640 20 reqs_thread_entry: start 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:22.248 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.249 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94732427583104 notifier 7664 bl.length()=827 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.1 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.1 2024-09-12T00:44:22.250 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.2 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.2 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.3 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.3 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:44:22.174+0000 7f2bc3b2d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2bc3b2d9c0 time 2024-09-12T00:44:22.176969+0000 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:22.251 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2bc74072eb] 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2bc740749f] 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56289b174cc1] 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x56289b18901c] 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56289b18a6a4] 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bc626dd90] 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:44:22.178+0000 7f2bc3b2d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f2bc3b2d9c0 thread_name:radosgw-admin 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.252 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2bc6286520] 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2bc7407345] 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2bc740749f] 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56289b174cc1] 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x56289b18901c] 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56289b18a6a4] 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bc626dd90] 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:44:22.253 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:44:22.254 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:44:22.255 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:44:22.256 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:44:22.257 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:44:22.258 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:44:22.259 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 7f29e7fff640 / http_manager 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2a767e4640 / http_manager 2024-09-12T00:44:22.260 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2a777e6640 / rgw_dt_lg_renew 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2a96ffd640 / ms_dispatch 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2aa4ff9640 / io_context_pool 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2aa6ffd640 / ms_dispatch 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2aade03640 / ms_dispatch 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2aaf606640 / io_context_pool 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc0e32640 / msgr-worker-2 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc1633640 / msgr-worker-1 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc1e34640 / msgr-worker-0 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc2635640 / io_context_pool 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc3b2d9c0 / radosgw-admin 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.139643.log 2024-09-12T00:44:22.261 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 4 set_mon_vals no callback set 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:44:22.082+0000 7f2aaf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:44:22.082+0000 7f2aaf606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:44:22.082+0000 7f2aaf606640 10 monclient: dump: 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.262 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 10 monclient: shutdown 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) unregister_commands rotate-key 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 10 monclient: build_initial_monmap 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 10 monclient: monmap: 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.263 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding auth protocol: cephx 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding auth protocol: cephx 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding auth protocol: cephx 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.264 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.265 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:44:22.082+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.265 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.265 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.265 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: crc 2024-09-12T00:44:22.265 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca29a50) adding con mode: secure 2024-09-12T00:44:22.265 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.265 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: starting msgr at 2024-09-12T00:44:22.265 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: starting objecter 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command objecter_requests hook 0x56289c7fc670 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: setting wanted keys 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: calling monclient init 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: init 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding auth protocol: cephx 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding auth protocol: cephx 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding auth protocol: cephx 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.266 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: crc 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca269f0) adding con mode: secure 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.267 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command rotate-key hook 0x56289ca26b38 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x56289c8b3e00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x56289c8d6920 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x56289c96ece0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.268 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient(hunting): authenticate will time out at 2363.217055s 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request con 0x56289c8d6920 auth_method 0 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request con 0x56289c96ece0 auth_method 0 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.269 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:44:22.086+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_done global_id 7655 payload 824 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient: _finish_hunting 0 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 1 monclient: found mon.noname-c 2024-09-12T00:44:22.270 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:44:22.086+0000 7f2bc0e32640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: dump: 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.271 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: _finish_auth 0 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: _check_auth_tickets 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 5 monclient: authenticate success, global_id 7655 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.272 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:44:22.086+0000 7f2aade03640 10 monclient: dump: 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.273 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:44:22.086+0000 7f2aaf606640 4 set_mon_vals no callback set 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:44:22.086+0000 7f2bc3b2d9c0 1 librados: init done 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:44:22.086+0000 7f2aade03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:44:22.086+0000 7f2aade03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:44:22.086+0000 7f2aade03640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:44:22.090+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2aa8070ae0 auth_method 0 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:44:22.090+0000 7f2bc1e34640 10 monclient: get_auth_request con 0x56289ca653c0 auth_method 0 2024-09-12T00:44:22.274 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:44:22.090+0000 7f2bc1633640 10 monclient: get_auth_request con 0x56289ca71650 auth_method 0 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x56289ca74e80 auth_method 0 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: build_initial_monmap 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: monmap: 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:22.275 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:22.276 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.276 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:22.276 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:22.276 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:22.276 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.276 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding auth protocol: cephx 2024-09-12T00:44:22.276 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding auth protocol: cephx 2024-09-12T00:44:22.276 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding auth protocol: cephx 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.277 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: crc 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca7a6b0) adding con mode: secure 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command objecter_requests cmddesc objecter_requests hook 0x56289ca7e0e0 EEXIST 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: init 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding auth protocol: cephx 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding auth protocol: cephx 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding auth protocol: cephx 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.278 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: crc 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289ca79648) adding con mode: secure 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command rotate-key cmddesc rotate-key hook 0x56289ca79790 EEXIST 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x56289caa2290 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x56289caa1bc0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:22.279 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x56289caa05a0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient(hunting): authenticate will time out at 2363.226522s 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): get_auth_request con 0x56289caa2290 auth_method 0 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request con 0x56289caa05a0 auth_method 0 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.280 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:44:22.094+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request con 0x56289caa1bc0 auth_method 0 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:44:22.094+0000 7f2bc0e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient(hunting): handle_auth_done global_id 7658 payload 824 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient: _finish_hunting 0 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:44:22.094+0000 7f2bc1633640 1 monclient: found mon.noname-c 2024-09-12T00:44:22.281 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:44:22.094+0000 7f2bc1633640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: dump: 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.282 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:44:22.094+0000 7f2aa6ffd640 10 monclient: dump: 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.283 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:44:22.094+0000 7f2bc2635640 4 set_mon_vals no callback set 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 5 monclient: authenticate success, global_id 7658 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:44:22.094+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:44:22.098+0000 7f2aa6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:44:22.098+0000 7f2aa6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:44:22.098+0000 7f2aa6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x7f2a98070a20 auth_method 0 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: get_monmap_and_config 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: build_initial_monmap 2024-09-12T00:44:22.284 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: monmap: 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding auth protocol: cephx 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding auth protocol: cephx 2024-09-12T00:44:22.285 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding auth protocol: cephx 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: crc 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289cac1bd0) adding con mode: secure 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.286 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: init 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding auth protocol: cephx 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding auth protocol: cephx 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding auth protocol: cephx 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.287 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: crc 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d11d0) adding con mode: secure 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff23d1318 EEXIST 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x56289cac5af0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x56289cac5ed0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x56289caf5eb0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:22.288 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient(hunting): authenticate will time out at 2363.230800s 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request con 0x56289cac5ed0 auth_method 0 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request con 0x56289caf5eb0 auth_method 0 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.289 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:44:22.098+0000 7f2bc1e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_done global_id 8058 payload 274 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient: _finish_hunting 0 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 1 monclient: found mon.noname-a 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:44:22.098+0000 7f2bc0e32640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: dump: 2024-09-12T00:44:22.290 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 5 monclient: authenticate success, global_id 8058 2024-09-12T00:44:22.291 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:44:22.098+0000 7f2bc3b2d9c0 4 set_mon_vals no callback set 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:44:22.098+0000 7f2aa4ff9640 10 monclient: dump: 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.292 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: shutdown 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: build_initial_monmap 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: monmap: 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:22.293 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding auth protocol: cephx 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding auth protocol: cephx 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding auth protocol: cephx 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.294 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: crc 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caf22d0) adding con mode: secure 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: starting msgr at 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: starting objecter 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command objecter_requests cmddesc objecter_requests hook 0x56289caf31d0 EEXIST 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: setting wanted keys 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: calling monclient init 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: init 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding auth protocol: cephx 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding auth protocol: cephx 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding auth protocol: cephx 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.295 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: crc 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 AuthRegistry(0x56289caa40b0) adding con mode: secure 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command rotate-key cmddesc rotate-key hook 0x56289caa41f8 EEXIST 2024-09-12T00:44:22.296 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x56289cac5af0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x56289caf5eb0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x56289caeead0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient(hunting): authenticate will time out at 2363.233352s 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): get_auth_request con 0x56289cac5af0 auth_method 0 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.297 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request con 0x56289caf5eb0 auth_method 0 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:44:22.102+0000 7f2bc0e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient: _finish_hunting 0 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:44:22.102+0000 7f2bc1633640 1 monclient: found mon.noname-c 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:44:22.102+0000 7f2bc1633640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.298 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: dump: 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: _finish_auth 0 2024-09-12T00:44:22.299 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 monclient: authenticate success, global_id 7664 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:44:22.102+0000 7f2a96ffd640 10 monclient: dump: 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:22.300 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:44:22.102+0000 7f2aa4ff9640 4 set_mon_vals no callback set 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _renew_subs 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 1 librados: init done 2024-09-12T00:44:22.301 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cr dump hook 0x56289caeef48 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:44:22.102+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:44:22.106+0000 7f2a96ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:44:22.106+0000 7f2a96ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:44:22.106+0000 7f2a96ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:44:22.106+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x7f2a8c070ae0 auth_method 0 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:44:22.106+0000 7f2bc1e34640 10 monclient: get_auth_request con 0x56289cb0ffa0 auth_method 0 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 realm 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.302 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:44:22.106+0000 7f2bc1633640 10 monclient: get_auth_request con 0x56289cb14230 auth_method 0 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:44:22.106+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:44:22.110+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:44:22.110+0000 7f2bc3b2d9c0 20 searching for the correct realm 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:44:22.110+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x56289cb194e0 auth_method 0 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:44:22.110+0000 7f2bc1e34640 10 monclient: get_auth_request con 0x7f2bb80f3c60 auth_method 0 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:44:22.114+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2bb403e060 auth_method 0 2024-09-12T00:44:22.303 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:44:22.114+0000 7f2bc0e32640 10 monclient: get_auth_request con 0x7f2bb80f6610 auth_method 0 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:44:22.114+0000 7f2bc1633640 0 -- 172.21.15.137:0/2646439599 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f2bb403e060 msgr2=0x7f2bb4079b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:44:22.114+0000 7f2a96ffd640 1 client.7664.objecter ms_handle_reset 0x7f2bb403e060 session 0x7f2bb401e070 osd.0 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:44:22.114+0000 7f2a96ffd640 10 monclient: _renew_subs 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:44:22.114+0000 7f2a96ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:44:22.114+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2a8c080e10 auth_method 0 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:44:22.118+0000 7f2bc1e34640 10 monclient: get_auth_request con 0x7f2bb4027040 auth_method 0 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:44:22.118+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2bbc018040 auth_method 0 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:44:22.122+0000 7f2bc1633640 0 -- 172.21.15.137:0/2646439599 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f2bbc018040 msgr2=0x7f2bbc029430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:44:22.122+0000 7f2a96ffd640 1 client.7664.objecter ms_handle_reset 0x7f2bbc018040 session 0x7f2bbc02f040 osd.3 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:44:22.122+0000 7f2bc1633640 10 monclient: get_auth_request con 0x7f2bb403e060 auth_method 0 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:22.304 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:44:22.126+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.305 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 zone default found 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 Realm: () 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 zonegroup default 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.306 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 started sync module instance, tier type = 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:44:22.130+0000 7f2bc3b2d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=0 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=1 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=2 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=3 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=4 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=5 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=6 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 20 add_watcher() i=7 2024-09-12T00:44:22.307 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:44:22.150+0000 7f2bc3b2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding auth protocol: cephx 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding auth protocol: cephx 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding auth protocol: cephx 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.308 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: crc 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 AuthRegistry(0x7ffff23d16b0) adding con mode: secure 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:44:22.154+0000 7f2a777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cache list hook 0x56289caeeef0 2024-09-12T00:44:22.309 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cache inspect hook 0x56289caeeef0 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cache erase hook 0x56289caeeef0 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command cache zap hook 0x56289caeeef0 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 note: GC not initialized 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:44:22.154+0000 7f2a767e4640 20 reqs_thread_entry: start 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command sync trace show hook 0x7f2bb80f79b0 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command sync trace history hook 0x7f2bb80f79b0 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command sync trace active hook 0x7f2bb80f79b0 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 5 asok(0x56289c8192b0) register_command sync trace active_short hook 0x7f2bb80f79b0 2024-09-12T00:44:22.310 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 Filter name: none 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:44:22.154+0000 7f29e7fff640 20 reqs_thread_entry: start 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:44:22.154+0000 7f2bc3b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.311 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:44:22.158+0000 7f2bc3b2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.312 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:44:22.162+0000 7f2bc3b2d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94732427583104 notifier 7664 bl.length()=827 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:44:22.162+0000 7f2aa4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:44:22.166+0000 7f2bc3b2d9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.1 2024-09-12T00:44:22.313 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.1 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.2 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.2 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.3 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.3 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:44:22.170+0000 7f2bc3b2d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:44:22.174+0000 7f2bc3b2d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2bc3b2d9c0 time 2024-09-12T00:44:22.176969+0000 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:44:22.314 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2bc74072eb] 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2bc740749f] 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56289b174cc1] 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x56289b18901c] 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56289b18a6a4] 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bc626dd90] 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:44:22.178+0000 7f2bc3b2d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:44:22.315 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f2bc3b2d9c0 thread_name:radosgw-admin 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2bc6286520] 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2bc7407345] 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2bc740749f] 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56289b174cc1] 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x56289b18901c] 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56289b18a6a4] 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bc626dd90] 2024-09-12T00:44:22.316 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:44:22.317 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:44:22.318 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:44:22.319 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:44:22.320 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:44:22.321 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:44:22.322 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:44:22.323 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 7f29e7fff640 / http_manager 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2a767e4640 / http_manager 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2a777e6640 / rgw_dt_lg_renew 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2a96ffd640 / ms_dispatch 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2aa4ff9640 / io_context_pool 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2aa6ffd640 / ms_dispatch 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2aade03640 / ms_dispatch 2024-09-12T00:44:22.324 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2aaf606640 / io_context_pool 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc0e32640 / msgr-worker-2 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc1633640 / msgr-worker-1 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc1e34640 / msgr-worker-0 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc2635640 / io_context_pool 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr: 7f2bc3b2d9c0 / radosgw-admin 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:44:22.179338Z_55eba8d9-a606-488a-9eec-e7f5564f21b8/log 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:44:22.325 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 20 realm 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:22.330 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.258+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.262+0000 7fbb377c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.262+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.262+0000 7fbb377c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.262+0000 7fbb377c79c0 20 searching for the correct realm 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.266+0000 7fbb34acc640 0 -- 172.21.15.137:0/2996875053 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fbb2c071c50 msgr2=0x7fbb2c03c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.274+0000 7fbb35ace640 0 -- 172.21.15.137:0/2996875053 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x56470de139f0 msgr2=0x56470de15de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:22.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 zone default found 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 4 Realm: () 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 zonegroup default 2024-09-12T00:44:22.332 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 started sync module instance, tier type = 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.282+0000 7fbb377c79c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 20 add_watcher() i=0 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 20 add_watcher() i=1 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 20 add_watcher() i=2 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 20 add_watcher() i=3 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 20 add_watcher() i=4 2024-09-12T00:44:22.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 20 add_watcher() i=5 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 20 add_watcher() i=6 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 20 add_watcher() i=7 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.306+0000 7fbb377c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fb9eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fbb377c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fbb377c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fbb377c79c0 5 note: GC not initialized 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fb9ea7e4640 20 reqs_thread_entry: start 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fbb377c79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:22.334 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fbb377c79c0 20 Filter name: none 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fb95bfff640 20 reqs_thread_entry: start 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fbb377c79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.310+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.314+0000 7fbb377c79c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.314+0000 7fbb377c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.314+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.314+0000 7fbb377c79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.314+0000 7fbb377c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.314+0000 7fbb377c79c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.314+0000 7fbb377c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:22.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.314+0000 7fb9eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:22.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.318+0000 7fbb377c79c0 20 remove_watcher() i=0 2024-09-12T00:44:22.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.318+0000 7fbb377c79c0 2 removed watcher, disabling cache 2024-09-12T00:44:22.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.322+0000 7fbb377c79c0 20 remove_watcher() i=1 2024-09-12T00:44:22.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.326+0000 7fbb377c79c0 20 remove_watcher() i=2 2024-09-12T00:44:22.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.326+0000 7fbb377c79c0 20 remove_watcher() i=3 2024-09-12T00:44:22.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.330+0000 7fbb377c79c0 20 remove_watcher() i=4 2024-09-12T00:44:22.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.334+0000 7fbb377c79c0 20 remove_watcher() i=5 2024-09-12T00:44:22.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.334+0000 7fbb377c79c0 20 remove_watcher() i=6 2024-09-12T00:44:22.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.338+0000 7fbb377c79c0 20 remove_watcher() i=7 2024-09-12T00:44:22.352 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:44:22.352 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:44:22.365 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:44:22.392 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:22.392 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:22.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.438+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 realm 2024-09-12T00:44:22.439 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:22.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:22.441 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.442+0000 7f3ffa2099c0 20 searching for the correct realm 2024-09-12T00:44:22.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.450+0000 7f3ff8510640 0 -- 172.21.15.137:0/783355579 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5629fdaf5b80 msgr2=0x5629fdaf7fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:22.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.458+0000 7f3ff750e640 0 -- 172.21.15.137:0/783355579 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x5629fdafeff0 msgr2=0x5629fdb014b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:22.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:22.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:22.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:22.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:22.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:22.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:22.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:22.464 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:22.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 zone default found 2024-09-12T00:44:22.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 4 Realm: () 2024-09-12T00:44:22.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:22.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:22.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:22.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 zonegroup default 2024-09-12T00:44:22.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.466+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.470+0000 7f3ffa2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.470+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.470+0000 7f3ffa2099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:22.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.470+0000 7f3ffa2099c0 20 started sync module instance, tier type = 2024-09-12T00:44:22.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.470+0000 7f3ffa2099c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:22.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.498+0000 7f3ffa2099c0 20 add_watcher() i=0 2024-09-12T00:44:22.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.498+0000 7f3ffa2099c0 20 add_watcher() i=1 2024-09-12T00:44:22.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.498+0000 7f3ffa2099c0 20 add_watcher() i=2 2024-09-12T00:44:22.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.498+0000 7f3ffa2099c0 20 add_watcher() i=3 2024-09-12T00:44:22.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.498+0000 7f3ffa2099c0 20 add_watcher() i=4 2024-09-12T00:44:22.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.498+0000 7f3ffa2099c0 20 add_watcher() i=5 2024-09-12T00:44:22.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.498+0000 7f3ffa2099c0 20 add_watcher() i=6 2024-09-12T00:44:22.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.502+0000 7f3ffa2099c0 20 add_watcher() i=7 2024-09-12T00:44:22.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.502+0000 7f3ffa2099c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:22.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3eadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:22.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:22.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:22.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 5 note: GC not initialized 2024-09-12T00:44:22.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3eacfe1640 20 reqs_thread_entry: start 2024-09-12T00:44:22.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:22.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 Filter name: none 2024-09-12T00:44:22.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3e267fc640 20 reqs_thread_entry: start 2024-09-12T00:44:22.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:22.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:22.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:22.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:22.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.506+0000 7f3ffa2099c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:22.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.510+0000 7f3ffa2099c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:22.506 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.510+0000 7f3ffa2099c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:22.507 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.510+0000 7f3eadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:22.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.514+0000 7f3ffa2099c0 20 remove_watcher() i=0 2024-09-12T00:44:22.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.514+0000 7f3ffa2099c0 2 removed watcher, disabling cache 2024-09-12T00:44:22.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.514+0000 7f3ffa2099c0 20 remove_watcher() i=1 2024-09-12T00:44:22.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.518+0000 7f3ffa2099c0 20 remove_watcher() i=2 2024-09-12T00:44:22.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.518+0000 7f3ffa2099c0 20 remove_watcher() i=3 2024-09-12T00:44:22.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.522+0000 7f3ffa2099c0 20 remove_watcher() i=4 2024-09-12T00:44:22.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.522+0000 7f3ffa2099c0 20 remove_watcher() i=5 2024-09-12T00:44:22.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.526+0000 7f3ffa2099c0 20 remove_watcher() i=6 2024-09-12T00:44:22.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:22.530+0000 7f3ffa2099c0 20 remove_watcher() i=7 2024-09-12T00:44:52.574 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:44:52.606 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:52.606 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:52.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.653+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.653+0000 7ffa75c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.653 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.653+0000 7ffa75c8f9c0 20 realm 2024-09-12T00:44:52.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.653+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.653+0000 7ffa75c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.653+0000 7ffa75c8f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:52.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.653+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.657+0000 7ffa75c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.657+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.657+0000 7ffa75c8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:52.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.657+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.657+0000 7ffa75c8f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:52.655 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.657+0000 7ffa75c8f9c0 20 searching for the correct realm 2024-09-12T00:44:52.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.661+0000 7ffa72f94640 0 -- 172.21.15.137:0/4105201346 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7ffa680d3f70 msgr2=0x7ffa680d9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:52.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.669+0000 7ffa73f96640 0 -- 172.21.15.137:0/4105201346 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5569024881f0 msgr2=0x55690248a5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:52.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:52.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:52.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:52.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:52.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:52.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:52.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.677+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:52.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:52.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 zone default found 2024-09-12T00:44:52.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 4 Realm: () 2024-09-12T00:44:52.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:52.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:52.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:52.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 zonegroup default 2024-09-12T00:44:52.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.680 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 started sync module instance, tier type = 2024-09-12T00:44:52.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.681+0000 7ffa75c8f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:52.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 20 add_watcher() i=0 2024-09-12T00:44:52.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 20 add_watcher() i=1 2024-09-12T00:44:52.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 20 add_watcher() i=2 2024-09-12T00:44:52.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 20 add_watcher() i=3 2024-09-12T00:44:52.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 20 add_watcher() i=4 2024-09-12T00:44:52.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 20 add_watcher() i=5 2024-09-12T00:44:52.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 20 add_watcher() i=6 2024-09-12T00:44:52.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 20 add_watcher() i=7 2024-09-12T00:44:52.702 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.701+0000 7ffa75c8f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:52.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.705+0000 7ff929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:52.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.705+0000 7ffa75c8f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:52.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.705+0000 7ffa75c8f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:52.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.705+0000 7ffa75c8f9c0 5 note: GC not initialized 2024-09-12T00:44:52.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ff928fe1640 20 reqs_thread_entry: start 2024-09-12T00:44:52.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:52.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 Filter name: none 2024-09-12T00:44:52.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ff8a27fc640 20 reqs_thread_entry: start 2024-09-12T00:44:52.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:52.708 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:44:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:44:52.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.709+0000 7ffa75c8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:52.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.713+0000 7ff929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:52.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.717+0000 7ffa75c8f9c0 20 remove_watcher() i=0 2024-09-12T00:44:52.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.717+0000 7ffa75c8f9c0 2 removed watcher, disabling cache 2024-09-12T00:44:52.716 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.717+0000 7ffa75c8f9c0 20 remove_watcher() i=1 2024-09-12T00:44:52.718 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.721+0000 7ffa75c8f9c0 20 remove_watcher() i=2 2024-09-12T00:44:52.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.721+0000 7ffa75c8f9c0 20 remove_watcher() i=3 2024-09-12T00:44:52.723 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.725+0000 7ffa75c8f9c0 20 remove_watcher() i=4 2024-09-12T00:44:52.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.725+0000 7ffa75c8f9c0 20 remove_watcher() i=5 2024-09-12T00:44:52.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.729+0000 7ffa75c8f9c0 20 remove_watcher() i=6 2024-09-12T00:44:52.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.733+0000 7ffa75c8f9c0 20 remove_watcher() i=7 2024-09-12T00:44:52.746 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:44:52.746 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:44:52.774 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:44:52.801 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:52.801 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:52.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.845+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.849+0000 7f50f43fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.849+0000 7f50f43fd9c0 20 realm 2024-09-12T00:44:52.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.849+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.849+0000 7f50f43fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.849+0000 7f50f43fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:52.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.849+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.849+0000 7f50f43fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.849 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.849+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.853+0000 7f50f43fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:52.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.853+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.853+0000 7f50f43fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:52.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.853+0000 7f50f43fd9c0 20 searching for the correct realm 2024-09-12T00:44:52.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.861+0000 7f50f2704640 0 -- 172.21.15.137:0/2267405917 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5626ce150990 msgr2=0x5626ce152d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:52.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.865+0000 7f50f1702640 0 -- 172.21.15.137:0/2267405917 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x5626ce159e90 msgr2=0x5626ce15c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:52.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:52.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:52.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:52.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:52.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:52.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:52.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:52.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:52.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 zone default found 2024-09-12T00:44:52.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 4 Realm: () 2024-09-12T00:44:52.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:52.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:52.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:52.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 zonegroup default 2024-09-12T00:44:52.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.873+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.877+0000 7f50f43fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.877+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.877+0000 7f50f43fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.877+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.875 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.877+0000 7f50f43fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:52.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.877+0000 7f50f43fd9c0 20 started sync module instance, tier type = 2024-09-12T00:44:52.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.877+0000 7f50f43fd9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:52.893 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.893+0000 7f50f43fd9c0 20 add_watcher() i=0 2024-09-12T00:44:52.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.893+0000 7f50f43fd9c0 20 add_watcher() i=1 2024-09-12T00:44:52.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.893+0000 7f50f43fd9c0 20 add_watcher() i=2 2024-09-12T00:44:52.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.893+0000 7f50f43fd9c0 20 add_watcher() i=3 2024-09-12T00:44:52.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.893+0000 7f50f43fd9c0 20 add_watcher() i=4 2024-09-12T00:44:52.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.893+0000 7f50f43fd9c0 20 add_watcher() i=5 2024-09-12T00:44:52.894 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.893+0000 7f50f43fd9c0 20 add_watcher() i=6 2024-09-12T00:44:52.896 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.897+0000 7f50f43fd9c0 20 add_watcher() i=7 2024-09-12T00:44:52.897 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.897+0000 7f50f43fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:52.899 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f4fa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:52.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:52.903 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:52.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 5 note: GC not initialized 2024-09-12T00:44:52.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f4fa27fc640 20 reqs_thread_entry: start 2024-09-12T00:44:52.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:52.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 Filter name: none 2024-09-12T00:44:52.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f4f13fff640 20 reqs_thread_entry: start 2024-09-12T00:44:52.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:52.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:52.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:52.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:52.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:52.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:52.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:52.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:52.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:52.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:52.906 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:52.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:52.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:52.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.901+0000 7f50f43fd9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:52.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.905+0000 7f50f43fd9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:52.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.905+0000 7f50f43fd9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:52.907 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.905+0000 7f50f43fd9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:52.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.905+0000 7f50f43fd9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:52.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.905+0000 7f4fa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:52.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.909+0000 7f50f43fd9c0 20 remove_watcher() i=0 2024-09-12T00:44:52.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.909+0000 7f50f43fd9c0 2 removed watcher, disabling cache 2024-09-12T00:44:52.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.913+0000 7f50f43fd9c0 20 remove_watcher() i=1 2024-09-12T00:44:52.913 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.913+0000 7f50f43fd9c0 20 remove_watcher() i=2 2024-09-12T00:44:52.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.917+0000 7f50f43fd9c0 20 remove_watcher() i=3 2024-09-12T00:44:52.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.917+0000 7f50f43fd9c0 20 remove_watcher() i=4 2024-09-12T00:44:52.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.921+0000 7f50f43fd9c0 20 remove_watcher() i=5 2024-09-12T00:44:52.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.921+0000 7f50f43fd9c0 20 remove_watcher() i=6 2024-09-12T00:44:52.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:52.925+0000 7f50f43fd9c0 20 remove_watcher() i=7 2024-09-12T00:44:52.938 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:44:52.964 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:52.964 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:53.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 20 realm 2024-09-12T00:44:53.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:53.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.010 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.009+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.013+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.013+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.013+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:53.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.013+0000 7f8fc0fbd9c0 20 searching for the correct realm 2024-09-12T00:44:53.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.017+0000 7f8fbeac3640 0 -- 172.21.15.137:0/534811665 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f8fb0062830 msgr2=0x7f8fb007d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.025+0000 7f8fbeac3640 0 -- 172.21.15.137:0/534811665 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55a356ec3f00 msgr2=0x55a356ec62f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.029+0000 7f8fc0fbd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:53.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.029+0000 7f8fc0fbd9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:53.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.029+0000 7f8fc0fbd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:53.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.029+0000 7f8fc0fbd9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:53.030 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.029+0000 7f8fc0fbd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:53.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.029+0000 7f8fc0fbd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:53.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.029+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.031 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 zone default found 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 4 Realm: () 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:53.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:53.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 zonegroup default 2024-09-12T00:44:53.033 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.034 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 started sync module instance, tier type = 2024-09-12T00:44:53.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.033+0000 7f8fc0fbd9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:53.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 20 add_watcher() i=0 2024-09-12T00:44:53.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 20 add_watcher() i=1 2024-09-12T00:44:53.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 20 add_watcher() i=2 2024-09-12T00:44:53.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 20 add_watcher() i=3 2024-09-12T00:44:53.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 20 add_watcher() i=4 2024-09-12T00:44:53.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 20 add_watcher() i=5 2024-09-12T00:44:53.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 20 add_watcher() i=6 2024-09-12T00:44:53.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 20 add_watcher() i=7 2024-09-12T00:44:53.053 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.053+0000 7f8fc0fbd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8fc0fbd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8fc0fbd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8fc0fbd9c0 5 note: GC not initialized 2024-09-12T00:44:53.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8deffff640 20 reqs_thread_entry: start 2024-09-12T00:44:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8fc0fbd9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8fc0fbd9c0 20 Filter name: none 2024-09-12T00:44:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8dedffb640 20 reqs_thread_entry: start 2024-09-12T00:44:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.057+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.061 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.062 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:53.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8fc0fbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:53.064 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.061+0000 7f8e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.065+0000 7f8fc0fbd9c0 20 remove_watcher() i=0 2024-09-12T00:44:53.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.065+0000 7f8fc0fbd9c0 2 removed watcher, disabling cache 2024-09-12T00:44:53.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.069+0000 7f8fc0fbd9c0 20 remove_watcher() i=1 2024-09-12T00:44:53.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.069+0000 7f8fc0fbd9c0 20 remove_watcher() i=2 2024-09-12T00:44:53.071 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.073+0000 7f8fc0fbd9c0 20 remove_watcher() i=3 2024-09-12T00:44:53.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.073+0000 7f8fc0fbd9c0 20 remove_watcher() i=4 2024-09-12T00:44:53.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.077+0000 7f8fc0fbd9c0 20 remove_watcher() i=5 2024-09-12T00:44:53.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.081+0000 7f8fc0fbd9c0 20 remove_watcher() i=6 2024-09-12T00:44:53.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.081+0000 7f8fc0fbd9c0 20 remove_watcher() i=7 2024-09-12T00:44:53.094 INFO:tasks.workunit.client.0.smithi137.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:44:53.095 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:44:53.122 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:53.122 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:53.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.165+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 realm 2024-09-12T00:44:53.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:53.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.169+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.173+0000 7f36ffb9e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:53.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.173+0000 7f36ffb9e9c0 20 searching for the correct realm 2024-09-12T00:44:53.173 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.173+0000 7f36fd6a4640 0 -- 172.21.15.137:0/383947795 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f36f006d040 msgr2=0x7f36f00884a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.386 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.385+0000 7f36fd6a4640 0 -- 172.21.15.137:0/383947795 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f36f8004040 msgr2=0x7f36f80c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:53.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:53.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:53.603 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:53.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:53.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:53.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.605+0000 7f36ffb9e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:53.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 zone default found 2024-09-12T00:44:53.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 4 Realm: () 2024-09-12T00:44:53.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:53.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:53.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:53.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 zonegroup default 2024-09-12T00:44:53.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 started sync module instance, tier type = 2024-09-12T00:44:53.608 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.609+0000 7f36ffb9e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:53.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 20 add_watcher() i=0 2024-09-12T00:44:53.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 20 add_watcher() i=1 2024-09-12T00:44:53.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 20 add_watcher() i=2 2024-09-12T00:44:53.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 20 add_watcher() i=3 2024-09-12T00:44:53.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 20 add_watcher() i=4 2024-09-12T00:44:53.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 20 add_watcher() i=5 2024-09-12T00:44:53.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 20 add_watcher() i=6 2024-09-12T00:44:53.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 20 add_watcher() i=7 2024-09-12T00:44:53.633 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.633+0000 7f36ffb9e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:53.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.637+0000 7f35b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.637+0000 7f36ffb9e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:53.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.637+0000 7f36ffb9e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:53.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.637+0000 7f36ffb9e9c0 5 note: GC not initialized 2024-09-12T00:44:53.638 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.637+0000 7f35b27e4640 20 reqs_thread_entry: start 2024-09-12T00:44:53.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.637+0000 7f36ffb9e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:53.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 Filter name: none 2024-09-12T00:44:53.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f3523fff640 20 reqs_thread_entry: start 2024-09-12T00:44:53.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:53.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:53.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:53.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.641+0000 7f36ffb9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:53.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.645+0000 7f35b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.649+0000 7f36ffb9e9c0 20 remove_watcher() i=0 2024-09-12T00:44:53.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.649+0000 7f36ffb9e9c0 2 removed watcher, disabling cache 2024-09-12T00:44:53.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.653+0000 7f36ffb9e9c0 20 remove_watcher() i=1 2024-09-12T00:44:53.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.657+0000 7f36ffb9e9c0 20 remove_watcher() i=2 2024-09-12T00:44:53.656 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.657+0000 7f36ffb9e9c0 20 remove_watcher() i=3 2024-09-12T00:44:53.658 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.661+0000 7f36ffb9e9c0 20 remove_watcher() i=4 2024-09-12T00:44:53.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.661+0000 7f36ffb9e9c0 20 remove_watcher() i=5 2024-09-12T00:44:53.664 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.665+0000 7f36ffb9e9c0 20 remove_watcher() i=6 2024-09-12T00:44:53.666 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.669+0000 7f36ffb9e9c0 20 remove_watcher() i=7 2024-09-12T00:44:53.681 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.681 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:44:53.682 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: a-bucket id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T00:44:53.682 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.682 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:44:53.718 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:53.718 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:53.761 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.761+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 realm 2024-09-12T00:44:53.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.764 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:53.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:53.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.765+0000 7ff7879109c0 20 searching for the correct realm 2024-09-12T00:44:53.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.773+0000 7ff785416640 0 -- 172.21.15.137:0/2894163118 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7ff778037060 msgr2=0x7ff778062de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.777+0000 7ff785416640 0 -- 172.21.15.137:0/2894163118 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7ff78005d890 msgr2=0x7ff780082130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:53.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:53.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:53.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:53.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:53.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:53.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:53.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 zone default found 2024-09-12T00:44:53.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 4 Realm: () 2024-09-12T00:44:53.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:53.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:53.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:53.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 zonegroup default 2024-09-12T00:44:53.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 started sync module instance, tier type = 2024-09-12T00:44:53.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.789+0000 7ff7879109c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:53.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=0 2024-09-12T00:44:53.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=1 2024-09-12T00:44:53.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=2 2024-09-12T00:44:53.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=3 2024-09-12T00:44:53.806 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=4 2024-09-12T00:44:53.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=5 2024-09-12T00:44:53.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=6 2024-09-12T00:44:53.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=7 2024-09-12T00:44:53.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.809+0000 7ff7879109c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:53.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff63b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:53.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:53.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 5 note: GC not initialized 2024-09-12T00:44:53.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff63a7e4640 20 reqs_thread_entry: start 2024-09-12T00:44:53.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:53.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 20 Filter name: none 2024-09-12T00:44:53.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff5abfff640 20 reqs_thread_entry: start 2024-09-12T00:44:53.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:53.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:53.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:53.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:53.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.817+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:53.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.817+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.817+0000 7ff7879109c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.817+0000 7ff7879109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:53.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.817+0000 7ff7879109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.817+0000 7ff7879109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.821+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.821+0000 7ff7879109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.821+0000 7ff7879109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.821+0000 7ff7879109c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:44:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94780427605104 notifier 7781 bl.length()=827 2024-09-12T00:44:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:44:53.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:44:53.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:44:53.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:44:53.827 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7879109c0 time 2024-09-12T00:44:53.831590+0000 2024-09-12T00:44:53.827 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:44:53.828 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:53.828 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff78b1ea2eb] 2024-09-12T00:44:53.828 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff78b1ea49f] 2024-09-12T00:44:53.828 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633c79c5cc1] 2024-09-12T00:44:53.828 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5633c79dad5a] 2024-09-12T00:44:53.828 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:44:53.828 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff78a050d90] 2024-09-12T00:44:53.828 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7ff7879109c0 thread_name:radosgw-admin 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.829+0000 7ff7879109c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7879109c0 time 2024-09-12T00:44:53.831590+0000 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff78b1ea2eb] 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff78b1ea49f] 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633c79c5cc1] 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5633c79dad5a] 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:44:53.829 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff78a050d90] 2024-09-12T00:44:53.830 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:44:53.830 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:44:53.830 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.839 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:53.839 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff78a069520] 2024-09-12T00:44:53.839 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:44:53.839 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:44:53.839 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:44:53.839 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff78b1ea345] 2024-09-12T00:44:53.839 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff78b1ea49f] 2024-09-12T00:44:53.839 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633c79c5cc1] 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5633c79dad5a] 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff78a050d90] 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.829+0000 7ff7879109c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7ff7879109c0 thread_name:radosgw-admin 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff78a069520] 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:44:53.840 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff78b1ea345] 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff78b1ea49f] 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633c79c5cc1] 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5633c79dad5a] 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff78a050d90] 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:44:53.741+0000 7ff785c17640 1 monclient: found mon.noname-c 2024-09-12T00:44:53.841 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:44:53.741+0000 7ff785c17640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: dump: 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.842 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: dump: 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.843 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 monclient: authenticate success, global_id 7769 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:44:53.741+0000 7ff7879109c0 10 monclient: get_monmap_and_config success 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:44:53.741+0000 7ff7879109c0 4 set_mon_vals no callback set 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:44:53.741+0000 7ff7879109c0 10 monclient: shutdown 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 asok(0x5633c987b2b0) unregister_commands rotate-key 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:44:53.741+0000 7ff7879109c0 10 monclient: build_initial_monmap 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:44:53.741+0000 7ff7879109c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:44:53.741+0000 7ff7879109c0 10 monclient: monmap: 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:53.844 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding auth protocol: cephx 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding auth protocol: cephx 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding auth protocol: cephx 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.845 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:44:53.741+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:44:53.741+0000 7ff7879109c0 1 librados: starting msgr at 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:44:53.741+0000 7ff7879109c0 1 librados: starting objecter 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command objecter_requests hook 0x5633c993de20 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:44:53.745+0000 7ff7879109c0 1 librados: setting wanted keys 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:44:53.745+0000 7ff7879109c0 1 librados: calling monclient init 2024-09-12T00:44:53.846 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: init 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding auth protocol: cephx 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding auth protocol: cephx 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding auth protocol: cephx 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.847 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:44:53.745+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:44:53.745+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command rotate-key hook 0x5633c9a88a18 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-b con 0x5633c99d41b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-a con 0x5633c99d4e50 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-c con 0x5633c9ab5cf0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.848 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): authenticate will time out at 2394.876673s 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): get_auth_request con 0x5633c99d4e50 auth_method 0 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): get_auth_request con 0x5633c9ab5cf0 auth_method 0 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.849 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient(hunting): get_auth_request con 0x5633c99d41b0 auth_method 0 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient: _finish_hunting 0 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:44:53.745+0000 7ff785c17640 1 monclient: found mon.noname-c 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: dump: 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.850 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:53.851 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: dump: 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 monclient: authenticate success, global_id 7772 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:44:53.745+0000 7ff673606640 4 set_mon_vals no callback set 2024-09-12T00:44:53.852 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:44:53.745+0000 7ff7879109c0 1 librados: init done 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:44:53.745+0000 7ff671e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:44:53.745+0000 7ff671e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:44:53.745+0000 7ff671e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff66c070ae0 auth_method 0 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:44:53.749+0000 7ff784c15640 10 monclient: get_auth_request con 0x5633c9ac6900 auth_method 0 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:44:53.749+0000 7ff785416640 10 monclient: get_auth_request con 0x5633c9ad33c0 auth_method 0 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:44:53.749+0000 7ff784c15640 10 monclient: get_auth_request con 0x5633c9ad6cb0 auth_method 0 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: build_initial_monmap 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:44:53.753+0000 7ff7879109c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:53.853 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: monmap: 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding auth protocol: cephx 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding auth protocol: cephx 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding auth protocol: cephx 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.854 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:44:53.753+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5633c9ae0030 EEXIST 2024-09-12T00:44:53.855 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: init 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding auth protocol: cephx 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding auth protocol: cephx 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding auth protocol: cephx 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.856 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:44:53.753+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:44:53.753+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command rotate-key cmddesc rotate-key hook 0x5633c9adb750 EEXIST 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-a con 0x5633c9b041e0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-c con 0x5633c9b03b10 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-b con 0x5633c9b024f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.857 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): authenticate will time out at 2394.885975s 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): get_auth_request con 0x5633c9b041e0 auth_method 0 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): get_auth_request con 0x5633c9b03b10 auth_method 0 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.858 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): handle_auth_done global_id 8184 payload 824 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient: _finish_hunting 0 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:44:53.753+0000 7ff785416640 1 monclient: found mon.noname-a 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:44:53.753+0000 7ff785c17640 10 monclient: get_auth_request con 0x5633c9b024f0 auth_method 0 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: dump: 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.859 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: dump: 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.860 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 monclient: authenticate success, global_id 8184 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:44:53.753+0000 7ff786418640 4 set_mon_vals no callback set 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:44:53.861 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:44:53.757+0000 7ff66affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:44:53.757+0000 7ff66affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:44:53.757+0000 7ff66affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:44:53.757+0000 7ff784c15640 10 monclient: get_auth_request con 0x7ff660070a20 auth_method 0 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: get_monmap_and_config 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: build_initial_monmap 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:44:53.757+0000 7ff7879109c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: monmap: 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.862 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding auth protocol: cephx 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding auth protocol: cephx 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding auth protocol: cephx 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.863 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:44:53.757+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: init 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding auth protocol: cephx 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding auth protocol: cephx 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding auth protocol: cephx 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.864 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:44:53.757+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:44:53.757+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe4ae1b068 EEXIST 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-c con 0x5633c9b52070 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:53.865 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-b con 0x5633c9b52450 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-a con 0x5633c9b53910 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): authenticate will time out at 2394.890327s 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): get_auth_request con 0x5633c9b52070 auth_method 0 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): get_auth_request con 0x5633c9b53910 auth_method 0 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.866 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): handle_auth_done global_id 7778 payload 274 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient: _finish_hunting 0 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:44:53.757+0000 7ff785416640 1 monclient: found mon.noname-c 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: dump: 2024-09-12T00:44:53.867 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.868 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: dump: 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.869 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 monclient: authenticate success, global_id 7778 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: get_monmap_and_config success 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:44:53.757+0000 7ff7879109c0 4 set_mon_vals no callback set 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: shutdown 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: build_initial_monmap 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:44:53.757+0000 7ff7879109c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: monmap: 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:53.870 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding auth protocol: cephx 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding auth protocol: cephx 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding auth protocol: cephx 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.871 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:44:53.761+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: starting msgr at 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: starting objecter 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5633c9b25f00 EEXIST 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: setting wanted keys 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: calling monclient init 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: init 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding auth protocol: cephx 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding auth protocol: cephx 2024-09-12T00:44:53.872 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding auth protocol: cephx 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.873 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:44:53.761+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:44:53.761+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command rotate-key cmddesc rotate-key hook 0x5633c9b06148 EEXIST 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-b con 0x5633c9b52070 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-c con 0x5633c9b53910 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-a con 0x5633c9b45340 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): authenticate will time out at 2394.893037s 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): get_auth_request con 0x5633c9b53910 auth_method 0 2024-09-12T00:44:53.874 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): get_auth_request con 0x5633c9b45340 auth_method 0 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.875 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:44:53.761+0000 7ff785416640 10 monclient(hunting): get_auth_request con 0x5633c9b52070 auth_method 0 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:44:53.761+0000 7ff785416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:44:53.761+0000 7ff785416640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:44:53.761+0000 7ff785416640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient: _finish_hunting 0 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:44:53.761+0000 7ff784c15640 1 monclient: found mon.noname-c 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: dump: 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.876 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: dump: 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 monclient: authenticate success, global_id 7781 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:44:53.761+0000 7ff668ff9640 4 set_mon_vals no callback set 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.878 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: init done 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cr dump hook 0x5633c9b48968 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:44:53.761+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:44:53.761+0000 7ff656ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:44:53.761+0000 7ff656ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:44:53.761+0000 7ff656ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:44:53.765+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff650070b10 auth_method 0 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:44:53.765+0000 7ff785c17640 10 monclient: get_auth_request con 0x5633c9b72160 auth_method 0 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 realm 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:44:53.765+0000 7ff7879109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.879 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:44:53.765+0000 7ff785416640 10 monclient: get_auth_request con 0x5633c9b761a0 auth_method 0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 searching for the correct realm 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:44:53.769+0000 7ff784c15640 10 monclient: get_auth_request con 0x5633c9b7b4b0 auth_method 0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:44:53.769+0000 7ff785c17640 10 monclient: get_auth_request con 0x7ff77c0e1030 auth_method 0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:44:53.769+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff778037060 auth_method 0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:44:53.773+0000 7ff784c15640 10 monclient: get_auth_request con 0x7ff77c10b5d0 auth_method 0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:44:53.773+0000 7ff785416640 0 -- 172.21.15.137:0/2894163118 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7ff778037060 msgr2=0x7ff778062de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:44:53.773+0000 7ff656ffd640 1 client.7781.objecter ms_handle_reset 0x7ff778037060 session 0x7ff778012040 osd.0 2024-09-12T00:44:53.880 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:44:53.773+0000 7ff656ffd640 10 monclient: _renew_subs 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:44:53.773+0000 7ff656ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:44:53.773+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff650080f20 auth_method 0 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:44:53.777+0000 7ff785c17640 10 monclient: get_auth_request con 0x7ff778008040 auth_method 0 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:44:53.777+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff78005d890 auth_method 0 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:44:53.777+0000 7ff785416640 0 -- 172.21.15.137:0/2894163118 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7ff78005d890 msgr2=0x7ff780082130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:44:53.777+0000 7ff656ffd640 1 client.7781.objecter ms_handle_reset 0x7ff78005d890 session 0x7ff7800594d0 osd.3 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:44:53.777+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff778037060 auth_method 0 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:53.881 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 zone default found 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:44:53.789+0000 7ff7879109c0 4 Realm: () 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:44:53.789+0000 7ff7879109c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:44:53.789+0000 7ff7879109c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:44:53.789+0000 7ff7879109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 zonegroup default 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.882 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 started sync module instance, tier type = 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=0 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=1 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=2 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=3 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=4 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=5 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=6 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=7 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:44:53.809+0000 7ff7879109c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:53.883 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding auth protocol: cephx 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding auth protocol: cephx 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding auth protocol: cephx 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:44:53.813+0000 7ff63b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.884 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:44:53.813+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cache list hook 0x5633c9b457a0 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cache inspect hook 0x5633c9b457a0 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cache erase hook 0x5633c9b457a0 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cache zap hook 0x5633c9b457a0 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 note: GC not initialized 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:44:53.813+0000 7ff63a7e4640 20 reqs_thread_entry: start 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command sync trace show hook 0x7ff77c0ab430 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command sync trace history hook 0x7ff77c0ab430 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command sync trace active hook 0x7ff77c0ab430 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command sync trace active_short hook 0x7ff77c0ab430 2024-09-12T00:44:53.885 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 Filter name: none 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:44:53.813+0000 7ff5abfff640 20 reqs_thread_entry: start 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:44:53.813+0000 7ff7879109c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:44:53.817+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.886 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:44:53.821+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:44:53.821+0000 7ff7879109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:44:53.821+0000 7ff7879109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:44:53.821+0000 7ff7879109c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94780427605104 notifier 7781 bl.length()=827 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:44:53.887 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:44:53.829+0000 7ff7879109c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7879109c0 time 2024-09-12T00:44:53.831590+0000 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff78b1ea2eb] 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff78b1ea49f] 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633c79c5cc1] 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5633c79dad5a] 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff78a050d90] 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:44:53.829+0000 7ff7879109c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:44:53.888 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7ff7879109c0 thread_name:radosgw-admin 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff78a069520] 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff78b1ea345] 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff78b1ea49f] 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633c79c5cc1] 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5633c79dad5a] 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff78a050d90] 2024-09-12T00:44:53.889 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:44:53.890 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:44:53.891 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:44:53.892 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:44:53.893 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:44:53.894 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:44:53.895 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:44:53.896 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff5abfff640 / http_manager 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff63a7e4640 / http_manager 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff63b7e6640 / rgw_dt_lg_renew 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff656ffd640 / ms_dispatch 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff668ff9640 / io_context_pool 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff66affd640 / ms_dispatch 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff671e03640 / ms_dispatch 2024-09-12T00:44:53.897 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff673606640 / io_context_pool 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff784c15640 / msgr-worker-2 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff785416640 / msgr-worker-1 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff785c17640 / msgr-worker-0 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff786418640 / io_context_pool 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff7879109c0 / radosgw-admin 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.143773.log 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:44:53.741+0000 7ff785c17640 1 monclient: found mon.noname-c 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:44:53.741+0000 7ff785c17640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.898 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: dump: 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.899 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:44:53.741+0000 7ff673606640 10 monclient: dump: 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.900 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 monclient: authenticate success, global_id 7769 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:44:53.741+0000 7ff7879109c0 10 monclient: get_monmap_and_config success 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:44:53.741+0000 7ff7879109c0 4 set_mon_vals no callback set 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:44:53.741+0000 7ff7879109c0 10 monclient: shutdown 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 asok(0x5633c987b2b0) unregister_commands rotate-key 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:44:53.741+0000 7ff7879109c0 10 monclient: build_initial_monmap 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:44:53.741+0000 7ff7879109c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:44:53.741+0000 7ff7879109c0 10 monclient: monmap: 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:53.901 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding auth protocol: cephx 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding auth protocol: cephx 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding auth protocol: cephx 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.902 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: crc 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a8dc20) adding con mode: secure 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:44:53.741+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:44:53.741+0000 7ff7879109c0 1 librados: starting msgr at 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:44:53.741+0000 7ff7879109c0 1 librados: starting objecter 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:44:53.741+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command objecter_requests hook 0x5633c993de20 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:44:53.745+0000 7ff7879109c0 1 librados: setting wanted keys 2024-09-12T00:44:53.903 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:44:53.745+0000 7ff7879109c0 1 librados: calling monclient init 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: init 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding auth protocol: cephx 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding auth protocol: cephx 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding auth protocol: cephx 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.904 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: crc 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 AuthRegistry(0x5633c9a888d0) adding con mode: secure 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:44:53.745+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:44:53.745+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command rotate-key hook 0x5633c9a88a18 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-b con 0x5633c99d41b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-a con 0x5633c99d4e50 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-c con 0x5633c9ab5cf0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.905 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient(hunting): authenticate will time out at 2394.876673s 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): get_auth_request con 0x5633c99d4e50 auth_method 0 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): get_auth_request con 0x5633c9ab5cf0 auth_method 0 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.906 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:44:53.745+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient(hunting): get_auth_request con 0x5633c99d41b0 auth_method 0 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient: _finish_hunting 0 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:44:53.745+0000 7ff785c17640 1 monclient: found mon.noname-c 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:44:53.745+0000 7ff785c17640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:53.907 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: dump: 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.908 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:44:53.745+0000 7ff671e03640 10 monclient: dump: 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.909 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:44:53.745+0000 7ff7879109c0 5 monclient: authenticate success, global_id 7772 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:44:53.745+0000 7ff673606640 4 set_mon_vals no callback set 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:44:53.745+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:44:53.745+0000 7ff7879109c0 1 librados: init done 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:44:53.745+0000 7ff671e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:44:53.745+0000 7ff671e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:44:53.745+0000 7ff671e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:44:53.745+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff66c070ae0 auth_method 0 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:44:53.749+0000 7ff784c15640 10 monclient: get_auth_request con 0x5633c9ac6900 auth_method 0 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:44:53.749+0000 7ff785416640 10 monclient: get_auth_request con 0x5633c9ad33c0 auth_method 0 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:44:53.749+0000 7ff784c15640 10 monclient: get_auth_request con 0x5633c9ad6cb0 auth_method 0 2024-09-12T00:44:53.910 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: build_initial_monmap 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:44:53.753+0000 7ff7879109c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: monmap: 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding auth protocol: cephx 2024-09-12T00:44:53.911 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding auth protocol: cephx 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding auth protocol: cephx 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: crc 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adc710) adding con mode: secure 2024-09-12T00:44:53.912 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:44:53.753+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5633c9ae0030 EEXIST 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: init 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding auth protocol: cephx 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding auth protocol: cephx 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding auth protocol: cephx 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.913 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: crc 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 AuthRegistry(0x5633c9adb608) adding con mode: secure 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:44:53.753+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:44:53.753+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command rotate-key cmddesc rotate-key hook 0x5633c9adb750 EEXIST 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-a con 0x5633c9b041e0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-c con 0x5633c9b03b10 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-b con 0x5633c9b024f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.914 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient(hunting): authenticate will time out at 2394.885975s 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): get_auth_request con 0x5633c9b041e0 auth_method 0 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): get_auth_request con 0x5633c9b03b10 auth_method 0 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.915 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:44:53.753+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient(hunting): handle_auth_done global_id 8184 payload 824 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient: _finish_hunting 0 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:44:53.753+0000 7ff785416640 1 monclient: found mon.noname-a 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:44:53.753+0000 7ff785416640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:44:53.753+0000 7ff785c17640 10 monclient: get_auth_request con 0x5633c9b024f0 auth_method 0 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:44:53.916 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: dump: 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.917 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:44:53.753+0000 7ff66affd640 10 monclient: dump: 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:44:53.753+0000 7ff7879109c0 5 monclient: authenticate success, global_id 8184 2024-09-12T00:44:53.918 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:44:53.753+0000 7ff786418640 4 set_mon_vals no callback set 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:44:53.753+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:44:53.757+0000 7ff66affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:44:53.757+0000 7ff66affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:44:53.757+0000 7ff66affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:44:53.757+0000 7ff784c15640 10 monclient: get_auth_request con 0x7ff660070a20 auth_method 0 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: get_monmap_and_config 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: build_initial_monmap 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:44:53.757+0000 7ff7879109c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: monmap: 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:53.919 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding auth protocol: cephx 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding auth protocol: cephx 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding auth protocol: cephx 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.920 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: crc 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23b10) adding con mode: secure 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:44:53.757+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: init 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding auth protocol: cephx 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding auth protocol: cephx 2024-09-12T00:44:53.921 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding auth protocol: cephx 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: crc 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1af20) adding con mode: secure 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:44:53.757+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:44:53.757+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.922 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe4ae1b068 EEXIST 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-c con 0x5633c9b52070 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-b con 0x5633c9b52450 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-a con 0x5633c9b53910 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient(hunting): authenticate will time out at 2394.890327s 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): get_auth_request con 0x5633c9b52070 auth_method 0 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.923 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): get_auth_request con 0x5633c9b53910 auth_method 0 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:44:53.757+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient(hunting): handle_auth_done global_id 7778 payload 274 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient: _finish_hunting 0 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:44:53.757+0000 7ff785416640 1 monclient: found mon.noname-c 2024-09-12T00:44:53.924 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:44:53.757+0000 7ff785416640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: dump: 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.925 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:44:53.757+0000 7ff668ff9640 10 monclient: dump: 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.926 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 monclient: authenticate success, global_id 7778 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: get_monmap_and_config success 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:44:53.757+0000 7ff7879109c0 4 set_mon_vals no callback set 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: shutdown 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: build_initial_monmap 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:44:53.757+0000 7ff7879109c0 1 build_initial for_mkfs: 0 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:44:53.757+0000 7ff7879109c0 10 monclient: monmap: 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:44:53.927 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding auth protocol: cephx 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding auth protocol: cephx 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding auth protocol: cephx 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.928 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: crc 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:44:53.757+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b23ac0) adding con mode: secure 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:44:53.761+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: starting msgr at 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: starting objecter 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5633c9b25f00 EEXIST 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: setting wanted keys 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: calling monclient init 2024-09-12T00:44:53.929 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: init 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding auth protocol: cephx 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding auth protocol: cephx 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding auth protocol: cephx 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.930 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: crc 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 AuthRegistry(0x5633c9b06000) adding con mode: secure 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:44:53.761+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:44:53.761+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command rotate-key cmddesc rotate-key hook 0x5633c9b06148 EEXIST 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _reopen_session rank -1 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-b con 0x5633c9b52070 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-c con 0x5633c9b53910 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): picked mon.noname-a con 0x5633c9b45340 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): _renew_subs 2024-09-12T00:44:53.931 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient(hunting): authenticate will time out at 2394.893037s 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): get_auth_request con 0x5633c9b53910 auth_method 0 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): get_auth_request con 0x5633c9b45340 auth_method 0 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:44:53.932 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:44:53.761+0000 7ff785c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:44:53.761+0000 7ff785416640 10 monclient(hunting): get_auth_request con 0x5633c9b52070 auth_method 0 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:44:53.761+0000 7ff785416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:44:53.761+0000 7ff785416640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:44:53.761+0000 7ff785416640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient: _finish_hunting 0 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:44:53.761+0000 7ff784c15640 1 monclient: found mon.noname-c 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:44:53.761+0000 7ff784c15640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: dump: 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.933 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: _finish_auth 0 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:44:53.934 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:44:53.761+0000 7ff656ffd640 10 monclient: dump: 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 monclient: authenticate success, global_id 7781 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:44:53.761+0000 7ff668ff9640 4 set_mon_vals no callback set 2024-09-12T00:44:53.935 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _renew_subs 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:44:53.761+0000 7ff7879109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:44:53.761+0000 7ff7879109c0 1 librados: init done 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:44:53.761+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cr dump hook 0x5633c9b48968 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:44:53.761+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:44:53.761+0000 7ff656ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:44:53.761+0000 7ff656ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:44:53.761+0000 7ff656ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:44:53.765+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff650070b10 auth_method 0 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:44:53.765+0000 7ff785c17640 10 monclient: get_auth_request con 0x5633c9b72160 auth_method 0 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 realm 2024-09-12T00:44:53.936 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:44:53.765+0000 7ff7879109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:44:53.765+0000 7ff785416640 10 monclient: get_auth_request con 0x5633c9b761a0 auth_method 0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:44:53.765+0000 7ff7879109c0 20 searching for the correct realm 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:44:53.769+0000 7ff784c15640 10 monclient: get_auth_request con 0x5633c9b7b4b0 auth_method 0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:44:53.769+0000 7ff785c17640 10 monclient: get_auth_request con 0x7ff77c0e1030 auth_method 0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:44:53.769+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff778037060 auth_method 0 2024-09-12T00:44:53.937 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:44:53.773+0000 7ff784c15640 10 monclient: get_auth_request con 0x7ff77c10b5d0 auth_method 0 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:44:53.773+0000 7ff785416640 0 -- 172.21.15.137:0/2894163118 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7ff778037060 msgr2=0x7ff778062de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:44:53.773+0000 7ff656ffd640 1 client.7781.objecter ms_handle_reset 0x7ff778037060 session 0x7ff778012040 osd.0 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:44:53.773+0000 7ff656ffd640 10 monclient: _renew_subs 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:44:53.773+0000 7ff656ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:44:53.773+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff650080f20 auth_method 0 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:44:53.777+0000 7ff785c17640 10 monclient: get_auth_request con 0x7ff778008040 auth_method 0 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:44:53.777+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff78005d890 auth_method 0 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:44:53.777+0000 7ff785416640 0 -- 172.21.15.137:0/2894163118 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7ff78005d890 msgr2=0x7ff780082130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:44:53.777+0000 7ff656ffd640 1 client.7781.objecter ms_handle_reset 0x7ff78005d890 session 0x7ff7800594d0 osd.3 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:44:53.777+0000 7ff785416640 10 monclient: get_auth_request con 0x7ff778037060 auth_method 0 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:53.938 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:44:53.785+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 zone default found 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:44:53.789+0000 7ff7879109c0 4 Realm: () 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:44:53.789+0000 7ff7879109c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:44:53.789+0000 7ff7879109c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:44:53.789+0000 7ff7879109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:53.939 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 zonegroup default 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 started sync module instance, tier type = 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:44:53.789+0000 7ff7879109c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=0 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=1 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=2 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=3 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=4 2024-09-12T00:44:53.940 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=5 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=6 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:44:53.809+0000 7ff7879109c0 20 add_watcher() i=7 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:44:53.809+0000 7ff7879109c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding auth protocol: cephx 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding auth protocol: cephx 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding auth protocol: cephx 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.941 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:44:53.813+0000 7ff63b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: crc 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 AuthRegistry(0x7ffe4ae1b400) adding con mode: secure 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:44:53.813+0000 7ff7879109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cache list hook 0x5633c9b457a0 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cache inspect hook 0x5633c9b457a0 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cache erase hook 0x5633c9b457a0 2024-09-12T00:44:53.942 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command cache zap hook 0x5633c9b457a0 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 note: GC not initialized 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:44:53.813+0000 7ff63a7e4640 20 reqs_thread_entry: start 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command sync trace show hook 0x7ff77c0ab430 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command sync trace history hook 0x7ff77c0ab430 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command sync trace active hook 0x7ff77c0ab430 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:44:53.813+0000 7ff7879109c0 5 asok(0x5633c987b2b0) register_command sync trace active_short hook 0x7ff77c0ab430 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 Filter name: none 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:44:53.813+0000 7ff5abfff640 20 reqs_thread_entry: start 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:44:53.813+0000 7ff7879109c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:53.943 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:44:53.813+0000 7ff7879109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:44:53.813+0000 7ff7879109c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:44:53.817+0000 7ff7879109c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:44:53.817+0000 7ff7879109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:44:53.821+0000 7ff7879109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:44:53.821+0000 7ff7879109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:44:53.821+0000 7ff7879109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:44:53.821+0000 7ff7879109c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94780427605104 notifier 7781 bl.length()=827 2024-09-12T00:44:53.944 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:44:53.821+0000 7ff668ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:44:53.825+0000 7ff7879109c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:44:53.829+0000 7ff7879109c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7879109c0 time 2024-09-12T00:44:53.831590+0000 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff78b1ea2eb] 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff78b1ea49f] 2024-09-12T00:44:53.945 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633c79c5cc1] 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5633c79dad5a] 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff78a050d90] 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:44:53.829+0000 7ff7879109c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7ff7879109c0 thread_name:radosgw-admin 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff78a069520] 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:44:53.946 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff78b1ea345] 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff78b1ea49f] 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633c79c5cc1] 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5633c79dad5a] 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff78a050d90] 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:44:53.947 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:44:53.948 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:44:53.949 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:44:53.950 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:44:53.951 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:44:53.952 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:44:53.953 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff5abfff640 / http_manager 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff63a7e4640 / http_manager 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff63b7e6640 / rgw_dt_lg_renew 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff656ffd640 / ms_dispatch 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff668ff9640 / io_context_pool 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff66affd640 / ms_dispatch 2024-09-12T00:44:53.954 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff671e03640 / ms_dispatch 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff673606640 / io_context_pool 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff784c15640 / msgr-worker-2 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff785416640 / msgr-worker-1 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff785c17640 / msgr-worker-0 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff786418640 / io_context_pool 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: 7ff7879109c0 / radosgw-admin 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:44:53.833600Z_a8771386-b1c8-4624-bc49-7fafe0b0713a/log 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:44:53.955 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.913+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 realm 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.917+0000 7f79f70d29c0 20 searching for the correct realm 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.925+0000 7f79effff640 0 -- 172.21.15.137:0/4131778563 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f79e00d5be0 msgr2=0x7f79e0132670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.929+0000 7f79f53d9640 0 -- 172.21.15.137:0/4131778563 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55d878b74780 msgr2=0x55d878b76c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:53.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 zone default found 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 4 Realm: () 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:53.960 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 zonegroup default 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.937+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.941+0000 7f79f70d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.941+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.941+0000 7f79f70d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.941+0000 7f79f70d29c0 20 started sync module instance, tier type = 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.941+0000 7f79f70d29c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.957+0000 7f79f70d29c0 20 add_watcher() i=0 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.957+0000 7f79f70d29c0 20 add_watcher() i=1 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.957+0000 7f79f70d29c0 20 add_watcher() i=2 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.957+0000 7f79f70d29c0 20 add_watcher() i=3 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.957+0000 7f79f70d29c0 20 add_watcher() i=4 2024-09-12T00:44:53.961 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.957+0000 7f79f70d29c0 20 add_watcher() i=5 2024-09-12T00:44:53.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.957+0000 7f79f70d29c0 20 add_watcher() i=6 2024-09-12T00:44:53.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.961+0000 7f79f70d29c0 20 add_watcher() i=7 2024-09-12T00:44:53.962 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.961+0000 7f79f70d29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:53.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f78aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f79f70d29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:53.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f79f70d29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:53.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f79f70d29c0 5 note: GC not initialized 2024-09-12T00:44:53.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f78a9fe3640 20 reqs_thread_entry: start 2024-09-12T00:44:53.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f79f70d29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:53.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f79f70d29c0 20 Filter name: none 2024-09-12T00:44:53.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f781b7fe640 20 reqs_thread_entry: start 2024-09-12T00:44:53.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f79f70d29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.965+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.969+0000 7f79f70d29c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:44:53.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.969+0000 7f79f70d29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:53.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.969+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.969+0000 7f79f70d29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:53.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.969+0000 7f79f70d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:53.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.969+0000 7f79f70d29c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:44:53.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.969+0000 7f79f70d29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:44:53.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.969+0000 7f78aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:53.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.973+0000 7f79f70d29c0 20 remove_watcher() i=0 2024-09-12T00:44:53.974 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.973+0000 7f79f70d29c0 2 removed watcher, disabling cache 2024-09-12T00:44:53.975 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.977+0000 7f79f70d29c0 20 remove_watcher() i=1 2024-09-12T00:44:53.977 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.977+0000 7f79f70d29c0 20 remove_watcher() i=2 2024-09-12T00:44:53.980 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.981+0000 7f79f70d29c0 20 remove_watcher() i=3 2024-09-12T00:44:53.982 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.981+0000 7f79f70d29c0 20 remove_watcher() i=4 2024-09-12T00:44:53.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.985+0000 7f79f70d29c0 20 remove_watcher() i=5 2024-09-12T00:44:53.987 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.989+0000 7f79f70d29c0 20 remove_watcher() i=6 2024-09-12T00:44:53.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:53.989+0000 7f79f70d29c0 20 remove_watcher() i=7 2024-09-12T00:44:54.005 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:44:54.005 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:44:54.018 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:44:54.045 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:54.045 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:54.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.089+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.089+0000 7fb25be869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:54.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.089+0000 7fb25be869c0 20 realm 2024-09-12T00:44:54.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.089+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:54.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:54.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:54.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:54.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:54.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.093+0000 7fb25be869c0 20 searching for the correct realm 2024-09-12T00:44:54.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.097+0000 7fb25918b640 0 -- 172.21.15.137:0/3611993590 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fb24403bc00 msgr2=0x7fb244017900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:54.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.105+0000 7fb25a18d640 0 -- 172.21.15.137:0/3611993590 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55ebf30c2680 msgr2=0x55ebf30c4b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:54.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:54.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:44:54.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:54.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:44:54.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:54.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:54.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 zone default found 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 4 Realm: () 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:54.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 zonegroup default 2024-09-12T00:44:54.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:54.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.114 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:54.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:54.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 started sync module instance, tier type = 2024-09-12T00:44:54.115 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.113+0000 7fb25be869c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:44:54.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.133+0000 7fb25be869c0 20 add_watcher() i=0 2024-09-12T00:44:54.131 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.133+0000 7fb25be869c0 20 add_watcher() i=1 2024-09-12T00:44:54.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.133+0000 7fb25be869c0 20 add_watcher() i=2 2024-09-12T00:44:54.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.133+0000 7fb25be869c0 20 add_watcher() i=3 2024-09-12T00:44:54.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.133+0000 7fb25be869c0 20 add_watcher() i=4 2024-09-12T00:44:54.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.133+0000 7fb25be869c0 20 add_watcher() i=5 2024-09-12T00:44:54.132 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.133+0000 7fb25be869c0 20 add_watcher() i=6 2024-09-12T00:44:54.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.137+0000 7fb25be869c0 20 add_watcher() i=7 2024-09-12T00:44:54.134 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.137+0000 7fb25be869c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:54.137 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.137+0000 7fb1107e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:54.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.137+0000 7fb25be869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:54.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.137+0000 7fb25be869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:54.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 5 note: GC not initialized 2024-09-12T00:44:54.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb10f7e6640 20 reqs_thread_entry: start 2024-09-12T00:44:54.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:54.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 Filter name: none 2024-09-12T00:44:54.139 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb10d7e2640 20 reqs_thread_entry: start 2024-09-12T00:44:54.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:44:54.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:44:54.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:44:54.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:44:54.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:44:54.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:54.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:44:54.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:44:54.141 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:54.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.141+0000 7fb25be869c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:44:54.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.145+0000 7fb1107e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:54.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.149+0000 7fb25be869c0 20 remove_watcher() i=0 2024-09-12T00:44:54.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.149+0000 7fb25be869c0 2 removed watcher, disabling cache 2024-09-12T00:44:54.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.149+0000 7fb25be869c0 20 remove_watcher() i=1 2024-09-12T00:44:54.150 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.153+0000 7fb25be869c0 20 remove_watcher() i=2 2024-09-12T00:44:54.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.153+0000 7fb25be869c0 20 remove_watcher() i=3 2024-09-12T00:44:54.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.157+0000 7fb25be869c0 20 remove_watcher() i=4 2024-09-12T00:44:54.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.157+0000 7fb25be869c0 20 remove_watcher() i=5 2024-09-12T00:44:54.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.161+0000 7fb25be869c0 20 remove_watcher() i=6 2024-09-12T00:44:54.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:44:54.161+0000 7fb25be869c0 20 remove_watcher() i=7 2024-09-12T00:45:24.206 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:45:24.247 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:24.247 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:24.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 realm 2024-09-12T00:45:24.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:24.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:24.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:24.296 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 searching for the correct realm 2024-09-12T00:45:24.301 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.301+0000 7f82bbfb4640 0 -- 172.21.15.137:0/709487092 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f82b00ba040 msgr2=0x7f82b00e7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:24.309 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.309+0000 7f82bbfb4640 0 -- 172.21.15.137:0/709487092 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55a4c9e3dc80 msgr2=0x55a4c9e400f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:24.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:24.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:24.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:24.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:24.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:24.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:24.316 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 zone default found 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 Realm: () 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 zonegroup default 2024-09-12T00:45:24.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 started sync module instance, tier type = 2024-09-12T00:45:24.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:24.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=0 2024-09-12T00:45:24.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=1 2024-09-12T00:45:24.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=2 2024-09-12T00:45:24.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=3 2024-09-12T00:45:24.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=4 2024-09-12T00:45:24.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=5 2024-09-12T00:45:24.338 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=6 2024-09-12T00:45:24.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.341+0000 7f82becaf9c0 20 add_watcher() i=7 2024-09-12T00:45:24.340 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.341+0000 7f82becaf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:24.344 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f8172fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 note: GC not initialized 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f8171fdb640 20 reqs_thread_entry: start 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 Filter name: none 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f80e37fe640 20 reqs_thread_entry: start 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:45:24.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:24.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:45:24.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:45:24.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:45:24.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:24.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:45:24.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.347 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:45:24.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.349+0000 7f82becaf9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:45:24.357 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.358 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:45:24.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94166250201312 notifier 7835 bl.length()=827 2024-09-12T00:45:24.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.359 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:45:24.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:45:24.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:45:24.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:45:24.363 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f82becaf9c0 time 2024-09-12T00:45:24.367313+0000 2024-09-12T00:45:24.363 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:45:24.364 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:24.364 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f82c25892eb] 2024-09-12T00:45:24.364 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f82c258949f] 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c8278cc1] 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422aac) [0x55a4c8cd6aac] 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c828dced] 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f82c13efd90] 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f82becaf9c0 thread_name:radosgw-admin 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.365+0000 7f82becaf9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f82becaf9c0 time 2024-09-12T00:45:24.367313+0000 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.365 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f82c25892eb] 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f82c258949f] 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c8278cc1] 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422aac) [0x55a4c8cd6aac] 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c828dced] 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f82c13efd90] 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:45:24.366 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.383 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:24.383 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f82c1408520] 2024-09-12T00:45:24.383 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f82c2589345] 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f82c258949f] 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c8278cc1] 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422aac) [0x55a4c8cd6aac] 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c828dced] 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f82c13efd90] 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:45:24.384 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.365+0000 7f82becaf9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f82becaf9c0 thread_name:radosgw-admin 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f82c1408520] 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f82c2589345] 2024-09-12T00:45:24.385 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f82c258949f] 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c8278cc1] 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422aac) [0x55a4c8cd6aac] 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c828dced] 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f82c13efd90] 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:45:24.269+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_done global_id 8235 payload 274 2024-09-12T00:45:24.386 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:45:24.269+0000 7f82bc7b5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:45:24.269+0000 7f82bc7b5640 1 monclient: found mon.noname-a 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:45:24.269+0000 7f82bc7b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: dump: 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.387 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: dump: 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.388 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:45:24.269+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 8235 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:45:24.269+0000 7f82becaf9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:45:24.269+0000 7f82becaf9c0 4 set_mon_vals no callback set 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: shutdown 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) unregister_commands rotate-key 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:24.389 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: monmap: 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding auth protocol: cephx 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding auth protocol: cephx 2024-09-12T00:45:24.390 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding auth protocol: cephx 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.391 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: starting msgr at 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: starting objecter 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command objecter_requests hook 0x55a4c9c9e100 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: setting wanted keys 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: calling monclient init 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: init 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding auth protocol: cephx 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding auth protocol: cephx 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding auth protocol: cephx 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.392 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command rotate-key hook 0x55a4c9d54e38 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:45:24.393 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c9be1e00 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c9c04920 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c9c9cce0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): authenticate will time out at 2425.405862s 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request con 0x55a4c9be1e00 auth_method 0 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request con 0x55a4c9c9cce0 auth_method 0 2024-09-12T00:45:24.394 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_done global_id 8238 payload 824 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 1 monclient: found mon.noname-a 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.395 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:45:24.273+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x55a4c9c04920 auth_method 0 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: dump: 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.396 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: dump: 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.397 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 8238 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:45:24.273+0000 7f81aa60c640 4 set_mon_vals no callback set 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: init done 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:45:24.277+0000 7f81a8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:45:24.277+0000 7f81a8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:45:24.277+0000 7f81a8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:45:24.277+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f81a4070ae0 auth_method 0 2024-09-12T00:45:24.398 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:45:24.277+0000 7f82bcfb6640 10 monclient: get_auth_request con 0x55a4c9d7f950 auth_method 0 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:45:24.277+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x55a4c9d9f390 auth_method 0 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:45:24.281+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x55a4c9da4590 auth_method 0 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: monmap: 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:24.399 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding auth protocol: cephx 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding auth protocol: cephx 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding auth protocol: cephx 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.400 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a4c9dabfd0 EEXIST 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: init 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding auth protocol: cephx 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding auth protocol: cephx 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding auth protocol: cephx 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.401 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command rotate-key cmddesc rotate-key hook 0x55a4c9da76a0 EEXIST 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:24.402 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c9dd0180 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c9dcfab0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c9dce490 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): authenticate will time out at 2425.415951s 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request con 0x55a4c9dd0180 auth_method 0 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): get_auth_request con 0x55a4c9dcfab0 auth_method 0 2024-09-12T00:45:24.403 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_done global_id 8241 payload 824 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 1 monclient: found mon.noname-a 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.404 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:45:24.285+0000 7f82bcfb6640 10 monclient: get_auth_request con 0x55a4c9dce490 auth_method 0 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: dump: 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.405 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: dump: 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.406 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 8241 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:45:24.285+0000 7f82bb7b3640 4 set_mon_vals no callback set 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.407 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f8194070a20 auth_method 0 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: get_monmap_and_config 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: monmap: 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.408 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding auth protocol: cephx 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding auth protocol: cephx 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding auth protocol: cephx 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.409 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: init 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding auth protocol: cephx 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding auth protocol: cephx 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding auth protocol: cephx 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.410 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command rotate-key cmddesc rotate-key hook 0x7fff9126cfa8 EEXIST 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:45:24.411 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c9e23c90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c9df3800 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c9e14710 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): authenticate will time out at 2425.419981s 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request con 0x55a4c9e23c90 auth_method 0 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request con 0x55a4c9e14710 auth_method 0 2024-09-12T00:45:24.412 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_done global_id 8244 payload 274 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 1 monclient: found mon.noname-a 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.413 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: dump: 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.414 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: dump: 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.415 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 8244 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 4 set_mon_vals no callback set 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: shutdown 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: monmap: 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:24.416 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding auth protocol: cephx 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding auth protocol: cephx 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding auth protocol: cephx 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.417 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: starting msgr at 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: starting objecter 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a4c9df5a90 EEXIST 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: setting wanted keys 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: calling monclient init 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: init 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding auth protocol: cephx 2024-09-12T00:45:24.418 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding auth protocol: cephx 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding auth protocol: cephx 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.419 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command rotate-key cmddesc rotate-key hook 0x55a4c9dd20e8 EEXIST 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c9df3800 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c9e14710 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c9e23c90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:24.420 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): authenticate will time out at 2425.422829s 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request con 0x55a4c9e23c90 auth_method 0 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): get_auth_request con 0x55a4c9e14710 auth_method 0 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.421 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request con 0x55a4c9df3800 auth_method 0 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_done global_id 7835 payload 824 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 1 monclient: found mon.noname-c 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: dump: 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.422 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.423 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: dump: 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 7835 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:45:24.289+0000 7f81937fe640 4 set_mon_vals no callback set 2024-09-12T00:45:24.424 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: init done 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cr dump hook 0x55a4c9e1b698 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:45:24.293+0000 7f8191ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:45:24.293+0000 7f8191ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:45:24.293+0000 7f8191ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:45:24.293+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x7f8184070ae0 auth_method 0 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:45:24.293+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x55a4c9e3dc80 auth_method 0 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.425 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 realm 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:45:24.297+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x55a4c9e41ec0 auth_method 0 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 searching for the correct realm 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:45:24.297+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x55a4c9e47160 auth_method 0 2024-09-12T00:45:24.426 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:45:24.297+0000 7f82bcfb6640 10 monclient: get_auth_request con 0x7f82b00cb070 auth_method 0 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:45:24.301+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x7f82ac019070 auth_method 0 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:45:24.301+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f82b00ba040 auth_method 0 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:45:24.301+0000 7f82bbfb4640 0 -- 172.21.15.137:0/709487092 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f82b00ba040 msgr2=0x7f82b00e7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:45:24.301+0000 7f8191ffb640 1 client.7835.objecter ms_handle_reset 0x7f82b00ba040 session 0x7f82b00b3040 osd.5 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:45:24.301+0000 7f8191ffb640 10 monclient: _renew_subs 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:45:24.301+0000 7f8191ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:45:24.305+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f8184080e90 auth_method 0 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:45:24.305+0000 7f82bcfb6640 10 monclient: get_auth_request con 0x7f82ac06fba0 auth_method 0 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:45:24.309+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x7f82b4004040 auth_method 0 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:45:24.309+0000 7f82bbfb4640 0 -- 172.21.15.137:0/709487092 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55a4c9e3dc80 msgr2=0x55a4c9e400f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:45:24.309+0000 7f8191ffb640 1 client.7835.objecter ms_handle_reset 0x55a4c9e3dc80 session 0x55a4c9e3d600 osd.6 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:45:24.309+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f82b00ba040 auth_method 0 2024-09-12T00:45:24.427 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:24.428 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:24.428 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:24.428 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:24.428 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:24.428 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 zone default found 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 Realm: () 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 zonegroup default 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.429 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 started sync module instance, tier type = 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=0 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=1 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=2 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=3 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=4 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=5 2024-09-12T00:45:24.430 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=6 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:45:24.341+0000 7f82becaf9c0 20 add_watcher() i=7 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:45:24.341+0000 7f82becaf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding auth protocol: cephx 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding auth protocol: cephx 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding auth protocol: cephx 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:45:24.345+0000 7f8172fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.431 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cache list hook 0x55a4c9e23200 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cache inspect hook 0x55a4c9e23200 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cache erase hook 0x55a4c9e23200 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cache zap hook 0x55a4c9e23200 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 note: GC not initialized 2024-09-12T00:45:24.432 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:45:24.345+0000 7f8171fdb640 20 reqs_thread_entry: start 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command sync trace show hook 0x7f82b4014040 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command sync trace history hook 0x7f82b4014040 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command sync trace active hook 0x7f82b4014040 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command sync trace active_short hook 0x7f82b4014040 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 Filter name: none 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:45:24.345+0000 7f80e37fe640 20 reqs_thread_entry: start 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:45:24.433 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:45:24.349+0000 7f82becaf9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94166250201312 notifier 7835 bl.length()=827 2024-09-12T00:45:24.434 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:45:24.365+0000 7f82becaf9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f82becaf9c0 time 2024-09-12T00:45:24.367313+0000 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f82c25892eb] 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f82c258949f] 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c8278cc1] 2024-09-12T00:45:24.435 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422aac) [0x55a4c8cd6aac] 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c828dced] 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f82c13efd90] 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:45:24.365+0000 7f82becaf9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f82becaf9c0 thread_name:radosgw-admin 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f82c1408520] 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:45:24.436 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f82c2589345] 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f82c258949f] 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c8278cc1] 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422aac) [0x55a4c8cd6aac] 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c828dced] 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f82c13efd90] 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.437 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:45:24.438 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:45:24.439 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:45:24.440 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:45:24.441 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:45:24.442 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:45:24.443 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 7f80e37fe640 / http_manager 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8171fdb640 / http_manager 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8172fdd640 / rgw_dt_lg_renew 2024-09-12T00:45:24.444 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8191ffb640 / ms_dispatch 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f81937fe640 / io_context_pool 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f81a1ffb640 / ms_dispatch 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f81a8e09640 / ms_dispatch 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f81aa60c640 / io_context_pool 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82bb7b3640 / io_context_pool 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82bbfb4640 / msgr-worker-2 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82bc7b5640 / msgr-worker-1 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82bcfb6640 / msgr-worker-0 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82becaf9c0 / radosgw-admin 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.145546.log 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:45:24.445 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:45:24.269+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_done global_id 8235 payload 274 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:45:24.269+0000 7f82bc7b5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:45:24.269+0000 7f82bc7b5640 1 monclient: found mon.noname-a 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:45:24.269+0000 7f82bc7b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: dump: 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.446 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:45:24.269+0000 7f81aa60c640 10 monclient: dump: 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.447 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:45:24.269+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 8235 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:45:24.269+0000 7f82becaf9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:45:24.269+0000 7f82becaf9c0 4 set_mon_vals no callback set 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: shutdown 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) unregister_commands rotate-key 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:24.448 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: monmap: 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding auth protocol: cephx 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding auth protocol: cephx 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding auth protocol: cephx 2024-09-12T00:45:24.449 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: crc 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d5a040) adding con mode: secure 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.450 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: starting msgr at 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: starting objecter 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command objecter_requests hook 0x55a4c9c9e100 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: setting wanted keys 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: calling monclient init 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: init 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding auth protocol: cephx 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding auth protocol: cephx 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding auth protocol: cephx 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.451 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: crc 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9d54cf0) adding con mode: secure 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command rotate-key hook 0x55a4c9d54e38 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:45:24.452 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c9be1e00 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c9c04920 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c9c9cce0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient(hunting): authenticate will time out at 2425.405862s 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request con 0x55a4c9be1e00 auth_method 0 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request con 0x55a4c9c9cce0 auth_method 0 2024-09-12T00:45:24.453 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:45:24.273+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_done global_id 8238 payload 824 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 1 monclient: found mon.noname-a 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:45:24.273+0000 7f82bc7b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:45:24.273+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x55a4c9c04920 auth_method 0 2024-09-12T00:45:24.454 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: dump: 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.455 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:45:24.273+0000 7f81a8e09640 10 monclient: dump: 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.456 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 8238 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:45:24.273+0000 7f81aa60c640 4 set_mon_vals no callback set 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:45:24.273+0000 7f82becaf9c0 1 librados: init done 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:45:24.277+0000 7f81a8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:45:24.277+0000 7f81a8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:45:24.277+0000 7f81a8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:45:24.277+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f81a4070ae0 auth_method 0 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:45:24.277+0000 7f82bcfb6640 10 monclient: get_auth_request con 0x55a4c9d7f950 auth_method 0 2024-09-12T00:45:24.457 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:45:24.277+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x55a4c9d9f390 auth_method 0 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:45:24.281+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x55a4c9da4590 auth_method 0 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: monmap: 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:24.458 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding auth protocol: cephx 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding auth protocol: cephx 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding auth protocol: cephx 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.459 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: crc 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da85c0) adding con mode: secure 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a4c9dabfd0 EEXIST 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: init 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding auth protocol: cephx 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding auth protocol: cephx 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding auth protocol: cephx 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.460 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: crc 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9da7558) adding con mode: secure 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command rotate-key cmddesc rotate-key hook 0x55a4c9da76a0 EEXIST 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c9dd0180 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:24.461 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c9dcfab0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c9dce490 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:45:24.281+0000 7f82becaf9c0 10 monclient(hunting): authenticate will time out at 2425.415951s 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request con 0x55a4c9dd0180 auth_method 0 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): get_auth_request con 0x55a4c9dcfab0 auth_method 0 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.462 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_done global_id 8241 payload 824 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 1 monclient: found mon.noname-a 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:45:24.285+0000 7f82bc7b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:45:24.285+0000 7f82bcfb6640 10 monclient: get_auth_request con 0x55a4c9dce490 auth_method 0 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:24.463 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: dump: 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.464 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 10 monclient: dump: 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.465 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 8241 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:45:24.285+0000 7f82bb7b3640 4 set_mon_vals no callback set 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:45:24.285+0000 7f81a1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:45:24.285+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f8194070a20 auth_method 0 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: get_monmap_and_config 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:24.466 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: monmap: 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding auth protocol: cephx 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding auth protocol: cephx 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding auth protocol: cephx 2024-09-12T00:45:24.467 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: crc 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9def7f0) adding con mode: secure 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: init 2024-09-12T00:45:24.468 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding auth protocol: cephx 2024-09-12T00:45:24.469 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding auth protocol: cephx 2024-09-12T00:45:24.469 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding auth protocol: cephx 2024-09-12T00:45:24.469 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.469 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.469 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.469 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.469 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.469 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.472 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: crc 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126ce60) adding con mode: secure 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command rotate-key cmddesc rotate-key hook 0x7fff9126cfa8 EEXIST 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c9e23c90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c9df3800 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:24.473 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c9e14710 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:45:24.285+0000 7f82becaf9c0 10 monclient(hunting): authenticate will time out at 2425.419981s 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request con 0x55a4c9e23c90 auth_method 0 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request con 0x55a4c9e14710 auth_method 0 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.474 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_done global_id 8244 payload 274 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 1 monclient: found mon.noname-a 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: dump: 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.475 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.476 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:45:24.289+0000 7f81937fe640 10 monclient: dump: 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 8244 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:45:24.477 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 4 set_mon_vals no callback set 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: shutdown 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: monmap: 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:24.478 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding auth protocol: cephx 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding auth protocol: cephx 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding auth protocol: cephx 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.479 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: crc 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9e1fef0) adding con mode: secure 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: starting msgr at 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: starting objecter 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a4c9df5a90 EEXIST 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: setting wanted keys 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: calling monclient init 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: init 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding auth protocol: cephx 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding auth protocol: cephx 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding auth protocol: cephx 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.480 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: crc 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 AuthRegistry(0x55a4c9dd1fa0) adding con mode: secure 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.481 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command rotate-key cmddesc rotate-key hook 0x55a4c9dd20e8 EEXIST 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-b con 0x55a4c9df3800 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-a con 0x55a4c9e14710 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): picked mon.noname-c con 0x55a4c9e23c90 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient(hunting): authenticate will time out at 2425.422829s 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request con 0x55a4c9e23c90 auth_method 0 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.482 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): get_auth_request con 0x55a4c9e14710 auth_method 0 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:45:24.289+0000 7f82bbfb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request con 0x55a4c9df3800 auth_method 0 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:24.483 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:45:24.289+0000 7f82bc7b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient(hunting): handle_auth_done global_id 7835 payload 824 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient: _finish_hunting 0 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 1 monclient: found mon.noname-c 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:45:24.289+0000 7f82bcfb6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: dump: 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.484 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: _finish_auth 0 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:24.485 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:45:24.289+0000 7f8191ffb640 10 monclient: dump: 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.486 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 monclient: authenticate success, global_id 7835 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:45:24.289+0000 7f81937fe640 4 set_mon_vals no callback set 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _renew_subs 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 1 librados: init done 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:45:24.289+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cr dump hook 0x55a4c9e1b698 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:45:24.293+0000 7f8191ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:45:24.293+0000 7f8191ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:45:24.293+0000 7f8191ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:45:24.293+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x7f8184070ae0 auth_method 0 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:45:24.293+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x55a4c9e3dc80 auth_method 0 2024-09-12T00:45:24.487 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 realm 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:45:24.293+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:45:24.297+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x55a4c9e41ec0 auth_method 0 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:45:24.297+0000 7f82becaf9c0 20 searching for the correct realm 2024-09-12T00:45:24.488 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:45:24.297+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x55a4c9e47160 auth_method 0 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:45:24.297+0000 7f82bcfb6640 10 monclient: get_auth_request con 0x7f82b00cb070 auth_method 0 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:45:24.301+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x7f82ac019070 auth_method 0 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:45:24.301+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f82b00ba040 auth_method 0 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:45:24.301+0000 7f82bbfb4640 0 -- 172.21.15.137:0/709487092 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f82b00ba040 msgr2=0x7f82b00e7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:45:24.301+0000 7f8191ffb640 1 client.7835.objecter ms_handle_reset 0x7f82b00ba040 session 0x7f82b00b3040 osd.5 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:45:24.301+0000 7f8191ffb640 10 monclient: _renew_subs 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:45:24.301+0000 7f8191ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:45:24.305+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f8184080e90 auth_method 0 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:45:24.305+0000 7f82bcfb6640 10 monclient: get_auth_request con 0x7f82ac06fba0 auth_method 0 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:45:24.309+0000 7f82bc7b5640 10 monclient: get_auth_request con 0x7f82b4004040 auth_method 0 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:45:24.309+0000 7f82bbfb4640 0 -- 172.21.15.137:0/709487092 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55a4c9e3dc80 msgr2=0x55a4c9e400f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:45:24.309+0000 7f8191ffb640 1 client.7835.objecter ms_handle_reset 0x55a4c9e3dc80 session 0x55a4c9e3d600 osd.6 2024-09-12T00:45:24.489 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:45:24.309+0000 7f82bbfb4640 10 monclient: get_auth_request con 0x7f82b00ba040 auth_method 0 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:24.490 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 zone default found 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 Realm: () 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 zonegroup default 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:45:24.317+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 started sync module instance, tier type = 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:45:24.321+0000 7f82becaf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:24.491 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=0 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=1 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=2 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=3 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=4 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=5 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:45:24.337+0000 7f82becaf9c0 20 add_watcher() i=6 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:45:24.341+0000 7f82becaf9c0 20 add_watcher() i=7 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:45:24.341+0000 7f82becaf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding auth protocol: cephx 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding auth protocol: cephx 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding auth protocol: cephx 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.492 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:45:24.345+0000 7f8172fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: crc 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 AuthRegistry(0x7fff9126d340) adding con mode: secure 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:24.493 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cache list hook 0x55a4c9e23200 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cache inspect hook 0x55a4c9e23200 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cache erase hook 0x55a4c9e23200 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command cache zap hook 0x55a4c9e23200 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 note: GC not initialized 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:45:24.345+0000 7f8171fdb640 20 reqs_thread_entry: start 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command sync trace show hook 0x7f82b4014040 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command sync trace history hook 0x7f82b4014040 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command sync trace active hook 0x7f82b4014040 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 5 asok(0x55a4c9b472b0) register_command sync trace active_short hook 0x7f82b4014040 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 Filter name: none 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:45:24.345+0000 7f80e37fe640 20 reqs_thread_entry: start 2024-09-12T00:45:24.494 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:45:24.345+0000 7f82becaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:45:24.495 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:45:24.349+0000 7f82becaf9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:45:24.357+0000 7f82becaf9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94166250201312 notifier 7835 bl.length()=827 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:45:24.357+0000 7f81937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:45:24.361+0000 7f82becaf9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:45:24.365+0000 7f82becaf9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f82becaf9c0 time 2024-09-12T00:45:24.367313+0000 2024-09-12T00:45:24.496 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f82c25892eb] 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f82c258949f] 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c8278cc1] 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 4: radosgw-admin(+0x1422aac) [0x55a4c8cd6aac] 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c828dced] 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 6: main() 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f82c13efd90] 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 8: __libc_start_main() 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 9: _start() 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.497 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:45:24.365+0000 7f82becaf9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f82becaf9c0 thread_name:radosgw-admin 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f82c1408520] 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f82c2589345] 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f82c258949f] 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4c8278cc1] 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 8: radosgw-admin(+0x1422aac) [0x55a4c8cd6aac] 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a4c828dced] 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 10: main() 2024-09-12T00:45:24.498 INFO:tasks.workunit.client.0.smithi137.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f82c13efd90] 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 12: __libc_start_main() 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 13: _start() 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:45:24.499 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:45:24.500 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:45:24.501 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:45:24.502 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:45:24.503 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:45:24.504 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:45:24.505 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f80e37fe640 / http_manager 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8171fdb640 / http_manager 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8172fdd640 / rgw_dt_lg_renew 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8191ffb640 / ms_dispatch 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f81937fe640 / io_context_pool 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f81a1ffb640 / ms_dispatch 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f81a8e09640 / ms_dispatch 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f81aa60c640 / io_context_pool 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82bb7b3640 / io_context_pool 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82bbfb4640 / msgr-worker-2 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82bc7b5640 / msgr-worker-1 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82bcfb6640 / msgr-worker-0 2024-09-12T00:45:24.506 INFO:tasks.workunit.client.0.smithi137.stderr: 7f82becaf9c0 / radosgw-admin 2024-09-12T00:45:24.507 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:45:24.507 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:45:24.507 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:45:24.369830Z_e9ed69f8-4036-4398-97f4-8bfbc2855f6b/log 2024-09-12T00:45:24.507 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:45:24.507 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:45:24.507 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:45:24.512 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:24.512 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:24.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.445+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 realm 2024-09-12T00:45:24.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.449+0000 7f90de8d19c0 20 searching for the correct realm 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.457+0000 7f90dc3d7640 0 -- 172.21.15.137:0/713395542 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f90cc008050 msgr2=0x7f90cc065970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.465+0000 7f90dc3d7640 0 -- 172.21.15.137:0/713395542 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f90d40c1070 msgr2=0x7f90d40f6a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:24.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.469+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 zone default found 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 4 Realm: () 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:24.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 zonegroup default 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 started sync module instance, tier type = 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.473+0000 7f90de8d19c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.489+0000 7f90de8d19c0 20 add_watcher() i=0 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.489+0000 7f90de8d19c0 20 add_watcher() i=1 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.489+0000 7f90de8d19c0 20 add_watcher() i=2 2024-09-12T00:45:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.489+0000 7f90de8d19c0 20 add_watcher() i=3 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.489+0000 7f90de8d19c0 20 add_watcher() i=4 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.489+0000 7f90de8d19c0 20 add_watcher() i=5 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.493+0000 7f90de8d19c0 20 add_watcher() i=6 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.493+0000 7f90de8d19c0 20 add_watcher() i=7 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.493+0000 7f90de8d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f8f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 5 note: GC not initialized 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f8f91fdb640 20 reqs_thread_entry: start 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 Filter name: none 2024-09-12T00:45:24.516 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f8f037fe640 20 reqs_thread_entry: start 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:45:24.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.497+0000 7f90de8d19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.501+0000 7f90de8d19c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.501+0000 7f90de8d19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.501+0000 7f90de8d19c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.501+0000 7f90de8d19c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.501+0000 7f8f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.505+0000 7f90de8d19c0 20 remove_watcher() i=0 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.505+0000 7f90de8d19c0 2 removed watcher, disabling cache 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.509+0000 7f90de8d19c0 20 remove_watcher() i=1 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.509+0000 7f90de8d19c0 20 remove_watcher() i=2 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.513+0000 7f90de8d19c0 20 remove_watcher() i=3 2024-09-12T00:45:24.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.513+0000 7f90de8d19c0 20 remove_watcher() i=4 2024-09-12T00:45:24.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.517+0000 7f90de8d19c0 20 remove_watcher() i=5 2024-09-12T00:45:24.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.517+0000 7f90de8d19c0 20 remove_watcher() i=6 2024-09-12T00:45:24.519 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:24.521+0000 7f90de8d19c0 20 remove_watcher() i=7 2024-09-12T00:45:24.532 INFO:tasks.workunit.client.0.smithi137.stderr: test: duplicated entries can be purged manually 2024-09-12T00:45:54.563 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:45:54.596 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:54.597 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:54.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.640+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.644+0000 7f0ce452a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:54.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.644+0000 7f0ce452a9c0 20 realm 2024-09-12T00:45:54.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.644+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.644+0000 7f0ce452a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:54.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.644+0000 7f0ce452a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:54.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.644+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.644+0000 7f0ce452a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:54.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.644+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.648+0000 7f0ce452a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:54.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.648+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.648+0000 7f0ce452a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:54.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.648+0000 7f0ce452a9c0 20 searching for the correct realm 2024-09-12T00:45:54.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.652+0000 7f0ce182f640 0 -- 172.21.15.137:0/2611999787 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f0ccc124930 msgr2=0x7f0ccc1241a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:54.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.868+0000 7f0ce2831640 0 -- 172.21.15.137:0/2611999787 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x564ad1d56220 msgr2=0x564ad1d586e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:54.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:54.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:54.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:54.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:54.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:54.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:54.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:54.879 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:54.880 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:54.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 zone default found 2024-09-12T00:45:54.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 4 Realm: () 2024-09-12T00:45:54.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:54.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:54.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:54.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 zonegroup default 2024-09-12T00:45:54.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:54.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.880+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.884+0000 7f0ce452a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:54.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.884+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.884+0000 7f0ce452a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:54.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.884+0000 7f0ce452a9c0 20 started sync module instance, tier type = 2024-09-12T00:45:54.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.884+0000 7f0ce452a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:54.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.908+0000 7f0ce452a9c0 20 add_watcher() i=0 2024-09-12T00:45:54.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.908+0000 7f0ce452a9c0 20 add_watcher() i=1 2024-09-12T00:45:54.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.908+0000 7f0ce452a9c0 20 add_watcher() i=2 2024-09-12T00:45:54.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.908+0000 7f0ce452a9c0 20 add_watcher() i=3 2024-09-12T00:45:54.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.908+0000 7f0ce452a9c0 20 add_watcher() i=4 2024-09-12T00:45:54.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.908+0000 7f0ce452a9c0 20 add_watcher() i=5 2024-09-12T00:45:54.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.908+0000 7f0ce452a9c0 20 add_watcher() i=6 2024-09-12T00:45:54.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.912+0000 7f0ce452a9c0 20 add_watcher() i=7 2024-09-12T00:45:54.910 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.912+0000 7f0ce452a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:54.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0b98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:54.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0ce452a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:54.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0ce452a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:54.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0ce452a9c0 5 note: GC not initialized 2024-09-12T00:45:54.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0b137fe640 20 reqs_thread_entry: start 2024-09-12T00:45:54.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0ce452a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:54.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0ce452a9c0 20 Filter name: none 2024-09-12T00:45:54.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0b117fa640 20 reqs_thread_entry: start 2024-09-12T00:45:54.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.916+0000 7f0ce452a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:54.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.920+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.920+0000 7f0ce452a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:54.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.920+0000 7f0ce452a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:45:54.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.920+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.920+0000 7f0ce452a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:54.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.920+0000 7f0ce452a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:54.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.920+0000 7f0ce452a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:54.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.920+0000 7f0ce452a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:45:54.923 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.924+0000 7f0b98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:54.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.928+0000 7f0ce452a9c0 20 remove_watcher() i=0 2024-09-12T00:45:54.928 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.928+0000 7f0ce452a9c0 2 removed watcher, disabling cache 2024-09-12T00:45:54.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.928+0000 7f0ce452a9c0 20 remove_watcher() i=1 2024-09-12T00:45:54.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.932+0000 7f0ce452a9c0 20 remove_watcher() i=2 2024-09-12T00:45:54.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.932+0000 7f0ce452a9c0 20 remove_watcher() i=3 2024-09-12T00:45:54.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.936+0000 7f0ce452a9c0 20 remove_watcher() i=4 2024-09-12T00:45:54.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.940+0000 7f0ce452a9c0 20 remove_watcher() i=5 2024-09-12T00:45:54.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.940+0000 7f0ce452a9c0 20 remove_watcher() i=6 2024-09-12T00:45:54.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:54.944+0000 7f0ce452a9c0 20 remove_watcher() i=7 2024-09-12T00:45:54.961 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:54.961 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:45:54.961 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: a-bucket id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T00:45:54.961 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:54.961 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:45:54.998 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:54.999 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:55.042 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.040+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 realm 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.048+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:55.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.048+0000 7f889daee9c0 20 searching for the correct realm 2024-09-12T00:45:55.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.056+0000 7f889b5f4640 0 -- 172.21.15.137:0/821317520 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55adfadb0da0 msgr2=0x55adfadb3190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.060+0000 7f889b5f4640 0 -- 172.21.15.137:0/821317520 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f8894017070 msgr2=0x7f889408eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:55.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:55.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:55.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:55.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:55.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:55.065 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:55.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 zone default found 2024-09-12T00:45:55.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 4 Realm: () 2024-09-12T00:45:55.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:55.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:55.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:55.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 zonegroup default 2024-09-12T00:45:55.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 started sync module instance, tier type = 2024-09-12T00:45:55.069 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.068+0000 7f889daee9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:55.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=0 2024-09-12T00:45:55.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=1 2024-09-12T00:45:55.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=2 2024-09-12T00:45:55.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=3 2024-09-12T00:45:55.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=4 2024-09-12T00:45:55.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=5 2024-09-12T00:45:55.088 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=6 2024-09-12T00:45:55.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=7 2024-09-12T00:45:55.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.088+0000 7f889daee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:55.092 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f8751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:55.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 5 note: GC not initialized 2024-09-12T00:45:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f8750fe1640 20 reqs_thread_entry: start 2024-09-12T00:45:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 20 Filter name: none 2024-09-12T00:45:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f86ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:45:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:45:55.094 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:55.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:45:55.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:45:55.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:45:55.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.096+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:55.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.096+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.096+0000 7f889daee9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.096+0000 7f889daee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:45:55.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.096+0000 7f889daee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.096 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.096+0000 7f889daee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:45:55.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.096+0000 7f889daee9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:45:55.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f889daee9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f889daee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f889daee9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:45:55.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94205726396976 notifier 7883 bl.length()=827 2024-09-12T00:45:55.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:45:55.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:45:55.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:45:55.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:45:55.110 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f889daee9c0 time 2024-09-12T00:45:55.114747+0000 2024-09-12T00:45:55.110 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f88a13c82eb] 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f88a13c849f] 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55adf8429cc1] 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55adf843ed5a] 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f88a022ed90] 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:45:55.112 INFO:tasks.workunit.client.0.smithi137.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f889daee9c0 thread_name:radosgw-admin 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.112+0000 7f889daee9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f889daee9c0 time 2024-09-12T00:45:55.114747+0000 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f88a13c82eb] 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f88a13c849f] 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55adf8429cc1] 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55adf843ed5a] 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f88a022ed90] 2024-09-12T00:45:55.113 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:45:55.114 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:45:55.114 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.141 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f88a0247520] 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f88a13c8345] 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f88a13c849f] 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55adf8429cc1] 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55adf843ed5a] 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:45:55.164 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f88a022ed90] 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.112+0000 7f889daee9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f889daee9c0 thread_name:radosgw-admin 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f88a0247520] 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f88a13c8345] 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f88a13c849f] 2024-09-12T00:45:55.165 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55adf8429cc1] 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55adf843ed5a] 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f88a022ed90] 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:45:55.020+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:45:55.020+0000 7f889bdf5640 10 monclient(hunting): handle_auth_done global_id 7871 payload 274 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:45:55.020+0000 7f889bdf5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.166 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:45:55.020+0000 7f889bdf5640 1 monclient: found mon.noname-c 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:45:55.020+0000 7f889bdf5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: dump: 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.167 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: dump: 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.168 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 monclient: authenticate success, global_id 7871 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:45:55.020+0000 7f889daee9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:45:55.020+0000 7f889daee9c0 4 set_mon_vals no callback set 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:45:55.020+0000 7f889daee9c0 10 monclient: shutdown 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 asok(0x55adfaab62b0) unregister_commands rotate-key 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:45:55.020+0000 7f889daee9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:45:55.020+0000 7f889daee9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:45:55.020+0000 7f889daee9c0 10 monclient: monmap: 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:55.169 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding auth protocol: cephx 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding auth protocol: cephx 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding auth protocol: cephx 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.170 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:45:55.020+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:45:55.020+0000 7f889daee9c0 1 librados: starting msgr at 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:45:55.020+0000 7f889daee9c0 1 librados: starting objecter 2024-09-12T00:45:55.171 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command objecter_requests hook 0x55adfab78af0 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:45:55.024+0000 7f889daee9c0 1 librados: setting wanted keys 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:45:55.024+0000 7f889daee9c0 1 librados: calling monclient init 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: init 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding auth protocol: cephx 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding auth protocol: cephx 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding auth protocol: cephx 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.172 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:45:55.024+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:45:55.024+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command rotate-key hook 0x55adfacc3918 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-a con 0x55adfac0f1b0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-b con 0x55adfac0fe50 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-c con 0x55adfacc6ae0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): authenticate will time out at 2456.156608s 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): get_auth_request con 0x55adfac0f1b0 auth_method 0 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): get_auth_request con 0x55adfacc6ae0 auth_method 0 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): handle_auth_done global_id 7874 payload 824 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:45:55.024+0000 7f889bdf5640 1 monclient: found mon.noname-c 2024-09-12T00:45:55.175 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: dump: 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.176 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: dump: 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:45:55.024+0000 7f878960a640 4 set_mon_vals no callback set 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 monclient: authenticate success, global_id 7874 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:45:55.024+0000 7f889daee9c0 1 librados: init done 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:45:55.024+0000 7f8787e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:45:55.024+0000 7f8787e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:45:55.024+0000 7f8787e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:45:55.028+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f8780070b10 auth_method 0 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:45:55.028+0000 7f889adf3640 10 monclient: get_auth_request con 0x55adfad0b880 auth_method 0 2024-09-12T00:45:55.178 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:45:55.028+0000 7f889b5f4640 10 monclient: get_auth_request con 0x55adfad0e6c0 auth_method 0 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:45:55.028+0000 7f889adf3640 10 monclient: get_auth_request con 0x55adfad137e0 auth_method 0 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:45:55.032+0000 7f889daee9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: monmap: 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:55.179 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding auth protocol: cephx 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding auth protocol: cephx 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding auth protocol: cephx 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.180 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:45:55.032+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command objecter_requests cmddesc objecter_requests hook 0x55adfad1b200 EEXIST 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: init 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding auth protocol: cephx 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding auth protocol: cephx 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding auth protocol: cephx 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.181 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:45:55.032+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:45:55.032+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command rotate-key cmddesc rotate-key hook 0x55adfad16930 EEXIST 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-b con 0x55adfad3f3b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-a con 0x55adfad3ece0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-c con 0x55adfad3d6c0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:55.182 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): authenticate will time out at 2456.166271s 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): get_auth_request con 0x55adfad3d6c0 auth_method 0 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): get_auth_request con 0x55adfad3ece0 auth_method 0 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): handle_auth_done global_id 7877 payload 824 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:45:55.032+0000 7f889bdf5640 1 monclient: found mon.noname-c 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:45:55.032+0000 7f889b5f4640 10 monclient: get_auth_request con 0x55adfad3f3b0 auth_method 0 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: dump: 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.184 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:55.185 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: dump: 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 monclient: authenticate success, global_id 7877 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:45:55.032+0000 7f889c5f6640 4 set_mon_vals no callback set 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.186 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:45:55.036+0000 7f8785602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:45:55.036+0000 7f8785602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:45:55.036+0000 7f8785602640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f8774070a20 auth_method 0 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: get_monmap_and_config 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:45:55.036+0000 7f889daee9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: monmap: 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:55.187 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding auth protocol: cephx 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding auth protocol: cephx 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding auth protocol: cephx 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:45:55.036+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: init 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding auth protocol: cephx 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding auth protocol: cephx 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding auth protocol: cephx 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:45:55.036+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:45:55.036+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd11284388 EEXIST 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-c con 0x55adfad92c80 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:55.190 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-b con 0x55adfad93060 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-a con 0x55adfad8e790 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): authenticate will time out at 2456.170262s 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): get_auth_request con 0x55adfad8e790 auth_method 0 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): get_auth_request con 0x55adfad92c80 auth_method 0 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.191 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): handle_auth_done global_id 8295 payload 274 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:45:55.036+0000 7f889bdf5640 1 monclient: found mon.noname-a 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.192 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: dump: 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.193 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: dump: 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 monclient: authenticate success, global_id 8295 2024-09-12T00:45:55.194 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:45:55.036+0000 7f889daee9c0 4 set_mon_vals no callback set 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: shutdown 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:45:55.036+0000 7f889daee9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: monmap: 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:55.195 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding auth protocol: cephx 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding auth protocol: cephx 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding auth protocol: cephx 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.196 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:45:55.040+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: starting msgr at 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: starting objecter 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command objecter_requests cmddesc objecter_requests hook 0x55adfad40f70 EEXIST 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: setting wanted keys 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: calling monclient init 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: init 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding auth protocol: cephx 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding auth protocol: cephx 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding auth protocol: cephx 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.197 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:45:55.040+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:45:55.040+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command rotate-key cmddesc rotate-key hook 0x55adfad41318 EEXIST 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-c con 0x55adfad8e790 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:55.198 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-a con 0x55adfad92c80 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-b con 0x55adfad862c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): authenticate will time out at 2456.172845s 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): get_auth_request con 0x55adfad8e790 auth_method 0 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): get_auth_request con 0x55adfad92c80 auth_method 0 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.199 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:45:55.040+0000 7f889bdf5640 10 monclient(hunting): get_auth_request con 0x55adfad862c0 auth_method 0 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:45:55.040+0000 7f889bdf5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:45:55.040+0000 7f889bdf5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:45:55.040+0000 7f889bdf5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): handle_auth_done global_id 7883 payload 824 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:45:55.040+0000 7f889b5f4640 1 monclient: found mon.noname-c 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.200 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: dump: 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.201 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: dump: 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 monclient: authenticate success, global_id 7883 2024-09-12T00:45:55.202 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:45:55.040+0000 7f877effd640 4 set_mon_vals no callback set 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: init done 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cr dump hook 0x55adfad85ef8 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:45:55.040+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:45:55.044+0000 7f877d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:45:55.044+0000 7f877d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:45:55.044+0000 7f877d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:45:55.044+0000 7f889adf3640 10 monclient: get_auth_request con 0x7f8764070ae0 auth_method 0 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:45:55.044+0000 7f889bdf5640 10 monclient: get_auth_request con 0x55adfadaca90 auth_method 0 2024-09-12T00:45:55.203 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 realm 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:45:55.044+0000 7f889daee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:45:55.044+0000 7f889b5f4640 10 monclient: get_auth_request con 0x55adfadb0da0 auth_method 0 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:45:55.048+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:45:55.048+0000 7f889daee9c0 20 searching for the correct realm 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:45:55.048+0000 7f889adf3640 10 monclient: get_auth_request con 0x55adfadb5f30 auth_method 0 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:45:55.048+0000 7f889bdf5640 10 monclient: get_auth_request con 0x7f88900ac030 auth_method 0 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:45:55.048+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f888c035040 auth_method 0 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:45:55.052+0000 7f889adf3640 10 monclient: get_auth_request con 0x7f88900ca940 auth_method 0 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:45:55.056+0000 7f889b5f4640 0 -- 172.21.15.137:0/821317520 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55adfadb0da0 msgr2=0x55adfadb3190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:45:55.056+0000 7f877d7fa640 1 client.7883.objecter ms_handle_reset 0x55adfadb0da0 session 0x55adfadafc30 osd.1 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:45:55.056+0000 7f877d7fa640 10 monclient: _renew_subs 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:45:55.056+0000 7f877d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:45:55.056+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f8764080e90 auth_method 0 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:45:55.056+0000 7f889bdf5640 10 monclient: get_auth_request con 0x7f888c019040 auth_method 0 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:45:55.056+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f8894017070 auth_method 0 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:45:55.060+0000 7f889b5f4640 0 -- 172.21.15.137:0/821317520 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f8894017070 msgr2=0x7f889408eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:45:55.060+0000 7f877d7fa640 1 client.7883.objecter ms_handle_reset 0x7f8894017070 session 0x7f889408b070 osd.3 2024-09-12T00:45:55.205 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:45:55.060+0000 7f889b5f4640 10 monclient: get_auth_request con 0x55adfadb0da0 auth_method 0 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 zone default found 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:45:55.068+0000 7f889daee9c0 4 Realm: () 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:45:55.068+0000 7f889daee9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:45:55.068+0000 7f889daee9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:45:55.068+0000 7f889daee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 zonegroup default 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 started sync module instance, tier type = 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=0 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=1 2024-09-12T00:45:55.207 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=2 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=3 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=4 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=5 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=6 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=7 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:45:55.088+0000 7f889daee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding auth protocol: cephx 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding auth protocol: cephx 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding auth protocol: cephx 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.208 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:45:55.092+0000 7f8751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:45:55.092+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cache list hook 0x55adfad5fc20 2024-09-12T00:45:55.209 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cache inspect hook 0x55adfad5fc20 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cache erase hook 0x55adfad5fc20 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cache zap hook 0x55adfad5fc20 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 note: GC not initialized 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:45:55.092+0000 7f8750fe1640 20 reqs_thread_entry: start 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command sync trace show hook 0x7f8890004650 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command sync trace history hook 0x7f8890004650 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command sync trace active hook 0x7f8890004650 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command sync trace active_short hook 0x7f8890004650 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 Filter name: none 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:45:55.092+0000 7f86ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:45:55.210 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:45:55.092+0000 7f889daee9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:45:55.096+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:45:55.104+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.211 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:45:55.104+0000 7f889daee9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:45:55.104+0000 7f889daee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:45:55.104+0000 7f889daee9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94205726396976 notifier 7883 bl.length()=827 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:45:55.112+0000 7f889daee9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f889daee9c0 time 2024-09-12T00:45:55.114747+0000 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:55.212 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f88a13c82eb] 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f88a13c849f] 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55adf8429cc1] 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55adf843ed5a] 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f88a022ed90] 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:45:55.112+0000 7f889daee9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f889daee9c0 thread_name:radosgw-admin 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f88a0247520] 2024-09-12T00:45:55.213 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f88a13c8345] 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f88a13c849f] 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55adf8429cc1] 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55adf843ed5a] 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f88a022ed90] 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:45:55.214 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:45:55.215 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:45:55.216 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:45:55.217 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:45:55.218 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:45:55.219 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 7f86ca7fc640 / http_manager 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8750fe1640 / http_manager 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8751fe3640 / rgw_dt_lg_renew 2024-09-12T00:45:55.221 INFO:tasks.workunit.client.0.smithi137.stderr: 7f877d7fa640 / ms_dispatch 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f877e7fc640 / io_context_pool 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f877effd640 / io_context_pool 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8785602640 / ms_dispatch 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8787e07640 / ms_dispatch 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f878960a640 / io_context_pool 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889adf3640 / msgr-worker-2 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889b5f4640 / msgr-worker-1 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889bdf5640 / msgr-worker-0 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889c5f6640 / io_context_pool 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889daee9c0 / radosgw-admin 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/log/ceph/ceph-client.admin.147317.log 2024-09-12T00:45:55.222 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr:--- begin dump of recent events --- 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr: -499> 2024-09-12T00:45:55.020+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr: -498> 2024-09-12T00:45:55.020+0000 7f889bdf5640 10 monclient(hunting): handle_auth_done global_id 7871 payload 274 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr: -497> 2024-09-12T00:45:55.020+0000 7f889bdf5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr: -496> 2024-09-12T00:45:55.020+0000 7f889bdf5640 1 monclient: found mon.noname-c 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr: -495> 2024-09-12T00:45:55.020+0000 7f889bdf5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr: -494> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr: -493> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr: -492> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: dump: 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr: -491> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr: -490> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr: -489> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr: -488> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr: -487> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr: -486> 2024-09-12T00:45:55.020+0000 7f878960a640 10 monclient: dump: 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.224 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr: -485> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 monclient: authenticate success, global_id 7871 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr: -484> 2024-09-12T00:45:55.020+0000 7f889daee9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr: -483> 2024-09-12T00:45:55.020+0000 7f889daee9c0 4 set_mon_vals no callback set 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr: -482> 2024-09-12T00:45:55.020+0000 7f889daee9c0 10 monclient: shutdown 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr: -481> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 asok(0x55adfaab62b0) unregister_commands rotate-key 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr: -480> 2024-09-12T00:45:55.020+0000 7f889daee9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:55.225 INFO:tasks.workunit.client.0.smithi137.stderr: -479> 2024-09-12T00:45:55.020+0000 7f889daee9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr: -478> 2024-09-12T00:45:55.020+0000 7f889daee9c0 10 monclient: monmap: 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr: -477> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding auth protocol: cephx 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr: -476> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding auth protocol: cephx 2024-09-12T00:45:55.226 INFO:tasks.workunit.client.0.smithi137.stderr: -475> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding auth protocol: cephx 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -474> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -473> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -472> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -471> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -470> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -469> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -468> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -467> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -466> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -465> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -464> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: crc 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -463> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc9850) adding con mode: secure 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -462> 2024-09-12T00:45:55.020+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.227 INFO:tasks.workunit.client.0.smithi137.stderr: -461> 2024-09-12T00:45:55.020+0000 7f889daee9c0 1 librados: starting msgr at 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -460> 2024-09-12T00:45:55.020+0000 7f889daee9c0 1 librados: starting objecter 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -459> 2024-09-12T00:45:55.020+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command objecter_requests hook 0x55adfab78af0 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -458> 2024-09-12T00:45:55.024+0000 7f889daee9c0 1 librados: setting wanted keys 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -457> 2024-09-12T00:45:55.024+0000 7f889daee9c0 1 librados: calling monclient init 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -456> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: init 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -455> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding auth protocol: cephx 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -454> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding auth protocol: cephx 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -453> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding auth protocol: cephx 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -452> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -451> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -450> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -449> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -448> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.228 INFO:tasks.workunit.client.0.smithi137.stderr: -447> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -446> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -445> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -444> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -443> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -442> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: crc 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -441> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 AuthRegistry(0x55adfacc37d0) adding con mode: secure 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -440> 2024-09-12T00:45:55.024+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -439> 2024-09-12T00:45:55.024+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -438> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command rotate-key hook 0x55adfacc3918 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -437> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -436> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -435> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-a con 0x55adfac0f1b0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -434> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-b con 0x55adfac0fe50 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:55.229 INFO:tasks.workunit.client.0.smithi137.stderr: -433> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-c con 0x55adfacc6ae0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -432> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -431> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -430> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -429> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -428> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient(hunting): authenticate will time out at 2456.156608s 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -427> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): get_auth_request con 0x55adfac0f1b0 auth_method 0 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -426> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -425> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -424> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -423> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): get_auth_request con 0x55adfacc6ae0 auth_method 0 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -422> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -421> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -420> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.230 INFO:tasks.workunit.client.0.smithi137.stderr: -419> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -418> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -417> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -416> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -415> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -414> 2024-09-12T00:45:55.024+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -413> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient(hunting): handle_auth_done global_id 7874 payload 824 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -412> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -411> 2024-09-12T00:45:55.024+0000 7f889bdf5640 1 monclient: found mon.noname-c 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -410> 2024-09-12T00:45:55.024+0000 7f889bdf5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -409> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -408> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr: -407> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: dump: 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.231 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr: -406> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr: -405> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr: -404> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr: -403> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr: -402> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:55.232 INFO:tasks.workunit.client.0.smithi137.stderr: -401> 2024-09-12T00:45:55.024+0000 7f8787e07640 10 monclient: dump: 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.233 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -400> 2024-09-12T00:45:55.024+0000 7f878960a640 4 set_mon_vals no callback set 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -399> 2024-09-12T00:45:55.024+0000 7f889daee9c0 5 monclient: authenticate success, global_id 7874 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -398> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -397> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -396> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -395> 2024-09-12T00:45:55.024+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -394> 2024-09-12T00:45:55.024+0000 7f889daee9c0 1 librados: init done 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -393> 2024-09-12T00:45:55.024+0000 7f8787e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -392> 2024-09-12T00:45:55.024+0000 7f8787e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -391> 2024-09-12T00:45:55.024+0000 7f8787e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -390> 2024-09-12T00:45:55.028+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f8780070b10 auth_method 0 2024-09-12T00:45:55.234 INFO:tasks.workunit.client.0.smithi137.stderr: -389> 2024-09-12T00:45:55.028+0000 7f889adf3640 10 monclient: get_auth_request con 0x55adfad0b880 auth_method 0 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr: -388> 2024-09-12T00:45:55.028+0000 7f889b5f4640 10 monclient: get_auth_request con 0x55adfad0e6c0 auth_method 0 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr: -387> 2024-09-12T00:45:55.028+0000 7f889adf3640 10 monclient: get_auth_request con 0x55adfad137e0 auth_method 0 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr: -386> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr: -385> 2024-09-12T00:45:55.032+0000 7f889daee9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr: -384> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: monmap: 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:55.235 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -383> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding auth protocol: cephx 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -382> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding auth protocol: cephx 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -381> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding auth protocol: cephx 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -380> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -379> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -378> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -377> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -376> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -375> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.236 INFO:tasks.workunit.client.0.smithi137.stderr: -374> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -373> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -372> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -371> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -370> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: crc 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -369> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad17850) adding con mode: secure 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -368> 2024-09-12T00:45:55.032+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -367> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command objecter_requests cmddesc objecter_requests hook 0x55adfad1b200 EEXIST 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -366> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: init 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -365> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding auth protocol: cephx 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -364> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding auth protocol: cephx 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -363> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding auth protocol: cephx 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi137.stderr: -362> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -361> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -360> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -359> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -358> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -357> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -356> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -355> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -354> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -353> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -352> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: crc 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -351> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 AuthRegistry(0x55adfad167e8) adding con mode: secure 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -350> 2024-09-12T00:45:55.032+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -349> 2024-09-12T00:45:55.032+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.238 INFO:tasks.workunit.client.0.smithi137.stderr: -348> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command rotate-key cmddesc rotate-key hook 0x55adfad16930 EEXIST 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -347> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -346> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -345> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-b con 0x55adfad3f3b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -344> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-a con 0x55adfad3ece0 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -343> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-c con 0x55adfad3d6c0 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -342> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -341> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -340> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -339> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -338> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient(hunting): authenticate will time out at 2456.166271s 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -337> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): get_auth_request con 0x55adfad3d6c0 auth_method 0 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -336> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -335> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi137.stderr: -334> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -333> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): get_auth_request con 0x55adfad3ece0 auth_method 0 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -332> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -331> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -330> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -329> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -328> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -327> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -326> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -325> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -324> 2024-09-12T00:45:55.032+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -323> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient(hunting): handle_auth_done global_id 7877 payload 824 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -322> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.240 INFO:tasks.workunit.client.0.smithi137.stderr: -321> 2024-09-12T00:45:55.032+0000 7f889bdf5640 1 monclient: found mon.noname-c 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr: -320> 2024-09-12T00:45:55.032+0000 7f889bdf5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr: -319> 2024-09-12T00:45:55.032+0000 7f889b5f4640 10 monclient: get_auth_request con 0x55adfad3f3b0 auth_method 0 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr: -318> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr: -317> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr: -316> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: dump: 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.241 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr: -315> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr: -314> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr: -313> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr: -312> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr: -311> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr: -310> 2024-09-12T00:45:55.032+0000 7f8785602640 10 monclient: dump: 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.242 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr: -309> 2024-09-12T00:45:55.032+0000 7f889daee9c0 5 monclient: authenticate success, global_id 7877 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr: -308> 2024-09-12T00:45:55.032+0000 7f889c5f6640 4 set_mon_vals no callback set 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr: -307> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr: -306> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr: -305> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.243 INFO:tasks.workunit.client.0.smithi137.stderr: -304> 2024-09-12T00:45:55.032+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr: -303> 2024-09-12T00:45:55.036+0000 7f8785602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr: -302> 2024-09-12T00:45:55.036+0000 7f8785602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr: -301> 2024-09-12T00:45:55.036+0000 7f8785602640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr: -300> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f8774070a20 auth_method 0 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr: -299> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: get_monmap_and_config 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr: -298> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr: -297> 2024-09-12T00:45:55.036+0000 7f889daee9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr: -296> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: monmap: 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:55.244 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: -295> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding auth protocol: cephx 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: -294> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding auth protocol: cephx 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: -293> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding auth protocol: cephx 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: -292> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: -291> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: -290> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: -289> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.245 INFO:tasks.workunit.client.0.smithi137.stderr: -288> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -287> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -286> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -285> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -284> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -283> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -282> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: crc 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -281> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad5e980) adding con mode: secure 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -280> 2024-09-12T00:45:55.036+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -279> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: init 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -278> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding auth protocol: cephx 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -277> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding auth protocol: cephx 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -276> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding auth protocol: cephx 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -275> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.246 INFO:tasks.workunit.client.0.smithi137.stderr: -274> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -273> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -272> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -271> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -270> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -269> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -268> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -267> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -266> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -265> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: crc 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -264> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284240) adding con mode: secure 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -263> 2024-09-12T00:45:55.036+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -262> 2024-09-12T00:45:55.036+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.247 INFO:tasks.workunit.client.0.smithi137.stderr: -261> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd11284388 EEXIST 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -260> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -259> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -258> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-c con 0x55adfad92c80 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -257> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-b con 0x55adfad93060 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -256> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-a con 0x55adfad8e790 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -255> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -254> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -253> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.248 INFO:tasks.workunit.client.0.smithi137.stderr: -252> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -251> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient(hunting): authenticate will time out at 2456.170262s 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -250> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): get_auth_request con 0x55adfad8e790 auth_method 0 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -249> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -248> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -247> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -246> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): get_auth_request con 0x55adfad92c80 auth_method 0 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -245> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -244> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -243> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -242> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -241> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -240> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.249 INFO:tasks.workunit.client.0.smithi137.stderr: -239> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -238> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -237> 2024-09-12T00:45:55.036+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -236> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient(hunting): handle_auth_done global_id 8295 payload 274 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -235> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -234> 2024-09-12T00:45:55.036+0000 7f889bdf5640 1 monclient: found mon.noname-a 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -233> 2024-09-12T00:45:55.036+0000 7f889bdf5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.137:3300/0 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -232> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -231> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr: -230> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: dump: 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.250 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr: -229> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr: -228> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr: -227> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr: -226> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr: -225> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr: -224> 2024-09-12T00:45:55.036+0000 7f877effd640 10 monclient: dump: 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.251 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr: -223> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 monclient: authenticate success, global_id 8295 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr: -222> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr: -221> 2024-09-12T00:45:55.036+0000 7f889daee9c0 4 set_mon_vals no callback set 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr: -220> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: shutdown 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr: -219> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: build_initial_monmap 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr: -218> 2024-09-12T00:45:55.036+0000 7f889daee9c0 1 build_initial for_mkfs: 0 2024-09-12T00:45:55.252 INFO:tasks.workunit.client.0.smithi137.stderr: -217> 2024-09-12T00:45:55.036+0000 7f889daee9c0 10 monclient: monmap: 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 0 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 0.000000 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:created 0.000000 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 0 (unknown) 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.noname-a 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.noname-c 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr: -216> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding auth protocol: cephx 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr: -215> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding auth protocol: cephx 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr: -214> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding auth protocol: cephx 2024-09-12T00:45:55.253 INFO:tasks.workunit.client.0.smithi137.stderr: -213> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -212> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -211> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -210> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -209> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -208> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -207> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -206> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -205> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -204> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -203> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: crc 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -202> 2024-09-12T00:45:55.036+0000 7f889daee9c0 5 AuthRegistry(0x55adfad834e0) adding con mode: secure 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -201> 2024-09-12T00:45:55.040+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -200> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: starting msgr at 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi137.stderr: -199> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: starting objecter 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -198> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command objecter_requests cmddesc objecter_requests hook 0x55adfad40f70 EEXIST 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -197> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: setting wanted keys 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -196> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: calling monclient init 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -195> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: init 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -194> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding auth protocol: cephx 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -193> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding auth protocol: cephx 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -192> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding auth protocol: cephx 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -191> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -190> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -189> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -188> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -187> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -186> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.255 INFO:tasks.workunit.client.0.smithi137.stderr: -185> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -184> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -183> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -182> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -181> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: crc 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -180> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 AuthRegistry(0x55adfad411d0) adding con mode: secure 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -179> 2024-09-12T00:45:55.040+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -178> 2024-09-12T00:45:55.040+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -177> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command rotate-key cmddesc rotate-key hook 0x55adfad41318 EEXIST 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -176> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -175> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -174> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-c con 0x55adfad8e790 addr [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -173> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-a con 0x55adfad92c80 addr [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -172> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): picked mon.noname-b con 0x55adfad862c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-12T00:45:55.256 INFO:tasks.workunit.client.0.smithi137.stderr: -171> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -170> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -169> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -168> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -167> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient(hunting): authenticate will time out at 2456.172845s 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -166> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): get_auth_request con 0x55adfad8e790 auth_method 0 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -165> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -164> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -163> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -162> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): get_auth_request con 0x55adfad92c80 auth_method 0 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -161> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -160> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -159> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi137.stderr: -158> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -157> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -156> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -155> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -154> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -153> 2024-09-12T00:45:55.040+0000 7f889adf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -152> 2024-09-12T00:45:55.040+0000 7f889bdf5640 10 monclient(hunting): get_auth_request con 0x55adfad862c0 auth_method 0 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -151> 2024-09-12T00:45:55.040+0000 7f889bdf5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -150> 2024-09-12T00:45:55.040+0000 7f889bdf5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -149> 2024-09-12T00:45:55.040+0000 7f889bdf5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -148> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient(hunting): handle_auth_done global_id 7883 payload 824 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -147> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient: _finish_hunting 0 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -146> 2024-09-12T00:45:55.040+0000 7f889b5f4640 1 monclient: found mon.noname-c 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -145> 2024-09-12T00:45:55.040+0000 7f889b5f4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -144> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.258 INFO:tasks.workunit.client.0.smithi137.stderr: -143> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr: -142> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: dump: 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr: -141> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr: -140> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:45:55.259 INFO:tasks.workunit.client.0.smithi137.stderr: -139> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr: -138> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr: -137> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr: -136> 2024-09-12T00:45:55.040+0000 7f877d7fa640 10 monclient: dump: 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:epoch 1 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:fsid 4e4db2d6-4863-4874-a7a6-6f11f6db62a8 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:last_changed 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:created 2024-09-12T00:20:26.590811+0000 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:min_mon_release 19 (squid) 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:election_strategy: 1 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.260 INFO:tasks.workunit.client.0.smithi137.stderr: -135> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 monclient: authenticate success, global_id 7883 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -134> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -133> 2024-09-12T00:45:55.040+0000 7f877effd640 4 set_mon_vals no callback set 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -132> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -131> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _renew_subs 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -130> 2024-09-12T00:45:55.040+0000 7f889daee9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -129> 2024-09-12T00:45:55.040+0000 7f889daee9c0 1 librados: init done 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -128> 2024-09-12T00:45:55.040+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cr dump hook 0x55adfad85ef8 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -127> 2024-09-12T00:45:55.040+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -126> 2024-09-12T00:45:55.044+0000 7f877d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -125> 2024-09-12T00:45:55.044+0000 7f877d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -124> 2024-09-12T00:45:55.044+0000 7f877d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.137:6832/1678349958,v1:172.21.15.137:6833/1678349958] 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -123> 2024-09-12T00:45:55.044+0000 7f889adf3640 10 monclient: get_auth_request con 0x7f8764070ae0 auth_method 0 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -122> 2024-09-12T00:45:55.044+0000 7f889bdf5640 10 monclient: get_auth_request con 0x55adfadaca90 auth_method 0 2024-09-12T00:45:55.261 INFO:tasks.workunit.client.0.smithi137.stderr: -121> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -120> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 realm 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -119> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -118> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -117> 2024-09-12T00:45:55.044+0000 7f889daee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -116> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -115> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -114> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -113> 2024-09-12T00:45:55.044+0000 7f889b5f4640 10 monclient: get_auth_request con 0x55adfadb0da0 auth_method 0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -112> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -111> 2024-09-12T00:45:55.044+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -110> 2024-09-12T00:45:55.048+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -109> 2024-09-12T00:45:55.048+0000 7f889daee9c0 20 searching for the correct realm 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -108> 2024-09-12T00:45:55.048+0000 7f889adf3640 10 monclient: get_auth_request con 0x55adfadb5f30 auth_method 0 2024-09-12T00:45:55.262 INFO:tasks.workunit.client.0.smithi137.stderr: -107> 2024-09-12T00:45:55.048+0000 7f889bdf5640 10 monclient: get_auth_request con 0x7f88900ac030 auth_method 0 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -106> 2024-09-12T00:45:55.048+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f888c035040 auth_method 0 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -105> 2024-09-12T00:45:55.052+0000 7f889adf3640 10 monclient: get_auth_request con 0x7f88900ca940 auth_method 0 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -104> 2024-09-12T00:45:55.056+0000 7f889b5f4640 0 -- 172.21.15.137:0/821317520 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55adfadb0da0 msgr2=0x55adfadb3190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -103> 2024-09-12T00:45:55.056+0000 7f877d7fa640 1 client.7883.objecter ms_handle_reset 0x55adfadb0da0 session 0x55adfadafc30 osd.1 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -102> 2024-09-12T00:45:55.056+0000 7f877d7fa640 10 monclient: _renew_subs 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -101> 2024-09-12T00:45:55.056+0000 7f877d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.137:3301/0 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -100> 2024-09-12T00:45:55.056+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f8764080e90 auth_method 0 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -99> 2024-09-12T00:45:55.056+0000 7f889bdf5640 10 monclient: get_auth_request con 0x7f888c019040 auth_method 0 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -98> 2024-09-12T00:45:55.056+0000 7f889b5f4640 10 monclient: get_auth_request con 0x7f8894017070 auth_method 0 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -97> 2024-09-12T00:45:55.060+0000 7f889b5f4640 0 -- 172.21.15.137:0/821317520 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f8894017070 msgr2=0x7f889408eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -96> 2024-09-12T00:45:55.060+0000 7f877d7fa640 1 client.7883.objecter ms_handle_reset 0x7f8894017070 session 0x7f889408b070 osd.3 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -95> 2024-09-12T00:45:55.060+0000 7f889b5f4640 10 monclient: get_auth_request con 0x55adfadb0da0 auth_method 0 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -94> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:55.263 INFO:tasks.workunit.client.0.smithi137.stderr: -93> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -92> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -91> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -90> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -89> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -88> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -87> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -86> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -85> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -84> 2024-09-12T00:45:55.064+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -83> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -82> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 zone default found 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -81> 2024-09-12T00:45:55.068+0000 7f889daee9c0 4 Realm: () 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -80> 2024-09-12T00:45:55.068+0000 7f889daee9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:55.264 INFO:tasks.workunit.client.0.smithi137.stderr: -79> 2024-09-12T00:45:55.068+0000 7f889daee9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -78> 2024-09-12T00:45:55.068+0000 7f889daee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -77> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 zonegroup default 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -76> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -75> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -74> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -73> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -72> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -71> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -70> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 started sync module instance, tier type = 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -69> 2024-09-12T00:45:55.068+0000 7f889daee9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -68> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=0 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -67> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=1 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -66> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=2 2024-09-12T00:45:55.265 INFO:tasks.workunit.client.0.smithi137.stderr: -65> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=3 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -64> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=4 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -63> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=5 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -62> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=6 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -61> 2024-09-12T00:45:55.088+0000 7f889daee9c0 20 add_watcher() i=7 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -60> 2024-09-12T00:45:55.088+0000 7f889daee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -59> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding auth protocol: cephx 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -58> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding auth protocol: cephx 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -57> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding auth protocol: cephx 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -56> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -55> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -54> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -53> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -52> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: -51> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -50> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -49> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -48> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -47> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -46> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: crc 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -45> 2024-09-12T00:45:55.092+0000 7f8751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -44> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 AuthRegistry(0x7ffd11284720) adding con mode: secure 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -43> 2024-09-12T00:45:55.092+0000 7f889daee9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -42> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -41> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -40> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cache list hook 0x55adfad5fc20 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -39> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cache inspect hook 0x55adfad5fc20 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -38> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cache erase hook 0x55adfad5fc20 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -37> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command cache zap hook 0x55adfad5fc20 2024-09-12T00:45:55.267 INFO:tasks.workunit.client.0.smithi137.stderr: -36> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 note: GC not initialized 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -35> 2024-09-12T00:45:55.092+0000 7f8750fe1640 20 reqs_thread_entry: start 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -34> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command sync trace show hook 0x7f8890004650 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -33> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command sync trace history hook 0x7f8890004650 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -32> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command sync trace active hook 0x7f8890004650 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -31> 2024-09-12T00:45:55.092+0000 7f889daee9c0 5 asok(0x55adfaab62b0) register_command sync trace active_short hook 0x7f8890004650 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -30> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -29> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 Filter name: none 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -28> 2024-09-12T00:45:55.092+0000 7f86ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -27> 2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:45:55.268 INFO:tasks.workunit.client.0.smithi137.stderr: -26> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -25> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -24> 2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -23> 2024-09-12T00:45:55.092+0000 7f889daee9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -22> 2024-09-12T00:45:55.092+0000 7f889daee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -21> 2024-09-12T00:45:55.092+0000 7f889daee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -20> 2024-09-12T00:45:55.096+0000 7f889daee9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -19> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -18> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -17> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -16> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -15> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -14> 2024-09-12T00:45:55.096+0000 7f889daee9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:45:55.269 INFO:tasks.workunit.client.0.smithi137.stderr: -13> 2024-09-12T00:45:55.104+0000 7f889daee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -12> 2024-09-12T00:45:55.104+0000 7f889daee9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -11> 2024-09-12T00:45:55.104+0000 7f889daee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -10> 2024-09-12T00:45:55.104+0000 7f889daee9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -9> 2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94205726396976 notifier 7883 bl.length()=827 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -8> 2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -7> 2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -6> 2024-09-12T00:45:55.104+0000 7f877e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -5> 2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -4> 2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -3> 2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -2> 2024-09-12T00:45:55.104+0000 7f889daee9c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: -1> 2024-09-12T00:45:55.112+0000 7f889daee9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f889daee9c0 time 2024-09-12T00:45:55.114747+0000 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:45:55.270 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f88a13c82eb] 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f88a13c849f] 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55adf8429cc1] 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55adf843ed5a] 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 5: main() 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f88a022ed90] 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 7: __libc_start_main() 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 8: _start() 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 0> 2024-09-12T00:45:55.112+0000 7f889daee9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: in thread 7f889daee9c0 thread_name:radosgw-admin 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi137.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f88a0247520] 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 2: pthread_kill() 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 3: raise() 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 4: abort() 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f88a13c8345] 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f88a13c849f] 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55adf8429cc1] 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55adf843ed5a] 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 9: main() 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f88a022ed90] 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 11: __libc_start_main() 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: 12: _start() 2024-09-12T00:45:55.272 INFO:tasks.workunit.client.0.smithi137.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr:--- logging levels --- 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 none 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 lockdep 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 context 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 crush 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_balancer 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_locker 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_log_expire 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mds_migrator 2024-09-12T00:45:55.273 INFO:tasks.workunit.client.0.smithi137.stderr: 3/ 5 mds_quiesce 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 buffer 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 timer 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 filer 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 striper 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 1 objecter 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rados 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_mirror 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_replay 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 rbd_pwl 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 journaler 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objectcacher 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 client 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 osd 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 optracker 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 objclass 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 filestore 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 journal 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 ms 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mon 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 0/10 monc 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 paxos 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 tp 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 auth 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 crypto 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 finisher 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 reserver 2024-09-12T00:45:55.275 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 heartbeatmap 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 perfcounter 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_sync 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_datacache 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_access 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_flight 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 20/20 rgw_notification 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 javaclient 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 asok 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 1 throttle 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 0 refs 2024-09-12T00:45:55.276 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 compressor 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluestore 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 bluefs 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 3 bdev 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 kstore 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 4/ 5 rocksdb 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 fuse 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 2/ 5 mgr 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mgrc 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 dpdk 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 eventtrace 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 prioritycache 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 test 2024-09-12T00:45:55.277 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cephsqlite 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_onode 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_odata 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_omap 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_tm 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_t 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_epm 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_lba 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:45:55.278 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_cache 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_journal 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_device 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 seastore_backref 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 alienstore 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 mclock 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 cyanstore 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 ceph_exporter 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 memstore 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 1/ 5 trace 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 0/ 5 ceph_dedup 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: -2/-2 (syslog threshold) 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 99/99 (stderr threshold) 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:45:55.279 INFO:tasks.workunit.client.0.smithi137.stderr: 7f86ca7fc640 / http_manager 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8750fe1640 / http_manager 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8751fe3640 / rgw_dt_lg_renew 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f877d7fa640 / ms_dispatch 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f877e7fc640 / io_context_pool 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f877effd640 / io_context_pool 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8785602640 / ms_dispatch 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f8787e07640 / ms_dispatch 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f878960a640 / io_context_pool 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889adf3640 / msgr-worker-2 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889b5f4640 / msgr-worker-1 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889bdf5640 / msgr-worker-0 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889c5f6640 / io_context_pool 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: 7f889daee9c0 / radosgw-admin 2024-09-12T00:45:55.280 INFO:tasks.workunit.client.0.smithi137.stderr: max_recent 500 2024-09-12T00:45:55.281 INFO:tasks.workunit.client.0.smithi137.stderr: max_new 1000 2024-09-12T00:45:55.281 INFO:tasks.workunit.client.0.smithi137.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:45:55.118007Z_a3f052ed-51e6-49b8-89e3-0f2d6d713e5b/log 2024-09-12T00:45:55.281 INFO:tasks.workunit.client.0.smithi137.stderr:--- end dump of recent events --- 2024-09-12T00:45:55.281 INFO:tasks.workunit.client.0.smithi137.stderr:Aborted 2024-09-12T00:45:55.281 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:45:55.286 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:55.286 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:55.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.196+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.196+0000 7fd1701dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.196+0000 7fd1701dc9c0 20 realm 2024-09-12T00:45:55.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.196+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.200+0000 7fd1701dc9c0 20 searching for the correct realm 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.208+0000 7fd16dce2640 0 -- 172.21.15.137:0/2190576081 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fd160018070 msgr2=0x7fd16006d7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.212+0000 7fd16dce2640 0 -- 172.21.15.137:0/2190576081 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55f395fad6d0 msgr2=0x55f395fafb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 zone default found 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 4 Realm: () 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 zonegroup default 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 started sync module instance, tier type = 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.220+0000 7fd1701dc9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.240+0000 7fd1701dc9c0 20 add_watcher() i=0 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.240+0000 7fd1701dc9c0 20 add_watcher() i=1 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.240+0000 7fd1701dc9c0 20 add_watcher() i=2 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.240+0000 7fd1701dc9c0 20 add_watcher() i=3 2024-09-12T00:45:55.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.240+0000 7fd1701dc9c0 20 add_watcher() i=4 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.240+0000 7fd1701dc9c0 20 add_watcher() i=5 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.240+0000 7fd1701dc9c0 20 add_watcher() i=6 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.244+0000 7fd1701dc9c0 20 add_watcher() i=7 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.244+0000 7fd1701dc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.244+0000 7fd01f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 5 note: GC not initialized 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd01e7fc640 20 reqs_thread_entry: start 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 Filter name: none 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fcf8ffff640 20 reqs_thread_entry: start 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.248+0000 7fd1701dc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.252+0000 7fd01f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.256+0000 7fd1701dc9c0 20 remove_watcher() i=0 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.256+0000 7fd1701dc9c0 2 removed watcher, disabling cache 2024-09-12T00:45:55.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.256+0000 7fd1701dc9c0 20 remove_watcher() i=1 2024-09-12T00:45:55.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.260+0000 7fd1701dc9c0 20 remove_watcher() i=2 2024-09-12T00:45:55.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.260+0000 7fd1701dc9c0 20 remove_watcher() i=3 2024-09-12T00:45:55.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.264+0000 7fd1701dc9c0 20 remove_watcher() i=4 2024-09-12T00:45:55.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.264+0000 7fd1701dc9c0 20 remove_watcher() i=5 2024-09-12T00:45:55.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.268+0000 7fd1701dc9c0 20 remove_watcher() i=6 2024-09-12T00:45:55.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.272+0000 7fd1701dc9c0 20 remove_watcher() i=7 2024-09-12T00:45:55.292 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:45:55.292 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:45:55.300 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:45:55.327 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:55.327 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:55.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 20 realm 2024-09-12T00:45:55.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:55.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.373 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.374 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.372+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.376+0000 7ff2a36cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.376+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.376+0000 7ff2a36cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:55.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.376+0000 7ff2a36cd9c0 20 searching for the correct realm 2024-09-12T00:45:55.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.384+0000 7ff2a19d4640 0 -- 172.21.15.137:0/2516534749 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55a743d8ddb0 msgr2=0x55a743d90220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.388 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.388+0000 7ff2a11d3640 0 -- 172.21.15.137:0/2516534749 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55a743d92020 msgr2=0x55a743d94430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:55.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:55.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:45:55.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:55.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:55.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 zone default found 2024-09-12T00:45:55.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 4 Realm: () 2024-09-12T00:45:55.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:45:55.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:45:55.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:55.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 zonegroup default 2024-09-12T00:45:55.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:55.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 started sync module instance, tier type = 2024-09-12T00:45:55.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.396+0000 7ff2a36cd9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:45:55.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 20 add_watcher() i=0 2024-09-12T00:45:55.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 20 add_watcher() i=1 2024-09-12T00:45:55.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 20 add_watcher() i=2 2024-09-12T00:45:55.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 20 add_watcher() i=3 2024-09-12T00:45:55.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 20 add_watcher() i=4 2024-09-12T00:45:55.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 20 add_watcher() i=5 2024-09-12T00:45:55.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 20 add_watcher() i=6 2024-09-12T00:45:55.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 20 add_watcher() i=7 2024-09-12T00:45:55.417 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.416+0000 7ff2a36cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.420+0000 7ff1577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.420+0000 7ff2a36cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.420+0000 7ff2a36cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 5 note: GC not initialized 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff1567e4640 20 reqs_thread_entry: start 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 Filter name: none 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff0c7fff640 20 reqs_thread_entry: start 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:45:55.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:45:55.425 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:45:55.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:45:55.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:45:55.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.424+0000 7ff2a36cd9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:45:55.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.428+0000 7ff1577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:55.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.432+0000 7ff2a36cd9c0 20 remove_watcher() i=0 2024-09-12T00:45:55.430 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.432+0000 7ff2a36cd9c0 2 removed watcher, disabling cache 2024-09-12T00:45:55.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.432+0000 7ff2a36cd9c0 20 remove_watcher() i=1 2024-09-12T00:45:55.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.436+0000 7ff2a36cd9c0 20 remove_watcher() i=2 2024-09-12T00:45:55.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.436+0000 7ff2a36cd9c0 20 remove_watcher() i=3 2024-09-12T00:45:55.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.440+0000 7ff2a36cd9c0 20 remove_watcher() i=4 2024-09-12T00:45:55.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.440+0000 7ff2a36cd9c0 20 remove_watcher() i=5 2024-09-12T00:45:55.443 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.444+0000 7ff2a36cd9c0 20 remove_watcher() i=6 2024-09-12T00:45:55.446 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:45:55.448+0000 7ff2a36cd9c0 20 remove_watcher() i=7 2024-09-12T00:46:25.491 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:46:25.524 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:25.525 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:25.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.567+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 realm 2024-09-12T00:46:25.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:25.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:25.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:25.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.571+0000 7f7a8db3a9c0 20 searching for the correct realm 2024-09-12T00:46:25.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.579+0000 7f7a8be41640 0 -- 172.21.15.137:0/1270243476 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f7a800891e0 msgr2=0x7f7a80090920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:25.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.583+0000 7f7a8b640640 0 -- 172.21.15.137:0/1270243476 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f7a7c038400 msgr2=0x7f7a7c038880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:25.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.591+0000 7f7a8db3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:25.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.591+0000 7f7a8db3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:25.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.591+0000 7f7a8db3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:25.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.591+0000 7f7a8db3a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:25.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.591+0000 7f7a8db3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:25.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.591+0000 7f7a8db3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:25.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.591+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:25.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:25.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 zone default found 2024-09-12T00:46:25.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 4 Realm: () 2024-09-12T00:46:25.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:25.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:25.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:25.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 zonegroup default 2024-09-12T00:46:25.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 started sync module instance, tier type = 2024-09-12T00:46:25.602 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.595+0000 7f7a8db3a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 20 add_watcher() i=0 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 20 add_watcher() i=1 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 20 add_watcher() i=2 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 20 add_watcher() i=3 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 20 add_watcher() i=4 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 20 add_watcher() i=5 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 20 add_watcher() i=6 2024-09-12T00:46:25.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 20 add_watcher() i=7 2024-09-12T00:46:25.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.615+0000 7f7a8db3a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:25.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7a8db3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7a8db3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7a8db3a9c0 5 note: GC not initialized 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7940fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7a8db3a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7a8db3a9c0 20 Filter name: none 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f78ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7a8db3a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.619+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:25.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:46:25.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.623+0000 7f7a8db3a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:46:25.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.627+0000 7f7941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:25.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.631+0000 7f7a8db3a9c0 20 remove_watcher() i=0 2024-09-12T00:46:25.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.631+0000 7f7a8db3a9c0 2 removed watcher, disabling cache 2024-09-12T00:46:25.634 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.631+0000 7f7a8db3a9c0 20 remove_watcher() i=1 2024-09-12T00:46:25.635 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.635+0000 7f7a8db3a9c0 20 remove_watcher() i=2 2024-09-12T00:46:25.637 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.635+0000 7f7a8db3a9c0 20 remove_watcher() i=3 2024-09-12T00:46:25.640 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.639+0000 7f7a8db3a9c0 20 remove_watcher() i=4 2024-09-12T00:46:25.642 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.639+0000 7f7a8db3a9c0 20 remove_watcher() i=5 2024-09-12T00:46:25.644 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.643+0000 7f7a8db3a9c0 20 remove_watcher() i=6 2024-09-12T00:46:25.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.647+0000 7f7a8db3a9c0 20 remove_watcher() i=7 2024-09-12T00:46:25.661 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:46:25.688 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:25.688 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:25.731 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.731+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.935+0000 7fe668eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.935+0000 7fe668eff9c0 20 realm 2024-09-12T00:46:25.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.935+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.935+0000 7fe668eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.935+0000 7fe668eff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:25.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.935+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.939+0000 7fe668eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.939+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.939+0000 7fe668eff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:25.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.939+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.939+0000 7fe668eff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:25.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.939+0000 7fe668eff9c0 20 searching for the correct realm 2024-09-12T00:46:25.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:25.947+0000 7fe666204640 0 -- 172.21.15.137:0/1657786978 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fe65c071f40 msgr2=0x7fe65c09d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.563+0000 7fe666a05640 0 -- 172.21.15.137:0/1657786978 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fe6600b5930 msgr2=0x7fe6600c0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:26.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:26.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:26.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:26.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:26.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:26.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:26.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:26.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 zone default found 2024-09-12T00:46:26.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 4 Realm: () 2024-09-12T00:46:26.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:26.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:26.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:26.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 zonegroup default 2024-09-12T00:46:26.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.786 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.783+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.787+0000 7fe668eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.787+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.787+0000 7fe668eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.787+0000 7fe668eff9c0 20 started sync module instance, tier type = 2024-09-12T00:46:26.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.787+0000 7fe668eff9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:26.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 20 add_watcher() i=0 2024-09-12T00:46:26.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 20 add_watcher() i=1 2024-09-12T00:46:26.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 20 add_watcher() i=2 2024-09-12T00:46:26.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 20 add_watcher() i=3 2024-09-12T00:46:26.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 20 add_watcher() i=4 2024-09-12T00:46:26.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 20 add_watcher() i=5 2024-09-12T00:46:26.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 20 add_watcher() i=6 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 20 add_watcher() i=7 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.811+0000 7fe668eff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:26.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.815+0000 7fe51d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 5 note: GC not initialized 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe497fff640 20 reqs_thread_entry: start 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 Filter name: none 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe495ffb640 20 reqs_thread_entry: start 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:46:26.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:46:26.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:26.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:26.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:26.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:26.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:46:26.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:46:26.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.819+0000 7fe668eff9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:46:26.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.823+0000 7fe668eff9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:46:26.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.823+0000 7fe668eff9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:46:26.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.823+0000 7fe668eff9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:46:26.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.823+0000 7fe668eff9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:46:26.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.823+0000 7fe51d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.831+0000 7fe668eff9c0 20 remove_watcher() i=0 2024-09-12T00:46:26.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.831+0000 7fe668eff9c0 2 removed watcher, disabling cache 2024-09-12T00:46:26.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.831+0000 7fe668eff9c0 20 remove_watcher() i=1 2024-09-12T00:46:26.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.835+0000 7fe668eff9c0 20 remove_watcher() i=2 2024-09-12T00:46:26.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.835+0000 7fe668eff9c0 20 remove_watcher() i=3 2024-09-12T00:46:26.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.839+0000 7fe668eff9c0 20 remove_watcher() i=4 2024-09-12T00:46:26.841 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.839+0000 7fe668eff9c0 20 remove_watcher() i=5 2024-09-12T00:46:26.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.843+0000 7fe668eff9c0 20 remove_watcher() i=6 2024-09-12T00:46:26.846 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.847+0000 7fe668eff9c0 20 remove_watcher() i=7 2024-09-12T00:46:26.864 INFO:tasks.workunit.client.0.smithi137.stderr:check reshard logrecord successfully 2024-09-12T00:46:26.864 INFO:tasks.workunit.client.0.smithi137.stderr: test: reshard versioned bucket 2024-09-12T00:46:26.864 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:46:26.896 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:26.896 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:26.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.939+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.939+0000 7f10c4adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.939+0000 7f10c4adf9c0 20 realm 2024-09-12T00:46:26.942 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.939+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:26.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.944 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:26.945 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.943+0000 7f10c4adf9c0 20 searching for the correct realm 2024-09-12T00:46:26.951 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.951+0000 7f10c25e5640 0 -- 172.21.15.137:0/3303671718 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f10b4072fa0 msgr2=0x7f10b407fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.956 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.955+0000 7f10c25e5640 0 -- 172.21.15.137:0/3303671718 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55e70f16bca0 msgr2=0x55e70f16e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:26.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:26.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:26.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:26.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:26.963 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:26.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:26.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.964 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 zone default found 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 4 Realm: () 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 zonegroup default 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.963+0000 7f10c4adf9c0 20 started sync module instance, tier type = 2024-09-12T00:46:26.967 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.967+0000 7f10c4adf9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:26.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 20 add_watcher() i=0 2024-09-12T00:46:26.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 20 add_watcher() i=1 2024-09-12T00:46:26.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 20 add_watcher() i=2 2024-09-12T00:46:26.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 20 add_watcher() i=3 2024-09-12T00:46:26.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 20 add_watcher() i=4 2024-09-12T00:46:26.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 20 add_watcher() i=5 2024-09-12T00:46:26.984 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 20 add_watcher() i=6 2024-09-12T00:46:26.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 20 add_watcher() i=7 2024-09-12T00:46:26.986 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.983+0000 7f10c4adf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:26.989 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.987+0000 7f0f78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.987+0000 7f10c4adf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:26.990 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.987+0000 7f10c4adf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:26.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.987+0000 7f10c4adf9c0 5 note: GC not initialized 2024-09-12T00:46:26.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.987+0000 7f0ef37fe640 20 reqs_thread_entry: start 2024-09-12T00:46:26.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:26.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 Filter name: none 2024-09-12T00:46:26.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f0ef17fa640 20 reqs_thread_entry: start 2024-09-12T00:46:26.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:26.992 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:26.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:26.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:26.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.991+0000 7f10c4adf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.995+0000 7f10c4adf9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:26.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.995+0000 7f10c4adf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:26.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.995+0000 7f0f78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:27.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.999+0000 7f10c4adf9c0 20 remove_watcher() i=0 2024-09-12T00:46:27.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:26.999+0000 7f10c4adf9c0 2 removed watcher, disabling cache 2024-09-12T00:46:27.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.003+0000 7f10c4adf9c0 20 remove_watcher() i=1 2024-09-12T00:46:27.005 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.003+0000 7f10c4adf9c0 20 remove_watcher() i=2 2024-09-12T00:46:27.007 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.007+0000 7f10c4adf9c0 20 remove_watcher() i=3 2024-09-12T00:46:27.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.007+0000 7f10c4adf9c0 20 remove_watcher() i=4 2024-09-12T00:46:27.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.011+0000 7f10c4adf9c0 20 remove_watcher() i=5 2024-09-12T00:46:27.014 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.011+0000 7f10c4adf9c0 20 remove_watcher() i=6 2024-09-12T00:46:27.017 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.015+0000 7f10c4adf9c0 20 remove_watcher() i=7 2024-09-12T00:46:27.030 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:27.031 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:46:27.031 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: myver id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:46:27.031 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:27.031 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T00:46:27.060 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:27.060 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:27.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.103+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 realm 2024-09-12T00:46:27.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.108 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:27.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:27.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:27.110 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.107+0000 7fc0cd5d89c0 20 searching for the correct realm 2024-09-12T00:46:27.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.111+0000 7fc0cb0de640 0 -- 172.21.15.137:0/1638362305 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fc0bc0d7070 msgr2=0x7fc0bc0bd050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:27.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.323+0000 7fc0cb0de640 0 -- 172.21.15.137:0/1638362305 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fc0b4003be0 msgr2=0x7fc0c4068c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:27.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:27.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:27.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:27.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:27.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:27.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:27.543 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:27.544 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:27.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 zone default found 2024-09-12T00:46:27.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 4 Realm: () 2024-09-12T00:46:27.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:27.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:27.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:27.545 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 zonegroup default 2024-09-12T00:46:27.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.543+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.547+0000 7fc0cd5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.546 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.547+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.547+0000 7fc0cd5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.547+0000 7fc0cd5d89c0 20 started sync module instance, tier type = 2024-09-12T00:46:27.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.547+0000 7fc0cd5d89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:27.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.567+0000 7fc0cd5d89c0 20 add_watcher() i=0 2024-09-12T00:46:27.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.567+0000 7fc0cd5d89c0 20 add_watcher() i=1 2024-09-12T00:46:27.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.567+0000 7fc0cd5d89c0 20 add_watcher() i=2 2024-09-12T00:46:27.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.567+0000 7fc0cd5d89c0 20 add_watcher() i=3 2024-09-12T00:46:27.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.567+0000 7fc0cd5d89c0 20 add_watcher() i=4 2024-09-12T00:46:27.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.567+0000 7fc0cd5d89c0 20 add_watcher() i=5 2024-09-12T00:46:27.571 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.571+0000 7fc0cd5d89c0 20 add_watcher() i=6 2024-09-12T00:46:27.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.571+0000 7fc0cd5d89c0 20 add_watcher() i=7 2024-09-12T00:46:27.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.571+0000 7fc0cd5d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:27.576 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fbf81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:27.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fc0cd5d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:27.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fc0cd5d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:27.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fc0cd5d89c0 5 note: GC not initialized 2024-09-12T00:46:27.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fbf80fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:27.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fc0cd5d89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:27.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fc0cd5d89c0 20 Filter name: none 2024-09-12T00:46:27.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fbefa7fc640 20 reqs_thread_entry: start 2024-09-12T00:46:27.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fc0cd5d89c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:46:27.578 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.575+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:27.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:46:27.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:46:27.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : miss 2024-09-12T00:46:27.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:27.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:27.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 10 adding default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:27.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:27.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:27.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.579+0000 7fc0cd5d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:27.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fc0cd5d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:27.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fc0cd5d89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:27.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fc0cd5d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:27.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fc0cd5d89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:27.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fbfaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 94200345592320 notifier 7985 bl.length()=821 2024-09-12T00:46:27.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fbfaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:27.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fbfaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:27.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fbfaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:27.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:27.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:27.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:27.589 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.587+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:27.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.591+0000 7fc0cd5d89c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.0 2024-09-12T00:46:27.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.591+0000 7fc0cd5d89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.0 2024-09-12T00:46:27.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.591+0000 7fc0cd5d89c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.1 2024-09-12T00:46:27.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.591+0000 7fc0cd5d89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.1 2024-09-12T00:46:27.594 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.591+0000 7fc0cd5d89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.0 2024-09-12T00:46:27.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.591+0000 7fc0cd5d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:27.595 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.591+0000 7fc0cd5d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:27.597 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.595+0000 7fc0cd5d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:27.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.595+0000 7fc0cd5d89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:27.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.595+0000 7fc0cd5d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:27.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.595+0000 7fc0cd5d89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:27.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.595+0000 7fbfaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94200345592320 notifier 7985 bl.length()=821 2024-09-12T00:46:27.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.595+0000 7fbfaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:27.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.595+0000 7fbfaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:27.598 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.595+0000 7fbfaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:27.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.599+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:27.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.599+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:27.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.599+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:27.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.599+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:27.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.599+0000 7fc0cd5d89c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.0 2024-09-12T00:46:27.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.599+0000 7fc0cd5d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:27.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.599+0000 7fc0cd5d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:27.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fc0cd5d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:27.604 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fc0cd5d89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:27.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fc0cd5d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:27.605 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fc0cd5d89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:27.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fbfae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94200345592320 notifier 7985 bl.length()=789 2024-09-12T00:46:27.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fbfae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:27.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fbfae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:27.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fbfae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:27.606 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:27.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:27.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:27.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.603+0000 7fc0cd5d89c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:27.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.607+0000 7fc0cd5d89c0 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T00:46:27.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.611+0000 7fbf81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:27.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.615+0000 7fc0cd5d89c0 20 remove_watcher() i=0 2024-09-12T00:46:27.615 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.615+0000 7fc0cd5d89c0 2 removed watcher, disabling cache 2024-09-12T00:46:27.617 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.615+0000 7fc0cd5d89c0 20 remove_watcher() i=1 2024-09-12T00:46:27.619 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.619+0000 7fc0cd5d89c0 20 remove_watcher() i=2 2024-09-12T00:46:27.621 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.619+0000 7fc0cd5d89c0 20 remove_watcher() i=3 2024-09-12T00:46:27.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.623+0000 7fc0cd5d89c0 20 remove_watcher() i=4 2024-09-12T00:46:27.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.623+0000 7fc0cd5d89c0 20 remove_watcher() i=5 2024-09-12T00:46:27.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.627+0000 7fc0cd5d89c0 20 remove_watcher() i=6 2024-09-12T00:46:27.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.631+0000 7fc0cd5d89c0 20 remove_watcher() i=7 2024-09-12T00:46:27.648 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:46:27.680 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:27.680 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:27.725 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.723+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 realm 2024-09-12T00:46:27.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:27.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.728 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:27.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:27.729 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.727+0000 7f6c8059b9c0 20 searching for the correct realm 2024-09-12T00:46:27.735 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.735+0000 7f6c7d8a0640 0 -- 172.21.15.137:0/444775862 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f6c74076930 msgr2=0x7f6c74064870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:27.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.739+0000 7f6c7d8a0640 0 -- 172.21.15.137:0/444775862 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55cf4653b070 msgr2=0x55cf4653d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:27.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:27.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:27.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:27.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:27.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:27.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:27.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:27.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.747+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:27.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 zone default found 2024-09-12T00:46:27.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 4 Realm: () 2024-09-12T00:46:27.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:27.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:27.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:27.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 zonegroup default 2024-09-12T00:46:27.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 started sync module instance, tier type = 2024-09-12T00:46:27.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.751+0000 7f6c8059b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:27.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 20 add_watcher() i=0 2024-09-12T00:46:27.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 20 add_watcher() i=1 2024-09-12T00:46:27.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 20 add_watcher() i=2 2024-09-12T00:46:27.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 20 add_watcher() i=3 2024-09-12T00:46:27.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 20 add_watcher() i=4 2024-09-12T00:46:27.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 20 add_watcher() i=5 2024-09-12T00:46:27.771 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 20 add_watcher() i=6 2024-09-12T00:46:27.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 20 add_watcher() i=7 2024-09-12T00:46:27.773 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.771+0000 7f6c8059b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:27.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6b34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:27.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6c8059b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:27.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6c8059b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:27.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6c8059b9c0 5 note: GC not initialized 2024-09-12T00:46:27.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6aaf7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:27.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6c8059b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:27.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6c8059b9c0 20 Filter name: none 2024-09-12T00:46:27.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6aad7fa640 20 reqs_thread_entry: start 2024-09-12T00:46:27.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6c8059b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:27.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.775+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.779+0000 7f6c8059b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:27.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.779+0000 7f6c8059b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:27.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.779+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.779+0000 7f6c8059b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:27.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.779+0000 7f6c8059b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.779+0000 7f6c8059b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:27.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.779+0000 7f6c8059b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:27.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.783+0000 7f6b34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:27.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.787+0000 7f6c8059b9c0 20 remove_watcher() i=0 2024-09-12T00:46:27.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.787+0000 7f6c8059b9c0 2 removed watcher, disabling cache 2024-09-12T00:46:27.790 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.787+0000 7f6c8059b9c0 20 remove_watcher() i=1 2024-09-12T00:46:27.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.791+0000 7f6c8059b9c0 20 remove_watcher() i=2 2024-09-12T00:46:27.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.791+0000 7f6c8059b9c0 20 remove_watcher() i=3 2024-09-12T00:46:27.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.795+0000 7f6c8059b9c0 20 remove_watcher() i=4 2024-09-12T00:46:27.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.799+0000 7f6c8059b9c0 20 remove_watcher() i=5 2024-09-12T00:46:27.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.799+0000 7f6c8059b9c0 20 remove_watcher() i=6 2024-09-12T00:46:27.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:27.803+0000 7f6c8059b9c0 20 remove_watcher() i=7 2024-09-12T00:46:27.818 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:27.818 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:46:27.818 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: myver id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:46:27.818 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:27.820 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:27.820 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:27.822 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:27.823 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:27.866 INFO:tasks.workunit.client.0.smithi137.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:46:27.869 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:27.869 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:27.926 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:27.926 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:28.022 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:46:28.053 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:28.054 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:28.099 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.099+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 realm 2024-09-12T00:46:28.102 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.103 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:28.105 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.103+0000 7fd31ad009c0 20 searching for the correct realm 2024-09-12T00:46:28.111 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.111+0000 7fd319007640 0 -- 172.21.15.137:0/438105142 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fd30c0cfb60 msgr2=0x7fd30c0da910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.115+0000 7fd318806640 0 -- 172.21.15.137:0/438105142 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fd31005f250 msgr2=0x7fd31005dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:28.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:28.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:28.124 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:28.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:28.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:28.125 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 zone default found 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 4 Realm: () 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:28.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 zonegroup default 2024-09-12T00:46:28.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.123+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.127+0000 7fd31ad009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.127+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.127 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.127+0000 7fd31ad009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.127+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.127+0000 7fd31ad009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.127+0000 7fd31ad009c0 20 started sync module instance, tier type = 2024-09-12T00:46:28.128 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.127+0000 7fd31ad009c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:28.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 20 add_watcher() i=0 2024-09-12T00:46:28.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 20 add_watcher() i=1 2024-09-12T00:46:28.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 20 add_watcher() i=2 2024-09-12T00:46:28.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 20 add_watcher() i=3 2024-09-12T00:46:28.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 20 add_watcher() i=4 2024-09-12T00:46:28.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 20 add_watcher() i=5 2024-09-12T00:46:28.147 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 20 add_watcher() i=6 2024-09-12T00:46:28.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 20 add_watcher() i=7 2024-09-12T00:46:28.148 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.147+0000 7fd31ad009c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:28.151 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd1cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:28.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:28.152 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 5 note: GC not initialized 2024-09-12T00:46:28.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd1cdfdb640 20 reqs_thread_entry: start 2024-09-12T00:46:28.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:28.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 Filter name: none 2024-09-12T00:46:28.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd13f7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:28.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:28.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:28.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:28.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:28.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.151+0000 7fd31ad009c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.155+0000 7fd31ad009c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:28.155 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.155+0000 7fd31ad009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:28.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.155+0000 7fd1cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.159+0000 7fd31ad009c0 20 remove_watcher() i=0 2024-09-12T00:46:28.160 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.159+0000 7fd31ad009c0 2 removed watcher, disabling cache 2024-09-12T00:46:28.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.159+0000 7fd31ad009c0 20 remove_watcher() i=1 2024-09-12T00:46:28.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.163+0000 7fd31ad009c0 20 remove_watcher() i=2 2024-09-12T00:46:28.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.163+0000 7fd31ad009c0 20 remove_watcher() i=3 2024-09-12T00:46:28.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.167+0000 7fd31ad009c0 20 remove_watcher() i=4 2024-09-12T00:46:28.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.167+0000 7fd31ad009c0 20 remove_watcher() i=5 2024-09-12T00:46:28.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.171+0000 7fd31ad009c0 20 remove_watcher() i=6 2024-09-12T00:46:28.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.175+0000 7fd31ad009c0 20 remove_watcher() i=7 2024-09-12T00:46:28.188 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:28.188 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:46:28.188 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: a-bucket id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T00:46:28.189 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:28.189 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:46:28.216 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:28.216 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:28.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.259+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.259+0000 7f47ca6e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.259+0000 7f47ca6e39c0 20 realm 2024-09-12T00:46:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.259+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:28.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.263+0000 7f47ca6e39c0 20 searching for the correct realm 2024-09-12T00:46:28.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.271+0000 7f47c89ea640 0 -- 172.21.15.137:0/1271730221 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f47bc027040 msgr2=0x7f47bc0199d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.276 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.275+0000 7f47c81e9640 0 -- 172.21.15.137:0/1271730221 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f47c0049070 msgr2=0x7f47c00083c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:28.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:28.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:28.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:28.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:28.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:28.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:28.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 zone default found 2024-09-12T00:46:28.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 4 Realm: () 2024-09-12T00:46:28.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:28.285 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:28.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:28.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 zonegroup default 2024-09-12T00:46:28.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.283+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.287+0000 7f47ca6e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.287+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.287+0000 7f47ca6e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.287+0000 7f47ca6e39c0 20 started sync module instance, tier type = 2024-09-12T00:46:28.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.287+0000 7f47ca6e39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:28.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.303+0000 7f47ca6e39c0 20 add_watcher() i=0 2024-09-12T00:46:28.304 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.303+0000 7f47ca6e39c0 20 add_watcher() i=1 2024-09-12T00:46:28.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.303+0000 7f47ca6e39c0 20 add_watcher() i=2 2024-09-12T00:46:28.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.303+0000 7f47ca6e39c0 20 add_watcher() i=3 2024-09-12T00:46:28.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.303+0000 7f47ca6e39c0 20 add_watcher() i=4 2024-09-12T00:46:28.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.303+0000 7f47ca6e39c0 20 add_watcher() i=5 2024-09-12T00:46:28.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.303+0000 7f47ca6e39c0 20 add_watcher() i=6 2024-09-12T00:46:28.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.307+0000 7f47ca6e39c0 20 add_watcher() i=7 2024-09-12T00:46:28.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.307+0000 7f47ca6e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:28.310 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f467efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:28.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:28.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 5 note: GC not initialized 2024-09-12T00:46:28.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f467dfdb640 20 reqs_thread_entry: start 2024-09-12T00:46:28.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:28.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 Filter name: none 2024-09-12T00:46:28.311 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f45ef7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:28.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:28.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:28.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f47ca6e39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:28.313 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.311+0000 7f467efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.315+0000 7f47ca6e39c0 20 remove_watcher() i=0 2024-09-12T00:46:28.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.315+0000 7f47ca6e39c0 2 removed watcher, disabling cache 2024-09-12T00:46:28.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.319+0000 7f47ca6e39c0 20 remove_watcher() i=1 2024-09-12T00:46:28.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.319+0000 7f47ca6e39c0 20 remove_watcher() i=2 2024-09-12T00:46:28.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.323+0000 7f47ca6e39c0 20 remove_watcher() i=3 2024-09-12T00:46:28.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.323+0000 7f47ca6e39c0 20 remove_watcher() i=4 2024-09-12T00:46:28.327 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.327+0000 7f47ca6e39c0 20 remove_watcher() i=5 2024-09-12T00:46:28.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.327+0000 7f47ca6e39c0 20 remove_watcher() i=6 2024-09-12T00:46:28.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.331+0000 7f47ca6e39c0 20 remove_watcher() i=7 2024-09-12T00:46:28.345 INFO:tasks.workunit.client.0.smithi137.stderr:rados -p default.rgw.buckets.index setomapval .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:46:28.371 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:28.372 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:28.392 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:46:28.417 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:28.417 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:28.459 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.459+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.459+0000 7f37e631d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.459+0000 7f37e631d9c0 20 realm 2024-09-12T00:46:28.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.459+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.459+0000 7f37e631d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.459+0000 7f37e631d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:28.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.459+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.463+0000 7f37e631d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.462 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.463+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.463+0000 7f37e631d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.463+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.463+0000 7f37e631d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:28.463 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.463+0000 7f37e631d9c0 20 searching for the correct realm 2024-09-12T00:46:28.469 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.467+0000 7f37e3622640 0 -- 172.21.15.137:0/3468015180 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f37d8008040 msgr2=0x7f37d801e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.474 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.475+0000 7f37e3622640 0 -- 172.21.15.137:0/3468015180 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5646fb402f20 msgr2=0x5646fb405340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.479+0000 7f37e631d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:28.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.479+0000 7f37e631d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:28.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.479+0000 7f37e631d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:28.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.479+0000 7f37e631d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:28.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.479+0000 7f37e631d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:28.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.479+0000 7f37e631d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:28.482 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.479+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.483 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:28.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 zone default found 2024-09-12T00:46:28.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 4 Realm: () 2024-09-12T00:46:28.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:28.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:28.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:28.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 zonegroup default 2024-09-12T00:46:28.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 started sync module instance, tier type = 2024-09-12T00:46:28.486 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.483+0000 7f37e631d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:28.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 20 add_watcher() i=0 2024-09-12T00:46:28.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 20 add_watcher() i=1 2024-09-12T00:46:28.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 20 add_watcher() i=2 2024-09-12T00:46:28.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 20 add_watcher() i=3 2024-09-12T00:46:28.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 20 add_watcher() i=4 2024-09-12T00:46:28.503 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 20 add_watcher() i=5 2024-09-12T00:46:28.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 20 add_watcher() i=6 2024-09-12T00:46:28.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 20 add_watcher() i=7 2024-09-12T00:46:28.505 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.503+0000 7f37e631d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:28.508 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f3699fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f37e631d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:28.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f37e631d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:28.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f37e631d9c0 5 note: GC not initialized 2024-09-12T00:46:28.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f3698fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:28.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f37e631d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:28.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f37e631d9c0 20 Filter name: none 2024-09-12T00:46:28.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f36127fc640 20 reqs_thread_entry: start 2024-09-12T00:46:28.510 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f37e631d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.507+0000 7f37e631d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:46:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 INFO: main: starting shard=0 2024-09-12T00:46:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:46:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:46:28.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:46:28.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 INFO: main: starting shard=1 2024-09-12T00:46:28.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:46:28.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:46:28.512 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:28.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 INFO: main: starting shard=2 2024-09-12T00:46:28.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:46:28.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:46:28.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:28.513 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f37e631d9c0 20 INFO: main: done 2024-09-12T00:46:28.514 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.511+0000 7f3699fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.515+0000 7f37e631d9c0 20 remove_watcher() i=0 2024-09-12T00:46:28.518 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.515+0000 7f37e631d9c0 2 removed watcher, disabling cache 2024-09-12T00:46:28.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.519+0000 7f37e631d9c0 20 remove_watcher() i=1 2024-09-12T00:46:28.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.519+0000 7f37e631d9c0 20 remove_watcher() i=2 2024-09-12T00:46:28.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.523+0000 7f37e631d9c0 20 remove_watcher() i=3 2024-09-12T00:46:28.525 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.523+0000 7f37e631d9c0 20 remove_watcher() i=4 2024-09-12T00:46:28.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.527+0000 7f37e631d9c0 20 remove_watcher() i=5 2024-09-12T00:46:28.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.531+0000 7f37e631d9c0 20 remove_watcher() i=6 2024-09-12T00:46:28.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.531+0000 7f37e631d9c0 20 remove_watcher() i=7 2024-09-12T00:46:28.547 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:46:28.577 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:28.578 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:28.623 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 20 realm 2024-09-12T00:46:28.624 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:28.625 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.623+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.627+0000 7f55949349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.626 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.627+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.627+0000 7f55949349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:28.627 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.627+0000 7f55949349c0 20 searching for the correct realm 2024-09-12T00:46:28.632 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.631+0000 7f558bfff640 0 -- 172.21.15.137:0/1796742896 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f557c08c7b0 msgr2=0x7f557c089810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.639 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.639+0000 7f5592c3b640 0 -- 172.21.15.137:0/1796742896 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55577ac236d0 msgr2=0x55577ac25b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.643+0000 7f55949349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:28.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.643+0000 7f55949349c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:28.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.643+0000 7f55949349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:28.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.643+0000 7f55949349c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:28.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.643+0000 7f55949349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:28.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.643+0000 7f55949349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:28.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.643+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.647 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:28.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 zone default found 2024-09-12T00:46:28.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 4 Realm: () 2024-09-12T00:46:28.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:28.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:28.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:28.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 zonegroup default 2024-09-12T00:46:28.648 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 started sync module instance, tier type = 2024-09-12T00:46:28.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.647+0000 7f55949349c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:28.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.667+0000 7f55949349c0 20 add_watcher() i=0 2024-09-12T00:46:28.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.667+0000 7f55949349c0 20 add_watcher() i=1 2024-09-12T00:46:28.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.667+0000 7f55949349c0 20 add_watcher() i=2 2024-09-12T00:46:28.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.667+0000 7f55949349c0 20 add_watcher() i=3 2024-09-12T00:46:28.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.667+0000 7f55949349c0 20 add_watcher() i=4 2024-09-12T00:46:28.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.667+0000 7f55949349c0 20 add_watcher() i=5 2024-09-12T00:46:28.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.667+0000 7f55949349c0 20 add_watcher() i=6 2024-09-12T00:46:28.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.671+0000 7f55949349c0 20 add_watcher() i=7 2024-09-12T00:46:28.671 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.671+0000 7f55949349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:28.675 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f5447fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 5 note: GC not initialized 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f5446fe5640 20 reqs_thread_entry: start 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 20 Filter name: none 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f5444fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:46:28.676 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:28.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:46:28.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:46:28.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : miss 2024-09-12T00:46:28.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:28.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:28.677 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:28.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:28.678 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.675+0000 7f55949349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:46:28.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f55949349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:28.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f55949349c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:28.682 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f55949349c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:28.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f55949349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:46:28.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f5463fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366282 cookie 93834210070320 notifier 8081 bl.length()=827 2024-09-12T00:46:28.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f5463fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:28.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f5463fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:28.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f5463fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:28.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:46:28.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:46:28.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:46:28.684 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.683+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:46:28.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:46:28.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:46:28.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:46:28.688 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:46:28.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:46:28.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:46:28.689 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:46:28.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:46:28.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.687+0000 7f55949349c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:46:28.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:28.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:46:28.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:28.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:28.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:28.692 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:46:28.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f5474ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366283 cookie 93834210070320 notifier 8081 bl.length()=827 2024-09-12T00:46:28.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f5474ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:28.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f5474ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:28.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f5474ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:28.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:46:28.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:46:28.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:46:28.693 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.691+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:46:28.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.695+0000 7f55949349c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:46:28.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.695+0000 7f55949349c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.0 2024-09-12T00:46:28.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.695+0000 7f55949349c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:46:28.696 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.695+0000 7f55949349c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.1 2024-09-12T00:46:28.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.695+0000 7f55949349c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:46:28.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.695+0000 7f55949349c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.2.2 2024-09-12T00:46:28.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.695+0000 7f55949349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:28.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.695+0000 7f55949349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 2024-09-12T00:46:28.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:28.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:28.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:28.698 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17, ofs0, ns] 2024-09-12T00:46:28.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f5474ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366284 cookie 93834210070320 notifier 8081 bl.length()=795 2024-09-12T00:46:28.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f5474ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 info.flags=0x17 2024-09-12T00:46:28.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f5474ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17 to cache LRU end 2024-09-12T00:46:28.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f5474ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:28.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_sources= new_sources= 2024-09-12T00:46:28.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential sources added=[] removed=[] 2024-09-12T00:46:28.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): orig_dests= new_dests= 2024-09-12T00:46:28.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 20 handle_bi_update(): bucket=:a-bucket[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17]): potential dests added=[] removed=[] 2024-09-12T00:46:28.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.699+0000 7f55949349c0 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T00:46:28.704 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.703+0000 7f5447fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.707+0000 7f55949349c0 20 remove_watcher() i=0 2024-09-12T00:46:28.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.707+0000 7f55949349c0 2 removed watcher, disabling cache 2024-09-12T00:46:28.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.711+0000 7f55949349c0 20 remove_watcher() i=1 2024-09-12T00:46:28.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.711+0000 7f55949349c0 20 remove_watcher() i=2 2024-09-12T00:46:28.715 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.715+0000 7f55949349c0 20 remove_watcher() i=3 2024-09-12T00:46:28.717 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.715+0000 7f55949349c0 20 remove_watcher() i=4 2024-09-12T00:46:28.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.719+0000 7f55949349c0 20 remove_watcher() i=5 2024-09-12T00:46:28.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.719+0000 7f55949349c0 20 remove_watcher() i=6 2024-09-12T00:46:28.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.723+0000 7f55949349c0 20 remove_watcher() i=7 2024-09-12T00:46:28.738 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:46:28.764 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:28.765 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:28.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.807+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.811 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 realm 2024-09-12T00:46:28.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:28.812 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:28.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.811+0000 7f0d6f8d69c0 20 searching for the correct realm 2024-09-12T00:46:28.821 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.819+0000 7f0d6dbdd640 0 -- 172.21.15.137:0/4234012949 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55d95590abe0 msgr2=0x55d95590cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.827 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.827+0000 7f0d6d3dc640 0 -- 172.21.15.137:0/4234012949 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55d95590ed50 msgr2=0x55d955911140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:28.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:28.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:28.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:28.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:28.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:28.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.831+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:28.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 zone default found 2024-09-12T00:46:28.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 4 Realm: () 2024-09-12T00:46:28.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:28.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:28.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:28.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 zonegroup default 2024-09-12T00:46:28.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 started sync module instance, tier type = 2024-09-12T00:46:28.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.835+0000 7f0d6f8d69c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:28.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 20 add_watcher() i=0 2024-09-12T00:46:28.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 20 add_watcher() i=1 2024-09-12T00:46:28.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 20 add_watcher() i=2 2024-09-12T00:46:28.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 20 add_watcher() i=3 2024-09-12T00:46:28.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 20 add_watcher() i=4 2024-09-12T00:46:28.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 20 add_watcher() i=5 2024-09-12T00:46:28.855 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 20 add_watcher() i=6 2024-09-12T00:46:28.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 20 add_watcher() i=7 2024-09-12T00:46:28.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.855+0000 7f0d6f8d69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:28.861 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0c237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0d6f8d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:28.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0d6f8d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:28.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0d6f8d69c0 5 note: GC not initialized 2024-09-12T00:46:28.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0c227e4640 20 reqs_thread_entry: start 2024-09-12T00:46:28.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0d6f8d69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:28.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0d6f8d69c0 20 Filter name: none 2024-09-12T00:46:28.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0b93fff640 20 reqs_thread_entry: start 2024-09-12T00:46:28.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.859+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:28.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:28.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:28.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:46:28.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 INFO: main: starting shard=0 2024-09-12T00:46:28.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:46:28.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17.3.0 2024-09-12T00:46:28.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:28.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0d6f8d69c0 20 INFO: main: done 2024-09-12T00:46:28.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.863+0000 7f0c237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.867+0000 7f0d6f8d69c0 20 remove_watcher() i=0 2024-09-12T00:46:28.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.867+0000 7f0d6f8d69c0 2 removed watcher, disabling cache 2024-09-12T00:46:28.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.871+0000 7f0d6f8d69c0 20 remove_watcher() i=1 2024-09-12T00:46:28.872 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.871+0000 7f0d6f8d69c0 20 remove_watcher() i=2 2024-09-12T00:46:28.874 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.875+0000 7f0d6f8d69c0 20 remove_watcher() i=3 2024-09-12T00:46:28.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.875+0000 7f0d6f8d69c0 20 remove_watcher() i=4 2024-09-12T00:46:28.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.879+0000 7f0d6f8d69c0 20 remove_watcher() i=5 2024-09-12T00:46:28.881 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.879+0000 7f0d6f8d69c0 20 remove_watcher() i=6 2024-09-12T00:46:28.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.883+0000 7f0d6f8d69c0 20 remove_watcher() i=7 2024-09-12T00:46:28.898 INFO:tasks.workunit.client.0.smithi137.stderr: test: PUT succeeds during reshard 2024-09-12T00:46:28.899 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:46:28.925 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:28.926 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:28.969 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.967+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 realm 2024-09-12T00:46:28.971 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:28.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.972 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:28.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.971+0000 7f7d25d619c0 20 searching for the correct realm 2024-09-12T00:46:28.978 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:28.979+0000 7f7d23066640 0 -- 172.21.15.137:0/1967380359 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f7d1806def0 msgr2=0x7f7d1807a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:29.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.191+0000 7f7d24068640 0 -- 172.21.15.137:0/1967380359 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55ff7f540040 msgr2=0x55ff7f542500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:29.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.203+0000 7f7d25d619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:29.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.203+0000 7f7d25d619c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:29.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.203+0000 7f7d25d619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:29.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.203+0000 7f7d25d619c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:29.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.203+0000 7f7d25d619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:29.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.203+0000 7f7d25d619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:29.207 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.203+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:29.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:29.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 zone default found 2024-09-12T00:46:29.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 4 Realm: () 2024-09-12T00:46:29.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:29.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:29.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:29.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 zonegroup default 2024-09-12T00:46:29.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.207+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.211+0000 7f7d25d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.211+0000 7f7d25d619c0 20 started sync module instance, tier type = 2024-09-12T00:46:29.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.211+0000 7f7d25d619c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:29.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.231+0000 7f7d25d619c0 20 add_watcher() i=0 2024-09-12T00:46:29.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.231+0000 7f7d25d619c0 20 add_watcher() i=1 2024-09-12T00:46:29.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.231+0000 7f7d25d619c0 20 add_watcher() i=2 2024-09-12T00:46:29.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.231+0000 7f7d25d619c0 20 add_watcher() i=3 2024-09-12T00:46:29.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.231+0000 7f7d25d619c0 20 add_watcher() i=4 2024-09-12T00:46:29.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.231+0000 7f7d25d619c0 20 add_watcher() i=5 2024-09-12T00:46:29.234 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.231+0000 7f7d25d619c0 20 add_watcher() i=6 2024-09-12T00:46:29.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.235+0000 7f7d25d619c0 20 add_watcher() i=7 2024-09-12T00:46:29.236 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.235+0000 7f7d25d619c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:29.241 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.239+0000 7f7bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:29.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.239+0000 7f7d25d619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:29.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.239+0000 7f7d25d619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:29.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 5 note: GC not initialized 2024-09-12T00:46:29.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7bd8fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:29.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:29.243 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 20 Filter name: none 2024-09-12T00:46:29.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7b527fc640 20 reqs_thread_entry: start 2024-09-12T00:46:29.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.244 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:29.245 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:29.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:29.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.243+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.247+0000 7f7d25d619c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:29.246 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.247+0000 7f7d25d619c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.247+0000 7f7d25d619c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:29.248 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.247+0000 7f7d25d619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:29.250 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.251+0000 7f7bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:29.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.255+0000 7f7d25d619c0 20 remove_watcher() i=0 2024-09-12T00:46:29.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.255+0000 7f7d25d619c0 2 removed watcher, disabling cache 2024-09-12T00:46:29.257 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.255+0000 7f7d25d619c0 20 remove_watcher() i=1 2024-09-12T00:46:29.259 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.259+0000 7f7d25d619c0 20 remove_watcher() i=2 2024-09-12T00:46:29.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.259+0000 7f7d25d619c0 20 remove_watcher() i=3 2024-09-12T00:46:29.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.263+0000 7f7d25d619c0 20 remove_watcher() i=4 2024-09-12T00:46:29.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.263+0000 7f7d25d619c0 20 remove_watcher() i=5 2024-09-12T00:46:29.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.267+0000 7f7d25d619c0 20 remove_watcher() i=6 2024-09-12T00:46:29.271 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.271+0000 7f7d25d619c0 20 remove_watcher() i=7 2024-09-12T00:46:29.287 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:29.287 INFO:tasks.workunit.client.0.smithi137.stderr:BUCKET_STATS: 2024-09-12T00:46:29.287 INFO:tasks.workunit.client.0.smithi137.stderr:bucket: myver id: 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:46:29.287 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:29.288 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T00:46:29.324 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:29.324 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:29.366 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.363+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.367+0000 7f07e50aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.367+0000 7f07e50aa9c0 20 realm 2024-09-12T00:46:29.369 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.367+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.367+0000 7f07e50aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.367+0000 7f07e50aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:29.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.367+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.367+0000 7f07e50aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.370 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.367+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.371+0000 7f07e50aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:29.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.371+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.371+0000 7f07e50aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:29.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.371+0000 7f07e50aa9c0 20 searching for the correct realm 2024-09-12T00:46:29.378 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.375+0000 7f07e33b1640 0 -- 172.21.15.137:0/2812274166 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f07d8040070 msgr2=0x7f07d8037760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:29.383 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.383+0000 7f07e2bb0640 0 -- 172.21.15.137:0/2812274166 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f07dc100590 msgr2=0x7f07dc0f8ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:29.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:29.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:29.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:29.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:29.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:29.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:29.392 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:29.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:29.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 zone default found 2024-09-12T00:46:29.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 4 Realm: () 2024-09-12T00:46:29.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:29.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:29.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:29.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 zonegroup default 2024-09-12T00:46:29.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.391+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.395+0000 7f07e50aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.395 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.395+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.395+0000 7f07e50aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.395+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.395+0000 7f07e50aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:29.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.395+0000 7f07e50aa9c0 20 started sync module instance, tier type = 2024-09-12T00:46:29.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.395+0000 7f07e50aa9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:29.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.411+0000 7f07e50aa9c0 20 add_watcher() i=0 2024-09-12T00:46:29.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.411+0000 7f07e50aa9c0 20 add_watcher() i=1 2024-09-12T00:46:29.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.411+0000 7f07e50aa9c0 20 add_watcher() i=2 2024-09-12T00:46:29.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.411+0000 7f07e50aa9c0 20 add_watcher() i=3 2024-09-12T00:46:29.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.411+0000 7f07e50aa9c0 20 add_watcher() i=4 2024-09-12T00:46:29.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.411+0000 7f07e50aa9c0 20 add_watcher() i=5 2024-09-12T00:46:29.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.411+0000 7f07e50aa9c0 20 add_watcher() i=6 2024-09-12T00:46:29.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.415+0000 7f07e50aa9c0 20 add_watcher() i=7 2024-09-12T00:46:29.415 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.415+0000 7f07e50aa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:29.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f06997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:29.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:29.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:29.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 5 note: GC not initialized 2024-09-12T00:46:29.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f0613fff640 20 reqs_thread_entry: start 2024-09-12T00:46:29.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:29.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 20 Filter name: none 2024-09-12T00:46:29.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f0611ffb640 20 reqs_thread_entry: start 2024-09-12T00:46:29.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:46:29.421 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:29.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:46:29.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:46:29.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : miss 2024-09-12T00:46:29.422 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.419+0000 7f07e50aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.423+0000 7f07e50aa9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:29.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.423+0000 7f07e50aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:29.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.423+0000 7f07e50aa9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:29.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.423+0000 7f07e50aa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:29.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.423+0000 7f07e50aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:29.423 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.423+0000 7f07e50aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:29.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f07e50aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:29.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f07e50aa9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:29.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f07e50aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:29.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f07e50aa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:29.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f06c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94115920266560 notifier 8132 bl.length()=821 2024-09-12T00:46:29.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f06c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:29.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f06c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:29.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f06c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:29.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:29.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:29.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:29.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.431+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:29.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:29.435+0000 7f07e50aa9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:46:30.293 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:30.293 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:30.330 INFO:tasks.workunit.client.0.smithi137.stderr:put object successful 2024-09-12T00:46:34.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:34.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:34.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:34.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:34.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:34.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:34.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.0 2024-09-12T00:46:34.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.0 2024-09-12T00:46:34.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.1 2024-09-12T00:46:34.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.439+0000 7f07e50aa9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.1 2024-09-12T00:46:34.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.443+0000 7f07e50aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:34.445 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.443+0000 7f07e50aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:34.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.447+0000 7f07e50aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:34.449 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.447+0000 7f07e50aa9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:34.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.447+0000 7f07e50aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:34.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.447+0000 7f07e50aa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:34.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.451+0000 7f06c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94115920266560 notifier 8132 bl.length()=821 2024-09-12T00:46:34.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.451+0000 7f06c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:34.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.451+0000 7f06c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:34.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.451+0000 7f06c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:34.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.451+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:34.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.451+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:34.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.451+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:34.452 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.451+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:34.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.455+0000 7f07e50aa9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.0 2024-09-12T00:46:34.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.455+0000 7f07e50aa9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.0 2024-09-12T00:46:34.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.455+0000 7f07e50aa9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.1 2024-09-12T00:46:34.456 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.455+0000 7f07e50aa9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.1.1 2024-09-12T00:46:34.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.459+0000 7f07e50aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:34.461 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.459+0000 7f07e50aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:34.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.463+0000 7f07e50aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:34.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.463+0000 7f07e50aa9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:34.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.463+0000 7f07e50aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:34.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.463+0000 7f07e50aa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:34.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.463+0000 7f06c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94115920266560 notifier 8132 bl.length()=789 2024-09-12T00:46:34.465 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.463+0000 7f06c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:34.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.463+0000 7f06c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:34.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.463+0000 7f06c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:34.466 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.467+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:34.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.467+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:34.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.467+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:34.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.467+0000 7f07e50aa9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:34.470 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.471+0000 7f07e50aa9c0 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T00:46:34.475 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.475+0000 7f06997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:34.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.479+0000 7f07e50aa9c0 20 remove_watcher() i=0 2024-09-12T00:46:34.481 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.479+0000 7f07e50aa9c0 2 removed watcher, disabling cache 2024-09-12T00:46:34.484 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.483+0000 7f07e50aa9c0 20 remove_watcher() i=1 2024-09-12T00:46:34.487 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.487+0000 7f07e50aa9c0 20 remove_watcher() i=2 2024-09-12T00:46:34.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.491+0000 7f07e50aa9c0 20 remove_watcher() i=3 2024-09-12T00:46:34.493 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.491+0000 7f07e50aa9c0 20 remove_watcher() i=4 2024-09-12T00:46:34.496 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.495+0000 7f07e50aa9c0 20 remove_watcher() i=5 2024-09-12T00:46:34.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.499+0000 7f07e50aa9c0 20 remove_watcher() i=6 2024-09-12T00:46:34.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:34.499+0000 7f07e50aa9c0 20 remove_watcher() i=7 2024-09-12T00:46:35.334 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:46:35.335 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T00:46:35.339 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:35.340 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:35.350 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:35.350 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:35.398 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:35.398 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:35.436 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:35.436 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:35.445 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:35.445 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:35.481 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:35.481 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:35.489 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:35.489 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:35.524 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:35.525 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:35.531 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:46:35.976 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:46:37.407 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:37.407 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:37.479 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:46:37.480 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:46:37.516 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:37.516 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:37.561 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.559+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:37.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 realm 2024-09-12T00:46:37.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:37.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:37.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:37.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:37.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.563+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.567+0000 7f78a67df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:37.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.567+0000 7f78a67df9c0 20 searching for the correct realm 2024-09-12T00:46:37.572 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.571+0000 7f78a3ae4640 0 -- 172.21.15.137:0/1755452278 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f789801a210 msgr2=0x7f7898026990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:37.785 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.783+0000 7f78a4ae6640 0 -- 172.21.15.137:0/1755452278 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55a53b43a960 msgr2=0x55a53b43cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:37.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:37.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:37.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:37.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:37.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:37.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:37.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.797 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:37.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:37.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.795+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:37.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 zone default found 2024-09-12T00:46:37.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 4 Realm: () 2024-09-12T00:46:37.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:37.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:37.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:37.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 zonegroup default 2024-09-12T00:46:37.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:37.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:37.800 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:37.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 started sync module instance, tier type = 2024-09-12T00:46:37.801 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.799+0000 7f78a67df9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:37.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 20 add_watcher() i=0 2024-09-12T00:46:37.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 20 add_watcher() i=1 2024-09-12T00:46:37.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 20 add_watcher() i=2 2024-09-12T00:46:37.823 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 20 add_watcher() i=3 2024-09-12T00:46:37.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 20 add_watcher() i=4 2024-09-12T00:46:37.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 20 add_watcher() i=5 2024-09-12T00:46:37.824 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 20 add_watcher() i=6 2024-09-12T00:46:37.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 20 add_watcher() i=7 2024-09-12T00:46:37.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.823+0000 7f78a67df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:37.830 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.827+0000 7f775a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:37.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:37.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:37.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 5 note: GC not initialized 2024-09-12T00:46:37.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f77597e2640 20 reqs_thread_entry: start 2024-09-12T00:46:37.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:37.831 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 Filter name: none 2024-09-12T00:46:37.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f76caffd640 20 reqs_thread_entry: start 2024-09-12T00:46:37.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:37.832 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:37.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:37.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:37.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:46:37.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 INFO: main: starting shard=0 2024-09-12T00:46:37.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:37.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.831+0000 7f78a67df9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:37.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:46:37.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 20 INFO: main: starting shard=1 2024-09-12T00:46:37.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:37.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:37.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:37.836 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 20 INFO: main: starting shard=2 2024-09-12T00:46:37.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:37.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:37.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:37.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.835+0000 7f78a67df9c0 20 INFO: main: done 2024-09-12T00:46:37.839 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.839+0000 7f775a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:37.843 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.843+0000 7f78a67df9c0 20 remove_watcher() i=0 2024-09-12T00:46:37.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.843+0000 7f78a67df9c0 2 removed watcher, disabling cache 2024-09-12T00:46:37.845 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.843+0000 7f78a67df9c0 20 remove_watcher() i=1 2024-09-12T00:46:37.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.847+0000 7f78a67df9c0 20 remove_watcher() i=2 2024-09-12T00:46:37.850 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.847+0000 7f78a67df9c0 20 remove_watcher() i=3 2024-09-12T00:46:37.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.851+0000 7f78a67df9c0 20 remove_watcher() i=4 2024-09-12T00:46:37.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.855+0000 7f78a67df9c0 20 remove_watcher() i=5 2024-09-12T00:46:37.857 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.855+0000 7f78a67df9c0 20 remove_watcher() i=6 2024-09-12T00:46:37.860 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:37.859+0000 7f78a67df9c0 20 remove_watcher() i=7 2024-09-12T00:46:37.877 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:37.878 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:37.882 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:37.882 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:37.943 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:46:37.944 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:46:37.975 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:37.975 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:38.020 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.019+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 realm 2024-09-12T00:46:38.022 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.023 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:38.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:38.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.024 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:38.025 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.023+0000 7fa6248af9c0 20 searching for the correct realm 2024-09-12T00:46:38.032 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.031+0000 7fa622bb6640 0 -- 172.21.15.137:0/2056431840 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7fa61802e040 msgr2=0x7fa61802e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:38.037 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.035+0000 7fa6223b5640 0 -- 172.21.15.137:0/2056431840 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fa61c018040 msgr2=0x7fa61c05fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:38.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:38.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:38.044 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:38.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:38.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:38.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:38.045 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:38.048 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:38.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 zone default found 2024-09-12T00:46:38.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 4 Realm: () 2024-09-12T00:46:38.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:38.049 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:38.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:38.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 zonegroup default 2024-09-12T00:46:38.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.043+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.047+0000 7fa6248af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.047+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.047+0000 7fa6248af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.051 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.047+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.047+0000 7fa6248af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.047+0000 7fa6248af9c0 20 started sync module instance, tier type = 2024-09-12T00:46:38.052 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.047+0000 7fa6248af9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:38.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 20 add_watcher() i=0 2024-09-12T00:46:38.067 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 20 add_watcher() i=1 2024-09-12T00:46:38.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 20 add_watcher() i=2 2024-09-12T00:46:38.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 20 add_watcher() i=3 2024-09-12T00:46:38.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 20 add_watcher() i=4 2024-09-12T00:46:38.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 20 add_watcher() i=5 2024-09-12T00:46:38.068 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 20 add_watcher() i=6 2024-09-12T00:46:38.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 20 add_watcher() i=7 2024-09-12T00:46:38.070 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.067+0000 7fa6248af9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:38.073 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa4d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:38.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa6248af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:38.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa6248af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:38.074 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa6248af9c0 5 note: GC not initialized 2024-09-12T00:46:38.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa4537fe640 20 reqs_thread_entry: start 2024-09-12T00:46:38.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa6248af9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:38.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa6248af9c0 20 Filter name: none 2024-09-12T00:46:38.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa4517fa640 20 reqs_thread_entry: start 2024-09-12T00:46:38.075 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.071+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.076 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:38.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:38.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:38.077 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:46:38.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 INFO: main: starting shard=0 2024-09-12T00:46:38.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:38.078 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:38.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:38.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 INFO: main: starting shard=1 2024-09-12T00:46:38.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:38.079 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.075+0000 7fa6248af9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:38.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.079+0000 7fa6248af9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:38.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.079+0000 7fa6248af9c0 20 INFO: main: starting shard=2 2024-09-12T00:46:38.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.079+0000 7fa6248af9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:38.080 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.079+0000 7fa6248af9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:38.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.079+0000 7fa6248af9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:46:38.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.079+0000 7fa6248af9c0 20 INFO: main: done 2024-09-12T00:46:38.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.079+0000 7fa4d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:38.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.083+0000 7fa6248af9c0 20 remove_watcher() i=0 2024-09-12T00:46:38.085 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.083+0000 7fa6248af9c0 2 removed watcher, disabling cache 2024-09-12T00:46:38.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.087+0000 7fa6248af9c0 20 remove_watcher() i=1 2024-09-12T00:46:38.089 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.087+0000 7fa6248af9c0 20 remove_watcher() i=2 2024-09-12T00:46:38.091 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.091+0000 7fa6248af9c0 20 remove_watcher() i=3 2024-09-12T00:46:38.093 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.091+0000 7fa6248af9c0 20 remove_watcher() i=4 2024-09-12T00:46:38.095 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.095+0000 7fa6248af9c0 20 remove_watcher() i=5 2024-09-12T00:46:38.097 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.095+0000 7fa6248af9c0 20 remove_watcher() i=6 2024-09-12T00:46:38.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.099+0000 7fa6248af9c0 20 remove_watcher() i=7 2024-09-12T00:46:38.116 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:38.116 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:38.119 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:38.120 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:38.183 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:46:38.184 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:46:38.221 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:38.222 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:38.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.263+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 realm 2024-09-12T00:46:38.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:38.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:38.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:38.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.267+0000 7f7f137059c0 20 searching for the correct realm 2024-09-12T00:46:38.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.275+0000 7f7f11a0c640 0 -- 172.21.15.137:0/3444048780 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x56486eaa6150 msgr2=0x56486eaa8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:38.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.283+0000 7f7f1120b640 0 -- 172.21.15.137:0/3444048780 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x56486eaaa250 msgr2=0x56486eaac710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:38.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.287+0000 7f7f137059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:38.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.287+0000 7f7f137059c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:38.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.287+0000 7f7f137059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:38.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.287+0000 7f7f137059c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:38.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.287+0000 7f7f137059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:38.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.287+0000 7f7f137059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:38.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.287+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.290 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:38.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:38.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 zone default found 2024-09-12T00:46:38.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 4 Realm: () 2024-09-12T00:46:38.291 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:38.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:38.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:38.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 zonegroup default 2024-09-12T00:46:38.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:38.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 started sync module instance, tier type = 2024-09-12T00:46:38.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.291+0000 7f7f137059c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:38.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.311+0000 7f7f137059c0 20 add_watcher() i=0 2024-09-12T00:46:38.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.311+0000 7f7f137059c0 20 add_watcher() i=1 2024-09-12T00:46:38.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.311+0000 7f7f137059c0 20 add_watcher() i=2 2024-09-12T00:46:38.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.311+0000 7f7f137059c0 20 add_watcher() i=3 2024-09-12T00:46:38.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.311+0000 7f7f137059c0 20 add_watcher() i=4 2024-09-12T00:46:38.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.311+0000 7f7f137059c0 20 add_watcher() i=5 2024-09-12T00:46:38.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.311+0000 7f7f137059c0 20 add_watcher() i=6 2024-09-12T00:46:38.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.315+0000 7f7f137059c0 20 add_watcher() i=7 2024-09-12T00:46:38.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.315+0000 7f7f137059c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:38.317 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.315+0000 7f7dc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:38.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.315+0000 7f7f137059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:38.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.315+0000 7f7f137059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:38.318 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.315+0000 7f7f137059c0 5 note: GC not initialized 2024-09-12T00:46:38.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7dc67e4640 20 reqs_thread_entry: start 2024-09-12T00:46:38.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:38.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 Filter name: none 2024-09-12T00:46:38.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7d37fff640 20 reqs_thread_entry: start 2024-09-12T00:46:38.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:38.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:38.320 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:38.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:38.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:46:38.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 INFO: main: starting shard=0 2024-09-12T00:46:38.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:38.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:38.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:38.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 INFO: main: starting shard=1 2024-09-12T00:46:38.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:38.322 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.319+0000 7f7f137059c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:38.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.323+0000 7f7f137059c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:46:38.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.323+0000 7f7f137059c0 20 INFO: main: starting shard=2 2024-09-12T00:46:38.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.323+0000 7f7f137059c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:38.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.323+0000 7f7f137059c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:38.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.323+0000 7f7f137059c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:46:38.324 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.323+0000 7f7f137059c0 20 INFO: main: done 2024-09-12T00:46:38.325 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.323+0000 7f7dc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:38.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.327+0000 7f7f137059c0 20 remove_watcher() i=0 2024-09-12T00:46:38.329 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.327+0000 7f7f137059c0 2 removed watcher, disabling cache 2024-09-12T00:46:38.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.331+0000 7f7f137059c0 20 remove_watcher() i=1 2024-09-12T00:46:38.333 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.331+0000 7f7f137059c0 20 remove_watcher() i=2 2024-09-12T00:46:38.335 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.335+0000 7f7f137059c0 20 remove_watcher() i=3 2024-09-12T00:46:38.337 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.335+0000 7f7f137059c0 20 remove_watcher() i=4 2024-09-12T00:46:38.339 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.339+0000 7f7f137059c0 20 remove_watcher() i=5 2024-09-12T00:46:38.342 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.339+0000 7f7f137059c0 20 remove_watcher() i=6 2024-09-12T00:46:38.345 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:38.343+0000 7f7f137059c0 20 remove_watcher() i=7 2024-09-12T00:46:38.361 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:38.361 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:38.364 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:46:38.784 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:46:39.191 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:46:39.224 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:39.224 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:39.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.263+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.263+0000 7f5f2389a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.263+0000 7f5f2389a9c0 20 realm 2024-09-12T00:46:39.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.263+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.263+0000 7f5f2389a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.263+0000 7f5f2389a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:39.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.263+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.267+0000 7f5f2389a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.266 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.267+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.267+0000 7f5f2389a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:39.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.267+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.267+0000 7f5f2389a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:39.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.267+0000 7f5f2389a9c0 20 searching for the correct realm 2024-09-12T00:46:39.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.271+0000 7f5f20b9f640 0 -- 172.21.15.137:0/102002624 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f5f18089b60 msgr2=0x7f5f180247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:39.485 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.483+0000 7f5f213a0640 0 -- 172.21.15.137:0/102002624 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f5f140c9410 msgr2=0x7f5f140c9850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:39.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:39.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:39.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:39.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:39.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:39.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:39.497 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.495+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:39.498 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 zone default found 2024-09-12T00:46:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 4 Realm: () 2024-09-12T00:46:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 zonegroup default 2024-09-12T00:46:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.501 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 started sync module instance, tier type = 2024-09-12T00:46:39.502 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.499+0000 7f5f2389a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:39.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 20 add_watcher() i=0 2024-09-12T00:46:39.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 20 add_watcher() i=1 2024-09-12T00:46:39.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 20 add_watcher() i=2 2024-09-12T00:46:39.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 20 add_watcher() i=3 2024-09-12T00:46:39.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 20 add_watcher() i=4 2024-09-12T00:46:39.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 20 add_watcher() i=5 2024-09-12T00:46:39.524 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 20 add_watcher() i=6 2024-09-12T00:46:39.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 20 add_watcher() i=7 2024-09-12T00:46:39.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.523+0000 7f5f2389a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:39.529 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.527+0000 7f5dd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:39.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.527+0000 7f5f2389a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:39.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.527+0000 7f5f2389a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:39.530 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 5 note: GC not initialized 2024-09-12T00:46:39.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5dd67e4640 20 reqs_thread_entry: start 2024-09-12T00:46:39.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:39.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 20 Filter name: none 2024-09-12T00:46:39.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5d47fff640 20 reqs_thread_entry: start 2024-09-12T00:46:39.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:46:39.531 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:39.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:46:39.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:46:39.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : miss 2024-09-12T00:46:39.532 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:39.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:39.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:39.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:39.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:39.533 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.531+0000 7f5f2389a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:39.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5f2389a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:39.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5f2389a9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:39.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5f2389a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:39.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5f2389a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:39.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5e04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366188 cookie 94345642058432 notifier 8225 bl.length()=821 2024-09-12T00:46:39.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5e04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:39.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5e04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:39.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5e04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:39.548 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:39.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:39.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:39.549 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.547+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:39.554 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.0 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.0 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.1 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.1 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.2 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.2 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.3 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.3 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.4 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.4 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.5 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.5 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.6 2024-09-12T00:46:39.555 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.6 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.7 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.7 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.8 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.8 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.10 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.10 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.11 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.11 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.12 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.12 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.13 2024-09-12T00:46:39.556 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.13 2024-09-12T00:46:39.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.14 2024-09-12T00:46:39.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.14 2024-09-12T00:46:39.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.15 2024-09-12T00:46:39.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.15 2024-09-12T00:46:39.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.16 2024-09-12T00:46:39.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.16 2024-09-12T00:46:39.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:39.557 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.551+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:39.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.555+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:39.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.555+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:39.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.555+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:39.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.555+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.559+0000 7f5f2389a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:39.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.559+0000 7f5f2389a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:39.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5f2389a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:39.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5f2389a9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:39.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5f2389a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:39.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5f2389a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:39.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5e04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94345642058432 notifier 8225 bl.length()=821 2024-09-12T00:46:39.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5e04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:39.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5e04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:39.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5e04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:39.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:39.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:39.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:39.566 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.563+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:39.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.567+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:39.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.567+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.0 2024-09-12T00:46:39.568 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.567+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:39.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.567+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.1 2024-09-12T00:46:39.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.567+0000 7f5f2389a9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:39.569 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.567+0000 7f5f2389a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.2.2 2024-09-12T00:46:39.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.567+0000 7f5f2389a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:39.570 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.567+0000 7f5f2389a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:39.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5f2389a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:39.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5f2389a9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:39.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5f2389a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:39.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5f2389a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18, ofs0, ns] 2024-09-12T00:46:39.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5df3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 94345642058432 notifier 8225 bl.length()=789 2024-09-12T00:46:39.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5df3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:39.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5df3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:39.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5df3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:39.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_sources= new_sources= 2024-09-12T00:46:39.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential sources added=[] removed=[] 2024-09-12T00:46:39.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): orig_dests= new_dests= 2024-09-12T00:46:39.574 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.571+0000 7f5f2389a9c0 20 handle_bi_update(): bucket=:myver[68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18]): potential dests added=[] removed=[] 2024-09-12T00:46:39.577 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.575+0000 7f5f2389a9c0 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T00:46:39.580 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.579+0000 7f5dd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:39.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.583+0000 7f5f2389a9c0 20 remove_watcher() i=0 2024-09-12T00:46:39.584 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.583+0000 7f5f2389a9c0 2 removed watcher, disabling cache 2024-09-12T00:46:39.586 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.583+0000 7f5f2389a9c0 20 remove_watcher() i=1 2024-09-12T00:46:39.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.587+0000 7f5f2389a9c0 20 remove_watcher() i=2 2024-09-12T00:46:39.590 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.587+0000 7f5f2389a9c0 20 remove_watcher() i=3 2024-09-12T00:46:39.592 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.591+0000 7f5f2389a9c0 20 remove_watcher() i=4 2024-09-12T00:46:39.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.591+0000 7f5f2389a9c0 20 remove_watcher() i=5 2024-09-12T00:46:39.596 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.595+0000 7f5f2389a9c0 20 remove_watcher() i=6 2024-09-12T00:46:39.599 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.599+0000 7f5f2389a9c0 20 remove_watcher() i=7 2024-09-12T00:46:39.616 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:46:39.653 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:39.653 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:39.697 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.695+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 realm 2024-09-12T00:46:39.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:39.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.700 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:39.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:39.701 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.699+0000 7f334db6f9c0 20 searching for the correct realm 2024-09-12T00:46:39.707 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.707+0000 7f334be76640 0 -- 172.21.15.137:0/778565757 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f333403e040 msgr2=0x7f333403f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:39.713 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.711+0000 7f334b675640 0 -- 172.21.15.137:0/778565757 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f3344062c20 msgr2=0x7f334405bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:39.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:39.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:39.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:39.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:39.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:39.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:39.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:39.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:39.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 zone default found 2024-09-12T00:46:39.720 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 4 Realm: () 2024-09-12T00:46:39.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:39.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:39.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:39.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 zonegroup default 2024-09-12T00:46:39.721 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 started sync module instance, tier type = 2024-09-12T00:46:39.722 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.719+0000 7f334db6f9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:39.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.739+0000 7f334db6f9c0 20 add_watcher() i=0 2024-09-12T00:46:39.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.739+0000 7f334db6f9c0 20 add_watcher() i=1 2024-09-12T00:46:39.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.739+0000 7f334db6f9c0 20 add_watcher() i=2 2024-09-12T00:46:39.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.739+0000 7f334db6f9c0 20 add_watcher() i=3 2024-09-12T00:46:39.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.739+0000 7f334db6f9c0 20 add_watcher() i=4 2024-09-12T00:46:39.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.739+0000 7f334db6f9c0 20 add_watcher() i=5 2024-09-12T00:46:39.740 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.739+0000 7f334db6f9c0 20 add_watcher() i=6 2024-09-12T00:46:39.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.743+0000 7f334db6f9c0 20 add_watcher() i=7 2024-09-12T00:46:39.742 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.743+0000 7f334db6f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.743+0000 7f3201fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.743+0000 7f334db6f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.743+0000 7f334db6f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:39.746 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.743+0000 7f334db6f9c0 5 note: GC not initialized 2024-09-12T00:46:39.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.743+0000 7f3200fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:39.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:39.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 Filter name: none 2024-09-12T00:46:39.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f317a7fc640 20 reqs_thread_entry: start 2024-09-12T00:46:39.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:46:39.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:39.747 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:46:39.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:46:39.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 : miss 2024-09-12T00:46:39.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:39.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 info.flags=0x17 2024-09-12T00:46:39.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 to cache LRU end 2024-09-12T00:46:39.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:39.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:39.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18 2024-09-12T00:46:39.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.0 2024-09-12T00:46:39.749 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.0 2024-09-12T00:46:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:46:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.1 2024-09-12T00:46:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.1 2024-09-12T00:46:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:46:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.2 2024-09-12T00:46:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.2 2024-09-12T00:46:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:46:39.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.3 2024-09-12T00:46:39.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.3 2024-09-12T00:46:39.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:46:39.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.4 2024-09-12T00:46:39.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.747+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.4 2024-09-12T00:46:39.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:46:39.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.5 2024-09-12T00:46:39.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.5 2024-09-12T00:46:39.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:46:39.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.6 2024-09-12T00:46:39.752 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.6 2024-09-12T00:46:39.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:46:39.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.7 2024-09-12T00:46:39.753 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.7 2024-09-12T00:46:39.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:46:39.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.8 2024-09-12T00:46:39.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.751+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.8 2024-09-12T00:46:39.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:46:39.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.10 2024-09-12T00:46:39.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.10 2024-09-12T00:46:39.755 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:46:39.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.11 2024-09-12T00:46:39.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.11 2024-09-12T00:46:39.756 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:46:39.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.12 2024-09-12T00:46:39.757 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.12 2024-09-12T00:46:39.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:46:39.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.13 2024-09-12T00:46:39.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.755+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.13 2024-09-12T00:46:39.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:46:39.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.14 2024-09-12T00:46:39.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.14 2024-09-12T00:46:39.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:46:39.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.15 2024-09-12T00:46:39.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.15 2024-09-12T00:46:39.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:46:39.759 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 10 bucket_obj is .dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.16 2024-09-12T00:46:39.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.16 2024-09-12T00:46:39.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:46:39.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:x state=0x55a34fcf8a28 s->prefetch_data=0 2024-09-12T00:46:39.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 20 get_obj_state: setting s->obj_tag to glgxtt9gkrvx1uvtskxbp5jlgf23smlf 2024-09-12T00:46:39.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 20 get_obj_state_impl: setting s->olh_tag to grjgawd9ncdm5ytxqififlwj8wuhg8hg 2024-09-12T00:46:39.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.759+0000 7f334db6f9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=grjgawd9ncdm5ytxqififlwj8wuhg8hg 2024-09-12T00:46:39.762 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:46:39.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 olh_log_entry: epoch=2 op=3 key=x[82dX8eM2oVggaYANEUR.47FgQEJFdSd] 2024-09-12T00:46:39.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:_:82dX8eM2oVggaYANEUR.47FgQEJFdSd_x state=0x55a34fcf7ca8 s->prefetch_data=0 2024-09-12T00:46:39.765 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 10 manifest: total_size = 9 2024-09-12T00:46:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.511912662505707928 2024-09-12T00:46:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:_:82dX8eM2oVggaYANEUR.47FgQEJFdSd_x state=0x55a34fcf7ca8 s->prefetch_data=0 2024-09-12T00:46:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a34fcf7ca8 2024-09-12T00:46:39.766 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.763+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.769 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.767+0000 7f334db6f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:39.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.767+0000 7f334db6f9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:46:39.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.767+0000 7f334db6f9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:46:39.770 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.767+0000 7f334db6f9c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18__shadow:82dX8eM2oVggaYANEUR.47FgQEJFdSd_.2jj5PmBIRY86XlGBSfE0JqeuFOvFuc2_0 2024-09-12T00:46:39.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.771+0000 7f334db6f9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:46:39.772 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.771+0000 7f322e7fc640 20 handle_completion(): completion ok for obj=x[82dX8eM2oVggaYANEUR.47FgQEJFdSd] 2024-09-12T00:46:39.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.771+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:x state=0x55a34fcf8a28 s->prefetch_data=0 2024-09-12T00:46:39.774 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.771+0000 7f334db6f9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=grjgawd9ncdm5ytxqififlwj8wuhg8hg 2024-09-12T00:46:39.778 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.775+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.779+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.779+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.780 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.779+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:y state=0x55a34fcfd6b8 s->prefetch_data=0 2024-09-12T00:46:39.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.779+0000 7f334db6f9c0 20 get_obj_state: setting s->obj_tag to 6pey0azn8jwswuidlgaae27pgvski3ln 2024-09-12T00:46:39.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.779+0000 7f334db6f9c0 20 get_obj_state_impl: setting s->olh_tag to pe2ul3ervffej75uuny33d44x4fqf937 2024-09-12T00:46:39.781 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.779+0000 7f334db6f9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pe2ul3ervffej75uuny33d44x4fqf937 2024-09-12T00:46:39.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.783+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:46:39.787 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 20 olh_log_entry: epoch=2 op=3 key=y[d7xVsJWVBXZRgAii8T2rMAxlFhlFiRb] 2024-09-12T00:46:39.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:_:d7xVsJWVBXZRgAii8T2rMAxlFhlFiRb_y state=0x55a34fcf8a28 s->prefetch_data=0 2024-09-12T00:46:39.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 10 manifest: total_size = 22 2024-09-12T00:46:39.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11114959937677831712 2024-09-12T00:46:39.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:_:d7xVsJWVBXZRgAii8T2rMAxlFhlFiRb_y state=0x55a34fcf8a28 s->prefetch_data=0 2024-09-12T00:46:39.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a34fcf8a28 2024-09-12T00:46:39.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.787+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.791+0000 7f334db6f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:39.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.791+0000 7f334db6f9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:46:39.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.791+0000 7f334db6f9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:46:39.792 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.791+0000 7f334db6f9c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18__shadow:d7xVsJWVBXZRgAii8T2rMAxlFhlFiRb_.E-lzLs1-ejBiH7e68tVHtObBlraJWOS_0 2024-09-12T00:46:39.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.791+0000 7f322effd640 20 handle_completion(): completion ok for obj=y[d7xVsJWVBXZRgAii8T2rMAxlFhlFiRb] 2024-09-12T00:46:39.794 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.795+0000 7f334db6f9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:46:39.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.799+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:y state=0x55a34fcfd6b8 s->prefetch_data=0 2024-09-12T00:46:39.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.799+0000 7f334db6f9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pe2ul3ervffej75uuny33d44x4fqf937 2024-09-12T00:46:39.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.803+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.807 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.807+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.807+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.808 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.807+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:z state=0x55a34fcfd6b8 s->prefetch_data=0 2024-09-12T00:46:39.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.807+0000 7f334db6f9c0 20 get_obj_state: setting s->obj_tag to u37afz3ouem638bzqx1f5thaekseani3 2024-09-12T00:46:39.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.807+0000 7f334db6f9c0 20 get_obj_state_impl: setting s->olh_tag to 7l64u8thex9f17jah8qrqd6a2mwsv0l5 2024-09-12T00:46:39.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.807+0000 7f334db6f9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7l64u8thex9f17jah8qrqd6a2mwsv0l5 2024-09-12T00:46:39.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.811+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:46:39.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 20 olh_log_entry: epoch=2 op=3 key=z[YRYY-qWUPVvOTpG8lsOUJB3Nde5jGgY] 2024-09-12T00:46:39.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:_:YRYY-qWUPVvOTpG8lsOUJB3Nde5jGgY_z state=0x55a34fcf8a28 s->prefetch_data=0 2024-09-12T00:46:39.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 10 manifest: total_size = 22 2024-09-12T00:46:39.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 20 get_obj_state: setting s->obj_tag to 68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5016691628690340564 2024-09-12T00:46:39.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:_:YRYY-qWUPVvOTpG8lsOUJB3Nde5jGgY_z state=0x55a34fcf8a28 s->prefetch_data=0 2024-09-12T00:46:39.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a34fcf8a28 2024-09-12T00:46:39.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.815+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.823+0000 7f334db6f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:39.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.823+0000 7f334db6f9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:46:39.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.823+0000 7f334db6f9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:46:39.822 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.823+0000 7f334db6f9c0 5 delete_objs_inline: removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18__shadow:YRYY-qWUPVvOTpG8lsOUJB3Nde5jGgY_.ma61XGFv-RUg6aMXc9tP_qOhKdiVFRc_0 2024-09-12T00:46:39.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.823+0000 7f322effd640 20 handle_completion(): completion ok for obj=z[YRYY-qWUPVvOTpG8lsOUJB3Nde5jGgY] 2024-09-12T00:46:39.825 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.823+0000 7f334db6f9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:46:39.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.827+0000 7f334db6f9c0 20 get_obj_state: octx=0x55a34fa4e740 obj=myver:z state=0x55a34fcfd6b8 s->prefetch_data=0 2024-09-12T00:46:39.829 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.827+0000 7f334db6f9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7l64u8thex9f17jah8qrqd6a2mwsv0l5 2024-09-12T00:46:39.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.835+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.835+0000 7f334db6f9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18.3.9 2024-09-12T00:46:39.837 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.835+0000 7f334db6f9c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:46:39.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.835+0000 7f334db6f9c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:46:39.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.839+0000 7f3201fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:39.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.843+0000 7f334db6f9c0 20 remove_watcher() i=0 2024-09-12T00:46:39.842 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.843+0000 7f334db6f9c0 2 removed watcher, disabling cache 2024-09-12T00:46:39.844 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.843+0000 7f334db6f9c0 20 remove_watcher() i=1 2024-09-12T00:46:39.847 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.847+0000 7f334db6f9c0 20 remove_watcher() i=2 2024-09-12T00:46:39.848 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.847+0000 7f334db6f9c0 20 remove_watcher() i=3 2024-09-12T00:46:39.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.851+0000 7f334db6f9c0 20 remove_watcher() i=4 2024-09-12T00:46:39.853 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.851+0000 7f334db6f9c0 20 remove_watcher() i=5 2024-09-12T00:46:39.856 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.855+0000 7f334db6f9c0 20 remove_watcher() i=6 2024-09-12T00:46:39.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.859+0000 7f334db6f9c0 20 remove_watcher() i=7 2024-09-12T00:46:39.874 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:39.874 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:39.880 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:39.880 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:39.923 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:46:39.951 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:39.951 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:39.991 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.991+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.991+0000 7f0eb73749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.991+0000 7f0eb73749c0 20 realm 2024-09-12T00:46:39.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.991+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:39.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:39.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:39.995 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:39.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:39.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.995+0000 7f0eb73749c0 20 searching for the correct realm 2024-09-12T00:46:40.001 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:39.999+0000 7f0eb4679640 0 -- 172.21.15.137:0/2055984100 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f0e9c037070 msgr2=0x7f0e9c03f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:40.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.211+0000 7f0eb567b640 0 -- 172.21.15.137:0/2055984100 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x563778463cc0 msgr2=0x5637784660b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:40.226 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.223+0000 7f0eb73749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:40.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.223+0000 7f0eb73749c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:46:40.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.223+0000 7f0eb73749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:40.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.223+0000 7f0eb73749c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:46:40.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.223+0000 7f0eb73749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:40.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.223+0000 7f0eb73749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:40.227 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:40.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:40.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.229 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:40.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 zone default found 2024-09-12T00:46:40.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 4 Realm: () 2024-09-12T00:46:40.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:46:40.230 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:46:40.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:40.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 zonegroup default 2024-09-12T00:46:40.231 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:40.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.232 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:40.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.227+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.231+0000 7f0eb73749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:40.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.231+0000 7f0eb73749c0 20 started sync module instance, tier type = 2024-09-12T00:46:40.233 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.231+0000 7f0eb73749c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:46:40.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 20 add_watcher() i=0 2024-09-12T00:46:40.255 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 20 add_watcher() i=1 2024-09-12T00:46:40.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 20 add_watcher() i=2 2024-09-12T00:46:40.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 20 add_watcher() i=3 2024-09-12T00:46:40.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 20 add_watcher() i=4 2024-09-12T00:46:40.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 20 add_watcher() i=5 2024-09-12T00:46:40.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 20 add_watcher() i=6 2024-09-12T00:46:40.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 20 add_watcher() i=7 2024-09-12T00:46:40.258 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.255+0000 7f0eb73749c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:40.262 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0d6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:40.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0eb73749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:40.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0eb73749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:40.263 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0eb73749c0 5 note: GC not initialized 2024-09-12T00:46:40.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0d6a7e4640 20 reqs_thread_entry: start 2024-09-12T00:46:40.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0eb73749c0 20 init_complete bucket index max shards: 1 2024-09-12T00:46:40.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0eb73749c0 20 Filter name: none 2024-09-12T00:46:40.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0d637fe640 20 reqs_thread_entry: start 2024-09-12T00:46:40.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0eb73749c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:40.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.263+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.267+0000 7f0eb73749c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:40.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.267+0000 7f0eb73749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:40.267 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.267+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.267+0000 7f0eb73749c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:46:40.268 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.267+0000 7f0eb73749c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:40.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.267+0000 7f0eb73749c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:46:40.269 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.267+0000 7f0eb73749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:40.273 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.271+0000 7f0d6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:40.277 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.275+0000 7f0eb73749c0 20 remove_watcher() i=0 2024-09-12T00:46:40.278 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.275+0000 7f0eb73749c0 2 removed watcher, disabling cache 2024-09-12T00:46:40.280 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.279+0000 7f0eb73749c0 20 remove_watcher() i=1 2024-09-12T00:46:40.282 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.279+0000 7f0eb73749c0 20 remove_watcher() i=2 2024-09-12T00:46:40.284 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.283+0000 7f0eb73749c0 20 remove_watcher() i=3 2024-09-12T00:46:40.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.287+0000 7f0eb73749c0 20 remove_watcher() i=4 2024-09-12T00:46:40.289 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.287+0000 7f0eb73749c0 20 remove_watcher() i=5 2024-09-12T00:46:40.292 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.291+0000 7f0eb73749c0 20 remove_watcher() i=6 2024-09-12T00:46:40.295 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T00:46:40.295+0000 7f0eb73749c0 20 remove_watcher() i=7 2024-09-12T00:46:40.313 INFO:tasks.workunit.client.0.smithi137.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:46:40.313 INFO:tasks.workunit.client.0.smithi137.stderr:Deleting bucket a-bucket 2024-09-12T00:46:40.314 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:40.314 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:40.319 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:40.319 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:40.347 INFO:tasks.workunit.client.0.smithi137.stderr:Deleting bucket myver 2024-09-12T00:46:40.348 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:40.348 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:40.398 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:46:40.398 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T00:46:40.491 INFO:tasks.workunit.client.0.smithi137.stderr:Completed resharding tests 2024-09-12T00:46:40.491 INFO:tasks.workunit.client.0.smithi137.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:46:40.492 INFO:tasks.workunit.client.0.smithi137.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:46:40.492 INFO:tasks.workunit.client.0.smithi137.stdout:connected to https://localhost:443 2024-09-12T00:46:40.613 INFO:tasks.workunit.client.0.smithi137.stderr:+ deactivate 2024-09-12T00:46:40.613 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:46:40.613 INFO:tasks.workunit.client.0.smithi137.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:46:40.613 INFO:tasks.workunit.client.0.smithi137.stderr:+ export PATH 2024-09-12T00:46:40.613 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:46:40.613 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n '' ']' 2024-09-12T00:46:40.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:46:40.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ hash -r 2024-09-12T00:46:40.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n '' ']' 2024-09-12T00:46:40.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:46:40.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:46:40.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:46:40.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset -f deactivate 2024-09-12T00:46:40.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo OK. 2024-09-12T00:46:40.615 INFO:tasks.workunit.client.0.smithi137.stdout:OK. 2024-09-12T00:46:40.615 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:46:40.616 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:46:40.672 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:46:40.672 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:46:41.126 DEBUG:teuthology.parallel:result is None 2024-09-12T00:46:41.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:46:41.139 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:46:41.139 DEBUG:teuthology.orchestra.run.smithi137:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:46:41.190 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:46:41.191 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:46:41.206 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:46:41.206 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:46:41.206 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:46:41.207 DEBUG:teuthology.orchestra.run.smithi137:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:46:41.239 INFO:teuthology.orchestra.run.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:46:45.713 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:46:45.714 DEBUG:teuthology.orchestra.run.smithi137:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:46:45.804 INFO:teuthology.orchestra.run.smithi137.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T00:46:45.864 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-12T00:46:46.076 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-12T00:46:46.077 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-12T00:46:46.275 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:46:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:46:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:46:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:46:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:46:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:46:46.276 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:46:46.276 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-09-12T00:46:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:46:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:46:46.278 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-09-12T00:46:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T00:46:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T00:46:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T00:46:46.315 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-09-12T00:46:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:46:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:46:46.515 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:46:46.516 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 46.0 MB of archives. 2024-09-12T00:46:46.516 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T00:46:46.516 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T00:46:46.879 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T00:46:47.240 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T00:46:47.240 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T00:46:47.247 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T00:46:47.247 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T00:46:48.346 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T00:46:48.347 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T00:46:48.587 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T00:46:48.995 INFO:teuthology.orchestra.run.smithi137.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T00:46:48.995 INFO:teuthology.orchestra.run.smithi137.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T00:46:48.995 INFO:teuthology.orchestra.run.smithi137.stderr:debconf: falling back to frontend: Readline 2024-09-12T00:46:49.005 INFO:teuthology.orchestra.run.smithi137.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T00:46:49.006 INFO:teuthology.orchestra.run.smithi137.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T00:46:49.006 INFO:teuthology.orchestra.run.smithi137.stderr:debconf: falling back to frontend: Teletype 2024-09-12T00:46:49.009 INFO:teuthology.orchestra.run.smithi137.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T00:46:49.044 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 46.0 MB in 2s (19.3 MB/s) 2024-09-12T00:46:49.155 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T00:46:49.247 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T00:46:49.252 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T00:46:49.295 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:49.624 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T00:46:49.653 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:46:49.732 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:50.178 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T00:46:50.207 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:46:50.245 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:50.498 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T00:46:50.526 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:46:50.564 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:50.783 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T00:46:50.800 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:46:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:51.221 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T00:46:51.249 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:46:51.291 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:46:52.917 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T00:46:52.946 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:46:52.987 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:46:53.431 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T00:46:53.459 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:46:53.500 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:46:54.292 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T00:46:54.322 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:46:54.362 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:46:54.722 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:46:55.851 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T00:46:55.876 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T00:46:55.892 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T00:46:56.250 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:56.427 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:56.795 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:46:56.869 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T00:46:56.938 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:46:57.030 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T00:46:57.062 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T00:46:57.093 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T00:46:57.118 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T00:46:57.245 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T00:46:57.405 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T00:46:57.532 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T00:46:57.625 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T00:46:57.676 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T00:46:57.728 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T00:46:57.753 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T00:46:57.769 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T00:46:57.859 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:57.986 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:58.104 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:46:58.179 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T00:46:58.272 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:46:58.399 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:46:59.466 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:46:59.550 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T00:46:59.844 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:47:00.325 INFO:teuthology.orchestra.run.smithi137.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:47:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:--2024-09-12 00:47:00-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:47:00.361 INFO:teuthology.orchestra.run.smithi137.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T00:47:00.369 INFO:teuthology.orchestra.run.smithi137.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T00:47:00.403 INFO:teuthology.orchestra.run.smithi137.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:47:00.403 INFO:teuthology.orchestra.run.smithi137.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:47:00.403 INFO:teuthology.orchestra.run.smithi137.stderr:--2024-09-12 00:47:00-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:47:00.404 INFO:teuthology.orchestra.run.smithi137.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-12T00:47:00.413 INFO:teuthology.orchestra.run.smithi137.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-12T00:47:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:47:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T004700Z&X-Amz-Expires=300&X-Amz-Signature=5d826639ec2a154de4ddb3259ce0026ed53ee1b9379250359dfd59a214615d3f&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:47:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:--2024-09-12 00:47:00-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T004700Z&X-Amz-Expires=300&X-Amz-Signature=5d826639ec2a154de4ddb3259ce0026ed53ee1b9379250359dfd59a214615d3f&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:47:00.494 INFO:teuthology.orchestra.run.smithi137.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.108.133, 185.199.109.133, ... 2024-09-12T00:47:00.507 INFO:teuthology.orchestra.run.smithi137.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-12T00:47:00.585 INFO:teuthology.orchestra.run.smithi137.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:47:00.585 INFO:teuthology.orchestra.run.smithi137.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:47:00.586 INFO:teuthology.orchestra.run.smithi137.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T00:47:00.586 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T00:47:00.597 INFO:teuthology.orchestra.run.smithi137.stderr: 0K .......... .......... .......... .......... .......... 0% 3.36M 27s 2024-09-12T00:47:00.607 INFO:teuthology.orchestra.run.smithi137.stderr: 50K .......... .......... .......... .......... .......... 0% 4.92M 23s 2024-09-12T00:47:00.609 INFO:teuthology.orchestra.run.smithi137.stderr: 100K .......... .......... .......... .......... .......... 0% 20.9M 17s 2024-09-12T00:47:00.611 INFO:teuthology.orchestra.run.smithi137.stderr: 150K .......... .......... .......... .......... .......... 0% 19.8M 14s 2024-09-12T00:47:00.619 INFO:teuthology.orchestra.run.smithi137.stderr: 200K .......... .......... .......... .......... .......... 0% 6.31M 14s 2024-09-12T00:47:00.621 INFO:teuthology.orchestra.run.smithi137.stderr: 250K .......... .......... .......... .......... .......... 0% 35.2M 12s 2024-09-12T00:47:00.623 INFO:teuthology.orchestra.run.smithi137.stderr: 300K .......... .......... .......... .......... .......... 0% 23.0M 11s 2024-09-12T00:47:00.625 INFO:teuthology.orchestra.run.smithi137.stderr: 350K .......... .......... .......... .......... .......... 0% 44.5M 10s 2024-09-12T00:47:00.626 INFO:teuthology.orchestra.run.smithi137.stderr: 400K .......... .......... .......... .......... .......... 0% 35.8M 9s 2024-09-12T00:47:00.630 INFO:teuthology.orchestra.run.smithi137.stderr: 450K .......... .......... .......... .......... .......... 0% 9.76M 9s 2024-09-12T00:47:00.632 INFO:teuthology.orchestra.run.smithi137.stderr: 500K .......... .......... .......... .......... .......... 0% 51.9M 8s 2024-09-12T00:47:00.633 INFO:teuthology.orchestra.run.smithi137.stderr: 550K .......... .......... .......... .......... .......... 0% 41.9M 8s 2024-09-12T00:47:00.639 INFO:teuthology.orchestra.run.smithi137.stderr: 600K .......... .......... .......... .......... .......... 0% 34.8M 7s 2024-09-12T00:47:00.639 INFO:teuthology.orchestra.run.smithi137.stderr: 650K .......... .......... .......... .......... .......... 0% 138M 7s 2024-09-12T00:47:00.639 INFO:teuthology.orchestra.run.smithi137.stderr: 700K .......... .......... .......... .......... .......... 0% 54.3M 6s 2024-09-12T00:47:00.639 INFO:teuthology.orchestra.run.smithi137.stderr: 750K .......... .......... .......... .......... .......... 0% 95.8M 6s 2024-09-12T00:47:00.639 INFO:teuthology.orchestra.run.smithi137.stderr: 800K .......... .......... .......... .......... .......... 0% 60.4M 6s 2024-09-12T00:47:00.639 INFO:teuthology.orchestra.run.smithi137.stderr: 850K .......... .......... .......... .......... .......... 0% 76.1M 6s 2024-09-12T00:47:00.639 INFO:teuthology.orchestra.run.smithi137.stderr: 900K .......... .......... .......... .......... .......... 1% 119M 5s 2024-09-12T00:47:01.873 INFO:teuthology.orchestra.run.smithi137.stderr: 950K .......... .......... .......... .......... .......... 1% 10.4M 5s 2024-09-12T00:47:01.873 INFO:teuthology.orchestra.run.smithi137.stderr: 1000K .......... .......... .......... .......... .......... 1% 81.9M 5s 2024-09-12T00:47:01.873 INFO:teuthology.orchestra.run.smithi137.stderr: 1050K .......... .......... .......... .......... .......... 1% 101M 5s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1100K .......... .......... .......... .......... .......... 1% 76.9M 5s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1150K .......... .......... .......... .......... .......... 1% 114M 5s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1200K .......... .......... .......... .......... .......... 1% 153M 5s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1250K .......... .......... .......... .......... .......... 1% 39.0M 4s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1300K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1350K .......... .......... .......... .......... .......... 1% 99.7M 4s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1400K .......... .......... .......... .......... .......... 1% 145M 4s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1450K .......... .......... .......... .......... .......... 1% 118M 4s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1500K .......... .......... .......... .......... .......... 1% 97.7M 4s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1550K .......... .......... .......... .......... .......... 1% 121M 4s 2024-09-12T00:47:01.874 INFO:teuthology.orchestra.run.smithi137.stderr: 1600K .......... .......... .......... .......... .......... 1% 121M 4s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 1650K .......... .......... .......... .......... .......... 1% 106M 4s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 1700K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 1750K .......... .......... .......... .......... .......... 1% 153M 3s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 1800K .......... .......... .......... .......... .......... 1% 145M 3s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 1850K .......... .......... .......... .......... .......... 2% 156M 3s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 1900K .......... .......... .......... .......... .......... 2% 15.4M 3s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 1950K .......... .......... .......... .......... .......... 2% 104M 3s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 2000K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 2050K .......... .......... .......... .......... .......... 2% 99.2M 3s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 2100K .......... .......... .......... .......... .......... 2% 81.7M 3s 2024-09-12T00:47:01.875 INFO:teuthology.orchestra.run.smithi137.stderr: 2150K .......... .......... .......... .......... .......... 2% 96.1M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2200K .......... .......... .......... .......... .......... 2% 117M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2250K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2300K .......... .......... .......... .......... .......... 2% 75.3M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2350K .......... .......... .......... .......... .......... 2% 88.2M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2400K .......... .......... .......... .......... .......... 2% 88.6M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2450K .......... .......... .......... .......... .......... 2% 101M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2500K .......... .......... .......... .......... .......... 2% 83.2M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2550K .......... .......... .......... .......... .......... 2% 75.0M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2600K .......... .......... .......... .......... .......... 2% 81.2M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2650K .......... .......... .......... .......... .......... 2% 69.1M 3s 2024-09-12T00:47:01.876 INFO:teuthology.orchestra.run.smithi137.stderr: 2700K .......... .......... .......... .......... .......... 2% 69.8M 3s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 2750K .......... .......... .......... .......... .......... 3% 151M 3s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 2800K .......... .......... .......... .......... .......... 3% 155M 3s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 2850K .......... .......... .......... .......... .......... 3% 154M 3s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 2900K .......... .......... .......... .......... .......... 3% 137M 2s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 2950K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 3000K .......... .......... .......... .......... .......... 3% 155M 2s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 3050K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 3100K .......... .......... .......... .......... .......... 3% 97.6M 2s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 3150K .......... .......... .......... .......... .......... 3% 93.3M 2s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 3200K .......... .......... .......... .......... .......... 3% 80.2M 2s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 3250K .......... .......... .......... .......... .......... 3% 98.7M 2s 2024-09-12T00:47:01.877 INFO:teuthology.orchestra.run.smithi137.stderr: 3300K .......... .......... .......... .......... .......... 3% 104M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3350K .......... .......... .......... .......... .......... 3% 85.7M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3400K .......... .......... .......... .......... .......... 3% 83.9M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3450K .......... .......... .......... .......... .......... 3% 59.5M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3500K .......... .......... .......... .......... .......... 3% 70.6M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3550K .......... .......... .......... .......... .......... 3% 67.1M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3600K .......... .......... .......... .......... .......... 3% 105M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3650K .......... .......... .......... .......... .......... 3% 116M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3700K .......... .......... .......... .......... .......... 4% 101M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3750K .......... .......... .......... .......... .......... 4% 105M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3800K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-12T00:47:01.878 INFO:teuthology.orchestra.run.smithi137.stderr: 3850K .......... .......... .......... .......... .......... 4% 86.4M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 3900K .......... .......... .......... .......... .......... 4% 120M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 3950K .......... .......... .......... .......... .......... 4% 95.7M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4000K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4050K .......... .......... .......... .......... .......... 4% 109M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4100K .......... .......... .......... .......... .......... 4% 135M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4150K .......... .......... .......... .......... .......... 4% 152M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4200K .......... .......... .......... .......... .......... 4% 92.6M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4250K .......... .......... .......... .......... .......... 4% 153M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4300K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4350K .......... .......... .......... .......... .......... 4% 96.8M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4400K .......... .......... .......... .......... .......... 4% 52.6M 2s 2024-09-12T00:47:01.879 INFO:teuthology.orchestra.run.smithi137.stderr: 4450K .......... .......... .......... .......... .......... 4% 95.8M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4500K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4550K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4600K .......... .......... .......... .......... .......... 5% 100M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4650K .......... .......... .......... .......... .......... 5% 93.3M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4700K .......... .......... .......... .......... .......... 5% 80.7M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4750K .......... .......... .......... .......... .......... 5% 150M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4800K .......... .......... .......... .......... .......... 5% 103M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4850K .......... .......... .......... .......... .......... 5% 126M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4900K .......... .......... .......... .......... .......... 5% 97.3M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 4950K .......... .......... .......... .......... .......... 5% 136M 2s 2024-09-12T00:47:01.880 INFO:teuthology.orchestra.run.smithi137.stderr: 5000K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5050K .......... .......... .......... .......... .......... 5% 93.9M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5100K .......... .......... .......... .......... .......... 5% 119M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5150K .......... .......... .......... .......... .......... 5% 119M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5200K .......... .......... .......... .......... .......... 5% 159M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5250K .......... .......... .......... .......... .......... 5% 116M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5300K .......... .......... .......... .......... .......... 5% 99.0M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5350K .......... .......... .......... .......... .......... 5% 120M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5400K .......... .......... .......... .......... .......... 5% 166M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5450K .......... .......... .......... .......... .......... 5% 97.3M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5500K .......... .......... .......... .......... .......... 5% 116M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5550K .......... .......... .......... .......... .......... 6% 172M 2s 2024-09-12T00:47:01.881 INFO:teuthology.orchestra.run.smithi137.stderr: 5600K .......... .......... .......... .......... .......... 6% 169M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 5650K .......... .......... .......... .......... .......... 6% 115M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 5700K .......... .......... .......... .......... .......... 6% 149M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 5750K .......... .......... .......... .......... .......... 6% 175M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 5800K .......... .......... .......... .......... .......... 6% 168M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 5850K .......... .......... .......... .......... .......... 6% 120M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 5900K .......... .......... .......... .......... .......... 6% 81.1M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 5950K .......... .......... .......... .......... .......... 6% 127M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 6000K .......... .......... .......... .......... .......... 6% 134M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 6050K .......... .......... .......... .......... .......... 6% 172M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 6100K .......... .......... .......... .......... .......... 6% 103M 2s 2024-09-12T00:47:01.882 INFO:teuthology.orchestra.run.smithi137.stderr: 6150K .......... .......... .......... .......... .......... 6% 120M 2s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6200K .......... .......... .......... .......... .......... 6% 144M 2s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6250K .......... .......... .......... .......... .......... 6% 141M 2s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6300K .......... .......... .......... .......... .......... 6% 145M 2s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6350K .......... .......... .......... .......... .......... 6% 99.2M 2s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6400K .......... .......... .......... .......... .......... 6% 190M 2s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6450K .......... .......... .......... .......... .......... 6% 147M 2s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6500K .......... .......... .......... .......... .......... 7% 159M 1s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6550K .......... .......... .......... .......... .......... 7% 149M 1s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6600K .......... .......... .......... .......... .......... 7% 132M 1s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6650K .......... .......... .......... .......... .......... 7% 107M 1s 2024-09-12T00:47:01.883 INFO:teuthology.orchestra.run.smithi137.stderr: 6700K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 6750K .......... .......... .......... .......... .......... 7% 144M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 6800K .......... .......... .......... .......... .......... 7% 192M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 6850K .......... .......... .......... .......... .......... 7% 191M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 6900K .......... .......... .......... .......... .......... 7% 114M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 6950K .......... .......... .......... .......... .......... 7% 180M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 7000K .......... .......... .......... .......... .......... 7% 131M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 7050K .......... .......... .......... .......... .......... 7% 205M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 7100K .......... .......... .......... .......... .......... 7% 167M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 7150K .......... .......... .......... .......... .......... 7% 209M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 7200K .......... .......... .......... .......... .......... 7% 115M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 7250K .......... .......... .......... .......... .......... 7% 199M 1s 2024-09-12T00:47:01.884 INFO:teuthology.orchestra.run.smithi137.stderr: 7300K .......... .......... .......... .......... .......... 7% 188M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7350K .......... .......... .......... .......... .......... 7% 201M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7400K .......... .......... .......... .......... .......... 8% 204M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7450K .......... .......... .......... .......... .......... 8% 99.0M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7500K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7550K .......... .......... .......... .......... .......... 8% 219M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7600K .......... .......... .......... .......... .......... 8% 121M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7650K .......... .......... .......... .......... .......... 8% 141M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7700K .......... .......... .......... .......... .......... 8% 115M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7750K .......... .......... .......... .......... .......... 8% 145M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7800K .......... .......... .......... .......... .......... 8% 193M 1s 2024-09-12T00:47:01.885 INFO:teuthology.orchestra.run.smithi137.stderr: 7850K .......... .......... .......... .......... .......... 8% 149M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 7900K .......... .......... .......... .......... .......... 8% 137M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 7950K .......... .......... .......... .......... .......... 8% 216M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8000K .......... .......... .......... .......... .......... 8% 161M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8050K .......... .......... .......... .......... .......... 8% 209M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8100K .......... .......... .......... .......... .......... 8% 142M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8150K .......... .......... .......... .......... .......... 8% 208M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8200K .......... .......... .......... .......... .......... 8% 222M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8250K .......... .......... .......... .......... .......... 8% 126M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8300K .......... .......... .......... .......... .......... 8% 112M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8350K .......... .......... .......... .......... .......... 9% 181M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8400K .......... .......... .......... .......... .......... 9% 180M 1s 2024-09-12T00:47:01.886 INFO:teuthology.orchestra.run.smithi137.stderr: 8450K .......... .......... .......... .......... .......... 9% 155M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8500K .......... .......... .......... .......... .......... 9% 205M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8550K .......... .......... .......... .......... .......... 9% 232M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8600K .......... .......... .......... .......... .......... 9% 145M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8650K .......... .......... .......... .......... .......... 9% 164M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8700K .......... .......... .......... .......... .......... 9% 116M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8750K .......... .......... .......... .......... .......... 9% 227M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8800K .......... .......... .......... .......... .......... 9% 229M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8850K .......... .......... .......... .......... .......... 9% 116M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8900K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 8950K .......... .......... .......... .......... .......... 9% 125M 1s 2024-09-12T00:47:01.887 INFO:teuthology.orchestra.run.smithi137.stderr: 9000K .......... .......... .......... .......... .......... 9% 202M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9050K .......... .......... .......... .......... .......... 9% 250M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9100K .......... .......... .......... .......... .......... 9% 205M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9150K .......... .......... .......... .......... .......... 9% 240M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9200K .......... .......... .......... .......... .......... 9% 135M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9250K .......... .......... .......... .......... .......... 10% 237M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9300K .......... .......... .......... .......... .......... 10% 222M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9350K .......... .......... .......... .......... .......... 10% 248M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9400K .......... .......... .......... .......... .......... 10% 245M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9450K .......... .......... .......... .......... .......... 10% 248M 1s 2024-09-12T00:47:01.888 INFO:teuthology.orchestra.run.smithi137.stderr: 9500K .......... .......... .......... .......... .......... 10% 152M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9550K .......... .......... .......... .......... .......... 10% 136M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9600K .......... .......... .......... .......... .......... 10% 207M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9650K .......... .......... .......... .......... .......... 10% 183M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9700K .......... .......... .......... .......... .......... 10% 159M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9750K .......... .......... .......... .......... .......... 10% 252M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9800K .......... .......... .......... .......... .......... 10% 234M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9850K .......... .......... .......... .......... .......... 10% 180M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9900K .......... .......... .......... .......... .......... 10% 166M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 9950K .......... .......... .......... .......... .......... 10% 259M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 10000K .......... .......... .......... .......... .......... 10% 137M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 10050K .......... .......... .......... .......... .......... 10% 212M 1s 2024-09-12T00:47:01.889 INFO:teuthology.orchestra.run.smithi137.stderr: 10100K .......... .......... .......... .......... .......... 10% 161M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10150K .......... .......... .......... .......... .......... 10% 251M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10200K .......... .......... .......... .......... .......... 11% 238M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10250K .......... .......... .......... .......... .......... 11% 151M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10300K .......... .......... .......... .......... .......... 11% 286M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10350K .......... .......... .......... .......... .......... 11% 284M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10400K .......... .......... .......... .......... .......... 11% 148M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10450K .......... .......... .......... .......... .......... 11% 217M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10500K .......... .......... .......... .......... .......... 11% 137M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10550K .......... .......... .......... .......... .......... 11% 216M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10600K .......... .......... .......... .......... .......... 11% 192M 1s 2024-09-12T00:47:01.890 INFO:teuthology.orchestra.run.smithi137.stderr: 10650K .......... .......... .......... .......... .......... 11% 236M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 10700K .......... .......... .......... .......... .......... 11% 237M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 10750K .......... .......... .......... .......... .......... 11% 171M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 10800K .......... .......... .......... .......... .......... 11% 194M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 10850K .......... .......... .......... .......... .......... 11% 267M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 10900K .......... .......... .......... .......... .......... 11% 266M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 10950K .......... .......... .......... .......... .......... 11% 182M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 11000K .......... .......... .......... .......... .......... 11% 172M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 11050K .......... .......... .......... .......... .......... 11% 178M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 11100K .......... .......... .......... .......... .......... 12% 164M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 11150K .......... .......... .......... .......... .......... 12% 216M 1s 2024-09-12T00:47:01.891 INFO:teuthology.orchestra.run.smithi137.stderr: 11200K .......... .......... .......... .......... .......... 12% 279M 1s 2024-09-12T00:47:01.892 INFO:teuthology.orchestra.run.smithi137.stderr: 11250K .......... .......... .......... .......... .......... 12% 200M 1s 2024-09-12T00:47:01.892 INFO:teuthology.orchestra.run.smithi137.stderr: 11300K .......... .......... .......... .......... .......... 12% 134M 1s 2024-09-12T00:47:01.892 INFO:teuthology.orchestra.run.smithi137.stderr: 11350K .......... .......... .......... .......... .......... 12% 248M 1s 2024-09-12T00:47:01.892 INFO:teuthology.orchestra.run.smithi137.stderr: 11400K .......... .......... .......... .......... .......... 12% 185M 1s 2024-09-12T00:47:01.892 INFO:teuthology.orchestra.run.smithi137.stderr: 11450K .......... .......... .......... .......... .......... 12% 235M 1s 2024-09-12T00:47:01.892 INFO:teuthology.orchestra.run.smithi137.stderr: 11500K .......... .......... .......... .......... .......... 12% 216M 1s 2024-09-12T00:47:01.892 INFO:teuthology.orchestra.run.smithi137.stderr: 11550K .......... .......... .......... .......... .......... 12% 235M 1s 2024-09-12T00:47:01.892 INFO:teuthology.orchestra.run.smithi137.stderr: 11600K .......... .......... .......... .......... .......... 12% 278M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 11650K .......... .......... .......... .......... .......... 12% 273M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 11700K .......... .......... .......... .......... .......... 12% 201M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 11750K .......... .......... .......... .......... .......... 12% 170M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 11800K .......... .......... .......... .......... .......... 12% 168M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 11850K .......... .......... .......... .......... .......... 12% 259M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 11900K .......... .......... .......... .......... .......... 12% 273M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 11950K .......... .......... .......... .......... .......... 12% 239M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 12000K .......... .......... .......... .......... .......... 12% 280M 1s 2024-09-12T00:47:01.893 INFO:teuthology.orchestra.run.smithi137.stderr: 12050K .......... .......... .......... .......... .......... 13% 202M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12100K .......... .......... .......... .......... .......... 13% 175M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12150K .......... .......... .......... .......... .......... 13% 148M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12200K .......... .......... .......... .......... .......... 13% 198M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12250K .......... .......... .......... .......... .......... 13% 221M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12300K .......... .......... .......... .......... .......... 13% 215M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12350K .......... .......... .......... .......... .......... 13% 251M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12400K .......... .......... .......... .......... .......... 13% 143M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12450K .......... .......... .......... .......... .......... 13% 237M 1s 2024-09-12T00:47:01.894 INFO:teuthology.orchestra.run.smithi137.stderr: 12500K .......... .......... .......... .......... .......... 13% 218M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12550K .......... .......... .......... .......... .......... 13% 266M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12600K .......... .......... .......... .......... .......... 13% 311M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12650K .......... .......... .......... .......... .......... 13% 243M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12700K .......... .......... .......... .......... .......... 13% 202M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12750K .......... .......... .......... .......... .......... 13% 249M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12800K .......... .......... .......... .......... .......... 13% 269M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12850K .......... .......... .......... .......... .......... 13% 220M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12900K .......... .......... .......... .......... .......... 13% 230M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 12950K .......... .......... .......... .......... .......... 13% 238M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 13000K .......... .......... .......... .......... .......... 14% 217M 1s 2024-09-12T00:47:01.895 INFO:teuthology.orchestra.run.smithi137.stderr: 13050K .......... .......... .......... .......... .......... 14% 195M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13100K .......... .......... .......... .......... .......... 14% 275M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13150K .......... .......... .......... .......... .......... 14% 252M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13200K .......... .......... .......... .......... .......... 14% 312M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13250K .......... .......... .......... .......... .......... 14% 328M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13300K .......... .......... .......... .......... .......... 14% 218M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13350K .......... .......... .......... .......... .......... 14% 195M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13400K .......... .......... .......... .......... .......... 14% 225M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13450K .......... .......... .......... .......... .......... 14% 313M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13500K .......... .......... .......... .......... .......... 14% 320M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13550K .......... .......... .......... .......... .......... 14% 266M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13600K .......... .......... .......... .......... .......... 14% 192M 1s 2024-09-12T00:47:01.896 INFO:teuthology.orchestra.run.smithi137.stderr: 13650K .......... .......... .......... .......... .......... 14% 302M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 13700K .......... .......... .......... .......... .......... 14% 195M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 13750K .......... .......... .......... .......... .......... 14% 258M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 13800K .......... .......... .......... .......... .......... 14% 322M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 13850K .......... .......... .......... .......... .......... 14% 208M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 13900K .......... .......... .......... .......... .......... 15% 119M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 13950K .......... .......... .......... .......... .......... 15% 118M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 14000K .......... .......... .......... .......... .......... 15% 169M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 14050K .......... .......... .......... .......... .......... 15% 152M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 14100K .......... .......... .......... .......... .......... 15% 95.1M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 14150K .......... .......... .......... .......... .......... 15% 100M 1s 2024-09-12T00:47:01.897 INFO:teuthology.orchestra.run.smithi137.stderr: 14200K .......... .......... .......... .......... .......... 15% 188M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14250K .......... .......... .......... .......... .......... 15% 320M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14300K .......... .......... .......... .......... .......... 15% 333M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14350K .......... .......... .......... .......... .......... 15% 173M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14400K .......... .......... .......... .......... .......... 15% 254M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14450K .......... .......... .......... .......... .......... 15% 311M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14500K .......... .......... .......... .......... .......... 15% 236M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14550K .......... .......... .......... .......... .......... 15% 262M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14600K .......... .......... .......... .......... .......... 15% 328M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14650K .......... .......... .......... .......... .......... 15% 266M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14700K .......... .......... .......... .......... .......... 15% 189M 1s 2024-09-12T00:47:01.898 INFO:teuthology.orchestra.run.smithi137.stderr: 14750K .......... .......... .......... .......... .......... 15% 168M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 14800K .......... .......... .......... .......... .......... 15% 242M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 14850K .......... .......... .......... .......... .......... 16% 162M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 14900K .......... .......... .......... .......... .......... 16% 214M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 14950K .......... .......... .......... .......... .......... 16% 227M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 15000K .......... .......... .......... .......... .......... 16% 329M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 15050K .......... .......... .......... .......... .......... 16% 154M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 15100K .......... .......... .......... .......... .......... 16% 139M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 15150K .......... .......... .......... .......... .......... 16% 191M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 15200K .......... .......... .......... .......... .......... 16% 173M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 15250K .......... .......... .......... .......... .......... 16% 186M 1s 2024-09-12T00:47:01.899 INFO:teuthology.orchestra.run.smithi137.stderr: 15300K .......... .......... .......... .......... .......... 16% 201M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15350K .......... .......... .......... .......... .......... 16% 239M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15400K .......... .......... .......... .......... .......... 16% 275M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15450K .......... .......... .......... .......... .......... 16% 198M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15500K .......... .......... .......... .......... .......... 16% 193M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15550K .......... .......... .......... .......... .......... 16% 147M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15600K .......... .......... .......... .......... .......... 16% 200M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15650K .......... .......... .......... .......... .......... 16% 167M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15700K .......... .......... .......... .......... .......... 16% 167M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15750K .......... .......... .......... .......... .......... 17% 242M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15800K .......... .......... .......... .......... .......... 17% 273M 1s 2024-09-12T00:47:01.900 INFO:teuthology.orchestra.run.smithi137.stderr: 15850K .......... .......... .......... .......... .......... 17% 175M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 15900K .......... .......... .......... .......... .......... 17% 176M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 15950K .......... .......... .......... .......... .......... 17% 172M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16000K .......... .......... .......... .......... .......... 17% 271M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16050K .......... .......... .......... .......... .......... 17% 156M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16100K .......... .......... .......... .......... .......... 17% 167M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16150K .......... .......... .......... .......... .......... 17% 189M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16200K .......... .......... .......... .......... .......... 17% 125M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16250K .......... .......... .......... .......... .......... 17% 52.9M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16300K .......... .......... .......... .......... .......... 17% 143M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16350K .......... .......... .......... .......... .......... 17% 159M 1s 2024-09-12T00:47:01.901 INFO:teuthology.orchestra.run.smithi137.stderr: 16400K .......... .......... .......... .......... .......... 17% 268M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16450K .......... .......... .......... .......... .......... 17% 257M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16500K .......... .......... .......... .......... .......... 17% 136M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16550K .......... .......... .......... .......... .......... 17% 130M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16600K .......... .......... .......... .......... .......... 17% 265M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16650K .......... .......... .......... .......... .......... 17% 272M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16700K .......... .......... .......... .......... .......... 18% 160M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16750K .......... .......... .......... .......... .......... 18% 156M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16800K .......... .......... .......... .......... .......... 18% 259M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16850K .......... .......... .......... .......... .......... 18% 169M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16900K .......... .......... .......... .......... .......... 18% 249M 1s 2024-09-12T00:47:01.902 INFO:teuthology.orchestra.run.smithi137.stderr: 16950K .......... .......... .......... .......... .......... 18% 133M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17000K .......... .......... .......... .......... .......... 18% 175M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17050K .......... .......... .......... .......... .......... 18% 155M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17100K .......... .......... .......... .......... .......... 18% 234M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17150K .......... .......... .......... .......... .......... 18% 149M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17200K .......... .......... .......... .......... .......... 18% 142M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17250K .......... .......... .......... .......... .......... 18% 173M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17300K .......... .......... .......... .......... .......... 18% 235M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17350K .......... .......... .......... .......... .......... 18% 138M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17400K .......... .......... .......... .......... .......... 18% 140M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17450K .......... .......... .......... .......... .......... 18% 172M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17500K .......... .......... .......... .......... .......... 18% 178M 1s 2024-09-12T00:47:01.903 INFO:teuthology.orchestra.run.smithi137.stderr: 17550K .......... .......... .......... .......... .......... 18% 171M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 17600K .......... .......... .......... .......... .......... 18% 157M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 17650K .......... .......... .......... .......... .......... 19% 235M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 17700K .......... .......... .......... .......... .......... 19% 229M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 17750K .......... .......... .......... .......... .......... 19% 191M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 17800K .......... .......... .......... .......... .......... 19% 128M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 17850K .......... .......... .......... .......... .......... 19% 150M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 17900K .......... .......... .......... .......... .......... 19% 155M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 17950K .......... .......... .......... .......... .......... 19% 123M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 18000K .......... .......... .......... .......... .......... 19% 229M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 18050K .......... .......... .......... .......... .......... 19% 237M 1s 2024-09-12T00:47:01.904 INFO:teuthology.orchestra.run.smithi137.stderr: 18100K .......... .......... .......... .......... .......... 19% 199M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18150K .......... .......... .......... .......... .......... 19% 149M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18200K .......... .......... .......... .......... .......... 19% 163M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18250K .......... .......... .......... .......... .......... 19% 175M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18300K .......... .......... .......... .......... .......... 19% 133M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18350K .......... .......... .......... .......... .......... 19% 125M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18400K .......... .......... .......... .......... .......... 19% 196M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18450K .......... .......... .......... .......... .......... 19% 168M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18500K .......... .......... .......... .......... .......... 19% 227M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18550K .......... .......... .......... .......... .......... 20% 187M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18600K .......... .......... .......... .......... .......... 20% 162M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18650K .......... .......... .......... .......... .......... 20% 178M 1s 2024-09-12T00:47:01.905 INFO:teuthology.orchestra.run.smithi137.stderr: 18700K .......... .......... .......... .......... .......... 20% 224M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 18750K .......... .......... .......... .......... .......... 20% 151M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 18800K .......... .......... .......... .......... .......... 20% 167M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 18850K .......... .......... .......... .......... .......... 20% 163M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 18900K .......... .......... .......... .......... .......... 20% 240M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 18950K .......... .......... .......... .......... .......... 20% 163M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 19000K .......... .......... .......... .......... .......... 20% 225M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 19050K .......... .......... .......... .......... .......... 20% 154M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 19100K .......... .......... .......... .......... .......... 20% 226M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 19150K .......... .......... .......... .......... .......... 20% 139M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 19200K .......... .......... .......... .......... .......... 20% 216M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 19250K .......... .......... .......... .......... .......... 20% 240M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 19300K .......... .......... .......... .......... .......... 20% 263M 1s 2024-09-12T00:47:01.906 INFO:teuthology.orchestra.run.smithi137.stderr: 19350K .......... .......... .......... .......... .......... 20% 234M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19400K .......... .......... .......... .......... .......... 20% 154M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19450K .......... .......... .......... .......... .......... 20% 150M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19500K .......... .......... .......... .......... .......... 21% 221M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19550K .......... .......... .......... .......... .......... 21% 180M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19600K .......... .......... .......... .......... .......... 21% 161M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19650K .......... .......... .......... .......... .......... 21% 158M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19700K .......... .......... .......... .......... .......... 21% 172M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19750K .......... .......... .......... .......... .......... 21% 170M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19800K .......... .......... .......... .......... .......... 21% 204M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19850K .......... .......... .......... .......... .......... 21% 214M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19900K .......... .......... .......... .......... .......... 21% 190M 1s 2024-09-12T00:47:01.907 INFO:teuthology.orchestra.run.smithi137.stderr: 19950K .......... .......... .......... .......... .......... 21% 192M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20000K .......... .......... .......... .......... .......... 21% 208M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20050K .......... .......... .......... .......... .......... 21% 212M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20100K .......... .......... .......... .......... .......... 21% 241M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20150K .......... .......... .......... .......... .......... 21% 158M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20200K .......... .......... .......... .......... .......... 21% 220M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20250K .......... .......... .......... .......... .......... 21% 169M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20300K .......... .......... .......... .......... .......... 21% 272M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20350K .......... .......... .......... .......... .......... 21% 159M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20400K .......... .......... .......... .......... .......... 22% 201M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20450K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-12T00:47:01.908 INFO:teuthology.orchestra.run.smithi137.stderr: 20500K .......... .......... .......... .......... .......... 22% 291M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20550K .......... .......... .......... .......... .......... 22% 303M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20600K .......... .......... .......... .......... .......... 22% 142M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20650K .......... .......... .......... .......... .......... 22% 191M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20700K .......... .......... .......... .......... .......... 22% 119M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20750K .......... .......... .......... .......... .......... 22% 183M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20800K .......... .......... .......... .......... .......... 22% 269M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20850K .......... .......... .......... .......... .......... 22% 196M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20900K .......... .......... .......... .......... .......... 22% 158M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 20950K .......... .......... .......... .......... .......... 22% 190M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 21000K .......... .......... .......... .......... .......... 22% 211M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 21050K .......... .......... .......... .......... .......... 22% 266M 1s 2024-09-12T00:47:01.909 INFO:teuthology.orchestra.run.smithi137.stderr: 21100K .......... .......... .......... .......... .......... 22% 58.2M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21150K .......... .......... .......... .......... .......... 22% 230M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21200K .......... .......... .......... .......... .......... 22% 200M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21250K .......... .......... .......... .......... .......... 22% 160M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21300K .......... .......... .......... .......... .......... 22% 181M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21350K .......... .......... .......... .......... .......... 23% 277M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21400K .......... .......... .......... .......... .......... 23% 200M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21450K .......... .......... .......... .......... .......... 23% 259M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21500K .......... .......... .......... .......... .......... 23% 127M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21550K .......... .......... .......... .......... .......... 23% 251M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21600K .......... .......... .......... .......... .......... 23% 191M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21650K .......... .......... .......... .......... .......... 23% 210M 1s 2024-09-12T00:47:01.910 INFO:teuthology.orchestra.run.smithi137.stderr: 21700K .......... .......... .......... .......... .......... 23% 259M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 21750K .......... .......... .......... .......... .......... 23% 105M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 21800K .......... .......... .......... .......... .......... 23% 205M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 21850K .......... .......... .......... .......... .......... 23% 179M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 21900K .......... .......... .......... .......... .......... 23% 237M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 21950K .......... .......... .......... .......... .......... 23% 287M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 22000K .......... .......... .......... .......... .......... 23% 85.5M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 22050K .......... .......... .......... .......... .......... 23% 182M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 22100K .......... .......... .......... .......... .......... 23% 154M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 22150K .......... .......... .......... .......... .......... 23% 173M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 22200K .......... .......... .......... .......... .......... 23% 241M 1s 2024-09-12T00:47:01.911 INFO:teuthology.orchestra.run.smithi137.stderr: 22250K .......... .......... .......... .......... .......... 24% 214M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22300K .......... .......... .......... .......... .......... 24% 191M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22350K .......... .......... .......... .......... .......... 24% 187M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22400K .......... .......... .......... .......... .......... 24% 219M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22450K .......... .......... .......... .......... .......... 24% 213M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22500K .......... .......... .......... .......... .......... 24% 202M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22550K .......... .......... .......... .......... .......... 24% 215M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22600K .......... .......... .......... .......... .......... 24% 223M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22650K .......... .......... .......... .......... .......... 24% 246M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22700K .......... .......... .......... .......... .......... 24% 215M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22750K .......... .......... .......... .......... .......... 24% 198M 1s 2024-09-12T00:47:01.912 INFO:teuthology.orchestra.run.smithi137.stderr: 22800K .......... .......... .......... .......... .......... 24% 208M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 22850K .......... .......... .......... .......... .......... 24% 203M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 22900K .......... .......... .......... .......... .......... 24% 115M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 22950K .......... .......... .......... .......... .......... 24% 145M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23000K .......... .......... .......... .......... .......... 24% 119M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23050K .......... .......... .......... .......... .......... 24% 181M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23100K .......... .......... .......... .......... .......... 24% 158M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23150K .......... .......... .......... .......... .......... 24% 270M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23200K .......... .......... .......... .......... .......... 25% 199M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23250K .......... .......... .......... .......... .......... 25% 185M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23300K .......... .......... .......... .......... .......... 25% 244M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23350K .......... .......... .......... .......... .......... 25% 157M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23400K .......... .......... .......... .......... .......... 25% 264M 1s 2024-09-12T00:47:01.913 INFO:teuthology.orchestra.run.smithi137.stderr: 23450K .......... .......... .......... .......... .......... 25% 183M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23500K .......... .......... .......... .......... .......... 25% 164M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23550K .......... .......... .......... .......... .......... 25% 171M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23600K .......... .......... .......... .......... .......... 25% 186M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23650K .......... .......... .......... .......... .......... 25% 282M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23700K .......... .......... .......... .......... .......... 25% 179M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23750K .......... .......... .......... .......... .......... 25% 73.3M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23800K .......... .......... .......... .......... .......... 25% 192M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23850K .......... .......... .......... .......... .......... 25% 282M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23900K .......... .......... .......... .......... .......... 25% 156M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 23950K .......... .......... .......... .......... .......... 25% 117M 1s 2024-09-12T00:47:01.914 INFO:teuthology.orchestra.run.smithi137.stderr: 24000K .......... .......... .......... .......... .......... 25% 193M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24050K .......... .......... .......... .......... .......... 25% 282M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24100K .......... .......... .......... .......... .......... 25% 84.4M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24150K .......... .......... .......... .......... .......... 26% 189M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24200K .......... .......... .......... .......... .......... 26% 201M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24250K .......... .......... .......... .......... .......... 26% 217M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24300K .......... .......... .......... .......... .......... 26% 184M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24350K .......... .......... .......... .......... .......... 26% 95.1M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24400K .......... .......... .......... .......... .......... 26% 189M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24450K .......... .......... .......... .......... .......... 26% 280M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24500K .......... .......... .......... .......... .......... 26% 200M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24550K .......... .......... .......... .......... .......... 26% 206M 1s 2024-09-12T00:47:01.915 INFO:teuthology.orchestra.run.smithi137.stderr: 24600K .......... .......... .......... .......... .......... 26% 256M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 24650K .......... .......... .......... .......... .......... 26% 217M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 24700K .......... .......... .......... .......... .......... 26% 96.6M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 24750K .......... .......... .......... .......... .......... 26% 168M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 24800K .......... .......... .......... .......... .......... 26% 197M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 24850K .......... .......... .......... .......... .......... 26% 274M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 24900K .......... .......... .......... .......... .......... 26% 124M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 24950K .......... .......... .......... .......... .......... 26% 166M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 25000K .......... .......... .......... .......... .......... 26% 225M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 25050K .......... .......... .......... .......... .......... 27% 186M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 25100K .......... .......... .......... .......... .......... 27% 185M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 25150K .......... .......... .......... .......... .......... 27% 193M 1s 2024-09-12T00:47:01.916 INFO:teuthology.orchestra.run.smithi137.stderr: 25200K .......... .......... .......... .......... .......... 27% 269M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25250K .......... .......... .......... .......... .......... 27% 257M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25300K .......... .......... .......... .......... .......... 27% 162M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25350K .......... .......... .......... .......... .......... 27% 201M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25400K .......... .......... .......... .......... .......... 27% 211M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25450K .......... .......... .......... .......... .......... 27% 263M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25500K .......... .......... .......... .......... .......... 27% 229M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25550K .......... .......... .......... .......... .......... 27% 168M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25600K .......... .......... .......... .......... .......... 27% 206M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25650K .......... .......... .......... .......... .......... 27% 255M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25700K .......... .......... .......... .......... .......... 27% 152M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25750K .......... .......... .......... .......... .......... 27% 220M 1s 2024-09-12T00:47:01.917 INFO:teuthology.orchestra.run.smithi137.stderr: 25800K .......... .......... .......... .......... .......... 27% 197M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 25850K .......... .......... .......... .......... .......... 27% 263M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 25900K .......... .......... .......... .......... .......... 27% 186M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 25950K .......... .......... .......... .......... .......... 27% 282M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26000K .......... .......... .......... .......... .......... 28% 147M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26050K .......... .......... .......... .......... .......... 28% 208M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26100K .......... .......... .......... .......... .......... 28% 212M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26150K .......... .......... .......... .......... .......... 28% 186M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26200K .......... .......... .......... .......... .......... 28% 115M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26250K .......... .......... .......... .......... .......... 28% 286M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26300K .......... .......... .......... .......... .......... 28% 120M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26350K .......... .......... .......... .......... .......... 28% 201M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26400K .......... .......... .......... .......... .......... 28% 223M 1s 2024-09-12T00:47:01.918 INFO:teuthology.orchestra.run.smithi137.stderr: 26450K .......... .......... .......... .......... .......... 28% 275M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26500K .......... .......... .......... .......... .......... 28% 127M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26550K .......... .......... .......... .......... .......... 28% 200M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26600K .......... .......... .......... .......... .......... 28% 276M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26650K .......... .......... .......... .......... .......... 28% 103M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26700K .......... .......... .......... .......... .......... 28% 175M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26750K .......... .......... .......... .......... .......... 28% 71.3M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26800K .......... .......... .......... .......... .......... 28% 116M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26850K .......... .......... .......... .......... .......... 28% 190M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26900K .......... .......... .......... .......... .......... 29% 235M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 26950K .......... .......... .......... .......... .......... 29% 186M 1s 2024-09-12T00:47:01.919 INFO:teuthology.orchestra.run.smithi137.stderr: 27000K .......... .......... .......... .......... .......... 29% 78.4M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27050K .......... .......... .......... .......... .......... 29% 165M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27100K .......... .......... .......... .......... .......... 29% 171M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27150K .......... .......... .......... .......... .......... 29% 211M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27200K .......... .......... .......... .......... .......... 29% 241M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27250K .......... .......... .......... .......... .......... 29% 232M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27300K .......... .......... .......... .......... .......... 29% 191M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27350K .......... .......... .......... .......... .......... 29% 264M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27400K .......... .......... .......... .......... .......... 29% 99.9M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27450K .......... .......... .......... .......... .......... 29% 215M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27500K .......... .......... .......... .......... .......... 29% 181M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27550K .......... .......... .......... .......... .......... 29% 278M 1s 2024-09-12T00:47:01.920 INFO:teuthology.orchestra.run.smithi137.stderr: 27600K .......... .......... .......... .......... .......... 29% 127M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 27650K .......... .......... .......... .......... .......... 29% 234M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 27700K .......... .......... .......... .......... .......... 29% 202M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 27750K .......... .......... .......... .......... .......... 29% 289M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 27800K .......... .......... .......... .......... .......... 29% 90.5M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 27850K .......... .......... .......... .......... .......... 30% 174M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 27900K .......... .......... .......... .......... .......... 30% 169M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 27950K .......... .......... .......... .......... .......... 30% 230M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 28000K .......... .......... .......... .......... .......... 30% 224M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 28050K .......... .......... .......... .......... .......... 30% 221M 1s 2024-09-12T00:47:01.921 INFO:teuthology.orchestra.run.smithi137.stderr: 28100K .......... .......... .......... .......... .......... 30% 239M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28150K .......... .......... .......... .......... .......... 30% 222M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28200K .......... .......... .......... .......... .......... 30% 215M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28250K .......... .......... .......... .......... .......... 30% 209M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28300K .......... .......... .......... .......... .......... 30% 239M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28350K .......... .......... .......... .......... .......... 30% 95.3M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28400K .......... .......... .......... .......... .......... 30% 190M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28450K .......... .......... .......... .......... .......... 30% 215M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28500K .......... .......... .......... .......... .......... 30% 208M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28550K .......... .......... .......... .......... .......... 30% 208M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28600K .......... .......... .......... .......... .......... 30% 214M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28650K .......... .......... .......... .......... .......... 30% 273M 1s 2024-09-12T00:47:01.922 INFO:teuthology.orchestra.run.smithi137.stderr: 28700K .......... .......... .......... .......... .......... 30% 158M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 28750K .......... .......... .......... .......... .......... 31% 79.0M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 28800K .......... .......... .......... .......... .......... 31% 268M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 28850K .......... .......... .......... .......... .......... 31% 159M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 28900K .......... .......... .......... .......... .......... 31% 180M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 28950K .......... .......... .......... .......... .......... 31% 222M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 29000K .......... .......... .......... .......... .......... 31% 298M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 29050K .......... .......... .......... .......... .......... 31% 202M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 29100K .......... .......... .......... .......... .......... 31% 174M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 29150K .......... .......... .......... .......... .......... 31% 292M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 29200K .......... .......... .......... .......... .......... 31% 302M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 29250K .......... .......... .......... .......... .......... 31% 69.8M 1s 2024-09-12T00:47:01.923 INFO:teuthology.orchestra.run.smithi137.stderr: 29300K .......... .......... .......... .......... .......... 31% 182M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29350K .......... .......... .......... .......... .......... 31% 252M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29400K .......... .......... .......... .......... .......... 31% 301M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29450K .......... .......... .......... .......... .......... 31% 138M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29500K .......... .......... .......... .......... .......... 31% 185M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29550K .......... .......... .......... .......... .......... 31% 193M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29600K .......... .......... .......... .......... .......... 31% 236M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29650K .......... .......... .......... .......... .......... 31% 233M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29700K .......... .......... .......... .......... .......... 32% 259M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29750K .......... .......... .......... .......... .......... 32% 120M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29800K .......... .......... .......... .......... .......... 32% 151M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29850K .......... .......... .......... .......... .......... 32% 203M 1s 2024-09-12T00:47:01.924 INFO:teuthology.orchestra.run.smithi137.stderr: 29900K .......... .......... .......... .......... .......... 32% 156M 1s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 29950K .......... .......... .......... .......... .......... 32% 227M 1s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30000K .......... .......... .......... .......... .......... 32% 212M 1s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30050K .......... .......... .......... .......... .......... 32% 203M 1s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30100K .......... .......... .......... .......... .......... 32% 257M 0s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30150K .......... .......... .......... .......... .......... 32% 129M 0s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30200K .......... .......... .......... .......... .......... 32% 185M 0s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30250K .......... .......... .......... .......... .......... 32% 205M 0s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30300K .......... .......... .......... .......... .......... 32% 122M 0s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30350K .......... .......... .......... .......... .......... 32% 172M 0s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30400K .......... .......... .......... .......... .......... 32% 264M 0s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30450K .......... .......... .......... .......... .......... 32% 215M 0s 2024-09-12T00:47:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 30500K .......... .......... .......... .......... .......... 32% 93.4M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30550K .......... .......... .......... .......... .......... 32% 186M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30600K .......... .......... .......... .......... .......... 32% 304M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30650K .......... .......... .......... .......... .......... 33% 130M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30700K .......... .......... .......... .......... .......... 33% 216M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30750K .......... .......... .......... .......... .......... 33% 172M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30800K .......... .......... .......... .......... .......... 33% 212M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30850K .......... .......... .......... .......... .......... 33% 221M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30900K .......... .......... .......... .......... .......... 33% 100M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 30950K .......... .......... .......... .......... .......... 33% 162M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 31000K .......... .......... .......... .......... .......... 33% 248M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 31050K .......... .......... .......... .......... .......... 33% 283M 0s 2024-09-12T00:47:01.926 INFO:teuthology.orchestra.run.smithi137.stderr: 31100K .......... .......... .......... .......... .......... 33% 226M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31150K .......... .......... .......... .......... .......... 33% 77.3M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31200K .......... .......... .......... .......... .......... 33% 215M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31250K .......... .......... .......... .......... .......... 33% 307M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31300K .......... .......... .......... .......... .......... 33% 157M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31350K .......... .......... .......... .......... .......... 33% 179M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31400K .......... .......... .......... .......... .......... 33% 146M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31450K .......... .......... .......... .......... .......... 33% 212M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31500K .......... .......... .......... .......... .......... 33% 223M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31550K .......... .......... .......... .......... .......... 34% 117M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31600K .......... .......... .......... .......... .......... 34% 186M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31650K .......... .......... .......... .......... .......... 34% 228M 0s 2024-09-12T00:47:01.927 INFO:teuthology.orchestra.run.smithi137.stderr: 31700K .......... .......... .......... .......... .......... 34% 243M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 31750K .......... .......... .......... .......... .......... 34% 271M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 31800K .......... .......... .......... .......... .......... 34% 82.3M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 31850K .......... .......... .......... .......... .......... 34% 237M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 31900K .......... .......... .......... .......... .......... 34% 166M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 31950K .......... .......... .......... .......... .......... 34% 157M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 32000K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 32050K .......... .......... .......... .......... .......... 34% 189M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 32100K .......... .......... .......... .......... .......... 34% 217M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 32150K .......... .......... .......... .......... .......... 34% 64.0M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 32200K .......... .......... .......... .......... .......... 34% 96.0M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 32250K .......... .......... .......... .......... .......... 34% 250M 0s 2024-09-12T00:47:01.928 INFO:teuthology.orchestra.run.smithi137.stderr: 32300K .......... .......... .......... .......... .......... 34% 208M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32350K .......... .......... .......... .......... .......... 34% 192M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32400K .......... .......... .......... .......... .......... 34% 232M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32450K .......... .......... .......... .......... .......... 34% 209M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32500K .......... .......... .......... .......... .......... 35% 185M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32550K .......... .......... .......... .......... .......... 35% 200M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32600K .......... .......... .......... .......... .......... 35% 228M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32650K .......... .......... .......... .......... .......... 35% 246M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32700K .......... .......... .......... .......... .......... 35% 236M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32750K .......... .......... .......... .......... .......... 35% 200M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32800K .......... .......... .......... .......... .......... 35% 299M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32850K .......... .......... .......... .......... .......... 35% 224M 0s 2024-09-12T00:47:01.929 INFO:teuthology.orchestra.run.smithi137.stderr: 32900K .......... .......... .......... .......... .......... 35% 189M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 32950K .......... .......... .......... .......... .......... 35% 213M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33000K .......... .......... .......... .......... .......... 35% 187M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33050K .......... .......... .......... .......... .......... 35% 292M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33100K .......... .......... .......... .......... .......... 35% 246M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33150K .......... .......... .......... .......... .......... 35% 217M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33200K .......... .......... .......... .......... .......... 35% 317M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33250K .......... .......... .......... .......... .......... 35% 86.2M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33300K .......... .......... .......... .......... .......... 35% 200M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33350K .......... .......... .......... .......... .......... 35% 178M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33400K .......... .......... .......... .......... .......... 36% 273M 0s 2024-09-12T00:47:01.930 INFO:teuthology.orchestra.run.smithi137.stderr: 33450K .......... .......... .......... .......... .......... 36% 179M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33500K .......... .......... .......... .......... .......... 36% 309M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33550K .......... .......... .......... .......... .......... 36% 266M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33600K .......... .......... .......... .......... .......... 36% 183M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33650K .......... .......... .......... .......... .......... 36% 182M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33700K .......... .......... .......... .......... .......... 36% 252M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33750K .......... .......... .......... .......... .......... 36% 233M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33800K .......... .......... .......... .......... .......... 36% 223M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33850K .......... .......... .......... .......... .......... 36% 309M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33900K .......... .......... .......... .......... .......... 36% 212M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 33950K .......... .......... .......... .......... .......... 36% 189M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 34000K .......... .......... .......... .......... .......... 36% 99.3M 0s 2024-09-12T00:47:01.931 INFO:teuthology.orchestra.run.smithi137.stderr: 34050K .......... .......... .......... .......... .......... 36% 173M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34100K .......... .......... .......... .......... .......... 36% 298M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34150K .......... .......... .......... .......... .......... 36% 49.5M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34200K .......... .......... .......... .......... .......... 36% 190M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34250K .......... .......... .......... .......... .......... 36% 227M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34300K .......... .......... .......... .......... .......... 36% 302M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34350K .......... .......... .......... .......... .......... 37% 124M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34400K .......... .......... .......... .......... .......... 37% 271M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34450K .......... .......... .......... .......... .......... 37% 78.1M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34500K .......... .......... .......... .......... .......... 37% 209M 0s 2024-09-12T00:47:01.932 INFO:teuthology.orchestra.run.smithi137.stderr: 34550K .......... .......... .......... .......... .......... 37% 194M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 34600K .......... .......... .......... .......... .......... 37% 208M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 34650K .......... .......... .......... .......... .......... 37% 314M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 34700K .......... .......... .......... .......... .......... 37% 203M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 34750K .......... .......... .......... .......... .......... 37% 155M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 34800K .......... .......... .......... .......... .......... 37% 315M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 34850K .......... .......... .......... .......... .......... 37% 65.2M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 34900K .......... .......... .......... .......... .......... 37% 192M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 34950K .......... .......... .......... .......... .......... 37% 178M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 35000K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 35050K .......... .......... .......... .......... .......... 37% 294M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 35100K .......... .......... .......... .......... .......... 37% 166M 0s 2024-09-12T00:47:01.933 INFO:teuthology.orchestra.run.smithi137.stderr: 35150K .......... .......... .......... .......... .......... 37% 195M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35200K .......... .......... .......... .......... .......... 37% 157M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35250K .......... .......... .......... .......... .......... 37% 207M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35300K .......... .......... .......... .......... .......... 38% 117M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35350K .......... .......... .......... .......... .......... 38% 207M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35400K .......... .......... .......... .......... .......... 38% 226M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35450K .......... .......... .......... .......... .......... 38% 210M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35500K .......... .......... .......... .......... .......... 38% 240M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35550K .......... .......... .......... .......... .......... 38% 227M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35600K .......... .......... .......... .......... .......... 38% 160M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35650K .......... .......... .......... .......... .......... 38% 210M 0s 2024-09-12T00:47:01.934 INFO:teuthology.orchestra.run.smithi137.stderr: 35700K .......... .......... .......... .......... .......... 38% 283M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 35750K .......... .......... .......... .......... .......... 38% 178M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 35800K .......... .......... .......... .......... .......... 38% 223M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 35850K .......... .......... .......... .......... .......... 38% 74.3M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 35900K .......... .......... .......... .......... .......... 38% 240M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 35950K .......... .......... .......... .......... .......... 38% 261M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 36000K .......... .......... .......... .......... .......... 38% 184M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 36050K .......... .......... .......... .......... .......... 38% 149M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 36100K .......... .......... .......... .......... .......... 38% 286M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 36150K .......... .......... .......... .......... .......... 38% 287M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 36200K .......... .......... .......... .......... .......... 39% 127M 0s 2024-09-12T00:47:01.935 INFO:teuthology.orchestra.run.smithi137.stderr: 36250K .......... .......... .......... .......... .......... 39% 285M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36300K .......... .......... .......... .......... .......... 39% 214M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36350K .......... .......... .......... .......... .......... 39% 173M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36400K .......... .......... .......... .......... .......... 39% 210M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36450K .......... .......... .......... .......... .......... 39% 189M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36500K .......... .......... .......... .......... .......... 39% 207M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36550K .......... .......... .......... .......... .......... 39% 209M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36600K .......... .......... .......... .......... .......... 39% 188M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36650K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36700K .......... .......... .......... .......... .......... 39% 332M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36750K .......... .......... .......... .......... .......... 39% 145M 0s 2024-09-12T00:47:01.936 INFO:teuthology.orchestra.run.smithi137.stderr: 36800K .......... .......... .......... .......... .......... 39% 84.1M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 36850K .......... .......... .......... .......... .......... 39% 184M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 36900K .......... .......... .......... .......... .......... 39% 275M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 36950K .......... .......... .......... .......... .......... 39% 245M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 37000K .......... .......... .......... .......... .......... 39% 151M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 37050K .......... .......... .......... .......... .......... 39% 70.1M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 37100K .......... .......... .......... .......... .......... 39% 180M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 37150K .......... .......... .......... .......... .......... 40% 192M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 37200K .......... .......... .......... .......... .......... 40% 236M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 37250K .......... .......... .......... .......... .......... 40% 233M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 37300K .......... .......... .......... .......... .......... 40% 194M 0s 2024-09-12T00:47:01.937 INFO:teuthology.orchestra.run.smithi137.stderr: 37350K .......... .......... .......... .......... .......... 40% 276M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37400K .......... .......... .......... .......... .......... 40% 127M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37450K .......... .......... .......... .......... .......... 40% 255M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37500K .......... .......... .......... .......... .......... 40% 156M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37550K .......... .......... .......... .......... .......... 40% 166M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37600K .......... .......... .......... .......... .......... 40% 200M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37650K .......... .......... .......... .......... .......... 40% 310M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37700K .......... .......... .......... .......... .......... 40% 204M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37750K .......... .......... .......... .......... .......... 40% 189M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37800K .......... .......... .......... .......... .......... 40% 254M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37850K .......... .......... .......... .......... .......... 40% 312M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37900K .......... .......... .......... .......... .......... 40% 68.0M 0s 2024-09-12T00:47:01.938 INFO:teuthology.orchestra.run.smithi137.stderr: 37950K .......... .......... .......... .......... .......... 40% 177M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38000K .......... .......... .......... .......... .......... 40% 204M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38050K .......... .......... .......... .......... .......... 41% 206M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38100K .......... .......... .......... .......... .......... 41% 229M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38150K .......... .......... .......... .......... .......... 41% 213M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38200K .......... .......... .......... .......... .......... 41% 226M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38250K .......... .......... .......... .......... .......... 41% 247M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38300K .......... .......... .......... .......... .......... 41% 200M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38350K .......... .......... .......... .......... .......... 41% 104M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38400K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38450K .......... .......... .......... .......... .......... 41% 71.1M 0s 2024-09-12T00:47:01.939 INFO:teuthology.orchestra.run.smithi137.stderr: 38500K .......... .......... .......... .......... .......... 41% 177M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38550K .......... .......... .......... .......... .......... 41% 212M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38600K .......... .......... .......... .......... .......... 41% 215M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38650K .......... .......... .......... .......... .......... 41% 209M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38700K .......... .......... .......... .......... .......... 41% 236M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38750K .......... .......... .......... .......... .......... 41% 205M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38800K .......... .......... .......... .......... .......... 41% 159M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38850K .......... .......... .......... .......... .......... 41% 99.7M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38900K .......... .......... .......... .......... .......... 41% 156M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 38950K .......... .......... .......... .......... .......... 41% 175M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 39000K .......... .......... .......... .......... .......... 42% 206M 0s 2024-09-12T00:47:01.940 INFO:teuthology.orchestra.run.smithi137.stderr: 39050K .......... .......... .......... .......... .......... 42% 299M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39100K .......... .......... .......... .......... .......... 42% 161M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39150K .......... .......... .......... .......... .......... 42% 187M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39200K .......... .......... .......... .......... .......... 42% 245M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39250K .......... .......... .......... .......... .......... 42% 222M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39300K .......... .......... .......... .......... .......... 42% 225M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39350K .......... .......... .......... .......... .......... 42% 229M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39400K .......... .......... .......... .......... .......... 42% 206M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39450K .......... .......... .......... .......... .......... 42% 249M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39500K .......... .......... .......... .......... .......... 42% 186M 0s 2024-09-12T00:47:01.941 INFO:teuthology.orchestra.run.smithi137.stderr: 39550K .......... .......... .......... .......... .......... 42% 234M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 39600K .......... .......... .......... .......... .......... 42% 304M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 39650K .......... .......... .......... .......... .......... 42% 265M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 39700K .......... .......... .......... .......... .......... 42% 199M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 39750K .......... .......... .......... .......... .......... 42% 216M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 39800K .......... .......... .......... .......... .......... 42% 198M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 39850K .......... .......... .......... .......... .......... 42% 236M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 39900K .......... .......... .......... .......... .......... 43% 204M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 39950K .......... .......... .......... .......... .......... 43% 283M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 40000K .......... .......... .......... .......... .......... 43% 281M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 40050K .......... .......... .......... .......... .......... 43% 222M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 40100K .......... .......... .......... .......... .......... 43% 219M 0s 2024-09-12T00:47:01.942 INFO:teuthology.orchestra.run.smithi137.stderr: 40150K .......... .......... .......... .......... .......... 43% 186M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40200K .......... .......... .......... .......... .......... 43% 326M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40250K .......... .......... .......... .......... .......... 43% 74.6M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40300K .......... .......... .......... .......... .......... 43% 232M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40350K .......... .......... .......... .......... .......... 43% 128M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40400K .......... .......... .......... .......... .......... 43% 227M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40450K .......... .......... .......... .......... .......... 43% 135M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40500K .......... .......... .......... .......... .......... 43% 161M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40550K .......... .......... .......... .......... .......... 43% 208M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40600K .......... .......... .......... .......... .......... 43% 343M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40650K .......... .......... .......... .......... .......... 43% 116M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40700K .......... .......... .......... .......... .......... 43% 240M 0s 2024-09-12T00:47:01.943 INFO:teuthology.orchestra.run.smithi137.stderr: 40750K .......... .......... .......... .......... .......... 43% 202M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 40800K .......... .......... .......... .......... .......... 43% 232M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 40850K .......... .......... .......... .......... .......... 44% 220M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 40900K .......... .......... .......... .......... .......... 44% 233M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 40950K .......... .......... .......... .......... .......... 44% 261M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 41000K .......... .......... .......... .......... .......... 44% 214M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 41050K .......... .......... .......... .......... .......... 44% 220M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 41100K .......... .......... .......... .......... .......... 44% 81.5M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 41150K .......... .......... .......... .......... .......... 44% 93.8M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 41200K .......... .......... .......... .......... .......... 44% 252M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 41250K .......... .......... .......... .......... .......... 44% 157M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 41300K .......... .......... .......... .......... .......... 44% 234M 0s 2024-09-12T00:47:01.944 INFO:teuthology.orchestra.run.smithi137.stderr: 41350K .......... .......... .......... .......... .......... 44% 150M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41400K .......... .......... .......... .......... .......... 44% 96.3M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41450K .......... .......... .......... .......... .......... 44% 236M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41500K .......... .......... .......... .......... .......... 44% 192M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41550K .......... .......... .......... .......... .......... 44% 277M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41600K .......... .......... .......... .......... .......... 44% 291M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41650K .......... .......... .......... .......... .......... 44% 225M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41700K .......... .......... .......... .......... .......... 44% 226M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41750K .......... .......... .......... .......... .......... 44% 262M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41800K .......... .......... .......... .......... .......... 45% 342M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41850K .......... .......... .......... .......... .......... 45% 101M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41900K .......... .......... .......... .......... .......... 45% 137M 0s 2024-09-12T00:47:01.945 INFO:teuthology.orchestra.run.smithi137.stderr: 41950K .......... .......... .......... .......... .......... 45% 204M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42000K .......... .......... .......... .......... .......... 45% 311M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42050K .......... .......... .......... .......... .......... 45% 113M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42100K .......... .......... .......... .......... .......... 45% 289M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42150K .......... .......... .......... .......... .......... 45% 293M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42200K .......... .......... .......... .......... .......... 45% 263M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42250K .......... .......... .......... .......... .......... 45% 189M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42300K .......... .......... .......... .......... .......... 45% 142M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42350K .......... .......... .......... .......... .......... 45% 126M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42400K .......... .......... .......... .......... .......... 45% 215M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42450K .......... .......... .......... .......... .......... 45% 320M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42500K .......... .......... .......... .......... .......... 45% 304M 0s 2024-09-12T00:47:01.946 INFO:teuthology.orchestra.run.smithi137.stderr: 42550K .......... .......... .......... .......... .......... 45% 148M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 42600K .......... .......... .......... .......... .......... 45% 192M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 42650K .......... .......... .......... .......... .......... 45% 244M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 42700K .......... .......... .......... .......... .......... 46% 255M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 42750K .......... .......... .......... .......... .......... 46% 253M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 42800K .......... .......... .......... .......... .......... 46% 226M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 42850K .......... .......... .......... .......... .......... 46% 261M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 42900K .......... .......... .......... .......... .......... 46% 252M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 42950K .......... .......... .......... .......... .......... 46% 229M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 43000K .......... .......... .......... .......... .......... 46% 300M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 43050K .......... .......... .......... .......... .......... 46% 254M 0s 2024-09-12T00:47:01.947 INFO:teuthology.orchestra.run.smithi137.stderr: 43100K .......... .......... .......... .......... .......... 46% 296M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43150K .......... .......... .......... .......... .......... 46% 330M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43200K .......... .......... .......... .......... .......... 46% 84.5M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43250K .......... .......... .......... .......... .......... 46% 199M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43300K .......... .......... .......... .......... .......... 46% 268M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43350K .......... .......... .......... .......... .......... 46% 203M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43400K .......... .......... .......... .......... .......... 46% 339M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43450K .......... .......... .......... .......... .......... 46% 106M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43500K .......... .......... .......... .......... .......... 46% 89.7M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43550K .......... .......... .......... .......... .......... 46% 148M 0s 2024-09-12T00:47:01.948 INFO:teuthology.orchestra.run.smithi137.stderr: 43600K .......... .......... .......... .......... .......... 46% 169M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 43650K .......... .......... .......... .......... .......... 47% 237M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 43700K .......... .......... .......... .......... .......... 47% 88.2M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 43750K .......... .......... .......... .......... .......... 47% 153M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 43800K .......... .......... .......... .......... .......... 47% 234M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 43850K .......... .......... .......... .......... .......... 47% 334M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 43900K .......... .......... .......... .......... .......... 47% 135M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 43950K .......... .......... .......... .......... .......... 47% 207M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 44000K .......... .......... .......... .......... .......... 47% 200M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 44050K .......... .......... .......... .......... .......... 47% 216M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 44100K .......... .......... .......... .......... .......... 47% 313M 0s 2024-09-12T00:47:01.949 INFO:teuthology.orchestra.run.smithi137.stderr: 44150K .......... .......... .......... .......... .......... 47% 75.1M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44200K .......... .......... .......... .......... .......... 47% 101M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44250K .......... .......... .......... .......... .......... 47% 213M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44300K .......... .......... .......... .......... .......... 47% 108M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44350K .......... .......... .......... .......... .......... 47% 271M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44400K .......... .......... .......... .......... .......... 47% 93.4M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44450K .......... .......... .......... .......... .......... 47% 50.0M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44500K .......... .......... .......... .......... .......... 47% 156M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44550K .......... .......... .......... .......... .......... 48% 230M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44600K .......... .......... .......... .......... .......... 48% 230M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44650K .......... .......... .......... .......... .......... 48% 246M 0s 2024-09-12T00:47:01.950 INFO:teuthology.orchestra.run.smithi137.stderr: 44700K .......... .......... .......... .......... .......... 48% 270M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 44750K .......... .......... .......... .......... .......... 48% 342M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 44800K .......... .......... .......... .......... .......... 48% 273M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 44850K .......... .......... .......... .......... .......... 48% 226M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 44900K .......... .......... .......... .......... .......... 48% 273M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 44950K .......... .......... .......... .......... .......... 48% 138M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 45000K .......... .......... .......... .......... .......... 48% 246M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 45050K .......... .......... .......... .......... .......... 48% 270M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 45100K .......... .......... .......... .......... .......... 48% 216M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 45150K .......... .......... .......... .......... .......... 48% 149M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 45200K .......... .......... .......... .......... .......... 48% 191M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 45250K .......... .......... .......... .......... .......... 48% 338M 0s 2024-09-12T00:47:01.951 INFO:teuthology.orchestra.run.smithi137.stderr: 45300K .......... .......... .......... .......... .......... 48% 305M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45350K .......... .......... .......... .......... .......... 48% 147M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45400K .......... .......... .......... .......... .......... 48% 224M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45450K .......... .......... .......... .......... .......... 48% 204M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45500K .......... .......... .......... .......... .......... 49% 226M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45550K .......... .......... .......... .......... .......... 49% 185M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45600K .......... .......... .......... .......... .......... 49% 227M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45650K .......... .......... .......... .......... .......... 49% 329M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45700K .......... .......... .......... .......... .......... 49% 209M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45750K .......... .......... .......... .......... .......... 49% 224M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45800K .......... .......... .......... .......... .......... 49% 233M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45850K .......... .......... .......... .......... .......... 49% 214M 0s 2024-09-12T00:47:01.952 INFO:teuthology.orchestra.run.smithi137.stderr: 45900K .......... .......... .......... .......... .......... 49% 259M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 45950K .......... .......... .......... .......... .......... 49% 217M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46000K .......... .......... .......... .......... .......... 49% 349M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46050K .......... .......... .......... .......... .......... 49% 346M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46100K .......... .......... .......... .......... .......... 49% 210M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46150K .......... .......... .......... .......... .......... 49% 217M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46200K .......... .......... .......... .......... .......... 49% 203M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46250K .......... .......... .......... .......... .......... 49% 347M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46300K .......... .......... .......... .......... .......... 49% 190M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46350K .......... .......... .......... .......... .......... 49% 320M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46400K .......... .......... .......... .......... .......... 49% 247M 0s 2024-09-12T00:47:01.953 INFO:teuthology.orchestra.run.smithi137.stderr: 46450K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46500K .......... .......... .......... .......... .......... 50% 64.4M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46550K .......... .......... .......... .......... .......... 50% 229M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46600K .......... .......... .......... .......... .......... 50% 172M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46650K .......... .......... .......... .......... .......... 50% 335M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46700K .......... .......... .......... .......... .......... 50% 46.5M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46750K .......... .......... .......... .......... .......... 50% 211M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46800K .......... .......... .......... .......... .......... 50% 291M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46850K .......... .......... .......... .......... .......... 50% 317M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46900K .......... .......... .......... .......... .......... 50% 224M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 46950K .......... .......... .......... .......... .......... 50% 259M 0s 2024-09-12T00:47:01.954 INFO:teuthology.orchestra.run.smithi137.stderr: 47000K .......... .......... .......... .......... .......... 50% 291M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47050K .......... .......... .......... .......... .......... 50% 131M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47100K .......... .......... .......... .......... .......... 50% 54.9M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47150K .......... .......... .......... .......... .......... 50% 143M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47200K .......... .......... .......... .......... .......... 50% 265M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47250K .......... .......... .......... .......... .......... 50% 263M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47300K .......... .......... .......... .......... .......... 50% 131M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47350K .......... .......... .......... .......... .......... 51% 331M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47400K .......... .......... .......... .......... .......... 51% 74.8M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47450K .......... .......... .......... .......... .......... 51% 116M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47500K .......... .......... .......... .......... .......... 51% 89.1M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47550K .......... .......... .......... .......... .......... 51% 219M 0s 2024-09-12T00:47:01.955 INFO:teuthology.orchestra.run.smithi137.stderr: 47600K .......... .......... .......... .......... .......... 51% 194M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 47650K .......... .......... .......... .......... .......... 51% 120M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 47700K .......... .......... .......... .......... .......... 51% 264M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 47750K .......... .......... .......... .......... .......... 51% 165M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 47800K .......... .......... .......... .......... .......... 51% 232M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 47850K .......... .......... .......... .......... .......... 51% 344M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 47900K .......... .......... .......... .......... .......... 51% 129M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 47950K .......... .......... .......... .......... .......... 51% 319M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 48000K .......... .......... .......... .......... .......... 51% 198M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 48050K .......... .......... .......... .......... .......... 51% 239M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 48100K .......... .......... .......... .......... .......... 51% 236M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 48150K .......... .......... .......... .......... .......... 51% 344M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 48200K .......... .......... .......... .......... .......... 51% 245M 0s 2024-09-12T00:47:01.956 INFO:teuthology.orchestra.run.smithi137.stderr: 48250K .......... .......... .......... .......... .......... 51% 223M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48300K .......... .......... .......... .......... .......... 52% 158M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48350K .......... .......... .......... .......... .......... 52% 332M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48400K .......... .......... .......... .......... .......... 52% 164M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48450K .......... .......... .......... .......... .......... 52% 214M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48500K .......... .......... .......... .......... .......... 52% 183M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48550K .......... .......... .......... .......... .......... 52% 253M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48600K .......... .......... .......... .......... .......... 52% 312M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48650K .......... .......... .......... .......... .......... 52% 247M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48700K .......... .......... .......... .......... .......... 52% 205M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48750K .......... .......... .......... .......... .......... 52% 276M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48800K .......... .......... .......... .......... .......... 52% 179M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48850K .......... .......... .......... .......... .......... 52% 258M 0s 2024-09-12T00:47:01.957 INFO:teuthology.orchestra.run.smithi137.stderr: 48900K .......... .......... .......... .......... .......... 52% 203M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 48950K .......... .......... .......... .......... .......... 52% 243M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49000K .......... .......... .......... .......... .......... 52% 196M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49050K .......... .......... .......... .......... .......... 52% 249M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49100K .......... .......... .......... .......... .......... 52% 167M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49150K .......... .......... .......... .......... .......... 52% 223M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49200K .......... .......... .......... .......... .......... 53% 265M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49250K .......... .......... .......... .......... .......... 53% 184M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49300K .......... .......... .......... .......... .......... 53% 240M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49350K .......... .......... .......... .......... .......... 53% 259M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49400K .......... .......... .......... .......... .......... 53% 213M 0s 2024-09-12T00:47:01.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49450K .......... .......... .......... .......... .......... 53% 281M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49500K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49550K .......... .......... .......... .......... .......... 53% 344M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49600K .......... .......... .......... .......... .......... 53% 314M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49650K .......... .......... .......... .......... .......... 53% 112M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49700K .......... .......... .......... .......... .......... 53% 105M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49750K .......... .......... .......... .......... .......... 53% 219M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49800K .......... .......... .......... .......... .......... 53% 249M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49850K .......... .......... .......... .......... .......... 53% 289M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49900K .......... .......... .......... .......... .......... 53% 225M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49950K .......... .......... .......... .......... .......... 53% 257M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 50000K .......... .......... .......... .......... .......... 53% 296M 0s 2024-09-12T00:47:01.959 INFO:teuthology.orchestra.run.smithi137.stderr: 50050K .......... .......... .......... .......... .......... 53% 259M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50100K .......... .......... .......... .......... .......... 53% 130M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50150K .......... .......... .......... .......... .......... 54% 325M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50200K .......... .......... .......... .......... .......... 54% 180M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50250K .......... .......... .......... .......... .......... 54% 90.9M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50300K .......... .......... .......... .......... .......... 54% 182M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50350K .......... .......... .......... .......... .......... 54% 55.3M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50400K .......... .......... .......... .......... .......... 54% 118M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50450K .......... .......... .......... .......... .......... 54% 246M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50500K .......... .......... .......... .......... .......... 54% 148M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50550K .......... .......... .......... .......... .......... 54% 119M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50600K .......... .......... .......... .......... .......... 54% 176M 0s 2024-09-12T00:47:01.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50650K .......... .......... .......... .......... .......... 54% 229M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 50700K .......... .......... .......... .......... .......... 54% 102M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 50750K .......... .......... .......... .......... .......... 54% 309M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 50800K .......... .......... .......... .......... .......... 54% 70.9M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 50850K .......... .......... .......... .......... .......... 54% 272M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 50900K .......... .......... .......... .......... .......... 54% 303M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 50950K .......... .......... .......... .......... .......... 54% 84.9M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 51000K .......... .......... .......... .......... .......... 54% 243M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 51050K .......... .......... .......... .......... .......... 55% 245M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 51100K .......... .......... .......... .......... .......... 55% 151M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 51150K .......... .......... .......... .......... .......... 55% 187M 0s 2024-09-12T00:47:01.961 INFO:teuthology.orchestra.run.smithi137.stderr: 51200K .......... .......... .......... .......... .......... 55% 263M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51250K .......... .......... .......... .......... .......... 55% 378M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51300K .......... .......... .......... .......... .......... 55% 213M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51350K .......... .......... .......... .......... .......... 55% 217M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51400K .......... .......... .......... .......... .......... 55% 283M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51450K .......... .......... .......... .......... .......... 55% 218M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51500K .......... .......... .......... .......... .......... 55% 182M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51550K .......... .......... .......... .......... .......... 55% 272M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51600K .......... .......... .......... .......... .......... 55% 275M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51650K .......... .......... .......... .......... .......... 55% 248M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51700K .......... .......... .......... .......... .......... 55% 304M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51750K .......... .......... .......... .......... .......... 55% 168M 0s 2024-09-12T00:47:01.962 INFO:teuthology.orchestra.run.smithi137.stderr: 51800K .......... .......... .......... .......... .......... 55% 271M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 51850K .......... .......... .......... .......... .......... 55% 142M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 51900K .......... .......... .......... .......... .......... 55% 285M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 51950K .......... .......... .......... .......... .......... 55% 215M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 52000K .......... .......... .......... .......... .......... 56% 226M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 52050K .......... .......... .......... .......... .......... 56% 197M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 52100K .......... .......... .......... .......... .......... 56% 276M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 52150K .......... .......... .......... .......... .......... 56% 211M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 52200K .......... .......... .......... .......... .......... 56% 190M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 52250K .......... .......... .......... .......... .......... 56% 202M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 52300K .......... .......... .......... .......... .......... 56% 291M 0s 2024-09-12T00:47:01.963 INFO:teuthology.orchestra.run.smithi137.stderr: 52350K .......... .......... .......... .......... .......... 56% 216M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52400K .......... .......... .......... .......... .......... 56% 251M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52450K .......... .......... .......... .......... .......... 56% 303M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52500K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52550K .......... .......... .......... .......... .......... 56% 180M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52600K .......... .......... .......... .......... .......... 56% 224M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52650K .......... .......... .......... .......... .......... 56% 264M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52700K .......... .......... .......... .......... .......... 56% 206M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52750K .......... .......... .......... .......... .......... 56% 343M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52800K .......... .......... .......... .......... .......... 56% 197M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52850K .......... .......... .......... .......... .......... 56% 205M 0s 2024-09-12T00:47:01.964 INFO:teuthology.orchestra.run.smithi137.stderr: 52900K .......... .......... .......... .......... .......... 56% 214M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 52950K .......... .......... .......... .......... .......... 57% 229M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53000K .......... .......... .......... .......... .......... 57% 338M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53050K .......... .......... .......... .......... .......... 57% 114M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53100K .......... .......... .......... .......... .......... 57% 164M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53150K .......... .......... .......... .......... .......... 57% 353M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53200K .......... .......... .......... .......... .......... 57% 248M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53250K .......... .......... .......... .......... .......... 57% 218M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53300K .......... .......... .......... .......... .......... 57% 315M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53350K .......... .......... .......... .......... .......... 57% 87.9M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53400K .......... .......... .......... .......... .......... 57% 113M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53450K .......... .......... .......... .......... .......... 57% 312M 0s 2024-09-12T00:47:01.965 INFO:teuthology.orchestra.run.smithi137.stderr: 53500K .......... .......... .......... .......... .......... 57% 73.6M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53550K .......... .......... .......... .......... .......... 57% 127M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53600K .......... .......... .......... .......... .......... 57% 163M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53650K .......... .......... .......... .......... .......... 57% 78.8M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53700K .......... .......... .......... .......... .......... 57% 135M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53750K .......... .......... .......... .......... .......... 57% 252M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53800K .......... .......... .......... .......... .......... 57% 323M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53850K .......... .......... .......... .......... .......... 58% 229M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53900K .......... .......... .......... .......... .......... 58% 150M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 53950K .......... .......... .......... .......... .......... 58% 255M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 54000K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 54050K .......... .......... .......... .......... .......... 58% 136M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 54100K .......... .......... .......... .......... .......... 58% 111M 0s 2024-09-12T00:47:01.966 INFO:teuthology.orchestra.run.smithi137.stderr: 54150K .......... .......... .......... .......... .......... 58% 296M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54200K .......... .......... .......... .......... .......... 58% 126M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54250K .......... .......... .......... .......... .......... 58% 82.8M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54300K .......... .......... .......... .......... .......... 58% 210M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54350K .......... .......... .......... .......... .......... 58% 270M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54400K .......... .......... .......... .......... .......... 58% 284M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54450K .......... .......... .......... .......... .......... 58% 243M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54500K .......... .......... .......... .......... .......... 58% 259M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54550K .......... .......... .......... .......... .......... 58% 257M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54600K .......... .......... .......... .......... .......... 58% 257M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54650K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54700K .......... .......... .......... .......... .......... 58% 57.1M 0s 2024-09-12T00:47:01.967 INFO:teuthology.orchestra.run.smithi137.stderr: 54750K .......... .......... .......... .......... .......... 58% 320M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 54800K .......... .......... .......... .......... .......... 59% 309M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 54850K .......... .......... .......... .......... .......... 59% 215M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 54900K .......... .......... .......... .......... .......... 59% 245M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 54950K .......... .......... .......... .......... .......... 59% 295M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 55000K .......... .......... .......... .......... .......... 59% 271M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 55050K .......... .......... .......... .......... .......... 59% 283M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 55100K .......... .......... .......... .......... .......... 59% 294M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 55150K .......... .......... .......... .......... .......... 59% 190M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 55200K .......... .......... .......... .......... .......... 59% 249M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 55250K .......... .......... .......... .......... .......... 59% 246M 0s 2024-09-12T00:47:01.968 INFO:teuthology.orchestra.run.smithi137.stderr: 55300K .......... .......... .......... .......... .......... 59% 300M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55350K .......... .......... .......... .......... .......... 59% 177M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55400K .......... .......... .......... .......... .......... 59% 207M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55450K .......... .......... .......... .......... .......... 59% 159M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55500K .......... .......... .......... .......... .......... 59% 209M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55550K .......... .......... .......... .......... .......... 59% 250M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55600K .......... .......... .......... .......... .......... 59% 266M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55650K .......... .......... .......... .......... .......... 59% 342M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55700K .......... .......... .......... .......... .......... 60% 229M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55750K .......... .......... .......... .......... .......... 60% 253M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55800K .......... .......... .......... .......... .......... 60% 345M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55850K .......... .......... .......... .......... .......... 60% 137M 0s 2024-09-12T00:47:01.969 INFO:teuthology.orchestra.run.smithi137.stderr: 55900K .......... .......... .......... .......... .......... 60% 222M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 55950K .......... .......... .......... .......... .......... 60% 261M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56000K .......... .......... .......... .......... .......... 60% 290M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56050K .......... .......... .......... .......... .......... 60% 363M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56100K .......... .......... .......... .......... .......... 60% 207M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56150K .......... .......... .......... .......... .......... 60% 131M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56200K .......... .......... .......... .......... .......... 60% 239M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56250K .......... .......... .......... .......... .......... 60% 342M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56300K .......... .......... .......... .......... .......... 60% 132M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56350K .......... .......... .......... .......... .......... 60% 248M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56400K .......... .......... .......... .......... .......... 60% 339M 0s 2024-09-12T00:47:01.970 INFO:teuthology.orchestra.run.smithi137.stderr: 56450K .......... .......... .......... .......... .......... 60% 155M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56500K .......... .......... .......... .......... .......... 60% 199M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56550K .......... .......... .......... .......... .......... 60% 279M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56600K .......... .......... .......... .......... .......... 60% 127M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56650K .......... .......... .......... .......... .......... 61% 85.8M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56700K .......... .......... .......... .......... .......... 61% 183M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56750K .......... .......... .......... .......... .......... 61% 50.1M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56800K .......... .......... .......... .......... .......... 61% 180M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56850K .......... .......... .......... .......... .......... 61% 225M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56900K .......... .......... .......... .......... .......... 61% 343M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 56950K .......... .......... .......... .......... .......... 61% 362M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 57000K .......... .......... .......... .......... .......... 61% 156M 0s 2024-09-12T00:47:01.971 INFO:teuthology.orchestra.run.smithi137.stderr: 57050K .......... .......... .......... .......... .......... 61% 227M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57100K .......... .......... .......... .......... .......... 61% 305M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57150K .......... .......... .......... .......... .......... 61% 327M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57200K .......... .......... .......... .......... .......... 61% 141M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57250K .......... .......... .......... .......... .......... 61% 87.3M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57300K .......... .......... .......... .......... .......... 61% 61.4M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57350K .......... .......... .......... .......... .......... 61% 236M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57400K .......... .......... .......... .......... .......... 61% 321M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57450K .......... .......... .......... .......... .......... 61% 152M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57500K .......... .......... .......... .......... .......... 61% 287M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57550K .......... .......... .......... .......... .......... 62% 279M 0s 2024-09-12T00:47:01.972 INFO:teuthology.orchestra.run.smithi137.stderr: 57600K .......... .......... .......... .......... .......... 62% 84.2M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 57650K .......... .......... .......... .......... .......... 62% 188M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 57700K .......... .......... .......... .......... .......... 62% 242M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 57750K .......... .......... .......... .......... .......... 62% 220M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 57800K .......... .......... .......... .......... .......... 62% 314M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 57850K .......... .......... .......... .......... .......... 62% 242M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 57900K .......... .......... .......... .......... .......... 62% 252M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 57950K .......... .......... .......... .......... .......... 62% 280M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 58000K .......... .......... .......... .......... .......... 62% 178M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 58050K .......... .......... .......... .......... .......... 62% 124M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 58100K .......... .......... .......... .......... .......... 62% 187M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 58150K .......... .......... .......... .......... .......... 62% 358M 0s 2024-09-12T00:47:01.973 INFO:teuthology.orchestra.run.smithi137.stderr: 58200K .......... .......... .......... .......... .......... 62% 57.3M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58250K .......... .......... .......... .......... .......... 62% 156M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58300K .......... .......... .......... .......... .......... 62% 217M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58350K .......... .......... .......... .......... .......... 62% 222M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58400K .......... .......... .......... .......... .......... 62% 210M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58450K .......... .......... .......... .......... .......... 62% 299M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58500K .......... .......... .......... .......... .......... 63% 115M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58550K .......... .......... .......... .......... .......... 63% 267M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58600K .......... .......... .......... .......... .......... 63% 155M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58650K .......... .......... .......... .......... .......... 63% 278M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58700K .......... .......... .......... .......... .......... 63% 188M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58750K .......... .......... .......... .......... .......... 63% 298M 0s 2024-09-12T00:47:01.974 INFO:teuthology.orchestra.run.smithi137.stderr: 58800K .......... .......... .......... .......... .......... 63% 277M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 58850K .......... .......... .......... .......... .......... 63% 241M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 58900K .......... .......... .......... .......... .......... 63% 210M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 58950K .......... .......... .......... .......... .......... 63% 322M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 59000K .......... .......... .......... .......... .......... 63% 368M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 59050K .......... .......... .......... .......... .......... 63% 359M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 59100K .......... .......... .......... .......... .......... 63% 254M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 59150K .......... .......... .......... .......... .......... 63% 211M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 59200K .......... .......... .......... .......... .......... 63% 245M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 59250K .......... .......... .......... .......... .......... 63% 236M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 59300K .......... .......... .......... .......... .......... 63% 307M 0s 2024-09-12T00:47:01.975 INFO:teuthology.orchestra.run.smithi137.stderr: 59350K .......... .......... .......... .......... .......... 63% 362M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59400K .......... .......... .......... .......... .......... 63% 93.3M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59450K .......... .......... .......... .......... .......... 64% 224M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59500K .......... .......... .......... .......... .......... 64% 217M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59550K .......... .......... .......... .......... .......... 64% 231M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59600K .......... .......... .......... .......... .......... 64% 349M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59650K .......... .......... .......... .......... .......... 64% 209M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59700K .......... .......... .......... .......... .......... 64% 68.4M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59750K .......... .......... .......... .......... .......... 64% 175M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59800K .......... .......... .......... .......... .......... 64% 261M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59850K .......... .......... .......... .......... .......... 64% 287M 0s 2024-09-12T00:47:01.976 INFO:teuthology.orchestra.run.smithi137.stderr: 59900K .......... .......... .......... .......... .......... 64% 219M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 59950K .......... .......... .......... .......... .......... 64% 253M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60000K .......... .......... .......... .......... .......... 64% 305M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60050K .......... .......... .......... .......... .......... 64% 359M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60100K .......... .......... .......... .......... .......... 64% 180M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60150K .......... .......... .......... .......... .......... 64% 95.0M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60200K .......... .......... .......... .......... .......... 64% 285M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60250K .......... .......... .......... .......... .......... 64% 132M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60300K .......... .......... .......... .......... .......... 64% 76.4M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60350K .......... .......... .......... .......... .......... 65% 185M 0s 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi137.stderr: 60400K .......... .......... .......... .......... .......... 65% 162M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60450K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60500K .......... .......... .......... .......... .......... 65% 120M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60550K .......... .......... .......... .......... .......... 65% 259M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60600K .......... .......... .......... .......... .......... 65% 183M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60650K .......... .......... .......... .......... .......... 65% 322M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60700K .......... .......... .......... .......... .......... 65% 111M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60750K .......... .......... .......... .......... .......... 65% 44.2M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60800K .......... .......... .......... .......... .......... 65% 271M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60850K .......... .......... .......... .......... .......... 65% 189M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60900K .......... .......... .......... .......... .......... 65% 195M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 60950K .......... .......... .......... .......... .......... 65% 361M 0s 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi137.stderr: 61000K .......... .......... .......... .......... .......... 65% 267M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61050K .......... .......... .......... .......... .......... 65% 270M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61100K .......... .......... .......... .......... .......... 65% 209M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61150K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61200K .......... .......... .......... .......... .......... 65% 238M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61250K .......... .......... .......... .......... .......... 65% 96.9M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61300K .......... .......... .......... .......... .......... 66% 227M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61350K .......... .......... .......... .......... .......... 66% 111M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61400K .......... .......... .......... .......... .......... 66% 287M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61450K .......... .......... .......... .......... .......... 66% 249M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61500K .......... .......... .......... .......... .......... 66% 100M 0s 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi137.stderr: 61550K .......... .......... .......... .......... .......... 66% 163M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 61600K .......... .......... .......... .......... .......... 66% 213M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 61650K .......... .......... .......... .......... .......... 66% 302M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 61700K .......... .......... .......... .......... .......... 66% 158M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 61750K .......... .......... .......... .......... .......... 66% 167M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 61800K .......... .......... .......... .......... .......... 66% 285M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 61850K .......... .......... .......... .......... .......... 66% 280M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 61900K .......... .......... .......... .......... .......... 66% 301M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 61950K .......... .......... .......... .......... .......... 66% 360M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 62000K .......... .......... .......... .......... .......... 66% 147M 0s 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi137.stderr: 62050K .......... .......... .......... .......... .......... 66% 286M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62100K .......... .......... .......... .......... .......... 66% 281M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62150K .......... .......... .......... .......... .......... 66% 298M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62200K .......... .......... .......... .......... .......... 67% 292M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62250K .......... .......... .......... .......... .......... 67% 199M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62300K .......... .......... .......... .......... .......... 67% 310M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62350K .......... .......... .......... .......... .......... 67% 166M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62400K .......... .......... .......... .......... .......... 67% 218M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62450K .......... .......... .......... .......... .......... 67% 365M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62500K .......... .......... .......... .......... .......... 67% 257M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62550K .......... .......... .......... .......... .......... 67% 267M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62600K .......... .......... .......... .......... .......... 67% 144M 0s 2024-09-12T00:47:01.981 INFO:teuthology.orchestra.run.smithi137.stderr: 62650K .......... .......... .......... .......... .......... 67% 262M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 62700K .......... .......... .......... .......... .......... 67% 147M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 62750K .......... .......... .......... .......... .......... 67% 126M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 62800K .......... .......... .......... .......... .......... 67% 252M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 62850K .......... .......... .......... .......... .......... 67% 246M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 62900K .......... .......... .......... .......... .......... 67% 212M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 62950K .......... .......... .......... .......... .......... 67% 279M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 63000K .......... .......... .......... .......... .......... 67% 236M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 63050K .......... .......... .......... .......... .......... 67% 304M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 63100K .......... .......... .......... .......... .......... 67% 297M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 63150K .......... .......... .......... .......... .......... 68% 235M 0s 2024-09-12T00:47:01.982 INFO:teuthology.orchestra.run.smithi137.stderr: 63200K .......... .......... .......... .......... .......... 68% 288M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63250K .......... .......... .......... .......... .......... 68% 238M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63300K .......... .......... .......... .......... .......... 68% 133M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63350K .......... .......... .......... .......... .......... 68% 77.8M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63400K .......... .......... .......... .......... .......... 68% 183M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63450K .......... .......... .......... .......... .......... 68% 269M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63500K .......... .......... .......... .......... .......... 68% 124M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63550K .......... .......... .......... .......... .......... 68% 242M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63600K .......... .......... .......... .......... .......... 68% 165M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63650K .......... .......... .......... .......... .......... 68% 86.5M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63700K .......... .......... .......... .......... .......... 68% 112M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63750K .......... .......... .......... .......... .......... 68% 229M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63800K .......... .......... .......... .......... .......... 68% 92.8M 0s 2024-09-12T00:47:01.983 INFO:teuthology.orchestra.run.smithi137.stderr: 63850K .......... .......... .......... .......... .......... 68% 263M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 63900K .......... .......... .......... .......... .......... 68% 201M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 63950K .......... .......... .......... .......... .......... 68% 164M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64000K .......... .......... .......... .......... .......... 68% 327M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64050K .......... .......... .......... .......... .......... 68% 246M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64100K .......... .......... .......... .......... .......... 69% 230M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64150K .......... .......... .......... .......... .......... 69% 136M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64200K .......... .......... .......... .......... .......... 69% 297M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64250K .......... .......... .......... .......... .......... 69% 198M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64300K .......... .......... .......... .......... .......... 69% 251M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64350K .......... .......... .......... .......... .......... 69% 217M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64400K .......... .......... .......... .......... .......... 69% 181M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64450K .......... .......... .......... .......... .......... 69% 274M 0s 2024-09-12T00:47:01.984 INFO:teuthology.orchestra.run.smithi137.stderr: 64500K .......... .......... .......... .......... .......... 69% 79.1M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64550K .......... .......... .......... .......... .......... 69% 210M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64600K .......... .......... .......... .......... .......... 69% 279M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64650K .......... .......... .......... .......... .......... 69% 288M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64700K .......... .......... .......... .......... .......... 69% 152M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64750K .......... .......... .......... .......... .......... 69% 72.1M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64800K .......... .......... .......... .......... .......... 69% 157M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64850K .......... .......... .......... .......... .......... 69% 275M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64900K .......... .......... .......... .......... .......... 69% 294M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 64950K .......... .......... .......... .......... .......... 69% 91.8M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 65000K .......... .......... .......... .......... .......... 70% 247M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 65050K .......... .......... .......... .......... .......... 70% 319M 0s 2024-09-12T00:47:01.985 INFO:teuthology.orchestra.run.smithi137.stderr: 65100K .......... .......... .......... .......... .......... 70% 213M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65150K .......... .......... .......... .......... .......... 70% 218M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65200K .......... .......... .......... .......... .......... 70% 260M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65250K .......... .......... .......... .......... .......... 70% 275M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65300K .......... .......... .......... .......... .......... 70% 232M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65350K .......... .......... .......... .......... .......... 70% 304M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65400K .......... .......... .......... .......... .......... 70% 221M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65450K .......... .......... .......... .......... .......... 70% 280M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65500K .......... .......... .......... .......... .......... 70% 294M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65550K .......... .......... .......... .......... .......... 70% 224M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65600K .......... .......... .......... .......... .......... 70% 306M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65650K .......... .......... .......... .......... .......... 70% 165M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65700K .......... .......... .......... .......... .......... 70% 124M 0s 2024-09-12T00:47:01.986 INFO:teuthology.orchestra.run.smithi137.stderr: 65750K .......... .......... .......... .......... .......... 70% 138M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 65800K .......... .......... .......... .......... .......... 70% 220M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 65850K .......... .......... .......... .......... .......... 70% 325M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 65900K .......... .......... .......... .......... .......... 70% 150M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 65950K .......... .......... .......... .......... .......... 71% 210M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66000K .......... .......... .......... .......... .......... 71% 253M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66050K .......... .......... .......... .......... .......... 71% 259M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66100K .......... .......... .......... .......... .......... 71% 331M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66150K .......... .......... .......... .......... .......... 71% 225M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66200K .......... .......... .......... .......... .......... 71% 249M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66250K .......... .......... .......... .......... .......... 71% 245M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66300K .......... .......... .......... .......... .......... 71% 356M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66350K .......... .......... .......... .......... .......... 71% 159M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66400K .......... .......... .......... .......... .......... 71% 203M 0s 2024-09-12T00:47:01.987 INFO:teuthology.orchestra.run.smithi137.stderr: 66450K .......... .......... .......... .......... .......... 71% 272M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66500K .......... .......... .......... .......... .......... 71% 139M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66550K .......... .......... .......... .......... .......... 71% 203M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66600K .......... .......... .......... .......... .......... 71% 235M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66650K .......... .......... .......... .......... .......... 71% 71.3M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66700K .......... .......... .......... .......... .......... 71% 155M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66750K .......... .......... .......... .......... .......... 71% 205M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66800K .......... .......... .......... .......... .......... 71% 264M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66850K .......... .......... .......... .......... .......... 72% 98.7M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66900K .......... .......... .......... .......... .......... 72% 255M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 66950K .......... .......... .......... .......... .......... 72% 274M 0s 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi137.stderr: 67000K .......... .......... .......... .......... .......... 72% 213M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67050K .......... .......... .......... .......... .......... 72% 365M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67100K .......... .......... .......... .......... .......... 72% 163M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67150K .......... .......... .......... .......... .......... 72% 180M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67200K .......... .......... .......... .......... .......... 72% 162M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67250K .......... .......... .......... .......... .......... 72% 192M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67300K .......... .......... .......... .......... .......... 72% 348M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67350K .......... .......... .......... .......... .......... 72% 128M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67400K .......... .......... .......... .......... .......... 72% 256M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67450K .......... .......... .......... .......... .......... 72% 276M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67500K .......... .......... .......... .......... .......... 72% 118M 0s 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi137.stderr: 67550K .......... .......... .......... .......... .......... 72% 48.1M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 67600K .......... .......... .......... .......... .......... 72% 239M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 67650K .......... .......... .......... .......... .......... 72% 337M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 67700K .......... .......... .......... .......... .......... 72% 374M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 67750K .......... .......... .......... .......... .......... 72% 105M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 67800K .......... .......... .......... .......... .......... 73% 61.5M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 67850K .......... .......... .......... .......... .......... 73% 188M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 67900K .......... .......... .......... .......... .......... 73% 325M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 67950K .......... .......... .......... .......... .......... 73% 46.8M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 68000K .......... .......... .......... .......... .......... 73% 224M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 68050K .......... .......... .......... .......... .......... 73% 342M 0s 2024-09-12T00:47:01.990 INFO:teuthology.orchestra.run.smithi137.stderr: 68100K .......... .......... .......... .......... .......... 73% 246M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68150K .......... .......... .......... .......... .......... 73% 225M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68200K .......... .......... .......... .......... .......... 73% 369M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68250K .......... .......... .......... .......... .......... 73% 137M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68300K .......... .......... .......... .......... .......... 73% 246M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68350K .......... .......... .......... .......... .......... 73% 198M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68400K .......... .......... .......... .......... .......... 73% 224M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68450K .......... .......... .......... .......... .......... 73% 222M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68500K .......... .......... .......... .......... .......... 73% 202M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68550K .......... .......... .......... .......... .......... 73% 314M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68600K .......... .......... .......... .......... .......... 73% 321M 0s 2024-09-12T00:47:01.991 INFO:teuthology.orchestra.run.smithi137.stderr: 68650K .......... .......... .......... .......... .......... 73% 238M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 68700K .......... .......... .......... .......... .......... 74% 290M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 68750K .......... .......... .......... .......... .......... 74% 180M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 68800K .......... .......... .......... .......... .......... 74% 300M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 68850K .......... .......... .......... .......... .......... 74% 264M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 68900K .......... .......... .......... .......... .......... 74% 353M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 68950K .......... .......... .......... .......... .......... 74% 207M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 69000K .......... .......... .......... .......... .......... 74% 322M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 69050K .......... .......... .......... .......... .......... 74% 163M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 69100K .......... .......... .......... .......... .......... 74% 239M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 69150K .......... .......... .......... .......... .......... 74% 225M 0s 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi137.stderr: 69200K .......... .......... .......... .......... .......... 74% 242M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69250K .......... .......... .......... .......... .......... 74% 246M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69300K .......... .......... .......... .......... .......... 74% 301M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69350K .......... .......... .......... .......... .......... 74% 243M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69400K .......... .......... .......... .......... .......... 74% 218M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69450K .......... .......... .......... .......... .......... 74% 226M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69500K .......... .......... .......... .......... .......... 74% 342M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69550K .......... .......... .......... .......... .......... 74% 197M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69600K .......... .......... .......... .......... .......... 74% 298M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69650K .......... .......... .......... .......... .......... 75% 192M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69700K .......... .......... .......... .......... .......... 75% 258M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69750K .......... .......... .......... .......... .......... 75% 204M 0s 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi137.stderr: 69800K .......... .......... .......... .......... .......... 75% 276M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 69850K .......... .......... .......... .......... .......... 75% 121M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 69900K .......... .......... .......... .......... .......... 75% 116M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 69950K .......... .......... .......... .......... .......... 75% 211M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70000K .......... .......... .......... .......... .......... 75% 88.5M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70050K .......... .......... .......... .......... .......... 75% 127M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70100K .......... .......... .......... .......... .......... 75% 360M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70150K .......... .......... .......... .......... .......... 75% 192M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70200K .......... .......... .......... .......... .......... 75% 249M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70250K .......... .......... .......... .......... .......... 75% 335M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70300K .......... .......... .......... .......... .......... 75% 94.2M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70350K .......... .......... .......... .......... .......... 75% 218M 0s 2024-09-12T00:47:01.994 INFO:teuthology.orchestra.run.smithi137.stderr: 70400K .......... .......... .......... .......... .......... 75% 127M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70450K .......... .......... .......... .......... .......... 75% 270M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70500K .......... .......... .......... .......... .......... 75% 354M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70550K .......... .......... .......... .......... .......... 75% 58.6M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70600K .......... .......... .......... .......... .......... 76% 181M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70650K .......... .......... .......... .......... .......... 76% 51.7M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70700K .......... .......... .......... .......... .......... 76% 297M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70750K .......... .......... .......... .......... .......... 76% 247M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70800K .......... .......... .......... .......... .......... 76% 59.2M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70850K .......... .......... .......... .......... .......... 76% 193M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70900K .......... .......... .......... .......... .......... 76% 195M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 70950K .......... .......... .......... .......... .......... 76% 218M 0s 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi137.stderr: 71000K .......... .......... .......... .......... .......... 76% 359M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71050K .......... .......... .......... .......... .......... 76% 218M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71100K .......... .......... .......... .......... .......... 76% 246M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71150K .......... .......... .......... .......... .......... 76% 212M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71200K .......... .......... .......... .......... .......... 76% 257M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71250K .......... .......... .......... .......... .......... 76% 350M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71300K .......... .......... .......... .......... .......... 76% 182M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71350K .......... .......... .......... .......... .......... 76% 147M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71400K .......... .......... .......... .......... .......... 76% 245M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71450K .......... .......... .......... .......... .......... 76% 266M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71500K .......... .......... .......... .......... .......... 77% 262M 0s 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi137.stderr: 71550K .......... .......... .......... .......... .......... 77% 116M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 71600K .......... .......... .......... .......... .......... 77% 249M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 71650K .......... .......... .......... .......... .......... 77% 142M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 71700K .......... .......... .......... .......... .......... 77% 294M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 71750K .......... .......... .......... .......... .......... 77% 155M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 71800K .......... .......... .......... .......... .......... 77% 210M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 71850K .......... .......... .......... .......... .......... 77% 246M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 71900K .......... .......... .......... .......... .......... 77% 206M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 71950K .......... .......... .......... .......... .......... 77% 185M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 72000K .......... .......... .......... .......... .......... 77% 257M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 72050K .......... .......... .......... .......... .......... 77% 251M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 72100K .......... .......... .......... .......... .......... 77% 241M 0s 2024-09-12T00:47:01.997 INFO:teuthology.orchestra.run.smithi137.stderr: 72150K .......... .......... .......... .......... .......... 77% 317M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72200K .......... .......... .......... .......... .......... 77% 239M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72250K .......... .......... .......... .......... .......... 77% 245M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72300K .......... .......... .......... .......... .......... 77% 253M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72350K .......... .......... .......... .......... .......... 77% 149M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72400K .......... .......... .......... .......... .......... 77% 242M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72450K .......... .......... .......... .......... .......... 78% 242M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72500K .......... .......... .......... .......... .......... 78% 164M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72550K .......... .......... .......... .......... .......... 78% 232M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72600K .......... .......... .......... .......... .......... 78% 255M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72650K .......... .......... .......... .......... .......... 78% 347M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72700K .......... .......... .......... .......... .......... 78% 145M 0s 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi137.stderr: 72750K .......... .......... .......... .......... .......... 78% 177M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 72800K .......... .......... .......... .......... .......... 78% 75.2M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 72850K .......... .......... .......... .......... .......... 78% 250M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 72900K .......... .......... .......... .......... .......... 78% 230M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 72950K .......... .......... .......... .......... .......... 78% 127M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73000K .......... .......... .......... .......... .......... 78% 129M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73050K .......... .......... .......... .......... .......... 78% 316M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73100K .......... .......... .......... .......... .......... 78% 150M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73150K .......... .......... .......... .......... .......... 78% 218M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73200K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73250K .......... .......... .......... .......... .......... 78% 243M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73300K .......... .......... .......... .......... .......... 78% 188M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73350K .......... .......... .......... .......... .......... 79% 235M 0s 2024-09-12T00:47:01.999 INFO:teuthology.orchestra.run.smithi137.stderr: 73400K .......... .......... .......... .......... .......... 79% 337M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73450K .......... .......... .......... .......... .......... 79% 79.1M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73500K .......... .......... .......... .......... .......... 79% 194M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73550K .......... .......... .......... .......... .......... 79% 229M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73600K .......... .......... .......... .......... .......... 79% 362M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73650K .......... .......... .......... .......... .......... 79% 155M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73700K .......... .......... .......... .......... .......... 79% 211M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73750K .......... .......... .......... .......... .......... 79% 276M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73800K .......... .......... .......... .......... .......... 79% 50.8M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73850K .......... .......... .......... .......... .......... 79% 222M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73900K .......... .......... .......... .......... .......... 79% 247M 0s 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi137.stderr: 73950K .......... .......... .......... .......... .......... 79% 273M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74000K .......... .......... .......... .......... .......... 79% 285M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74050K .......... .......... .......... .......... .......... 79% 301M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74100K .......... .......... .......... .......... .......... 79% 170M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74150K .......... .......... .......... .......... .......... 79% 96.3M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74200K .......... .......... .......... .......... .......... 79% 135M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74250K .......... .......... .......... .......... .......... 79% 279M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74300K .......... .......... .......... .......... .......... 80% 281M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74350K .......... .......... .......... .......... .......... 80% 137M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74400K .......... .......... .......... .......... .......... 80% 229M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74450K .......... .......... .......... .......... .......... 80% 228M 0s 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi137.stderr: 74500K .......... .......... .......... .......... .......... 80% 284M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74550K .......... .......... .......... .......... .......... 80% 226M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74600K .......... .......... .......... .......... .......... 80% 139M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74650K .......... .......... .......... .......... .......... 80% 251M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74700K .......... .......... .......... .......... .......... 80% 158M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74750K .......... .......... .......... .......... .......... 80% 110M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74800K .......... .......... .......... .......... .......... 80% 84.8M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74850K .......... .......... .......... .......... .......... 80% 266M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74900K .......... .......... .......... .......... .......... 80% 250M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 74950K .......... .......... .......... .......... .......... 80% 266M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 75000K .......... .......... .......... .......... .......... 80% 219M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 75050K .......... .......... .......... .......... .......... 80% 163M 0s 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi137.stderr: 75100K .......... .......... .......... .......... .......... 80% 168M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75150K .......... .......... .......... .......... .......... 80% 280M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75200K .......... .......... .......... .......... .......... 81% 297M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75250K .......... .......... .......... .......... .......... 81% 192M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75300K .......... .......... .......... .......... .......... 81% 83.5M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75350K .......... .......... .......... .......... .......... 81% 279M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75400K .......... .......... .......... .......... .......... 81% 254M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75450K .......... .......... .......... .......... .......... 81% 289M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75500K .......... .......... .......... .......... .......... 81% 216M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75550K .......... .......... .......... .......... .......... 81% 299M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75600K .......... .......... .......... .......... .......... 81% 251M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75650K .......... .......... .......... .......... .......... 81% 287M 0s 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi137.stderr: 75700K .......... .......... .......... .......... .......... 81% 370M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 75750K .......... .......... .......... .......... .......... 81% 134M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 75800K .......... .......... .......... .......... .......... 81% 85.7M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 75850K .......... .......... .......... .......... .......... 81% 265M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 75900K .......... .......... .......... .......... .......... 81% 211M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 75950K .......... .......... .......... .......... .......... 81% 355M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 76000K .......... .......... .......... .......... .......... 81% 214M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 76050K .......... .......... .......... .......... .......... 81% 219M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 76100K .......... .......... .......... .......... .......... 81% 307M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 76150K .......... .......... .......... .......... .......... 82% 95.9M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 76200K .......... .......... .......... .......... .......... 82% 203M 0s 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi137.stderr: 76250K .......... .......... .......... .......... .......... 82% 278M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76300K .......... .......... .......... .......... .......... 82% 255M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76350K .......... .......... .......... .......... .......... 82% 346M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76400K .......... .......... .......... .......... .......... 82% 156M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76450K .......... .......... .......... .......... .......... 82% 264M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76500K .......... .......... .......... .......... .......... 82% 219M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76550K .......... .......... .......... .......... .......... 82% 269M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76600K .......... .......... .......... .......... .......... 82% 308M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76650K .......... .......... .......... .......... .......... 82% 243M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76700K .......... .......... .......... .......... .......... 82% 226M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76750K .......... .......... .......... .......... .......... 82% 43.4M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76800K .......... .......... .......... .......... .......... 82% 101M 0s 2024-09-12T00:47:02.005 INFO:teuthology.orchestra.run.smithi137.stderr: 76850K .......... .......... .......... .......... .......... 82% 301M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 76900K .......... .......... .......... .......... .......... 82% 343M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 76950K .......... .......... .......... .......... .......... 82% 250M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77000K .......... .......... .......... .......... .......... 82% 187M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77050K .......... .......... .......... .......... .......... 82% 238M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77100K .......... .......... .......... .......... .......... 83% 360M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77150K .......... .......... .......... .......... .......... 83% 173M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77200K .......... .......... .......... .......... .......... 83% 114M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77250K .......... .......... .......... .......... .......... 83% 293M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77300K .......... .......... .......... .......... .......... 83% 130M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77350K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77400K .......... .......... .......... .......... .......... 83% 94.4M 0s 2024-09-12T00:47:02.006 INFO:teuthology.orchestra.run.smithi137.stderr: 77450K .......... .......... .......... .......... .......... 83% 203M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77500K .......... .......... .......... .......... .......... 83% 270M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77550K .......... .......... .......... .......... .......... 83% 127M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77600K .......... .......... .......... .......... .......... 83% 83.5M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77650K .......... .......... .......... .......... .......... 83% 167M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77700K .......... .......... .......... .......... .......... 83% 255M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77750K .......... .......... .......... .......... .......... 83% 52.7M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77800K .......... .......... .......... .......... .......... 83% 189M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77850K .......... .......... .......... .......... .......... 83% 238M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77900K .......... .......... .......... .......... .......... 83% 337M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 77950K .......... .......... .......... .......... .......... 83% 218M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 78000K .......... .......... .......... .......... .......... 84% 257M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 78050K .......... .......... .......... .......... .......... 84% 237M 0s 2024-09-12T00:47:02.007 INFO:teuthology.orchestra.run.smithi137.stderr: 78100K .......... .......... .......... .......... .......... 84% 355M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78150K .......... .......... .......... .......... .......... 84% 268M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78200K .......... .......... .......... .......... .......... 84% 286M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78250K .......... .......... .......... .......... .......... 84% 316M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78300K .......... .......... .......... .......... .......... 84% 289M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78350K .......... .......... .......... .......... .......... 84% 291M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78400K .......... .......... .......... .......... .......... 84% 234M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78450K .......... .......... .......... .......... .......... 84% 290M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78500K .......... .......... .......... .......... .......... 84% 361M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78550K .......... .......... .......... .......... .......... 84% 220M 0s 2024-09-12T00:47:02.008 INFO:teuthology.orchestra.run.smithi137.stderr: 78600K .......... .......... .......... .......... .......... 84% 120M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 78650K .......... .......... .......... .......... .......... 84% 147M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 78700K .......... .......... .......... .......... .......... 84% 281M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 78750K .......... .......... .......... .......... .......... 84% 233M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 78800K .......... .......... .......... .......... .......... 84% 148M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 78850K .......... .......... .......... .......... .......... 84% 140M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 78900K .......... .......... .......... .......... .......... 84% 346M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 78950K .......... .......... .......... .......... .......... 85% 193M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 79000K .......... .......... .......... .......... .......... 85% 289M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 79050K .......... .......... .......... .......... .......... 85% 289M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 79100K .......... .......... .......... .......... .......... 85% 279M 0s 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi137.stderr: 79150K .......... .......... .......... .......... .......... 85% 196M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79200K .......... .......... .......... .......... .......... 85% 109M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79250K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79300K .......... .......... .......... .......... .......... 85% 221M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79350K .......... .......... .......... .......... .......... 85% 240M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79400K .......... .......... .......... .......... .......... 85% 246M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79450K .......... .......... .......... .......... .......... 85% 138M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79500K .......... .......... .......... .......... .......... 85% 192M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79550K .......... .......... .......... .......... .......... 85% 241M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79600K .......... .......... .......... .......... .......... 85% 216M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79650K .......... .......... .......... .......... .......... 85% 288M 0s 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi137.stderr: 79700K .......... .......... .......... .......... .......... 85% 136M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 79750K .......... .......... .......... .......... .......... 85% 69.0M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 79800K .......... .......... .......... .......... .......... 85% 99.3M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 79850K .......... .......... .......... .......... .......... 86% 239M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 79900K .......... .......... .......... .......... .......... 86% 92.6M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 79950K .......... .......... .......... .......... .......... 86% 215M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 80000K .......... .......... .......... .......... .......... 86% 229M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 80050K .......... .......... .......... .......... .......... 86% 348M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 80100K .......... .......... .......... .......... .......... 86% 193M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 80150K .......... .......... .......... .......... .......... 86% 69.6M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 80200K .......... .......... .......... .......... .......... 86% 95.5M 0s 2024-09-12T00:47:02.011 INFO:teuthology.orchestra.run.smithi137.stderr: 80250K .......... .......... .......... .......... .......... 86% 237M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80300K .......... .......... .......... .......... .......... 86% 353M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80350K .......... .......... .......... .......... .......... 86% 145M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80400K .......... .......... .......... .......... .......... 86% 220M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80450K .......... .......... .......... .......... .......... 86% 196M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80500K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80550K .......... .......... .......... .......... .......... 86% 351M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80600K .......... .......... .......... .......... .......... 86% 197M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80650K .......... .......... .......... .......... .......... 86% 160M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80700K .......... .......... .......... .......... .......... 86% 121M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80750K .......... .......... .......... .......... .......... 86% 113M 0s 2024-09-12T00:47:02.012 INFO:teuthology.orchestra.run.smithi137.stderr: 80800K .......... .......... .......... .......... .......... 87% 316M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 80850K .......... .......... .......... .......... .......... 87% 262M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 80900K .......... .......... .......... .......... .......... 87% 121M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 80950K .......... .......... .......... .......... .......... 87% 204M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81000K .......... .......... .......... .......... .......... 87% 181M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81050K .......... .......... .......... .......... .......... 87% 219M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81100K .......... .......... .......... .......... .......... 87% 329M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81150K .......... .......... .......... .......... .......... 87% 225M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81200K .......... .......... .......... .......... .......... 87% 147M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81250K .......... .......... .......... .......... .......... 87% 310M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81300K .......... .......... .......... .......... .......... 87% 112M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81350K .......... .......... .......... .......... .......... 87% 221M 0s 2024-09-12T00:47:02.013 INFO:teuthology.orchestra.run.smithi137.stderr: 81400K .......... .......... .......... .......... .......... 87% 196M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81450K .......... .......... .......... .......... .......... 87% 185M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81500K .......... .......... .......... .......... .......... 87% 236M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81550K .......... .......... .......... .......... .......... 87% 324M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81600K .......... .......... .......... .......... .......... 87% 207M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81650K .......... .......... .......... .......... .......... 87% 246M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81700K .......... .......... .......... .......... .......... 87% 320M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81750K .......... .......... .......... .......... .......... 88% 314M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81800K .......... .......... .......... .......... .......... 88% 209M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81850K .......... .......... .......... .......... .......... 88% 248M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81900K .......... .......... .......... .......... .......... 88% 385M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 81950K .......... .......... .......... .......... .......... 88% 64.4M 0s 2024-09-12T00:47:02.014 INFO:teuthology.orchestra.run.smithi137.stderr: 82000K .......... .......... .......... .......... .......... 88% 205M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82050K .......... .......... .......... .......... .......... 88% 191M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82100K .......... .......... .......... .......... .......... 88% 253M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82150K .......... .......... .......... .......... .......... 88% 350M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82200K .......... .......... .......... .......... .......... 88% 63.3M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82250K .......... .......... .......... .......... .......... 88% 62.7M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82300K .......... .......... .......... .......... .......... 88% 185M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82350K .......... .......... .......... .......... .......... 88% 244M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82400K .......... .......... .......... .......... .......... 88% 184M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82450K .......... .......... .......... .......... .......... 88% 307M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82500K .......... .......... .......... .......... .......... 88% 196M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82550K .......... .......... .......... .......... .......... 88% 185M 0s 2024-09-12T00:47:02.015 INFO:teuthology.orchestra.run.smithi137.stderr: 82600K .......... .......... .......... .......... .......... 88% 299M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 82650K .......... .......... .......... .......... .......... 89% 164M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 82700K .......... .......... .......... .......... .......... 89% 118M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 82750K .......... .......... .......... .......... .......... 89% 65.0M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 82800K .......... .......... .......... .......... .......... 89% 109M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 82850K .......... .......... .......... .......... .......... 89% 181M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 82900K .......... .......... .......... .......... .......... 89% 166M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 82950K .......... .......... .......... .......... .......... 89% 251M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 83000K .......... .......... .......... .......... .......... 89% 248M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 83050K .......... .......... .......... .......... .......... 89% 323M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 83100K .......... .......... .......... .......... .......... 89% 225M 0s 2024-09-12T00:47:02.016 INFO:teuthology.orchestra.run.smithi137.stderr: 83150K .......... .......... .......... .......... .......... 89% 358M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83200K .......... .......... .......... .......... .......... 89% 114M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83250K .......... .......... .......... .......... .......... 89% 264M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83300K .......... .......... .......... .......... .......... 89% 188M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83350K .......... .......... .......... .......... .......... 89% 356M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83400K .......... .......... .......... .......... .......... 89% 255M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83450K .......... .......... .......... .......... .......... 89% 329M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83500K .......... .......... .......... .......... .......... 89% 235M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83550K .......... .......... .......... .......... .......... 89% 257M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83600K .......... .......... .......... .......... .......... 90% 274M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83650K .......... .......... .......... .......... .......... 90% 291M 0s 2024-09-12T00:47:02.017 INFO:teuthology.orchestra.run.smithi137.stderr: 83700K .......... .......... .......... .......... .......... 90% 86.9M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 83750K .......... .......... .......... .......... .......... 90% 282M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 83800K .......... .......... .......... .......... .......... 90% 241M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 83850K .......... .......... .......... .......... .......... 90% 315M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 83900K .......... .......... .......... .......... .......... 90% 135M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 83950K .......... .......... .......... .......... .......... 90% 181M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 84000K .......... .......... .......... .......... .......... 90% 184M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 84050K .......... .......... .......... .......... .......... 90% 238M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 84100K .......... .......... .......... .......... .......... 90% 144M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 84150K .......... .......... .......... .......... .......... 90% 214M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 84200K .......... .......... .......... .......... .......... 90% 143M 0s 2024-09-12T00:47:02.018 INFO:teuthology.orchestra.run.smithi137.stderr: 84250K .......... .......... .......... .......... .......... 90% 227M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84300K .......... .......... .......... .......... .......... 90% 227M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84350K .......... .......... .......... .......... .......... 90% 185M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84400K .......... .......... .......... .......... .......... 90% 161M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84450K .......... .......... .......... .......... .......... 90% 247M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84500K .......... .......... .......... .......... .......... 91% 232M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84550K .......... .......... .......... .......... .......... 91% 115M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84600K .......... .......... .......... .......... .......... 91% 142M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84650K .......... .......... .......... .......... .......... 91% 243M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84700K .......... .......... .......... .......... .......... 91% 90.4M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84750K .......... .......... .......... .......... .......... 91% 108M 0s 2024-09-12T00:47:02.019 INFO:teuthology.orchestra.run.smithi137.stderr: 84800K .......... .......... .......... .......... .......... 91% 237M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 84850K .......... .......... .......... .......... .......... 91% 267M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 84900K .......... .......... .......... .......... .......... 91% 67.8M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 84950K .......... .......... .......... .......... .......... 91% 277M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 85000K .......... .......... .......... .......... .......... 91% 139M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 85050K .......... .......... .......... .......... .......... 91% 85.4M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 85100K .......... .......... .......... .......... .......... 91% 153M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 85150K .......... .......... .......... .......... .......... 91% 147M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 85200K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 85250K .......... .......... .......... .......... .......... 91% 108M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 85300K .......... .......... .......... .......... .......... 91% 312M 0s 2024-09-12T00:47:02.020 INFO:teuthology.orchestra.run.smithi137.stderr: 85350K .......... .......... .......... .......... .......... 91% 215M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85400K .......... .......... .......... .......... .......... 91% 212M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85450K .......... .......... .......... .......... .......... 92% 281M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85500K .......... .......... .......... .......... .......... 92% 266M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85550K .......... .......... .......... .......... .......... 92% 281M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85600K .......... .......... .......... .......... .......... 92% 217M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85650K .......... .......... .......... .......... .......... 92% 251M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85700K .......... .......... .......... .......... .......... 92% 227M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85750K .......... .......... .......... .......... .......... 92% 155M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85800K .......... .......... .......... .......... .......... 92% 138M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85850K .......... .......... .......... .......... .......... 92% 182M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85900K .......... .......... .......... .......... .......... 92% 132M 0s 2024-09-12T00:47:02.021 INFO:teuthology.orchestra.run.smithi137.stderr: 85950K .......... .......... .......... .......... .......... 92% 199M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86000K .......... .......... .......... .......... .......... 92% 309M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86050K .......... .......... .......... .......... .......... 92% 238M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86100K .......... .......... .......... .......... .......... 92% 174M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86150K .......... .......... .......... .......... .......... 92% 222M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86200K .......... .......... .......... .......... .......... 92% 227M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86250K .......... .......... .......... .......... .......... 92% 236M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86300K .......... .......... .......... .......... .......... 92% 201M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86350K .......... .......... .......... .......... .......... 93% 349M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86400K .......... .......... .......... .......... .......... 93% 290M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86450K .......... .......... .......... .......... .......... 93% 263M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86500K .......... .......... .......... .......... .......... 93% 290M 0s 2024-09-12T00:47:02.022 INFO:teuthology.orchestra.run.smithi137.stderr: 86550K .......... .......... .......... .......... .......... 93% 288M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 86600K .......... .......... .......... .......... .......... 93% 246M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 86650K .......... .......... .......... .......... .......... 93% 155M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 86700K .......... .......... .......... .......... .......... 93% 46.7M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 86750K .......... .......... .......... .......... .......... 93% 47.2M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 86800K .......... .......... .......... .......... .......... 93% 158M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 86850K .......... .......... .......... .......... .......... 93% 207M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 86900K .......... .......... .......... .......... .......... 93% 202M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 86950K .......... .......... .......... .......... .......... 93% 123M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 87000K .......... .......... .......... .......... .......... 93% 237M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 87050K .......... .......... .......... .......... .......... 93% 292M 0s 2024-09-12T00:47:02.023 INFO:teuthology.orchestra.run.smithi137.stderr: 87100K .......... .......... .......... .......... .......... 93% 185M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87150K .......... .......... .......... .......... .......... 93% 270M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87200K .......... .......... .......... .......... .......... 93% 177M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87250K .......... .......... .......... .......... .......... 93% 234M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87300K .......... .......... .......... .......... .......... 94% 204M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87350K .......... .......... .......... .......... .......... 94% 286M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87400K .......... .......... .......... .......... .......... 94% 185M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87450K .......... .......... .......... .......... .......... 94% 242M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87500K .......... .......... .......... .......... .......... 94% 185M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87550K .......... .......... .......... .......... .......... 94% 213M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87600K .......... .......... .......... .......... .......... 94% 283M 0s 2024-09-12T00:47:02.024 INFO:teuthology.orchestra.run.smithi137.stderr: 87650K .......... .......... .......... .......... .......... 94% 224M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 87700K .......... .......... .......... .......... .......... 94% 164M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 87750K .......... .......... .......... .......... .......... 94% 253M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 87800K .......... .......... .......... .......... .......... 94% 48.5M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 87850K .......... .......... .......... .......... .......... 94% 320M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 87900K .......... .......... .......... .......... .......... 94% 217M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 87950K .......... .......... .......... .......... .......... 94% 319M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 88000K .......... .......... .......... .......... .......... 94% 251M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 88050K .......... .......... .......... .......... .......... 94% 350M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 88100K .......... .......... .......... .......... .......... 94% 73.1M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 88150K .......... .......... .......... .......... .......... 94% 232M 0s 2024-09-12T00:47:02.025 INFO:teuthology.orchestra.run.smithi137.stderr: 88200K .......... .......... .......... .......... .......... 94% 135M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88250K .......... .......... .......... .......... .......... 95% 238M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88300K .......... .......... .......... .......... .......... 95% 80.9M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88350K .......... .......... .......... .......... .......... 95% 274M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88400K .......... .......... .......... .......... .......... 95% 225M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88450K .......... .......... .......... .......... .......... 95% 228M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88500K .......... .......... .......... .......... .......... 95% 267M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88550K .......... .......... .......... .......... .......... 95% 265M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88600K .......... .......... .......... .......... .......... 95% 241M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88650K .......... .......... .......... .......... .......... 95% 357M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88700K .......... .......... .......... .......... .......... 95% 214M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88750K .......... .......... .......... .......... .......... 95% 330M 0s 2024-09-12T00:47:02.026 INFO:teuthology.orchestra.run.smithi137.stderr: 88800K .......... .......... .......... .......... .......... 95% 237M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 88850K .......... .......... .......... .......... .......... 95% 347M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 88900K .......... .......... .......... .......... .......... 95% 200M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 88950K .......... .......... .......... .......... .......... 95% 292M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89000K .......... .......... .......... .......... .......... 95% 41.6M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89050K .......... .......... .......... .......... .......... 95% 306M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89100K .......... .......... .......... .......... .......... 95% 114M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89150K .......... .......... .......... .......... .......... 96% 235M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89200K .......... .......... .......... .......... .......... 96% 267M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89250K .......... .......... .......... .......... .......... 96% 340M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89300K .......... .......... .......... .......... .......... 96% 104M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89350K .......... .......... .......... .......... .......... 96% 222M 0s 2024-09-12T00:47:02.027 INFO:teuthology.orchestra.run.smithi137.stderr: 89400K .......... .......... .......... .......... .......... 96% 235M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89450K .......... .......... .......... .......... .......... 96% 353M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89500K .......... .......... .......... .......... .......... 96% 167M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89550K .......... .......... .......... .......... .......... 96% 244M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89600K .......... .......... .......... .......... .......... 96% 211M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89650K .......... .......... .......... .......... .......... 96% 354M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89700K .......... .......... .......... .......... .......... 96% 86.9M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89750K .......... .......... .......... .......... .......... 96% 57.7M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89800K .......... .......... .......... .......... .......... 96% 186M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89850K .......... .......... .......... .......... .......... 96% 270M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89900K .......... .......... .......... .......... .......... 96% 239M 0s 2024-09-12T00:47:02.028 INFO:teuthology.orchestra.run.smithi137.stderr: 89950K .......... .......... .......... .......... .......... 96% 259M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90000K .......... .......... .......... .......... .......... 96% 188M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90050K .......... .......... .......... .......... .......... 96% 245M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90100K .......... .......... .......... .......... .......... 97% 229M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90150K .......... .......... .......... .......... .......... 97% 325M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90200K .......... .......... .......... .......... .......... 97% 199M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90250K .......... .......... .......... .......... .......... 97% 227M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90300K .......... .......... .......... .......... .......... 97% 138M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90350K .......... .......... .......... .......... .......... 97% 293M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90400K .......... .......... .......... .......... .......... 97% 226M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90450K .......... .......... .......... .......... .......... 97% 97.4M 0s 2024-09-12T00:47:02.029 INFO:teuthology.orchestra.run.smithi137.stderr: 90500K .......... .......... .......... .......... .......... 97% 243M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90550K .......... .......... .......... .......... .......... 97% 342M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90600K .......... .......... .......... .......... .......... 97% 116M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90650K .......... .......... .......... .......... .......... 97% 270M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90700K .......... .......... .......... .......... .......... 97% 217M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90750K .......... .......... .......... .......... .......... 97% 71.7M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90800K .......... .......... .......... .......... .......... 97% 211M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90850K .......... .......... .......... .......... .......... 97% 202M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90900K .......... .......... .......... .......... .......... 97% 141M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 90950K .......... .......... .......... .......... .......... 97% 102M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 91000K .......... .......... .......... .......... .......... 98% 271M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 91050K .......... .......... .......... .......... .......... 98% 234M 0s 2024-09-12T00:47:02.030 INFO:teuthology.orchestra.run.smithi137.stderr: 91100K .......... .......... .......... .......... .......... 98% 62.1M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91150K .......... .......... .......... .......... .......... 98% 212M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91200K .......... .......... .......... .......... .......... 98% 133M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91250K .......... .......... .......... .......... .......... 98% 92.6M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91300K .......... .......... .......... .......... .......... 98% 115M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91350K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91400K .......... .......... .......... .......... .......... 98% 251M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91450K .......... .......... .......... .......... .......... 98% 297M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91500K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91550K .......... .......... .......... .......... .......... 98% 178M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91600K .......... .......... .......... .......... .......... 98% 213M 0s 2024-09-12T00:47:02.031 INFO:teuthology.orchestra.run.smithi137.stderr: 91650K .......... .......... .......... .......... .......... 98% 329M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 91700K .......... .......... .......... .......... .......... 98% 188M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 91750K .......... .......... .......... .......... .......... 98% 244M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 91800K .......... .......... .......... .......... .......... 98% 333M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 91850K .......... .......... .......... .......... .......... 98% 233M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 91900K .......... .......... .......... .......... .......... 98% 223M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 91950K .......... .......... .......... .......... .......... 99% 342M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 92000K .......... .......... .......... .......... .......... 99% 354M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 92050K .......... .......... .......... .......... .......... 99% 151M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 92100K .......... .......... .......... .......... .......... 99% 178M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 92150K .......... .......... .......... .......... .......... 99% 392M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 92200K .......... .......... .......... .......... .......... 99% 355M 0s 2024-09-12T00:47:02.032 INFO:teuthology.orchestra.run.smithi137.stderr: 92250K .......... .......... .......... .......... .......... 99% 188M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92300K .......... .......... .......... .......... .......... 99% 276M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92350K .......... .......... .......... .......... .......... 99% 211M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92400K .......... .......... .......... .......... .......... 99% 227M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92450K .......... .......... .......... .......... .......... 99% 233M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92500K .......... .......... .......... .......... .......... 99% 209M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92550K .......... .......... .......... .......... .......... 99% 258M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92600K .......... .......... .......... .......... .......... 99% 156M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92650K .......... .......... .......... .......... .......... 99% 247M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92700K .......... .......... .......... .......... .......... 99% 262M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92750K .......... .......... .......... .......... .......... 99% 60.9M 0s 2024-09-12T00:47:02.033 INFO:teuthology.orchestra.run.smithi137.stderr: 92800K .......... .......... .......... .......... .......... 99% 73.7M 0s 2024-09-12T00:47:02.034 INFO:teuthology.orchestra.run.smithi137.stderr: 92850K .......... .......... .......... .......... .......... 99% 193M 0s 2024-09-12T00:47:02.034 INFO:teuthology.orchestra.run.smithi137.stderr: 92900K 100% 134G=0.6s 2024-09-12T00:47:02.034 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T00:47:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12 00:47:01 (157 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T00:47:02.034 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T00:47:02.065 INFO:teuthology.orchestra.run.smithi137.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:47:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:47:02.067 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:47:02.068 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:47:02.069 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:47:02.070 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:47:02.071 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:47:02.072 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:47:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:47:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:47:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:47:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:47:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:47:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:47:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:47:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:47:02.081 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:47:02.082 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:47:02.083 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:47:02.084 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:47:02.085 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:47:02.086 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:47:02.086 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:47:02.086 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:47:02.086 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:47:02.086 INFO:teuthology.orchestra.run.smithi137.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:47:02.086 INFO:teuthology.orchestra.run.smithi137.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T00:47:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.388 INFO:teuthology.orchestra.run.smithi137.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:47:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.388 INFO:teuthology.orchestra.run.smithi137.stdout:Here are the highlights of this release: 2024-09-12T00:47:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:47:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:47:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: - Advanced control of transitive versions 2024-09-12T00:47:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: - Support for optional features and dependencies 2024-09-12T00:47:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: - Rules to tweak published metadata 2024-09-12T00:47:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: - Support for Java 13 2024-09-12T00:47:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: - New Zinc compiler for Scala 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: - VS2019 support 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout:------------------------------------------------------------ 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout:Gradle 6.0.1 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout:------------------------------------------------------------ 2024-09-12T00:47:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.392 INFO:teuthology.orchestra.run.smithi137.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:47:02.392 INFO:teuthology.orchestra.run.smithi137.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:47:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.392 INFO:teuthology.orchestra.run.smithi137.stdout:Kotlin: 1.3.50 2024-09-12T00:47:02.392 INFO:teuthology.orchestra.run.smithi137.stdout:Groovy: 2.5.8 2024-09-12T00:47:02.392 INFO:teuthology.orchestra.run.smithi137.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:47:02.393 INFO:teuthology.orchestra.run.smithi137.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T00:47:02.393 INFO:teuthology.orchestra.run.smithi137.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T00:47:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.395 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:47:02.395 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:47:02.395 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T00:47:02.395 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:47:02.395 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T00:47:02.395 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:47:02.656 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:47:02.656 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:47:02.656 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'IPZDUKLJLLQWLWNFIASI', 'access_secret': 'p4JlkVSRro5lvb77izRThSZdX/oJsy2KvidB1+Hn0dcrIXYYczUc1g==', 'region': 'mexico', 'endpoint': 'smithi137.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi137.front.sepia.ceph.com'} 2024-09-12T00:47:02.657 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:47:02.657 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'IPZDUKLJLLQWLWNFIASI', '--secret', 'p4JlkVSRro5lvb77izRThSZdX/oJsy2KvidB1+Hn0dcrIXYYczUc1g==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:47:02.657 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key IPZDUKLJLLQWLWNFIASI --secret p4JlkVSRro5lvb77izRThSZdX/oJsy2KvidB1+Hn0dcrIXYYczUc1g== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:47:02.703 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:02.703 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:02.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.743+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 realm 2024-09-12T00:47:02.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.747+0000 7f192b37e9c0 20 searching for the correct realm 2024-09-12T00:47:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.755+0000 7f1929685640 0 -- 172.21.15.137:0/3322066209 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f191c031040 msgr2=0x7f191c027410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:02.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.759+0000 7f1928e84640 0 -- 172.21.15.137:0/3322066209 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f1920069040 msgr2=0x7f1920077040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:02.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:02.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:47:02.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:02.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:47:02.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:02.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:02.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:02.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:02.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 zone default found 2024-09-12T00:47:02.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 4 Realm: () 2024-09-12T00:47:02.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:47:02.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:47:02.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:02.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 zonegroup default 2024-09-12T00:47:02.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.767+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.771+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.771+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.771+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.771+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.771+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.771+0000 7f192b37e9c0 20 started sync module instance, tier type = 2024-09-12T00:47:02.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.771+0000 7f192b37e9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:47:02.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.791+0000 7f192b37e9c0 20 add_watcher() i=0 2024-09-12T00:47:02.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.791+0000 7f192b37e9c0 20 add_watcher() i=1 2024-09-12T00:47:02.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.791+0000 7f192b37e9c0 20 add_watcher() i=2 2024-09-12T00:47:02.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.791+0000 7f192b37e9c0 20 add_watcher() i=3 2024-09-12T00:47:02.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.791+0000 7f192b37e9c0 20 add_watcher() i=4 2024-09-12T00:47:02.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.791+0000 7f192b37e9c0 20 add_watcher() i=5 2024-09-12T00:47:02.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.791+0000 7f192b37e9c0 20 add_watcher() i=6 2024-09-12T00:47:02.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.795+0000 7f192b37e9c0 20 add_watcher() i=7 2024-09-12T00:47:02.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.795+0000 7f192b37e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f17df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 5 note: GC not initialized 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f17de7e4640 20 reqs_thread_entry: start 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 Filter name: none 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f17d77fe640 20 reqs_thread_entry: start 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:47:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:47:02.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:47:02.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:47:02.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:47:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:47:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache get: name=default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI : miss 2024-09-12T00:47:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache put: name=default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI info.flags=0x0 2024-09-12T00:47:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 adding default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI to cache LRU end 2024-09-12T00:47:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache get: name=default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI : hit (negative entry) 2024-09-12T00:47:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache get: name=default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI : hit (negative entry) 2024-09-12T00:47:02.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:47:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:47:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.799+0000 7f192b37e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:47:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.803+0000 7f17fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366287 cookie 94866260837840 notifier 8276 bl.length()=670 2024-09-12T00:47:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.803+0000 7f17fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:47:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.803+0000 7f17fffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:47:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.807+0000 7f192b37e9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:47:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.807+0000 7f192b37e9c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:47:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.807+0000 7f192b37e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:47:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.807+0000 7f17fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94866260824000 notifier 8276 bl.length()=200 2024-09-12T00:47:02.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.807+0000 7f17fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:47:02.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.807+0000 7f17fffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:47:02.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.811+0000 7f192b37e9c0 10 cache put: name=default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI info.flags=0x7 2024-09-12T00:47:02.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.811+0000 7f192b37e9c0 10 moving default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI to cache LRU end 2024-09-12T00:47:02.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.811+0000 7f192b37e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:IPZDUKLJLLQWLWNFIASI, ofs0, ns] 2024-09-12T00:47:02.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.811+0000 7f17fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94866260832080 notifier 8276 bl.length()=189 2024-09-12T00:47:02.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.811+0000 7f17fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI info.flags=0x7 2024-09-12T00:47:02.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.811+0000 7f17fffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IPZDUKLJLLQWLWNFIASI to cache LRU end 2024-09-12T00:47:02.812 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:47:02.812 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "tester.client.0", 2024-09-12T00:47:02.812 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:47:02.813 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:47:02.813 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:47:02.813 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:47:02.813 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:47:02.813 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:47:02.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:47:02.813 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "tester.client.0", 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "IPZDUKLJLLQWLWNFIASI", 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "p4JlkVSRro5lvb77izRThSZdX/oJsy2KvidB1+Hn0dcrIXYYczUc1g==", 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:47:02.804908Z" 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:47:02.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:47:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "rgw", 2024-09-12T00:47:02.816 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:47:02.816 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "", 2024-09-12T00:47:02.816 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:47:02.816 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:47:02.804894Z", 2024-09-12T00:47:02.816 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:47:02.816 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:47:02.817 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:47:02.817 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:02.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.811+0000 7f17df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:02.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.815+0000 7f192b37e9c0 20 remove_watcher() i=0 2024-09-12T00:47:02.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.815+0000 7f192b37e9c0 2 removed watcher, disabling cache 2024-09-12T00:47:02.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.819+0000 7f192b37e9c0 20 remove_watcher() i=1 2024-09-12T00:47:02.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.823+0000 7f192b37e9c0 20 remove_watcher() i=2 2024-09-12T00:47:02.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.827+0000 7f192b37e9c0 20 remove_watcher() i=3 2024-09-12T00:47:02.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.827+0000 7f192b37e9c0 20 remove_watcher() i=4 2024-09-12T00:47:02.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.831+0000 7f192b37e9c0 20 remove_watcher() i=5 2024-09-12T00:47:02.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.835+0000 7f192b37e9c0 20 remove_watcher() i=6 2024-09-12T00:47:02.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:02.839+0000 7f192b37e9c0 20 remove_watcher() i=7 2024-09-12T00:47:02.857 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:47:02.857 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:47:02.864 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:47:02.864 DEBUG:teuthology.orchestra.run.smithi137:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:47:02.911 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:47:02.984 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:02.985 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:03.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.027+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.031+0000 7f392c6a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.031+0000 7f392c6a29c0 20 realm 2024-09-12T00:47:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.031+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.031+0000 7f392c6a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.031+0000 7f392c6a29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.031+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.031+0000 7f392c6a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.031+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.035+0000 7f392c6a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:03.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.035+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.035+0000 7f392c6a29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:03.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.035+0000 7f392c6a29c0 20 searching for the correct realm 2024-09-12T00:47:03.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.039+0000 7f39299a7640 0 -- 172.21.15.137:0/1829878645 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f3914025040 msgr2=0x7f3914030a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:03.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.047+0000 7f392a9a9640 0 -- 172.21.15.137:0/1829878645 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x559eadc02620 msgr2=0x559eadc04a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:03.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:03.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:47:03.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:03.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:47:03.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:03.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:03.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:03.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 zone default found 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 4 Realm: () 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 zonegroup default 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 started sync module instance, tier type = 2024-09-12T00:47:03.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.055+0000 7f392c6a29c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:47:03.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.083+0000 7f392c6a29c0 20 add_watcher() i=0 2024-09-12T00:47:03.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.083+0000 7f392c6a29c0 20 add_watcher() i=1 2024-09-12T00:47:03.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.083+0000 7f392c6a29c0 20 add_watcher() i=2 2024-09-12T00:47:03.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.083+0000 7f392c6a29c0 20 add_watcher() i=3 2024-09-12T00:47:03.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.083+0000 7f392c6a29c0 20 add_watcher() i=4 2024-09-12T00:47:03.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.083+0000 7f392c6a29c0 20 add_watcher() i=5 2024-09-12T00:47:03.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.083+0000 7f392c6a29c0 20 add_watcher() i=6 2024-09-12T00:47:03.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.087+0000 7f392c6a29c0 20 add_watcher() i=7 2024-09-12T00:47:03.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.087+0000 7f392c6a29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:03.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.087+0000 7f37e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:03.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.091+0000 7f392c6a29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:03.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.091+0000 7f392c6a29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:03.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.167+0000 7f375b7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:03.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.167+0000 7f392c6a29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:47:03.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.167+0000 7f392c6a29c0 20 Filter name: none 2024-09-12T00:47:03.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.167+0000 7f37597fa640 20 reqs_thread_entry: start 2024-09-12T00:47:03.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.167+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:47:03.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:47:03.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.764802820529089515', time=2024-09-12T02:40:51.834279+0000, chain.objs.size()=1 2024-09-12T00:47:03.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.1PFtYyADybeo7z8CM0uxckEaRA6rTFX_0 2024-09-12T00:47:03.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4634488418758871568', time=2024-09-12T02:40:53.356020+0000, chain.objs.size()=1 2024-09-12T00:47:03.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.krgDKDAhfI1YAVgqg-3qA0yLX81Gj9m_0 2024-09-12T00:47:03.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10441638224809146682', time=2024-09-12T02:40:54.653460+0000, chain.objs.size()=1 2024-09-12T00:47:03.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.VVaqneh_mMSDQZDiDF4l3ep7mH7XE0C_0 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4289825894031129658', time=2024-09-12T02:40:54.655169+0000, chain.objs.size()=1 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.R_PXFB_Ad6yPrSXJTt5DosqY2N96PxT_0 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6084334681797450948', time=2024-09-12T02:41:29.445490+0000, chain.objs.size()=1 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.QQWAsN8vTsSX0fO5JHzvqDHMXuIdgb0_0 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8568460540425855901', time=2024-09-12T02:42:04.985849+0000, chain.objs.size()=1 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.xKiQyZHkqNTUgxX49MQLbvdqn8muMxM_0 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16085134960635466967', time=2024-09-12T02:42:37.423453+0000, chain.objs.size()=1 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.06DnIbkMXb2Q9cq4b4nGbZJNst_XSx__0 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11381286937316443297', time=2024-09-12T02:42:39.858597+0000, chain.objs.size()=1 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.D6tHnqPPFbII_7ag7j_RK9vjjbvTaY9_0 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7434726425693237441', time=2024-09-12T02:43:12.057884+0000, chain.objs.size()=1 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.l9ga8E2ECi1kunvxJh8D_24Ha5zmrol_0 2024-09-12T00:47:03.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4281182827482398236', time=2024-09-12T02:43:14.181168+0000, chain.objs.size()=1 2024-09-12T00:47:03.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.AypZOfuLGtQsYcDMYxg9-BSfP79omSd_0 2024-09-12T00:47:03.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39428082549494628', time=2024-09-12T02:43:45.861395+0000, chain.objs.size()=1 2024-09-12T00:47:03.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.sqrAktcesgtQ5nUB1D-DpfofSn8k7lP_0 2024-09-12T00:47:03.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8042411402132301493', time=2024-09-12T02:44:21.243535+0000, chain.objs.size()=1 2024-09-12T00:47:03.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.171+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.-uv3lVTYprpHDy669GT-GGJPKD-5D0L_0 2024-09-12T00:47:03.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.179+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10151883633769722226', time=2024-09-12T02:46:28.011042+0000, chain.objs.size()=1 2024-09-12T00:47:03.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.179+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.fyXPNdjD2CCafq-GO-2YBW5xxNWPWtG_0 2024-09-12T00:47:03.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.183+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.187+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:47:03.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.191+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.191+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11675433722985138976', time=2024-09-12T02:38:23.722274+0000, chain.objs.size()=7 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__multipart_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.1 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__shadow_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.1_1 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__multipart_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.2 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__shadow_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.2_1 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__multipart_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.3 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__shadow_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.3_1 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12__multipart_foo.2~7Vsd5Mfw4tOZdC2C36b5QEQSJGCfiMP.4 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4284001784754705353', time=2024-09-12T02:38:24.195584+0000, chain.objs.size()=5 2024-09-12T00:47:03.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.1 2024-09-12T00:47:03.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__shadow_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.1_1 2024-09-12T00:47:03.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.2 2024-09-12T00:47:03.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__shadow_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.2_1 2024-09-12T00:47:03.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.195+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-FROZEN.2~FAA36PQb7BPFq0lRnVRnkMlIV2VhwD-.3 2024-09-12T00:47:03.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6438348411348334641', time=2024-09-12T02:39:44.628241+0000, chain.objs.size()=1 2024-09-12T00:47:03.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.QqY_z_OuVSxwSmPpf0FkzqyW3fawa0Y_0 2024-09-12T00:47:03.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15578015315128614512', time=2024-09-12T02:39:44.635485+0000, chain.objs.size()=1 2024-09-12T00:47:03.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.jr5SAllVByN7SZLAGKBUKDykPP068Os_0 2024-09-12T00:47:03.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11372672625798777545', time=2024-09-12T02:40:19.728032+0000, chain.objs.size()=1 2024-09-12T00:47:03.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.zQYqWm0kpeLaGeO-ubWHvGQO8pTk_Gu_0 2024-09-12T00:47:03.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7919852479669353164', time=2024-09-12T02:40:51.793626+0000, chain.objs.size()=1 2024-09-12T00:47:03.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.7NMqEBxoyE9nH376UbRIr7C7LzwDkl8_0 2024-09-12T00:47:03.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9756887572511418837', time=2024-09-12T02:40:54.663620+0000, chain.objs.size()=1 2024-09-12T00:47:03.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.r2GTpn1BepK4VOcNrJmDKfoZuZh8198_0 2024-09-12T00:47:03.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2606842018927021489', time=2024-09-12T02:42:05.017560+0000, chain.objs.size()=1 2024-09-12T00:47:03.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.199+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.FkJi3XlC_4v-HcSYjBssfEW_mn7dp8u_0 2024-09-12T00:47:03.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7475327380647708414', time=2024-09-12T02:42:37.417716+0000, chain.objs.size()=1 2024-09-12T00:47:03.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.eUOOVY47otCSLO_KDTcX5X8ACURKSnS_0 2024-09-12T00:47:03.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16351006374495442349', time=2024-09-12T02:42:37.426351+0000, chain.objs.size()=1 2024-09-12T00:47:03.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.9wmiFvBb9W5HqJxrJk3TWMz5wGFVg9C_0 2024-09-12T00:47:03.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17273164702989674031', time=2024-09-12T02:42:39.876764+0000, chain.objs.size()=1 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.HKB1oy8t-7nsXIKXQW4sG6O9TnhTmG6_0 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4508787011637819894', time=2024-09-12T02:43:12.040240+0000, chain.objs.size()=1 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.iK14xrMfeoJSI1NvWV_6Cu59BoVVV-T_0 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1335624981019935001', time=2024-09-12T02:43:14.200181+0000, chain.objs.size()=1 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.rJfkhQ6aA63I6a32Xn30joL46vr_5Ah_0 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14196352923774590687', time=2024-09-12T02:43:14.215372+0000, chain.objs.size()=1 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.Fk_oYUY2IPXZy79opsYwJglfaV4lwft_0 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2128607813600112542', time=2024-09-12T02:43:47.342630+0000, chain.objs.size()=1 2024-09-12T00:47:03.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.207+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.li4kslCohF5-inV3Vc33t53sccjWuUZ_0 2024-09-12T00:47:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.211+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15121061256584395766', time=2024-09-12T02:43:47.357414+0000, chain.objs.size()=1 2024-09-12T00:47:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.211+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.uQd486_om1kWk_uEe5dMyxkoNEmIsgU_0 2024-09-12T00:47:03.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.211+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11061990331456025148', time=2024-09-12T02:43:48.865455+0000, chain.objs.size()=1 2024-09-12T00:47:03.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.211+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.Q7zuYgx3s62admR81N90naU8OAE7bQX_0 2024-09-12T00:47:03.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.211+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15556126622552505471', time=2024-09-12T02:44:21.226781+0000, chain.objs.size()=1 2024-09-12T00:47:03.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.211+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.O-gqOzU40O4BegPIhc86-X4oy6zH_Cp_0 2024-09-12T00:47:03.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.211+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17734492380284245550', time=2024-09-12T02:46:28.011606+0000, chain.objs.size()=1 2024-09-12T00:47:03.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.211+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.RmiWxpdDEvXiWFMGI-Ej7Lvh5HUSNXt_0 2024-09-12T00:47:03.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.219+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.223+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:47:03.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15608017885044275844', time=2024-09-12T02:39:44.653589+0000, chain.objs.size()=1 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.f_bJogdp4J3z1rU6VaviLMDzYdTtKIc_0 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10678841353735002722', time=2024-09-12T02:40:18.657768+0000, chain.objs.size()=1 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.1A6xaOxOeKG64PBBmMEca5RQqaxFMuA_0 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16352044798339557723', time=2024-09-12T02:40:52.916215+0000, chain.objs.size()=1 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.bNa9Cq9j54DyNpDAI4F3BSNjcJMg93M_0 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7497966418472131079', time=2024-09-12T02:40:54.669951+0000, chain.objs.size()=1 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.q7wu66_ph9G-MmfTUVKL4iROPYGULfX_0 2024-09-12T00:47:03.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.227+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3997903394841765895', time=2024-09-12T02:41:26.652568+0000, chain.objs.size()=1 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.lsIGplLt8DKbjMZtZlm_5dLWttjSJCN_0 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12238143633941775545', time=2024-09-12T02:42:03.023218+0000, chain.objs.size()=1 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.GPua20nYT4zpC56dv2j4hLvnZgVccN7_0 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13880883969034340503', time=2024-09-12T02:42:36.960057+0000, chain.objs.size()=1 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.mX93CmPbF-PJq41oKJplRrJ92So9GVN_0 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3674036736217041804', time=2024-09-12T02:42:39.889063+0000, chain.objs.size()=1 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.ciuVciTP9rP7JQC7RJ-GN-_Tk17R7dH_0 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7077840940423909173', time=2024-09-12T02:43:45.864541+0000, chain.objs.size()=1 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.Zpeu1AB8XfG-gqQWakML344Mm862GJ2_0 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17130407896662398417', time=2024-09-12T02:43:45.883795+0000, chain.objs.size()=1 2024-09-12T00:47:03.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.231+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.htpZX3BHj30iaho-3yDlsdNHLuSe4Ey_0 2024-09-12T00:47:03.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.235+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.243+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:47:03.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.243+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:47:03.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1727877715676901833', time=2024-09-12T02:38:23.872825+0000, chain.objs.size()=2 2024-09-12T00:47:03.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.3dG4vsDhUOiLU101QO132qdmvo6Moio_0 2024-09-12T00:47:03.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.3dG4vsDhUOiLU101QO132qdmvo6Moio_1 2024-09-12T00:47:03.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_Cxqqs_p-x7SopvqB770d6MgJifd2dJL', time=2024-09-12T02:38:23.895506+0000, chain.objs.size()=2 2024-09-12T00:47:03.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.iamwPoQXVb_mdC8IAAnL5UsA4KXDAbJ_0 2024-09-12T00:47:03.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.iamwPoQXVb_mdC8IAAnL5UsA4KXDAbJ_1 2024-09-12T00:47:03.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1766724577228741593', time=2024-09-12T02:38:23.907231+0000, chain.objs.size()=2 2024-09-12T00:47:03.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Zd3ilCO_YJnTgakOrZ342hbzUEU2Oql_0 2024-09-12T00:47:03.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Zd3ilCO_YJnTgakOrZ342hbzUEU2Oql_1 2024-09-12T00:47:03.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4422862853459967443', time=2024-09-12T02:39:43.559136+0000, chain.objs.size()=1 2024-09-12T00:47:03.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.FU93TLuGS5dvqoM-CyizfFkaF9HN465_0 2024-09-12T00:47:03.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1590586121907793387', time=2024-09-12T02:39:44.632788+0000, chain.objs.size()=1 2024-09-12T00:47:03.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.F5wyEH7DsJ5jSEcX03EmnNULnxD3lqO_0 2024-09-12T00:47:03.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13340875311137733655', time=2024-09-12T02:39:44.657701+0000, chain.objs.size()=1 2024-09-12T00:47:03.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.dDEPeiFBqZ_T5pXEQ0BnldQr40bUNab_0 2024-09-12T00:47:03.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9010834709436142762', time=2024-09-12T02:40:16.956258+0000, chain.objs.size()=1 2024-09-12T00:47:03.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.cNZmsC1ZYuC_rxkj1fwyvHKIL5se5te_0 2024-09-12T00:47:03.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12440985112779667484', time=2024-09-12T02:40:53.390173+0000, chain.objs.size()=1 2024-09-12T00:47:03.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.qfQZr_Z4cw9VQwyYYUUz48eelvO_erq_0 2024-09-12T00:47:03.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5204506464885044410', time=2024-09-12T02:41:26.631639+0000, chain.objs.size()=1 2024-09-12T00:47:03.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.247+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.iI5xOJ5ozcjYV21UnKyF9UfiaC5ihMN_0 2024-09-12T00:47:03.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.251+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8262276108472164592', time=2024-09-12T02:42:01.091496+0000, chain.objs.size()=1 2024-09-12T00:47:03.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.251+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.BGd-Zy0pr9qO0XYAw0yR9lOEMyX67NF_0 2024-09-12T00:47:03.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.251+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3471678082053531920', time=2024-09-12T02:42:01.101807+0000, chain.objs.size()=1 2024-09-12T00:47:03.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.251+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.tNKYH8QT1Bv09mG127r4GZl9jxsgQDJ_0 2024-09-12T00:47:03.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9599923865266424255', time=2024-09-12T02:42:03.027643+0000, chain.objs.size()=1 2024-09-12T00:47:03.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.OnEXHaguHulK45zHpv-TRzwB9XjgFdR_0 2024-09-12T00:47:03.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12670591334297539182', time=2024-09-12T02:42:37.414111+0000, chain.objs.size()=1 2024-09-12T00:47:03.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.v0mKtQFXwgWDGdJqE5Faren9ZJ-o7Cd_0 2024-09-12T00:47:03.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4068263552075544716', time=2024-09-12T02:42:37.429239+0000, chain.objs.size()=1 2024-09-12T00:47:03.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.BmrZRYfy9Ezfvs6UzLVvalq2iBQNZpg_0 2024-09-12T00:47:03.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5309506032062895611', time=2024-09-12T02:43:13.313638+0000, chain.objs.size()=1 2024-09-12T00:47:03.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.FEGNkw7zwq_TxsYqFP2rqKSj4Acs4Nu_0 2024-09-12T00:47:03.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7479063724343582113', time=2024-09-12T02:43:14.195748+0000, chain.objs.size()=1 2024-09-12T00:47:03.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.739kLlJFjLR-NUOuzWUyvFJhcdXK2-O_0 2024-09-12T00:47:03.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15605498579247694888', time=2024-09-12T02:43:45.867959+0000, chain.objs.size()=1 2024-09-12T00:47:03.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.mKw0GBKCN67nRsG1FXoPkWYsIs7eMxy_0 2024-09-12T00:47:03.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7758255529459223115', time=2024-09-12T02:43:47.361324+0000, chain.objs.size()=1 2024-09-12T00:47:03.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.duIeeaDKQzaBib7LTQ21IgADrsWfksm_0 2024-09-12T00:47:03.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1490893144314665768', time=2024-09-12T02:46:39.904339+0000, chain.objs.size()=1 2024-09-12T00:47:03.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.255+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18__shadow:vg5LyH69CbRJDXZtPGpHlehJ-IHcpqK_.UfbLOlp4-PFVTcWjDyxoDiA8N1aB3Jk_0 2024-09-12T00:47:03.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.263+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.267+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:47:03.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T00:47:03.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_IIHFJtU3WFLvcMHs8jBdY83wM5KpuAG', time=2024-09-12T02:38:24.130991+0000, chain.objs.size()=1 2024-09-12T00:47:03.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.a1mOpuGczRKXuhH10Ha4-CIHgAcvIG4_0 2024-09-12T00:47:03.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2831578355814823032', time=2024-09-12T02:39:43.542696+0000, chain.objs.size()=1 2024-09-12T00:47:03.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.PdP25vWW7rR2Bj0I6Emb7Q23gCUusGE_0 2024-09-12T00:47:03.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10288146871176838962', time=2024-09-12T02:40:16.960186+0000, chain.objs.size()=1 2024-09-12T00:47:03.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.K3PYiKJtrtFA_sx688x2c0XwAI19isx_0 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6897193539464061946', time=2024-09-12T02:40:18.679925+0000, chain.objs.size()=1 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.167qoXzUEb4RpqpcxeMp0wEz340Sh_e_0 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17049900207077447746', time=2024-09-12T02:40:19.720583+0000, chain.objs.size()=1 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.IDbRvHymCHOruBAe9gcDh7pvEGlZfPu_0 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2049169959348403276', time=2024-09-12T02:40:19.735943+0000, chain.objs.size()=1 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.Y1Ske3p4KWEzcxMe4QrOW78Lcy9zWHn_0 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17166402162494835268', time=2024-09-12T02:41:26.634549+0000, chain.objs.size()=1 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.UQZG2V_Xn8aUSIrGUPc1UjCvnmArycZ_0 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6298837107423359622', time=2024-09-12T02:41:26.638760+0000, chain.objs.size()=1 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.27YybXEwkTTzIbMQizzuq_UEwT5cBrE_0 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3662832191257833412', time=2024-09-12T02:42:01.088801+0000, chain.objs.size()=1 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.vxjmPmVM9LnPnzDy5zD9BeKR3K6Qi5x_0 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5160459089533357003', time=2024-09-12T02:42:04.990978+0000, chain.objs.size()=1 2024-09-12T00:47:03.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.643tETIfQJ4upAq_1Ntmiq84oOo8aA4_0 2024-09-12T00:47:03.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15473617544150241566', time=2024-09-12T02:42:37.396690+0000, chain.objs.size()=1 2024-09-12T00:47:03.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.gis_1mVWg2MecPXOM20xwBynjbcW824_0 2024-09-12T00:47:03.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16284234039826190941', time=2024-09-12T02:42:39.885388+0000, chain.objs.size()=1 2024-09-12T00:47:03.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.271+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.bQoQTKM-RY9EXi4Sr0Zf1xhtzLlJd31_0 2024-09-12T00:47:03.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.275+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13182729924588404975', time=2024-09-12T02:43:14.179499+0000, chain.objs.size()=1 2024-09-12T00:47:03.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.275+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.CGAy-7-geJFO1mskan1Y7nbUx6ErorB_0 2024-09-12T00:47:03.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9624670556673075953', time=2024-09-12T02:43:14.199783+0000, chain.objs.size()=1 2024-09-12T00:47:03.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.Jwu_XkNzZOOuLDWfrC4bu3EBoslE-c6_0 2024-09-12T00:47:03.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16312777108303896759', time=2024-09-12T02:43:45.858537+0000, chain.objs.size()=1 2024-09-12T00:47:03.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.3Wc5--EyRIGG4a_Fab0avDaevNJnvg3_0 2024-09-12T00:47:03.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6944733480702683045', time=2024-09-12T02:43:47.354604+0000, chain.objs.size()=1 2024-09-12T00:47:03.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.NVyQ2gyxNM9hXmWpV4d2OtsUXQPV5Ze_0 2024-09-12T00:47:03.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13668723476405063637', time=2024-09-12T02:43:47.358514+0000, chain.objs.size()=1 2024-09-12T00:47:03.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.C8jsakNP31egXZzNmQKZXGkFm74Piuz_0 2024-09-12T00:47:03.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.538817525295245031', time=2024-09-12T02:43:48.859709+0000, chain.objs.size()=1 2024-09-12T00:47:03.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.XuzQy71RS8zg4s_p_Ukb2u7r_F_pGWr_0 2024-09-12T00:47:03.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13810335156033215666', time=2024-09-12T02:43:48.877827+0000, chain.objs.size()=1 2024-09-12T00:47:03.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.nf2kxfJOD3LBbfLIqPp4i_n044U8I1g_0 2024-09-12T00:47:03.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8582893300408718238', time=2024-09-12T02:43:48.886744+0000, chain.objs.size()=1 2024-09-12T00:47:03.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.Qv7eLmQbPhdWNVHxqvTFjsVg3Kw1_9i_0 2024-09-12T00:47:03.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4121483445180164330', time=2024-09-12T02:46:28.018240+0000, chain.objs.size()=1 2024-09-12T00:47:03.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.279+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.lEh1eqhFO0q_OpDFQbsjxvRVmB86Z-x_0 2024-09-12T00:47:03.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.287+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.291+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:47:03.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.291+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18082052346983333561', time=2024-09-12T02:38:23.584718+0000, chain.objs.size()=1 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.E71GqXb3IfGVS_gMYYntXcK1Ax9w5cc_0 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2317704166395227262', time=2024-09-12T02:38:23.819374+0000, chain.objs.size()=4 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9__multipart_foo.2~dWb6fegdDmhi6UDHsonUOSpreTL04Ms.1 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9__multipart_foo.2~dWb6fegdDmhi6UDHsonUOSpreTL04Ms.2 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9__multipart_foo.2~dWb6fegdDmhi6UDHsonUOSpreTL04Ms.3 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9__multipart_foo.2~dWb6fegdDmhi6UDHsonUOSpreTL04Ms.4 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11731696310696778318', time=2024-09-12T02:38:24.388369+0000, chain.objs.size()=1 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7__shadow_.4UrRVB6LTrdj7wsaco04Rb9zpHhHeaH_0 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.768027393391991978', time=2024-09-12T02:39:43.556445+0000, chain.objs.size()=1 2024-09-12T00:47:03.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.ne_4UIh9hi5PF2yIC2vfWHkodGGTTIi_0 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4413173786685539269', time=2024-09-12T02:39:43.567213+0000, chain.objs.size()=1 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.cGhRGD6iKAXaaSuDS9keZqaQH9UWnbU_0 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.865901010748720808', time=2024-09-12T02:39:44.651807+0000, chain.objs.size()=1 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.zQdLFLaC_ogS_AFYbncIS1Veq1Ttxkw_0 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5783056446558989571', time=2024-09-12T02:40:16.977038+0000, chain.objs.size()=1 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.q2rSjlaxd7f5mrh00u9-ATApFmFZpqR_0 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3905421189042636435', time=2024-09-12T02:40:18.676096+0000, chain.objs.size()=1 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.b3DxU0yfY6GCXxswV5Di3YU5aRPuN17_0 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14305900497477080526', time=2024-09-12T02:40:51.794086+0000, chain.objs.size()=1 2024-09-12T00:47:03.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.295+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.JBte87_Rt7wa-pu8mvATFMwS88Svcnn_0 2024-09-12T00:47:03.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.299+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17578668089534670026', time=2024-09-12T02:40:51.812169+0000, chain.objs.size()=1 2024-09-12T00:47:03.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.299+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.gGTZJT0jjUcL9T-xhEB74x56xKWhcg2_0 2024-09-12T00:47:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.299+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12438789862653960581', time=2024-09-12T02:40:54.663451+0000, chain.objs.size()=1 2024-09-12T00:47:03.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.299+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.hwWK6uxZb8iA1PVao-3EEmFDLmPyEu9_0 2024-09-12T00:47:03.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.299+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18351850072429288634', time=2024-09-12T02:40:54.678935+0000, chain.objs.size()=1 2024-09-12T00:47:03.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.299+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.x9lcpFkyrDSjkM3HMwmcU5sOW5JlPIH_0 2024-09-12T00:47:03.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18097294654507031438', time=2024-09-12T02:41:29.446025+0000, chain.objs.size()=1 2024-09-12T00:47:03.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.md02Y9LD8O6Zbc6qC9kYdKo4Z1-uoxV_0 2024-09-12T00:47:03.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6124426322659468917', time=2024-09-12T02:42:01.112398+0000, chain.objs.size()=1 2024-09-12T00:47:03.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.11rV6csRgYepdT_2CLJFwU08WvsVH0b_0 2024-09-12T00:47:03.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.76642863084474435', time=2024-09-12T02:42:39.867828+0000, chain.objs.size()=1 2024-09-12T00:47:03.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.aVme4t4O7CqN_sXndNdBoMdNFkKx_3e_0 2024-09-12T00:47:03.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11635706119957445820', time=2024-09-12T02:43:47.339670+0000, chain.objs.size()=1 2024-09-12T00:47:03.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.gxzhZ2B99JLKaJccY9p5DyLBrQHFEKs_0 2024-09-12T00:47:03.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8547084408962901606', time=2024-09-12T02:43:48.865446+0000, chain.objs.size()=1 2024-09-12T00:47:03.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.CLTYHGdcWycw5aS-496g-YjirBgYD3E_0 2024-09-12T00:47:03.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13114703941432138080', time=2024-09-12T02:46:28.022400+0000, chain.objs.size()=1 2024-09-12T00:47:03.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.303+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_._PX2DJ9hxvSzasFF5K4k4mB7hDm0XVt_0 2024-09-12T00:47:03.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.307+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.311+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:47:03.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:47:03.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13565597472375044945', time=2024-09-12T02:38:23.600710+0000, chain.objs.size()=1 2024-09-12T00:47:03.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.pqJSszpV73iqOEAEhGBcos_PMCKQl9h_0 2024-09-12T00:47:03.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14632437925105352469', time=2024-09-12T02:38:24.411105+0000, chain.objs.size()=1 2024-09-12T00:47:03.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7__shadow_.Pla0T3Ue7Nz1iXTLwSS5YkuFoVWjfZ8_0 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2701829754307325910', time=2024-09-12T02:39:43.541118+0000, chain.objs.size()=1 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.1u0QFNT_xXJg68lpOTNWrhO89wZ3kyV_0 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1351065769125500950', time=2024-09-12T02:39:44.641666+0000, chain.objs.size()=1 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.yqbKOPMNMH72mPGvlpkPPORWWh710NQ_0 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18335288716439762802', time=2024-09-12T02:40:16.956904+0000, chain.objs.size()=1 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.HN80haDcGYVI9ZPDpq8ibnscSw4-MmL_0 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9595196443668922473', time=2024-09-12T02:40:16.967517+0000, chain.objs.size()=1 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.xErlc-eAtvpR3jKTM7i8pJapl8LvnP9_0 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14734846369776456682', time=2024-09-12T02:42:01.091218+0000, chain.objs.size()=1 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_._7LGotYmL72wlxgRf-dPX1ctwn1iBH__0 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7729942842682631490', time=2024-09-12T02:42:39.854191+0000, chain.objs.size()=1 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.pZ_TzyxdBbl9awb7-U_RPML7NOV7psA_0 2024-09-12T00:47:03.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18408668731760760955', time=2024-09-12T02:43:14.179009+0000, chain.objs.size()=1 2024-09-12T00:47:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.fPV6JeuwyJMFWtEj5jlhlSntS7anBB6_0 2024-09-12T00:47:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11389807626404343255', time=2024-09-12T02:43:47.349758+0000, chain.objs.size()=1 2024-09-12T00:47:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.JnSEB8Xa3Eo--8H-x2EAnwszalUpLEo_0 2024-09-12T00:47:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.122326358901373888', time=2024-09-12T02:43:48.884429+0000, chain.objs.size()=1 2024-09-12T00:47:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.u1E8cmq9CxBZD8z74MqEFFl_1MSjOyd_0 2024-09-12T00:47:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1024958969025617250', time=2024-09-12T02:46:28.012697+0000, chain.objs.size()=1 2024-09-12T00:47:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.315+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.4EGgV2YocDR6jYTTg5Cqwy5jDcLStC-_0 2024-09-12T00:47:03.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.323+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:47:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:47:03.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13464161237666588757', time=2024-09-12T02:38:23.861557+0000, chain.objs.size()=2 2024-09-12T00:47:03.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.3dG4vsDhUOiLU101QO132qdmvo6Moio_0 2024-09-12T00:47:03.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.3dG4vsDhUOiLU101QO132qdmvo6Moio_1 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15392162542722894952', time=2024-09-12T02:38:23.929802+0000, chain.objs.size()=2 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Zd3ilCO_YJnTgakOrZ342hbzUEU2Oql_0 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Zd3ilCO_YJnTgakOrZ342hbzUEU2Oql_1 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7523698091026624793', time=2024-09-12T02:40:18.663883+0000, chain.objs.size()=1 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.CGm1dhXY_Z4fkFLV1A9pr7Wz4LHAjeP_0 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1296991574570622082', time=2024-09-12T02:40:19.723476+0000, chain.objs.size()=1 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.EBHBYujs1Vq0TEcx1VA1IkmcegYI_qh_0 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10488626941336474029', time=2024-09-12T02:41:29.432119+0000, chain.objs.size()=1 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.X3-UX2iDmSnOkpMWij0QdmvWrnC5o3K_0 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8066450919492229420', time=2024-09-12T02:41:29.446384+0000, chain.objs.size()=1 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.C3FiMurTt-PQNK_IrLlMObhJW86ECWB_0 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6948458470563678539', time=2024-09-12T02:41:29.449319+0000, chain.objs.size()=1 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.LAFc0tefHT2p_AxBf7P2KnDymOt53dT_0 2024-09-12T00:47:03.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14405439041870131556', time=2024-09-12T02:42:01.098867+0000, chain.objs.size()=1 2024-09-12T00:47:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.jQqcaQXrIcFPTLuw-6Tx4jMBbsvUEKZ_0 2024-09-12T00:47:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3958411559446323056', time=2024-09-12T02:42:03.042253+0000, chain.objs.size()=1 2024-09-12T00:47:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.K7KF8Ibv9L8F1P9IIH5cPc6jjD9lOXt_0 2024-09-12T00:47:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6941285954342750122', time=2024-09-12T02:43:12.038741+0000, chain.objs.size()=1 2024-09-12T00:47:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.327+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.5TFJ6mCvDGg0V5MAP68ZFLcijU8imff_0 2024-09-12T00:47:03.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8935028136715645076', time=2024-09-12T02:43:12.060541+0000, chain.objs.size()=1 2024-09-12T00:47:03.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.MzZs3Lm6eM3CYYDV5ATTLgGChUbmrbM_0 2024-09-12T00:47:03.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4311748506376877028', time=2024-09-12T02:43:14.190007+0000, chain.objs.size()=1 2024-09-12T00:47:03.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.uMRPRAQdwXU6g6Zp3yIegx2GdxADVzY_0 2024-09-12T00:47:03.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4715957670999224290', time=2024-09-12T02:44:21.220174+0000, chain.objs.size()=1 2024-09-12T00:47:03.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.gf6O27lU0UEE8GVZrtA52poDIH1bAbB_0 2024-09-12T00:47:03.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14151399071301637938', time=2024-09-12T02:46:28.013340+0000, chain.objs.size()=1 2024-09-12T00:47:03.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.Bmg14I91BqEJTGj68RyTYmOhqhHu9rL_0 2024-09-12T00:47:03.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16849752022375338370', time=2024-09-12T02:46:35.380254+0000, chain.objs.size()=1 2024-09-12T00:47:03.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.335+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18__shadow:btUbJH9Q2vzsdiMqydnC-VlO.HR4cme_.PARJ42waqZ60vBLzP0fr4DS4Url0P7W_0 2024-09-12T00:47:03.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.339+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.343+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:47:03.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.343+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.343+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:47:03.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2728085434152388860', time=2024-09-12T02:38:24.272291+0000, chain.objs.size()=3 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.7VO0ay2Ue86qeJGF4kUjuBRErcGwpIr_0 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.7VO0ay2Ue86qeJGF4kUjuBRErcGwpIr_1 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.7VO0ay2Ue86qeJGF4kUjuBRErcGwpIr_2 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14735142168636370161', time=2024-09-12T02:38:24.400187+0000, chain.objs.size()=1 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7__shadow_.xJtmB7gR5gUIs_wSr9Lc6lhxhKCGpxl_0 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16646221818667131189', time=2024-09-12T02:39:43.544217+0000, chain.objs.size()=1 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.EMxgh4s2XLKVDCbXtivMPllGinaH-d9_0 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.772973640990670360', time=2024-09-12T02:40:16.978209+0000, chain.objs.size()=1 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.TGrW4UDVbedfV2qX3smn8rl4kdoOuPQ_0 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8772864267860893945', time=2024-09-12T02:40:18.238754+0000, chain.objs.size()=1 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.85hDyajB5nPWb-QYeMekRcmByYUHxMR_0 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6811323165435054880', time=2024-09-12T02:41:26.654779+0000, chain.objs.size()=1 2024-09-12T00:47:03.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.667rWuh_svdWAWoHC6UvPnpm7DIhimX_0 2024-09-12T00:47:03.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8199280658012355423', time=2024-09-12T02:42:01.098546+0000, chain.objs.size()=1 2024-09-12T00:47:03.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.vp5bTr2Engf2SgznFbL2AbWN1wkkZEs_0 2024-09-12T00:47:03.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5968035581420371065', time=2024-09-12T02:42:01.101107+0000, chain.objs.size()=1 2024-09-12T00:47:03.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.XK83F1LZkwkCFrFFVVhZFfME-dnvcfe_0 2024-09-12T00:47:03.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10635981123076319104', time=2024-09-12T02:42:37.395385+0000, chain.objs.size()=1 2024-09-12T00:47:03.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.BsgWeTxte_wOjiPkAq_cXxzwqAPfxQQ_0 2024-09-12T00:47:03.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8163615080009269746', time=2024-09-12T02:42:37.401266+0000, chain.objs.size()=1 2024-09-12T00:47:03.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.347+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.wskcFnRLoIegxCvTDJy07KBKF4pi5oy_0 2024-09-12T00:47:03.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5731783273352651170', time=2024-09-12T02:42:39.862481+0000, chain.objs.size()=1 2024-09-12T00:47:03.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.HO-ssNF36v_ijBxVtewx0j_PgthEHXI_0 2024-09-12T00:47:03.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2170677158496913996', time=2024-09-12T02:43:14.176919+0000, chain.objs.size()=1 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_._J_fj8-Si5tpnvzIva_RUxB31JuPlHL_0 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16820500038228058204', time=2024-09-12T02:43:46.912837+0000, chain.objs.size()=1 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.p5yZwAEBS8hj5wrNTKPMMO3JqIqoQsQ_0 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12626401631205828747', time=2024-09-12T02:43:47.352857+0000, chain.objs.size()=1 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.xN5LR8IdgU2HV2TXUFdX3lmdM8TXf4p_0 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1671753815692017684', time=2024-09-12T02:43:47.354791+0000, chain.objs.size()=1 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.SLBzi55Do5ZiTM42ruYNmUS-KwebsSj_0 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1388935517971175292', time=2024-09-12T02:43:47.358291+0000, chain.objs.size()=1 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_._Fn6iw-K5lf2k4sZNxVax14Tuq67ggi_0 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11972826857171330538', time=2024-09-12T02:43:47.367375+0000, chain.objs.size()=1 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.qZGBICtqVL7Ffaqfe9ej_Scnrv9Vx4B_0 2024-09-12T00:47:03.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2611236446956763832', time=2024-09-12T02:43:48.871009+0000, chain.objs.size()=1 2024-09-12T00:47:03.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.5vyKfrgQhYCkXNiTyP7AcfBx8_agl-m_0 2024-09-12T00:47:03.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9484972615631231157', time=2024-09-12T02:44:21.239216+0000, chain.objs.size()=1 2024-09-12T00:47:03.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.351+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.kJnp4OfA-Qp2OHOUftcLyvM3z7Yu5Ew_0 2024-09-12T00:47:03.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.359+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.359+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:47:03.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:47:03.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7336346608119678845', time=2024-09-12T02:39:44.635067+0000, chain.objs.size()=1 2024-09-12T00:47:03.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.y5P6Dy55F2MVWfh0r8AAnmm0TBdoJhX_0 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9555206484805870407', time=2024-09-12T02:40:16.957024+0000, chain.objs.size()=1 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.cthIzJtBrEAv20assdfp6t43BMYgNWO_0 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9042135664568273283', time=2024-09-12T02:40:18.661918+0000, chain.objs.size()=1 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.FaBbqoYpX9gV2aExhKAgPY25Qd4xNH0_0 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14771317490232016248', time=2024-09-12T02:40:19.736970+0000, chain.objs.size()=1 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.OUbrJAxu8FOh8xvMcvfDq5CAZqTnjwj_0 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8314242194174718391', time=2024-09-12T02:40:53.371213+0000, chain.objs.size()=1 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.XNjWV9iaG1Rs9FH-IBHDfW-DrZ9I1mq_0 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4713697680177343990', time=2024-09-12T02:41:26.629090+0000, chain.objs.size()=1 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.PooHACLGHzy4GbTxnYw76yXopK92chQ_0 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12292142552163258598', time=2024-09-12T02:41:29.430110+0000, chain.objs.size()=1 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.gnwGGuHxdiXtFnQqDTxR43ewkRg7OLW_0 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15329249605673008208', time=2024-09-12T02:41:29.431021+0000, chain.objs.size()=1 2024-09-12T00:47:03.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.AVmZ3egXOf3xB9fwaVpLwNpSQkguFyG_0 2024-09-12T00:47:03.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1145690714350517870', time=2024-09-12T02:42:03.038855+0000, chain.objs.size()=1 2024-09-12T00:47:03.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.iVMXRmuy4vNI6_fg9hPJk0E28FN66wN_0 2024-09-12T00:47:03.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17381043821312631003', time=2024-09-12T02:42:03.040947+0000, chain.objs.size()=1 2024-09-12T00:47:03.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.PQRpuIRp_x0P9tga1OcvvyFZ38UJeS5_0 2024-09-12T00:47:03.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4562222258235383607', time=2024-09-12T02:42:04.998732+0000, chain.objs.size()=1 2024-09-12T00:47:03.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.Qa4uKHs4MW3SxYnNlSPgWRmBzAUKYjb_0 2024-09-12T00:47:03.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16423055923090687140', time=2024-09-12T02:42:04.999661+0000, chain.objs.size()=1 2024-09-12T00:47:03.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.363+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.D_FtiUSJnP1iZJ4T2B2LuaUxbdg8qOh_0 2024-09-12T00:47:03.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.367+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5011056029151197858', time=2024-09-12T02:43:14.198727+0000, chain.objs.size()=1 2024-09-12T00:47:03.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.367+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.NbKbNKbPeTqPaT9EAXDRwdVe_RmAp-F_0 2024-09-12T00:47:03.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.367+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6707930499831269013', time=2024-09-12T02:43:14.220708+0000, chain.objs.size()=1 2024-09-12T00:47:03.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.367+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.8t2zzpB4n0miLK7mqgjzPTVJdLFiGKP_0 2024-09-12T00:47:03.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.367+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13064795786086307746', time=2024-09-12T02:46:39.901472+0000, chain.objs.size()=1 2024-09-12T00:47:03.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.367+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18__shadow:wFRehKEK6KHPDGvr15PUZI6h0bO8vgO_.4yaZT0Sf1ppG59lSJPbijs1rKVV7EQG_0 2024-09-12T00:47:03.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.371+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.375+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:47:03.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.375+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.375+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_74IvHFLQZ58y8ku5eDxrcM0qlUOMMCP', time=2024-09-12T02:38:23.940945+0000, chain.objs.size()=2 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.udap7EJSsQt9134NWKtQfxiAtJMJ6Gm_0 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.udap7EJSsQt9134NWKtQfxiAtJMJ6Gm_1 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_kSFjkRJpvri2VKxKgxAtElqxnpu1nEY', time=2024-09-12T02:38:23.974849+0000, chain.objs.size()=1 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.jY8x4BKpAMsvw5C5cuZwV4_kN6sRgN1_0 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_buaLVvxWYEHxi9eMD-MBCcRbLerAlaf', time=2024-09-12T02:38:24.084330+0000, chain.objs.size()=3 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.kDV_Dirie0e0IRSW87zqqK8AEcZbApb_0 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.kDV_Dirie0e0IRSW87zqqK8AEcZbApb_1 2024-09-12T00:47:03.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.kDV_Dirie0e0IRSW87zqqK8AEcZbApb_2 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1252510230179875176', time=2024-09-12T02:40:16.974775+0000, chain.objs.size()=1 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.u_p6uJJDbBVsSbKiCKX3z86oCEOvDCx_0 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13021129209809980817', time=2024-09-12T02:40:54.662679+0000, chain.objs.size()=1 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.zWz1s5vsr25bC2Yx_rgEAbj8wVmow4__0 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8707946420092951047', time=2024-09-12T02:42:01.125541+0000, chain.objs.size()=1 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.iYOlFAlZMlEPGFdiMyerhxuZy5tpKmi_0 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6490914678330026039', time=2024-09-12T02:42:04.987785+0000, chain.objs.size()=1 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.lkr3OXY615iRylOogSF9u7OzCoBJXWB_0 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15520795964425085574', time=2024-09-12T02:42:37.413593+0000, chain.objs.size()=1 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.pQgK976lt8X4GI2nLoZW5tEJertYtL__0 2024-09-12T00:47:03.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18106032878948335743', time=2024-09-12T02:42:39.881788+0000, chain.objs.size()=1 2024-09-12T00:47:03.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.379+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.aGk__C30f4AjNylAgaOCS9GbhXjAhok_0 2024-09-12T00:47:03.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7085636768651371258', time=2024-09-12T02:43:12.044718+0000, chain.objs.size()=1 2024-09-12T00:47:03.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.V1K9DfA6euBYJMcQF1D9WqTJF1HDLkc_0 2024-09-12T00:47:03.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15487200551088820909', time=2024-09-12T02:43:12.054593+0000, chain.objs.size()=1 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.eFuP5oPTGAxKBdH-znfkD4Mf_DXAS9n_0 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11951181394791545989', time=2024-09-12T02:43:47.348666+0000, chain.objs.size()=1 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.t3v0ZlPrfeRN5344M0g8ItqlTYLchZS_0 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15419523588296194192', time=2024-09-12T02:43:48.878689+0000, chain.objs.size()=1 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.KqvfJZ7WoMIKLutayI1mfd5bm8q49Av_0 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17167328811087872445', time=2024-09-12T02:44:21.233510+0000, chain.objs.size()=1 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.f0xiWSjZdyJKAWbRyFLnEafPjPLmGSk_0 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2465397326786594287', time=2024-09-12T02:46:28.011504+0000, chain.objs.size()=1 2024-09-12T00:47:03.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.383+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.xD2E4qrnYU2tcb4KC2qHqYPSxBGjk9N_0 2024-09-12T00:47:03.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.387+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:47:03.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:47:03.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11091927205037828304', time=2024-09-12T02:39:43.550790+0000, chain.objs.size()=1 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.gucE33NdnIsEvMEHd6zfAgNYJPwzBjq_0 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9920242677047519916', time=2024-09-12T02:39:43.573870+0000, chain.objs.size()=1 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_._PSmC4oQwOr9GloVXbNqmNh0_QJJ4n__0 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.382267345032514647', time=2024-09-12T02:40:16.986750+0000, chain.objs.size()=1 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.DTOkz_WMVMUEkve3ikA8sQn5juI529a_0 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15904062968771021686', time=2024-09-12T02:40:18.664760+0000, chain.objs.size()=1 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.CDm1RJwdSebNbqUkvC10TsD7dvTiX5R_0 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1644940170131722209', time=2024-09-12T02:41:26.634034+0000, chain.objs.size()=1 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.zTgjs2bpZ3xAvGGLk2O-UtEgO2agNO5_0 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3417159911107465767', time=2024-09-12T02:42:03.018202+0000, chain.objs.size()=1 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.mG7O4eLQz8p7DaLDehLcF_IdL9jeGv__0 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8949740331604969032', time=2024-09-12T02:42:04.996875+0000, chain.objs.size()=1 2024-09-12T00:47:03.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.XShE24U7MGop0qQqTeQxDgxE5IyUr8__0 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7677304473373213811', time=2024-09-12T02:42:05.000409+0000, chain.objs.size()=1 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.3tmxoe-kniCUuTn1mMGhKhdkNOgkbWG_0 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10494825134454308669', time=2024-09-12T02:43:12.044654+0000, chain.objs.size()=1 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.YrGcUtBZYdZFM_X_5W493nMBTYOTDYl_0 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17473630921771387248', time=2024-09-12T02:43:14.205440+0000, chain.objs.size()=1 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.gxZeON7Am5gzEqAw8skfs53Qn-Dre2i_0 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.752932404399386707', time=2024-09-12T02:44:21.239436+0000, chain.objs.size()=1 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.Q9yZD7e61IfMkr0iUOAQoRo_FdPkkRh_0 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8994562935292735780', time=2024-09-12T02:46:28.017493+0000, chain.objs.size()=1 2024-09-12T00:47:03.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.391+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.nqUWQuA0Xxh3Bbie81xc24NgN2RZ7Ru_0 2024-09-12T00:47:03.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.399+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:47:03.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:47:03.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2690242146807296384', time=2024-09-12T02:38:23.609513+0000, chain.objs.size()=1 2024-09-12T00:47:03.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.NtOmBj32aRH3tQg6gRPonRWHONRrAcI_0 2024-09-12T00:47:03.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11142735719276150189', time=2024-09-12T02:38:23.618347+0000, chain.objs.size()=1 2024-09-12T00:47:03.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.XpV3YB_cVgYYN1T-Mto-CzOYYZwfiKG_0 2024-09-12T00:47:03.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_RhXoA_rMAg1k5-QqhSu0F_RljYEaBXh', time=2024-09-12T02:38:23.963612+0000, chain.objs.size()=1 2024-09-12T00:47:03.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Pf5vRn6dPAInCRcKWiEp1k-4bXkKEdM_0 2024-09-12T00:47:03.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7152380700479614482', time=2024-09-12T02:39:44.640210+0000, chain.objs.size()=1 2024-09-12T00:47:03.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.L1j59a6mOz3tS6qNXTgIBCbMGibiVTP_0 2024-09-12T00:47:03.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16740338920856231291', time=2024-09-12T02:40:19.733705+0000, chain.objs.size()=1 2024-09-12T00:47:03.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.EuKXBjpU2NBa-NpoZrplMXzzrJruSpH_0 2024-09-12T00:47:03.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17254899515845653063', time=2024-09-12T02:40:19.738879+0000, chain.objs.size()=1 2024-09-12T00:47:03.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.oNXa9RJzeOdMGo4WZJq7buEICQhCqSc_0 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5356232925334959586', time=2024-09-12T02:40:53.373333+0000, chain.objs.size()=1 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.TbhkucSVHS5LhJgk7jtbKiSqvlIIPPI_0 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.845347382696818196', time=2024-09-12T02:42:03.016688+0000, chain.objs.size()=1 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.KWkVbxlbA211S_RNMY2g-jU_l3R5iza_0 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11139148781481775800', time=2024-09-12T02:42:37.419234+0000, chain.objs.size()=1 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.znoFXHxiG0lToueoCWxed9HtWK5NVc7_0 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12630776658716478688', time=2024-09-12T02:43:14.171095+0000, chain.objs.size()=1 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.gcY5MQkhE1ekNcb-FcEktoy8imSzJet_0 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14260274756537364055', time=2024-09-12T02:43:14.187305+0000, chain.objs.size()=1 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.LHf4nEW6ietweeItTrcVggXT9Ly_Y7g_0 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11841849887552133839', time=2024-09-12T02:43:47.350966+0000, chain.objs.size()=1 2024-09-12T00:47:03.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.403+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.AL84AUv4nWll99C5Gqso3FAkG9Wi7ua_0 2024-09-12T00:47:03.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.407+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12500017585230762440', time=2024-09-12T02:43:48.863279+0000, chain.objs.size()=1 2024-09-12T00:47:03.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.407+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.nCUu_qKMsA76qMcJEH3B3dAXB1J-jRL_0 2024-09-12T00:47:03.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.411+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.411+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:47:03.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:47:03.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_N4KOTQBXNti4Vbhqyd7ccmbNyqBMESx', time=2024-09-12T02:38:24.108883+0000, chain.objs.size()=3 2024-09-12T00:47:03.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.Bg-juM9rd7gByJ4CQDX1RUh25xtxVWs_0 2024-09-12T00:47:03.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.Bg-juM9rd7gByJ4CQDX1RUh25xtxVWs_1 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.Bg-juM9rd7gByJ4CQDX1RUh25xtxVWs_2 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3953113063790806831', time=2024-09-12T02:39:43.105401+0000, chain.objs.size()=1 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.faWAL_Mr5xBf6HKtMDe0vz9grpzrKfk_0 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6271728186993261200', time=2024-09-12T02:39:43.561071+0000, chain.objs.size()=1 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.eKYQ0pjj5DoAhK_vKXh9KvMd5qSneWt_0 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17942047972659332030', time=2024-09-12T02:40:18.673486+0000, chain.objs.size()=1 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.9Zkr60gYor2nZuqaK9Wyi2gufXNDYvF_0 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15600209326434128375', time=2024-09-12T02:40:18.682145+0000, chain.objs.size()=1 2024-09-12T00:47:03.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.NYR2YOqV6EdvxRsKWDN7TiTO_TkHh7p_0 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8264870948302178917', time=2024-09-12T02:40:19.728204+0000, chain.objs.size()=1 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.PF9Wz2C1Y8zdux-hec-ZeTrsS8XIXQn_0 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.800547742231412183', time=2024-09-12T02:40:19.737932+0000, chain.objs.size()=1 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.uCaf6GbLYHUQOnkwxanF4C00zE8gsV-_0 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14806396890806401533', time=2024-09-12T02:40:51.805320+0000, chain.objs.size()=1 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.sKPLZF1kHpUZk8diyiy3XBPJe0DT7_w_0 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4095527704575888243', time=2024-09-12T02:41:28.153086+0000, chain.objs.size()=1 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.pt3zlDyxmcc6kNDoyvqDjGh80sFLP65_0 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4270986785243493569', time=2024-09-12T02:42:03.035228+0000, chain.objs.size()=1 2024-09-12T00:47:03.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.415+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.MYEIexAdtu9Anye9PDhL2AENylQqZ2T_0 2024-09-12T00:47:03.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.419+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5484035397506816876', time=2024-09-12T02:43:45.865056+0000, chain.objs.size()=1 2024-09-12T00:47:03.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.419+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.yjolpJ6M0FA08e4ljMKnbvEQ0frThJx_0 2024-09-12T00:47:03.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.419+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4150668979220927317', time=2024-09-12T02:43:48.885229+0000, chain.objs.size()=1 2024-09-12T00:47:03.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.419+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.CPVM2g7U-DsrO6kzMawVxSmEZ1pZgxo_0 2024-09-12T00:47:03.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.423+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:47:03.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:47:03.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6723429214614070990', time=2024-09-12T02:38:23.593196+0000, chain.objs.size()=1 2024-09-12T00:47:03.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.v6M3RpikRclkDZa9lqppLUNxVSC6gZ7_0 2024-09-12T00:47:03.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7441884542923628493', time=2024-09-12T02:38:23.644849+0000, chain.objs.size()=1 2024-09-12T00:47:03.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.tm8gTamFKHvYrC53XoCb2O2CE06oYMM_0 2024-09-12T00:47:03.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2056972279469717974', time=2024-09-12T02:39:43.555067+0000, chain.objs.size()=1 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.K0AHHfbTPOl0PFIxZvMzxiXzlIuFTVV_0 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7584525414291448449', time=2024-09-12T02:39:44.634734+0000, chain.objs.size()=1 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.zUtHd7vNa3hVFGlrILViL5gGAHO3-FW_0 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.817346102813432454', time=2024-09-12T02:40:51.810715+0000, chain.objs.size()=1 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.m7pLZcY__3fvc4ssZzIQODBOYf_-fX-_0 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14177891210274097071', time=2024-09-12T02:40:51.815291+0000, chain.objs.size()=1 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.Z0-B8i6zNeDlJZoPJeEDjLRjUdbMsP6_0 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3141987367839911655', time=2024-09-12T02:40:54.678935+0000, chain.objs.size()=1 2024-09-12T00:47:03.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.HysFhkafwj7jnYeIt-rUolxm3y1DtWY_0 2024-09-12T00:47:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10742952544497736624', time=2024-09-12T02:41:29.456955+0000, chain.objs.size()=1 2024-09-12T00:47:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.u1iI8n06JdHpR-IyniRuUp2Z8eCsYjJ_0 2024-09-12T00:47:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12197097360408334162', time=2024-09-12T02:42:01.113619+0000, chain.objs.size()=1 2024-09-12T00:47:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.UOiiAxAZCi4Px-_MXrO_vCbztJchkKj_0 2024-09-12T00:47:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12242923100212755782', time=2024-09-12T02:42:03.029639+0000, chain.objs.size()=1 2024-09-12T00:47:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.cLUShpTFl0nKegR_MhDV689xdP9fj35_0 2024-09-12T00:47:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6546691376884153701', time=2024-09-12T02:42:39.886926+0000, chain.objs.size()=1 2024-09-12T00:47:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.W4Xb5BDblhyOhtbEISJG49cQENTXsQH_0 2024-09-12T00:47:03.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15833824486765409392', time=2024-09-12T02:43:14.200652+0000, chain.objs.size()=1 2024-09-12T00:47:03.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.427+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.HpewIpQ3645UJKwgWr9rGyjyrkXOLGJ_0 2024-09-12T00:47:03.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.431+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4425214211836121081', time=2024-09-12T02:43:45.856600+0000, chain.objs.size()=1 2024-09-12T00:47:03.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.431+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.qcxP1UYzACI66JkT-nDy_H2ybKae0qT_0 2024-09-12T00:47:03.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.435+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17292494872115929430', time=2024-09-12T02:43:45.890363+0000, chain.objs.size()=1 2024-09-12T00:47:03.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.435+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_._wsU3jSQ7Xt7mExVLRMvq4AqXKbgtdL_0 2024-09-12T00:47:03.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.435+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2818217104068038181', time=2024-09-12T02:43:48.879311+0000, chain.objs.size()=1 2024-09-12T00:47:03.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.435+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.jpY5DTk2Nnj1L_AcW94pOjuxmE2J21R_0 2024-09-12T00:47:03.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.435+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16642914867686851646', time=2024-09-12T02:43:48.880044+0000, chain.objs.size()=1 2024-09-12T00:47:03.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.435+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.sXPR2n6mo6XQGvOHptjTuVECV-4vdvr_0 2024-09-12T00:47:03.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.439+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:47:03.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:47:03.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15857204626996212775', time=2024-09-12T02:38:23.985195+0000, chain.objs.size()=1 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.UWbjlDCvL4-_KZIoYFICmbk5bnosJTw_0 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13940922646380237668', time=2024-09-12T02:38:24.218814+0000, chain.objs.size()=3 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-STANDARD.2~lUVzowMzw3_ZQqLIGQX3qEAcs5JqHvc.1 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-STANDARD.2~lUVzowMzw3_ZQqLIGQX3qEAcs5JqHvc.2 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-STANDARD.2~lUVzowMzw3_ZQqLIGQX3qEAcs5JqHvc.3 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17204012886278353303', time=2024-09-12T02:40:16.953408+0000, chain.objs.size()=1 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.vfQAPj-jAx_F2LMEJgn-S2poVNVKUnH_0 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5346063295204126366', time=2024-09-12T02:40:19.719129+0000, chain.objs.size()=1 2024-09-12T00:47:03.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.0eqGUu0Hsw44m4aKXihisUIpliLxlQv_0 2024-09-12T00:47:03.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12343137585405925345', time=2024-09-12T02:40:19.747571+0000, chain.objs.size()=1 2024-09-12T00:47:03.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.HISIyWIdQWXBqygevM6H1FHLQRtFy2w_0 2024-09-12T00:47:03.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10472195137606793134', time=2024-09-12T02:40:51.825691+0000, chain.objs.size()=1 2024-09-12T00:47:03.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.CfkbdXUoRG3yQ_O_UFP7idEJ5PWyB7Q_0 2024-09-12T00:47:03.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14799757948990560467', time=2024-09-12T02:40:53.362346+0000, chain.objs.size()=1 2024-09-12T00:47:03.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.jOydjgRdGlBwESG3E-VeMbwWHvhCjFi_0 2024-09-12T00:47:03.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2669982303259882337', time=2024-09-12T02:40:53.380599+0000, chain.objs.size()=1 2024-09-12T00:47:03.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.Koja9DOCN-9mo1m_ftCPG7hDYdNdbnE_0 2024-09-12T00:47:03.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8919819124038970511', time=2024-09-12T02:40:54.654382+0000, chain.objs.size()=1 2024-09-12T00:47:03.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_._GcXM9jEEyLbmBVcO2kIQMbk-XRUSqO_0 2024-09-12T00:47:03.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11677199651262749866', time=2024-09-12T02:41:26.639178+0000, chain.objs.size()=1 2024-09-12T00:47:03.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.443+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.oQregIErHb0t8WSBGnVsza3MdDUk55p_0 2024-09-12T00:47:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17831244566461849197', time=2024-09-12T02:41:29.434639+0000, chain.objs.size()=1 2024-09-12T00:47:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.RGGM7VG-MhU02uqK2Nv_AYhqGhupdxB_0 2024-09-12T00:47:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11291536878231308882', time=2024-09-12T02:42:04.988054+0000, chain.objs.size()=1 2024-09-12T00:47:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.3eiRy3GX9PUooDlDupHDPLZvUNYhJ2U_0 2024-09-12T00:47:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2126135677650981731', time=2024-09-12T02:42:37.399015+0000, chain.objs.size()=1 2024-09-12T00:47:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.st8WdEjd3Nac3S-rSqt7ghB-AB7Gh4L_0 2024-09-12T00:47:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7191270078245439542', time=2024-09-12T02:43:12.043622+0000, chain.objs.size()=1 2024-09-12T00:47:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.XBX6t-gWWxx-yIfyAqqFZ47VrA4_7Hv_0 2024-09-12T00:47:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6166791017588589173', time=2024-09-12T02:44:21.212167+0000, chain.objs.size()=1 2024-09-12T00:47:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.x9O79t5rMHliuW69yYtElHDYWh75K1-_0 2024-09-12T00:47:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4075122578327827840', time=2024-09-12T02:44:21.242976+0000, chain.objs.size()=1 2024-09-12T00:47:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.oOqDh8m7pYtE5Vwg_WqwXIh9XDAa3XK_0 2024-09-12T00:47:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8879861497942755619', time=2024-09-12T02:44:21.250308+0000, chain.objs.size()=1 2024-09-12T00:47:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.ZC-i6-mdYXLvsqjpmsFp9U0uYgOHCdI_0 2024-09-12T00:47:03.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13929374890046114463', time=2024-09-12T02:46:39.903643+0000, chain.objs.size()=1 2024-09-12T00:47:03.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.447+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18__shadow:nVV64c5fkixd5x5nlnNx2KInAycwp94_.VFMfiLe4ds6jcT6jdyF--CmPlAktNi0_0 2024-09-12T00:47:03.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.455+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.455+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:47:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:47:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15363106844412019892', time=2024-09-12T02:38:23.627964+0000, chain.objs.size()=1 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.hMEP4XQo9bb46pPXSXZUe-ipj9kKbU0_0 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17155208232630382861', time=2024-09-12T02:38:24.072346+0000, chain.objs.size()=5 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.1 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.1_1 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.2 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.2_1 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.3 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1602472788173440852', time=2024-09-12T02:38:24.157318+0000, chain.objs.size()=3 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.1 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.2 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.3 2024-09-12T00:47:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4271728512572506110', time=2024-09-12T02:38:24.283339+0000, chain.objs.size()=1 2024-09-12T00:47:03.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.ts1DkAxKrUW4cnVC5VNXiEHnsYKRH5r_0 2024-09-12T00:47:03.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11542524997250851180', time=2024-09-12T02:38:24.476411+0000, chain.objs.size()=1 2024-09-12T00:47:03.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8__shadow_.0HRDPhXeJpDxzYiLaB8SSZIvT9vc_MO_0 2024-09-12T00:47:03.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10173772687125907371', time=2024-09-12T02:39:44.663473+0000, chain.objs.size()=1 2024-09-12T00:47:03.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.459+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.wlVsIZg3ucqW4_o0QG-3gXuZnCRcIKe_0 2024-09-12T00:47:03.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7508399214045993990', time=2024-09-12T02:40:16.980984+0000, chain.objs.size()=1 2024-09-12T00:47:03.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.cWlo02S9IsvWsUeAn8xJzb1J1IBPvHx_0 2024-09-12T00:47:03.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12722502145485933214', time=2024-09-12T02:40:18.683283+0000, chain.objs.size()=1 2024-09-12T00:47:03.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.JUIXZPUjzvwHMA2L88wx9fQDDxpYCsO_0 2024-09-12T00:47:03.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8307058886764013649', time=2024-09-12T02:40:51.801545+0000, chain.objs.size()=1 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.h_wbpf826FkwKKb8Toc0GBtgC8GxJJi_0 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12860459043485416484', time=2024-09-12T02:40:53.370804+0000, chain.objs.size()=1 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.07xZ3m9iMEwFXktcslqDCABnPZKZMZC_0 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.746935384828988201', time=2024-09-12T02:40:53.397048+0000, chain.objs.size()=1 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.dsgOzt8uvcA_rOV8mfwSG9RZO9OF05l_0 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12791347964857689166', time=2024-09-12T02:40:54.653077+0000, chain.objs.size()=1 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.uO1hLXOrQrjq5E9mFbX4Ly2YGKX0Eia_0 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8424149122013045050', time=2024-09-12T02:41:26.638656+0000, chain.objs.size()=1 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.VnqZEcXm7Uc_geN_ZbCrYZ0yzWDHkWH_0 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7642943879855489392', time=2024-09-12T02:42:01.089492+0000, chain.objs.size()=1 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.qC4w-jIFjdClxoPSYVPebAJQ_Yj9sjW_0 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7653786912440905699', time=2024-09-12T02:42:04.975690+0000, chain.objs.size()=1 2024-09-12T00:47:03.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.DO_4-WZs0kS268mJp1bMS8u0HMYgDxy_0 2024-09-12T00:47:03.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16512685037097809048', time=2024-09-12T02:42:37.437725+0000, chain.objs.size()=1 2024-09-12T00:47:03.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.28ZENxtnMstC9Onf1BZub5udTVUKwpD_0 2024-09-12T00:47:03.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10161067973512665004', time=2024-09-12T02:43:12.046983+0000, chain.objs.size()=1 2024-09-12T00:47:03.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.463+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.eldzrVLs-KLWXRb958M0aaD-k5aPuhf_0 2024-09-12T00:47:03.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.467+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17665502646169614997', time=2024-09-12T02:43:12.060099+0000, chain.objs.size()=1 2024-09-12T00:47:03.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.467+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.xuNgPTAUsZKrAVUQN7vrrbv8eFP_JHa_0 2024-09-12T00:47:03.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.467+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12224492012216222399', time=2024-09-12T02:43:48.876903+0000, chain.objs.size()=1 2024-09-12T00:47:03.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.467+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.P_pEU4Tk1SPchQa0vPUwWbIyaZFUO5Q_0 2024-09-12T00:47:03.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.471+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.471+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:47:03.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:47:03.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5686629681862548085', time=2024-09-12T02:39:44.627665+0000, chain.objs.size()=1 2024-09-12T00:47:03.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.OgBjr_m04r2PIbEht3K8ihNwUbFvhzm_0 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17249167169263602254', time=2024-09-12T02:40:16.964841+0000, chain.objs.size()=1 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.Y2VdyEX9lf05cmSZTVkISaJHJgv3J4W_0 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4486300186498022222', time=2024-09-12T02:40:51.815627+0000, chain.objs.size()=1 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.2Swkfl4AIYSkCjkGZDNTAaub1z5ZBYf_0 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5038391953264197904', time=2024-09-12T02:40:53.360145+0000, chain.objs.size()=1 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.Zv6oEsa2-PYikvyhqy51TOdNM1sFrA3_0 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10026720282887236927', time=2024-09-12T02:40:53.375346+0000, chain.objs.size()=1 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.9wOXdklIZS1lnsLClB7Bj3iy2wfQqwI_0 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5435308380295206484', time=2024-09-12T02:40:54.676399+0000, chain.objs.size()=1 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.FfjWmHUn8n4ric6zLZYf8d6vBAcfB9Z_0 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16644632790739336174', time=2024-09-12T02:42:01.096574+0000, chain.objs.size()=1 2024-09-12T00:47:03.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.BLe0eTKeIGpoKUJzKA5-DWpu2e_s_Xm_0 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11954832379639413844', time=2024-09-12T02:42:01.113557+0000, chain.objs.size()=1 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.1qxvTpYvWVtNCh3S6-mjhm6TD6d3dP-_0 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5283181887755890568', time=2024-09-12T02:42:03.051897+0000, chain.objs.size()=1 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.F30ZPJSAzGOLv-7K3vwpBqLSAlyjNNx_0 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2138179936089872148', time=2024-09-12T02:43:12.049571+0000, chain.objs.size()=1 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.BXbwojculmmHg7if1rl_dyOLzsQf-IF_0 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15611491159934657043', time=2024-09-12T02:43:15.223013+0000, chain.objs.size()=1 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.WP31FVpEKpbAEsD4WvJnMuEodiAohNJ_0 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4052042345125304525', time=2024-09-12T02:43:48.863358+0000, chain.objs.size()=1 2024-09-12T00:47:03.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.475+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.arOhvOEBWqU12bU9Ncdn7y93ZquedTT_0 2024-09-12T00:47:03.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.479+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8409911202598782950', time=2024-09-12T02:44:21.229136+0000, chain.objs.size()=1 2024-09-12T00:47:03.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.479+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.Sg16DrQ8ceBjQrVi48SFicOs6sM6EOI_0 2024-09-12T00:47:03.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.479+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11439419216232598389', time=2024-09-12T02:44:21.248825+0000, chain.objs.size()=1 2024-09-12T00:47:03.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.479+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.B_MrzpP6CvFdaPfVCAEjXgEqF_tR0MG_0 2024-09-12T00:47:03.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.479+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5279194462602019403', time=2024-09-12T02:46:28.013297+0000, chain.objs.size()=1 2024-09-12T00:47:03.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.479+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.9sJ7HVlpJhB8vyUuUzVxddsBd8Fn8oq_0 2024-09-12T00:47:03.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.483+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:47:03.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:47:03.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_wD7AEuXfBT_ahUu_FtJmGlg1fdQsSXi', time=2024-09-12T02:38:24.060050+0000, chain.objs.size()=3 2024-09-12T00:47:03.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.03wmSYKc4NWdRHZeOiWDgwyoD4T0FHd_0 2024-09-12T00:47:03.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.03wmSYKc4NWdRHZeOiWDgwyoD4T0FHd_1 2024-09-12T00:47:03.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.03wmSYKc4NWdRHZeOiWDgwyoD4T0FHd_2 2024-09-12T00:47:03.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16649148674952198838', time=2024-09-12T02:39:43.550100+0000, chain.objs.size()=1 2024-09-12T00:47:03.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_._NOTqdx_WMw-OpbY9Zgy0oUsiHqiAhd_0 2024-09-12T00:47:03.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7445479443649665800', time=2024-09-12T02:40:51.818278+0000, chain.objs.size()=1 2024-09-12T00:47:03.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.mCabNUE53_d2P5aiXQPtxXLFLnD3WOx_0 2024-09-12T00:47:03.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8095810551394733923', time=2024-09-12T02:40:53.366988+0000, chain.objs.size()=1 2024-09-12T00:47:03.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.XEqH-3Qwu33jr0zHgyIoXgk7UoONvDU_0 2024-09-12T00:47:03.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17138936091264381610', time=2024-09-12T02:40:54.657552+0000, chain.objs.size()=1 2024-09-12T00:47:03.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.HTHKETdJlsNX3A1mTopjNu-T9RWcDeY_0 2024-09-12T00:47:03.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14784192904361283485', time=2024-09-12T02:40:54.677931+0000, chain.objs.size()=1 2024-09-12T00:47:03.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.tcEK6oypdl7Uj2pz5X1-qSkh12INY4h_0 2024-09-12T00:47:03.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14383519386632491161', time=2024-09-12T02:41:26.648681+0000, chain.objs.size()=1 2024-09-12T00:47:03.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.N9RWih5QSTA9vuzGkKFfOgnQzLOZvWx_0 2024-09-12T00:47:03.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5117199685785453845', time=2024-09-12T02:41:29.443577+0000, chain.objs.size()=1 2024-09-12T00:47:03.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.GtZUiPW5UwPpzMyfTXW5mdC-JTZB3dc_0 2024-09-12T00:47:03.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13033860084273758436', time=2024-09-12T02:42:03.040378+0000, chain.objs.size()=1 2024-09-12T00:47:03.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.PWvuW3uJUkuRXzfZwOdwfK8TVTfuNyf_0 2024-09-12T00:47:03.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16999322985080432126', time=2024-09-12T02:42:03.041320+0000, chain.objs.size()=1 2024-09-12T00:47:03.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.487+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.ViFR0BOZa2_9TdP-4GwJ8o3k5QVWjzE_0 2024-09-12T00:47:03.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.491+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4950366405762937821', time=2024-09-12T02:42:03.052561+0000, chain.objs.size()=1 2024-09-12T00:47:03.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.491+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.EEYrulqr1ASsf9KyD951LWLf8lEXYLc_0 2024-09-12T00:47:03.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.491+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17978082976575362291', time=2024-09-12T02:42:04.992408+0000, chain.objs.size()=1 2024-09-12T00:47:03.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.491+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.fq7vwesNaXegTw3QrS5ozR0cXQxIT1j_0 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.491+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8733601774776346047', time=2024-09-12T02:42:05.004573+0000, chain.objs.size()=1 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.491+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.3W62ZiBnSixkKWctZ2p8vt7-0vthANF_0 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.491+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14115115975248257593', time=2024-09-12T02:42:39.861949+0000, chain.objs.size()=1 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.491+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.kLIoUYpSQBKp42jlZ8_YzI1wvOz3kCc_0 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.495+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8087012053058215267', time=2024-09-12T02:42:39.886988+0000, chain.objs.size()=1 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.495+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.vKoMUc2pIOynb3t7H-nj9-5wQs6hBtS_0 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.495+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10052212098968617812', time=2024-09-12T02:43:12.037470+0000, chain.objs.size()=1 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.495+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.Uq3ZKYHdcub_pCgsni3yvBD8skkF8nS_0 2024-09-12T00:47:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.495+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7796564143645006602', time=2024-09-12T02:44:21.221070+0000, chain.objs.size()=1 2024-09-12T00:47:03.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.495+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.UHiyxhdCAR19kSo2hHbjn1fR5oylV8q_0 2024-09-12T00:47:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.499+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.499+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:47:03.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:47:03.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_AMRSdYHVAfZEmemfPnLmqvYh4wQn0QX', time=2024-09-12T02:38:23.882722+0000, chain.objs.size()=2 2024-09-12T00:47:03.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.R53C5ESKv6Y7KHuN1bZhbEkg9QI7ROQ_0 2024-09-12T00:47:03.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.R53C5ESKv6Y7KHuN1bZhbEkg9QI7ROQ_1 2024-09-12T00:47:03.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4374762034495499551', time=2024-09-12T02:40:16.966240+0000, chain.objs.size()=1 2024-09-12T00:47:03.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.elPWh1HZrhjO3T51OeiKBi1SrGIvF2D_0 2024-09-12T00:47:03.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8905522096822240039', time=2024-09-12T02:40:51.788969+0000, chain.objs.size()=1 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.BZLxFxPL0eORxWNxjR_VBjnwPvtVI3f_0 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1972719383454507267', time=2024-09-12T02:40:51.789989+0000, chain.objs.size()=1 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.zMIw2BALpM68XT6s5-XITDoBVYyRbSR_0 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17415282660144655328', time=2024-09-12T02:40:51.790684+0000, chain.objs.size()=1 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.OgzXoo3xLmWgTXWPPsP4M6kqNC_jvuM_0 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6527415857349426246', time=2024-09-12T02:40:54.658489+0000, chain.objs.size()=1 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.zkhR62n3VnX28GueiA7PKr4Uh2eOt-s_0 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9592285173942125892', time=2024-09-12T02:42:37.418748+0000, chain.objs.size()=1 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.sEx5-iGEhNw1IQFmoUVdBQmXsQFNJUi_0 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4420920845177696918', time=2024-09-12T02:42:39.855757+0000, chain.objs.size()=1 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.nnp8a_4C7kKbmF2fiJicJQnoShXIO38_0 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3175156218866179218', time=2024-09-12T02:42:39.876763+0000, chain.objs.size()=1 2024-09-12T00:47:03.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.UtiIqKj9uTWJKPs190DGgahmR1He9m7_0 2024-09-12T00:47:03.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3440827397636399621', time=2024-09-12T02:43:12.051115+0000, chain.objs.size()=1 2024-09-12T00:47:03.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.RhxTb-E6Nj2I7PGxXQWKo8Y6kVopVLd_0 2024-09-12T00:47:03.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16019336137314138102', time=2024-09-12T02:43:45.853421+0000, chain.objs.size()=1 2024-09-12T00:47:03.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.503+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.G_wPLPAxScmLGgx2XlP4XFMA59kj0mw_0 2024-09-12T00:47:03.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.507+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1752464383939780977', time=2024-09-12T02:43:48.870431+0000, chain.objs.size()=1 2024-09-12T00:47:03.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.507+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.NvhGekc7SM23_pGeq-wuRQeXwwul67j_0 2024-09-12T00:47:03.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.507+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13706261595345766195', time=2024-09-12T02:43:48.874756+0000, chain.objs.size()=1 2024-09-12T00:47:03.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.507+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.rt747aSP3Y9HnQQaLgKKdmYkS2EomBj_0 2024-09-12T00:47:03.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.507+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10116072285583387362', time=2024-09-12T02:44:21.212870+0000, chain.objs.size()=1 2024-09-12T00:47:03.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.507+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.8Lq35_yMHCUWY26goActOKqa0ZmlJn8_0 2024-09-12T00:47:03.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.511+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.511+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:47:03.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:47:03.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_Bol8F7obqm23Ocnw-s8HNvj1utv7sS8', time=2024-09-12T02:38:24.050099+0000, chain.objs.size()=3 2024-09-12T00:47:03.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.PkLLlJwBE2SVxF8RJW6jEqkeyG-XTIO_0 2024-09-12T00:47:03.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.PkLLlJwBE2SVxF8RJW6jEqkeyG-XTIO_1 2024-09-12T00:47:03.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.PkLLlJwBE2SVxF8RJW6jEqkeyG-XTIO_2 2024-09-12T00:47:03.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4111095470088255982', time=2024-09-12T02:39:43.567673+0000, chain.objs.size()=1 2024-09-12T00:47:03.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.AcgNwMN9gBw35ev_SYuSfZSr-SS_Sws_0 2024-09-12T00:47:03.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8264166671233583049', time=2024-09-12T02:39:44.646190+0000, chain.objs.size()=1 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.hoUFRmVPSUyIfgDbKBsqJI-zn6SGD_E_0 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6522525706757581130', time=2024-09-12T02:40:18.681140+0000, chain.objs.size()=1 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.9aGWmk8-jXRNjm4oVwYWGbFhykGhXxN_0 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8039071154157481379', time=2024-09-12T02:40:19.727087+0000, chain.objs.size()=1 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.KV1jgzJnFCkNgxlHhu6PRBulPR7HnFK_0 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12290883799067666330', time=2024-09-12T02:40:19.733062+0000, chain.objs.size()=1 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.Jkme4To8k3fCM8HezoWtQiLv2NhNJZM_0 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9863000397481671103', time=2024-09-12T02:40:19.735594+0000, chain.objs.size()=1 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.1vErckdD5m405QoxXpkeZhpdfGUmAiE_0 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3987858637567273719', time=2024-09-12T02:40:51.824843+0000, chain.objs.size()=1 2024-09-12T00:47:03.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.QB2HUw_ZDX2oOiJ2_5UqSAHjl_3Cb1V_0 2024-09-12T00:47:03.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14166932283531716907', time=2024-09-12T02:40:54.664964+0000, chain.objs.size()=1 2024-09-12T00:47:03.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.U_ifZIGGbc5bX6_7HJjFRo3oahiLUW5_0 2024-09-12T00:47:03.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8521422914575711479', time=2024-09-12T02:41:26.641053+0000, chain.objs.size()=1 2024-09-12T00:47:03.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.515+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.SvRRbT0AG4lxQE7nDf17cMd7kRaeeOF_0 2024-09-12T00:47:03.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.519+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.961391095877525960', time=2024-09-12T02:41:29.446292+0000, chain.objs.size()=1 2024-09-12T00:47:03.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.519+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.7Qv_k0VeNHC0R4PpdT_sEh3dt9gL21P_0 2024-09-12T00:47:03.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.519+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10722643405077423962', time=2024-09-12T02:42:01.116649+0000, chain.objs.size()=1 2024-09-12T00:47:03.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.519+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.68zH8pgskMh7kevVBosco50vbbkCeim_0 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3150760289446035081', time=2024-09-12T02:42:02.158471+0000, chain.objs.size()=1 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.Kt-SZEZpnzQlX8Ik2bQQE-K81S-zcLG_0 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13368603673778549439', time=2024-09-12T02:42:03.046155+0000, chain.objs.size()=1 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.7i4f_UPFGXnc9Ia3D9g0biQZzIEwxBV_0 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2329905967614867018', time=2024-09-12T02:42:37.402244+0000, chain.objs.size()=1 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.0Nzm5Gc6WG3DsW5ubKtPtrVF2aqk_Kq_0 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.221512970920170472', time=2024-09-12T02:42:37.406415+0000, chain.objs.size()=1 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.TECxD1cIS0F4TVeb-To0GTn1cQsUGyJ_0 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10748802782412155774', time=2024-09-12T02:43:45.864221+0000, chain.objs.size()=1 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.atPMiNpBcdjo_PZB9Ue1SV2IfixTrdI_0 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3200819590168765267', time=2024-09-12T02:43:45.874258+0000, chain.objs.size()=1 2024-09-12T00:47:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.neYShPi9MBeRSzsAW5XOaZI2MJ5SA4K_0 2024-09-12T00:47:03.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18004230875520189624', time=2024-09-12T02:43:48.882002+0000, chain.objs.size()=1 2024-09-12T00:47:03.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.CTBUBgkWBLxXk3lmVXEcYUybCYNs-De_0 2024-09-12T00:47:03.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17064034973454933638', time=2024-09-12T02:43:50.126970+0000, chain.objs.size()=1 2024-09-12T00:47:03.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.523+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.5mmiAyrBaMRRZV9JRleESFE3qyZeg1F_0 2024-09-12T00:47:03.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.527+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:47:03.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:47:03.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6380667923577498495', time=2024-09-12T02:40:16.976718+0000, chain.objs.size()=1 2024-09-12T00:47:03.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.zFcxEmBuvzhosPG7YG6svIfsS8duMFZ_0 2024-09-12T00:47:03.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13877398943021480488', time=2024-09-12T02:40:18.655579+0000, chain.objs.size()=1 2024-09-12T00:47:03.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.g1mg1sPQnUeDEVztV7l2uwpjSzZkhYX_0 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9506353939750280806', time=2024-09-12T02:42:01.103820+0000, chain.objs.size()=1 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.CRTo1XMnbKFKPhv3v8fqxLwMV9-f4Pu_0 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9177755779277177426', time=2024-09-12T02:42:03.034138+0000, chain.objs.size()=1 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.h7v5jP9EpjTguOpIzZKXXazt1S9-XPt_0 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13255580263217637972', time=2024-09-12T02:42:39.864528+0000, chain.objs.size()=1 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.DsQ0Spp4yu6Lz7LeLupSZBuyjXgqj9__0 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16310120749028405343', time=2024-09-12T02:42:39.881350+0000, chain.objs.size()=1 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.SP49CTKg-s0twq8-TqxNlJphceS7Sgz_0 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10408569483811513426', time=2024-09-12T02:43:12.044240+0000, chain.objs.size()=1 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.AEtS5Gf_J0FebxDmQhBsMtjcWPxw3Cw_0 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7987232909156894670', time=2024-09-12T02:43:14.217476+0000, chain.objs.size()=1 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.cibtIX4zdH12nOHCEAZrnJgsX1rYpyV_0 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8574415342284832074', time=2024-09-12T02:43:45.880790+0000, chain.objs.size()=1 2024-09-12T00:47:03.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.OdrLuMbM5n4pO9BnCcNaHgmW23TP70L_0 2024-09-12T00:47:03.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6744104081951548170', time=2024-09-12T02:44:21.229621+0000, chain.objs.size()=1 2024-09-12T00:47:03.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.531+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.MFzVli0OfJ0Ep8sCkinEj7pWjHQyHWG_0 2024-09-12T00:47:03.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.535+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:47:03.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:47:03.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2410429415558141803', time=2024-09-12T02:38:23.686457+0000, chain.objs.size()=4 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11__multipart_foo.2~jqvxjEBo3iUot8gBd096VARsDGbysv4.1 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11__multipart_foo.2~jqvxjEBo3iUot8gBd096VARsDGbysv4.2 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11__multipart_foo.2~jqvxjEBo3iUot8gBd096VARsDGbysv4.3 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11__multipart_foo.2~jqvxjEBo3iUot8gBd096VARsDGbysv4.4 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12420192300422293832', time=2024-09-12T02:38:24.038081+0000, chain.objs.size()=5 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.1 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.1_1 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.2 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.539+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.2_1 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.3 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4344258100534045415', time=2024-09-12T02:38:24.096051+0000, chain.objs.size()=5 2024-09-12T00:47:03.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.1 2024-09-12T00:47:03.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.1_1 2024-09-12T00:47:03.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.2 2024-09-12T00:47:03.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.2_1 2024-09-12T00:47:03.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-LUKEWARM.2~1z-X7K_9UWNKtkNqxxzJEMm0dtFm_T1.3 2024-09-12T00:47:03.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11358556242025169333', time=2024-09-12T02:39:44.639161+0000, chain.objs.size()=1 2024-09-12T00:47:03.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.Fh8OqGeGIX8dMGVg58O1Hy5v9wkkzqq_0 2024-09-12T00:47:03.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13868230149034316977', time=2024-09-12T02:41:26.644718+0000, chain.objs.size()=1 2024-09-12T00:47:03.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.15R17RVkesMLZ8_DNfdqzpKBvD-siUb_0 2024-09-12T00:47:03.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6087251605892940278', time=2024-09-12T02:41:26.647299+0000, chain.objs.size()=1 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.0L13XTgp15ol8ki3rIIAshOLaNRpZfG_0 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18338628792614529870', time=2024-09-12T02:41:29.442349+0000, chain.objs.size()=1 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.iqGBH55Vqroq0QkSbGwILyZEDr0byhY_0 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15944876066705259523', time=2024-09-12T02:42:01.088828+0000, chain.objs.size()=1 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.bQ9ITuJmoFFKocOe8IsaZE0dSjg4TJt_0 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4352199372524687831', time=2024-09-12T02:42:01.096533+0000, chain.objs.size()=1 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.Z4YJqi1qdI_6gYyHJysGN_XofI8B1NL_0 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5560550815029390767', time=2024-09-12T02:42:39.860977+0000, chain.objs.size()=1 2024-09-12T00:47:03.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.543+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.9_zlLRXpUisBpF3UfdmR8Pgu7HNH7A__0 2024-09-12T00:47:03.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.547+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13427284009842830108', time=2024-09-12T02:43:12.055628+0000, chain.objs.size()=1 2024-09-12T00:47:03.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.547+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.bz8U_w83fxq9eYX4inAnoiGxW6J26wW_0 2024-09-12T00:47:03.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.547+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16525601936640827339', time=2024-09-12T02:43:48.861052+0000, chain.objs.size()=1 2024-09-12T00:47:03.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.547+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.SEof9G7LvM8LGM_G23ckHvFECWJUxhM_0 2024-09-12T00:47:03.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.551+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10798354205720202401', time=2024-09-12T02:44:21.231688+0000, chain.objs.size()=1 2024-09-12T00:47:03.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.551+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.gFGY1n81_LESDVz87o5uYAdWdqRd-ow_0 2024-09-12T00:47:03.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.551+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8327900148879107434', time=2024-09-12T02:46:28.011696+0000, chain.objs.size()=1 2024-09-12T00:47:03.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.551+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.-GtuH14I9eb_zjtRUx8go0sV0MMVj7g_0 2024-09-12T00:47:03.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.551+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3836201539234489990', time=2024-09-12T02:46:28.022667+0000, chain.objs.size()=1 2024-09-12T00:47:03.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.551+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.ookKia8ZvPNK61VDVa4FqBoW2XxQ-iu_0 2024-09-12T00:47:03.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.551+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.555+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:47:03.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.555+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:47:03.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_dWQitoNrIA6TeT-VJvywcldqtFfUU9N', time=2024-09-12T02:38:23.918579+0000, chain.objs.size()=2 2024-09-12T00:47:03.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Dab863m0NLWbCSk7lAoRj0hien_HuFy_0 2024-09-12T00:47:03.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.Dab863m0NLWbCSk7lAoRj0hien_HuFy_1 2024-09-12T00:47:03.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9717849770251784682', time=2024-09-12T02:39:43.555986+0000, chain.objs.size()=1 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.9eooHChd8su0rHVjeKUyy8rVFh3Vsl3_0 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12112172833626414093', time=2024-09-12T02:39:43.564312+0000, chain.objs.size()=1 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.WUkyWGZYLGQvreMLWqrbjG1vuI0oduH_0 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6372423115282810441', time=2024-09-12T02:39:43.575273+0000, chain.objs.size()=1 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.YAl9ZvZ_TYpCku1mPtEkSoS9KRWLcxg_0 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10588823011713259117', time=2024-09-12T02:39:44.629950+0000, chain.objs.size()=1 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.4-OuDOkyyjcz8u38P7kSAXOVaDFLjmp_0 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10421235542416601793', time=2024-09-12T02:40:16.962519+0000, chain.objs.size()=1 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.cRkAAKFDPO_5Vo4DoEOnFvnmaDbCsFJ_0 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10302068813816931195', time=2024-09-12T02:40:16.967123+0000, chain.objs.size()=1 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.JTW_sbS_gTO_B-Jt_5Rce1AdEPiE4dF_0 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9536370685316432391', time=2024-09-12T02:40:53.380235+0000, chain.objs.size()=1 2024-09-12T00:47:03.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.ZBmeew91b8GI13TtOIHKKhTCjgQsT9V_0 2024-09-12T00:47:03.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.405764816098068138', time=2024-09-12T02:41:26.633567+0000, chain.objs.size()=1 2024-09-12T00:47:03.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.7JylvX_PpHm9t9eNJZv9ApjMTnTfXYi_0 2024-09-12T00:47:03.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9275223626423311907', time=2024-09-12T02:41:29.440898+0000, chain.objs.size()=1 2024-09-12T00:47:03.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.nnsxtlvqIvmSdmf40144T2nFtugkgHt_0 2024-09-12T00:47:03.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14898077866333983534', time=2024-09-12T02:41:29.460588+0000, chain.objs.size()=1 2024-09-12T00:47:03.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.4xCbSOGIEh0qBwImxKIhin7Qjd8uLj9_0 2024-09-12T00:47:03.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2693943275790741789', time=2024-09-12T02:41:30.466016+0000, chain.objs.size()=1 2024-09-12T00:47:03.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.eN7RDC7KBhzLLqrCd3czaTjm0pYbObh_0 2024-09-12T00:47:03.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8265626228506550341', time=2024-09-12T02:42:05.008802+0000, chain.objs.size()=1 2024-09-12T00:47:03.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.559+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.S2HI7giDbrFvnLAqrUUAx-N5lroZhpZ_0 2024-09-12T00:47:03.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10312161288551489031', time=2024-09-12T02:42:37.394919+0000, chain.objs.size()=1 2024-09-12T00:47:03.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.6tM_E4bYZek9IbtWFAVhTecTCSH3hsl_0 2024-09-12T00:47:03.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17565724316170982893', time=2024-09-12T02:42:39.412773+0000, chain.objs.size()=1 2024-09-12T00:47:03.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.s_wjzcFInJVN4wQtqZq9xmW3DJtqtIw_0 2024-09-12T00:47:03.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40672221904521037', time=2024-09-12T02:43:45.874385+0000, chain.objs.size()=1 2024-09-12T00:47:03.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.NezYeU41ONJ2g2-DxiBaYNCPFYLbOss_0 2024-09-12T00:47:03.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17994651782243959580', time=2024-09-12T02:43:45.878034+0000, chain.objs.size()=1 2024-09-12T00:47:03.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.VgRCOD3romHF-JL3YMVoiQKEMnuQy38_0 2024-09-12T00:47:03.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12868948615291752472', time=2024-09-12T02:43:47.339176+0000, chain.objs.size()=1 2024-09-12T00:47:03.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.563+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.6yIeUD2bWQg7wrjeDwQ2UDe_84qcW6n_0 2024-09-12T00:47:03.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.567+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.567+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:47:03.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:47:03.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.384669685069405699', time=2024-09-12T02:39:43.552766+0000, chain.objs.size()=1 2024-09-12T00:47:03.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.UZt_oj8WczhDBAFUjTXlhuSrrvdAiTJ_0 2024-09-12T00:47:03.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4140872885318922529', time=2024-09-12T02:39:44.632106+0000, chain.objs.size()=1 2024-09-12T00:47:03.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.Rd9LLB77hLCb2JZEpe-tN8zp-hBdWhG_0 2024-09-12T00:47:03.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1249634956855688587', time=2024-09-12T02:40:19.736005+0000, chain.objs.size()=1 2024-09-12T00:47:03.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.EWj9Gzgz4YX8MhEEZjjvrnDtmqUWEL6_0 2024-09-12T00:47:03.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14263249104794966605', time=2024-09-12T02:40:19.737898+0000, chain.objs.size()=1 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.Hdv_RCJ_IRTaaYmAWKxbtS5c1nQeBiw_0 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2154759646765752965', time=2024-09-12T02:40:51.818276+0000, chain.objs.size()=1 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.wc2SEOO21QLD-AU-7qOH0d-BXaP8mOX_0 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3503056540477011211', time=2024-09-12T02:40:54.669622+0000, chain.objs.size()=1 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.-pVpovxnivaJKpw_IGDwq2_8AtyzAvJ_0 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9503488967985750452', time=2024-09-12T02:40:55.728856+0000, chain.objs.size()=1 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.gKZiK3dwxTx9o1mJW24Tpa2oS2vacxS_0 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4585903387834712176', time=2024-09-12T02:42:03.025842+0000, chain.objs.size()=1 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.UTDYy6alzhty2xbg057hyZ3R170bWR-_0 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13853172348307073113', time=2024-09-12T02:42:04.978402+0000, chain.objs.size()=1 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.XKgK_vH-VEC-jrwDguLoxnRVT0Pfggq_0 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15389647394487191004', time=2024-09-12T02:42:39.852257+0000, chain.objs.size()=1 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.zQTW6PNLB5BPyF_olBxdjqIGev5o-ND_0 2024-09-12T00:47:03.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2259981847463083935', time=2024-09-12T02:43:12.041856+0000, chain.objs.size()=1 2024-09-12T00:47:03.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.f3ia_BjImEGe7C4ZX-xw39nIEiTlXqO_0 2024-09-12T00:47:03.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1383220106577713647', time=2024-09-12T02:43:47.348044+0000, chain.objs.size()=1 2024-09-12T00:47:03.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.571+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.D7ow7AIz1SODXQnoxVU_3y5ao8X2ZQs_0 2024-09-12T00:47:03.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.575+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14197455972349838190', time=2024-09-12T02:44:21.230378+0000, chain.objs.size()=1 2024-09-12T00:47:03.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.575+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.ftMTo1eRKNYxtQ3dhGWTwiCbd1K8P6B_0 2024-09-12T00:47:03.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.575+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.579+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:47:03.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.579+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:47:03.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9234104548329529724', time=2024-09-12T02:38:24.120392+0000, chain.objs.size()=3 2024-09-12T00:47:03.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.1 2024-09-12T00:47:03.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.2 2024-09-12T00:47:03.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-STANDARD.2~aXGF3kyLcbI2UB6hcm1-3flYWmx72NT.3 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18329846714066474852', time=2024-09-12T02:38:24.205072+0000, chain.objs.size()=5 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.1 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__shadow_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.1_1 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.2 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__shadow_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.2_1 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14__multipart_foo-LUKEWARM.2~f3iJCEmvPagsQBNTzk62ZRAZeY6MwjX.3 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5272612489678195521', time=2024-09-12T02:39:44.645912+0000, chain.objs.size()=1 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.iG0oeBZoaqqvx7RGfFR9E1yQs9lhWW9_0 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14869143718696248727', time=2024-09-12T02:40:18.661138+0000, chain.objs.size()=1 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.0lt4JNdwtVRZB1tGFpFre4FJYkePATO_0 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5482072599272660858', time=2024-09-12T02:40:54.659717+0000, chain.objs.size()=1 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.Szsufu9Hx7aj7M_QIpmAM1fTsVKh4QT_0 2024-09-12T00:47:03.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8497390503294782529', time=2024-09-12T02:40:54.664898+0000, chain.objs.size()=1 2024-09-12T00:47:03.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.ygzZRw2ntL-yTtEuImTgShFZvKfRly4_0 2024-09-12T00:47:03.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6600930203118760455', time=2024-09-12T02:41:26.635938+0000, chain.objs.size()=1 2024-09-12T00:47:03.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.7hLU7_MwULOGI6IU4xJyij5AcETg4LL_0 2024-09-12T00:47:03.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12892814069149962937', time=2024-09-12T02:43:12.039290+0000, chain.objs.size()=1 2024-09-12T00:47:03.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.583+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.fF0NPpqcosVK1omb7DC7zflqNhThg8K_0 2024-09-12T00:47:03.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.587+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11906238406523384967', time=2024-09-12T02:43:14.194294+0000, chain.objs.size()=1 2024-09-12T00:47:03.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.587+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.2M2lBUMrCVerdTrIDwiOiqR8say2e70_0 2024-09-12T00:47:03.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.587+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16518925748577129441', time=2024-09-12T02:43:14.196562+0000, chain.objs.size()=1 2024-09-12T00:47:03.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.587+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.sS_2wF_mkl-H9ESK139UeM7WH7p0VGK_0 2024-09-12T00:47:03.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.587+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13428208431477897524', time=2024-09-12T02:43:47.346257+0000, chain.objs.size()=1 2024-09-12T00:47:03.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.587+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.kQd41KcmV2g9OErw1s_TtvfAUCJkGjV_0 2024-09-12T00:47:03.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.587+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.591+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:47:03.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.591+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:47:03.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7575174709835912214', time=2024-09-12T02:39:44.654773+0000, chain.objs.size()=1 2024-09-12T00:47:03.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.50mDEu_KOCPLysqIzfFuumG-6H4u7kW_0 2024-09-12T00:47:03.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11478276007826532821', time=2024-09-12T02:39:44.658668+0000, chain.objs.size()=1 2024-09-12T00:47:03.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.eIid6JoCkgbLqbO0Ac1MCUSHrW6nkqB_0 2024-09-12T00:47:03.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15211493024655882278', time=2024-09-12T02:40:18.665424+0000, chain.objs.size()=1 2024-09-12T00:47:03.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.4Z52udt_zTgMqk2lHyCY0PQRDl4bfDi_0 2024-09-12T00:47:03.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13506436959504440770', time=2024-09-12T02:40:18.673376+0000, chain.objs.size()=1 2024-09-12T00:47:03.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.M0FDOYuY78oV0nMPxCFqKT0mbUg0zCS_0 2024-09-12T00:47:03.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12560040751180904392', time=2024-09-12T02:40:21.175520+0000, chain.objs.size()=1 2024-09-12T00:47:03.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.eUHSjXCtFiYOultQA3_Tpl_fLppKg-u_0 2024-09-12T00:47:03.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7980431966349380643', time=2024-09-12T02:40:51.785193+0000, chain.objs.size()=1 2024-09-12T00:47:03.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.IC-pWaOlqvjDSFuI68Fo2asgtUbn1Ra_0 2024-09-12T00:47:03.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4290785538968610374', time=2024-09-12T02:40:53.395559+0000, chain.objs.size()=1 2024-09-12T00:47:03.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.3qAlS4RjKTmxD-OJqvnV43AQnWTpiKL_0 2024-09-12T00:47:03.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12638925980551007744', time=2024-09-12T02:42:03.021071+0000, chain.objs.size()=1 2024-09-12T00:47:03.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.4XNWUAMgeCf544yANIfE9RmZM3n9cGa_0 2024-09-12T00:47:03.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14451043943465452115', time=2024-09-12T02:42:04.989507+0000, chain.objs.size()=1 2024-09-12T00:47:03.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.PzOte75KAud1mPXROCXMitKhjqXX60r_0 2024-09-12T00:47:03.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1578308144552101621', time=2024-09-12T02:42:05.017256+0000, chain.objs.size()=1 2024-09-12T00:47:03.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.WWHGb78-AVTiT4CI_gQolPl1xirnbTG_0 2024-09-12T00:47:03.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7617419443242227437', time=2024-09-12T02:42:41.177298+0000, chain.objs.size()=1 2024-09-12T00:47:03.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.6pWDbcunL7J8alX9y2VGs0fi8WgYuvh_0 2024-09-12T00:47:03.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2773225917299710027', time=2024-09-12T02:46:28.011427+0000, chain.objs.size()=1 2024-09-12T00:47:03.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.595+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17__shadow_.uU1nF2glgjoB0eiA64nm0Iexr-UG10z_0 2024-09-12T00:47:03.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.599+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:47:03.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:47:03.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_jZkhCkcwIQjWiWlFnm31aXqzkpIAFob', time=2024-09-12T02:38:24.142105+0000, chain.objs.size()=1 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_.xRgxP2yuyHMUK9r-6B0sapklxa1C6r6_0 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8824900813053310674', time=2024-09-12T02:38:24.258251+0000, chain.objs.size()=3 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.ihl3og6mMcq9vO96gGIJKgGApk-RLHx_0 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.ihl3og6mMcq9vO96gGIJKgGApk-RLHx_1 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13__shadow_.ihl3og6mMcq9vO96gGIJKgGApk-RLHx_2 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10263310354121222374', time=2024-09-12T02:39:44.649746+0000, chain.objs.size()=1 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20__shadow_.KP5tDqHPaYsQOX5_6SIQ9NYnl-Ngzxe_0 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11316453260828772540', time=2024-09-12T02:40:16.951057+0000, chain.objs.size()=1 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.GBgyK2RXBkg4FqyehHv2yIc08E0a0nm_0 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15172466312088587415', time=2024-09-12T02:40:16.955542+0000, chain.objs.size()=1 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.jce-3tOwMT7h7sRaHP1nnl60W3QxMsq_0 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9547579381394016432', time=2024-09-12T02:40:18.687950+0000, chain.objs.size()=1 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.WO6Ji_YTK9D8mGXlIdPTyK5O-JT2OFF_0 2024-09-12T00:47:03.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2445408089771296382', time=2024-09-12T02:40:19.720529+0000, chain.objs.size()=1 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.agqF7-xsrcjgCwcx45rzQIy_Xi0Tc3N_0 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18296491618915920411', time=2024-09-12T02:40:19.722594+0000, chain.objs.size()=1 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.4iXnoukJSKKk9M3WillKUv8HcfnTahu_0 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16894859751845767187', time=2024-09-12T02:40:19.726339+0000, chain.objs.size()=1 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.WP9hUtr57LI1HDF8YLNBcnwWPTxMngj_0 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13571134886045976038', time=2024-09-12T02:40:51.779470+0000, chain.objs.size()=1 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.603+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.hnMleAg6rulib1wCQ_u4dznFv4pfb2l_0 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8964191160656659717', time=2024-09-12T02:40:53.371504+0000, chain.objs.size()=1 2024-09-12T00:47:03.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.m-B7dIdzAFpuvIfjtUIBloUh-bW6mXS_0 2024-09-12T00:47:03.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6618102724852240981', time=2024-09-12T02:40:53.380572+0000, chain.objs.size()=1 2024-09-12T00:47:03.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.Gx26fez-Ouf6LkHJnTVOYsyu0kaxh5M_0 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11594467419645913372', time=2024-09-12T02:41:26.630842+0000, chain.objs.size()=1 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.zBF68p1IKslIMrQnBpalZv63gbrKTq__0 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10003620524610594936', time=2024-09-12T02:41:26.644199+0000, chain.objs.size()=1 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.05QhWofzquxLs-tzAPO3D9z2E6jjMPU_0 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10385391159230781624', time=2024-09-12T02:42:01.109924+0000, chain.objs.size()=1 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.-CkTH7d5-AyrmXdfe-_ATOi6hAUr5K__0 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16232039037017831895', time=2024-09-12T02:42:37.398436+0000, chain.objs.size()=1 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.3z8cm_6ou7d7ujlN8X6D7jNnqD3oFt9_0 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14656984561812287240', time=2024-09-12T02:42:39.870558+0000, chain.objs.size()=1 2024-09-12T00:47:03.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.607+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.0EaTT4mX5O9BU_LbTKmVvmis7Ke9UtQ_0 2024-09-12T00:47:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.611+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.615+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:47:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.615+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.615+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:47:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5806294821694888612', time=2024-09-12T02:38:23.636782+0000, chain.objs.size()=1 2024-09-12T00:47:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.2xGCSBs0MdsLtPR4u3zHmZSlTC2Gjk6_0 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12965751929160141143', time=2024-09-12T02:38:23.654326+0000, chain.objs.size()=1 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4__shadow_.GqxqpQQvr4O5sYx8f3eOawbhrWplEQy_0 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16743090360714296088', time=2024-09-12T02:39:43.560802+0000, chain.objs.size()=1 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.MIFaB8GowbTWIx6cdH7Vgz8UNFwjXVR_0 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16130595928160408848', time=2024-09-12T02:39:45.649588+0000, chain.objs.size()=1 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.bIrsgAvWqVoM26kpduiyyEfc47jMn6C_0 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12562010344106493702', time=2024-09-12T02:40:16.970279+0000, chain.objs.size()=1 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.21__shadow_.YzNNfP93wUrGY0pxb92MTIboJmdrGwi_0 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9247328074429745520', time=2024-09-12T02:40:18.664275+0000, chain.objs.size()=1 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.Gb1Usv9XIAhjp2KFukeaB1bcLYVmbgl_0 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3324949870925764521', time=2024-09-12T02:40:18.685125+0000, chain.objs.size()=1 2024-09-12T00:47:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.LdEu6Po8x3Qyqp8N3FcaGakDM7zQupx_0 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8476503492977538485', time=2024-09-12T02:40:51.799571+0000, chain.objs.size()=1 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.24__shadow_.Xgg7_d1qTpxVF-clKCPUh34GkIrQs4V_0 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1286382271639526195', time=2024-09-12T02:40:53.360623+0000, chain.objs.size()=1 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.-KMyTR-QyXdTFgYrcWubBvwgQWd6ocp_0 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3228898291738482565', time=2024-09-12T02:40:53.383406+0000, chain.objs.size()=1 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.4NXR9nQ15H320SNCSczucH2xe7i0OZs_0 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17429228152274715159', time=2024-09-12T02:40:54.655483+0000, chain.objs.size()=1 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.g4c6QIgXb0_JebGI2GXqDCGN7TEQtlr_0 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5624681202298657230', time=2024-09-12T02:41:29.452652+0000, chain.objs.size()=1 2024-09-12T00:47:03.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.Ifem3BNFdgAmBYYJUYyM3DwAWxEPhYE_0 2024-09-12T00:47:03.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1402374335286822050', time=2024-09-12T02:42:04.997587+0000, chain.objs.size()=1 2024-09-12T00:47:03.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.619+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.5rblWVT_ww8DzXIFaiud9sNfh_F9bM-_0 2024-09-12T00:47:03.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2514203344097369190', time=2024-09-12T02:42:37.398241+0000, chain.objs.size()=1 2024-09-12T00:47:03.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.RvgtmQZZTXjYstzGwspEXov5gwyiyoQ_0 2024-09-12T00:47:03.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8777047319568531145', time=2024-09-12T02:43:12.050292+0000, chain.objs.size()=1 2024-09-12T00:47:03.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.2fiwEpn9YP1wEKR-5EwNYoXOwrNrgX0_0 2024-09-12T00:47:03.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6064885191103542316', time=2024-09-12T02:43:45.864539+0000, chain.objs.size()=1 2024-09-12T00:47:03.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.DmQMQfB_1WyjWwSxWEJ6-ZHbl_QDOyY_0 2024-09-12T00:47:03.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17143984102467043109', time=2024-09-12T02:43:45.871730+0000, chain.objs.size()=1 2024-09-12T00:47:03.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.yotJAjek3K92wSKCOnyT-oaqxbg2HeW_0 2024-09-12T00:47:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2151392217877716036', time=2024-09-12T02:43:47.341805+0000, chain.objs.size()=1 2024-09-12T00:47:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.fSim2KB2RbbPZq-uUMLqe-LB3QDJ9Be_0 2024-09-12T00:47:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1453561413052516034', time=2024-09-12T02:43:47.366841+0000, chain.objs.size()=1 2024-09-12T00:47:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.bI-SZd0RmF5OI2n9P8E0eCKT4SpMxte_0 2024-09-12T00:47:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.666138480620496143', time=2024-09-12T02:44:21.221003+0000, chain.objs.size()=1 2024-09-12T00:47:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.623+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.vDqGKRdP5PJlrfoMOntUzMweMJ44ujA_0 2024-09-12T00:47:03.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.627+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:47:03.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:47:03.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8902715874227619212', time=2024-09-12T02:38:23.771094+0000, chain.objs.size()=4 2024-09-12T00:47:03.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10__multipart_foo.2~xnOP5ufN1wEoDlXx-edib0qp9G-L3Zg.1 2024-09-12T00:47:03.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10__multipart_foo.2~xnOP5ufN1wEoDlXx-edib0qp9G-L3Zg.2 2024-09-12T00:47:03.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10__multipart_foo.2~xnOP5ufN1wEoDlXx-edib0qp9G-L3Zg.3 2024-09-12T00:47:03.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10__multipart_foo.2~xnOP5ufN1wEoDlXx-edib0qp9G-L3Zg.4 2024-09-12T00:47:03.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1225490261366057273', time=2024-09-12T02:38:24.025584+0000, chain.objs.size()=5 2024-09-12T00:47:03.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.1 2024-09-12T00:47:03.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.1_1 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.2 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__shadow_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.2_1 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16__multipart_foo-FROZEN.2~9mxgDdnWlJkhgx1rbh5zijSl-LqrC2p.3 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285699794501358581', time=2024-09-12T02:38:24.496510+0000, chain.objs.size()=1 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8__shadow_.G4xbm7NmeKxHbBdA0gbWY5WdFOsAyJh_0 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2082984235193352242', time=2024-09-12T02:39:43.554306+0000, chain.objs.size()=1 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.c5zvW8VUksGE3Z0ih1h4zYwRrgItvFz_0 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5071269888846565304', time=2024-09-12T02:40:53.366416+0000, chain.objs.size()=1 2024-09-12T00:47:03.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.631+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.6Gj6ET3nGGdBG-WuF-9BkVtbvQd8ejN_0 2024-09-12T00:47:03.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6132749050860593623', time=2024-09-12T02:40:53.384620+0000, chain.objs.size()=1 2024-09-12T00:47:03.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25__shadow_.WmVrN8vVXwmGPRI8js7Wuawt0vaReqm_0 2024-09-12T00:47:03.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1039005342136957209', time=2024-09-12T02:40:54.660959+0000, chain.objs.size()=1 2024-09-12T00:47:03.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.26__shadow_.zCJJj1NWWrPbXqbcbuWzSStyaiJs3P2_0 2024-09-12T00:47:03.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8877358313432058528', time=2024-09-12T02:41:29.433233+0000, chain.objs.size()=1 2024-09-12T00:47:03.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.8v1E58her9VgvWqfej4UrOXziubuVHL_0 2024-09-12T00:47:03.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5439905162997650917', time=2024-09-12T02:42:04.977663+0000, chain.objs.size()=1 2024-09-12T00:47:03.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.pFLpX9mR_v4re59pBVPsZkMpuaCHCFV_0 2024-09-12T00:47:03.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9290682863705286385', time=2024-09-12T02:42:04.985846+0000, chain.objs.size()=1 2024-09-12T00:47:03.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.NNsOSGllnRJ8iib0Mqfhvkt7vpyBAUN_0 2024-09-12T00:47:03.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8751388492376903644', time=2024-09-12T02:42:37.396653+0000, chain.objs.size()=1 2024-09-12T00:47:03.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.32__shadow_.2IdGpZaEkV-2j0zorrz8kHRYZz_Atw9_0 2024-09-12T00:47:03.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.753561360037094053', time=2024-09-12T02:43:45.871215+0000, chain.objs.size()=1 2024-09-12T00:47:03.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.cAc78DXZ2gIFYHMXmenHuRYJO1n4BeT_0 2024-09-12T00:47:03.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7318746901301069847', time=2024-09-12T02:43:45.885796+0000, chain.objs.size()=1 2024-09-12T00:47:03.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.FHz0BAJIgHvcTK_oWKkty4hq0U55oyL_0 2024-09-12T00:47:03.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16585163383551039320', time=2024-09-12T02:44:21.232677+0000, chain.objs.size()=1 2024-09-12T00:47:03.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.943vP7JGAnzkAHEJUPWOxRcjnbU8kkU_0 2024-09-12T00:47:03.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6125854629505844153', time=2024-09-12T02:44:21.241657+0000, chain.objs.size()=1 2024-09-12T00:47:03.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.635+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39__shadow_.aRsz3ChqKUuULQs1_umsqkeBNNNiveU_0 2024-09-12T00:47:03.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.639+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.643+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:47:03.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2874327365277545327', time=2024-09-12T02:40:18.680762+0000, chain.objs.size()=1 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.XdhY9UslfD-9eszcnES7eA_Aew6l4n__0 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5689691502108602231', time=2024-09-12T02:40:19.747082+0000, chain.objs.size()=1 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.23__shadow_.g-Cswjxj0FllBTVvIKliOTgBsgiKiFK_0 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12325532909271268105', time=2024-09-12T02:41:26.627465+0000, chain.objs.size()=1 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.ERRhRksLjBl7u-7eNsub5Va7sK4985B_0 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7489699886062860477', time=2024-09-12T02:41:26.637344+0000, chain.objs.size()=1 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.27__shadow_.S_moD898hcNkW-USqqyzUkPUtG4lpU8_0 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17103319995966733959', time=2024-09-12T02:41:29.434481+0000, chain.objs.size()=1 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_._qW88uazXI4UidPAtBzZ1nTVUTOJkfT_0 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.617389026324169613', time=2024-09-12T02:41:29.454542+0000, chain.objs.size()=1 2024-09-12T00:47:03.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.erRxF8KvKbI1kljKMXCLiVHeJvkaDDt_0 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13232082326144469374', time=2024-09-12T02:42:03.051046+0000, chain.objs.size()=1 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.voLs7aMOsCmkuckBg8vsii5aScTwQD1_0 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15391431329556117105', time=2024-09-12T02:42:05.014587+0000, chain.objs.size()=1 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.31__shadow_.PVc8wh3BlF0g35DNSgC8A8BVsCzTofq_0 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1695225770157205435', time=2024-09-12T02:42:39.883485+0000, chain.objs.size()=1 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.33__shadow_.4OWg2ivW9TfN3-9-skwv07QyZzIqP6m_0 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10678413172209647252', time=2024-09-12T02:43:45.859300+0000, chain.objs.size()=1 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.36__shadow_.xBmW25BSYw3AyqXq8za7AgO9sWXCs5a_0 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11153210049656274573', time=2024-09-12T02:43:48.877599+0000, chain.objs.size()=1 2024-09-12T00:47:03.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.647+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.H6Sl0cFd6R4xRbosw8uYpfl2E7Drmeh_0 2024-09-12T00:47:03.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.651+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.655+0000 7f392c6a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:47:03.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.655+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:03.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.655+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:03.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.655+0000 7f392c6a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:47:03.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.655+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12116136436557743323', time=2024-09-12T02:38:23.951526+0000, chain.objs.size()=1 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.655+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15__shadow_.UWbjlDCvL4-_KZIoYFICmbk5bnosJTw_0 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13020905528310279984', time=2024-09-12T02:38:24.423404+0000, chain.objs.size()=1 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7__shadow_.Ylkl7yX5ZbVSVos6FI0eJdNWbQUUog0_0 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.439460983713103010', time=2024-09-12T02:38:24.464529+0000, chain.objs.size()=1 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8__shadow_.17Bf8R-3BsWghP3PgvOmRnsrNdUhOxR_0 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5763680082550506495', time=2024-09-12T02:38:24.487037+0000, chain.objs.size()=1 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8__shadow_.-DhJ1lMuJn5wVMTVigUiN3gMVQlvXEy_0 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6727452586778008116', time=2024-09-12T02:39:43.552005+0000, chain.objs.size()=1 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.19__shadow_.nlRqoGeglCLSuS4hi9g9iMtkzJ5CluN_0 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7838153979608125433', time=2024-09-12T02:40:18.675301+0000, chain.objs.size()=1 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.22__shadow_.G-UvASGA7VZcLkLWEg7eXVlGCqNzxNn_0 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16010483225611141332', time=2024-09-12T02:41:29.438383+0000, chain.objs.size()=1 2024-09-12T00:47:03.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.28__shadow_.adyFNTSi3szqVaKtMjsenxgC8QzWk1M_0 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5732406387789126356', time=2024-09-12T02:42:01.112905+0000, chain.objs.size()=1 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.29__shadow_.QKwCoNzBfKM_IRItIwQtYCHO5f_lnmT_0 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10358771989164026182', time=2024-09-12T02:42:03.015604+0000, chain.objs.size()=1 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.30__shadow_.ywrWVEegKnm4D8JHKUfQ3_1sbxxf1zR_0 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8201651466300111882', time=2024-09-12T02:43:12.064444+0000, chain.objs.size()=1 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.34__shadow_.fx5bRuWdOuYAUgxGNzhmCTAEGMpCMvt_0 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1746583133971320054', time=2024-09-12T02:43:14.208329+0000, chain.objs.size()=1 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.35__shadow_.XYGhqe0LIErcy07OdN909WStLzOxsGz_0 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16630930339825560971', time=2024-09-12T02:43:47.351354+0000, chain.objs.size()=1 2024-09-12T00:47:03.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.37__shadow_.HMu7tLKEXFwz0Ky5Wc3Ti1Xmn57FOr__0 2024-09-12T00:47:03.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3623911455690410452', time=2024-09-12T02:43:48.879364+0000, chain.objs.size()=1 2024-09-12T00:47:03.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.659+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.38__shadow_.XMIul18pAwHPsmXy3FNf7FbHdZguBHd_0 2024-09-12T00:47:03.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.663+0000 7f392c6a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:47:03.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.667+0000 7f37e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:03.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.671+0000 7f392c6a29c0 20 remove_watcher() i=0 2024-09-12T00:47:03.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.671+0000 7f392c6a29c0 2 removed watcher, disabling cache 2024-09-12T00:47:03.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.671+0000 7f392c6a29c0 20 remove_watcher() i=1 2024-09-12T00:47:03.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.671+0000 7f392c6a29c0 20 remove_watcher() i=2 2024-09-12T00:47:03.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.671+0000 7f392c6a29c0 20 remove_watcher() i=3 2024-09-12T00:47:03.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.675+0000 7f392c6a29c0 20 remove_watcher() i=4 2024-09-12T00:47:03.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.675+0000 7f392c6a29c0 20 remove_watcher() i=5 2024-09-12T00:47:03.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.675+0000 7f392c6a29c0 20 remove_watcher() i=6 2024-09-12T00:47:03.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.675+0000 7f392c6a29c0 20 remove_watcher() i=7 2024-09-12T00:47:03.691 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:47:03.761 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:03.762 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.803+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 realm 2024-09-12T00:47:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:03.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.807+0000 7f43328429c0 20 searching for the correct realm 2024-09-12T00:47:03.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:03.811+0000 7f432fb47640 0 -- 172.21.15.137:0/884358314 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f4324065180 msgr2=0x7f432406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.023+0000 7f4330b49640 0 -- 172.21.15.137:0/884358314 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x561e2b403120 msgr2=0x561e2b4055b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:04.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:47:04.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:04.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:47:04.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:04.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:04.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.035+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:04.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 zone default found 2024-09-12T00:47:04.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 4 Realm: () 2024-09-12T00:47:04.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:47:04.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:47:04.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:04.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 zonegroup default 2024-09-12T00:47:04.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 started sync module instance, tier type = 2024-09-12T00:47:04.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.039+0000 7f43328429c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:47:04.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 20 add_watcher() i=0 2024-09-12T00:47:04.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 20 add_watcher() i=1 2024-09-12T00:47:04.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 20 add_watcher() i=2 2024-09-12T00:47:04.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 20 add_watcher() i=3 2024-09-12T00:47:04.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 20 add_watcher() i=4 2024-09-12T00:47:04.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 20 add_watcher() i=5 2024-09-12T00:47:04.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 20 add_watcher() i=6 2024-09-12T00:47:04.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 20 add_watcher() i=7 2024-09-12T00:47:04.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.063+0000 7f43328429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:04.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.071+0000 7f41e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:04.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.071+0000 7f43328429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:04.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.071+0000 7f43328429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:04.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.167+0000 7f41e5fdb640 20 reqs_thread_entry: start 2024-09-12T00:47:04.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.167+0000 7f43328429c0 20 init_complete bucket index max shards: 1 2024-09-12T00:47:04.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.167+0000 7f43328429c0 20 Filter name: none 2024-09-12T00:47:04.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.167+0000 7f41577fe640 20 reqs_thread_entry: start 2024-09-12T00:47:04.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.167+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:47:04.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.171+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.175+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.175+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.179+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:47:04.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.179+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.183+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.183+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.187+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:47:04.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.191+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.191+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.191+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.195+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:47:04.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.195+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.199+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.199+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.203+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:47:04.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.207+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.207+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.207+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.211+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:47:04.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.215+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.215+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.215+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.219+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:47:04.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.223+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.223+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.223+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.227+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:47:04.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.231+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.231+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.231+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.235+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:47:04.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.239+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.239+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.239+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.243+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:47:04.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.247+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.247+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.247+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.251+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:47:04.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.255+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.255+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.259+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.259+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:47:04.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.263+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.267+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.267+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.271+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:47:04.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.271+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.275+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.275+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.279+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:47:04.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.279+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.283+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.283+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.287+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:47:04.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.291+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.291+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.291+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.295+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:47:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.299+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.299+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.303+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.303+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:47:04.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.307+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.311+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.311+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.311+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:47:04.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.315+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.319+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.319+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.319+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:47:04.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.323+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.327+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.327+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.327+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:47:04.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.331+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.335+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.335+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.339+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:47:04.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.343+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.343+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.343+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.347+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:47:04.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.351+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.351+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.351+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.355+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:47:04.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.359+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.363+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.363+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.367+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:47:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.367+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.371+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.371+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.371+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:47:04.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.375+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.379+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.379+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.383+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:47:04.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.383+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.387+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.387+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.391+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:47:04.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.395+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.395+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.395+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.399+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:47:04.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.403+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.403+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.403+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.407+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:47:04.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.411+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.411+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.415+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.415+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:47:04.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.419+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.419+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.423+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.423+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:47:04.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.427+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.431+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.431+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.435+0000 7f43328429c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:47:04.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.439+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.439+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:47:04.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.439+0000 7f43328429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:47:04.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.447+0000 7f41e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:04.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.451+0000 7f43328429c0 20 remove_watcher() i=0 2024-09-12T00:47:04.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.451+0000 7f43328429c0 2 removed watcher, disabling cache 2024-09-12T00:47:04.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.451+0000 7f43328429c0 20 remove_watcher() i=1 2024-09-12T00:47:04.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.455+0000 7f43328429c0 20 remove_watcher() i=2 2024-09-12T00:47:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.459+0000 7f43328429c0 20 remove_watcher() i=3 2024-09-12T00:47:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.463+0000 7f43328429c0 20 remove_watcher() i=4 2024-09-12T00:47:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.463+0000 7f43328429c0 20 remove_watcher() i=5 2024-09-12T00:47:04.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.467+0000 7f43328429c0 20 remove_watcher() i=6 2024-09-12T00:47:04.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:47:04.471+0000 7f43328429c0 20 remove_watcher() i=7 2024-09-12T00:47:04.493 DEBUG:teuthology.orchestra.run.smithi137:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:47:05.097 INFO:teuthology.orchestra.run.smithi137.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:47:09.494 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:47:28.694 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :compileJava 2024-09-12T00:47:28.694 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :processResources 2024-09-12T00:47:28.694 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :classes 2024-09-12T00:47:29.493 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:29.493 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :compileTestJava 2024-09-12T00:47:29.494 INFO:teuthology.orchestra.run.smithi137.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:47:29.494 INFO:teuthology.orchestra.run.smithi137.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:47:29.494 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:29.494 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:47:29.495 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :testClasses 2024-09-12T00:47:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:36.493 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :test 2024-09-12T00:47:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:36.493 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:47:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:37.393 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:47:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:37.693 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:47:37.792 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:37.793 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:47:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:37.993 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:47:38.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:38.693 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:47:38.893 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:38.893 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:47:38.893 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:38.893 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:47:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:38.993 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:47:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:39.093 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:47:39.293 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:39.293 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:47:39.993 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:39.993 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:47:40.393 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:40.393 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:47:40.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:40.693 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:47:40.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12 00:47:40,614 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:47:47.392 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:47.393 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:47:47.793 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:47.793 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:47:47.793 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:47.793 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:47:48.093 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:48.093 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:47:48.093 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:48.093 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:47:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:48.493 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:47:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:48.893 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:47:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:49.193 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:47:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:49.193 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:47:49.293 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:49.293 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:47:51.792 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:51.793 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:47:51.992 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:51.993 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:47:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:52.693 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:47:52.992 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:52.993 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:47:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:53.493 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:47:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:47:53.693 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:48:01.593 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:01.593 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:48:01.893 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:01.893 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:48:03.192 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:03.193 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:48:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:03.493 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:48:05.192 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:05.193 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:48:05.394 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:05.394 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:48:05.892 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:05.893 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:48:06.193 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:06.193 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:48:06.193 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:06.193 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:48:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:06.395 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:48:06.501 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:06.501 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:48:06.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:06.693 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:48:06.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:06.693 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:48:06.993 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:06.993 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:48:06.993 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:06.993 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:48:07.293 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:07.293 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:48:07.293 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:07.293 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:48:07.592 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:07.593 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:48:07.593 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:07.593 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:48:07.792 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:07.792 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:48:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:07.893 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:48:08.092 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:08.093 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:48:08.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:08.693 INFO:teuthology.orchestra.run.smithi137.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:48:09.093 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:09.093 INFO:teuthology.orchestra.run.smithi137.stdout:---------------------------------------------------------------------- 2024-09-12T00:48:09.093 INFO:teuthology.orchestra.run.smithi137.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:48:09.093 INFO:teuthology.orchestra.run.smithi137.stdout:---------------------------------------------------------------------- 2024-09-12T00:48:09.093 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:09.094 INFO:teuthology.orchestra.run.smithi137.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:48:09.094 INFO:teuthology.orchestra.run.smithi137.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:48:09.094 INFO:teuthology.orchestra.run.smithi137.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:48:09.094 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:09.094 INFO:teuthology.orchestra.run.smithi137.stdout:BUILD SUCCESSFUL in 1m 4s 2024-09-12T00:48:09.094 INFO:teuthology.orchestra.run.smithi137.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:48:09.444 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:48:09.475 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:09.475 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:09.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.522+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:09.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 realm 2024-09-12T00:48:09.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:09.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:09.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:09.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:09.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:09.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.526+0000 7fcb64d599c0 20 searching for the correct realm 2024-09-12T00:48:09.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.534+0000 7fcb6285f640 0 -- 172.21.15.137:0/4270332054 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fcb54090b60 msgr2=0x7fcb540891d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.538+0000 7fcb6285f640 0 -- 172.21.15.137:0/4270332054 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55e381302ce0 msgr2=0x55e381305110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:09.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.546+0000 7fcb64d599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:09.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.546+0000 7fcb64d599c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:48:09.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.546+0000 7fcb64d599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:09.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.546+0000 7fcb64d599c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:48:09.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.546+0000 7fcb64d599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:09.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.546+0000 7fcb64d599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:09.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.546+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:09.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:09.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 zone default found 2024-09-12T00:48:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 4 Realm: () 2024-09-12T00:48:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:48:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:48:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 zonegroup default 2024-09-12T00:48:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 started sync module instance, tier type = 2024-09-12T00:48:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.550+0000 7fcb64d599c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:48:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 20 add_watcher() i=0 2024-09-12T00:48:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 20 add_watcher() i=1 2024-09-12T00:48:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 20 add_watcher() i=2 2024-09-12T00:48:09.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 20 add_watcher() i=3 2024-09-12T00:48:09.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 20 add_watcher() i=4 2024-09-12T00:48:09.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 20 add_watcher() i=5 2024-09-12T00:48:09.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 20 add_watcher() i=6 2024-09-12T00:48:09.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 20 add_watcher() i=7 2024-09-12T00:48:09.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.570+0000 7fcb64d599c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:09.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.574+0000 7fca197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:09.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.578+0000 7fcb64d599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:09.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.578+0000 7fcb64d599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.650+0000 7fc993fff640 20 reqs_thread_entry: start 2024-09-12T00:48:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.650+0000 7fcb64d599c0 20 init_complete bucket index max shards: 1 2024-09-12T00:48:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.650+0000 7fcb64d599c0 20 Filter name: none 2024-09-12T00:48:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.650+0000 7fc991ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.654+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:48:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.654+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.654+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.654+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.658+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:48:09.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:48:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1024434577332466927', time=2024-09-12T02:47:59.218982+0000, chain.objs.size()=19 2024-09-12T00:48:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.1 2024-09-12T00:48:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.1_1 2024-09-12T00:48:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.2 2024-09-12T00:48:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.2_1 2024-09-12T00:48:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.3 2024-09-12T00:48:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.3_1 2024-09-12T00:48:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.4 2024-09-12T00:48:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.4_1 2024-09-12T00:48:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.5 2024-09-12T00:48:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.5_1 2024-09-12T00:48:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.6 2024-09-12T00:48:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.662+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.6_1 2024-09-12T00:48:09.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.7 2024-09-12T00:48:09.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.7_1 2024-09-12T00:48:09.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.8 2024-09-12T00:48:09.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.8_1 2024-09-12T00:48:09.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.9 2024-09-12T00:48:09.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.9_1 2024-09-12T00:48:09.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~m4V5CuewoTN6j1T1SLciOlxl7G84t7O.10 2024-09-12T00:48:09.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13401702054577435001', time=2024-09-12T02:48:01.498602+0000, chain.objs.size()=16 2024-09-12T00:48:09.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.1 2024-09-12T00:48:09.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.1_1 2024-09-12T00:48:09.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.670+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.1_2 2024-09-12T00:48:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.678+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.2 2024-09-12T00:48:09.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.678+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.2_1 2024-09-12T00:48:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.682+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.2_2 2024-09-12T00:48:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.682+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.3 2024-09-12T00:48:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.682+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.3_1 2024-09-12T00:48:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.682+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.3_2 2024-09-12T00:48:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.682+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.4 2024-09-12T00:48:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.682+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.4_1 2024-09-12T00:48:09.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.690+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.4_2 2024-09-12T00:48:09.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.690+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.5 2024-09-12T00:48:09.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.690+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.5_1 2024-09-12T00:48:09.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.690+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.5_2 2024-09-12T00:48:09.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.690+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~_dWH46iXC8yJViMKDm1d7MYu0ck-inu.6 2024-09-12T00:48:09.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.690+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15353170868772991237', time=2024-09-12T02:48:07.358154+0000, chain.objs.size()=1 2024-09-12T00:48:09.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.690+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.63__shadow_.7Pn_kH6r1I1RCDlTYYx7j-8wf9ZPvUO_0 2024-09-12T00:48:09.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.702+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.706+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:48:09.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:09.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3441107966423100424', time=2024-09-12T02:48:01.669238+0000, chain.objs.size()=16 2024-09-12T00:48:09.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.1 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.1_1 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.1_2 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.2 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.2_1 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.2_2 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.3 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.3_1 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.3_2 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.4 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.4_1 2024-09-12T00:48:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.710+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.4_2 2024-09-12T00:48:09.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.718+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.5 2024-09-12T00:48:09.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.722+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.5_1 2024-09-12T00:48:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.722+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.5_2 2024-09-12T00:48:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.722+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~Vspu_d_niaA76-vNn_8EmNVV3C1ZYhf.6 2024-09-12T00:48:09.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.726+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.730+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:48:09.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.730+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:48:09.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13659639302525766944', time=2024-09-12T02:48:02.650650+0000, chain.objs.size()=1 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__shadow_.r3mz0AfeRs2i70JZkR6S-m2mXXB0tvW_0 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8694108131185521782', time=2024-09-12T02:48:03.266494+0000, chain.objs.size()=9 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__multipart_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.1 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__shadow_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.1_1 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__multipart_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.2 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__shadow_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.2_1 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__multipart_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.3 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__shadow_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.3_1 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__multipart_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.4 2024-09-12T00:48:09.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__shadow_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.4_1 2024-09-12T00:48:09.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.734+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.56__multipart_key1.2~3Zg36EVdLlU_0Ye0ZZ9HfOcWt3bebqE.5 2024-09-12T00:48:09.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.742+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.746+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:48:09.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.746+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:48:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14978716233468999708', time=2024-09-12T02:47:51.823377+0000, chain.objs.size()=9 2024-09-12T00:48:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__multipart_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.1 2024-09-12T00:48:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__shadow_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.1_1 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__multipart_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.2 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__shadow_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.2_1 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__multipart_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.3 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__shadow_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.3_1 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__multipart_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.4 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__shadow_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.4_1 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.52__multipart_key1.2~3DvbK4omrIbWJIuT2OnmowB_BB68eft.5 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13041596304338995', time=2024-09-12T02:47:58.079319+0000, chain.objs.size()=21 2024-09-12T00:48:09.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.1 2024-09-12T00:48:09.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.1_1 2024-09-12T00:48:09.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.750+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.2 2024-09-12T00:48:09.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.754+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.2_1 2024-09-12T00:48:09.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.758+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.3 2024-09-12T00:48:09.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.758+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.3_1 2024-09-12T00:48:09.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.758+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.4 2024-09-12T00:48:09.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.758+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.4_1 2024-09-12T00:48:09.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.758+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.5 2024-09-12T00:48:09.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.758+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.5_1 2024-09-12T00:48:09.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.758+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.6 2024-09-12T00:48:09.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.758+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.6_1 2024-09-12T00:48:09.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.762+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.7 2024-09-12T00:48:09.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.762+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.7_1 2024-09-12T00:48:09.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.762+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.8 2024-09-12T00:48:09.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.766+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.8_1 2024-09-12T00:48:09.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.9 2024-09-12T00:48:09.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.9_1 2024-09-12T00:48:09.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.10 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.10_1 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~4ayAbmjg7YlnexYhtwQ3RbLHe0JfZta.11 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6889321672540560037', time=2024-09-12T02:48:08.794436+0000, chain.objs.size()=21 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.1 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.1_1 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.2 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.2_1 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.3 2024-09-12T00:48:09.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.770+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.3_1 2024-09-12T00:48:09.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.778+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.4 2024-09-12T00:48:09.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.778+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.4_1 2024-09-12T00:48:09.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.778+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.5 2024-09-12T00:48:09.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.778+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.5_1 2024-09-12T00:48:09.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.778+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.6 2024-09-12T00:48:09.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.778+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.6_1 2024-09-12T00:48:09.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.778+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.7 2024-09-12T00:48:09.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.782+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.7_1 2024-09-12T00:48:09.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.782+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.8 2024-09-12T00:48:09.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.786+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.8_1 2024-09-12T00:48:09.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.786+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.9 2024-09-12T00:48:09.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.786+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.9_1 2024-09-12T00:48:09.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.786+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.10 2024-09-12T00:48:09.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.786+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__shadow_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.10_1 2024-09-12T00:48:09.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.786+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.66__multipart_key1.2~mzjtZUm3EtSeqhbKskSia8rPoj5CCJ3.11 2024-09-12T00:48:09.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.790+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.794+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:48:09.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.798+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.798+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.798+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.798+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:48:09.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.798+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:48:09.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11369340622078213304', time=2024-09-12T02:47:45.041162+0000, chain.objs.size()=9 2024-09-12T00:48:09.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.1 2024-09-12T00:48:09.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.1_1 2024-09-12T00:48:09.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.2 2024-09-12T00:48:09.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.2_1 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.3 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.3_1 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.4 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.4_1 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~l7Pw5DQGectTSAhvWypcMGbqnuNKPGR.5 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15483952314918426839', time=2024-09-12T02:47:48.986952+0000, chain.objs.size()=9 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__multipart_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.1 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__shadow_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.1_1 2024-09-12T00:48:09.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.802+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__multipart_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.2 2024-09-12T00:48:09.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.806+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__shadow_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.2_1 2024-09-12T00:48:09.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.806+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__multipart_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.3 2024-09-12T00:48:09.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.806+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__shadow_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.3_1 2024-09-12T00:48:09.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.806+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__multipart_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.4 2024-09-12T00:48:09.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.806+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__shadow_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.4_1 2024-09-12T00:48:09.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.806+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.51__multipart_key1.2~2oFoD2zy3JQUK5wF21iRXr0MO_by2Kx.5 2024-09-12T00:48:09.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.810+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.814+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:48:09.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.818+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.818+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.818+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.818+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:48:09.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.818+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.822+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.822+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.822+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:48:09.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.822+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.826+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.826+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.826+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:48:09.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.826+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.826+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7395544758083239104', time=2024-09-12T02:47:47.596583+0000, chain.objs.size()=7 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~JiKH7VcArXEu-ly54KLeTdQnwvv0wxw.1 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~JiKH7VcArXEu-ly54KLeTdQnwvv0wxw.1_1 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~JiKH7VcArXEu-ly54KLeTdQnwvv0wxw.1_2 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~JiKH7VcArXEu-ly54KLeTdQnwvv0wxw.2 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~JiKH7VcArXEu-ly54KLeTdQnwvv0wxw.2_1 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~JiKH7VcArXEu-ly54KLeTdQnwvv0wxw.2_2 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~JiKH7VcArXEu-ly54KLeTdQnwvv0wxw.3 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12259354742879902702', time=2024-09-12T02:47:52.824143+0000, chain.objs.size()=9 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.1 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.1_1 2024-09-12T00:48:09.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.2 2024-09-12T00:48:09.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.2_1 2024-09-12T00:48:09.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.830+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.3 2024-09-12T00:48:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.3_1 2024-09-12T00:48:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.4 2024-09-12T00:48:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.4_1 2024-09-12T00:48:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file2.mpg.2~Bk-rih-04zwz1Z3Q4_El7EfLsVJP69D.5 2024-09-12T00:48:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13616846121126226892', time=2024-09-12T02:48:05.235548+0000, chain.objs.size()=9 2024-09-12T00:48:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__multipart_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.1 2024-09-12T00:48:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__shadow_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.1_1 2024-09-12T00:48:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__multipart_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.2 2024-09-12T00:48:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__shadow_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.2_1 2024-09-12T00:48:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.834+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__multipart_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.3 2024-09-12T00:48:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.838+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__shadow_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.3_1 2024-09-12T00:48:09.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.838+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__multipart_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.4 2024-09-12T00:48:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.838+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__shadow_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.4_1 2024-09-12T00:48:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.838+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57__multipart_key1.2~0FMWqMHEz835I5r7po5kz6QWeHuIsym.5 2024-09-12T00:48:09.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.842+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.846+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:48:09.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.846+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.850+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.850+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:09.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.850+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.858899257321330398', time=2024-09-12T02:48:06.238604+0000, chain.objs.size()=1 2024-09-12T00:48:09.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.850+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.59__shadow_.1-qMHcyGq-38JvYXJe8GeKO66YSTqFT_0 2024-09-12T00:48:09.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.850+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.854+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:48:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.854+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.854+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.854+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.854+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17098440552812164307', time=2024-09-12T02:47:52.806045+0000, chain.objs.size()=1 2024-09-12T00:48:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.854+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_.oDIRYQ0Vhg3JqC7JmITsVnVcpEQzHGL_0 2024-09-12T00:48:09.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.858+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.858+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:48:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:48:09.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17290053917873376179', time=2024-09-12T02:47:43.459813+0000, chain.objs.size()=9 2024-09-12T00:48:09.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.1 2024-09-12T00:48:09.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.1_1 2024-09-12T00:48:09.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.2 2024-09-12T00:48:09.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.2_1 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.3 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.3_1 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.4 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.4_1 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~jsjCBAg6Zbf44d5lnbwJpGTx0FmmfBg.5 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8683720057308592596', time=2024-09-12T02:47:52.840025+0000, chain.objs.size()=1 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_.DjMx5Tgj8TO8jVIIzhrnBaq-egdb4ir_0 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17900279101730930236', time=2024-09-12T02:48:07.642781+0000, chain.objs.size()=1 2024-09-12T00:48:09.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.862+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.64__shadow_.GR6wktuDxs1gogShXDz4zen9wKFFcwW_0 2024-09-12T00:48:09.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.866+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.870+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:48:09.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.870+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.870+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.874+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.874+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:48:09.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.874+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.874+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11066805104781969964', time=2024-09-12T02:47:38.719532+0000, chain.objs.size()=9 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__multipart_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.1 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__shadow_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.1_1 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__multipart_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.2 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__shadow_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.2_1 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__multipart_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.3 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__shadow_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.3_1 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__multipart_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.4 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__shadow_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.4_1 2024-09-12T00:48:09.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.42__multipart_key1.2~BxUxAHuJQHxeTGApZSA5ctm5bg07O9w.5 2024-09-12T00:48:09.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16337556798202526061', time=2024-09-12T02:48:06.792067+0000, chain.objs.size()=1 2024-09-12T00:48:09.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.878+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.61__shadow_.1ujC_ZexBhQDJAmUHw6zQ7tsONALcUK_0 2024-09-12T00:48:09.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.882+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.886+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:48:09.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.886+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.886+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:09.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13284252387882567278', time=2024-09-12T02:47:52.792089+0000, chain.objs.size()=9 2024-09-12T00:48:09.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.1 2024-09-12T00:48:09.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.1_1 2024-09-12T00:48:09.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.2 2024-09-12T00:48:09.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.2_1 2024-09-12T00:48:09.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.3 2024-09-12T00:48:09.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.3_1 2024-09-12T00:48:09.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.4 2024-09-12T00:48:09.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.4_1 2024-09-12T00:48:09.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.890+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__multipart_file.mpg.2~AKyVbJY0kdeyWxaKT4b8gRNCO0YGp4_.5 2024-09-12T00:48:09.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.894+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.898+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:48:09.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.898+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.898+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.898+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.898+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:48:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6538958545582480371', time=2024-09-12T02:47:40.225751+0000, chain.objs.size()=9 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.1 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__shadow_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.1_1 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.2 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__shadow_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.2_1 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.3 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__shadow_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.3_1 2024-09-12T00:48:09.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.4 2024-09-12T00:48:09.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__shadow_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.4_1 2024-09-12T00:48:09.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.5 2024-09-12T00:48:09.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.295778465102987727', time=2024-09-12T02:47:52.854774+0000, chain.objs.size()=1 2024-09-12T00:48:09.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.902+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.53__shadow_.Ue8Yd7ElzD5A0BY6hkNC5srIBsz1VTI_0 2024-09-12T00:48:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.906+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.910+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:48:09.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.910+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.910+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.914+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.914+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:48:09.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.918+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.918+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.918+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.918+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:48:09.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.918+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.922+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.922+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:09.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.922+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8506817377443886221', time=2024-09-12T02:48:06.517047+0000, chain.objs.size()=1 2024-09-12T00:48:09.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.922+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.60__shadow_.V8bPvSv3CU_yydCclB1naZv-FU1u3JW_0 2024-09-12T00:48:09.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.922+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.926+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:48:09.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.926+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.926+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.926+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:48:09.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:09.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.57373281388516331', time=2024-09-12T02:47:56.820293+0000, chain.objs.size()=21 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.1 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.1_1 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.2 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.2_1 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.3 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.3_1 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.4 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.4_1 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.5 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.5_1 2024-09-12T00:48:09.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.6 2024-09-12T00:48:09.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.930+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.6_1 2024-09-12T00:48:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.934+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.7 2024-09-12T00:48:09.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.934+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.7_1 2024-09-12T00:48:09.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.934+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.8 2024-09-12T00:48:09.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.934+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.8_1 2024-09-12T00:48:09.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.934+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.9 2024-09-12T00:48:09.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.934+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.9_1 2024-09-12T00:48:09.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.938+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.10 2024-09-12T00:48:09.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.938+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.10_1 2024-09-12T00:48:09.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.938+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~vHuO-KKP26aj-_NCkuQC3ZzqOv8Ab8p.11 2024-09-12T00:48:09.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.942+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.942+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:48:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.946+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.946+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.946+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.946+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:48:09.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.946+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:48:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10773353937460043657', time=2024-09-12T02:47:44.323973+0000, chain.objs.size()=9 2024-09-12T00:48:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.1 2024-09-12T00:48:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.1_1 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.2 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.2_1 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.3 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.3_1 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.4 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.4_1 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~eIEdd0V4LqidyxaG4bHrdp_BBNTSK_I.5 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XyAHTtEa1p5DRa_ku6UNd1S_unNsVi0', time=2024-09-12T02:47:53.579371+0000, chain.objs.size()=5 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.54__multipart_key1.2~XyAHTtEa1p5DRa_ku6UNd1S_unNsVi0.7 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.54__shadow_key1.2~XyAHTtEa1p5DRa_ku6UNd1S_unNsVi0.7_1 2024-09-12T00:48:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.950+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.54__multipart_key1.2~XyAHTtEa1p5DRa_ku6UNd1S_unNsVi0.10 2024-09-12T00:48:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.954+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.54__shadow_key1.2~XyAHTtEa1p5DRa_ku6UNd1S_unNsVi0.10_1 2024-09-12T00:48:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.954+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.54__multipart_key1.2~XyAHTtEa1p5DRa_ku6UNd1S_unNsVi0.13 2024-09-12T00:48:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.958+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.958+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:48:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:09.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6831737180187490250', time=2024-09-12T02:47:47.271523+0000, chain.objs.size()=7 2024-09-12T00:48:09.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~_Uwj7LVEnLJs3_jsgltY0A0UcZ-kw_F.1 2024-09-12T00:48:09.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~_Uwj7LVEnLJs3_jsgltY0A0UcZ-kw_F.1_1 2024-09-12T00:48:09.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~_Uwj7LVEnLJs3_jsgltY0A0UcZ-kw_F.1_2 2024-09-12T00:48:09.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~_Uwj7LVEnLJs3_jsgltY0A0UcZ-kw_F.2 2024-09-12T00:48:09.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~_Uwj7LVEnLJs3_jsgltY0A0UcZ-kw_F.2_1 2024-09-12T00:48:09.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~_Uwj7LVEnLJs3_jsgltY0A0UcZ-kw_F.2_2 2024-09-12T00:48:09.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~_Uwj7LVEnLJs3_jsgltY0A0UcZ-kw_F.3 2024-09-12T00:48:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.962+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:09.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:48:09.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:09.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:09.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:48:09.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12378361547120838390', time=2024-09-12T02:47:40.069587+0000, chain.objs.size()=9 2024-09-12T00:48:09.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.1 2024-09-12T00:48:09.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__shadow_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.1_1 2024-09-12T00:48:09.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.2 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__shadow_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.2_1 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.3 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__shadow_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.3_1 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.4 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__shadow_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.4_1 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.44__multipart_key1.2~wukRIvwGSHF-ZHNT5R9br2Sonpe_hQA.5 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7906912788704027184', time=2024-09-12T02:47:45.725522+0000, chain.objs.size()=7 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~rM2YKaB3ASNUCPEHCR9j1F-H2lj90Te.1 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~rM2YKaB3ASNUCPEHCR9j1F-H2lj90Te.1_1 2024-09-12T00:48:09.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.970+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~rM2YKaB3ASNUCPEHCR9j1F-H2lj90Te.1_2 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~rM2YKaB3ASNUCPEHCR9j1F-H2lj90Te.2 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~rM2YKaB3ASNUCPEHCR9j1F-H2lj90Te.2_1 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__shadow_key1.2~rM2YKaB3ASNUCPEHCR9j1F-H2lj90Te.2_2 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.47__multipart_key1.2~rM2YKaB3ASNUCPEHCR9j1F-H2lj90Te.3 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL', time=2024-09-12T02:48:06.000067+0000, chain.objs.size()=61 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.1 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.2 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.3 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.4 2024-09-12T00:48:09.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.5 2024-09-12T00:48:09.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.6 2024-09-12T00:48:09.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.974+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.7 2024-09-12T00:48:09.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.8 2024-09-12T00:48:09.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.9 2024-09-12T00:48:09.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.10 2024-09-12T00:48:09.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.11 2024-09-12T00:48:09.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.12 2024-09-12T00:48:09.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.13 2024-09-12T00:48:09.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.14 2024-09-12T00:48:09.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.15 2024-09-12T00:48:09.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.16 2024-09-12T00:48:09.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.17 2024-09-12T00:48:09.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.982+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.18 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.19 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.20 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.21 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.22 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.23 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.24 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.25 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.26 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.27 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.28 2024-09-12T00:48:09.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.986+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.29 2024-09-12T00:48:09.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.30 2024-09-12T00:48:09.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.31 2024-09-12T00:48:09.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.32 2024-09-12T00:48:09.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.33 2024-09-12T00:48:09.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.34 2024-09-12T00:48:09.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.35 2024-09-12T00:48:09.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.36 2024-09-12T00:48:09.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.37 2024-09-12T00:48:09.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.38 2024-09-12T00:48:09.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.39 2024-09-12T00:48:09.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.990+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.40 2024-09-12T00:48:09.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.41 2024-09-12T00:48:09.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.42 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.43 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.44 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.45 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.46 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.47 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.48 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.49 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.50 2024-09-12T00:48:09.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:09.994+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.51 2024-09-12T00:48:10.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.002+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.52 2024-09-12T00:48:10.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.002+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.53 2024-09-12T00:48:10.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.002+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.54 2024-09-12T00:48:10.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.002+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.55 2024-09-12T00:48:10.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.002+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.56 2024-09-12T00:48:10.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.006+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.57 2024-09-12T00:48:10.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.006+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.58 2024-09-12T00:48:10.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.006+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.59 2024-09-12T00:48:10.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.006+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.60 2024-09-12T00:48:10.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.006+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.58__multipart_key1.2~Lf_CAX5dUh6xPUGV1yszlhMUbxr7rQL.61 2024-09-12T00:48:10.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.006+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10363846960087374643', time=2024-09-12T02:48:07.072550+0000, chain.objs.size()=1 2024-09-12T00:48:10.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.006+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.62__shadow_.kLWm_p9r04j2PRGc5qxQ7p1Rb5xk6NW_0 2024-09-12T00:48:10.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.010+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:10.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.014+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:48:10.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.014+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12542665206902080893', time=2024-09-12T02:48:00.349111+0000, chain.objs.size()=16 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.1 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.1_1 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.1_2 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.2 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.2_1 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.2_2 2024-09-12T00:48:10.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.3 2024-09-12T00:48:10.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.3_1 2024-09-12T00:48:10.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.3_2 2024-09-12T00:48:10.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.4 2024-09-12T00:48:10.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.4_1 2024-09-12T00:48:10.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.4_2 2024-09-12T00:48:10.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.5 2024-09-12T00:48:10.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.018+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.5_1 2024-09-12T00:48:10.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.022+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__shadow_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.5_2 2024-09-12T00:48:10.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.022+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.55__multipart_key1.2~ZjKn7Xny27t5Cidres4wi7DhGtvqGaa.6 2024-09-12T00:48:10.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.026+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:10.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.026+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:48:10.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12076014442924339458', time=2024-09-12T02:47:47.438817+0000, chain.objs.size()=6 2024-09-12T00:48:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.46__shadow_.FbSgav4rq2wJ8S8h5I69_vjapY6Z84K_0 2024-09-12T00:48:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.46__shadow_.FbSgav4rq2wJ8S8h5I69_vjapY6Z84K_1 2024-09-12T00:48:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.46__shadow_.FbSgav4rq2wJ8S8h5I69_vjapY6Z84K_2 2024-09-12T00:48:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.46__shadow_.FbSgav4rq2wJ8S8h5I69_vjapY6Z84K_3 2024-09-12T00:48:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.46__shadow_.FbSgav4rq2wJ8S8h5I69_vjapY6Z84K_4 2024-09-12T00:48:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.030+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.46__shadow_.FbSgav4rq2wJ8S8h5I69_vjapY6Z84K_5 2024-09-12T00:48:10.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.034+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:10.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:48:10.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:10.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 20 garbage collection: RGWGC::process iterating over entry tag='2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG', time=2024-09-12T02:47:37.338259+0000, chain.objs.size()=9 2024-09-12T00:48:10.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__multipart_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.1 2024-09-12T00:48:10.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__shadow_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.1_1 2024-09-12T00:48:10.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__multipart_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.2 2024-09-12T00:48:10.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__shadow_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.2_1 2024-09-12T00:48:10.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__multipart_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.3 2024-09-12T00:48:10.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__shadow_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.3_1 2024-09-12T00:48:10.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__multipart_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.4 2024-09-12T00:48:10.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__shadow_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.4_1 2024-09-12T00:48:10.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.038+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40__multipart_key1.2~GdaHKtmVNk-LIHHffdxEwhhFexSQjhG.5 2024-09-12T00:48:10.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.042+0000 7fcb64d599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:10.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.046+0000 7fcb64d599c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:48:10.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.046+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.050+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.050+0000 7fcb64d599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.050+0000 7fca197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:10.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.054+0000 7fcb64d599c0 20 remove_watcher() i=0 2024-09-12T00:48:10.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.054+0000 7fcb64d599c0 2 removed watcher, disabling cache 2024-09-12T00:48:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.054+0000 7fcb64d599c0 20 remove_watcher() i=1 2024-09-12T00:48:10.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.054+0000 7fcb64d599c0 20 remove_watcher() i=2 2024-09-12T00:48:10.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.054+0000 7fcb64d599c0 20 remove_watcher() i=3 2024-09-12T00:48:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.058+0000 7fcb64d599c0 20 remove_watcher() i=4 2024-09-12T00:48:10.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.058+0000 7fcb64d599c0 20 remove_watcher() i=5 2024-09-12T00:48:10.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.058+0000 7fcb64d599c0 20 remove_watcher() i=6 2024-09-12T00:48:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.058+0000 7fcb64d599c0 20 remove_watcher() i=7 2024-09-12T00:48:10.069 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:48:10.134 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:10.134 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:10.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.174+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.178+0000 7f0563c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.178+0000 7f0563c619c0 20 realm 2024-09-12T00:48:10.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.178+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.178+0000 7f0563c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.178+0000 7f0563c619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:10.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.178+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.178+0000 7f0563c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.178+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.382+0000 7f0563c619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.382+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.382+0000 7f0563c619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.382+0000 7f0563c619c0 20 searching for the correct realm 2024-09-12T00:48:10.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.394+0000 7f0561f68640 0 -- 172.21.15.137:0/3099060652 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55a86fe98be0 msgr2=0x55a86fe9b010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:10.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.402+0000 7f0561767640 0 -- 172.21.15.137:0/3099060652 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55a86fe9ce10 msgr2=0x55a86fe9f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:48:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:48:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.410+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:10.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:10.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 zone default found 2024-09-12T00:48:10.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 4 Realm: () 2024-09-12T00:48:10.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:48:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:48:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 zonegroup default 2024-09-12T00:48:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 started sync module instance, tier type = 2024-09-12T00:48:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.414+0000 7f0563c619c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:48:10.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 20 add_watcher() i=0 2024-09-12T00:48:10.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 20 add_watcher() i=1 2024-09-12T00:48:10.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 20 add_watcher() i=2 2024-09-12T00:48:10.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 20 add_watcher() i=3 2024-09-12T00:48:10.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 20 add_watcher() i=4 2024-09-12T00:48:10.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 20 add_watcher() i=5 2024-09-12T00:48:10.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 20 add_watcher() i=6 2024-09-12T00:48:10.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 20 add_watcher() i=7 2024-09-12T00:48:10.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.438+0000 7f0563c619c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:10.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.442+0000 7f0417fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:10.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.442+0000 7f0563c619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:10.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.442+0000 7f0563c619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:10.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.534+0000 7f0416fe5640 20 reqs_thread_entry: start 2024-09-12T00:48:10.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.534+0000 7f0563c619c0 20 init_complete bucket index max shards: 1 2024-09-12T00:48:10.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.534+0000 7f0563c619c0 20 Filter name: none 2024-09-12T00:48:10.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.534+0000 7f0414fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:10.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.534+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:48:10.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.538+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.538+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.538+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.542+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:48:10.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.546+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.546+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.546+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.550+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:48:10.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.554+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.554+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.554+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.558+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:48:10.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.562+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.562+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.562+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.566+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:48:10.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.570+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.570+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.570+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.570+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:48:10.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.574+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.574+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.574+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.578+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:48:10.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.582+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.582+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.582+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.586+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:48:10.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.590+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.590+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.590+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.594+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:48:10.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.598+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.598+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.598+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.602+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:48:10.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.606+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.606+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.606+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.610+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:48:10.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.614+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.614+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.614+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.618+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:48:10.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.618+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.622+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.622+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.622+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:48:10.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.626+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.630+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.630+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.634+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:48:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.634+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.638+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.638+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.638+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:48:10.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.642+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.646+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.646+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.650+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:48:10.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.654+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.654+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.654+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.658+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:48:10.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.662+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.662+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.662+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.666+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:48:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.670+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.674+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.674+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.678+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:48:10.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.682+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.682+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.682+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.686+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:48:10.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.690+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.690+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.694+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.694+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:48:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.698+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.702+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.702+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.706+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:48:10.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.706+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.710+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.710+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.714+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:48:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.718+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.718+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.718+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.722+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:48:10.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.726+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.726+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.726+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.730+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:48:10.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.734+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.734+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.738+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.738+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:48:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.742+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.746+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.746+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.750+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:48:10.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.754+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.754+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.754+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.758+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:48:10.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.762+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.762+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.762+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.766+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:48:10.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.770+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.770+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.770+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.774+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:48:10.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.778+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.778+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.778+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.782+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:48:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.786+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.786+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.786+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.790+0000 7f0563c619c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:48:10.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.794+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.798+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:10.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.798+0000 7f0563c619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:10.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.802+0000 7f0417fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:10.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.810+0000 7f0563c619c0 20 remove_watcher() i=0 2024-09-12T00:48:10.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.810+0000 7f0563c619c0 2 removed watcher, disabling cache 2024-09-12T00:48:10.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.810+0000 7f0563c619c0 20 remove_watcher() i=1 2024-09-12T00:48:10.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.814+0000 7f0563c619c0 20 remove_watcher() i=2 2024-09-12T00:48:10.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.814+0000 7f0563c619c0 20 remove_watcher() i=3 2024-09-12T00:48:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.818+0000 7f0563c619c0 20 remove_watcher() i=4 2024-09-12T00:48:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.822+0000 7f0563c619c0 20 remove_watcher() i=5 2024-09-12T00:48:10.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.822+0000 7f0563c619c0 20 remove_watcher() i=6 2024-09-12T00:48:10.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.826+0000 7f0563c619c0 20 remove_watcher() i=7 2024-09-12T00:48:10.845 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:48:10.917 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:10.917 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:10.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 20 realm 2024-09-12T00:48:10.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:10.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:10.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.966+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.970+0000 7fb885a169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.970+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.970+0000 7fb885a169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.970+0000 7fb885a169c0 20 searching for the correct realm 2024-09-12T00:48:10.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:10.974+0000 7fb88351c640 0 -- 172.21.15.137:0/1253863783 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fb87c0e2930 msgr2=0x7fb87c0e1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.190+0000 7fb88351c640 0 -- 172.21.15.137:0/1253863783 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fb87408f5f0 msgr2=0x7fb87408e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:48:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:48:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 zone default found 2024-09-12T00:48:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 4 Realm: () 2024-09-12T00:48:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:48:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:48:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 zonegroup default 2024-09-12T00:48:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.410+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.414+0000 7fb885a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.414+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.414+0000 7fb885a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.414+0000 7fb885a169c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.414+0000 7fb885a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.414+0000 7fb885a169c0 20 started sync module instance, tier type = 2024-09-12T00:48:11.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.414+0000 7fb885a169c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:48:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.434+0000 7fb885a169c0 20 add_watcher() i=0 2024-09-12T00:48:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.434+0000 7fb885a169c0 20 add_watcher() i=1 2024-09-12T00:48:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.434+0000 7fb885a169c0 20 add_watcher() i=2 2024-09-12T00:48:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.434+0000 7fb885a169c0 20 add_watcher() i=3 2024-09-12T00:48:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.434+0000 7fb885a169c0 20 add_watcher() i=4 2024-09-12T00:48:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.434+0000 7fb885a169c0 20 add_watcher() i=5 2024-09-12T00:48:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.434+0000 7fb885a169c0 20 add_watcher() i=6 2024-09-12T00:48:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.438+0000 7fb885a169c0 20 add_watcher() i=7 2024-09-12T00:48:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.438+0000 7fb885a169c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.442+0000 7fb739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.442+0000 7fb885a169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.442+0000 7fb885a169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:11.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.526+0000 7fb738fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:11.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.530+0000 7fb885a169c0 20 init_complete bucket index max shards: 1 2024-09-12T00:48:11.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.530+0000 7fb885a169c0 20 Filter name: none 2024-09-12T00:48:11.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.530+0000 7fb6b27fc640 20 reqs_thread_entry: start 2024-09-12T00:48:11.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.530+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:48:11.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.530+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.530+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.534+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.534+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:48:11.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.538+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.538+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.542+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.542+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:48:11.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.546+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.546+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.546+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.550+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:48:11.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.550+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.554+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.554+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.554+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:48:11.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.558+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.558+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.562+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.562+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:48:11.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.566+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.566+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.566+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.570+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:48:11.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.570+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.570+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.570+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.574+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:48:11.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.578+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.578+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.578+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.582+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:48:11.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.586+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.586+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.586+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.586+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:48:11.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.590+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.594+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.594+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.594+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:48:11.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.598+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.602+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.602+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.602+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:48:11.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.606+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.606+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.606+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.610+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:48:11.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.610+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.614+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.614+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.618+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:48:11.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.622+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.622+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.622+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.626+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:48:11.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.630+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.630+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.630+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.634+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:48:11.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.634+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.638+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.638+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.642+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:48:11.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.642+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.646+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.646+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.649+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:48:11.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.649+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.653+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.653+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.653+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:48:11.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.657+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.657+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.657+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.661+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:48:11.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.665+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.665+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.665+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.669+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:48:11.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.673+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.673+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.673+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.677+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:48:11.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.681+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.681+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.681+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.685+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:48:11.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.689+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.689+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.689+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.693+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:48:11.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.697+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.697+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.697+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.701+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:48:11.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.705+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.705+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.705+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.709+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:48:11.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.713+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.713+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.713+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.717+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:48:11.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.717+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.721+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.721+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.721+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:48:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.725+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.729+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.729+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.729+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:48:11.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.733+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.733+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.733+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.737+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:48:11.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.741+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.741+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.745+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.745+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:48:11.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.749+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.749+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.749+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.753+0000 7fb885a169c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:48:11.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.753+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.757+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:11.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.757+0000 7fb885a169c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:11.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.761+0000 7fb739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:11.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.765+0000 7fb885a169c0 20 remove_watcher() i=0 2024-09-12T00:48:11.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.765+0000 7fb885a169c0 2 removed watcher, disabling cache 2024-09-12T00:48:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.765+0000 7fb885a169c0 20 remove_watcher() i=1 2024-09-12T00:48:11.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.769+0000 7fb885a169c0 20 remove_watcher() i=2 2024-09-12T00:48:11.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.769+0000 7fb885a169c0 20 remove_watcher() i=3 2024-09-12T00:48:11.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.773+0000 7fb885a169c0 20 remove_watcher() i=4 2024-09-12T00:48:11.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.777+0000 7fb885a169c0 20 remove_watcher() i=5 2024-09-12T00:48:11.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.777+0000 7fb885a169c0 20 remove_watcher() i=6 2024-09-12T00:48:11.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.781+0000 7fb885a169c0 20 remove_watcher() i=7 2024-09-12T00:48:11.797 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:48:11.873 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:11.873 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:11.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.921+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.921+0000 7f7bd142b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:11.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.921+0000 7f7bd142b9c0 20 realm 2024-09-12T00:48:11.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.921+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.921+0000 7f7bd142b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:11.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.921+0000 7f7bd142b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:11.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.921+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.925+0000 7f7bd142b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:11.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.925+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.925+0000 7f7bd142b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:11.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.925+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:11.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.925+0000 7f7bd142b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:11.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.925+0000 7f7bd142b9c0 20 searching for the correct realm 2024-09-12T00:48:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.929+0000 7f7bcef31640 0 -- 172.21.15.137:0/2034252155 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f7a98080e90 msgr2=0x7f7a980832c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:11.937+0000 7f7bcef31640 0 -- 172.21.15.137:0/2034252155 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f7bc8059120 msgr2=0x7f7bc8086280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:48:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:48:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 zone default found 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 4 Realm: () 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 zonegroup default 2024-09-12T00:48:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.157+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.161+0000 7f7bd142b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.161+0000 7f7bd142b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.161+0000 7f7bd142b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.161+0000 7f7bd142b9c0 20 started sync module instance, tier type = 2024-09-12T00:48:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.161+0000 7f7bd142b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:48:12.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 20 add_watcher() i=0 2024-09-12T00:48:12.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 20 add_watcher() i=1 2024-09-12T00:48:12.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 20 add_watcher() i=2 2024-09-12T00:48:12.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 20 add_watcher() i=3 2024-09-12T00:48:12.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 20 add_watcher() i=4 2024-09-12T00:48:12.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 20 add_watcher() i=5 2024-09-12T00:48:12.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 20 add_watcher() i=6 2024-09-12T00:48:12.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 20 add_watcher() i=7 2024-09-12T00:48:12.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.185+0000 7f7bd142b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:12.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.193+0000 7f7a857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:12.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.193+0000 7f7bd142b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:12.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.193+0000 7f7bd142b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.281+0000 7f79fffff640 20 reqs_thread_entry: start 2024-09-12T00:48:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.281+0000 7f7bd142b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:48:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.281+0000 7f7bd142b9c0 20 Filter name: none 2024-09-12T00:48:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.281+0000 7f79fdffb640 20 reqs_thread_entry: start 2024-09-12T00:48:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.281+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:48:12.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.285+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.285+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.285+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.289+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:48:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.293+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.293+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.297+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.297+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:48:12.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.301+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.301+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.301+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.301+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:48:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.305+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.309+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.309+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.313+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:48:12.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.313+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.317+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.317+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.317+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:48:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.321+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.325+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.325+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.325+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:48:12.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.333+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.337+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.337+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.341+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:48:12.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.341+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.341+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.341+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.345+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:48:12.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.349+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.349+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.349+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.353+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:48:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.357+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.357+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.361+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.361+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:48:12.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.365+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.365+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.365+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.369+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:48:12.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.373+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.373+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.373+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.373+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:48:12.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.377+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.381+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.381+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.381+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:48:12.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.385+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.389+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.389+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.389+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:48:12.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.393+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.397+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.397+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.401+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:48:12.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.401+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.405+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.405+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.405+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:48:12.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.409+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.409+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.409+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.413+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:48:12.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.413+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.417+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.417+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.417+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:48:12.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.421+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.425+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.425+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.429+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:48:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.429+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.429+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.433+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.433+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:48:12.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.437+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.437+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.441+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.441+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:48:12.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.445+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.445+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.449+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.449+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:48:12.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.453+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.453+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.453+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.457+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:48:12.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.457+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.457+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.461+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.461+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:48:12.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.465+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.469+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.469+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.473+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:48:12.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.473+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.477+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.477+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.477+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:48:12.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.481+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.481+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.485+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.485+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:48:12.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.489+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.489+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.489+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.493+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:48:12.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.497+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.497+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.497+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.497+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:48:12.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.501+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.505+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.505+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.509+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:48:12.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.513+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.513+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.513+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.517+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:48:12.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.521+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.521+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:12.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.525+0000 7f7bd142b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:12.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.529+0000 7f7a857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:12.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.533+0000 7f7bd142b9c0 20 remove_watcher() i=0 2024-09-12T00:48:12.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.533+0000 7f7bd142b9c0 2 removed watcher, disabling cache 2024-09-12T00:48:12.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.537+0000 7f7bd142b9c0 20 remove_watcher() i=1 2024-09-12T00:48:12.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.537+0000 7f7bd142b9c0 20 remove_watcher() i=2 2024-09-12T00:48:12.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.541+0000 7f7bd142b9c0 20 remove_watcher() i=3 2024-09-12T00:48:12.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.541+0000 7f7bd142b9c0 20 remove_watcher() i=4 2024-09-12T00:48:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.545+0000 7f7bd142b9c0 20 remove_watcher() i=5 2024-09-12T00:48:12.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.549+0000 7f7bd142b9c0 20 remove_watcher() i=6 2024-09-12T00:48:12.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:12.549+0000 7f7bd142b9c0 20 remove_watcher() i=7 2024-09-12T00:48:12.568 DEBUG:teuthology.orchestra.run.smithi137:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:48:13.262 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :clean 2024-09-12T00:48:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :compileJava 2024-09-12T00:48:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :processResources 2024-09-12T00:48:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :classes 2024-09-12T00:48:14.560 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:14.560 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :compileTestJava 2024-09-12T00:48:14.560 INFO:teuthology.orchestra.run.smithi137.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:48:14.560 INFO:teuthology.orchestra.run.smithi137.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:48:14.561 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:14.561 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:48:14.561 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :testClasses 2024-09-12T00:48:16.561 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.561 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :test 2024-09-12T00:48:16.561 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.561 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:48:16.561 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12 00:48:15,876 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:48:16.562 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.562 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:48:16.562 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.562 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:48:16.562 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.562 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:48:16.562 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.562 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:48:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.760 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:48:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.760 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:48:16.959 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:16.959 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:48:17.059 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:17.059 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:48:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:17.159 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:48:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:17.259 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:48:17.559 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:17.559 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:48:17.659 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:17.659 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:48:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:48:17.859 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:17.859 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:48:18.259 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:18.260 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:48:18.260 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:18.260 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:48:18.560 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:18.560 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:48:18.560 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:18.560 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:48:18.721 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------- 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------- 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T00:48:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:5 actionable tasks: 5 executed 2024-09-12T00:48:18.730 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:48:18.760 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:18.760 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:18.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.805+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 realm 2024-09-12T00:48:18.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:18.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:18.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:18.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.809+0000 7ff7b6d2d9c0 20 searching for the correct realm 2024-09-12T00:48:18.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.817+0000 7ff7b5034640 0 -- 172.21.15.137:0/1279463747 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7ff7a8115000 msgr2=0x7ff7a8100810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:18.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.821+0000 7ff7b4833640 0 -- 172.21.15.137:0/1279463747 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7ff7ac037040 msgr2=0x7ff7ac018930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:18.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:18.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:48:18.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:18.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:48:18.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:18.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:18.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:18.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.829+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:18.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 zone default found 2024-09-12T00:48:18.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 4 Realm: () 2024-09-12T00:48:18.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:48:18.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:48:18.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:18.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 zonegroup default 2024-09-12T00:48:18.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 started sync module instance, tier type = 2024-09-12T00:48:18.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.833+0000 7ff7b6d2d9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:48:18.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 20 add_watcher() i=0 2024-09-12T00:48:18.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 20 add_watcher() i=1 2024-09-12T00:48:18.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 20 add_watcher() i=2 2024-09-12T00:48:18.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 20 add_watcher() i=3 2024-09-12T00:48:18.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 20 add_watcher() i=4 2024-09-12T00:48:18.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 20 add_watcher() i=5 2024-09-12T00:48:18.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 20 add_watcher() i=6 2024-09-12T00:48:18.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 20 add_watcher() i=7 2024-09-12T00:48:18.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.853+0000 7ff7b6d2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:18.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.857+0000 7ff66afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:18.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.857+0000 7ff7b6d2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:18.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.857+0000 7ff7b6d2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:18.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.941+0000 7ff669fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:18.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.941+0000 7ff7b6d2d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:48:18.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.941+0000 7ff7b6d2d9c0 20 Filter name: none 2024-09-12T00:48:18.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.941+0000 7ff5db7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:18.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.941+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:48:18.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.941+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.945+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.945+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.945+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:48:18.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.949+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.949+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.949+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.953+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:48:18.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.957+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.957+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.957+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.957+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:48:18.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.961+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.961+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.961+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.965+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:48:18.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.969+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.969+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.969+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.973+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:48:18.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.977+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.977+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.977+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.981+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:48:18.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.981+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.985+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.985+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.985+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:48:18.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.989+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.989+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.989+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.993+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:48:18.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.997+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.997+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:18.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:18.997+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:18.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.001+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:48:19.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.005+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.005+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.005+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.009+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:48:19.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.013+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.013+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.013+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.017+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:48:19.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.021+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.021+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.021+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.025+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:48:19.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.029+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.029+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.029+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.033+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:48:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.037+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.037+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.041+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.041+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:48:19.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.045+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.049+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.049+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.053+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:48:19.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.057+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.057+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.057+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.061+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:48:19.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.065+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.069+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.069+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.073+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:48:19.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.077+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.077+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.077+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:19.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.077+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13594385660849473895', time=2024-09-12T02:48:17.358604+0000, chain.objs.size()=1 2024-09-12T00:48:19.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.077+0000 7ff7b6d2d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.71__shadow_.Rk4MJh16UMHflizU6Mr-3w2-tQMbP_I_0 2024-09-12T00:48:19.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.081+0000 7ff7b6d2d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:19.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.085+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:48:19.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.093+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.093+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.093+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.097+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:48:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.101+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.101+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.105+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.105+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:48:19.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.109+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.113+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.113+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.113+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:48:19.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.117+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.121+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.121+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.125+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:48:19.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.129+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.129+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.133+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.133+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:48:19.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.137+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.141+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.141+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.141+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:48:19.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.145+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.149+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.149+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:48:19.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.149+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.861689171797511143', time=2024-09-12T02:48:18.033550+0000, chain.objs.size()=1 2024-09-12T00:48:19.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.149+0000 7ff7b6d2d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.72__shadow_.MVScfG_jLF3Re-nqJ4vHPHiZzhsp5dM_0 2024-09-12T00:48:19.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.153+0000 7ff7b6d2d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:48:19.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.161+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:48:19.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.165+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.165+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.169+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.169+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:48:19.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.173+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.173+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.173+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.177+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:48:19.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.181+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.181+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.181+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.185+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:48:19.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.189+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.189+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.189+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.193+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:48:19.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.197+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.197+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.201+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.201+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:48:19.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.205+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.209+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.209+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.209+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:48:19.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.213+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.217+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.217+0000 7ff7b6d2d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.221+0000 7ff66afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:19.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.225+0000 7ff7b6d2d9c0 20 remove_watcher() i=0 2024-09-12T00:48:19.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.225+0000 7ff7b6d2d9c0 2 removed watcher, disabling cache 2024-09-12T00:48:19.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.229+0000 7ff7b6d2d9c0 20 remove_watcher() i=1 2024-09-12T00:48:19.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.229+0000 7ff7b6d2d9c0 20 remove_watcher() i=2 2024-09-12T00:48:19.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.233+0000 7ff7b6d2d9c0 20 remove_watcher() i=3 2024-09-12T00:48:19.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.233+0000 7ff7b6d2d9c0 20 remove_watcher() i=4 2024-09-12T00:48:19.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.237+0000 7ff7b6d2d9c0 20 remove_watcher() i=5 2024-09-12T00:48:19.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.241+0000 7ff7b6d2d9c0 20 remove_watcher() i=6 2024-09-12T00:48:19.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.241+0000 7ff7b6d2d9c0 20 remove_watcher() i=7 2024-09-12T00:48:19.260 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:48:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:19.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.381+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.381+0000 7f2905ab39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.381+0000 7f2905ab39c0 20 realm 2024-09-12T00:48:19.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.381+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.381+0000 7f2905ab39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.381+0000 7f2905ab39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:19.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.381+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.385+0000 7f2905ab39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.385+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.385+0000 7f2905ab39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:19.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.385+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.385+0000 7f2905ab39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:19.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.385+0000 7f2905ab39c0 20 searching for the correct realm 2024-09-12T00:48:19.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.393+0000 7f2903dba640 0 -- 172.21.15.137:0/1112585588 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55b47c98bf40 msgr2=0x55b47c98e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:19.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.397+0000 7f29035b9640 0 -- 172.21.15.137:0/1112585588 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55b47c990080 msgr2=0x55b47c992540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:19.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:19.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:48:19.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:19.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:48:19.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:19.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:19.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:19.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 zone default found 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 4 Realm: () 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 zonegroup default 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.405+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.409+0000 7f2905ab39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.409+0000 7f2905ab39c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.409+0000 7f2905ab39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.409+0000 7f2905ab39c0 20 started sync module instance, tier type = 2024-09-12T00:48:19.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.409+0000 7f2905ab39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:48:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.425+0000 7f2905ab39c0 20 add_watcher() i=0 2024-09-12T00:48:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.425+0000 7f2905ab39c0 20 add_watcher() i=1 2024-09-12T00:48:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.425+0000 7f2905ab39c0 20 add_watcher() i=2 2024-09-12T00:48:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.425+0000 7f2905ab39c0 20 add_watcher() i=3 2024-09-12T00:48:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.425+0000 7f2905ab39c0 20 add_watcher() i=4 2024-09-12T00:48:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.425+0000 7f2905ab39c0 20 add_watcher() i=5 2024-09-12T00:48:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.425+0000 7f2905ab39c0 20 add_watcher() i=6 2024-09-12T00:48:19.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.429+0000 7f2905ab39c0 20 add_watcher() i=7 2024-09-12T00:48:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.429+0000 7f2905ab39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:19.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.433+0000 7f27b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:19.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.433+0000 7f2905ab39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:19.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.433+0000 7f2905ab39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:19.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.505+0000 7f27b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:19.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.505+0000 7f2905ab39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:48:19.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.505+0000 7f2905ab39c0 20 Filter name: none 2024-09-12T00:48:19.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.505+0000 7f27327fc640 20 reqs_thread_entry: start 2024-09-12T00:48:19.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.505+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:48:19.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.509+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.513+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.513+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.513+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:48:19.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.517+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.517+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.517+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.521+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:48:19.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.521+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.525+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.525+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.525+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:48:19.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.529+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.529+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.529+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.533+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:48:19.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.537+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.537+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.541+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.541+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:48:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.545+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.545+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.545+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.545+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:48:19.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.549+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.549+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.553+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.553+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:48:19.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.557+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.561+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.561+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.561+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:48:19.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.565+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.565+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.565+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.569+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:48:19.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.573+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.573+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.573+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.573+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:48:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.577+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.581+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.581+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.581+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:48:19.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.585+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.585+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.589+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.589+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:48:19.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.593+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.593+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.593+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.597+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:48:19.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.601+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.601+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.601+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.601+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:48:19.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.605+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.605+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.605+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.609+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:48:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.609+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.613+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.613+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.617+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:48:19.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.617+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.621+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.621+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.621+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:48:19.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.625+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.629+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.629+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.629+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:48:19.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.633+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.637+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.637+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.637+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:48:19.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.641+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.645+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.645+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.649+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:48:19.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.649+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.649+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.649+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.653+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:48:19.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.657+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.657+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.657+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.661+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:48:19.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.665+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.665+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.665+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.669+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:48:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.673+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.673+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.677+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.677+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:48:19.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.681+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.685+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.685+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.689+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:48:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.689+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.693+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.693+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.693+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:48:19.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.697+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.701+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.701+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.705+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:48:19.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.709+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.709+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.709+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.713+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:48:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.717+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.717+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.721+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.721+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:48:19.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.725+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.725+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.725+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.729+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:48:19.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.733+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.733+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.737+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.737+0000 7f2905ab39c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:48:19.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.741+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.741+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:19.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.741+0000 7f2905ab39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:19.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.745+0000 7f27b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:19.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.753+0000 7f2905ab39c0 20 remove_watcher() i=0 2024-09-12T00:48:19.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.753+0000 7f2905ab39c0 2 removed watcher, disabling cache 2024-09-12T00:48:19.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.753+0000 7f2905ab39c0 20 remove_watcher() i=1 2024-09-12T00:48:19.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.757+0000 7f2905ab39c0 20 remove_watcher() i=2 2024-09-12T00:48:19.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.761+0000 7f2905ab39c0 20 remove_watcher() i=3 2024-09-12T00:48:19.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.761+0000 7f2905ab39c0 20 remove_watcher() i=4 2024-09-12T00:48:19.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.765+0000 7f2905ab39c0 20 remove_watcher() i=5 2024-09-12T00:48:19.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.769+0000 7f2905ab39c0 20 remove_watcher() i=6 2024-09-12T00:48:19.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.769+0000 7f2905ab39c0 20 remove_watcher() i=7 2024-09-12T00:48:19.793 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:48:19.865 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:19.865 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:19.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.913+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.913+0000 7fceacef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.913+0000 7fceacef69c0 20 realm 2024-09-12T00:48:19.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.913+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:19.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:19.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:19.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.917+0000 7fceacef69c0 20 searching for the correct realm 2024-09-12T00:48:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.925+0000 7fceaa1fb640 0 -- 172.21.15.137:0/2898419579 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fce9406d070 msgr2=0x7fce9407d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.929+0000 7fceaa9fc640 0 -- 172.21.15.137:0/2898419579 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fcea40c2bd0 msgr2=0x7fcea40dc910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:19.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.937+0000 7fceacef69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:19.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.937+0000 7fceacef69c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:48:19.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.937+0000 7fceacef69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:19.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.937+0000 7fceacef69c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:48:19.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.937+0000 7fceacef69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:19.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.937+0000 7fceacef69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:19.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.937+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:19.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:19.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 zone default found 2024-09-12T00:48:19.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 4 Realm: () 2024-09-12T00:48:19.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:48:19.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:48:19.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:19.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 zonegroup default 2024-09-12T00:48:19.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:19.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:19.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 started sync module instance, tier type = 2024-09-12T00:48:19.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.941+0000 7fceacef69c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:48:19.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.961+0000 7fceacef69c0 20 add_watcher() i=0 2024-09-12T00:48:19.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.961+0000 7fceacef69c0 20 add_watcher() i=1 2024-09-12T00:48:19.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.961+0000 7fceacef69c0 20 add_watcher() i=2 2024-09-12T00:48:19.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.961+0000 7fceacef69c0 20 add_watcher() i=3 2024-09-12T00:48:19.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.961+0000 7fceacef69c0 20 add_watcher() i=4 2024-09-12T00:48:19.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.961+0000 7fceacef69c0 20 add_watcher() i=5 2024-09-12T00:48:19.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.961+0000 7fceacef69c0 20 add_watcher() i=6 2024-09-12T00:48:19.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.965+0000 7fceacef69c0 20 add_watcher() i=7 2024-09-12T00:48:19.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.965+0000 7fceacef69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:19.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.969+0000 7fcd61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:19.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.969+0000 7fceacef69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:19.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:19.969+0000 7fceacef69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.041+0000 7fcd60fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.041+0000 7fceacef69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:48:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.041+0000 7fceacef69c0 20 Filter name: none 2024-09-12T00:48:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.041+0000 7fcd59ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.041+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:48:20.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.045+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.045+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.045+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.045+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:48:20.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.049+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.053+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.053+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.057+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:48:20.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.061+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.061+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.061+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.061+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:48:20.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.065+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.065+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.069+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.069+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:48:20.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.073+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.073+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.073+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.073+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:48:20.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.077+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.077+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.077+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.081+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:48:20.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.081+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.081+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.085+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.085+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:48:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.089+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.093+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.093+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.093+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:48:20.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.097+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.097+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.097+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.101+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:48:20.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.105+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.105+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.105+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.109+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:48:20.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.113+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.113+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.113+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.117+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:48:20.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.121+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.121+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.121+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.125+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:48:20.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.125+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.125+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.129+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.129+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:48:20.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.133+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.133+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.137+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.137+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:48:20.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.141+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.141+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.141+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.145+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:48:20.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.145+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.149+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.149+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.153+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:48:20.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.153+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.157+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.157+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.157+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:48:20.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.161+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.161+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.161+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.165+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:48:20.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.169+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.173+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.173+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.177+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:48:20.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.181+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.181+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.185+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.185+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:48:20.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.189+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.193+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.193+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.197+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:48:20.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.201+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.201+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.201+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.205+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:48:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.209+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.209+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.213+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.217+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:48:20.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.221+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.225+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.225+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.229+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:48:20.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.233+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.233+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.237+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.237+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:48:20.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.241+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.241+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.245+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.245+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:48:20.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.249+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.253+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.253+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.253+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:48:20.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.257+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.261+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.261+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.265+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:48:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.269+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.269+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.269+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.273+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:48:20.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.277+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.281+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.281+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.285+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:48:20.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.289+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.289+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.289+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.293+0000 7fceacef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:48:20.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.297+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.301+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.301+0000 7fceacef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.305+0000 7fcd61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:20.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.309+0000 7fceacef69c0 20 remove_watcher() i=0 2024-09-12T00:48:20.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.309+0000 7fceacef69c0 2 removed watcher, disabling cache 2024-09-12T00:48:20.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.313+0000 7fceacef69c0 20 remove_watcher() i=1 2024-09-12T00:48:20.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.317+0000 7fceacef69c0 20 remove_watcher() i=2 2024-09-12T00:48:20.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.317+0000 7fceacef69c0 20 remove_watcher() i=3 2024-09-12T00:48:20.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.321+0000 7fceacef69c0 20 remove_watcher() i=4 2024-09-12T00:48:20.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.325+0000 7fceacef69c0 20 remove_watcher() i=5 2024-09-12T00:48:20.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.329+0000 7fceacef69c0 20 remove_watcher() i=6 2024-09-12T00:48:20.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.329+0000 7fceacef69c0 20 remove_watcher() i=7 2024-09-12T00:48:20.350 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:48:20.425 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:20.425 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:20.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:20.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 20 realm 2024-09-12T00:48:20.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:20.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:20.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:20.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.477+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.481+0000 7fa4b4e789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:20.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.481+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.481+0000 7fa4b4e789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:20.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.481+0000 7fa4b4e789c0 20 searching for the correct realm 2024-09-12T00:48:20.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.485+0000 7fa4b217d640 0 -- 172.21.15.137:0/4032445547 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fa4a8008040 msgr2=0x7fa4a808f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:20.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.697+0000 7fa4b317f640 0 -- 172.21.15.137:0/4032445547 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x564dc492c3e0 msgr2=0x564dc492e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:20.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:20.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:48:20.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:20.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:48:20.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.709+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 zone default found 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 4 Realm: () 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 zonegroup default 2024-09-12T00:48:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 rados->read ofs=0 len=0 2024-09-12T00:48:20.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:20.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 started sync module instance, tier type = 2024-09-12T00:48:20.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.713+0000 7fa4b4e789c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:48:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 20 add_watcher() i=0 2024-09-12T00:48:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 20 add_watcher() i=1 2024-09-12T00:48:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 20 add_watcher() i=2 2024-09-12T00:48:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 20 add_watcher() i=3 2024-09-12T00:48:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 20 add_watcher() i=4 2024-09-12T00:48:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 20 add_watcher() i=5 2024-09-12T00:48:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 20 add_watcher() i=6 2024-09-12T00:48:20.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 20 add_watcher() i=7 2024-09-12T00:48:20.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.737+0000 7fa4b4e789c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:20.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.741+0000 7fa3697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:20.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.745+0000 7fa4b4e789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:20.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.745+0000 7fa4b4e789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:20.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.833+0000 7fa2e3fff640 20 reqs_thread_entry: start 2024-09-12T00:48:20.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.833+0000 7fa4b4e789c0 20 init_complete bucket index max shards: 1 2024-09-12T00:48:20.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.833+0000 7fa4b4e789c0 20 Filter name: none 2024-09-12T00:48:20.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.837+0000 7fa2e1ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:20.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.837+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:48:20.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.841+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.841+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.841+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.841+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:48:20.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.845+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.845+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.845+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.849+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:48:20.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.853+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.853+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.853+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.857+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:48:20.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.861+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.861+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.861+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.861+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:48:20.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.865+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.865+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.869+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.869+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:48:20.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.873+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.873+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.877+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.877+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:48:20.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.881+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.881+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.881+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.885+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:48:20.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.889+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.889+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.889+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.893+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:48:20.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.893+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.897+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.897+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.901+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:48:20.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.905+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.905+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.905+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.909+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:48:20.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.913+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.913+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.913+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.917+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:48:20.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.921+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.921+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.921+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.925+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:48:20.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.929+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.929+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.929+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.933+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:48:20.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.937+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.937+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.937+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.941+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:48:20.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.945+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.945+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.945+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.949+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:48:20.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.953+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.953+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.957+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.957+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:48:20.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.961+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.965+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.965+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.969+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:48:20.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.973+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.973+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.973+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.977+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:48:20.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.981+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.981+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.985+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.985+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:48:20.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.989+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.989+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.993+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.993+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:48:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:20.997+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.001+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:20.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.001+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.001+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:48:21.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.005+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.009+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.009+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.009+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:48:21.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.013+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.017+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.017+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.021+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:48:21.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.025+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.025+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.025+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.029+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:48:21.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.033+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.033+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.037+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.037+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:48:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.041+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.045+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.045+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.049+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:48:21.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.049+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.053+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.053+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.057+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:48:21.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.061+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.061+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.061+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.065+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:48:21.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.069+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.069+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.069+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.073+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:48:21.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.077+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.077+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.077+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.081+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:48:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.085+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.085+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.085+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.089+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:48:21.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.093+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.093+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:48:21.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.093+0000 7fa4b4e789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:48:21.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.097+0000 7fa3697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.101+0000 7fa4b4e789c0 20 remove_watcher() i=0 2024-09-12T00:48:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.101+0000 7fa4b4e789c0 2 removed watcher, disabling cache 2024-09-12T00:48:21.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.105+0000 7fa4b4e789c0 20 remove_watcher() i=1 2024-09-12T00:48:21.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.109+0000 7fa4b4e789c0 20 remove_watcher() i=2 2024-09-12T00:48:21.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.109+0000 7fa4b4e789c0 20 remove_watcher() i=3 2024-09-12T00:48:21.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.113+0000 7fa4b4e789c0 20 remove_watcher() i=4 2024-09-12T00:48:21.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.113+0000 7fa4b4e789c0 20 remove_watcher() i=5 2024-09-12T00:48:21.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.117+0000 7fa4b4e789c0 20 remove_watcher() i=6 2024-09-12T00:48:21.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:48:21.121+0000 7fa4b4e789c0 20 remove_watcher() i=7 2024-09-12T00:48:21.137 DEBUG:teuthology.orchestra.run.smithi137:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:48:21.869 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :clean 2024-09-12T00:48:22.567 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :compileJava 2024-09-12T00:48:22.567 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :processResources 2024-09-12T00:48:22.567 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :classes 2024-09-12T00:48:23.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:23.167 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :compileTestJava 2024-09-12T00:48:23.168 INFO:teuthology.orchestra.run.smithi137.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:48:23.168 INFO:teuthology.orchestra.run.smithi137.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:48:23.168 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:23.169 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:48:23.169 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :testClasses 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout:> Task :test 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12 00:48:24,539 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.169 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:48:25.267 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.267 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:48:25.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:48:25.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:48:25.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:48:25.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:25.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:48:26.767 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:26.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:48:27.067 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:27.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:48:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:27.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:48:27.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:27.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:48:27.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:27.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:48:27.767 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:27.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:48:27.767 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:27.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:48:27.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:27.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:48:27.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:27.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:48:28.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:28.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:48:28.566 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:28.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:48:28.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:28.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:48:28.967 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:28.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:48:29.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:29.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:48:29.267 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:29.267 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:48:29.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:29.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:48:29.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:29.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:48:29.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:29.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:48:29.967 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:29.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:48:30.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:30.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:48:30.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:30.168 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:48:30.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:30.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:48:30.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:30.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:48:30.767 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:30.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:48:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:30.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:48:31.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:31.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:48:31.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:31.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:48:32.067 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:32.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:48:38.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:38.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:48:38.967 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:38.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:48:38.967 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:38.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:48:39.267 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:39.267 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:48:39.267 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:39.267 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:48:39.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:39.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:48:40.067 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:40.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:48:40.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:40.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:48:40.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:40.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:48:40.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:40.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:48:41.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:41.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:48:41.767 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:41.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:48:42.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:42.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:48:42.566 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:42.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:48:43.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:43.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:48:43.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:43.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:48:47.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:47.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:48:47.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:47.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:48:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:48.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:48:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:49.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:48:49.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:49.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:48:50.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:50.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:48:50.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:50.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:48:51.066 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:51.066 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:48:51.067 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:51.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:48:51.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:51.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:48:51.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:51.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:48:51.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:51.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:48:51.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:51.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:48:51.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:51.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:48:51.866 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:51.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:48:52.066 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:52.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:48:52.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:52.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:48:52.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:52.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:48:52.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:52.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:48:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:52.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:48:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:52.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:48:52.967 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:52.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:48:53.066 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:53.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:48:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:53.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:48:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:53.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:48:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:53.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:48:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:53.866 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:48:54.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:54.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:48:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:54.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:48:54.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:54.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:48:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:54.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:48:54.966 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:54.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:48:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:55.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:48:55.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:55.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:48:55.566 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:55.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:48:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:55.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:48:55.966 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:55.966 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:48:56.266 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:56.267 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:48:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:56.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:48:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:56.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:48:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:56.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:48:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:57.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:48:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:57.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:48:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:57.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:48:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:57.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:48:57.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:57.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:48:57.966 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:57.966 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:48:58.266 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:58.267 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:48:58.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:58.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:48:58.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:58.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:48:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:58.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:48:59.070 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:59.070 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:48:59.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:59.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:48:59.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:59.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:48:59.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:59.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:48:59.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:59.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:48:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:48:59.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:49:00.266 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:49:00.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:00.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:49:00.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:00.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:49:00.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:00.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:49:01.066 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:01.066 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:49:01.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:01.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:49:01.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:01.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:49:01.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:01.466 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:49:01.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:01.766 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:49:01.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:01.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:49:02.066 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:02.067 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:49:02.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:02.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:49:02.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:02.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:49:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:49:02.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:02.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:49:02.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:02.767 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:49:02.969 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:02.969 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:49:03.166 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:03.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:49:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:03.367 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:49:03.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:03.466 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:49:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:03.566 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:49:03.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:03.667 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:49:03.866 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:03.867 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:49:03.966 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:03.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:49:04.167 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:04.167 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:49:04.266 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:04.266 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:49:04.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:04.466 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:49:04.566 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:04.567 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:49:04.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:04.766 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T00:49:05.267 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:05.267 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T00:49:05.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:05.467 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T00:49:05.966 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:05.967 INFO:teuthology.orchestra.run.smithi137.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T00:49:06.215 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:06.215 INFO:teuthology.orchestra.run.smithi137.stdout:---------------------------------------------------------------------- 2024-09-12T00:49:06.215 INFO:teuthology.orchestra.run.smithi137.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T00:49:06.215 INFO:teuthology.orchestra.run.smithi137.stdout:---------------------------------------------------------------------- 2024-09-12T00:49:06.216 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:06.216 INFO:teuthology.orchestra.run.smithi137.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:49:06.216 INFO:teuthology.orchestra.run.smithi137.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:49:06.216 INFO:teuthology.orchestra.run.smithi137.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:49:06.216 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:06.216 INFO:teuthology.orchestra.run.smithi137.stdout:BUILD SUCCESSFUL in 44s 2024-09-12T00:49:06.216 INFO:teuthology.orchestra.run.smithi137.stdout:5 actionable tasks: 5 executed 2024-09-12T00:49:06.234 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:49:06.262 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:06.262 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:06.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.305+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:06.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 realm 2024-09-12T00:49:06.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:06.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:06.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.309+0000 7f3e3f2d79c0 20 searching for the correct realm 2024-09-12T00:49:06.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.317+0000 7f3e3d5de640 0 -- 172.21.15.137:0/311361097 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f3e300e9040 msgr2=0x7f3e300e9930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:06.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.321+0000 7f3e3cddd640 0 -- 172.21.15.137:0/311361097 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f3e34018040 msgr2=0x7f3e34031920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:06.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:06.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:06.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 zone default found 2024-09-12T00:49:06.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 4 Realm: () 2024-09-12T00:49:06.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:06.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:06.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:06.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 zonegroup default 2024-09-12T00:49:06.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.329+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.333+0000 7f3e3f2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:06.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.333+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.333+0000 7f3e3f2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:06.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.333+0000 7f3e3f2d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:06.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.333+0000 7f3e3f2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:06.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.333+0000 7f3e3f2d79c0 20 started sync module instance, tier type = 2024-09-12T00:49:06.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.333+0000 7f3e3f2d79c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:06.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.349+0000 7f3e3f2d79c0 20 add_watcher() i=0 2024-09-12T00:49:06.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.349+0000 7f3e3f2d79c0 20 add_watcher() i=1 2024-09-12T00:49:06.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.349+0000 7f3e3f2d79c0 20 add_watcher() i=2 2024-09-12T00:49:06.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.349+0000 7f3e3f2d79c0 20 add_watcher() i=3 2024-09-12T00:49:06.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.349+0000 7f3e3f2d79c0 20 add_watcher() i=4 2024-09-12T00:49:06.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.349+0000 7f3e3f2d79c0 20 add_watcher() i=5 2024-09-12T00:49:06.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.349+0000 7f3e3f2d79c0 20 add_watcher() i=6 2024-09-12T00:49:06.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.353+0000 7f3e3f2d79c0 20 add_watcher() i=7 2024-09-12T00:49:06.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.353+0000 7f3e3f2d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:06.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.357+0000 7f3cf2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:06.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.357+0000 7f3e3f2d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:06.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.357+0000 7f3e3f2d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.429+0000 7f3cf1fe3640 20 reqs_thread_entry: start 2024-09-12T00:49:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.429+0000 7f3e3f2d79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.429+0000 7f3e3f2d79c0 20 Filter name: none 2024-09-12T00:49:06.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.429+0000 7f3c637fe640 20 reqs_thread_entry: start 2024-09-12T00:49:06.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.429+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:49:06.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.40800367551552453', time=2024-09-12T02:49:05.282337+0000, chain.objs.size()=9 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__multipart_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.1 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__shadow_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.1_1 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__multipart_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.2 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__shadow_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.2_1 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__multipart_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.3 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.433+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__shadow_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.3_1 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.437+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__multipart_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.4 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.437+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__shadow_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.4_1 2024-09-12T00:49:06.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.437+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.143__multipart_key1.2~QhCGdEAU-op9Z3zC1-nUQSeUrEl33ku.5 2024-09-12T00:49:06.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.441+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.449+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:49:06.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.449+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.449+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:49:06.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4296361770857713089', time=2024-09-12T02:48:40.170282+0000, chain.objs.size()=9 2024-09-12T00:49:06.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__multipart_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.1 2024-09-12T00:49:06.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__shadow_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.1_1 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__multipart_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.2 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__shadow_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.2_1 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__multipart_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.3 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__shadow_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.3_1 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__multipart_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.4 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__shadow_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.4_1 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.98__multipart_key1.2~VOWPS7nGK_FtiEXkx1qfj68fRz-veXJ.5 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16049885216030115204', time=2024-09-12T02:48:54.828214+0000, chain.objs.size()=1 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.116__shadow_.wi6-n7MGQrvV0AVD8LuiYv0yY4sWRVJ_0 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16527731864097754888', time=2024-09-12T02:48:55.635320+0000, chain.objs.size()=1 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.118__shadow_.uxD8yGzafKAz9MCqG_YPQOabIwVuxDB_0 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3651154350083769732', time=2024-09-12T02:48:58.841628+0000, chain.objs.size()=1 2024-09-12T00:49:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.453+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.126__shadow_.EUhTC5m58CKaa6fuYq6SxCHkTVHp9Ya_0 2024-09-12T00:49:06.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.457+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13881028603189850053', time=2024-09-12T02:48:58.868611+0000, chain.objs.size()=1 2024-09-12T00:49:06.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.457+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.126__shadow_.VIMiU3pVi_zrjQa5AyAp_D_vFHT8-vA_0 2024-09-12T00:49:06.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.457+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4850498275885346263', time=2024-09-12T02:49:03.018041+0000, chain.objs.size()=1 2024-09-12T00:49:06.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.457+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.138__shadow_.81v1xud54_FqDEATz5jL4pIgA1eixVW_0 2024-09-12T00:49:06.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.465+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.469+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:49:06.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.469+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10310279597114441917', time=2024-09-12T02:48:45.888907+0000, chain.objs.size()=9 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.1 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.1_1 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.2 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.2_1 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.3 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.3_1 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.4 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.4_1 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~RckUzdsG6oNL0flASERzV3dqFEtBFOR.5 2024-09-12T00:49:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4411426116456779785', time=2024-09-12T02:48:47.202118+0000, chain.objs.size()=7 2024-09-12T00:49:06.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~jTSA-rh5qnmGtp3yZvhvTh3Vjca3Ke_.1 2024-09-12T00:49:06.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~jTSA-rh5qnmGtp3yZvhvTh3Vjca3Ke_.1_1 2024-09-12T00:49:06.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.473+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~jTSA-rh5qnmGtp3yZvhvTh3Vjca3Ke_.1_2 2024-09-12T00:49:06.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~jTSA-rh5qnmGtp3yZvhvTh3Vjca3Ke_.2 2024-09-12T00:49:06.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~jTSA-rh5qnmGtp3yZvhvTh3Vjca3Ke_.2_1 2024-09-12T00:49:06.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~jTSA-rh5qnmGtp3yZvhvTh3Vjca3Ke_.2_2 2024-09-12T00:49:06.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~jTSA-rh5qnmGtp3yZvhvTh3Vjca3Ke_.3 2024-09-12T00:49:06.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10850881471946183672', time=2024-09-12T02:48:53.976399+0000, chain.objs.size()=1 2024-09-12T00:49:06.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.114__shadow_.SGQl4-pnhNGNjRWS9ECqpuTYLwCR2_k_0 2024-09-12T00:49:06.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17985796826120531554', time=2024-09-12T02:48:54.415611+0000, chain.objs.size()=1 2024-09-12T00:49:06.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.115__shadow_.2rbof-41U4I-H4-5woW3uiOu_JBBdGT_0 2024-09-12T00:49:06.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7596037277303000212', time=2024-09-12T02:48:54.790013+0000, chain.objs.size()=1 2024-09-12T00:49:06.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.116__shadow_.QJAv1lh7j9R7GGIbcapfV3OE2qRkl9Z_0 2024-09-12T00:49:06.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9149714929550444706', time=2024-09-12T02:48:58.829390+0000, chain.objs.size()=1 2024-09-12T00:49:06.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.126__shadow_.JvUkC8HoEWSoisJFEtBhR49SY-W5jCM_0 2024-09-12T00:49:06.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8154963071268668838', time=2024-09-12T02:49:00.457241+0000, chain.objs.size()=1 2024-09-12T00:49:06.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.481+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.130__shadow_.6WGpytK2JrTnO6k4MuR2xSV2rIjzVwJ_0 2024-09-12T00:49:06.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.489+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:49:06.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12767623984034321435', time=2024-09-12T02:48:56.018085+0000, chain.objs.size()=1 2024-09-12T00:49:06.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.119__shadow_.gzIfSwqrBJtRs7_MtSaefqDZE3FRm1S_0 2024-09-12T00:49:06.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7433734761523985689', time=2024-09-12T02:48:58.855471+0000, chain.objs.size()=1 2024-09-12T00:49:06.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.126__shadow_.-l6QEp93FNOwELNujn_PYcAehI6UNUZ_0 2024-09-12T00:49:06.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14853165368277254206', time=2024-09-12T02:48:59.286805+0000, chain.objs.size()=1 2024-09-12T00:49:06.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.127__shadow_.Ze4ixqOpmrtZhq_FoEqUmQ6otR2Gq2u_0 2024-09-12T00:49:06.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13603370768385373245', time=2024-09-12T02:48:59.688471+0000, chain.objs.size()=1 2024-09-12T00:49:06.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.497+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.128__shadow_.GSx3mHqJCNfxbBktIf_RbmqKfL6Emi9_0 2024-09-12T00:49:06.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.501+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.505+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:49:06.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:49:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6182133044295822105', time=2024-09-12T02:48:56.861478+0000, chain.objs.size()=1 2024-09-12T00:49:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.121__shadow_.tnZujYFhpWcX8bHXP0lsp8WnVWdD2PK_0 2024-09-12T00:49:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16188082457985314134', time=2024-09-12T02:48:59.273905+0000, chain.objs.size()=1 2024-09-12T00:49:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.127__shadow_.zIEh5riyqqjt4z7mY0XsD4ab_QG7bG4_0 2024-09-12T00:49:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11124670372081784042', time=2024-09-12T02:49:02.785703+0000, chain.objs.size()=1 2024-09-12T00:49:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.509+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.137__shadow_.ElSgyZNyYZbT6UA_dfkqicfFABcDxRO_0 2024-09-12T00:49:06.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.513+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.521+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:49:06.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.521+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.521+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:49:06.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11142576245892493603', time=2024-09-12T02:48:34.243216+0000, chain.objs.size()=9 2024-09-12T00:49:06.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.1 2024-09-12T00:49:06.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.1_1 2024-09-12T00:49:06.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.2 2024-09-12T00:49:06.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.2_1 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.3 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.3_1 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.4 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.4_1 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~OchTByPaeJyi2QR3ljS4cV505IJKesB.5 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16349415993642361944', time=2024-09-12T02:48:47.035064+0000, chain.objs.size()=7 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~cMkXgLYJGJ0vpMClaxQeFGAiJVTXTdK.1 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~cMkXgLYJGJ0vpMClaxQeFGAiJVTXTdK.1_1 2024-09-12T00:49:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.525+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~cMkXgLYJGJ0vpMClaxQeFGAiJVTXTdK.1_2 2024-09-12T00:49:06.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.533+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~cMkXgLYJGJ0vpMClaxQeFGAiJVTXTdK.2 2024-09-12T00:49:06.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.533+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~cMkXgLYJGJ0vpMClaxQeFGAiJVTXTdK.2_1 2024-09-12T00:49:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.533+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~cMkXgLYJGJ0vpMClaxQeFGAiJVTXTdK.2_2 2024-09-12T00:49:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.533+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~cMkXgLYJGJ0vpMClaxQeFGAiJVTXTdK.3 2024-09-12T00:49:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.533+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13198719809232332559', time=2024-09-12T02:48:55.623105+0000, chain.objs.size()=1 2024-09-12T00:49:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.533+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.118__shadow_.J9k_75PDC1fTXAv5jizhYLPiv_AImXM_0 2024-09-12T00:49:06.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.541+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.545+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:49:06.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:49:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17984221256578075490', time=2024-09-12T02:48:31.926680+0000, chain.objs.size()=9 2024-09-12T00:49:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.1 2024-09-12T00:49:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__shadow_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.1_1 2024-09-12T00:49:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.2 2024-09-12T00:49:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__shadow_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.2_1 2024-09-12T00:49:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.3 2024-09-12T00:49:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__shadow_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.3_1 2024-09-12T00:49:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.4 2024-09-12T00:49:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__shadow_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.4_1 2024-09-12T00:49:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.5 2024-09-12T00:49:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13256283878856094316', time=2024-09-12T02:48:42.278466+0000, chain.objs.size()=9 2024-09-12T00:49:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.1 2024-09-12T00:49:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.1_1 2024-09-12T00:49:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.549+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.2 2024-09-12T00:49:06.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.2_1 2024-09-12T00:49:06.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.3 2024-09-12T00:49:06.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.3_1 2024-09-12T00:49:06.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.4 2024-09-12T00:49:06.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.4_1 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file.mpg.2~zuv-kdul7IExt4Tzu_iCfC5TcPlI0CB.5 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5979019560903035927', time=2024-09-12T02:48:51.266085+0000, chain.objs.size()=1 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.106__shadow_.G00dN1tyQUMxAQVpSyEpa33uKY2F8-v_0 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16405949265196116930', time=2024-09-12T02:48:58.416825+0000, chain.objs.size()=1 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.125__shadow_.E8lv1U2BnzTh2syW4SO0KdiuyBe9e9v_0 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4494218628411331989', time=2024-09-12T02:49:00.443291+0000, chain.objs.size()=1 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.130__shadow_.hp8C6FQ7wYB6qHQY8udrs9DAkwf8WPL_0 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.764931028453634068', time=2024-09-12T02:49:01.184036+0000, chain.objs.size()=1 2024-09-12T00:49:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.557+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.132__shadow_.ws5AM1dzSS0O6FmirpwSvZH4-bGN0Qz_0 2024-09-12T00:49:06.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.569+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.573+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:49:06.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6696144244244319275', time=2024-09-12T02:48:42.325417+0000, chain.objs.size()=1 2024-09-12T00:49:06.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_.ATB4HYhedvs3BHle4ZqagQBwrqeaQPb_0 2024-09-12T00:49:06.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15721884163763034793', time=2024-09-12T02:48:53.961470+0000, chain.objs.size()=1 2024-09-12T00:49:06.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.114__shadow_.Wl9DRbkix73nigWql6q6PTXyKfOPgkF_0 2024-09-12T00:49:06.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14269925348693676281', time=2024-09-12T02:48:59.701551+0000, chain.objs.size()=1 2024-09-12T00:49:06.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.128__shadow_.o2-M0KRKrVtCPLB6enyEOusvZx_QMZD_0 2024-09-12T00:49:06.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4470831549606564963', time=2024-09-12T02:49:00.822428+0000, chain.objs.size()=1 2024-09-12T00:49:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.577+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.131__shadow_.fIN6Bj2h6l5uaYJ6KOwqoVKz2xGjxH5_0 2024-09-12T00:49:06.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.581+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.589+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:49:06.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.589+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.589+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13221973143856387198', time=2024-09-12T02:48:41.555515+0000, chain.objs.size()=9 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__multipart_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.1 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__shadow_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.1_1 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__multipart_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.2 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__shadow_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.2_1 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__multipart_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.3 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__shadow_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.3_1 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__multipart_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.4 2024-09-12T00:49:06.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__shadow_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.4_1 2024-09-12T00:49:06.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99__multipart_key1.2~SmC02nldqDcxLKsvV-brjytNy4YOF7q.5 2024-09-12T00:49:06.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103673515713046013', time=2024-09-12T02:48:46.474139+0000, chain.objs.size()=7 2024-09-12T00:49:06.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~AzxRRtszY-mn0AMUaBzxoxHfwZ1R4AC.1 2024-09-12T00:49:06.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~AzxRRtszY-mn0AMUaBzxoxHfwZ1R4AC.1_1 2024-09-12T00:49:06.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.593+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~AzxRRtszY-mn0AMUaBzxoxHfwZ1R4AC.1_2 2024-09-12T00:49:06.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.597+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~AzxRRtszY-mn0AMUaBzxoxHfwZ1R4AC.2 2024-09-12T00:49:06.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.597+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~AzxRRtszY-mn0AMUaBzxoxHfwZ1R4AC.2_1 2024-09-12T00:49:06.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.597+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~AzxRRtszY-mn0AMUaBzxoxHfwZ1R4AC.2_2 2024-09-12T00:49:06.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.597+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~AzxRRtszY-mn0AMUaBzxoxHfwZ1R4AC.3 2024-09-12T00:49:06.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.597+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11330359664155570059', time=2024-09-12T02:49:01.584913+0000, chain.objs.size()=1 2024-09-12T00:49:06.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.597+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.133__shadow_.mgujmby0RpCx2At9d1NomDdvHtvSuYs_0 2024-09-12T00:49:06.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.597+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18319364603292209249', time=2024-09-12T02:49:03.694237+0000, chain.objs.size()=1 2024-09-12T00:49:06.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.597+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.139__shadow_.o2M_Q33QRO9s0ht09xbwGvmTO-KTIRQ_0 2024-09-12T00:49:06.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.605+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.605+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:49:06.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.609+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.609+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:49:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13633664715457532135', time=2024-09-12T02:48:30.758815+0000, chain.objs.size()=1 2024-09-12T00:49:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.90__shadow_.PHSawtviNqSnq9Jg5sLyVBRHi8erKIl_0 2024-09-12T00:49:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7716764366846918728', time=2024-09-12T02:48:53.546815+0000, chain.objs.size()=1 2024-09-12T00:49:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.113__shadow_.mKOUnQbNJ7GdBGuJdjPAY5ELGdBDOIB_0 2024-09-12T00:49:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8979934336153528949', time=2024-09-12T02:48:55.210353+0000, chain.objs.size()=1 2024-09-12T00:49:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.117__shadow_.85dA65yvabHOC4gwhY5mG4RBEVOyasS_0 2024-09-12T00:49:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9145674005865288405', time=2024-09-12T02:48:58.039484+0000, chain.objs.size()=1 2024-09-12T00:49:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.124__shadow_.vaFiQ6sJW268FSFI4jBmmX-4F2sdQtR_0 2024-09-12T00:49:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9557811198842967626', time=2024-09-12T02:49:05.991412+0000, chain.objs.size()=1 2024-09-12T00:49:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__shadow_.JXrk2AAYiYxvnLqoM0A1ljOEAJbEvVQ_0 2024-09-12T00:49:06.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.613+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.617+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:49:06.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:49:06.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8764353483045083223', time=2024-09-12T02:48:38.254801+0000, chain.objs.size()=7 2024-09-12T00:49:06.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~tNjO8p2me0TEN9chtKTuSrSWCFGYmnO.1 2024-09-12T00:49:06.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~tNjO8p2me0TEN9chtKTuSrSWCFGYmnO.1_1 2024-09-12T00:49:06.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~tNjO8p2me0TEN9chtKTuSrSWCFGYmnO.1_2 2024-09-12T00:49:06.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~tNjO8p2me0TEN9chtKTuSrSWCFGYmnO.2 2024-09-12T00:49:06.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~tNjO8p2me0TEN9chtKTuSrSWCFGYmnO.2_1 2024-09-12T00:49:06.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~tNjO8p2me0TEN9chtKTuSrSWCFGYmnO.2_2 2024-09-12T00:49:06.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~tNjO8p2me0TEN9chtKTuSrSWCFGYmnO.3 2024-09-12T00:49:06.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1177775275217994885', time=2024-09-12T02:48:59.660483+0000, chain.objs.size()=1 2024-09-12T00:49:06.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.128__shadow_.nVBxirztBujfkn-YUk7v3d0evl86msu_0 2024-09-12T00:49:06.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.732196691931557872', time=2024-09-12T02:49:00.808621+0000, chain.objs.size()=1 2024-09-12T00:49:06.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.621+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.131__shadow_.3BqyJnz-cmBBdgcQM_SvZRoMnGSBvYi_0 2024-09-12T00:49:06.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.625+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.629+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:49:06.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.633+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.633+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.633+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:49:06.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.633+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18298402789091685856', time=2024-09-12T02:48:56.847923+0000, chain.objs.size()=1 2024-09-12T00:49:06.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.633+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.121__shadow_.ik4_IVp3M7GTIp-ZIxvXvtBNT8S4e3h_0 2024-09-12T00:49:06.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.633+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14218843481270192479', time=2024-09-12T02:48:57.286597+0000, chain.objs.size()=1 2024-09-12T00:49:06.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.633+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.122__shadow_.ATe2dXxhcNNL84kPAd7rhEr0rohLWvP_0 2024-09-12T00:49:06.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.637+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.637+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:49:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6057751598328324524', time=2024-09-12T02:48:35.902655+0000, chain.objs.size()=9 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.1 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.1_1 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.2 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.2_1 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.3 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.3_1 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.4 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.4_1 2024-09-12T00:49:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~SK4ePVx1RkiESnSbYpgKg5tNSNfXZBl.5 2024-09-12T00:49:06.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11202456942367565823', time=2024-09-12T02:48:45.324433+0000, chain.objs.size()=9 2024-09-12T00:49:06.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.1 2024-09-12T00:49:06.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.1_1 2024-09-12T00:49:06.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.641+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.2 2024-09-12T00:49:06.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.645+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.2_1 2024-09-12T00:49:06.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.645+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.3 2024-09-12T00:49:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.645+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.3_1 2024-09-12T00:49:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.645+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.4 2024-09-12T00:49:06.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.645+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.4_1 2024-09-12T00:49:06.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.645+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~B4j3m_S2bea0LmPckG_YhkO5NGb4ziC.5 2024-09-12T00:49:06.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.649+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4198559366763506192', time=2024-09-12T02:48:53.573929+0000, chain.objs.size()=1 2024-09-12T00:49:06.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.649+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.113__shadow_.Szybnms5yyC-J8L2vz1ynm74VA6YFvp_0 2024-09-12T00:49:06.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.649+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14023351365315550313', time=2024-09-12T02:48:54.401397+0000, chain.objs.size()=1 2024-09-12T00:49:06.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.649+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.115__shadow_.xmDN_5ZyWRwniohimaxUVvSDOiRiozY_0 2024-09-12T00:49:06.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.653+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.657+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:49:06.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.657+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.657+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:49:06.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16372575121716527573', time=2024-09-12T02:48:35.155601+0000, chain.objs.size()=9 2024-09-12T00:49:06.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.1 2024-09-12T00:49:06.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.1_1 2024-09-12T00:49:06.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.2 2024-09-12T00:49:06.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.2_1 2024-09-12T00:49:06.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.3 2024-09-12T00:49:06.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.3_1 2024-09-12T00:49:06.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.4 2024-09-12T00:49:06.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.4_1 2024-09-12T00:49:06.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~XARN-6M8XBIEUJA0TBN28wZaBMMq1gw.5 2024-09-12T00:49:06.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6516429902166344624', time=2024-09-12T02:48:48.923160+0000, chain.objs.size()=9 2024-09-12T00:49:06.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__multipart_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.1 2024-09-12T00:49:06.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__shadow_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.1_1 2024-09-12T00:49:06.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__multipart_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.2 2024-09-12T00:49:06.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.661+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__shadow_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.2_1 2024-09-12T00:49:06.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__multipart_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.3 2024-09-12T00:49:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__shadow_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.3_1 2024-09-12T00:49:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__multipart_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.4 2024-09-12T00:49:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__shadow_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.4_1 2024-09-12T00:49:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__multipart_key1.2~yXWHDpPPwbDIZqEk-2VsFPdDhCDDP06.5 2024-09-12T00:49:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12628453857801349044', time=2024-09-12T02:48:53.140127+0000, chain.objs.size()=1 2024-09-12T00:49:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.112__shadow_.VSDaPkHKIKJ53xboz9lWZqFPNwd54km_0 2024-09-12T00:49:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.253727060424970635', time=2024-09-12T02:48:53.560603+0000, chain.objs.size()=1 2024-09-12T00:49:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.113__shadow_.6aud-AcygHhAYm6OAPKL0IWlILJ2TLY_0 2024-09-12T00:49:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4640637416936328884', time=2024-09-12T02:48:56.005454+0000, chain.objs.size()=1 2024-09-12T00:49:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.665+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.119__shadow_.p_g3TRPuS3qQ0d7faNXe8usYEciMAaU_0 2024-09-12T00:49:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.673+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.677+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:49:06.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.677+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.677+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.677+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:49:06.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.677+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1986035194091689832', time=2024-09-12T02:48:53.587145+0000, chain.objs.size()=1 2024-09-12T00:49:06.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.677+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.113__shadow_.tyxHnjiDfxvjbMC6e2dRF31wlgTmbue_0 2024-09-12T00:49:06.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.677+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15143993209175640337', time=2024-09-12T02:48:53.989272+0000, chain.objs.size()=1 2024-09-12T00:49:06.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.677+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.114__shadow_.yokG1cqM_qt0p99LORBkcc5KuFDBSJW_0 2024-09-12T00:49:06.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.681+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.681+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:49:06.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:49:06.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16215523270315439606', time=2024-09-12T02:48:42.294150+0000, chain.objs.size()=1 2024-09-12T00:49:06.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_.o_qR7gEe4qmmPrxP4jw9cAb3eD7yB4l_0 2024-09-12T00:49:06.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg', time=2024-09-12T02:48:50.866109+0000, chain.objs.size()=46 2024-09-12T00:49:06.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.1 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.2 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.3 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.4 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.5 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.6 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.7 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.8 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.9 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.10 2024-09-12T00:49:06.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.685+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.11 2024-09-12T00:49:06.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.12 2024-09-12T00:49:06.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.13 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.14 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.15 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.16 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.17 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.18 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.19 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.20 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.21 2024-09-12T00:49:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.689+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.22 2024-09-12T00:49:06.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.23 2024-09-12T00:49:06.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.24 2024-09-12T00:49:06.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.25 2024-09-12T00:49:06.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.26 2024-09-12T00:49:06.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.27 2024-09-12T00:49:06.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.28 2024-09-12T00:49:06.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.29 2024-09-12T00:49:06.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.30 2024-09-12T00:49:06.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.693+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.31 2024-09-12T00:49:06.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.697+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.32 2024-09-12T00:49:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.697+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.33 2024-09-12T00:49:06.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.34 2024-09-12T00:49:06.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.35 2024-09-12T00:49:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.36 2024-09-12T00:49:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.37 2024-09-12T00:49:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.38 2024-09-12T00:49:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.39 2024-09-12T00:49:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.40 2024-09-12T00:49:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.41 2024-09-12T00:49:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.42 2024-09-12T00:49:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.43 2024-09-12T00:49:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.701+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.44 2024-09-12T00:49:06.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.705+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.45 2024-09-12T00:49:06.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.705+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.105__multipart_key1.2~hdOMmwW1uUv2dgeiam1m1x2kIykpEJg.46 2024-09-12T00:49:06.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.705+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9722920864936798672', time=2024-09-12T02:48:57.254874+0000, chain.objs.size()=1 2024-09-12T00:49:06.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.705+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.122__shadow_.LjhsDsvc6RQ1oLkumXCxbnPy2IMXO27_0 2024-09-12T00:49:06.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.709+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.709+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:49:06.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.713+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.713+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.713+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:49:06.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.713+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1114349390504871855', time=2024-09-12T02:48:56.416440+0000, chain.objs.size()=1 2024-09-12T00:49:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.713+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.120__shadow_.oF_YBeVO_kCLYH97hbVVnhl0anOE6zN_0 2024-09-12T00:49:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.713+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4864603980139201706', time=2024-09-12T02:49:03.082388+0000, chain.objs.size()=1 2024-09-12T00:49:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.713+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.138__shadow_._zLQwHQpB4l4NSPwHO5YWlyNh4BUtIS_0 2024-09-12T00:49:06.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.717+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.717+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:49:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw', time=2024-09-12T02:48:43.320049+0000, chain.objs.size()=9 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__multipart_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.7 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__shadow_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.7_1 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__multipart_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.8 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__shadow_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.8_1 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__multipart_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.9 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__shadow_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.9_1 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__multipart_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.10 2024-09-12T00:49:06.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__shadow_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.10_1 2024-09-12T00:49:06.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.101__multipart_key1.2~a5qmdfAr2TJH0BaXDBVFBcPW7eb02yw.11 2024-09-12T00:49:06.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6677135036240801962', time=2024-09-12T02:48:55.595066+0000, chain.objs.size()=1 2024-09-12T00:49:06.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.118__shadow_.yPbUh-_XVEREvJDP_jryAEw4fHM9kY2_0 2024-09-12T00:49:06.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17730594561734293069', time=2024-09-12T02:48:55.609223+0000, chain.objs.size()=1 2024-09-12T00:49:06.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.118__shadow_.zSOCNDWlICt6eK1gDG0VO158X7V6fQb_0 2024-09-12T00:49:06.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6351586511096199213', time=2024-09-12T02:48:56.431981+0000, chain.objs.size()=1 2024-09-12T00:49:06.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.721+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.120__shadow_.KBehiblQ7VNNh_iQOsAnxp8Xoka3fDZ_0 2024-09-12T00:49:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.725+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1974173043691230621', time=2024-09-12T02:48:56.460507+0000, chain.objs.size()=1 2024-09-12T00:49:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.725+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.120__shadow_.0XL1t0CsVs0WwNQ92Ci48Auc21zvFV3_0 2024-09-12T00:49:06.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.725+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1673391690665116637', time=2024-09-12T02:48:59.259325+0000, chain.objs.size()=1 2024-09-12T00:49:06.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.725+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.127__shadow_.j8TlQO44JwXQLv4oMGEinqAvvgeespz_0 2024-09-12T00:49:06.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.729+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.729+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:49:06.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5117132954356377323', time=2024-09-12T02:48:28.670754+0000, chain.objs.size()=3 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.83__shadow_.Y6NAHuRME1UrqYv5gmE2DDxtMHEbtVw_0 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.83__shadow_.Y6NAHuRME1UrqYv5gmE2DDxtMHEbtVw_1 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.83__shadow_.Y6NAHuRME1UrqYv5gmE2DDxtMHEbtVw_2 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15385779653828583241', time=2024-09-12T02:48:31.781126+0000, chain.objs.size()=9 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.1 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__shadow_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.1_1 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.2 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__shadow_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.2_1 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.3 2024-09-12T00:49:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__shadow_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.3_1 2024-09-12T00:49:06.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.4 2024-09-12T00:49:06.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__shadow_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.4_1 2024-09-12T00:49:06.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.733+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91__multipart_key1.2~sveFi5nWicCz34sgt4Lkv6PN7R4LPIA.5 2024-09-12T00:49:06.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.737+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11362278296253045576', time=2024-09-12T02:48:54.003596+0000, chain.objs.size()=1 2024-09-12T00:49:06.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.737+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.114__shadow_.XjkMlbsPjh2ciHQ5nSnQ7B6mMn2ttYU_0 2024-09-12T00:49:06.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.737+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12760183060321757554', time=2024-09-12T02:48:54.816225+0000, chain.objs.size()=1 2024-09-12T00:49:06.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.737+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.116__shadow_._6wT_Qnfcg_FTcDXGKo3ErecVB2SujU_0 2024-09-12T00:49:06.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.737+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16151845004906561851', time=2024-09-12T02:48:55.195669+0000, chain.objs.size()=1 2024-09-12T00:49:06.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.737+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.117__shadow_.lkm9dfAyX6FBdwSoXBvAiNSwXIAhJLh_0 2024-09-12T00:49:06.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.737+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5657191344068441132', time=2024-09-12T02:48:56.045012+0000, chain.objs.size()=1 2024-09-12T00:49:06.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.737+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.119__shadow_.qCyYBfpU6kFdvEOr9mGAkHEdeiYIIDY_0 2024-09-12T00:49:06.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.741+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13595203620149567030', time=2024-09-12T02:49:00.056264+0000, chain.objs.size()=1 2024-09-12T00:49:06.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.741+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.129__shadow_.UCNTWs5Z-83q_76q2ErlKYgPiudTZAp_0 2024-09-12T00:49:06.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.741+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7132041408005441247', time=2024-09-12T02:49:01.568447+0000, chain.objs.size()=1 2024-09-12T00:49:06.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.741+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.133__shadow_.dUHPpwVzq1FWnaeveF7T82h39aplCW7_0 2024-09-12T00:49:06.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.745+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.745+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:49:06.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.749+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.749+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.749+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:49:06.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.749+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8307576260425683568', time=2024-09-12T02:49:01.599413+0000, chain.objs.size()=1 2024-09-12T00:49:06.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.749+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.133__shadow_.xm-wxvG2QSP4krSBkQ7xeNMxudxQXu4_0 2024-09-12T00:49:06.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.749+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.753+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:49:06.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.753+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.753+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17530942666534406058', time=2024-09-12T02:48:44.797305+0000, chain.objs.size()=9 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.1 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.1_1 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.2 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.2_1 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.3 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.3_1 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.4 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__shadow_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.4_1 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102__multipart_key1.2~QmfIGEGuTPbFCgS5p6u83OBnCsGbf2B.5 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9133686153673313292', time=2024-09-12T02:48:49.962255+0000, chain.objs.size()=9 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__multipart_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.1 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__shadow_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.1_1 2024-09-12T00:49:06.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__multipart_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.2 2024-09-12T00:49:06.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__shadow_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.2_1 2024-09-12T00:49:06.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__multipart_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.3 2024-09-12T00:49:06.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.757+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__shadow_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.3_1 2024-09-12T00:49:06.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.761+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__multipart_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.4 2024-09-12T00:49:06.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.761+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__shadow_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.4_1 2024-09-12T00:49:06.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.761+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.104__multipart_key1.2~OPog6DI41I1lUUCzgNwyZdNVwJ-1raQ.5 2024-09-12T00:49:06.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.765+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.765+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:49:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:49:06.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5033572343767232932', time=2024-09-12T02:48:36.651436+0000, chain.objs.size()=7 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~-zkfnWDvGWCd-neB0LNN37piFmupKAA.1 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~-zkfnWDvGWCd-neB0LNN37piFmupKAA.1_1 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~-zkfnWDvGWCd-neB0LNN37piFmupKAA.1_2 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~-zkfnWDvGWCd-neB0LNN37piFmupKAA.2 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~-zkfnWDvGWCd-neB0LNN37piFmupKAA.2_1 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~-zkfnWDvGWCd-neB0LNN37piFmupKAA.2_2 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~-zkfnWDvGWCd-neB0LNN37piFmupKAA.3 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3342657818209722884', time=2024-09-12T02:48:53.167224+0000, chain.objs.size()=1 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.112__shadow_.RTIF93m7RlRczv0O03fog5Yk6_IUdxM_0 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13772172632008265669', time=2024-09-12T02:48:57.656971+0000, chain.objs.size()=1 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.123__shadow_.Rxqm8Tv-XQWZjznwPZj0BKR6obZwyJt_0 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15172410485666794421', time=2024-09-12T02:48:58.052713+0000, chain.objs.size()=1 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.124__shadow_.5sFtzY9ffPYlJf_reJifDk-qwlwEmq-_0 2024-09-12T00:49:06.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14015855618063904989', time=2024-09-12T02:48:59.244294+0000, chain.objs.size()=1 2024-09-12T00:49:06.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.127__shadow_.t3P4AKGfpIrhXsLPwFrDYxYLmcPpCzh_0 2024-09-12T00:49:06.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17518310557763979168', time=2024-09-12T02:49:00.094440+0000, chain.objs.size()=1 2024-09-12T00:49:06.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.769+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.129__shadow_.GnYZCyag-dKre8fCvW86jOUT-Bsd7Mx_0 2024-09-12T00:49:06.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.773+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9379385191679342124', time=2024-09-12T02:49:01.198023+0000, chain.objs.size()=1 2024-09-12T00:49:06.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.773+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.132__shadow_.yfn6NVAVnpRm0qYZ8rlPtXv_GppO1e7_0 2024-09-12T00:49:06.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.773+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17223987165953012869', time=2024-09-12T02:49:01.211593+0000, chain.objs.size()=1 2024-09-12T00:49:06.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.773+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.132__shadow_.x6uL_5qQcuOEjz7qGOJudnnaLEKF0cs_0 2024-09-12T00:49:06.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.773+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14258193437753206967', time=2024-09-12T02:49:02.488362+0000, chain.objs.size()=1 2024-09-12T00:49:06.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.773+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.136__shadow_.Q6LYNPPoYhxu4id9isM1c9oZBKaxmIz_0 2024-09-12T00:49:06.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.777+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.777+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:49:06.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:49:06.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12969950094975983363', time=2024-09-12T02:48:29.357978+0000, chain.objs.size()=1 2024-09-12T00:49:06.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.85__shadow_.T6LVZhcN605Hy2OPdLrHHLBH9srX4_J_0 2024-09-12T00:49:06.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10720828451511954729', time=2024-09-12T02:48:53.125189+0000, chain.objs.size()=1 2024-09-12T00:49:06.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.112__shadow_.OoKRammChpZ8gCEPFgfr2j8pSpI4wTT_0 2024-09-12T00:49:06.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5666747714642377983', time=2024-09-12T02:48:54.387852+0000, chain.objs.size()=1 2024-09-12T00:49:06.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.115__shadow_.1D1AMlZkqTDZBebDyZIDg52Uvr_Tukp_0 2024-09-12T00:49:06.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17105054055337639135', time=2024-09-12T02:48:56.444920+0000, chain.objs.size()=1 2024-09-12T00:49:06.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.120__shadow_.Yo_GAMLx6uI2LCSZ8HPK15osvRZ-XLm_0 2024-09-12T00:49:06.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13754614490060924486', time=2024-09-12T02:48:58.431337+0000, chain.objs.size()=1 2024-09-12T00:49:06.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.125__shadow_.wpptdysReE2CU5HB_vhtmrBmclmSl2B_0 2024-09-12T00:49:06.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10344150208338774432', time=2024-09-12T02:49:04.016007+0000, chain.objs.size()=1 2024-09-12T00:49:06.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.781+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.140__shadow_.CN1EEyuwlpddvPiXuxbhfUCKcgQoQZP_0 2024-09-12T00:49:06.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.785+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.785+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:49:06.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:49:06.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-', time=2024-09-12T02:48:26.749755+0000, chain.objs.size()=9 2024-09-12T00:49:06.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__multipart_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.1 2024-09-12T00:49:06.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__shadow_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.1_1 2024-09-12T00:49:06.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__multipart_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.2 2024-09-12T00:49:06.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__shadow_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.2_1 2024-09-12T00:49:06.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__multipart_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.3 2024-09-12T00:49:06.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__shadow_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.3_1 2024-09-12T00:49:06.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__multipart_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.4 2024-09-12T00:49:06.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__shadow_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.4_1 2024-09-12T00:49:06.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.79__multipart_key1.2~U2ax0N9GrmyVx5ezomuPR6SRjukuKj-.5 2024-09-12T00:49:06.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2880423607958874245', time=2024-09-12T02:49:00.834722+0000, chain.objs.size()=1 2024-09-12T00:49:06.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.789+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.131__shadow_.RF7Sz76N-pdbYdYwKFMnbq7zhQ_5xZ-_0 2024-09-12T00:49:06.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.793+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:49:06.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18041904072239385882', time=2024-09-12T02:48:48.197959+0000, chain.objs.size()=1 2024-09-12T00:49:06.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.103__shadow_.gj-iD6Z8rk5sZmIEDeo8W428ihebQrT_0 2024-09-12T00:49:06.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3301230739158436470', time=2024-09-12T02:48:57.643470+0000, chain.objs.size()=1 2024-09-12T00:49:06.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.123__shadow_._roZ88hnooTwFk9LWifRepjaIDra5vP_0 2024-09-12T00:49:06.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4266206303204782257', time=2024-09-12T02:48:58.458140+0000, chain.objs.size()=1 2024-09-12T00:49:06.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.125__shadow_.qNGpMt0qsh1fJHI_QvrXCOIU8oaqfzO_0 2024-09-12T00:49:06.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11381155776578759063', time=2024-09-12T02:48:59.675045+0000, chain.objs.size()=1 2024-09-12T00:49:06.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.797+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.128__shadow_.eZv5q1mSWnwKm_gYyEvtfcaUgOd55rE_0 2024-09-12T00:49:06.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.801+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.801+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:49:06.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15018643773083884876', time=2024-09-12T02:48:54.804051+0000, chain.objs.size()=1 2024-09-12T00:49:06.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.116__shadow_.iIlcvxu46hBI-KSRtQF6iMuKbzUMEg5_0 2024-09-12T00:49:06.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15391300405043482701', time=2024-09-12T02:48:57.240885+0000, chain.objs.size()=1 2024-09-12T00:49:06.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.122__shadow_.Zt1WhM20OTlga3i8U2MS5SnAu2lLcsh_0 2024-09-12T00:49:06.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1110168578640190328', time=2024-09-12T02:49:00.070804+0000, chain.objs.size()=1 2024-09-12T00:49:06.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.129__shadow_.oeBHs3sC-SM3fkswB6immapEMwexP5E_0 2024-09-12T00:49:06.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1638237494797437009', time=2024-09-12T02:49:00.469643+0000, chain.objs.size()=1 2024-09-12T00:49:06.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.805+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.130__shadow_.7WYmQOS58KY85x3A18Xu3aTY_dBlrKq_0 2024-09-12T00:49:06.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.809+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.809+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:49:06.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1875212292885111471', time=2024-09-12T02:48:42.338048+0000, chain.objs.size()=1 2024-09-12T00:49:06.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_.v2FCKC5kaGhk09WPS6GBno8y6jG6BFz_0 2024-09-12T00:49:06.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.474277727802082771', time=2024-09-12T02:48:54.374726+0000, chain.objs.size()=1 2024-09-12T00:49:06.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.115__shadow_.yowHCaLdJ9Jpm9nYeBKSsRjuQuXOf_N_0 2024-09-12T00:49:06.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13775637447894362501', time=2024-09-12T02:48:55.223394+0000, chain.objs.size()=1 2024-09-12T00:49:06.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.117__shadow_.3tKnbolRPRLKkHK8VMJKbDctnhPxXGZ_0 2024-09-12T00:49:06.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14725357510174260792', time=2024-09-12T02:48:58.444868+0000, chain.objs.size()=1 2024-09-12T00:49:06.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.125__shadow_.iVoG76qhT34ryVDoCs8JhWXmzOiPg6x_0 2024-09-12T00:49:06.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.813+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.817+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:49:06.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.817+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.817+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10527172798487302238', time=2024-09-12T02:48:38.778235+0000, chain.objs.size()=7 2024-09-12T00:49:06.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~19Xw2xtBTTtHWjNpni80V3NqINagiGb.1 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~19Xw2xtBTTtHWjNpni80V3NqINagiGb.1_1 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~19Xw2xtBTTtHWjNpni80V3NqINagiGb.1_2 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~19Xw2xtBTTtHWjNpni80V3NqINagiGb.2 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~19Xw2xtBTTtHWjNpni80V3NqINagiGb.2_1 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__shadow_key1.2~19Xw2xtBTTtHWjNpni80V3NqINagiGb.2_2 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.94__multipart_key1.2~19Xw2xtBTTtHWjNpni80V3NqINagiGb.3 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11814209870932487634', time=2024-09-12T02:48:53.152865+0000, chain.objs.size()=1 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.112__shadow_.anqnrpS9ksdX70GpJgGJFdAE6GyLRHi_0 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1040551220338150095', time=2024-09-12T02:48:55.236872+0000, chain.objs.size()=1 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.117__shadow_.VrrADGQbF7I_CAQ2qPLtKMh0iflDfO__0 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14573053546049991697', time=2024-09-12T02:48:57.671043+0000, chain.objs.size()=1 2024-09-12T00:49:06.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.821+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.123__shadow_.a4l7ZG5lgH6JTHQNdGNQH-7h_cQlxYJ_0 2024-09-12T00:49:06.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.825+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.825+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:49:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.829+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.829+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.829+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.829+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:49:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.833+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.833+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.833+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:49:06.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.833+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15755029763801897725', time=2024-09-12T02:49:00.081768+0000, chain.objs.size()=1 2024-09-12T00:49:06.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.833+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.129__shadow_.oxVJXnBFBDJKspr2WHBJep4WHX4YlQV_0 2024-09-12T00:49:06.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.833+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16879547017044713175', time=2024-09-12T02:48:27.551676+0000, chain.objs.size()=1 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.81__shadow_.cGz1yQEUnepynDkWKJSx_GiV0Dli5Tg_0 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576673205865451770', time=2024-09-12T02:48:29.012356+0000, chain.objs.size()=1 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.84__shadow_.v23b7ctOfzCaISrHDGhVUIw4BK0jBh4_0 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10680407167182900807', time=2024-09-12T02:48:38.422154+0000, chain.objs.size()=6 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.93__shadow_.KP4zazblz25tuR9ySqNucqy8hNjMzxL_0 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.93__shadow_.KP4zazblz25tuR9ySqNucqy8hNjMzxL_1 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.93__shadow_.KP4zazblz25tuR9ySqNucqy8hNjMzxL_2 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.93__shadow_.KP4zazblz25tuR9ySqNucqy8hNjMzxL_3 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.93__shadow_.KP4zazblz25tuR9ySqNucqy8hNjMzxL_4 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.93__shadow_.KP4zazblz25tuR9ySqNucqy8hNjMzxL_5 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.508223376987260818', time=2024-09-12T02:48:42.310838+0000, chain.objs.size()=9 2024-09-12T00:49:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.1 2024-09-12T00:49:06.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.1_1 2024-09-12T00:49:06.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.2 2024-09-12T00:49:06.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.837+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.2_1 2024-09-12T00:49:06.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.841+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.3 2024-09-12T00:49:06.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.841+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.3_1 2024-09-12T00:49:06.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.841+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.4 2024-09-12T00:49:06.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.841+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__shadow_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.4_1 2024-09-12T00:49:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.845+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.100__multipart_file2.mpg.2~-FH4WCXVTodz9Uzfuab14oW6_yjSU2u.5 2024-09-12T00:49:06.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.849+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.849+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:49:06.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:06.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:06.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:49:06.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9368799390993203869', time=2024-09-12T02:48:25.437400+0000, chain.objs.size()=1 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.77__shadow_.mp0DTu2SVWA8phoclJZXlDEpqOu9Fjb_0 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11796314934341568396', time=2024-09-12T02:48:56.032604+0000, chain.objs.size()=1 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.119__shadow_.wWlEXWg3BUloBS_6RXPTnBRciY5UuHk_0 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1022674159541018435', time=2024-09-12T02:48:56.832692+0000, chain.objs.size()=1 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.121__shadow_.t286o0f-xhMUfNB7z0jOWOw0pAkHOpp_0 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8684825579804361955', time=2024-09-12T02:48:56.874767+0000, chain.objs.size()=1 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.121__shadow_.Pl_l9yGwPUAouTRtjxaEjtezwlI-CBg_0 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16524542755057333267', time=2024-09-12T02:48:57.273294+0000, chain.objs.size()=1 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.122__shadow_._qoNSEpmI_y3mZ64RQANA1p0KWxMWwc_0 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3434344931293582753', time=2024-09-12T02:48:58.025415+0000, chain.objs.size()=1 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.124__shadow_.v3r_cOmz7lRgMfvWOO1-Jp--hFzd7aO_0 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7101001281835847553', time=2024-09-12T02:49:05.977184+0000, chain.objs.size()=9 2024-09-12T00:49:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__multipart_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.1 2024-09-12T00:49:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__shadow_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.1_1 2024-09-12T00:49:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__multipart_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.2 2024-09-12T00:49:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__shadow_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.2_1 2024-09-12T00:49:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__multipart_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.3 2024-09-12T00:49:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.853+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__shadow_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.3_1 2024-09-12T00:49:06.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.857+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__multipart_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.4 2024-09-12T00:49:06.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.857+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__shadow_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.4_1 2024-09-12T00:49:06.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.857+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144__multipart_key1/data/file.mpg.2~fzJouSyDawWvfsHp-JU0hrCEd-EDt2W.5 2024-09-12T00:49:06.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.861+0000 7f3e3f2d79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:49:06.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.865+0000 7f3cf2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:06.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.869+0000 7f3e3f2d79c0 20 remove_watcher() i=0 2024-09-12T00:49:06.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.869+0000 7f3e3f2d79c0 2 removed watcher, disabling cache 2024-09-12T00:49:06.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.869+0000 7f3e3f2d79c0 20 remove_watcher() i=1 2024-09-12T00:49:06.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.869+0000 7f3e3f2d79c0 20 remove_watcher() i=2 2024-09-12T00:49:06.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.873+0000 7f3e3f2d79c0 20 remove_watcher() i=3 2024-09-12T00:49:06.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.873+0000 7f3e3f2d79c0 20 remove_watcher() i=4 2024-09-12T00:49:06.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.873+0000 7f3e3f2d79c0 20 remove_watcher() i=5 2024-09-12T00:49:06.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.873+0000 7f3e3f2d79c0 20 remove_watcher() i=6 2024-09-12T00:49:06.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:06.877+0000 7f3e3f2d79c0 20 remove_watcher() i=7 2024-09-12T00:49:06.888 DEBUG:teuthology.orchestra.run.smithi137:> radosgw-admin gc process --include-all 2024-09-12T00:49:06.956 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:06.956 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:06.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 realm 2024-09-12T00:49:07.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:07.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:07.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.001+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.005+0000 7f213ece49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:07.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.005+0000 7f213ece49c0 20 searching for the correct realm 2024-09-12T00:49:07.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.009+0000 7f213bfe9640 0 -- 172.21.15.137:0/723843909 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f21300e1ee0 msgr2=0x7f21300f7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:07.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.013+0000 7f213cfeb640 0 -- 172.21.15.137:0/723843909 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x564e51f53b20 msgr2=0x564e51f55f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:07.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:07.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:07.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:07.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:07.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:07.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:07.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 zone default found 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 4 Realm: () 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 zonegroup default 2024-09-12T00:49:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.025+0000 7f213ece49c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.029+0000 7f213ece49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.029+0000 7f213ece49c0 20 started sync module instance, tier type = 2024-09-12T00:49:07.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.029+0000 7f213ece49c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:07.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.045+0000 7f213ece49c0 20 add_watcher() i=0 2024-09-12T00:49:07.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.045+0000 7f213ece49c0 20 add_watcher() i=1 2024-09-12T00:49:07.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.045+0000 7f213ece49c0 20 add_watcher() i=2 2024-09-12T00:49:07.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.045+0000 7f213ece49c0 20 add_watcher() i=3 2024-09-12T00:49:07.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.045+0000 7f213ece49c0 20 add_watcher() i=4 2024-09-12T00:49:07.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.045+0000 7f213ece49c0 20 add_watcher() i=5 2024-09-12T00:49:07.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.045+0000 7f213ece49c0 20 add_watcher() i=6 2024-09-12T00:49:07.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.049+0000 7f213ece49c0 20 add_watcher() i=7 2024-09-12T00:49:07.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.049+0000 7f213ece49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:07.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.053+0000 7f1ff2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:07.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.053+0000 7f213ece49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:07.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.053+0000 7f213ece49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:07.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.129+0000 7f1ff1fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:07.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.129+0000 7f213ece49c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:07.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.129+0000 7f213ece49c0 20 Filter name: none 2024-09-12T00:49:07.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.129+0000 7f1f637fe640 20 reqs_thread_entry: start 2024-09-12T00:49:07.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.129+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:49:07.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.133+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.133+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.133+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.137+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:49:07.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.141+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.141+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.141+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.145+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:49:07.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.149+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.149+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.149+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.153+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:49:07.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.153+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.157+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.157+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.161+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:49:07.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.161+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.165+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.165+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.169+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:49:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.169+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.173+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.173+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.177+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:49:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.181+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.181+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.181+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.185+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:49:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.185+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.185+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.185+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.189+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:49:07.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.193+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.193+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.193+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.197+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:49:07.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.201+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.201+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.201+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.205+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:49:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.205+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.205+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.205+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.209+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:49:07.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.213+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.213+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.213+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.217+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:49:07.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.221+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.221+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.221+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.225+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:49:07.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.229+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.229+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.229+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.233+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:49:07.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.237+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.237+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.237+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.241+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:49:07.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.245+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.245+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.245+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.249+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:49:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.253+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.253+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.253+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.257+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:49:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.261+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.261+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.265+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.265+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:49:07.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.269+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.269+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.269+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.273+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:49:07.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.277+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.277+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.277+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.281+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:49:07.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.285+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.285+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.285+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.289+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:49:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.293+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.293+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.293+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.297+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:49:07.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.301+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.305+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.305+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.309+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:49:07.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.313+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.313+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.313+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.317+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:49:07.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.321+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.325+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.325+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.329+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:49:07.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.333+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.333+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.333+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.337+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:49:07.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.341+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.341+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.345+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.345+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:49:07.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.349+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.353+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.353+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.357+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:49:07.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.357+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.361+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.361+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.365+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:49:07.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.369+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.369+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.369+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.373+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:49:07.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.377+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.377+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.377+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.381+0000 7f213ece49c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:49:07.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.385+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.385+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:49:07.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.389+0000 7f213ece49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:49:07.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.393+0000 7f1ff2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:07.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.397+0000 7f213ece49c0 20 remove_watcher() i=0 2024-09-12T00:49:07.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.397+0000 7f213ece49c0 2 removed watcher, disabling cache 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.401+0000 7f213ece49c0 20 remove_watcher() i=1 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.405+0000 7f213ece49c0 20 remove_watcher() i=2 2024-09-12T00:49:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.405+0000 7f213ece49c0 20 remove_watcher() i=3 2024-09-12T00:49:07.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.409+0000 7f213ece49c0 20 remove_watcher() i=4 2024-09-12T00:49:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.409+0000 7f213ece49c0 20 remove_watcher() i=5 2024-09-12T00:49:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.413+0000 7f213ece49c0 20 remove_watcher() i=6 2024-09-12T00:49:07.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:07.417+0000 7f213ece49c0 20 remove_watcher() i=7 2024-09-12T00:49:07.434 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T00:49:07.456 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T00:49:07.457 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T00:49:07.457 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T00:49:07.457 DEBUG:teuthology.orchestra.run.smithi137:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T00:49:08.338 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T00:49:08.338 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T00:49:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:08.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.465+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 realm 2024-09-12T00:49:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.469+0000 7f4b5cc939c0 20 searching for the correct realm 2024-09-12T00:49:08.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.473+0000 7f4b5a799640 0 -- 172.21.15.137:0/1601766822 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f4b4c0c6040 msgr2=0x7f4b4c132900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:08.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.685+0000 7f4b5a799640 0 -- 172.21.15.137:0/1601766822 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f4b54073040 msgr2=0x7f4b540803d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:08.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:08.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:08.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:08.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:08.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:08.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:08.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:08.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.905+0000 7f4b5cc939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:08.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 zone default found 2024-09-12T00:49:08.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 4 Realm: () 2024-09-12T00:49:08.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:08.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:08.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:08.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 zonegroup default 2024-09-12T00:49:08.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 started sync module instance, tier type = 2024-09-12T00:49:08.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.909+0000 7f4b5cc939c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 20 add_watcher() i=0 2024-09-12T00:49:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 20 add_watcher() i=1 2024-09-12T00:49:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 20 add_watcher() i=2 2024-09-12T00:49:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 20 add_watcher() i=3 2024-09-12T00:49:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 20 add_watcher() i=4 2024-09-12T00:49:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 20 add_watcher() i=5 2024-09-12T00:49:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 20 add_watcher() i=6 2024-09-12T00:49:08.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 20 add_watcher() i=7 2024-09-12T00:49:08.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.933+0000 7f4b5cc939c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.937+0000 7f4a10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.937+0000 7f4b5cc939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.937+0000 7f4b5cc939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.937+0000 7f4b5cc939c0 5 note: GC not initialized 2024-09-12T00:49:08.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.937+0000 7f498b7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:08.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.937+0000 7f4b5cc939c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:08.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 20 Filter name: none 2024-09-12T00:49:08.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f49897fa640 20 reqs_thread_entry: start 2024-09-12T00:49:08.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T00:49:08.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T00:49:08.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:49:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T00:49:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T00:49:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T00:49:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:49:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.941+0000 7f4b5cc939c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T00:49:08.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.945+0000 7f4b5cc939c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:49:08.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.945+0000 7f4b5cc939c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:49:08.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.945+0000 7f4b5cc939c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T00:49:08.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.945+0000 7f4a3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366416 cookie 94519035289056 notifier 8949 bl.length()=384 2024-09-12T00:49:08.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.945+0000 7f4a3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:49:08.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.945+0000 7f4a3dffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:49:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.949+0000 7f4b5cc939c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:49:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.949+0000 7f4b5cc939c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:49:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.949+0000 7f4b5cc939c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T00:49:08.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.949+0000 7f4a3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366417 cookie 94519035305200 notifier 8949 bl.length()=225 2024-09-12T00:49:08.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.949+0000 7f4a3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:49:08.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.949+0000 7f4a3d7fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:49:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.953+0000 7f4b5cc939c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:49:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.953+0000 7f4b5cc939c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:49:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.953+0000 7f4b5cc939c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T00:49:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.953+0000 7f4a3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366251 cookie 94519035302592 notifier 8949 bl.length()=234 2024-09-12T00:49:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.953+0000 7f4a3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:49:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.953+0000 7f4a3d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:49:08.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.953+0000 7f4a10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:08.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.961+0000 7f4b5cc939c0 20 remove_watcher() i=0 2024-09-12T00:49:08.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.961+0000 7f4b5cc939c0 2 removed watcher, disabling cache 2024-09-12T00:49:08.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.961+0000 7f4b5cc939c0 20 remove_watcher() i=1 2024-09-12T00:49:08.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.965+0000 7f4b5cc939c0 20 remove_watcher() i=2 2024-09-12T00:49:08.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.965+0000 7f4b5cc939c0 20 remove_watcher() i=3 2024-09-12T00:49:08.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.969+0000 7f4b5cc939c0 20 remove_watcher() i=4 2024-09-12T00:49:08.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.969+0000 7f4b5cc939c0 20 remove_watcher() i=5 2024-09-12T00:49:08.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.973+0000 7f4b5cc939c0 20 remove_watcher() i=6 2024-09-12T00:49:08.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:08.973+0000 7f4b5cc939c0 20 remove_watcher() i=7 2024-09-12T00:49:08.986 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:08.986 INFO:teuthology.orchestra.run.smithi137.stdout: "id": "RGW11111111111111111", 2024-09-12T00:49:08.986 INFO:teuthology.orchestra.run.smithi137.stdout: "tenant": "", 2024-09-12T00:49:08.986 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T00:49:08.986 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T00:49:08.986 INFO:teuthology.orchestra.run.smithi137.stdout: "quota": { 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_users": 1000, 2024-09-12T00:49:08.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_roles": 1000, 2024-09-12T00:49:08.988 INFO:teuthology.orchestra.run.smithi137.stdout: "max_groups": 1000, 2024-09-12T00:49:08.988 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:08.988 INFO:teuthology.orchestra.run.smithi137.stdout: "max_access_keys": 4 2024-09-12T00:49:08.988 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:08.989 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T00:49:08.989 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key OSQDSOMEYRAXEELTVAUD --secret Wytp0usaAnj6tLzmQuyLOwMV+lkGEW5x8dcOtMlLnOcu5bPmCGwnvg== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T00:49:09.082 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:09.082 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:09.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.125+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.125+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.125+0000 7f982a1cd9c0 20 realm 2024-09-12T00:49:09.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.125+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:09.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:09.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:09.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.129+0000 7f982a1cd9c0 20 searching for the correct realm 2024-09-12T00:49:09.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.137+0000 7f98284d4640 0 -- 172.21.15.137:0/1920426798 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f981c008040 msgr2=0x7f981c05c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:09.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.141+0000 7f9827cd3640 0 -- 172.21.15.137:0/1920426798 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f9820018040 msgr2=0x7f9820023730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:09.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:09.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:09.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:09.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:09.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 zone default found 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 4 Realm: () 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 zonegroup default 2024-09-12T00:49:09.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.149+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.153+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.153+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.153+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.153+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.153+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.153+0000 7f982a1cd9c0 20 started sync module instance, tier type = 2024-09-12T00:49:09.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.153+0000 7f982a1cd9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:09.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 20 add_watcher() i=0 2024-09-12T00:49:09.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 20 add_watcher() i=1 2024-09-12T00:49:09.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 20 add_watcher() i=2 2024-09-12T00:49:09.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 20 add_watcher() i=3 2024-09-12T00:49:09.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 20 add_watcher() i=4 2024-09-12T00:49:09.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 20 add_watcher() i=5 2024-09-12T00:49:09.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 20 add_watcher() i=6 2024-09-12T00:49:09.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 20 add_watcher() i=7 2024-09-12T00:49:09.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.173+0000 7f982a1cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:09.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.177+0000 7f96ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:09.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.177+0000 7f982a1cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:09.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.177+0000 7f982a1cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:09.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.177+0000 7f982a1cd9c0 5 note: GC not initialized 2024-09-12T00:49:09.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.177+0000 7f96dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:49:09.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.177+0000 7f982a1cd9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:09.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 Filter name: none 2024-09-12T00:49:09.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f96567fc640 20 reqs_thread_entry: start 2024-09-12T00:49:09.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:49:09.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T00:49:09.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:49:09.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T00:49:09.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T00:49:09.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:49:09.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache get: name=default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD : miss 2024-09-12T00:49:09.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache put: name=default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD info.flags=0x0 2024-09-12T00:49:09.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 adding default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD to cache LRU end 2024-09-12T00:49:09.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T00:49:09.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:49:09.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:49:09.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:49:09.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:09.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache get: name=default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD : hit (negative entry) 2024-09-12T00:49:09.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.181+0000 7f982a1cd9c0 10 cache get: name=default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD : hit (negative entry) 2024-09-12T00:49:09.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.189+0000 7f982a1cd9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:49:09.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.189+0000 7f982a1cd9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:49:09.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.189+0000 7f982a1cd9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:49:09.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.189+0000 7f9706ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94183410833024 notifier 8507 bl.length()=673 2024-09-12T00:49:09.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.189+0000 7f9706ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:49:09.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.189+0000 7f9706ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:49:09.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.193+0000 7f982a1cd9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:49:09.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.193+0000 7f982a1cd9c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:49:09.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.193+0000 7f982a1cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T00:49:09.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.193+0000 7f9706ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366418 cookie 94183410844864 notifier 8507 bl.length()=185 2024-09-12T00:49:09.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.193+0000 7f9706ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:49:09.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.193+0000 7f9706ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:49:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.197+0000 7f982a1cd9c0 10 cache put: name=default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD info.flags=0x7 2024-09-12T00:49:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.197+0000 7f982a1cd9c0 10 moving default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD to cache LRU end 2024-09-12T00:49:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.197+0000 7f982a1cd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:OSQDSOMEYRAXEELTVAUD, ofs0, ns] 2024-09-12T00:49:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.197+0000 7f97067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366431 cookie 94183410846080 notifier 8507 bl.length()=186 2024-09-12T00:49:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.197+0000 7f97067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD info.flags=0x7 2024-09-12T00:49:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.197+0000 7f97067fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OSQDSOMEYRAXEELTVAUD to cache LRU end 2024-09-12T00:49:09.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.201+0000 7f982a1cd9c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T00:49:09.199 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "foo.client.0", 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "foo+test@test.test", 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "foo.client.0", 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "OSQDSOMEYRAXEELTVAUD", 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "Wytp0usaAnj6tLzmQuyLOwMV+lkGEW5x8dcOtMlLnOcu5bPmCGwnvg==", 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:09.186389Z" 2024-09-12T00:49:09.200 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:09.201 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "root", 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "RGW11111111111111111", 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:09.186371Z", 2024-09-12T00:49:09.202 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:49:09.203 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:49:09.203 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:09.203 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:09.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.201+0000 7f96ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.205+0000 7f982a1cd9c0 20 remove_watcher() i=0 2024-09-12T00:49:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.205+0000 7f982a1cd9c0 2 removed watcher, disabling cache 2024-09-12T00:49:09.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.209+0000 7f982a1cd9c0 20 remove_watcher() i=1 2024-09-12T00:49:09.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.209+0000 7f982a1cd9c0 20 remove_watcher() i=2 2024-09-12T00:49:09.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.213+0000 7f982a1cd9c0 20 remove_watcher() i=3 2024-09-12T00:49:09.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.213+0000 7f982a1cd9c0 20 remove_watcher() i=4 2024-09-12T00:49:09.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.217+0000 7f982a1cd9c0 20 remove_watcher() i=5 2024-09-12T00:49:09.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.217+0000 7f982a1cd9c0 20 remove_watcher() i=6 2024-09-12T00:49:09.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.221+0000 7f982a1cd9c0 20 remove_watcher() i=7 2024-09-12T00:49:09.235 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6408676908 --totp-seed FWJPUB3CLWGU6B3VLHR7AHRUBE3QVJF5DDHAYLP3LAEOYAJBOC7LC3S3SL2LWQFU --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:49:09.278 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:09.278 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:09.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.317+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.321+0000 7fa1abbc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.321+0000 7fa1abbc39c0 20 realm 2024-09-12T00:49:09.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.321+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.321+0000 7fa1abbc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.321+0000 7fa1abbc39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:09.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.321+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.321+0000 7fa1abbc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.321+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.325+0000 7fa1abbc39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:09.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.325+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.325+0000 7fa1abbc39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:09.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.325+0000 7fa1abbc39c0 20 searching for the correct realm 2024-09-12T00:49:09.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.329+0000 7fa1a8ec8640 0 -- 172.21.15.137:0/522068230 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fa19411fb40 msgr2=0x7fa19412c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:09.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.337+0000 7fa1a9eca640 0 -- 172.21.15.137:0/522068230 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x556c931165e0 msgr2=0x556c93118a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:09.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:09.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:09.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:09.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 zone default found 2024-09-12T00:49:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 4 Realm: () 2024-09-12T00:49:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:09.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:09.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:09.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 zonegroup default 2024-09-12T00:49:09.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.345+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.349+0000 7fa1abbc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:09.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.349+0000 7fa1abbc39c0 20 started sync module instance, tier type = 2024-09-12T00:49:09.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.349+0000 7fa1abbc39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:09.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.365+0000 7fa1abbc39c0 20 add_watcher() i=0 2024-09-12T00:49:09.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.365+0000 7fa1abbc39c0 20 add_watcher() i=1 2024-09-12T00:49:09.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.365+0000 7fa1abbc39c0 20 add_watcher() i=2 2024-09-12T00:49:09.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.365+0000 7fa1abbc39c0 20 add_watcher() i=3 2024-09-12T00:49:09.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.365+0000 7fa1abbc39c0 20 add_watcher() i=4 2024-09-12T00:49:09.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.365+0000 7fa1abbc39c0 20 add_watcher() i=5 2024-09-12T00:49:09.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.365+0000 7fa1abbc39c0 20 add_watcher() i=6 2024-09-12T00:49:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.369+0000 7fa1abbc39c0 20 add_watcher() i=7 2024-09-12T00:49:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.369+0000 7fa1abbc39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa05f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 5 note: GC not initialized 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa05e7e4640 20 reqs_thread_entry: start 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 20 Filter name: none 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7f9fcffff640 20 reqs_thread_entry: start 2024-09-12T00:49:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:49:09.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:09.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T00:49:09.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T00:49:09.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:49:09.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:09.373+0000 7fa1abbc39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:10.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.641+0000 7fa1abbc39c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:49:10.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.641+0000 7fa1abbc39c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:49:10.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.641+0000 7fa1abbc39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:49:10.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.641+0000 7fa08cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300817 cookie 93924812228016 notifier 8525 bl.length()=687 2024-09-12T00:49:10.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.641+0000 7fa08cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:49:10.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.641+0000 7fa08cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:49:10.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.645+0000 7fa05f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:10.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.645+0000 7fa1abbc39c0 20 remove_watcher() i=0 2024-09-12T00:49:10.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.645+0000 7fa1abbc39c0 2 removed watcher, disabling cache 2024-09-12T00:49:10.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.649+0000 7fa1abbc39c0 20 remove_watcher() i=1 2024-09-12T00:49:10.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.653+0000 7fa1abbc39c0 20 remove_watcher() i=2 2024-09-12T00:49:10.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.653+0000 7fa1abbc39c0 20 remove_watcher() i=3 2024-09-12T00:49:10.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.653+0000 7fa1abbc39c0 20 remove_watcher() i=4 2024-09-12T00:49:10.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.657+0000 7fa1abbc39c0 20 remove_watcher() i=5 2024-09-12T00:49:10.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.661+0000 7fa1abbc39c0 20 remove_watcher() i=6 2024-09-12T00:49:10.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.661+0000 7fa1abbc39c0 20 remove_watcher() i=7 2024-09-12T00:49:10.678 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T00:49:10.678 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key UAKOYCZKAAXNHINWSHPK --secret TuV0KPeCrqex0Hs9HCNgcq/55FhjAUeKhBsstf/HUGOApvX2cDvcPg== --cluster ceph 2024-09-12T00:49:10.771 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:10.771 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:10.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.813+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 realm 2024-09-12T00:49:10.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:10.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.817+0000 7f9a315399c0 20 searching for the correct realm 2024-09-12T00:49:10.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.825+0000 7f9a2e83e640 0 -- 172.21.15.137:0/4035019870 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f9a2406a990 msgr2=0x7f9a24068830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:10.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.829+0000 7f9a2f03f640 0 -- 172.21.15.137:0/4035019870 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f9a200d1910 msgr2=0x7f9a200c2430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:10.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:10.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:10.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:10.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:10.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:10.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:10.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:10.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 zone default found 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 4 Realm: () 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 zonegroup default 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.837+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.841+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.841+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.841+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.841+0000 7f9a315399c0 20 started sync module instance, tier type = 2024-09-12T00:49:10.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.841+0000 7f9a315399c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:10.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.857+0000 7f9a315399c0 20 add_watcher() i=0 2024-09-12T00:49:10.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.857+0000 7f9a315399c0 20 add_watcher() i=1 2024-09-12T00:49:10.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.857+0000 7f9a315399c0 20 add_watcher() i=2 2024-09-12T00:49:10.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.857+0000 7f9a315399c0 20 add_watcher() i=3 2024-09-12T00:49:10.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.857+0000 7f9a315399c0 20 add_watcher() i=4 2024-09-12T00:49:10.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.857+0000 7f9a315399c0 20 add_watcher() i=5 2024-09-12T00:49:10.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.857+0000 7f9a315399c0 20 add_watcher() i=6 2024-09-12T00:49:10.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.861+0000 7f9a315399c0 20 add_watcher() i=7 2024-09-12T00:49:10.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.861+0000 7f9a315399c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:10.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f98e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:10.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:10.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:10.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 5 note: GC not initialized 2024-09-12T00:49:10.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f98e57e2640 20 reqs_thread_entry: start 2024-09-12T00:49:10.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:10.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 Filter name: none 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f98de7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 cache get: name=default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK : miss 2024-09-12T00:49:10.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 cache put: name=default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK info.flags=0x0 2024-09-12T00:49:10.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 adding default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK to cache LRU end 2024-09-12T00:49:10.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 cache get: name=default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK : hit (negative entry) 2024-09-12T00:49:10.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.865+0000 7f9a315399c0 10 cache get: name=default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK : hit (negative entry) 2024-09-12T00:49:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.869+0000 7f9a315399c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:49:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.869+0000 7f9a315399c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:49:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.869+0000 7f9a315399c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:49:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.869+0000 7f9912ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301011 cookie 94129405300336 notifier 8997 bl.length()=645 2024-09-12T00:49:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.869+0000 7f9912ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:49:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.869+0000 7f9912ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:49:10.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9a315399c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:49:10.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9a315399c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:49:10.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9a315399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T00:49:10.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9912ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301024 cookie 94129405310160 notifier 8997 bl.length()=185 2024-09-12T00:49:10.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9912ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:49:10.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9912ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:49:10.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9a315399c0 10 cache put: name=default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK info.flags=0x7 2024-09-12T00:49:10.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9a315399c0 10 moving default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK to cache LRU end 2024-09-12T00:49:10.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.873+0000 7f9a315399c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:UAKOYCZKAAXNHINWSHPK, ofs0, ns] 2024-09-12T00:49:10.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.877+0000 7f9912ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301025 cookie 94129405313216 notifier 8997 bl.length()=186 2024-09-12T00:49:10.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.877+0000 7f9912ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK info.flags=0x7 2024-09-12T00:49:10.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.877+0000 7f9912ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UAKOYCZKAAXNHINWSHPK to cache LRU end 2024-09-12T00:49:10.875 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:10.875 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "bar.client.0", 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "bar+test@test.test", 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "bar.client.0", 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "UAKOYCZKAAXNHINWSHPK", 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "TuV0KPeCrqex0Hs9HCNgcq/55FhjAUeKhBsstf/HUGOApvX2cDvcPg==", 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:49:10.876 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:10.869853Z" 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:10.877 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:10.878 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "rgw", 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "", 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:10.869832Z", 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:10.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.877+0000 7f98e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:10.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.881+0000 7f9a315399c0 20 remove_watcher() i=0 2024-09-12T00:49:10.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.881+0000 7f9a315399c0 2 removed watcher, disabling cache 2024-09-12T00:49:10.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.885+0000 7f9a315399c0 20 remove_watcher() i=1 2024-09-12T00:49:10.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.885+0000 7f9a315399c0 20 remove_watcher() i=2 2024-09-12T00:49:10.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.889+0000 7f9a315399c0 20 remove_watcher() i=3 2024-09-12T00:49:10.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.889+0000 7f9a315399c0 20 remove_watcher() i=4 2024-09-12T00:49:10.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.893+0000 7f9a315399c0 20 remove_watcher() i=5 2024-09-12T00:49:10.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.893+0000 7f9a315399c0 20 remove_watcher() i=6 2024-09-12T00:49:10.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.897+0000 7f9a315399c0 20 remove_watcher() i=7 2024-09-12T00:49:10.911 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7864893648 --totp-seed 47UXIBDIB2WM4BC56JHZU5SOJOGWMJQZ2NVZ6MAQDBVXSEGJXLENOB2ETM2G6TES --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:49:10.952 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:10.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.993+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 realm 2024-09-12T00:49:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:10.997+0000 7fa202eb79c0 20 searching for the correct realm 2024-09-12T00:49:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.001+0000 7fa2009bd640 0 -- 172.21.15.137:0/97874049 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fa1f00c6040 msgr2=0x7fa1f01039b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.009+0000 7fa2009bd640 0 -- 172.21.15.137:0/97874049 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fa1f807f070 msgr2=0x7fa1f8078060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.225+0000 7fa202eb79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.225+0000 7fa202eb79c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.225+0000 7fa202eb79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.225+0000 7fa202eb79c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.225+0000 7fa202eb79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.225+0000 7fa202eb79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:11.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 zone default found 2024-09-12T00:49:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 4 Realm: () 2024-09-12T00:49:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 zonegroup default 2024-09-12T00:49:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.229+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.233+0000 7fa202eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.233+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.233+0000 7fa202eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.233+0000 7fa202eb79c0 20 started sync module instance, tier type = 2024-09-12T00:49:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.233+0000 7fa202eb79c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 20 add_watcher() i=0 2024-09-12T00:49:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 20 add_watcher() i=1 2024-09-12T00:49:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 20 add_watcher() i=2 2024-09-12T00:49:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 20 add_watcher() i=3 2024-09-12T00:49:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 20 add_watcher() i=4 2024-09-12T00:49:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 20 add_watcher() i=5 2024-09-12T00:49:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 20 add_watcher() i=6 2024-09-12T00:49:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 20 add_watcher() i=7 2024-09-12T00:49:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.257+0000 7fa202eb79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.261+0000 7fa0b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 5 note: GC not initialized 2024-09-12T00:49:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa0b5fe3640 20 reqs_thread_entry: start 2024-09-12T00:49:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 20 Filter name: none 2024-09-12T00:49:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa0277fe640 20 reqs_thread_entry: start 2024-09-12T00:49:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:49:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:49:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T00:49:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:49:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.265+0000 7fa202eb79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.269+0000 7fa202eb79c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:49:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.269+0000 7fa202eb79c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:49:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.269+0000 7fa202eb79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:49:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.269+0000 7fa0d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301012 cookie 94530623462064 notifier 8558 bl.length()=659 2024-09-12T00:49:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.269+0000 7fa0d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:49:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.269+0000 7fa0d7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:49:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.273+0000 7fa0b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.277+0000 7fa202eb79c0 20 remove_watcher() i=0 2024-09-12T00:49:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.277+0000 7fa202eb79c0 2 removed watcher, disabling cache 2024-09-12T00:49:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.281+0000 7fa202eb79c0 20 remove_watcher() i=1 2024-09-12T00:49:11.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.281+0000 7fa202eb79c0 20 remove_watcher() i=2 2024-09-12T00:49:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.285+0000 7fa202eb79c0 20 remove_watcher() i=3 2024-09-12T00:49:11.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.285+0000 7fa202eb79c0 20 remove_watcher() i=4 2024-09-12T00:49:11.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.289+0000 7fa202eb79c0 20 remove_watcher() i=5 2024-09-12T00:49:11.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.289+0000 7fa202eb79c0 20 remove_watcher() i=6 2024-09-12T00:49:11.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.293+0000 7fa202eb79c0 20 remove_watcher() i=7 2024-09-12T00:49:11.309 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T00:49:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 20 realm 2024-09-12T00:49:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.433+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.437+0000 7fe358fb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.437+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.437+0000 7fe358fb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.437+0000 7fe358fb39c0 20 searching for the correct realm 2024-09-12T00:49:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.441+0000 7fe3562b8640 0 -- 172.21.15.137:0/1940611997 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fe34c0b8b00 msgr2=0x7fe34c12b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:11.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.681+0000 7fe3562b8640 0 -- 172.21.15.137:0/1940611997 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5574b845e5d0 msgr2=0x5574b8460a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:11.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:11.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:11.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:11.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:11.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:11.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:11.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:11.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:11.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 zone default found 2024-09-12T00:49:11.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 4 Realm: () 2024-09-12T00:49:11.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:11.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:11.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:11.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 zonegroup default 2024-09-12T00:49:11.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.709+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.713+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.713+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.713+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.713+0000 7fe358fb39c0 20 started sync module instance, tier type = 2024-09-12T00:49:11.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.713+0000 7fe358fb39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:11.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.733+0000 7fe358fb39c0 20 add_watcher() i=0 2024-09-12T00:49:11.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.733+0000 7fe358fb39c0 20 add_watcher() i=1 2024-09-12T00:49:11.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.733+0000 7fe358fb39c0 20 add_watcher() i=2 2024-09-12T00:49:11.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.733+0000 7fe358fb39c0 20 add_watcher() i=3 2024-09-12T00:49:11.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.733+0000 7fe358fb39c0 20 add_watcher() i=4 2024-09-12T00:49:11.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.733+0000 7fe358fb39c0 20 add_watcher() i=5 2024-09-12T00:49:11.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.733+0000 7fe358fb39c0 20 add_watcher() i=6 2024-09-12T00:49:11.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.737+0000 7fe358fb39c0 20 add_watcher() i=7 2024-09-12T00:49:11.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.737+0000 7fe358fb39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe20d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 5 note: GC not initialized 2024-09-12T00:49:11.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe187fff640 20 reqs_thread_entry: start 2024-09-12T00:49:11.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:11.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 20 Filter name: none 2024-09-12T00:49:11.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe185ffb640 20 reqs_thread_entry: start 2024-09-12T00:49:11.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T00:49:11.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.741+0000 7fe358fb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.745+0000 7fe358fb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.745+0000 7fe358fb39c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.745+0000 7fe358fb39c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:49:11.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.745+0000 7fe358fb39c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T00:49:11.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.745+0000 7fe358fb39c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:49:11.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.745+0000 7fe358fb39c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:49:11.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.745+0000 7fe358fb39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T00:49:11.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe23a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268309 cookie 93959796207296 notifier 9033 bl.length()=389 2024-09-12T00:49:11.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe23a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:49:11.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe23a7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:49:11.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe358fb39c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:49:11.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe358fb39c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:49:11.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe358fb39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T00:49:11.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe23a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268310 cookie 93959796216592 notifier 9033 bl.length()=230 2024-09-12T00:49:11.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe23a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:49:11.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.749+0000 7fe23a7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:49:11.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.753+0000 7fe358fb39c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:49:11.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.753+0000 7fe358fb39c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:49:11.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.753+0000 7fe358fb39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T00:49:11.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.753+0000 7fe239ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268140 cookie 93959796210560 notifier 9033 bl.length()=234 2024-09-12T00:49:11.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.753+0000 7fe239ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:49:11.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.753+0000 7fe239ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:49:11.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.757+0000 7fe20d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:11.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.761+0000 7fe358fb39c0 20 remove_watcher() i=0 2024-09-12T00:49:11.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.761+0000 7fe358fb39c0 2 removed watcher, disabling cache 2024-09-12T00:49:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.761+0000 7fe358fb39c0 20 remove_watcher() i=1 2024-09-12T00:49:11.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.765+0000 7fe358fb39c0 20 remove_watcher() i=2 2024-09-12T00:49:11.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.769+0000 7fe358fb39c0 20 remove_watcher() i=3 2024-09-12T00:49:11.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.769+0000 7fe358fb39c0 20 remove_watcher() i=4 2024-09-12T00:49:11.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.773+0000 7fe358fb39c0 20 remove_watcher() i=5 2024-09-12T00:49:11.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.773+0000 7fe358fb39c0 20 remove_watcher() i=6 2024-09-12T00:49:11.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.777+0000 7fe358fb39c0 20 remove_watcher() i=7 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "id": "RGW33333333333333333", 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "tenant": "testx", 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "quota": { 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_users": 1000, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_roles": 1000, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_groups": 1000, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max_access_keys": 4 2024-09-12T00:49:11.798 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:11.801 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T00:49:11.802 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key GWATQLZQOZLUMCCAYISB --secret DpRp0RaMGO07tt9SpY0UHOwLvoFn+9LVJEvnYLZe4wOv6e2Gre5qIg== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T00:49:11.891 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:11.892 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:11.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.933+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 realm 2024-09-12T00:49:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:11.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:11.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:11.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.937+0000 7f5d951539c0 20 searching for the correct realm 2024-09-12T00:49:11.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.941+0000 7f5d92458640 0 -- 172.21.15.137:0/458390475 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f5d88037b40 msgr2=0x7f5d88008940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:11.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.949+0000 7f5d92458640 0 -- 172.21.15.137:0/458390475 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5609b3a85aa0 msgr2=0x5609b3a87f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 zone default found 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 4 Realm: () 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 zonegroup default 2024-09-12T00:49:11.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.957+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.961+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.961+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.961+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.961+0000 7f5d951539c0 20 started sync module instance, tier type = 2024-09-12T00:49:11.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.961+0000 7f5d951539c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.977+0000 7f5d951539c0 20 add_watcher() i=0 2024-09-12T00:49:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.977+0000 7f5d951539c0 20 add_watcher() i=1 2024-09-12T00:49:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.977+0000 7f5d951539c0 20 add_watcher() i=2 2024-09-12T00:49:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.977+0000 7f5d951539c0 20 add_watcher() i=3 2024-09-12T00:49:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.977+0000 7f5d951539c0 20 add_watcher() i=4 2024-09-12T00:49:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.977+0000 7f5d951539c0 20 add_watcher() i=5 2024-09-12T00:49:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.977+0000 7f5d951539c0 20 add_watcher() i=6 2024-09-12T00:49:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.981+0000 7f5d951539c0 20 add_watcher() i=7 2024-09-12T00:49:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.981+0000 7f5d951539c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:11.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5c497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:11.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:11.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 5 note: GC not initialized 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5bc3fff640 20 reqs_thread_entry: start 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 Filter name: none 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5bc1ffb640 20 reqs_thread_entry: start 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T00:49:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:49:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T00:49:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T00:49:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:49:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache get: name=default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB : miss 2024-09-12T00:49:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache put: name=default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB info.flags=0x0 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 adding default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB to cache LRU end 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache get: name=default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB : hit (negative entry) 2024-09-12T00:49:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.985+0000 7f5d951539c0 10 cache get: name=default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB : hit (negative entry) 2024-09-12T00:49:11.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.989+0000 7f5d951539c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:49:11.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.989+0000 7f5d951539c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:49:11.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.989+0000 7f5d951539c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:49:11.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5c75ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268322 cookie 94599668909808 notifier 8594 bl.length()=732 2024-09-12T00:49:11.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5c75ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:49:11.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5c75ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:49:11.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5d951539c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:49:11.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5d951539c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:49:11.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5d951539c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T00:49:11.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5c75ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268323 cookie 94599668914576 notifier 8594 bl.length()=215 2024-09-12T00:49:11.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5c75ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:49:11.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.993+0000 7f5c75ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:49:11.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.997+0000 7f5d951539c0 10 cache put: name=default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB info.flags=0x7 2024-09-12T00:49:11.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.997+0000 7f5d951539c0 10 moving default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB to cache LRU end 2024-09-12T00:49:11.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.997+0000 7f5d951539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:GWATQLZQOZLUMCCAYISB, ofs0, ns] 2024-09-12T00:49:11.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.997+0000 7f5c767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268114 cookie 94599668857728 notifier 8594 bl.length()=201 2024-09-12T00:49:11.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.997+0000 7f5c767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB info.flags=0x7 2024-09-12T00:49:11.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:11.997+0000 7f5c767fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GWATQLZQOZLUMCCAYISB to cache LRU end 2024-09-12T00:49:12.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.001+0000 7f5d951539c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T00:49:12.000 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:12.000 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T00:49:12.000 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T00:49:12.000 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T00:49:12.000 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "GWATQLZQOZLUMCCAYISB", 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "DpRp0RaMGO07tt9SpY0UHOwLvoFn+9LVJEvnYLZe4wOv6e2Gre5qIg==", 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:11.990423Z" 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:49:12.001 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:12.002 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "root", 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "RGW33333333333333333", 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:11.990408Z", 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:49:12.003 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:12.004 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.001+0000 7f5c497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:12.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.005+0000 7f5d951539c0 20 remove_watcher() i=0 2024-09-12T00:49:12.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.005+0000 7f5d951539c0 2 removed watcher, disabling cache 2024-09-12T00:49:12.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.009+0000 7f5d951539c0 20 remove_watcher() i=1 2024-09-12T00:49:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.009+0000 7f5d951539c0 20 remove_watcher() i=2 2024-09-12T00:49:12.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.013+0000 7f5d951539c0 20 remove_watcher() i=3 2024-09-12T00:49:12.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.013+0000 7f5d951539c0 20 remove_watcher() i=4 2024-09-12T00:49:12.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.017+0000 7f5d951539c0 20 remove_watcher() i=5 2024-09-12T00:49:12.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.021+0000 7f5d951539c0 20 remove_watcher() i=6 2024-09-12T00:49:12.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.021+0000 7f5d951539c0 20 remove_watcher() i=7 2024-09-12T00:49:12.036 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 2586965679 --totp-seed M5JSYMMC37OGK5U4X524HTAC2IBOPUILZNXKZAZT4HNLKYNJPKNYTWRKETZQQBFP --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:49:12.077 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:12.077 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:12.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.117+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.121+0000 7f0bd980b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.121+0000 7f0bd980b9c0 20 realm 2024-09-12T00:49:12.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.121+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.121+0000 7f0bd980b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.121+0000 7f0bd980b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:12.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.121+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.121+0000 7f0bd980b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.121+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.125+0000 7f0bd980b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:12.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.125+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.125+0000 7f0bd980b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:12.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.125+0000 7f0bd980b9c0 20 searching for the correct realm 2024-09-12T00:49:12.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.133+0000 7f0bd7b12640 0 -- 172.21.15.137:0/2313551497 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55cc30872c10 msgr2=0x55cc308750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:12.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.137+0000 7f0bd7b12640 0 -- 172.21.15.137:0/2313551497 >> [v2:172.21.15.150:6800/1704738992,v1:172.21.15.150:6801/1704738992] conn(0x7f0bc803fb50 msgr2=0x7f0bc803f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:12.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.141+0000 7f0bd980b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:12.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.141+0000 7f0bd980b9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:12.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.141+0000 7f0bd980b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:12.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.141+0000 7f0bd980b9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:12.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.141+0000 7f0bd980b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:12.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.141+0000 7f0bd980b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:12.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.141+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 zone default found 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 4 Realm: () 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:12.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 zonegroup default 2024-09-12T00:49:12.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 started sync module instance, tier type = 2024-09-12T00:49:12.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.145+0000 7f0bd980b9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 20 add_watcher() i=0 2024-09-12T00:49:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 20 add_watcher() i=1 2024-09-12T00:49:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 20 add_watcher() i=2 2024-09-12T00:49:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 20 add_watcher() i=3 2024-09-12T00:49:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 20 add_watcher() i=4 2024-09-12T00:49:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 20 add_watcher() i=5 2024-09-12T00:49:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 20 add_watcher() i=6 2024-09-12T00:49:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 20 add_watcher() i=7 2024-09-12T00:49:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.165+0000 7f0bd980b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:12.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0a8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:12.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0bd980b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:12.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0bd980b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:12.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0bd980b9c0 5 note: GC not initialized 2024-09-12T00:49:12.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0a8cfe1640 20 reqs_thread_entry: start 2024-09-12T00:49:12.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0bd980b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:12.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0bd980b9c0 20 Filter name: none 2024-09-12T00:49:12.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0a067fc640 20 reqs_thread_entry: start 2024-09-12T00:49:12.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0bd980b9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:49:12.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.169+0000 7f0bd980b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.173+0000 7f0bd980b9c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T00:49:12.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.173+0000 7f0bd980b9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T00:49:12.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.173+0000 7f0bd980b9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:49:12.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.173+0000 7f0bd980b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:12.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.177+0000 7f0bd980b9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:49:12.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.177+0000 7f0bd980b9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:49:12.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.177+0000 7f0bd980b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:49:12.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.177+0000 7f0abaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268324 cookie 94335475920768 notifier 9069 bl.length()=746 2024-09-12T00:49:12.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.177+0000 7f0abaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:49:12.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.177+0000 7f0abaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:49:12.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.181+0000 7f0a8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:12.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.185+0000 7f0bd980b9c0 20 remove_watcher() i=0 2024-09-12T00:49:12.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.185+0000 7f0bd980b9c0 2 removed watcher, disabling cache 2024-09-12T00:49:12.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.185+0000 7f0bd980b9c0 20 remove_watcher() i=1 2024-09-12T00:49:12.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.189+0000 7f0bd980b9c0 20 remove_watcher() i=2 2024-09-12T00:49:12.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.189+0000 7f0bd980b9c0 20 remove_watcher() i=3 2024-09-12T00:49:12.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.193+0000 7f0bd980b9c0 20 remove_watcher() i=4 2024-09-12T00:49:12.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.193+0000 7f0bd980b9c0 20 remove_watcher() i=5 2024-09-12T00:49:12.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.197+0000 7f0bd980b9c0 20 remove_watcher() i=6 2024-09-12T00:49:12.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.201+0000 7f0bd980b9c0 20 remove_watcher() i=7 2024-09-12T00:49:12.213 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T00:49:12.214 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key FABKTYBYGEKZXSZZZYJH --secret Uq4zwlPxns4sNdBp0+z53FEGelSDJLwAijpN9cLeaLrMu9oxSPy0vw== --cluster ceph 2024-09-12T00:49:12.293 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:12.293 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:12.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.333+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.337+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.337+0000 7f17e83589c0 20 realm 2024-09-12T00:49:12.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.337+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.337+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.337+0000 7f17e83589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:12.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.337+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.337+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.337+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.341+0000 7f17e83589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:12.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.341+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.341+0000 7f17e83589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:12.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.341+0000 7f17e83589c0 20 searching for the correct realm 2024-09-12T00:49:12.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.345+0000 7f17e665f640 0 -- 172.21.15.137:0/2277175288 >> [v2:172.21.15.137:6808/3452645018,v1:172.21.15.137:6809/3452645018] conn(0x7f17dc036690 msgr2=0x7f17dc027450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:12.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.353+0000 7f17e5e5e640 0 -- 172.21.15.137:0/2277175288 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f17e0008040 msgr2=0x7f17e005fed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:12.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 zone default found 2024-09-12T00:49:12.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 4 Realm: () 2024-09-12T00:49:12.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:12.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:12.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:12.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 zonegroup default 2024-09-12T00:49:12.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 started sync module instance, tier type = 2024-09-12T00:49:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.361+0000 7f17e83589c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:12.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 20 add_watcher() i=0 2024-09-12T00:49:12.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 20 add_watcher() i=1 2024-09-12T00:49:12.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 20 add_watcher() i=2 2024-09-12T00:49:12.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 20 add_watcher() i=3 2024-09-12T00:49:12.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 20 add_watcher() i=4 2024-09-12T00:49:12.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 20 add_watcher() i=5 2024-09-12T00:49:12.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 20 add_watcher() i=6 2024-09-12T00:49:12.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 20 add_watcher() i=7 2024-09-12T00:49:12.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.381+0000 7f17e83589c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:12.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.385+0000 7f169bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:12.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.385+0000 7f17e83589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:12.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.385+0000 7f17e83589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:12.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.385+0000 7f17e83589c0 5 note: GC not initialized 2024-09-12T00:49:12.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.385+0000 7f169afe5640 20 reqs_thread_entry: start 2024-09-12T00:49:12.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.385+0000 7f17e83589c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:12.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 20 Filter name: none 2024-09-12T00:49:12.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f1698fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:12.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:49:12.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 cache get: name=default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH : miss 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 cache put: name=default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH info.flags=0x0 2024-09-12T00:49:12.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 adding default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH to cache LRU end 2024-09-12T00:49:12.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 cache get: name=default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH : hit (negative entry) 2024-09-12T00:49:12.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.389+0000 7f17e83589c0 10 cache get: name=default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH : hit (negative entry) 2024-09-12T00:49:12.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.393+0000 7f17e83589c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:49:12.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.393+0000 7f17e83589c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:12.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.393+0000 7f17e83589c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:49:12.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.393+0000 7f16c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268325 cookie 94437759466608 notifier 8627 bl.length()=660 2024-09-12T00:49:12.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.393+0000 7f16c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:49:12.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.393+0000 7f16c97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:12.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.393+0000 7f17e83589c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:49:12.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.393+0000 7f17e83589c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:49:12.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.397+0000 7f17e83589c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T00:49:12.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.397+0000 7f16c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268311 cookie 94437759456928 notifier 8627 bl.length()=191 2024-09-12T00:49:12.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.397+0000 7f16c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:49:12.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.397+0000 7f16c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:49:12.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.397+0000 7f17e83589c0 10 cache put: name=default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH info.flags=0x7 2024-09-12T00:49:12.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.397+0000 7f17e83589c0 10 moving default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH to cache LRU end 2024-09-12T00:49:12.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.397+0000 7f17e83589c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:FABKTYBYGEKZXSZZZYJH, ofs0, ns] 2024-09-12T00:49:12.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.401+0000 7f16c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268141 cookie 94437759461728 notifier 8627 bl.length()=189 2024-09-12T00:49:12.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.401+0000 7f16c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH info.flags=0x7 2024-09-12T00:49:12.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.401+0000 7f16c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FABKTYBYGEKZXSZZZYJH to cache LRU end 2024-09-12T00:49:12.399 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "foobar.client.0", 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "foobar+test@test.test", 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "foobar.client.0", 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "FABKTYBYGEKZXSZZZYJH", 2024-09-12T00:49:12.400 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "Uq4zwlPxns4sNdBp0+z53FEGelSDJLwAijpN9cLeaLrMu9oxSPy0vw==", 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:12.392235Z" 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:12.401 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "rgw", 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:49:12.402 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "", 2024-09-12T00:49:12.403 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:49:12.403 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:12.392215Z", 2024-09-12T00:49:12.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:49:12.403 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:49:12.403 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:12.403 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:12.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.401+0000 7f169bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:12.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.405+0000 7f17e83589c0 20 remove_watcher() i=0 2024-09-12T00:49:12.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.405+0000 7f17e83589c0 2 removed watcher, disabling cache 2024-09-12T00:49:12.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.409+0000 7f17e83589c0 20 remove_watcher() i=1 2024-09-12T00:49:12.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.409+0000 7f17e83589c0 20 remove_watcher() i=2 2024-09-12T00:49:12.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.413+0000 7f17e83589c0 20 remove_watcher() i=3 2024-09-12T00:49:12.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.413+0000 7f17e83589c0 20 remove_watcher() i=4 2024-09-12T00:49:12.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.417+0000 7f17e83589c0 20 remove_watcher() i=5 2024-09-12T00:49:12.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.421+0000 7f17e83589c0 20 remove_watcher() i=6 2024-09-12T00:49:12.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.421+0000 7f17e83589c0 20 remove_watcher() i=7 2024-09-12T00:49:12.436 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 0079840126 --totp-seed ECGJYVAOLELQB6GINGJFASL7XLODVGKE32YW7XU74Z3KWUYMVZGGRTWYE3MPZEN3 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:49:12.523 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:12.524 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:12.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.565+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 realm 2024-09-12T00:49:12.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:12.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:12.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.569+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.573+0000 7fad9fc279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:12.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.573+0000 7fad9fc279c0 20 searching for the correct realm 2024-09-12T00:49:12.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.577+0000 7fad9cf2c640 0 -- 172.21.15.137:0/3362724670 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fad88093260 msgr2=0x7fad88064210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:12.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.585+0000 7fad9d72d640 0 -- 172.21.15.137:0/3362724670 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fad980c7040 msgr2=0x7fad980d53f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:12.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:12.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:12.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:12.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:12.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:12.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:12.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:12.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:12.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 zone default found 2024-09-12T00:49:12.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 4 Realm: () 2024-09-12T00:49:12.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:12.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:12.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:12.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 zonegroup default 2024-09-12T00:49:12.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 started sync module instance, tier type = 2024-09-12T00:49:12.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.593+0000 7fad9fc279c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:12.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.613+0000 7fad9fc279c0 20 add_watcher() i=0 2024-09-12T00:49:12.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.613+0000 7fad9fc279c0 20 add_watcher() i=1 2024-09-12T00:49:12.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.613+0000 7fad9fc279c0 20 add_watcher() i=2 2024-09-12T00:49:12.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.613+0000 7fad9fc279c0 20 add_watcher() i=3 2024-09-12T00:49:12.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.613+0000 7fad9fc279c0 20 add_watcher() i=4 2024-09-12T00:49:12.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.613+0000 7fad9fc279c0 20 add_watcher() i=5 2024-09-12T00:49:12.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.613+0000 7fad9fc279c0 20 add_watcher() i=6 2024-09-12T00:49:12.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.617+0000 7fad9fc279c0 20 add_watcher() i=7 2024-09-12T00:49:12.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.617+0000 7fad9fc279c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:12.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.617+0000 7fac53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:12.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:12.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:12.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 5 note: GC not initialized 2024-09-12T00:49:12.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fac52fe5640 20 reqs_thread_entry: start 2024-09-12T00:49:12.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:12.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 20 Filter name: none 2024-09-12T00:49:12.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fac50fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:12.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:49:12.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T00:49:12.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:49:12.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:12.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.621+0000 7fad9fc279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:12.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.625+0000 7fad9fc279c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:49:12.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.625+0000 7fad9fc279c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:12.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.625+0000 7fad9fc279c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:49:12.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.625+0000 7fac80ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268326 cookie 94619426656400 notifier 9105 bl.length()=674 2024-09-12T00:49:12.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.625+0000 7fac80ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:49:12.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.625+0000 7fac80ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:12.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.629+0000 7fac53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:12.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.633+0000 7fad9fc279c0 20 remove_watcher() i=0 2024-09-12T00:49:12.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.633+0000 7fad9fc279c0 2 removed watcher, disabling cache 2024-09-12T00:49:12.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.633+0000 7fad9fc279c0 20 remove_watcher() i=1 2024-09-12T00:49:12.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.637+0000 7fad9fc279c0 20 remove_watcher() i=2 2024-09-12T00:49:12.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.637+0000 7fad9fc279c0 20 remove_watcher() i=3 2024-09-12T00:49:12.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.641+0000 7fad9fc279c0 20 remove_watcher() i=4 2024-09-12T00:49:12.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.641+0000 7fad9fc279c0 20 remove_watcher() i=5 2024-09-12T00:49:12.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.645+0000 7fad9fc279c0 20 remove_watcher() i=6 2024-09-12T00:49:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.649+0000 7fad9fc279c0 20 remove_watcher() i=7 2024-09-12T00:49:12.661 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T00:49:12.734 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:12.735 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:12.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.777+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 realm 2024-09-12T00:49:12.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:12.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:12.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:12.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:12.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:12.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.781+0000 7f17ac4d39c0 20 searching for the correct realm 2024-09-12T00:49:12.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:12.789+0000 7f17a97d8640 0 -- 172.21.15.137:0/4213845773 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f17a0029400 msgr2=0x7f17a0029880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:13.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.005+0000 7f17a97d8640 0 -- 172.21.15.137:0/4213845773 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55c08368ada0 msgr2=0x55c08368d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:13.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:13.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:13.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:13.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:13.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:13.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:13.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:13.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 zone default found 2024-09-12T00:49:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 4 Realm: () 2024-09-12T00:49:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 zonegroup default 2024-09-12T00:49:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.017+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.021+0000 7f17ac4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.021+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.021+0000 7f17ac4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.021+0000 7f17ac4d39c0 20 started sync module instance, tier type = 2024-09-12T00:49:13.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.021+0000 7f17ac4d39c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:13.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 20 add_watcher() i=0 2024-09-12T00:49:13.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 20 add_watcher() i=1 2024-09-12T00:49:13.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 20 add_watcher() i=2 2024-09-12T00:49:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 20 add_watcher() i=3 2024-09-12T00:49:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 20 add_watcher() i=4 2024-09-12T00:49:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 20 add_watcher() i=5 2024-09-12T00:49:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 20 add_watcher() i=6 2024-09-12T00:49:13.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 20 add_watcher() i=7 2024-09-12T00:49:13.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.045+0000 7f17ac4d39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:13.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f165b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:13.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f17ac4d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:13.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f17ac4d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:13.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f17ac4d39c0 5 note: GC not initialized 2024-09-12T00:49:13.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f165a7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:13.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f17ac4d39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:13.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f17ac4d39c0 20 Filter name: none 2024-09-12T00:49:13.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f15cbfff640 20 reqs_thread_entry: start 2024-09-12T00:49:13.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f17ac4d39c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:49:13.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.049+0000 7f17ac4d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.053+0000 7f17ac4d39c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:49:13.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.053+0000 7f17ac4d39c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:49:13.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.053+0000 7f17ac4d39c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:13.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.053+0000 7f17ac4d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:13.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.057+0000 7f17ac4d39c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:49:13.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.057+0000 7f17ac4d39c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:13.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.057+0000 7f17ac4d39c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:49:13.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.057+0000 7f168d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268327 cookie 94285326819392 notifier 9123 bl.length()=727 2024-09-12T00:49:13.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.057+0000 7f168d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:49:13.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.057+0000 7f168d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:49:13.056 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:13.056 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "foobar.client.0", 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "foobar+test@test.test", 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "foobar.client.0", 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "FABKTYBYGEKZXSZZZYJH", 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "Uq4zwlPxns4sNdBp0+z53FEGelSDJLwAijpN9cLeaLrMu9oxSPy0vw==", 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:12.392235Z" 2024-09-12T00:49:13.057 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [ 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "oidc-provider", 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: "perm": "*" 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "roles", 2024-09-12T00:49:13.058 INFO:teuthology.orchestra.run.smithi137.stdout: "perm": "*" 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "user-policy", 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "perm": "*" 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:13.059 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "rgw", 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [ 2024-09-12T00:49:13.060 INFO:teuthology.orchestra.run.smithi137.stdout: "0079840126" 2024-09-12T00:49:13.061 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:13.061 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "", 2024-09-12T00:49:13.061 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:49:13.061 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:12.392215Z", 2024-09-12T00:49:13.061 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:49:13.061 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:49:13.061 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:13.061 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:13.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.057+0000 7f165b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:13.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.061+0000 7f17ac4d39c0 20 remove_watcher() i=0 2024-09-12T00:49:13.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.061+0000 7f17ac4d39c0 2 removed watcher, disabling cache 2024-09-12T00:49:13.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.065+0000 7f17ac4d39c0 20 remove_watcher() i=1 2024-09-12T00:49:13.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.065+0000 7f17ac4d39c0 20 remove_watcher() i=2 2024-09-12T00:49:13.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.069+0000 7f17ac4d39c0 20 remove_watcher() i=3 2024-09-12T00:49:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.073+0000 7f17ac4d39c0 20 remove_watcher() i=4 2024-09-12T00:49:13.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.073+0000 7f17ac4d39c0 20 remove_watcher() i=5 2024-09-12T00:49:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.077+0000 7f17ac4d39c0 20 remove_watcher() i=6 2024-09-12T00:49:13.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.077+0000 7f17ac4d39c0 20 remove_watcher() i=7 2024-09-12T00:49:13.101 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T00:49:13.182 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:13.182 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:13.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 20 realm 2024-09-12T00:49:13.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:13.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.225+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.229+0000 7fc1340ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:13.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.229+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.229+0000 7fc1340ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:13.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.229+0000 7fc1340ef9c0 20 searching for the correct realm 2024-09-12T00:49:13.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.233+0000 7fc1313f4640 0 -- 172.21.15.137:0/42695168 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fc12800a440 msgr2=0x7fc12800a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:13.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.445+0000 7fc131bf5640 0 -- 172.21.15.137:0/42695168 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fc12c102bb0 msgr2=0x7fc12c001710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:13.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.664+0000 7fc1340ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 zone default found 2024-09-12T00:49:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 4 Realm: () 2024-09-12T00:49:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 zonegroup default 2024-09-12T00:49:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 started sync module instance, tier type = 2024-09-12T00:49:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.668+0000 7fc1340ef9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:13.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.692+0000 7fc1340ef9c0 20 add_watcher() i=0 2024-09-12T00:49:13.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.692+0000 7fc1340ef9c0 20 add_watcher() i=1 2024-09-12T00:49:13.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.692+0000 7fc1340ef9c0 20 add_watcher() i=2 2024-09-12T00:49:13.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.692+0000 7fc1340ef9c0 20 add_watcher() i=3 2024-09-12T00:49:13.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.692+0000 7fc1340ef9c0 20 add_watcher() i=4 2024-09-12T00:49:13.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.692+0000 7fc1340ef9c0 20 add_watcher() i=5 2024-09-12T00:49:13.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.692+0000 7fc1340ef9c0 20 add_watcher() i=6 2024-09-12T00:49:13.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.696+0000 7fc1340ef9c0 20 add_watcher() i=7 2024-09-12T00:49:13.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.696+0000 7fc1340ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:13.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fbfe37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:13.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:13.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:13.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 5 note: GC not initialized 2024-09-12T00:49:13.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fbfe27fc640 20 reqs_thread_entry: start 2024-09-12T00:49:13.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:13.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 20 Filter name: none 2024-09-12T00:49:13.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fbf53fff640 20 reqs_thread_entry: start 2024-09-12T00:49:13.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T00:49:13.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T00:49:13.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:49:13.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T00:49:13.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T00:49:13.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.700+0000 7fc1340ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc1340ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc1340ef9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T00:49:13.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc1340ef9c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:49:13.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc1340ef9c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T00:49:13.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc1340ef9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:49:13.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc1340ef9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:49:13.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc1340ef9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T00:49:13.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc0157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268312 cookie 94630962139232 notifier 8681 bl.length()=384 2024-09-12T00:49:13.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc0157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:49:13.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.704+0000 7fc0157fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:49:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.712+0000 7fc1340ef9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:49:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.712+0000 7fc1340ef9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:49:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.712+0000 7fc1340ef9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T00:49:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.712+0000 7fc0157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268313 cookie 94630962147744 notifier 8681 bl.length()=225 2024-09-12T00:49:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.712+0000 7fc0157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:49:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.712+0000 7fc0157fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:49:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.716+0000 7fc1340ef9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:49:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.716+0000 7fc1340ef9c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:49:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.716+0000 7fc1340ef9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T00:49:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.716+0000 7fc014ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268142 cookie 94630962110688 notifier 8681 bl.length()=234 2024-09-12T00:49:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.716+0000 7fc014ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:49:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.716+0000 7fc014ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:49:13.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.720+0000 7fbfe37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:13.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.724+0000 7fc1340ef9c0 20 remove_watcher() i=0 2024-09-12T00:49:13.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.724+0000 7fc1340ef9c0 2 removed watcher, disabling cache 2024-09-12T00:49:13.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.724+0000 7fc1340ef9c0 20 remove_watcher() i=1 2024-09-12T00:49:13.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.728+0000 7fc1340ef9c0 20 remove_watcher() i=2 2024-09-12T00:49:13.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.728+0000 7fc1340ef9c0 20 remove_watcher() i=3 2024-09-12T00:49:13.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.732+0000 7fc1340ef9c0 20 remove_watcher() i=4 2024-09-12T00:49:13.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.732+0000 7fc1340ef9c0 20 remove_watcher() i=5 2024-09-12T00:49:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.736+0000 7fc1340ef9c0 20 remove_watcher() i=6 2024-09-12T00:49:13.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.740+0000 7fc1340ef9c0 20 remove_watcher() i=7 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "id": "RGW88888888888888888", 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "tenant": "", 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "quota": { 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:13.753 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max_users": 1000, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max_roles": 1000, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max_groups": 1000, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:13.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max_access_keys": 4 2024-09-12T00:49:13.755 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:13.756 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T00:49:13.756 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key SJPDXDWMNHWLLQIQEYMS --secret URkqw2pZQ1KhUg//GK2dXaKuqZnl8leNxJTUCUV5SclNrimCKHs9Hg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T00:49:13.846 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:13.846 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:13.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.888+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 realm 2024-09-12T00:49:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:13.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:13.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:13.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:13.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.892+0000 7f69e24809c0 20 searching for the correct realm 2024-09-12T00:49:13.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:13.900+0000 7f69df785640 0 -- 172.21.15.137:0/1510092990 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f69d407a0b0 msgr2=0x7f69d404e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:14.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.116+0000 7f69df785640 0 -- 172.21.15.137:0/1510092990 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55c6ec156970 msgr2=0x55c6ec158e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.124+0000 7f69e24809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.124+0000 7f69e24809c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.124+0000 7f69e24809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.124+0000 7f69e24809c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.124+0000 7f69e24809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.124+0000 7f69e24809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.124+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:14.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 zone default found 2024-09-12T00:49:14.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 4 Realm: () 2024-09-12T00:49:14.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:14.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:14.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:14.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 zonegroup default 2024-09-12T00:49:14.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.128+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.132+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.132+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.132+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.132+0000 7f69e24809c0 20 started sync module instance, tier type = 2024-09-12T00:49:14.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.132+0000 7f69e24809c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:14.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 20 add_watcher() i=0 2024-09-12T00:49:14.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 20 add_watcher() i=1 2024-09-12T00:49:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 20 add_watcher() i=2 2024-09-12T00:49:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 20 add_watcher() i=3 2024-09-12T00:49:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 20 add_watcher() i=4 2024-09-12T00:49:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 20 add_watcher() i=5 2024-09-12T00:49:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 20 add_watcher() i=6 2024-09-12T00:49:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 20 add_watcher() i=7 2024-09-12T00:49:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.156+0000 7f69e24809c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:14.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.160+0000 7f6895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:14.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.160+0000 7f69e24809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:14.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.160+0000 7f69e24809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:14.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.160+0000 7f69e24809c0 5 note: GC not initialized 2024-09-12T00:49:14.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.160+0000 7f6894fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:14.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:14.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 Filter name: none 2024-09-12T00:49:14.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f680e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:14.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:49:14.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T00:49:14.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:49:14.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T00:49:14.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T00:49:14.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:49:14.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 cache get: name=default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS : miss 2024-09-12T00:49:14.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 cache put: name=default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS info.flags=0x0 2024-09-12T00:49:14.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 adding default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS to cache LRU end 2024-09-12T00:49:14.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T00:49:14.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.164+0000 7f69e24809c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.168+0000 7f69e24809c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:49:14.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.168+0000 7f69e24809c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:49:14.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.168+0000 7f69e24809c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:49:14.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.168+0000 7f69e24809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:14.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.168+0000 7f69e24809c0 10 cache get: name=default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS : hit (negative entry) 2024-09-12T00:49:14.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.168+0000 7f69e24809c0 10 cache get: name=default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS : hit (negative entry) 2024-09-12T00:49:14.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.172+0000 7f69e24809c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:49:14.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.172+0000 7f69e24809c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:49:14.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.172+0000 7f69e24809c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:49:14.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.172+0000 7f68beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268314 cookie 94312852718720 notifier 8699 bl.length()=681 2024-09-12T00:49:14.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.172+0000 7f68beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:49:14.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.172+0000 7f68beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:49:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.176+0000 7f69e24809c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:49:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.176+0000 7f69e24809c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:49:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.176+0000 7f69e24809c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T00:49:14.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.176+0000 7f68beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268328 cookie 94312852771552 notifier 8699 bl.length()=189 2024-09-12T00:49:14.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.176+0000 7f68beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:49:14.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.176+0000 7f68beffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:49:14.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.180+0000 7f69e24809c0 10 cache put: name=default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS info.flags=0x7 2024-09-12T00:49:14.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.180+0000 7f69e24809c0 10 moving default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS to cache LRU end 2024-09-12T00:49:14.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.180+0000 7f69e24809c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:SJPDXDWMNHWLLQIQEYMS, ofs0, ns] 2024-09-12T00:49:14.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.180+0000 7f68beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268329 cookie 94312852774048 notifier 8699 bl.length()=188 2024-09-12T00:49:14.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.180+0000 7f68beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS info.flags=0x7 2024-09-12T00:49:14.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.180+0000 7f68beffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SJPDXDWMNHWLLQIQEYMS to cache LRU end 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.184+0000 7f69e24809c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "root1.client.0", 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "root1+test@test.test", 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:49:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "root1.client.0", 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "SJPDXDWMNHWLLQIQEYMS", 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "URkqw2pZQ1KhUg//GK2dXaKuqZnl8leNxJTUCUV5SclNrimCKHs9Hg==", 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:14.170846Z" 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:49:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:14.185 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "root", 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "RGW88888888888888888", 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:14.170811Z", 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:14.186 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:14.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.184+0000 7f6895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:14.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.188+0000 7f69e24809c0 20 remove_watcher() i=0 2024-09-12T00:49:14.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.188+0000 7f69e24809c0 2 removed watcher, disabling cache 2024-09-12T00:49:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.192+0000 7f69e24809c0 20 remove_watcher() i=1 2024-09-12T00:49:14.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.192+0000 7f69e24809c0 20 remove_watcher() i=2 2024-09-12T00:49:14.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.196+0000 7f69e24809c0 20 remove_watcher() i=3 2024-09-12T00:49:14.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.196+0000 7f69e24809c0 20 remove_watcher() i=4 2024-09-12T00:49:14.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.200+0000 7f69e24809c0 20 remove_watcher() i=5 2024-09-12T00:49:14.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.204+0000 7f69e24809c0 20 remove_watcher() i=6 2024-09-12T00:49:14.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.204+0000 7f69e24809c0 20 remove_watcher() i=7 2024-09-12T00:49:14.220 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 1236483585 --totp-seed NL7772FC3KUMWMAJUVJVHFL7EOPUISYA3WQPMZP6DOGJONXEAKFDKG6JSWLWLCUQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:49:14.265 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:14.265 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:14.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.304+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 realm 2024-09-12T00:49:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:14.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:14.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.308+0000 7f0991dd89c0 20 searching for the correct realm 2024-09-12T00:49:14.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.316+0000 7f098f8de640 0 -- 172.21.15.137:0/2203581404 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7f09800e3420 msgr2=0x7f09800e3860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:14.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.320+0000 7f098f8de640 0 -- 172.21.15.137:0/2203581404 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f0988060740 msgr2=0x7f098805f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:14.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:14.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:14.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:14.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:14.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:14.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:14.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 zone default found 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 4 Realm: () 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:14.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 zonegroup default 2024-09-12T00:49:14.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.328+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.332+0000 7f0991dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.332+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.332+0000 7f0991dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.332+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.332+0000 7f0991dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.332+0000 7f0991dd89c0 20 started sync module instance, tier type = 2024-09-12T00:49:14.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.332+0000 7f0991dd89c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:14.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.348+0000 7f0991dd89c0 20 add_watcher() i=0 2024-09-12T00:49:14.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.348+0000 7f0991dd89c0 20 add_watcher() i=1 2024-09-12T00:49:14.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.348+0000 7f0991dd89c0 20 add_watcher() i=2 2024-09-12T00:49:14.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.348+0000 7f0991dd89c0 20 add_watcher() i=3 2024-09-12T00:49:14.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.348+0000 7f0991dd89c0 20 add_watcher() i=4 2024-09-12T00:49:14.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.348+0000 7f0991dd89c0 20 add_watcher() i=5 2024-09-12T00:49:14.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.348+0000 7f0991dd89c0 20 add_watcher() i=6 2024-09-12T00:49:14.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.352+0000 7f0991dd89c0 20 add_watcher() i=7 2024-09-12T00:49:14.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.352+0000 7f0991dd89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:14.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.352+0000 7f0845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 5 note: GC not initialized 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0844fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 20 Filter name: none 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f07be7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:49:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:49:14.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T00:49:14.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:49:14.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.356+0000 7f0991dd89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:14.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.364+0000 7f0991dd89c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:49:14.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.364+0000 7f0991dd89c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:49:14.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.364+0000 7f0991dd89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:49:14.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.364+0000 7f086effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268315 cookie 94690994430176 notifier 8714 bl.length()=695 2024-09-12T00:49:14.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.364+0000 7f086effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:49:14.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.364+0000 7f086effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:49:14.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.364+0000 7f0845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:14.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.368+0000 7f0991dd89c0 20 remove_watcher() i=0 2024-09-12T00:49:14.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.368+0000 7f0991dd89c0 2 removed watcher, disabling cache 2024-09-12T00:49:14.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.372+0000 7f0991dd89c0 20 remove_watcher() i=1 2024-09-12T00:49:14.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.372+0000 7f0991dd89c0 20 remove_watcher() i=2 2024-09-12T00:49:14.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.376+0000 7f0991dd89c0 20 remove_watcher() i=3 2024-09-12T00:49:14.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.376+0000 7f0991dd89c0 20 remove_watcher() i=4 2024-09-12T00:49:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.380+0000 7f0991dd89c0 20 remove_watcher() i=5 2024-09-12T00:49:14.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.380+0000 7f0991dd89c0 20 remove_watcher() i=6 2024-09-12T00:49:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.384+0000 7f0991dd89c0 20 remove_watcher() i=7 2024-09-12T00:49:14.398 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T00:49:14.477 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:14.478 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:14.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.520+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.520+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.520+0000 7f2000a009c0 20 realm 2024-09-12T00:49:14.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.520+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.520+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.520+0000 7f2000a009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:14.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.520+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.524+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.524+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.524+0000 7f2000a009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:14.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.524+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.524+0000 7f2000a009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:14.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.524+0000 7f2000a009c0 20 searching for the correct realm 2024-09-12T00:49:14.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.528+0000 7f1ffdd05640 0 -- 172.21.15.137:0/817211385 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f1ff40583c0 msgr2=0x7f1ff407e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:14.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.740+0000 7f1ffed07640 0 -- 172.21.15.137:0/817211385 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5634eaaf36f0 msgr2=0x5634eaaf5b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:14.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:14.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:14.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:14.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:14.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:14.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:14.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.752+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:14.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:14.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 zone default found 2024-09-12T00:49:14.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 4 Realm: () 2024-09-12T00:49:14.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:14.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:14.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:14.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 zonegroup default 2024-09-12T00:49:14.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 started sync module instance, tier type = 2024-09-12T00:49:14.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.756+0000 7f2000a009c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:14.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.780+0000 7f2000a009c0 20 add_watcher() i=0 2024-09-12T00:49:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.780+0000 7f2000a009c0 20 add_watcher() i=1 2024-09-12T00:49:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.780+0000 7f2000a009c0 20 add_watcher() i=2 2024-09-12T00:49:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.780+0000 7f2000a009c0 20 add_watcher() i=3 2024-09-12T00:49:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.780+0000 7f2000a009c0 20 add_watcher() i=4 2024-09-12T00:49:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.780+0000 7f2000a009c0 20 add_watcher() i=5 2024-09-12T00:49:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.780+0000 7f2000a009c0 20 add_watcher() i=6 2024-09-12T00:49:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.784+0000 7f2000a009c0 20 add_watcher() i=7 2024-09-12T00:49:14.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.784+0000 7f2000a009c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.788+0000 7f1eb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.788+0000 7f2000a009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.788+0000 7f2000a009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.788+0000 7f2000a009c0 5 note: GC not initialized 2024-09-12T00:49:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.788+0000 7f1e2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.788+0000 7f2000a009c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:14.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.788+0000 7f2000a009c0 20 Filter name: none 2024-09-12T00:49:14.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.788+0000 7f1e2d7fa640 20 reqs_thread_entry: start 2024-09-12T00:49:14.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T00:49:14.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T00:49:14.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:49:14.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T00:49:14.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T00:49:14.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T00:49:14.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:49:14.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T00:49:14.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:49:14.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:49:14.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f2000a009c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T00:49:14.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f1ee1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268316 cookie 94785275690320 notifier 9195 bl.length()=384 2024-09-12T00:49:14.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f1ee1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:49:14.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.792+0000 7f1ee1ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:49:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.796+0000 7f2000a009c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:49:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.796+0000 7f2000a009c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:49:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.796+0000 7f2000a009c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T00:49:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.800+0000 7f1ee1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268317 cookie 94785275691440 notifier 9195 bl.length()=225 2024-09-12T00:49:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.800+0000 7f1ee1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:49:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.800+0000 7f1ee1ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:49:14.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.800+0000 7f2000a009c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:49:14.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.800+0000 7f2000a009c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:49:14.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.800+0000 7f2000a009c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T00:49:14.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.804+0000 7f1ee1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268143 cookie 94785275697120 notifier 9195 bl.length()=234 2024-09-12T00:49:14.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.804+0000 7f1ee1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:49:14.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.804+0000 7f1ee1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:49:14.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.804+0000 7f1eb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:14.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.808+0000 7f2000a009c0 20 remove_watcher() i=0 2024-09-12T00:49:14.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.808+0000 7f2000a009c0 2 removed watcher, disabling cache 2024-09-12T00:49:14.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.812+0000 7f2000a009c0 20 remove_watcher() i=1 2024-09-12T00:49:14.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.812+0000 7f2000a009c0 20 remove_watcher() i=2 2024-09-12T00:49:14.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.816+0000 7f2000a009c0 20 remove_watcher() i=3 2024-09-12T00:49:14.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.816+0000 7f2000a009c0 20 remove_watcher() i=4 2024-09-12T00:49:14.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.820+0000 7f2000a009c0 20 remove_watcher() i=5 2024-09-12T00:49:14.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.824+0000 7f2000a009c0 20 remove_watcher() i=6 2024-09-12T00:49:14.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.824+0000 7f2000a009c0 20 remove_watcher() i=7 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "id": "RGW99999999999999999", 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "tenant": "", 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "quota": { 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:14.840 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max_users": 1000, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max_roles": 1000, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max_groups": 1000, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:14.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max_access_keys": 4 2024-09-12T00:49:14.842 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:14.843 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T00:49:14.843 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key RQHNICAIHDNZBRUZSQDO --secret KDqlOd5M9NRik3vZNE+NTkzWOQYnC6uV7gCZr7LdjqSJHPQz5kjW7Q== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T00:49:14.939 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:14.939 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:14.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.980+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 realm 2024-09-12T00:49:14.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:14.984+0000 7f2f031f99c0 20 searching for the correct realm 2024-09-12T00:49:15.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.192+0000 7f2f004fe640 0 -- 172.21.15.137:0/3933625410 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x56188e777e80 msgr2=0x56188e77a340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:15.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.204+0000 7f2f00cff640 0 -- 172.21.15.137:0/3933625410 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7f2ef8008040 msgr2=0x7f2ef805f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.420+0000 7f2f031f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.420+0000 7f2f031f99c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.420+0000 7f2f031f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.420+0000 7f2f031f99c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.420+0000 7f2f031f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.420+0000 7f2f031f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.420+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:15.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 zone default found 2024-09-12T00:49:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 4 Realm: () 2024-09-12T00:49:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 zonegroup default 2024-09-12T00:49:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.424+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.428+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.428+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.428+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.428+0000 7f2f031f99c0 20 started sync module instance, tier type = 2024-09-12T00:49:15.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.428+0000 7f2f031f99c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:15.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 20 add_watcher() i=0 2024-09-12T00:49:15.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 20 add_watcher() i=1 2024-09-12T00:49:15.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 20 add_watcher() i=2 2024-09-12T00:49:15.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 20 add_watcher() i=3 2024-09-12T00:49:15.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 20 add_watcher() i=4 2024-09-12T00:49:15.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 20 add_watcher() i=5 2024-09-12T00:49:15.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 20 add_watcher() i=6 2024-09-12T00:49:15.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 20 add_watcher() i=7 2024-09-12T00:49:15.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.452+0000 7f2f031f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:15.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2db6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:15.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:15.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:15.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 5 note: GC not initialized 2024-09-12T00:49:15.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2db5fe3640 20 reqs_thread_entry: start 2024-09-12T00:49:15.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:15.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 20 Filter name: none 2024-09-12T00:49:15.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2d277fe640 20 reqs_thread_entry: start 2024-09-12T00:49:15.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:49:15.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T00:49:15.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:49:15.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T00:49:15.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.460+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T00:49:15.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:49:15.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 cache get: name=default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO : miss 2024-09-12T00:49:15.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 cache put: name=default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO info.flags=0x0 2024-09-12T00:49:15.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 adding default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO to cache LRU end 2024-09-12T00:49:15.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T00:49:15.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:49:15.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:49:15.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:49:15.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:15.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 cache get: name=default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO : hit (negative entry) 2024-09-12T00:49:15.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.464+0000 7f2f031f99c0 10 cache get: name=default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO : hit (negative entry) 2024-09-12T00:49:15.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.468+0000 7f2f031f99c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:49:15.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.468+0000 7f2f031f99c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:49:15.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.468+0000 7f2f031f99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:49:15.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.468+0000 7f2dd7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268318 cookie 94663469405888 notifier 9213 bl.length()=681 2024-09-12T00:49:15.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.468+0000 7f2dd7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:49:15.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.468+0000 7f2dd7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:49:15.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.472+0000 7f2f031f99c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:49:15.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.472+0000 7f2f031f99c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:49:15.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.472+0000 7f2f031f99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T00:49:15.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.472+0000 7f2dd77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268330 cookie 94663469418080 notifier 9213 bl.length()=189 2024-09-12T00:49:15.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.472+0000 7f2dd77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:49:15.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.472+0000 7f2dd77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:49:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.476+0000 7f2f031f99c0 10 cache put: name=default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO info.flags=0x7 2024-09-12T00:49:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.476+0000 7f2f031f99c0 10 moving default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO to cache LRU end 2024-09-12T00:49:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.476+0000 7f2f031f99c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:RQHNICAIHDNZBRUZSQDO, ofs0, ns] 2024-09-12T00:49:15.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.480+0000 7f2dd77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268331 cookie 94663469428384 notifier 9213 bl.length()=188 2024-09-12T00:49:15.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.480+0000 7f2dd77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO info.flags=0x7 2024-09-12T00:49:15.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.480+0000 7f2dd77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RQHNICAIHDNZBRUZSQDO to cache LRU end 2024-09-12T00:49:15.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.480+0000 7f2f031f99c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "user_id": "root2.client.0", 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "email": "root2+test@test.test", 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "suspended": 0, 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "max_buckets": 1000, 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "subusers": [], 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "keys": [ 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "user": "root2.client.0", 2024-09-12T00:49:15.482 INFO:teuthology.orchestra.run.smithi137.stdout: "access_key": "RQHNICAIHDNZBRUZSQDO", 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "secret_key": "KDqlOd5M9NRik3vZNE+NTkzWOQYnC6uV7gCZr7LdjqSJHPQz5kjW7Q==", 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "active": true, 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:15.468856Z" 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "swift_keys": [], 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": [], 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "op_mask": "read, write, delete", 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "default_placement": "", 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "default_storage_class": "", 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "placement_tags": [], 2024-09-12T00:49:15.483 INFO:teuthology.orchestra.run.smithi137.stdout: "bucket_quota": { 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "user_quota": { 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": false, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "check_on_raw": false, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size": -1, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "max_size_kb": 0, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "max_objects": -1 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-12T00:49:15.484 INFO:teuthology.orchestra.run.smithi137.stdout: "temp_url_keys": [], 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "root", 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout: "mfa_ids": [], 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout: "account_id": "RGW99999999999999999", 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout: "create_date": "2024-09-12T00:49:15.468818Z", 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout: "group_ids": [] 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:49:15.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.484+0000 7f2db6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:15.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.488+0000 7f2f031f99c0 20 remove_watcher() i=0 2024-09-12T00:49:15.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.488+0000 7f2f031f99c0 2 removed watcher, disabling cache 2024-09-12T00:49:15.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.492+0000 7f2f031f99c0 20 remove_watcher() i=1 2024-09-12T00:49:15.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.492+0000 7f2f031f99c0 20 remove_watcher() i=2 2024-09-12T00:49:15.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.496+0000 7f2f031f99c0 20 remove_watcher() i=3 2024-09-12T00:49:15.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.496+0000 7f2f031f99c0 20 remove_watcher() i=4 2024-09-12T00:49:15.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.500+0000 7f2f031f99c0 20 remove_watcher() i=5 2024-09-12T00:49:15.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.504+0000 7f2f031f99c0 20 remove_watcher() i=6 2024-09-12T00:49:15.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.504+0000 7f2f031f99c0 20 remove_watcher() i=7 2024-09-12T00:49:15.525 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1771040338 --totp-seed LB2RWSMFPDYATH7DKKGBQB4PXEF35NSZSHCDCNOK34HTX74QWZYT4RVBFHRHDTE2 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:49:15.572 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:15.572 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:15.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 20 realm 2024-09-12T00:49:15.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:15.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.612+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.616+0000 7f7d1e2989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:15.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.616+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.616+0000 7f7d1e2989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:15.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.616+0000 7f7d1e2989c0 20 searching for the correct realm 2024-09-12T00:49:15.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.624+0000 7f7d1c59f640 0 -- 172.21.15.137:0/3872273714 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5630b8e651d0 msgr2=0x5630b8e67690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:15.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.628+0000 7f7d1bd9e640 0 -- 172.21.15.137:0/3872273714 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5630b8e69500 msgr2=0x5630b8e6b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:15.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:15.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T00:49:15.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:15.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T00:49:15.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:15.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:15.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:15.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 zone default found 2024-09-12T00:49:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 4 Realm: () 2024-09-12T00:49:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T00:49:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T00:49:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 zonegroup default 2024-09-12T00:49:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.636+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.640+0000 7f7d1e2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:15.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.640+0000 7f7d1e2989c0 20 started sync module instance, tier type = 2024-09-12T00:49:15.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.640+0000 7f7d1e2989c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T00:49:15.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.656+0000 7f7d1e2989c0 20 add_watcher() i=0 2024-09-12T00:49:15.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.656+0000 7f7d1e2989c0 20 add_watcher() i=1 2024-09-12T00:49:15.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.656+0000 7f7d1e2989c0 20 add_watcher() i=2 2024-09-12T00:49:15.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.656+0000 7f7d1e2989c0 20 add_watcher() i=3 2024-09-12T00:49:15.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.656+0000 7f7d1e2989c0 20 add_watcher() i=4 2024-09-12T00:49:15.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.656+0000 7f7d1e2989c0 20 add_watcher() i=5 2024-09-12T00:49:15.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.656+0000 7f7d1e2989c0 20 add_watcher() i=6 2024-09-12T00:49:15.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.660+0000 7f7d1e2989c0 20 add_watcher() i=7 2024-09-12T00:49:15.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.660+0000 7f7d1e2989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:15.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7bd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:15.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:15.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:15.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 5 note: GC not initialized 2024-09-12T00:49:15.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7bd0fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:15.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 20 init_complete bucket index max shards: 1 2024-09-12T00:49:15.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 20 Filter name: none 2024-09-12T00:49:15.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7b4a7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:15.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:49:15.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 20 rados->read ofs=0 len=0 2024-09-12T00:49:15.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:49:15.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T00:49:15.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:49:15.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.664+0000 7f7d1e2989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.668+0000 7f7d1e2989c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:49:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.668+0000 7f7d1e2989c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:49:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.668+0000 7f7d1e2989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:49:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.672+0000 7f7bfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268319 cookie 94767260523200 notifier 9234 bl.length()=695 2024-09-12T00:49:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.672+0000 7f7bfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:49:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.672+0000 7f7bfaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:49:15.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.672+0000 7f7bd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.676+0000 7f7d1e2989c0 20 remove_watcher() i=0 2024-09-12T00:49:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.676+0000 7f7d1e2989c0 2 removed watcher, disabling cache 2024-09-12T00:49:15.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.676+0000 7f7d1e2989c0 20 remove_watcher() i=1 2024-09-12T00:49:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.680+0000 7f7d1e2989c0 20 remove_watcher() i=2 2024-09-12T00:49:15.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.680+0000 7f7d1e2989c0 20 remove_watcher() i=3 2024-09-12T00:49:15.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.684+0000 7f7d1e2989c0 20 remove_watcher() i=4 2024-09-12T00:49:15.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.684+0000 7f7d1e2989c0 20 remove_watcher() i=5 2024-09-12T00:49:15.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.688+0000 7f7d1e2989c0 20 remove_watcher() i=6 2024-09-12T00:49:15.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T00:49:15.692+0000 7f7d1e2989c0 20 remove_watcher() i=7 2024-09-12T00:49:15.705 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T00:49:15.706 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:49:15.706 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T00:49:15.711 INFO:tasks.s3tests:Configuring boto... 2024-09-12T00:49:15.712 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T00:49:15.712 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:49:15.759 DEBUG:teuthology.orchestra.run.smithi137:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:49:15.932 INFO:teuthology.orchestra.run.smithi137.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T00:49:16.125 INFO:teuthology.orchestra.run.smithi137.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T00:49:16.425 INFO:teuthology.orchestra.run.smithi137.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:51:18.493 INFO:teuthology.orchestra.run.smithi137.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T00:51:20.361 INFO:teuthology.orchestra.run.smithi137.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=a3894c2fa4305a9139866b023ba32ccf8d3923d4252a11db9a42f1c2f90a01b5,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:51:20.361 INFO:teuthology.orchestra.run.smithi137.stdout:py run-test-pre: PYTHONHASHSEED='2020008050' 2024-09-12T00:51:20.361 INFO:teuthology.orchestra.run.smithi137.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:51:20.539 INFO:teuthology.orchestra.run.smithi137.stdout:============================= test session starts ============================== 2024-09-12T00:51:20.539 INFO:teuthology.orchestra.run.smithi137.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T00:51:20.540 INFO:teuthology.orchestra.run.smithi137.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:51:20.540 INFO:teuthology.orchestra.run.smithi137.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:51:20.540 INFO:teuthology.orchestra.run.smithi137.stdout:configfile: pytest.ini 2024-09-12T00:51:22.362 INFO:teuthology.orchestra.run.smithi137.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T00:51:22.363 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T00:51:22.725 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T00:51:22.935 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T00:51:23.153 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T00:51:23.365 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T00:51:23.577 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T00:51:23.732 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T00:51:23.958 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T00:51:24.119 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T00:51:24.218 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T00:51:24.314 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T00:51:24.519 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T00:51:24.731 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T00:51:24.933 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T00:51:25.144 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T00:51:25.246 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T00:51:25.346 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T00:51:25.402 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T00:51:25.458 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T00:51:25.514 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T00:51:25.570 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T00:51:25.626 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T00:51:25.682 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T00:51:25.738 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:51:25.794 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:51:25.850 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:51:25.907 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:51:25.961 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:51:26.017 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:51:26.074 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T00:51:26.130 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T00:51:26.186 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:51:26.242 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:51:26.298 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:51:26.354 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:51:26.410 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:51:26.465 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:51:26.522 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T00:51:26.583 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T00:51:26.642 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:51:26.698 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:51:26.753 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T00:51:26.810 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:51:26.866 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:51:26.922 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:51:26.978 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T00:51:27.033 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:51:27.085 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:51:27.142 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:51:27.197 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:51:27.249 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:51:27.305 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:51:27.362 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T00:51:27.418 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T00:51:27.921 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T00:51:28.847 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T00:51:30.577 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T00:51:32.266 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T00:51:35.171 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T00:51:36.171 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T00:51:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T00:51:37.894 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T00:51:38.074 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T00:51:38.374 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T00:51:38.684 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T00:51:39.095 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T00:51:39.345 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T00:51:39.611 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T00:51:39.613 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:51:39.615 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:51:39.617 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:51:39.623 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:51:39.625 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:51:39.628 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:51:39.630 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T00:51:39.632 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:51:39.634 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:51:39.636 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:51:39.639 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:51:39.641 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T00:51:39.643 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:51:39.645 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:51:39.647 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:51:39.649 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:51:39.651 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:51:39.652 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:51:39.654 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:51:39.656 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T00:51:39.658 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T00:51:39.659 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T00:51:39.661 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T00:51:39.663 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T00:51:39.664 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T00:51:39.666 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T00:51:39.667 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T00:51:39.769 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T00:51:39.778 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T00:51:40.561 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T00:51:45.786 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T00:51:46.273 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T00:51:46.877 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T00:51:47.506 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T00:51:48.153 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T00:51:48.741 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T00:51:49.250 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T00:51:50.018 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T00:51:50.670 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T00:51:51.278 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T00:51:51.833 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T00:51:52.317 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T00:51:52.833 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T00:51:53.181 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T00:51:53.702 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T00:51:54.321 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T00:51:54.973 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T00:51:55.542 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T00:51:56.102 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T00:51:56.686 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T00:51:57.238 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T00:51:57.765 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T00:51:58.278 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T00:51:58.790 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T00:51:59.202 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T00:51:59.642 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T00:52:00.037 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T00:52:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T00:52:00.858 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T00:52:01.502 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T00:52:01.889 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:52:02.337 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T00:52:02.854 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T00:52:03.354 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T00:52:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:52:04.349 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T00:52:05.490 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:52:06.134 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:52:06.618 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T00:52:07.161 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T00:52:07.713 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T00:52:08.469 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:52:09.098 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:52:09.722 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:52:10.438 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:52:11.218 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:52:11.994 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:52:12.766 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:52:13.530 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:52:14.237 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:52:14.861 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T00:52:15.630 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T00:52:16.241 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T00:52:17.470 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T00:52:18.366 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T00:52:19.442 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T00:52:21.418 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T00:52:24.058 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T00:52:25.638 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T00:52:27.026 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T00:52:28.110 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T00:52:28.874 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T00:52:30.122 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T00:52:31.082 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T00:52:32.286 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T00:52:33.170 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T00:52:34.750 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T00:52:35.958 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T00:52:37.614 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T00:52:39.246 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T00:52:40.398 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T00:52:41.482 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T00:52:42.398 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T00:52:44.410 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T00:52:45.922 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T00:52:47.618 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T00:52:49.182 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T00:52:50.674 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T00:52:52.158 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T00:52:53.358 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T00:52:54.466 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T00:52:55.482 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T00:52:57.350 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T00:52:59.678 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T00:53:00.710 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T00:53:02.246 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T00:53:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T00:53:05.198 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:53:06.763 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:53:08.435 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T00:53:10.005 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T00:53:11.495 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T00:53:12.506 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T00:53:13.582 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:53:14.450 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:53:15.358 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T00:53:16.767 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:53:18.202 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:53:19.638 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:53:21.062 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:53:22.515 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:53:23.982 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:53:25.403 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T00:53:26.871 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T00:53:28.278 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T00:53:29.686 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:53:31.167 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T00:53:32.783 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T00:53:33.779 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T00:53:34.743 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T00:53:35.663 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:53:36.583 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T00:53:37.386 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T00:53:38.134 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T00:53:38.822 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T00:53:39.550 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T00:53:40.206 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T00:53:40.890 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T00:53:41.550 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T00:53:42.318 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T00:53:42.986 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T00:53:44.186 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T00:53:45.354 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T00:53:45.990 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:53:46.690 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:53:47.350 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T00:53:48.062 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T00:53:49.226 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:53:50.422 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:53:51.098 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T00:53:51.810 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T00:53:52.494 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:53:53.194 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:53:53.878 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T00:53:54.586 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T00:53:55.302 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:53:56.053 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:53:56.730 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T00:53:57.426 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T00:53:58.146 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T00:53:58.846 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T00:53:59.538 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T00:54:00.181 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T00:54:01.606 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:54:02.298 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:54:26.274 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T00:54:26.974 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T00:54:27.622 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T00:54:28.310 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T00:54:28.974 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T00:54:29.634 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T00:54:30.302 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T00:54:31.042 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T00:54:31.718 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T00:54:32.418 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T00:54:33.098 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T00:54:33.770 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T00:54:34.422 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T00:54:35.118 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:54:35.886 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:54:36.582 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:54:37.290 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:54:37.955 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T00:54:38.646 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T00:54:39.334 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:54:40.114 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:54:40.810 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:54:41.478 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:54:42.198 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T00:54:42.930 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T00:54:43.654 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T00:54:44.350 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T00:54:45.110 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T00:54:45.770 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T00:54:46.198 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T00:54:46.862 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T00:54:48.270 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T00:54:49.730 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T00:54:50.422 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T00:54:51.094 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T00:54:51.798 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T00:54:52.522 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T00:54:53.254 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T00:54:53.990 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T00:54:54.758 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T00:54:55.446 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T00:54:56.114 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T00:54:56.778 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T00:54:57.470 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T00:54:58.166 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T00:54:59.122 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T00:55:00.194 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T00:55:00.782 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T00:55:01.386 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T00:55:01.910 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:55:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:55:02.910 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T00:55:03.302 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T00:55:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T00:55:04.378 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T00:55:04.918 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T00:55:05.346 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T00:55:05.926 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T00:55:06.422 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T00:55:06.986 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T00:55:07.542 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T00:55:08.554 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T00:55:09.398 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T00:55:10.238 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T00:55:33.634 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T00:55:57.186 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T00:55:57.766 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T00:55:58.374 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T00:55:58.986 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T00:55:59.558 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T00:56:00.326 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T00:56:00.890 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T00:56:01.466 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T00:56:02.134 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T00:56:02.790 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T00:56:03.470 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T00:56:04.128 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T00:56:04.779 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T00:56:05.446 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T00:56:05.978 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T00:56:06.570 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T00:56:07.162 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T00:56:07.838 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T00:56:08.510 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T00:56:09.142 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T00:56:09.770 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T00:56:10.426 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T00:56:11.094 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T00:56:11.622 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T00:56:12.146 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T00:56:12.714 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T00:56:13.246 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T00:56:13.794 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T00:56:14.345 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T00:56:15.006 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T00:56:15.585 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T00:56:16.142 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T00:56:16.750 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T00:56:17.282 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T00:56:17.982 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T00:56:18.521 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T00:56:19.106 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T00:56:20.214 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T00:56:20.770 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T00:56:21.394 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T00:56:21.938 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T00:56:22.618 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T00:56:23.170 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T00:56:23.814 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T00:56:24.446 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T00:56:25.061 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T00:56:25.706 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T00:56:26.346 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T00:56:28.038 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T00:56:28.678 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T00:56:29.302 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T00:56:30.033 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T00:56:30.806 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T00:56:31.570 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T00:56:32.201 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T00:56:32.958 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T00:56:33.790 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T00:56:34.397 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T00:56:35.150 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T00:56:35.738 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T00:56:36.266 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T00:56:36.866 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T00:56:37.522 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T00:56:38.081 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T00:56:38.561 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T00:56:39.282 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T00:56:39.874 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T00:56:40.490 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T00:56:43.430 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T00:56:44.014 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T00:56:44.654 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T00:56:45.278 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T00:56:45.961 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T00:56:46.537 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T00:56:47.153 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T00:56:47.830 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T00:56:48.498 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T00:56:49.157 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T00:56:49.774 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T00:56:50.374 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T00:56:51.022 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T00:56:51.702 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T00:56:52.318 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T00:56:52.977 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T00:56:53.710 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T00:56:54.398 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T00:56:54.806 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T00:56:55.225 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T00:56:56.165 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T00:56:56.634 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T00:56:57.118 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T00:56:57.606 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T00:56:58.166 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T00:56:58.562 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T00:56:58.966 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T00:56:59.462 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T00:56:59.858 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T00:57:00.249 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T00:57:00.645 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T00:57:01.074 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T00:57:01.577 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T00:57:02.114 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T00:57:02.742 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T00:57:03.286 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T00:57:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T00:57:04.382 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T00:57:04.946 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T00:57:05.538 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T00:57:06.082 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:57:06.622 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:57:07.293 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T00:57:07.938 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T00:57:08.709 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T00:57:09.318 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:57:09.954 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:57:10.626 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T00:57:11.298 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T00:57:11.938 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T00:57:12.606 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T00:57:13.149 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T00:57:13.909 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T00:57:14.654 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T00:57:15.357 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T00:57:16.093 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T00:57:16.806 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T00:57:17.786 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T00:57:18.718 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T00:57:19.698 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T00:57:20.669 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T00:57:21.614 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T00:57:22.258 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T00:57:22.893 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T00:57:23.562 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T00:57:24.301 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T00:57:24.926 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T00:57:25.621 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T00:57:26.666 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T00:57:27.693 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T00:57:28.673 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T00:57:29.745 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T00:57:30.693 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:57:31.670 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T00:57:32.713 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T00:57:33.722 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T00:57:34.777 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:57:35.650 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T00:57:36.538 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T00:57:37.429 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T00:57:38.458 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T00:57:39.409 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T00:57:39.829 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T00:57:40.221 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T00:57:40.626 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T00:57:41.306 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T00:57:41.949 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T00:57:42.433 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T00:57:42.897 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T00:57:43.713 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T00:57:45.354 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T00:57:46.137 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T00:57:46.841 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T00:57:47.773 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T00:57:48.473 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T00:57:49.154 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T00:57:49.846 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T00:57:51.474 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T00:57:52.225 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T00:57:53.177 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T00:57:53.945 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T00:57:54.949 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T00:57:55.870 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T00:57:56.401 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T00:57:56.937 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T00:57:58.720 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T00:57:59.493 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T00:58:02.313 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T00:58:02.973 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T00:58:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T00:58:04.989 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T00:58:05.737 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T00:58:06.941 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T00:58:09.973 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T00:58:14.205 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T00:58:18.377 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T00:58:36.377 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T00:58:38.829 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T00:58:43.189 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T00:58:44.177 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T00:58:45.429 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T00:58:46.557 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T00:58:47.473 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T00:58:48.109 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T00:58:49.345 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T00:58:50.101 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T00:58:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T00:58:51.501 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T00:59:07.853 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T00:59:10.397 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T00:59:11.157 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T00:59:11.678 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T00:59:12.365 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T00:59:17.777 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T00:59:21.537 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T00:59:25.169 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T00:59:25.825 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T00:59:26.509 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T00:59:27.201 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T00:59:27.873 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T00:59:28.569 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T00:59:29.261 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T00:59:29.913 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T00:59:30.737 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T00:59:31.733 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T00:59:32.921 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T00:59:33.885 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T00:59:35.125 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T00:59:36.585 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T00:59:37.685 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T00:59:38.821 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T00:59:40.033 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T00:59:40.941 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T00:59:41.665 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T00:59:42.701 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T00:59:43.445 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T00:59:48.085 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T00:59:48.749 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T00:59:49.421 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T00:59:50.077 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T00:59:50.749 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T00:59:51.649 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T01:00:00.121 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T01:00:01.173 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T01:00:02.009 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T01:00:03.021 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T01:00:04.145 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T01:00:07.953 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T01:00:08.973 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:00:13.465 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:00:29.441 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:00:33.841 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:00:35.569 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:00:37.421 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:00:38.309 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:00:39.261 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:00:40.045 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:00:41.065 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:00:41.985 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:00:42.917 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:00:43.486 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:00:44.078 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:00:44.665 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:00:45.225 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:00:45.829 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:00:46.473 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:00:47.041 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:00:47.597 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:00:48.241 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:00:48.817 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:00:49.337 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:00:49.854 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:00:50.417 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:00:51.057 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:00:51.665 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:00:52.342 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:00:52.970 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:00:53.601 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:00:54.221 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:00:54.853 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:00:56.129 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:00:56.697 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:00:57.233 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:00:57.773 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:01:03.081 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:01:08.337 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:01:10.158 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:01:10.809 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:02:11.794 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:03:13.022 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:03:13.690 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:03:14.326 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:03:14.862 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:03:15.414 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:03:19.346 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:03:20.918 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:03:22.546 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:03:23.194 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:03:23.874 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:03:24.534 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:03:25.202 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:03:25.858 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:03:26.502 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:03:27.130 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:03:27.854 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:03:28.522 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:03:29.222 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:03:29.886 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:03:30.506 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:03:31.502 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:03:32.534 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:03:33.434 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:03:34.230 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:03:35.110 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:03:35.966 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:03:36.846 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:03:37.714 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:03:38.638 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:03:39.630 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:03:40.562 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:03:41.198 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:03:41.834 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:03:42.546 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:03:43.626 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:03:44.542 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:03:45.510 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:03:46.766 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:03:51.246 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:03:52.042 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:03:52.958 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:03:53.842 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:03:55.042 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:03:56.098 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:03:56.732 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:03:57.682 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:03:58.250 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:03:58.794 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:03:59.334 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:03:59.918 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:04:00.651 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:04:01.234 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:04:02.166 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:04:02.706 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:04:03.246 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:04:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:04:04.302 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:04:04.842 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:04:05.458 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:04:06.086 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:04:06.627 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:04:07.186 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:04:07.714 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:04:08.362 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:04:08.986 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:04:09.650 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:04:10.294 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:04:10.882 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:04:11.514 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:04:12.198 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:04:12.838 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:04:13.590 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:04:14.230 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:04:14.862 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:04:15.498 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:04:16.258 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:04:17.002 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:04:17.726 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:04:18.310 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:04:18.906 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:04:19.606 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:04:20.274 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:04:20.902 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:04:21.570 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:04:22.346 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:04:22.946 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:04:23.550 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:04:24.158 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:04:34.578 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:04:35.254 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:04:45.374 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:04:46.078 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:04:46.810 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:04:47.366 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:04:47.958 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:04:48.588 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:04:49.230 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:04:49.862 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:04:50.486 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:04:51.134 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:04:51.744 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:04:52.406 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:04:53.010 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:04:53.734 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:04:54.426 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:04:55.006 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:04:55.546 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:04:56.402 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:04:58.298 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:04:58.794 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:04:59.414 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:05:00.036 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:05:00.710 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:05:01.478 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:05:02.106 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:05:03.102 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:05:04.354 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:05:05.050 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:05:12.358 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:05:19.606 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:05:20.154 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:05:21.026 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:05:23.062 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:05:24.982 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:05:26.823 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:05:27.874 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:05:29.010 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:05:30.038 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:05:30.626 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:05:31.934 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:05:33.390 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:05:36.006 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:05:37.450 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:05:38.414 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:05:39.170 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:05:39.846 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:05:40.854 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:05:42.074 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:05:43.062 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:05:43.894 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:05:45.070 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:05:46.135 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:05:47.078 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:05:47.974 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:05:48.350 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:05:49.678 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:05:51.042 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:05:51.990 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:05:52.826 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:05:53.582 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:06:04.134 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:06:04.494 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:06:05.422 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:06:06.186 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:06:06.794 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:06:07.642 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:06:07.686 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:06:07.686 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.686 INFO:teuthology.orchestra.run.smithi137.stdout:=============================== warnings summary =============================== 2024-09-12T01:06:07.686 INFO:teuthology.orchestra.run.smithi137.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T01:06:07.686 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T01:06:07.686 INFO:teuthology.orchestra.run.smithi137.stdout: import imp 2024-09-12T01:06:07.686 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.686 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: if boto_type is 'S3Connection': 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:06:07.687 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout: if k is 'BucketName': 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout: @pytest.mark.timeout(10) 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:06:07.688 INFO:teuthology.orchestra.run.smithi137.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:06:07.689 INFO:teuthology.orchestra.run.smithi137.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:06:07.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.692 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:06:07.692 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.692 INFO:teuthology.orchestra.run.smithi137.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:06:07.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.692 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:06:07.692 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.692 INFO:teuthology.orchestra.run.smithi137.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:06:07.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:06:07.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.695 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi137.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout: warnings.warn( 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout: s = ssl.wrap_socket(s); 2024-09-12T01:06:07.696 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.697 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:06:07.697 INFO:teuthology.orchestra.run.smithi137.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:06:07.697 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-12T01:06:07.697 INFO:teuthology.orchestra.run.smithi137.stdout: context = SSLContext(ssl_version) 2024-09-12T01:06:07.697 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:06:07.697 INFO:teuthology.orchestra.run.smithi137.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:06:07.697 INFO:teuthology.orchestra.run.smithi137.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 887.14s (0:14:47) = 2024-09-12T01:06:07.861 INFO:teuthology.orchestra.run.smithi137.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:06:07.861 INFO:teuthology.orchestra.run.smithi137.stdout: py: commands succeeded 2024-09-12T01:06:07.861 INFO:teuthology.orchestra.run.smithi137.stdout: congratulations :) 2024-09-12T01:06:07.900 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:06:07.900 DEBUG:teuthology.orchestra.run.smithi137:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:06:07.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:06:07.999 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:06:07.999 DEBUG:teuthology.orchestra.run.smithi137:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:06:08.004 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:06:08.004 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:06:08.201 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:06:08.222 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:06:08.223 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:06:08.223 DEBUG:teuthology.orchestra.run.smithi137:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:06:08.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:06:08.229 INFO:teuthology.orchestra.run.smithi137.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:06:08.229 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:06:08.276 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:06:08.276 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:06:08.324 INFO:tasks.workunit:timeout=3h 2024-09-12T01:06:08.324 INFO:tasks.workunit:cleanup=True 2024-09-12T01:06:08.324 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:06:08.374 INFO:tasks.workunit.client.0.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:06:53.567 INFO:tasks.workunit.client.0.smithi137.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:06:53.567 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:06:53.567 INFO:tasks.workunit.client.0.smithi137.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:06:53.567 INFO:tasks.workunit.client.0.smithi137.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr: git switch -c 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr:Or undo this operation with: 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr: git switch - 2024-09-12T01:06:53.568 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:06:53.569 INFO:tasks.workunit.client.0.smithi137.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:06:53.569 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:06:53.569 INFO:tasks.workunit.client.0.smithi137.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:06:53.573 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:06:53.620 INFO:tasks.workunit.client.0.smithi137.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:06:53.623 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:06:53.623 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:06:53.681 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:06:53.741 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:06:53.790 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:06:53.791 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:06:53.792 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:06:53.833 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:06:53.837 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T01:06:53.837 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:06:53.884 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:06:53.885 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:06:53.885 DEBUG:teuthology.orchestra.run.smithi137:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:06:53.937 INFO:tasks.workunit.client.0.smithi137.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:06:53.937 INFO:tasks.workunit.client.0.smithi137.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:06:53.937 INFO:tasks.workunit.client.0.smithi137.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ deactivate nondestructive 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ hash -r 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:06:56.802 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ export VIRTUAL_ENV 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ export PATH 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' ']' 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -z '' ']' 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ PS1='(rgw) ' 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ export PS1 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:06:56.803 INFO:tasks.workunit.client.0.smithi137.stderr:++ hash -r 2024-09-12T01:06:56.804 INFO:tasks.workunit.client.0.smithi137.stderr:+ pip install pip --upgrade 2024-09-12T01:06:57.160 INFO:tasks.workunit.client.0.smithi137.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T01:06:57.374 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting pip 2024-09-12T01:06:57.380 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:06:57.414 INFO:tasks.workunit.client.0.smithi137.stdout:Installing collected packages: pip 2024-09-12T01:06:57.414 INFO:tasks.workunit.client.0.smithi137.stdout: Attempting uninstall: pip 2024-09-12T01:06:57.415 INFO:tasks.workunit.client.0.smithi137.stdout: Found existing installation: pip 22.0.2 2024-09-12T01:06:57.675 INFO:tasks.workunit.client.0.smithi137.stdout: Uninstalling pip-22.0.2: 2024-09-12T01:06:57.681 INFO:tasks.workunit.client.0.smithi137.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T01:06:58.419 INFO:tasks.workunit.client.0.smithi137.stdout:Successfully installed pip-24.2 2024-09-12T01:06:58.481 INFO:tasks.workunit.client.0.smithi137.stderr:+ pip install boto3 2024-09-12T01:06:59.475 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting boto3 2024-09-12T01:06:59.476 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:07:00.029 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:07:00.030 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:07:00.077 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:07:00.078 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:07:00.150 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:07:00.151 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:07:00.202 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:07:00.203 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:07:00.316 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:07:00.318 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T01:07:00.481 INFO:tasks.workunit.client.0.smithi137.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:07:00.482 INFO:tasks.workunit.client.0.smithi137.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:07:00.486 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:07:00.487 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:07:00.497 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:07:00.498 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:07:00.499 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:07:00.501 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T01:07:00.502 INFO:tasks.workunit.client.0.smithi137.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:07:00.571 INFO:tasks.workunit.client.0.smithi137.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:07:01.713 INFO:tasks.workunit.client.0.smithi137.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T01:07:01.923 INFO:tasks.workunit.client.0.smithi137.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:07:02.063 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:07:02.101 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:07:02.102 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:07:02.142 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.140+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.144 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 realm 2024-09-12T01:07:02.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:07:02.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.145 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:02.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:07:02.146 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.144+0000 7fca65d299c0 20 searching for the correct realm 2024-09-12T01:07:02.153 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.152+0000 7fca6382f640 0 -- 172.21.15.137:0/1005519600 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fca540e5b00 msgr2=0x7fca54105400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:02.158 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.156+0000 7fca6382f640 0 -- 172.21.15.137:0/1005519600 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x55e435a89780 msgr2=0x55e435a8bbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:07:02.164 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:07:02.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T01:07:02.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:07:02.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T01:07:02.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:07:02.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:07:02.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.165 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:02.166 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 zone default found 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 4 Realm: () 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 zonegroup default 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.164+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.168+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.167 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.168+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.168+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.168+0000 7fca65d299c0 20 started sync module instance, tier type = 2024-09-12T01:07:02.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.168+0000 7fca65d299c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T01:07:02.185 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.184+0000 7fca65d299c0 20 add_watcher() i=0 2024-09-12T01:07:02.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.184+0000 7fca65d299c0 20 add_watcher() i=1 2024-09-12T01:07:02.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.184+0000 7fca65d299c0 20 add_watcher() i=2 2024-09-12T01:07:02.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.184+0000 7fca65d299c0 20 add_watcher() i=3 2024-09-12T01:07:02.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.184+0000 7fca65d299c0 20 add_watcher() i=4 2024-09-12T01:07:02.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.184+0000 7fca65d299c0 20 add_watcher() i=5 2024-09-12T01:07:02.186 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.184+0000 7fca65d299c0 20 add_watcher() i=6 2024-09-12T01:07:02.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.188+0000 7fca65d299c0 20 add_watcher() i=7 2024-09-12T01:07:02.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.188+0000 7fca65d299c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:07:02.191 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fc919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:02.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:07:02.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:07:02.192 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 5 note: GC not initialized 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fc918fe1640 20 reqs_thread_entry: start 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 20 init_complete bucket index max shards: 1 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 20 Filter name: none 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fc8927fc640 20 reqs_thread_entry: start 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:07:02.193 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:07:02.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:07:02.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:07:02.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:07:02.194 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:07:02.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:07:02.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.192+0000 7fca65d299c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:07:02.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.196+0000 7fc942ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269933 cookie 94438641195888 notifier 8780 bl.length()=613 2024-09-12T01:07:02.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.196+0000 7fc942ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:07:02.195 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.196+0000 7fc942ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:07:02.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.196+0000 7fca65d299c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:07:02.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.196+0000 7fca65d299c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:07:02.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.196+0000 7fca65d299c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:07:02.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.200+0000 7fc9427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269934 cookie 94438641188960 notifier 8780 bl.length()=191 2024-09-12T01:07:02.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.200+0000 7fc9427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:07:02.199 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.200+0000 7fc9427fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:07:02.201 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.200+0000 7fc919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:02.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.204+0000 7fca65d299c0 20 remove_watcher() i=0 2024-09-12T01:07:02.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.204+0000 7fca65d299c0 2 removed watcher, disabling cache 2024-09-12T01:07:02.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.204+0000 7fca65d299c0 20 remove_watcher() i=1 2024-09-12T01:07:02.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.208+0000 7fca65d299c0 20 remove_watcher() i=2 2024-09-12T01:07:02.210 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.208+0000 7fca65d299c0 20 remove_watcher() i=3 2024-09-12T01:07:02.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.212+0000 7fca65d299c0 20 remove_watcher() i=4 2024-09-12T01:07:02.214 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.212+0000 7fca65d299c0 20 remove_watcher() i=5 2024-09-12T01:07:02.216 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.216+0000 7fca65d299c0 20 remove_watcher() i=6 2024-09-12T01:07:02.219 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.220+0000 7fca65d299c0 20 remove_watcher() i=7 2024-09-12T01:07:02.363 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:02.364 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:02.413 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:02.413 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:02.462 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:02.462 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:02.486 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:02.486 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:02.494 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:07:02.494 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:07:02.497 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:02.497 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:02.518 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:02.518 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:02.535 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:02.535 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:02.561 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:07:02.594 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:07:02.594 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:07:02.646 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.644+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 realm 2024-09-12T01:07:02.649 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:07:02.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:02.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.648+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.652+0000 7f83cc7d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:07:02.651 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.652+0000 7f83cc7d99c0 20 searching for the correct realm 2024-09-12T01:07:02.657 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.656+0000 7f83c9ade640 0 -- 172.21.15.137:0/3985322314 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7f83c0069040 msgr2=0x7f83c00193c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:02.870 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.868+0000 7f83caae0640 0 -- 172.21.15.137:0/3985322314 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x55eca7e6a260 msgr2=0x55eca7e6c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:07:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T01:07:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:07:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T01:07:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:07:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:07:02.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.880+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:02.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:07:02.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 20 zone default found 2024-09-12T01:07:02.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 4 Realm: () 2024-09-12T01:07:02.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T01:07:02.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T01:07:02.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:07:02.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 20 zonegroup default 2024-09-12T01:07:02.886 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.884+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.888+0000 7f83cc7d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.887 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.888+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.888+0000 7f83cc7d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:02.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.888+0000 7f83cc7d99c0 20 started sync module instance, tier type = 2024-09-12T01:07:02.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.888+0000 7f83cc7d99c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T01:07:02.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 20 add_watcher() i=0 2024-09-12T01:07:02.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 20 add_watcher() i=1 2024-09-12T01:07:02.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 20 add_watcher() i=2 2024-09-12T01:07:02.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 20 add_watcher() i=3 2024-09-12T01:07:02.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 20 add_watcher() i=4 2024-09-12T01:07:02.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 20 add_watcher() i=5 2024-09-12T01:07:02.912 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 20 add_watcher() i=6 2024-09-12T01:07:02.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 20 add_watcher() i=7 2024-09-12T01:07:02.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.912+0000 7f83cc7d99c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:07:02.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.916+0000 7f8280fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:02.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f83cc7d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:07:02.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f83cc7d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:07:02.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f83cc7d99c0 5 note: GC not initialized 2024-09-12T01:07:02.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f81fb7fe640 20 reqs_thread_entry: start 2024-09-12T01:07:02.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f83cc7d99c0 20 init_complete bucket index max shards: 1 2024-09-12T01:07:02.921 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f83cc7d99c0 20 Filter name: none 2024-09-12T01:07:02.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f81f97fa640 20 reqs_thread_entry: start 2024-09-12T01:07:02.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f83cc7d99c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:07:02.925 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.920+0000 7f83cc7d99c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.924+0000 7f83cc7d99c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:07:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.924+0000 7f83cc7d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:07:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.924+0000 7f83cc7d99c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:07:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.924+0000 7f83cc7d99c0 20 INFO: main: starting shard=0 2024-09-12T01:07:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.924+0000 7f83cc7d99c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.782.0 2024-09-12T01:07:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.924+0000 7f83cc7d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:07:02.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.924+0000 7f83cc7d99c0 20 INFO: main: done 2024-09-12T01:07:02.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.924+0000 7f8280fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:02.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.928+0000 7f83cc7d99c0 20 remove_watcher() i=0 2024-09-12T01:07:02.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.928+0000 7f83cc7d99c0 2 removed watcher, disabling cache 2024-09-12T01:07:02.932 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.932+0000 7f83cc7d99c0 20 remove_watcher() i=1 2024-09-12T01:07:02.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.932+0000 7f83cc7d99c0 20 remove_watcher() i=2 2024-09-12T01:07:02.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.936+0000 7f83cc7d99c0 20 remove_watcher() i=3 2024-09-12T01:07:02.938 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.936+0000 7f83cc7d99c0 20 remove_watcher() i=4 2024-09-12T01:07:02.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.940+0000 7f83cc7d99c0 20 remove_watcher() i=5 2024-09-12T01:07:02.943 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.944+0000 7f83cc7d99c0 20 remove_watcher() i=6 2024-09-12T01:07:02.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:02.944+0000 7f83cc7d99c0 20 remove_watcher() i=7 2024-09-12T01:07:02.962 INFO:tasks.workunit.client.0.smithi137.stderr:rados -p default.rgw.buckets.data ls | grep 1129e11d-3ea3-4f4e-bdbf-e644ef91471e 2024-09-12T01:07:02.985 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:07:02.985 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:07:03.117 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:03.116+0000 7f0a9ec2e640 0 -- 172.21.15.137:0/229194327 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x562c5781a820 msgr2=0x562c578cf140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:03.176 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:07:03.176 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:07:03.177 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:07:04.621 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:04.621 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:04.640 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:07:05.091 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:07:05.121 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:07:05.121 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:07:05.163 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:05.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 20 realm 2024-09-12T01:07:05.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:05.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:07:05.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:05.169 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.164+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.168+0000 7fdf2250a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:05.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.168+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.168+0000 7fdf2250a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:07:05.170 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.168+0000 7fdf2250a9c0 20 searching for the correct realm 2024-09-12T01:07:05.172 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.172+0000 7fdf1f80f640 0 -- 172.21.15.137:0/911532803 >> [v2:172.21.15.150:6816/3675960294,v1:172.21.15.150:6817/3675960294] conn(0x56042edebe50 msgr2=0x56042edee2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:05.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.176+0000 7fdf20010640 0 -- 172.21.15.137:0/911532803 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fdf0c003cc0 msgr2=0x7fdf1805f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:05.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:07:05.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T01:07:05.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:07:05.396 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T01:07:05.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:07:05.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:07:05.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:05.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:05.397 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 zone default found 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 4 Realm: () 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 zonegroup default 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.396+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.400+0000 7fdf2250a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:05.399 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.400+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.400+0000 7fdf2250a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:05.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.400+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.400+0000 7fdf2250a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:05.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.400+0000 7fdf2250a9c0 20 started sync module instance, tier type = 2024-09-12T01:07:05.401 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.400+0000 7fdf2250a9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T01:07:05.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 20 add_watcher() i=0 2024-09-12T01:07:05.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 20 add_watcher() i=1 2024-09-12T01:07:05.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 20 add_watcher() i=2 2024-09-12T01:07:05.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 20 add_watcher() i=3 2024-09-12T01:07:05.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 20 add_watcher() i=4 2024-09-12T01:07:05.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 20 add_watcher() i=5 2024-09-12T01:07:05.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 20 add_watcher() i=6 2024-09-12T01:07:05.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 20 add_watcher() i=7 2024-09-12T01:07:05.426 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.424+0000 7fdf2250a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:07:05.431 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.428+0000 7fddd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:05.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdf2250a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:07:05.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdf2250a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:07:05.432 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdf2250a9c0 5 note: GC not initialized 2024-09-12T01:07:05.433 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fddd5fdb640 20 reqs_thread_entry: start 2024-09-12T01:07:05.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdf2250a9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:07:05.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdf2250a9c0 20 Filter name: none 2024-09-12T01:07:05.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdd477fe640 20 reqs_thread_entry: start 2024-09-12T01:07:05.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.434 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdf2250a9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:07:05.435 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.432+0000 7fdf2250a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:05.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.436+0000 7fdf2250a9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:07:05.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.436+0000 7fdf2250a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:07:05.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.436+0000 7fdf2250a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:07:05.436 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.436+0000 7fdf2250a9c0 20 INFO: main: starting shard=0 2024-09-12T01:07:05.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.436+0000 7fdf2250a9c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.782.0 2024-09-12T01:07:05.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.436+0000 7fdf2250a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:07:05.437 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.436+0000 7fdf2250a9c0 20 INFO: main: done 2024-09-12T01:07:05.438 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.436+0000 7fddd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:05.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.440+0000 7fdf2250a9c0 20 remove_watcher() i=0 2024-09-12T01:07:05.442 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.440+0000 7fdf2250a9c0 2 removed watcher, disabling cache 2024-09-12T01:07:05.444 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.444+0000 7fdf2250a9c0 20 remove_watcher() i=1 2024-09-12T01:07:05.446 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.444+0000 7fdf2250a9c0 20 remove_watcher() i=2 2024-09-12T01:07:05.448 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.448+0000 7fdf2250a9c0 20 remove_watcher() i=3 2024-09-12T01:07:05.450 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.448+0000 7fdf2250a9c0 20 remove_watcher() i=4 2024-09-12T01:07:05.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.452+0000 7fdf2250a9c0 20 remove_watcher() i=5 2024-09-12T01:07:05.455 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.456+0000 7fdf2250a9c0 20 remove_watcher() i=6 2024-09-12T01:07:05.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.456+0000 7fdf2250a9c0 20 remove_watcher() i=7 2024-09-12T01:07:05.475 INFO:tasks.workunit.client.0.smithi137.stderr:rados -p default.rgw.buckets.data ls | grep 6d5d5a58-db4a-454e-90ad-7e05a8a7750f 2024-09-12T01:07:05.505 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:07:05.505 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:07:05.652 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:05.652+0000 7f469ba78640 0 -- 172.21.15.137:0/1950220460 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x55f78a5db3a0 msgr2=0x55f78a5dd790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:05.682 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:07:05.682 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:07:05.684 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:05.685 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:05.697 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:05.698 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:05.718 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:05.718 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:05.726 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:07:07.171 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:07.171 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:07.244 INFO:tasks.workunit.client.0.smithi137.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:07:07.244 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:07:07.691 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:07.691 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:07.703 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:07.703 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:07.749 INFO:tasks.workunit.client.0.smithi137.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:07:07.749 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-12T01:07:07.753 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:07.753 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:07.806 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:07.806 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:07.861 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:07.862 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:07.881 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:07:09.317 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:09.318 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:09.328 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:09.328 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:11.354 INFO:tasks.workunit.client.0.smithi137.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:07:11.793 INFO:tasks.workunit.client.0.smithi137.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:07:11.825 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:07:11.825 INFO:tasks.workunit.client.0.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:07:11.864 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.864+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.864+0000 7f4a041039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:11.866 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.864+0000 7f4a041039c0 20 realm 2024-09-12T01:07:11.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.864+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:11.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:07:11.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.867 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:11.868 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:11.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:07:11.869 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.868+0000 7f4a041039c0 20 searching for the correct realm 2024-09-12T01:07:11.876 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.876+0000 7f4a01408640 0 -- 172.21.15.137:0/295262053 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x5600bdfbd0c0 msgr2=0x5600bdfbf500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:11.882 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.880+0000 7f4a01c09640 0 -- 172.21.15.137:0/295262053 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x5600bdfc1320 msgr2=0x5600bdfc3750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:11.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:07:11.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T01:07:11.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:07:11.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T01:07:11.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:07:11.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:07:11.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:11.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:11.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:07:11.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 zone default found 2024-09-12T01:07:11.890 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 4 Realm: () 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 zonegroup default 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:11.891 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.888+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.892+0000 7f4a041039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:11.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.892+0000 7f4a041039c0 20 started sync module instance, tier type = 2024-09-12T01:07:11.892 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.892+0000 7f4a041039c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T01:07:11.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.908+0000 7f4a041039c0 20 add_watcher() i=0 2024-09-12T01:07:11.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.908+0000 7f4a041039c0 20 add_watcher() i=1 2024-09-12T01:07:11.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.908+0000 7f4a041039c0 20 add_watcher() i=2 2024-09-12T01:07:11.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.908+0000 7f4a041039c0 20 add_watcher() i=3 2024-09-12T01:07:11.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.908+0000 7f4a041039c0 20 add_watcher() i=4 2024-09-12T01:07:11.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.908+0000 7f4a041039c0 20 add_watcher() i=5 2024-09-12T01:07:11.909 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.908+0000 7f4a041039c0 20 add_watcher() i=6 2024-09-12T01:07:11.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 20 add_watcher() i=7 2024-09-12T01:07:11.911 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:07:11.914 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f48b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 5 note: GC not initialized 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f48b27fc640 20 reqs_thread_entry: start 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 20 init_complete bucket index max shards: 1 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 20 Filter name: none 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4823fff640 20 reqs_thread_entry: start 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:07:11.915 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.912+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:07:11.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:07:11.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:07:11.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.782 : miss 2024-09-12T01:07:11.916 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:11.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:07:11.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.782 info.flags=0x17 2024-09-12T01:07:11.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.782 to cache LRU end 2024-09-12T01:07:11.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:07:11.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:07:11.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.782 2024-09-12T01:07:11.917 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 20 bucket index object: :.dir.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.782.0 2024-09-12T01:07:11.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:07:11.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f4a041039c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:07:11.918 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.916+0000 7f48b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:11.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.920+0000 7f4a041039c0 20 remove_watcher() i=0 2024-09-12T01:07:11.922 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.920+0000 7f4a041039c0 2 removed watcher, disabling cache 2024-09-12T01:07:11.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.924+0000 7f4a041039c0 20 remove_watcher() i=1 2024-09-12T01:07:11.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.924+0000 7f4a041039c0 20 remove_watcher() i=2 2024-09-12T01:07:11.927 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.928+0000 7f4a041039c0 20 remove_watcher() i=3 2024-09-12T01:07:11.929 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.928+0000 7f4a041039c0 20 remove_watcher() i=4 2024-09-12T01:07:11.931 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.932+0000 7f4a041039c0 20 remove_watcher() i=5 2024-09-12T01:07:11.934 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.932+0000 7f4a041039c0 20 remove_watcher() i=6 2024-09-12T01:07:11.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-12T01:07:11.936+0000 7f4a041039c0 20 remove_watcher() i=7 2024-09-12T01:07:11.947 INFO:tasks.workunit.client.0.smithi137.stderr:Deleting bucket versioning-bucket 2024-09-12T01:07:11.948 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:11.948 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:11.952 INFO:tasks.workunit.client.0.smithi137.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:07:11.952 INFO:tasks.workunit.client.0.smithi137.stderr: warnings.warn( 2024-09-12T01:07:11.974 INFO:tasks.workunit.client.0.smithi137.stderr:Completed bucket versioning tests 2024-09-12T01:07:11.974 INFO:tasks.workunit.client.0.smithi137.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:07:11.974 INFO:tasks.workunit.client.0.smithi137.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:07:11.974 INFO:tasks.workunit.client.0.smithi137.stdout:connected to https://localhost:443 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ deactivate 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ export PATH 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n '' ']' 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ hash -r 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n '' ']' 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:07:12.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:07:12.035 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:07:12.035 INFO:tasks.workunit.client.0.smithi137.stderr:+ unset -f deactivate 2024-09-12T01:07:12.035 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo OK. 2024-09-12T01:07:12.036 INFO:tasks.workunit.client.0.smithi137.stdout:OK. 2024-09-12T01:07:12.036 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:07:12.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:07:12.090 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:07:12.090 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:07:12.490 DEBUG:teuthology.parallel:result is None 2024-09-12T01:07:12.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:07:12.502 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:07:12.503 DEBUG:teuthology.orchestra.run.smithi137:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:07:12.551 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:07:12.551 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:07:12.562 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:07:12.602 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:07:12.603 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:07:12.603 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:07:12.654 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:07:12.655 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:07:12.689 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:07:12.689 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:07:12.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.728+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.728+0000 7f34a6b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:12.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.728+0000 7f34a6b349c0 20 realm 2024-09-12T01:07:12.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.728+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:12.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:07:12.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:12.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:12.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:07:12.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.732+0000 7f34a6b349c0 20 searching for the correct realm 2024-09-12T01:07:12.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.740+0000 7f34a3e39640 0 -- 172.21.15.137:0/3967205793 >> [v2:172.21.15.150:6808/2067574013,v1:172.21.15.150:6809/2067574013] conn(0x56293c24db30 msgr2=0x56293c24fff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:12.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.744+0000 7f34a463a640 0 -- 172.21.15.137:0/3967205793 >> [v2:172.21.15.137:6816/2821877990,v1:172.21.15.137:6817/2821877990] conn(0x56293c251fb0 msgr2=0x56293c2543a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:12.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:07:12.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T01:07:12.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:07:12.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T01:07:12.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:07:12.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:07:12.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:12.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:12.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:07:12.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 zone default found 2024-09-12T01:07:12.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 4 Realm: () 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 zonegroup default 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.752+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.756+0000 7f34a6b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:12.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.756+0000 7f34a6b349c0 20 started sync module instance, tier type = 2024-09-12T01:07:12.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.756+0000 7f34a6b349c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T01:07:12.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.772+0000 7f34a6b349c0 20 add_watcher() i=0 2024-09-12T01:07:12.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.772+0000 7f34a6b349c0 20 add_watcher() i=1 2024-09-12T01:07:12.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.772+0000 7f34a6b349c0 20 add_watcher() i=2 2024-09-12T01:07:12.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.772+0000 7f34a6b349c0 20 add_watcher() i=3 2024-09-12T01:07:12.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.772+0000 7f34a6b349c0 20 add_watcher() i=4 2024-09-12T01:07:12.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.772+0000 7f34a6b349c0 20 add_watcher() i=5 2024-09-12T01:07:12.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.772+0000 7f34a6b349c0 20 add_watcher() i=6 2024-09-12T01:07:12.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.776+0000 7f34a6b349c0 20 add_watcher() i=7 2024-09-12T01:07:12.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.776+0000 7f34a6b349c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:07:12.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.776+0000 7f335afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:12.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.776+0000 7f34a6b349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:07:12.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.776+0000 7f34a6b349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:07:12.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f3359fdb640 20 reqs_thread_entry: start 2024-09-12T01:07:12.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 20 init_complete bucket index max shards: 1 2024-09-12T01:07:12.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 20 Filter name: none 2024-09-12T01:07:12.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f32cb7fe640 20 reqs_thread_entry: start 2024-09-12T01:07:12.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:07:12.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:12.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:07:12.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:07:12.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:07:12.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:07:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.860+0000 7f34a6b349c0 10 removing key index: IPZDUKLJLLQWLWNFIASI 2024-09-12T01:07:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.864+0000 7f34a6b349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:IPZDUKLJLLQWLWNFIASI, ofs0, ns] 2024-09-12T01:07:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.864+0000 7f337affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268359 cookie 94735102700688 notifier 8888 bl.length()=170 2024-09-12T01:07:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.864+0000 7f34a6b349c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:07:12.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.868+0000 7f34a6b349c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:07:12.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.868+0000 7f337affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268249 cookie 94735102698336 notifier 8888 bl.length()=181 2024-09-12T01:07:12.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.868+0000 7f34a6b349c0 10 removing user buckets index 2024-09-12T01:07:12.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.872+0000 7f34a6b349c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:07:12.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.872+0000 7f337b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269937 cookie 94735102753616 notifier 8888 bl.length()=172 2024-09-12T01:07:12.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.872+0000 7f34a6b349c0 10 removing user index: tester.client.0 2024-09-12T01:07:12.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.876+0000 7f34a6b349c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:07:12.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.876+0000 7f34a6b349c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:07:12.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.876+0000 7f337b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269938 cookie 94735102747856 notifier 8888 bl.length()=164 2024-09-12T01:07:12.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.880+0000 7f335afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:12.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.884+0000 7f34a6b349c0 20 remove_watcher() i=0 2024-09-12T01:07:12.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.884+0000 7f34a6b349c0 2 removed watcher, disabling cache 2024-09-12T01:07:12.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.884+0000 7f34a6b349c0 20 remove_watcher() i=1 2024-09-12T01:07:12.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.888+0000 7f34a6b349c0 20 remove_watcher() i=2 2024-09-12T01:07:12.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.888+0000 7f34a6b349c0 20 remove_watcher() i=3 2024-09-12T01:07:12.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.892+0000 7f34a6b349c0 20 remove_watcher() i=4 2024-09-12T01:07:12.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.892+0000 7f34a6b349c0 20 remove_watcher() i=5 2024-09-12T01:07:12.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.896+0000 7f34a6b349c0 20 remove_watcher() i=6 2024-09-12T01:07:12.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:12.900+0000 7f34a6b349c0 20 remove_watcher() i=7 2024-09-12T01:07:12.917 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:07:12.927 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:07:12.939 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:07:13.009 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:07:13.019 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:07:13.019 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:07:13.020 INFO:tasks.rgw.client.0.smithi137.stdout:2024-09-12T01:07:13.020+0000 7f5bc1603640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 40109) UID: 0 2024-09-12T01:07:13.020 INFO:tasks.rgw.client.0.smithi137.stdout:2024-09-12T01:07:13.020+0000 7f5bc4e4ba40 -1 shutting down 2024-09-12T01:07:25.222 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:07:25.222 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:07:25.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:07:25.284 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:07:25.339 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:07:25.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:07:25.339 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:07:25.423 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:07:25.423 INFO:teuthology.orchestra.run.smithi137.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:07:25.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.464+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:25.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 realm 2024-09-12T01:07:25.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:25.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:07:25.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:25.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:07:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.468+0000 7fbe17aed9c0 20 searching for the correct realm 2024-09-12T01:07:25.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.476+0000 7fbe14df2640 0 -- 172.21.15.137:0/1809423053 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fbe08109090 msgr2=0x7fbe080fe710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:25.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.480+0000 7fbe155f3640 0 -- 172.21.15.137:0/1809423053 >> [v2:172.21.15.137:6824/2424472815,v1:172.21.15.137:6825/2424472815] conn(0x7fbe10025040 msgr2=0x7fbe10025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:25.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.488+0000 7fbe17aed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:07:25.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.488+0000 7fbe17aed9c0 20 RGWRados::pool_iterate: got zonegroup_info.068e54ae-8128-4287-aa02-334b3712b01c 2024-09-12T01:07:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.488+0000 7fbe17aed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:07:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.488+0000 7fbe17aed9c0 20 RGWRados::pool_iterate: got zone_info.68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 2024-09-12T01:07:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.488+0000 7fbe17aed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:07:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.488+0000 7fbe17aed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:07:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.488+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:07:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:07:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 zone default found 2024-09-12T01:07:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 4 Realm: () 2024-09-12T01:07:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 4 ZoneGroup: default (068e54ae-8128-4287-aa02-334b3712b01c) 2024-09-12T01:07:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 4 Zone: default (68f093c2-d97a-4f4c-96cb-d3cbe2b155a4) 2024-09-12T01:07:25.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:07:25.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 zonegroup default 2024-09-12T01:07:25.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:25.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:25.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados->read ofs=0 len=0 2024-09-12T01:07:25.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:07:25.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 started sync module instance, tier type = 2024-09-12T01:07:25.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.492+0000 7fbe17aed9c0 20 started zone id=68f093c2-d97a-4f4c-96cb-d3cbe2b155a4 (name=default) with tier type = 2024-09-12T01:07:25.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 20 add_watcher() i=0 2024-09-12T01:07:25.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 20 add_watcher() i=1 2024-09-12T01:07:25.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 20 add_watcher() i=2 2024-09-12T01:07:25.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 20 add_watcher() i=3 2024-09-12T01:07:25.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 20 add_watcher() i=4 2024-09-12T01:07:25.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 20 add_watcher() i=5 2024-09-12T01:07:25.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 20 add_watcher() i=6 2024-09-12T01:07:25.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 20 add_watcher() i=7 2024-09-12T01:07:25.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.512+0000 7fbe17aed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:07:25.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.516+0000 7fbccbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:25.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.516+0000 7fbe17aed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:07:25.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.516+0000 7fbe17aed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:07:25.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.592+0000 7fbccafe5640 20 reqs_thread_entry: start 2024-09-12T01:07:25.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.592+0000 7fbe17aed9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:07:25.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.592+0000 7fbe17aed9c0 20 Filter name: none 2024-09-12T01:07:25.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.592+0000 7fbcc8fe1640 20 reqs_thread_entry: start 2024-09-12T01:07:25.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:07:25.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:25.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52444' 2024-09-12T01:07:25.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3960472071098591027', time=2024-09-12T02:51:39.306537+0000, chain.objs.size()=1 2024-09-12T01:07:25.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.171__shadow_.2KTEJHAP1RvUFDMD1K6CDi5G0vM_VjS_0 2024-09-12T01:07:25.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13236683272850292174', time=2024-09-12T02:54:23.028020+0000, chain.objs.size()=1 2024-09-12T01:07:25.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dVyBOgX1oBKEkc_u6I-owKZZOWlYRu3_0 2024-09-12T01:07:25.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13075945299198907560', time=2024-09-12T02:54:23.114485+0000, chain.objs.size()=1 2024-09-12T01:07:25.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5KvwzsnTzBh9pPg2I4tviBYsFUZryA0_0 2024-09-12T01:07:25.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10083282584352115567', time=2024-09-12T02:54:23.120375+0000, chain.objs.size()=1 2024-09-12T01:07:25.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9fwpjOnLarijPYQ2sZ2jveTwCdqlcpX_0 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.962708187970441232', time=2024-09-12T02:54:23.122044+0000, chain.objs.size()=1 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gz-XAJ6fwU048I4Rxjp2Hb7hb6taPIh_0 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4875131302240521124', time=2024-09-12T02:54:23.219243+0000, chain.objs.size()=1 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.v9TJqXePZb_bmFF8hTdOOVl-suQX0FP_0 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2474598049810493002', time=2024-09-12T02:54:23.227955+0000, chain.objs.size()=1 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1S22-nXAbW-SvTgRryNsKv_qv0velyp_0 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9108307104988219890', time=2024-09-12T02:54:23.246539+0000, chain.objs.size()=1 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WljJp8FxZpwV14h8mVZg9M780lCz_Xf_0 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13926155956519418384', time=2024-09-12T02:54:23.464699+0000, chain.objs.size()=1 2024-09-12T01:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4nL70ON54DKlA3H1O3dp-G7GyivvBZ7_0 2024-09-12T01:07:25.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13608235797516919167', time=2024-09-12T02:54:23.533995+0000, chain.objs.size()=1 2024-09-12T01:07:25.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HPRuToZi1ZOKA-G8KwFBx1Jcxv32Mwt_0 2024-09-12T01:07:25.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7112504778185634428', time=2024-09-12T02:54:23.559558+0000, chain.objs.size()=1 2024-09-12T01:07:25.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FVQRFtK3rmT2L9_85-5_1K2oDAFGMhg_0 2024-09-12T01:07:25.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1688259663089817566', time=2024-09-12T02:54:23.609387+0000, chain.objs.size()=1 2024-09-12T01:07:25.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.n-Qsd9mfIUF2uzThjRbe4VZMMf7FBqp_0 2024-09-12T01:07:25.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12063699998863438493', time=2024-09-12T02:54:23.780608+0000, chain.objs.size()=1 2024-09-12T01:07:25.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hVrMveDlSj6m7Ffr7qlWk8lAxLJgadz_0 2024-09-12T01:07:25.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.857898940872753509', time=2024-09-12T02:54:24.334615+0000, chain.objs.size()=1 2024-09-12T01:07:25.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.C0TypPX-33YvGOPRPN2ph6k3qm5PqEr_0 2024-09-12T01:07:25.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1675535020672371359', time=2024-09-12T02:54:24.426582+0000, chain.objs.size()=1 2024-09-12T01:07:25.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NvJGirl2OG_Ft9cuKnWOlR8s6_LrWxA_0 2024-09-12T01:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3207167932223289567', time=2024-09-12T02:54:24.480554+0000, chain.objs.size()=1 2024-09-12T01:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gduT1C2CzQtXfNM5SqzyjCIw1J4fTnC_0 2024-09-12T01:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3423871161411076602', time=2024-09-12T02:54:24.855626+0000, chain.objs.size()=1 2024-09-12T01:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rclbrz_AP5YQRjff3c6EdfXgFBbxILg_0 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10137304403518446218', time=2024-09-12T02:54:24.897312+0000, chain.objs.size()=1 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LvwuTWHwe_q3Lzx2NBNtA7d_bjWpwjx_0 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9127648209186781965', time=2024-09-12T02:54:25.124734+0000, chain.objs.size()=1 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wU5HeTzvT77iBku4Y9_q3ZupkSYNT5J_0 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7042973603371757185', time=2024-09-12T02:54:25.287675+0000, chain.objs.size()=1 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uDCaoE7DY0p-tjNpg179cNVPW6DXP2h_0 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11047792924637808893', time=2024-09-12T02:54:25.311466+0000, chain.objs.size()=1 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.awfu5rZlkCyPmhbkd4xYId5pf04nIJ8_0 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5399753553185499729', time=2024-09-12T02:54:25.319675+0000, chain.objs.size()=1 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.SPkGOBsjruT3GiCxxTfSxo6FIuE_Iqt_0 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9759494655241515715', time=2024-09-12T02:54:25.595127+0000, chain.objs.size()=1 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Ebm7ib02yzD9AtXLZSXZBwK8fHZato8_0 2024-09-12T01:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3050965863931507742', time=2024-09-12T02:54:25.624581+0000, chain.objs.size()=1 2024-09-12T01:07:25.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.tDC064zGac7t0AM2b8uDJtwSNK71gvY_0 2024-09-12T01:07:25.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6270344973361398058', time=2024-09-12T02:54:25.707812+0000, chain.objs.size()=1 2024-09-12T01:07:25.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.axvrHJkiZTO51JP3RplCMEtLyCfOMdL_0 2024-09-12T01:07:25.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11612416099583152582', time=2024-09-12T02:54:25.740688+0000, chain.objs.size()=1 2024-09-12T01:07:25.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uixBNzD5IbdFWf8hRTHvhI97nvVgy5p_0 2024-09-12T01:07:25.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2239782595640951283', time=2024-09-12T02:54:25.885539+0000, chain.objs.size()=1 2024-09-12T01:07:25.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.A2xGCo6Xjz8Ae6gSkbOjzBu6SRIZY5v_0 2024-09-12T01:07:25.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.620+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.704077872905861275', time=2024-09-12T02:54:25.970608+0000, chain.objs.size()=1 2024-09-12T01:07:25.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.620+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Y4_KQRnRD1sibTZhWxFO1fJ0aTbaFtI_0 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15692456073841089556', time=2024-09-12T02:54:26.023650+0000, chain.objs.size()=1 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AYI0G8UC9noNVEbjF6JVKZsqZ_7tFvj_0 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8726010558244562155', time=2024-09-12T02:54:33.456971+0000, chain.objs.size()=1 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.273__shadow_.Qgt7yYCdzavMnqMhkjDEJ_CtCQZKIla_0 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6449490515584354799', time=2024-09-12T02:54:36.939193+0000, chain.objs.size()=1 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.278__shadow_.h7Scfdv_pyNiJAd-3Xk_0__gBKVCJvm_0 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18357045951923141901', time=2024-09-12T02:54:37.644308+0000, chain.objs.size()=1 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.279__shadow_.A2Sl8rg32hTj2REZDo9iyNFwFGQw3QR_0 2024-09-12T01:07:25.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8357342850394134883', time=2024-09-12T02:54:56.471863+0000, chain.objs.size()=1 2024-09-12T01:07:25.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.303__shadow_.q608mK80-j9FtORLZDKCTCoBvbMhlp-_0 2024-09-12T01:07:25.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7399271687137143657', time=2024-09-12T02:55:30.864772+0000, chain.objs.size()=1 2024-09-12T01:07:25.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.EntQULkTi293O9dXpKoLE0OYWKvw7-D_0 2024-09-12T01:07:25.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18016521001285960817', time=2024-09-12T02:55:30.909193+0000, chain.objs.size()=1 2024-09-12T01:07:25.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KJREbPrJ45uRrbpH-6ZVIJD_9FGaB5R_0 2024-09-12T01:07:25.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5345153178069593189', time=2024-09-12T02:55:30.923597+0000, chain.objs.size()=1 2024-09-12T01:07:25.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rexg1WI7fNPAiCwMg_e9GGO4Pdrv4Vf_0 2024-09-12T01:07:25.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14861178252965502813', time=2024-09-12T02:55:31.010949+0000, chain.objs.size()=1 2024-09-12T01:07:25.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rGO5GC2uF0r7weLhh97qSV8GlqZbZfE_0 2024-09-12T01:07:25.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6294065556839049143', time=2024-09-12T02:55:31.247492+0000, chain.objs.size()=1 2024-09-12T01:07:25.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-qj80LQ66Cqx95O8ORAIYEMNkvr1_vj_0 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17780899968156437508', time=2024-09-12T02:55:31.273960+0000, chain.objs.size()=1 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.y3BCpUdFiMz1AP7jkPxFDBnM3jYnoNj_0 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4522424644545422198', time=2024-09-12T02:55:31.290146+0000, chain.objs.size()=1 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.BXaR4os859u-AZmUGoIMKTZ1GwpU5p-_0 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8303315982454239229', time=2024-09-12T02:55:31.304613+0000, chain.objs.size()=1 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.00_9Kq1M9ir8PXYBvOOxskJriDsZC9s_0 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.881755847679161034', time=2024-09-12T02:55:31.429769+0000, chain.objs.size()=1 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qWO4OvvhMIMhpFQCHgb1gk0XoL2TodD_0 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17958702946783605944', time=2024-09-12T02:55:31.431702+0000, chain.objs.size()=1 2024-09-12T01:07:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xC5CJUHNo8uBGkhgNCko9Ahf7Ulh2S5_0 2024-09-12T01:07:25.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8778770111004542624', time=2024-09-12T02:55:31.567679+0000, chain.objs.size()=1 2024-09-12T01:07:25.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QnVAKiTpTcU9nkoiGwKO6Q2MTxf97tp_0 2024-09-12T01:07:25.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5072588982409902772', time=2024-09-12T02:55:31.588909+0000, chain.objs.size()=1 2024-09-12T01:07:25.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.x-0-LGzuCENTvVm_NoDhdt3-3hgpAmy_0 2024-09-12T01:07:25.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17833742465973914649', time=2024-09-12T02:55:31.635425+0000, chain.objs.size()=1 2024-09-12T01:07:25.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RZFDDWxPUJSK7M03KN3ThJcAClDGkzd_0 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7503876273146642768', time=2024-09-12T02:55:31.686646+0000, chain.objs.size()=1 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pZ3cWcb3nbXVh2Wt9cdlAXlIehfweoq_0 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1842757331139467404', time=2024-09-12T02:55:31.702780+0000, chain.objs.size()=1 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.wMhMRdqe2GQhSzUk15_z2-nhtBUU_vK_0 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17177100118539648707', time=2024-09-12T02:55:31.713132+0000, chain.objs.size()=1 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MsIuJWzT-k3ZKsEvmwIw-M1WiPYbixB_0 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12406450958275314799', time=2024-09-12T02:55:31.737428+0000, chain.objs.size()=1 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mS1WYY-ORGih7dLWd8wf_baGdhEFdxi_0 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13734378743616110358', time=2024-09-12T02:55:31.920313+0000, chain.objs.size()=1 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ayuD_oIvuIVP8CL1BDZh1Mjb-ZHA_1R_0 2024-09-12T01:07:25.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8820057269663813823', time=2024-09-12T02:55:32.040429+0000, chain.objs.size()=1 2024-09-12T01:07:25.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.105322D6OAa5yYXt7idI_FvhGE4jVw9_0 2024-09-12T01:07:25.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3625885511121941096', time=2024-09-12T02:55:32.066723+0000, chain.objs.size()=1 2024-09-12T01:07:25.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ov15zPH81_-7EiBrVbqTuT2WkCydU3-_0 2024-09-12T01:07:25.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15101435391678265438', time=2024-09-12T02:55:32.233666+0000, chain.objs.size()=1 2024-09-12T01:07:25.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qMrSxGijMKLB37P7Dv3sB6y__viGoof_0 2024-09-12T01:07:25.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5009665348660259635', time=2024-09-12T02:55:32.239108+0000, chain.objs.size()=1 2024-09-12T01:07:25.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.suHS2oUD0BsXhWQW0NWsgqfTGhz6GPn_0 2024-09-12T01:07:25.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5467010462741985581', time=2024-09-12T02:55:32.308626+0000, chain.objs.size()=1 2024-09-12T01:07:25.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Bq1BPG5-O0522qFXbYVGHEYrQtR3A2i_0 2024-09-12T01:07:25.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16989876362517162646', time=2024-09-12T02:55:32.325851+0000, chain.objs.size()=1 2024-09-12T01:07:25.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.slIwW6h8IcqFKUMCmt1l3K6uZVX4-eD_0 2024-09-12T01:07:25.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15589100978757728924', time=2024-09-12T02:55:32.350383+0000, chain.objs.size()=1 2024-09-12T01:07:25.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lc0cqr02aB8amsqmEnN_aGMDHaMRMJc_0 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8145847367787721199', time=2024-09-12T02:55:32.398848+0000, chain.objs.size()=1 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.nIDISCq8GRaDSkE-SgHghPf0oIS3pNW_0 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5280886639271572914', time=2024-09-12T02:55:32.568317+0000, chain.objs.size()=1 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KG-uEZd54C0P3Hgv6PpRGCkSSiqySFi_0 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3002779022541377223', time=2024-09-12T02:55:32.587829+0000, chain.objs.size()=1 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.49ClhzCo1rzA2i9OVTdSKt0xt-0nDRP_0 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12023565569054911305', time=2024-09-12T02:55:32.606420+0000, chain.objs.size()=1 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.M5DEUrDALeythy7dwdpcr-IDz0m4sBD_0 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10607508007278369308', time=2024-09-12T02:55:32.632011+0000, chain.objs.size()=1 2024-09-12T01:07:25.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YoVPwR0h8tGkrOWyuGqbTsQIL5XXHaA_0 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15699297048204564762', time=2024-09-12T02:55:32.637879+0000, chain.objs.size()=1 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TgpdURk3CPVXwcvmU4D-06T168fhgYF_0 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2077306078637732435', time=2024-09-12T02:55:32.873082+0000, chain.objs.size()=1 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rf_wICH0y05T2DsBEYryqUCyICVAw_u_0 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1275634025429087596', time=2024-09-12T02:55:32.883535+0000, chain.objs.size()=1 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0MlkM7uGfk7CAWJAtL-RtauC4WDGDPg_0 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14973433773199382840', time=2024-09-12T02:55:33.034272+0000, chain.objs.size()=1 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WaMImG_nTlZ9T24UNuBcCpi2D28BtNR_0 2024-09-12T01:07:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8825825883233514896', time=2024-09-12T02:55:33.193633+0000, chain.objs.size()=1 2024-09-12T01:07:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.AfWqRuRg7mc7RUa14AxEnaVGKOFMAVH_0 2024-09-12T01:07:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2825351764150981114', time=2024-09-12T02:55:33.198560+0000, chain.objs.size()=1 2024-09-12T01:07:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.i5bR5fTbnvxfIaymW77Od-0UdxNVqjt_0 2024-09-12T01:07:25.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15736372756610191483', time=2024-09-12T02:55:33.219296+0000, chain.objs.size()=1 2024-09-12T01:07:25.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.84Q0LAb3CV349sclaclyMCdYnb35sR1_0 2024-09-12T01:07:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11047144027310894989', time=2024-09-12T02:55:33.258570+0000, chain.objs.size()=1 2024-09-12T01:07:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rt8qu3vGde4j6D37VxnJWoaHySU94G6_0 2024-09-12T01:07:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14727999698094279667', time=2024-09-12T02:55:33.260584+0000, chain.objs.size()=1 2024-09-12T01:07:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.53y3KBJ9W-efEVcOSVkm34RNqZeq1pE_0 2024-09-12T01:07:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13947656737498666611', time=2024-09-12T02:55:54.536186+0000, chain.objs.size()=1 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hShqVRNKmCOxRHbTEotVNwX4SxbR0ho_0 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10323246604285530057', time=2024-09-12T02:55:54.577994+0000, chain.objs.size()=1 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uu5uxVdAirvVhoKjoYEHW_9pcyI6ZgG_0 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7978896696800425577', time=2024-09-12T02:55:54.634088+0000, chain.objs.size()=1 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._ZX2LsAc8oKXIXo16MxzIY9KAAeoYzZ_0 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2170093122126182051', time=2024-09-12T02:55:54.666962+0000, chain.objs.size()=1 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LXsdfbJ1QRmIXQQxpDnrjnm0Mey8wvX_0 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5685403935848918427', time=2024-09-12T02:55:54.829850+0000, chain.objs.size()=1 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eFD9wKTQOUxb3A9wTOiJffH3ywED1bJ_0 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12105571445150977832', time=2024-09-12T02:55:54.882177+0000, chain.objs.size()=1 2024-09-12T01:07:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JuRbbN_mrPy7i4ct4bqTBQaJ13LfucW_0 2024-09-12T01:07:25.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.884772205340625170', time=2024-09-12T02:55:54.912780+0000, chain.objs.size()=1 2024-09-12T01:07:25.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.yqsHCoy0mICnIPqihfQfKP34asIo2T5_0 2024-09-12T01:07:25.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17962355372604277762', time=2024-09-12T02:55:54.939595+0000, chain.objs.size()=1 2024-09-12T01:07:25.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8Q72hizLvbzeWhvpQX7FiLEcMprOAHs_0 2024-09-12T01:07:25.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9829141090699706374', time=2024-09-12T02:55:54.980877+0000, chain.objs.size()=1 2024-09-12T01:07:25.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.rcyj6zY3zG4LkezpvGXOdLGPXmT54wZ_0 2024-09-12T01:07:25.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17959878935211739592', time=2024-09-12T02:55:55.000984+0000, chain.objs.size()=1 2024-09-12T01:07:25.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uvoX1bEMM2A99mw1eiOVsTj6uzAJZvc_0 2024-09-12T01:07:25.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.934282312887456530', time=2024-09-12T02:55:55.207552+0000, chain.objs.size()=1 2024-09-12T01:07:25.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ht0dGITI94xXcpT5z82itGLiyUyDC3t_0 2024-09-12T01:07:25.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4978435301845586721', time=2024-09-12T02:55:55.260567+0000, chain.objs.size()=1 2024-09-12T01:07:25.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Kb-kCaT5h1S5HKBkDfXPpXHhD6uoU3A_0 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2470374161234241554', time=2024-09-12T02:55:55.484796+0000, chain.objs.size()=1 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WhuZjUX-khA71-nF2xaZclYYDrFqU8S_0 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3716374486457995075', time=2024-09-12T02:55:55.488636+0000, chain.objs.size()=1 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hFoN4qbDmuGxSr_tdc7eZPLeupS04A6_0 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3729565978293953470', time=2024-09-12T02:55:55.502518+0000, chain.objs.size()=1 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9xDKtqEj-eSYLl1dlYbiZ52jBTyOWo3_0 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7533759311039589667', time=2024-09-12T02:55:55.544827+0000, chain.objs.size()=1 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7eo0oBpUtx2KJoCtlVcI4GtMD6OZuRW_0 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5996409594367399011', time=2024-09-12T02:55:55.632790+0000, chain.objs.size()=1 2024-09-12T01:07:25.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vxIx-Din5gtMwrYflcGUOh_MToH0Asn_0 2024-09-12T01:07:25.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3792259629777566672', time=2024-09-12T02:55:55.817618+0000, chain.objs.size()=1 2024-09-12T01:07:25.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jd-eyBqrRMTXdbIvx84Q1N12FTdLz3z_0 2024-09-12T01:07:25.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14671235402736775041', time=2024-09-12T02:55:55.982917+0000, chain.objs.size()=1 2024-09-12T01:07:25.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7C5B6eXPhv_-qfZX_6BdnbLtQG-uZJ5_0 2024-09-12T01:07:25.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4459316662914375376', time=2024-09-12T02:55:56.166189+0000, chain.objs.size()=1 2024-09-12T01:07:25.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3rj5VRmyx7X3QCZ4HbZ--NAm6IvFEd4_0 2024-09-12T01:07:25.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10056079541124662608', time=2024-09-12T02:55:56.258226+0000, chain.objs.size()=1 2024-09-12T01:07:25.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3A9b23QyrZYyOK9WrfeZ3n2kqFPNNbe_0 2024-09-12T01:07:25.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4272681792318644134', time=2024-09-12T02:55:56.264657+0000, chain.objs.size()=1 2024-09-12T01:07:25.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Lcj1Cm_L9Hj5rnPhUMpzZ9U1lsYRXWB_0 2024-09-12T01:07:25.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8843417674365454136', time=2024-09-12T02:55:56.270933+0000, chain.objs.size()=1 2024-09-12T01:07:25.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RRyRtXprJrA0hn2536d-JtjI46yin6d_0 2024-09-12T01:07:25.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1129392416428999079', time=2024-09-12T02:55:56.292456+0000, chain.objs.size()=1 2024-09-12T01:07:25.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.KR0322bJS6VXCatH6LRwjuN-T6Y66jL_0 2024-09-12T01:07:25.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16633469394036307715', time=2024-09-12T02:55:56.325373+0000, chain.objs.size()=1 2024-09-12T01:07:25.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.F9WhpaVR4sTWrnhvxdx_R_a0nM4ObCl_0 2024-09-12T01:07:25.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11339560236854437064', time=2024-09-12T02:55:56.487066+0000, chain.objs.size()=1 2024-09-12T01:07:25.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uxplfaxr7rR7sx31YNqOZ0bONOKP5AP_0 2024-09-12T01:07:25.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4639590471810416006', time=2024-09-12T02:55:56.512070+0000, chain.objs.size()=1 2024-09-12T01:07:25.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.r01R6JxRxCIQ6h1hdHgVyioRodcT-QA_0 2024-09-12T01:07:25.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7796582414578860726', time=2024-09-12T02:55:56.767293+0000, chain.objs.size()=1 2024-09-12T01:07:25.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.A3bmr5NlbjqFt19lg_VlR8vuqcdZg24_0 2024-09-12T01:07:25.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52444 2024-09-12T01:07:25.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T01:07:25.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5582562237256388758', time=2024-09-12T02:55:56.845307+0000, chain.objs.size()=1 2024-09-12T01:07:25.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OhKvh4qOyel5nkUz5SM5kg0sSBa8qw7_0 2024-09-12T01:07:25.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6162597269181195580', time=2024-09-12T02:55:56.851446+0000, chain.objs.size()=1 2024-09-12T01:07:25.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pRQcljku4pgor7fx8KtXhqOe6P3tWeG_0 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.901088183633356704', time=2024-09-12T02:55:56.855353+0000, chain.objs.size()=1 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OetXYaL46xTT9azV24z4wSt3wedr-x6_0 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16274467935768012298', time=2024-09-12T02:55:56.874257+0000, chain.objs.size()=1 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GQaZlD5wGD9hvFt3JXKDdIgfFwa_Mkd_0 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.906668689048377695', time=2024-09-12T02:55:56.883242+0000, chain.objs.size()=1 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.P2YT5UalGqWmBQrorLgbRZ7r3MjZsfh_0 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3803422850385557985', time=2024-09-12T02:56:01.157255+0000, chain.objs.size()=1 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.331__shadow_.BRwobh2I3RTrmM8nxn4HkmTZR4dLXtH_0 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2762126782400253946', time=2024-09-12T02:56:38.964991+0000, chain.objs.size()=1 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.390__shadow_.IAFK4jyqQab8TNlKLiwJXbeBfdV5Ku-_0 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13761096161828590550', time=2024-09-12T02:57:45.050924+0000, chain.objs.size()=1 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.ZUJbQLWoNmpFrJGi6RKIn1b5Rw8Vuhi_0 2024-09-12T01:07:25.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tW6LpvQMN-ZzKrv8E9hwPMJme4GrN7C', time=2024-09-12T02:58:46.939489+0000, chain.objs.size()=2 2024-09-12T01:07:25.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.529__multipart_mymultipart.2~tW6LpvQMN-ZzKrv8E9hwPMJme4GrN7C.1 2024-09-12T01:07:25.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.529__multipart_mymultipart.2~tW6LpvQMN-ZzKrv8E9hwPMJme4GrN7C.2 2024-09-12T01:07:25.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~NEaIRUKr7zro9iHG1yQdFLkDi82btSq', time=2024-09-12T02:58:50.463221+0000, chain.objs.size()=1 2024-09-12T01:07:25.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.533__multipart_mymultipart.2~NEaIRUKr7zro9iHG1yQdFLkDi82btSq.1 2024-09-12T01:07:25.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17803535913580207853', time=2024-09-12T02:59:37.164514+0000, chain.objs.size()=1 2024-09-12T01:07:25.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.556__shadow_.DvPhyIh9w1kRr93DhfwZrE5MjYFwUDu_0 2024-09-12T01:07:25.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17829906323636972328', time=2024-09-12T02:59:53.321161+0000, chain.objs.size()=1 2024-09-12T01:07:25.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:jGvedF4g57QciOcZvkafUpAg7KC4Ogc_.ysoJ47GBhfggAzPTbuZa-dRIAIdQJ7d_0 2024-09-12T01:07:25.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4171740361042080029', time=2024-09-12T03:00:24.450858+0000, chain.objs.size()=1 2024-09-12T01:07:25.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:U5C02R6s-xFvq6uOIl-T8qONcml7MVH_.UTiQIp1-bC-XqkCEqx73qgaMUz95vuL_0 2024-09-12T01:07:25.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15221908702503634326', time=2024-09-12T03:00:35.211249+0000, chain.objs.size()=1 2024-09-12T01:07:25.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:XjeyBU6uQ9SApcwTj3IAGvVq3JRtl77_.KlL3NLV4tJM-nZHmHSQgdNR8qsz9P9j_0 2024-09-12T01:07:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13612324271157105794', time=2024-09-12T03:03:37.396646+0000, chain.objs.size()=1 2024-09-12T01:07:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.647__shadow_.MPLIWTuwmRamV0znJEIjyr3_673yFM-_0 2024-09-12T01:07:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9928292588938595955', time=2024-09-12T03:03:51.730196+0000, chain.objs.size()=1 2024-09-12T01:07:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.663__shadow_.pY5lQIh9ETWqM1wfcZxDWEIDR-T_kKG_0 2024-09-12T01:07:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.360197635348204524', time=2024-09-12T03:05:01.141178+0000, chain.objs.size()=1 2024-09-12T01:07:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.740__shadow_.oqYxpMmz03cF0lvxSACqNcnFpuxY2Gr_0 2024-09-12T01:07:25.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:25.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:07:25.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:25.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:25.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48617' 2024-09-12T01:07:25.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.641414368033607287', time=2024-09-12T02:51:30.536096+0000, chain.objs.size()=3 2024-09-12T01:07:25.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-STANDARD.2~ngJctbG4Or-ru05Xjc2O-wzGOndPg_b.1 2024-09-12T01:07:25.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-STANDARD.2~ngJctbG4Or-ru05Xjc2O-wzGOndPg_b.2 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-STANDARD.2~ngJctbG4Or-ru05Xjc2O-wzGOndPg_b.3 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11168769515079374661', time=2024-09-12T02:51:37.318774+0000, chain.objs.size()=3 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.164__multipart_foo.2~9oa3XF9XMLqURIU0D9LIE1Ks2bR5He4.1 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.164__shadow_foo.2~9oa3XF9XMLqURIU0D9LIE1Ks2bR5He4.1_1 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.164__multipart_foo.2~9oa3XF9XMLqURIU0D9LIE1Ks2bR5He4.2 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2534891860947742444', time=2024-09-12T02:52:13.849818+0000, chain.objs.size()=1 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.204__shadow_.E-G3jnu5O6tumcNgpX2WG1PIe6TDd0V_0 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15724117239961720838', time=2024-09-12T02:53:52.185672+0000, chain.objs.size()=1 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.247__shadow_.iXAi1cLUsFlY4QaNIDZaYS08sAH6vFo_0 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6565522110420006284', time=2024-09-12T02:53:57.795507+0000, chain.objs.size()=1 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.255__shadow_.emy5vxjcVTZfJznGpWpkYrry4sPud9w_0 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11477208970686381675', time=2024-09-12T02:53:59.864641+0000, chain.objs.size()=1 2024-09-12T01:07:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.258__shadow_.X1innP9Zy_kpkcgPBxE0F3nZmszR0Fw_0 2024-09-12T01:07:25.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2403482880809899382', time=2024-09-12T02:54:22.999270+0000, chain.objs.size()=1 2024-09-12T01:07:25.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ECK0n-YP6V8DgvEMoYt4_HZmjWyK6H6_0 2024-09-12T01:07:25.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14232795007876525240', time=2024-09-12T02:54:23.070714+0000, chain.objs.size()=1 2024-09-12T01:07:25.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.clyCP0Q7fWJaPT8PU2w1uKvCssUXTSi_0 2024-09-12T01:07:25.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.461379204420440801', time=2024-09-12T02:54:23.085099+0000, chain.objs.size()=1 2024-09-12T01:07:25.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XMSA_6_mjrl3m_s8XVS_MysrTPHI0NS_0 2024-09-12T01:07:25.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5614428519735304688', time=2024-09-12T02:54:23.098802+0000, chain.objs.size()=1 2024-09-12T01:07:25.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.s1-p9PbWYlHOk4SKAuKTW4-1GE2HLUs_0 2024-09-12T01:07:25.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5080400332770639141', time=2024-09-12T02:54:23.183636+0000, chain.objs.size()=1 2024-09-12T01:07:25.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dOdNfdl3_nTJ8hlhbaXaEWxWsYySdtq_0 2024-09-12T01:07:25.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4373059148241186929', time=2024-09-12T02:54:23.187440+0000, chain.objs.size()=1 2024-09-12T01:07:25.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zCwkZXZIHdfNwnPUijQD727iZEyzN3h_0 2024-09-12T01:07:25.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7261719820608115711', time=2024-09-12T02:54:23.556760+0000, chain.objs.size()=1 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nCJEld2B8FTlFoBz0edbh1PCFygTfo1_0 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9522945837491232398', time=2024-09-12T02:54:24.050019+0000, chain.objs.size()=1 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.q8IHgJBIFYEDfZvJjvjrUgH3Yum85AK_0 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12202151320187233665', time=2024-09-12T02:54:24.375910+0000, chain.objs.size()=1 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.QaUqSS2d_7e5jsPmdsZkW6Vdz0cCAOP_0 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13447889272395624652', time=2024-09-12T02:54:24.432107+0000, chain.objs.size()=1 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Yw5lHTtKiLf1Zl0Td_LXK4kcOv0XBjt_0 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16454961502680409323', time=2024-09-12T02:54:24.458546+0000, chain.objs.size()=1 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VQLb1e7bw3NooLCaeXkmh0wwWNzVHDh_0 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16421291616175918265', time=2024-09-12T02:54:24.855195+0000, chain.objs.size()=1 2024-09-12T01:07:25.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.P7FilfUmilo9dPXmN4DittdWOZXD45z_0 2024-09-12T01:07:25.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2396034183145695641', time=2024-09-12T02:54:24.884038+0000, chain.objs.size()=1 2024-09-12T01:07:25.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vjMyL72fhXXAz9iuCMZxRUEGZIxwjHO_0 2024-09-12T01:07:25.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1808346645026176307', time=2024-09-12T02:54:24.949252+0000, chain.objs.size()=1 2024-09-12T01:07:25.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6OA0tPn8esm62X0FrV43t1LSq9sT6Sj_0 2024-09-12T01:07:25.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.202726080753549531', time=2024-09-12T02:54:24.988708+0000, chain.objs.size()=1 2024-09-12T01:07:25.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FGAiCynRjNWE9foMwxYK9az5dok632r_0 2024-09-12T01:07:25.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14819644926329304224', time=2024-09-12T02:54:25.000789+0000, chain.objs.size()=1 2024-09-12T01:07:25.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2KoIIRKc3AMQhQINcsdKhAAcTFz0_C-_0 2024-09-12T01:07:25.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15391140792072313476', time=2024-09-12T02:54:25.182356+0000, chain.objs.size()=1 2024-09-12T01:07:25.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uB6kHLKZ1O7xXRlDDKEXHWVQ459eZaf_0 2024-09-12T01:07:25.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13085318159416617396', time=2024-09-12T02:54:25.282711+0000, chain.objs.size()=1 2024-09-12T01:07:25.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Jj99yw_1WKCk_lzGEe2kydbX7LPB1lS_0 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9691220040925301839', time=2024-09-12T02:54:25.338712+0000, chain.objs.size()=1 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.W8R3f-iFTdi8QaGs_u3tIfeL4vjkbid_0 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10918225490563544563', time=2024-09-12T02:54:25.339562+0000, chain.objs.size()=1 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.sbKxXAg0LRQNravXYG0PWdSExktctaP_0 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4528242622708036382', time=2024-09-12T02:54:25.537567+0000, chain.objs.size()=1 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6CPHALLp2khBuq4wqaUxqFJJ-8-P78J_0 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1197066499423518323', time=2024-09-12T02:54:25.666008+0000, chain.objs.size()=1 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.z5_tNODPxeY89RqiYpdtxMx1zYgOk9w_0 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11276103614967330245', time=2024-09-12T02:54:25.743409+0000, chain.objs.size()=1 2024-09-12T01:07:25.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kFjsJY7Un1f6rmGaqVUy2ms8o1IAE0H_0 2024-09-12T01:07:25.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15696930036697609207', time=2024-09-12T02:54:25.902335+0000, chain.objs.size()=1 2024-09-12T01:07:25.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.N5XJdO27jdWrGCId5Q6ZdQjSMKr9WrF_0 2024-09-12T01:07:25.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15999280115182235544', time=2024-09-12T02:54:25.996219+0000, chain.objs.size()=1 2024-09-12T01:07:25.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XFaUbSgCHH2lp5nOLdEJYihQFAHzY6P_0 2024-09-12T01:07:25.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2197199250805691573', time=2024-09-12T02:54:36.267920+0000, chain.objs.size()=1 2024-09-12T01:07:25.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.277__shadow_.amTO-9Mb2Wsj1XRfz2RUuX-cVUzOCU-_0 2024-09-12T01:07:25.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10193468068769218568', time=2024-09-12T02:54:55.799772+0000, chain.objs.size()=1 2024-09-12T01:07:25.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.302__shadow_.pOUorz8ojMiOvZXv9ZzmoF0Fj7azZ5G_0 2024-09-12T01:07:25.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6781991547675959762', time=2024-09-12T02:54:56.467663+0000, chain.objs.size()=1 2024-09-12T01:07:25.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.303__shadow_.B6EdTwa5qvZm_YzjVVLiLYGMsBjR2hO_0 2024-09-12T01:07:25.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16119886023423074917', time=2024-09-12T02:55:08.006844+0000, chain.objs.size()=1 2024-09-12T01:07:25.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.319__shadow:Zqu65koGgRHO5TlGNB.LKjSKrc82vBp_.l22zzNo0XrzDKGvAnG0AC2B9Lyhy9mK_0 2024-09-12T01:07:25.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17852580715761369538', time=2024-09-12T02:55:30.958863+0000, chain.objs.size()=1 2024-09-12T01:07:25.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RAFeMMjWw4Zh_pIRd8I3mnO0UkGynxN_0 2024-09-12T01:07:25.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9693731149712653694', time=2024-09-12T02:55:30.972829+0000, chain.objs.size()=1 2024-09-12T01:07:25.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HVqrjiW2vTZD2jmIIZrItiU_UpWhWY2_0 2024-09-12T01:07:25.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15952478424469376773', time=2024-09-12T02:55:30.977655+0000, chain.objs.size()=1 2024-09-12T01:07:25.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Zm1gYkmM1mHO_itlmBjbZ5q4nwxmS_k_0 2024-09-12T01:07:25.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8159447999262501507', time=2024-09-12T02:55:31.021856+0000, chain.objs.size()=1 2024-09-12T01:07:25.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zH04HRTa8fxtt1Dfm0n6BYRUe7JzSlL_0 2024-09-12T01:07:25.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10632740759642585732', time=2024-09-12T02:55:31.045789+0000, chain.objs.size()=1 2024-09-12T01:07:25.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1O3yk4am21YU17FeNtXEXGcRP1YTH2g_0 2024-09-12T01:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7034057325372893744', time=2024-09-12T02:55:31.048029+0000, chain.objs.size()=1 2024-09-12T01:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.g5H7vz3_i-j-KdbB5rKHlIyJbKwPut3_0 2024-09-12T01:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1226279164985021318', time=2024-09-12T02:55:31.051574+0000, chain.objs.size()=1 2024-09-12T01:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZlE2ER-fErrrIhGdXRXQKhHE3Tsds6j_0 2024-09-12T01:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14394849631235731808', time=2024-09-12T02:55:31.083987+0000, chain.objs.size()=1 2024-09-12T01:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.P6ZsGtc6VmXewvGWArCPPLqhFmGdBho_0 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15536898421042776224', time=2024-09-12T02:55:31.265233+0000, chain.objs.size()=1 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pD6yjvIOp2dXAyFFx4-sBntmlfTEE-7_0 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8939970656253537050', time=2024-09-12T02:55:31.320692+0000, chain.objs.size()=1 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.T6krx3Ybt1YKW57PrrSJM8Z8xhOSUxC_0 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12381903698793248658', time=2024-09-12T02:55:31.339836+0000, chain.objs.size()=1 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._MLfIMm9K1QCO5zTn_yotGANJdNHIgg_0 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13550874381068422467', time=2024-09-12T02:55:31.350955+0000, chain.objs.size()=1 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hRCcKtr1MBBPEG79KoXznK4zvluIhYb_0 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12983685890129292297', time=2024-09-12T02:55:31.362255+0000, chain.objs.size()=1 2024-09-12T01:07:25.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3dvNaA-kyvvAtLdeFqTT1D605jSMKop_0 2024-09-12T01:07:25.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13696192433876126127', time=2024-09-12T02:55:31.603664+0000, chain.objs.size()=1 2024-09-12T01:07:25.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Q2nqH9jYnwInaHurDvCLEIH6DbM5A13_0 2024-09-12T01:07:25.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1012781483953623619', time=2024-09-12T02:55:31.660473+0000, chain.objs.size()=1 2024-09-12T01:07:25.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.S_16yhmZEodezsmWZEvnXDsn4N8YCTc_0 2024-09-12T01:07:25.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4423338591382854598', time=2024-09-12T02:55:31.721633+0000, chain.objs.size()=1 2024-09-12T01:07:25.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IETNINA0X_XEWLhuzax6kCJwcV4xytF_0 2024-09-12T01:07:25.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3537434861610975145', time=2024-09-12T02:55:31.962368+0000, chain.objs.size()=1 2024-09-12T01:07:25.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gX6FJfC2-GpovNBpEHYOd2t9D4oekNM_0 2024-09-12T01:07:25.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12749101292258464884', time=2024-09-12T02:55:31.970817+0000, chain.objs.size()=1 2024-09-12T01:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.adG5Tq_lbYSAP71n_yMewjBq-mtUHtT_0 2024-09-12T01:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9230103334075249846', time=2024-09-12T02:55:31.983094+0000, chain.objs.size()=1 2024-09-12T01:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.NMGZuwT8H2iG1NmCWlMHG6rIaXfrfwA_0 2024-09-12T01:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6130486420760673392', time=2024-09-12T02:55:31.997366+0000, chain.objs.size()=1 2024-09-12T01:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mwCIe6eVEYxOYG9hjgTYrEBUtfFAXMw_0 2024-09-12T01:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15771698454011548144', time=2024-09-12T02:55:32.012554+0000, chain.objs.size()=1 2024-09-12T01:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Ul8dKAJtC0smXgqbASeg6gGe_UjPlrm_0 2024-09-12T01:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14467858030193306511', time=2024-09-12T02:55:32.063707+0000, chain.objs.size()=1 2024-09-12T01:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Tbn-5Pg8W84PFavKY4KWFhy9wGKWHIT_0 2024-09-12T01:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8844194914909457938', time=2024-09-12T02:55:32.241073+0000, chain.objs.size()=1 2024-09-12T01:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7WQNlQcrzBjhHwNBz-MkrCIrXLdYBWF_0 2024-09-12T01:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13132946622771428414', time=2024-09-12T02:55:32.288760+0000, chain.objs.size()=1 2024-09-12T01:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZGAQnunr-eCxYYu8poOcLUYydkq_l0O_0 2024-09-12T01:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5335637120374160054', time=2024-09-12T02:55:32.367776+0000, chain.objs.size()=1 2024-09-12T01:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.DAlqac2h9NOWOFBMHoG2-YYZSc-X-mX_0 2024-09-12T01:07:25.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11791280130266709653', time=2024-09-12T02:55:32.381706+0000, chain.objs.size()=1 2024-09-12T01:07:25.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WURNI-Y8KZDyJzby-m_Pj5pH3ecfV9h_0 2024-09-12T01:07:25.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18291476818807781363', time=2024-09-12T02:55:32.451126+0000, chain.objs.size()=1 2024-09-12T01:07:25.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.faZDq03-o2CHUrSHM21cNGF5y5KZlsf_0 2024-09-12T01:07:25.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.385660339913444541', time=2024-09-12T02:55:32.543521+0000, chain.objs.size()=1 2024-09-12T01:07:25.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.uVLwiifCSCB0HcLzxazB6ertu_FzOoB_0 2024-09-12T01:07:25.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3939117077482595611', time=2024-09-12T02:55:32.642003+0000, chain.objs.size()=1 2024-09-12T01:07:25.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vGFQeEhWye7lChRgJfoqZd7SHmY4Lzi_0 2024-09-12T01:07:25.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13743822741933826272', time=2024-09-12T02:55:32.656851+0000, chain.objs.size()=1 2024-09-12T01:07:25.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7XpvErs5Ym92erh-moMJ4LnAuz_w0Uq_0 2024-09-12T01:07:25.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10688496715489821061', time=2024-09-12T02:55:32.667084+0000, chain.objs.size()=1 2024-09-12T01:07:25.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.NIXcR1tTky1VDkdr-fa6IXOP4ueLClF_0 2024-09-12T01:07:25.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.325592441528866599', time=2024-09-12T02:55:32.692779+0000, chain.objs.size()=1 2024-09-12T01:07:25.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bn_PX86pIylwVGTdPdJmJhgCuE14bot_0 2024-09-12T01:07:25.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5849350401879796634', time=2024-09-12T02:55:32.707996+0000, chain.objs.size()=1 2024-09-12T01:07:25.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.i2QP28GeEd4R7oFvdJeAghtJ5DzTZqI_0 2024-09-12T01:07:25.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12292790281249942876', time=2024-09-12T02:55:32.948123+0000, chain.objs.size()=1 2024-09-12T01:07:25.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5zzx3djrEFV0kvFT-P4pcuLEVxdk1SR_0 2024-09-12T01:07:25.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12888596535027535110', time=2024-09-12T02:55:33.021678+0000, chain.objs.size()=1 2024-09-12T01:07:25.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sto252ewD-WoiyjPnu8XFZBhCLkyrpk_0 2024-09-12T01:07:25.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10194829276963939819', time=2024-09-12T02:55:33.258163+0000, chain.objs.size()=1 2024-09-12T01:07:25.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yY4t0yUibDfGFzkUh8RzIgF7EKVgWWa_0 2024-09-12T01:07:25.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3072278133025973917', time=2024-09-12T02:55:33.306232+0000, chain.objs.size()=1 2024-09-12T01:07:25.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8sAZqEW5xZeyf-GFRgs22we59UF2XT0_0 2024-09-12T01:07:25.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9211542889241395942', time=2024-09-12T02:55:54.595863+0000, chain.objs.size()=1 2024-09-12T01:07:25.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SH0pEqILQ5dZ-NLyGuigPhr6yiZKv_g_0 2024-09-12T01:07:25.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8943890274080587934', time=2024-09-12T02:55:54.599710+0000, chain.objs.size()=1 2024-09-12T01:07:25.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IRmBPcKOJc5uD0Ur5AIFhFftBRZwdAJ_0 2024-09-12T01:07:25.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9825321728931303795', time=2024-09-12T02:55:54.608762+0000, chain.objs.size()=1 2024-09-12T01:07:25.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.AqO8qP3njWPZ9mAZoyh1fGgGNH20zVf_0 2024-09-12T01:07:25.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9121708426945957268', time=2024-09-12T02:55:54.612677+0000, chain.objs.size()=1 2024-09-12T01:07:25.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PYHeeCK77--nfG0yHeEG6yMP_XXdA3D_0 2024-09-12T01:07:25.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16180822871358502026', time=2024-09-12T02:55:54.614704+0000, chain.objs.size()=1 2024-09-12T01:07:25.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZrdJ-FnOPKDQNXi_bXse60ZA6k24Nsq_0 2024-09-12T01:07:25.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2125139224555719789', time=2024-09-12T02:55:54.682879+0000, chain.objs.size()=1 2024-09-12T01:07:25.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kGXFmn1JKRGKgdNLwfs7cCQvBDTVDw0_0 2024-09-12T01:07:25.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14135450989901528452', time=2024-09-12T02:55:54.852383+0000, chain.objs.size()=1 2024-09-12T01:07:25.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.cTjH8oey2EsqwdhkDv8bx4YbbjnipLP_0 2024-09-12T01:07:25.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2390143739727778619', time=2024-09-12T02:55:54.854720+0000, chain.objs.size()=1 2024-09-12T01:07:25.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.tzDY8T37OMLeRKgW6TIYUcY-YDKNM6K_0 2024-09-12T01:07:25.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12702065835383777992', time=2024-09-12T02:55:54.965883+0000, chain.objs.size()=1 2024-09-12T01:07:25.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mtICuOC3TF1t1uwh9l7AdYjSYmsnwRm_0 2024-09-12T01:07:25.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3001167982733938958', time=2024-09-12T02:55:54.967621+0000, chain.objs.size()=1 2024-09-12T01:07:25.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pD-D0wMlJaLJ-WO0AlBpN8kUk8OTveU_0 2024-09-12T01:07:25.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2260722870411947892', time=2024-09-12T02:55:55.129607+0000, chain.objs.size()=1 2024-09-12T01:07:25.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qAlwj4-hbVLNMhQz5Qy6h7Te1Z3x-CK_0 2024-09-12T01:07:25.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.138221004047711375', time=2024-09-12T02:55:55.159987+0000, chain.objs.size()=1 2024-09-12T01:07:25.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LiW0DgRsgSLqQzcsrk6VIR430Lq23U0_0 2024-09-12T01:07:25.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14326301687356827386', time=2024-09-12T02:55:55.185447+0000, chain.objs.size()=1 2024-09-12T01:07:25.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qNBZnXpddPGru74swlpzy7277hBptAr_0 2024-09-12T01:07:25.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11665747935443902533', time=2024-09-12T02:55:55.193052+0000, chain.objs.size()=1 2024-09-12T01:07:25.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JWB7Ecvo-V1EpAc5ytnqE0lUJli3NcO_0 2024-09-12T01:07:25.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13296388194265769085', time=2024-09-12T02:55:55.224431+0000, chain.objs.size()=1 2024-09-12T01:07:25.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9w41-hfG997EAYXO9WfzhkHxgQfdW02_0 2024-09-12T01:07:25.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10648468569773713749', time=2024-09-12T02:55:55.264347+0000, chain.objs.size()=1 2024-09-12T01:07:25.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.huGS_2xjnZjkqSpdFQ2YZPFiwaFugOS_0 2024-09-12T01:07:25.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7025220655215806207', time=2024-09-12T02:55:55.302765+0000, chain.objs.size()=1 2024-09-12T01:07:25.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6qDRY7jTrOk_2_H1ziuSkC1mW6pdnDg_0 2024-09-12T01:07:25.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1322677236927910271', time=2024-09-12T02:55:55.326990+0000, chain.objs.size()=1 2024-09-12T01:07:25.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.v34roqb_IMwl3RH5-eXtVzund1NjQJO_0 2024-09-12T01:07:25.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16728795627028049420', time=2024-09-12T02:55:55.588805+0000, chain.objs.size()=1 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZtvrfQDjr9WeGVepIsOudIQ59reIC0B_0 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2758926583667493033', time=2024-09-12T02:55:55.874494+0000, chain.objs.size()=1 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-qcwJT_hjZ4OzvPk_CRwseGXgD_9yqz_0 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15290673548223292654', time=2024-09-12T02:55:55.882259+0000, chain.objs.size()=1 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.w55UG1v9Z_3V8jLGuwI3rus4bl4jClU_0 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4541028864028493247', time=2024-09-12T02:55:55.894055+0000, chain.objs.size()=1 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9xzeJVx7n7AR5TxU2DfNzWU9FBdIeku_0 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6863530473421009616', time=2024-09-12T02:55:56.175475+0000, chain.objs.size()=1 2024-09-12T01:07:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.w_5bF5tr9lZsWbUZBn-FWrUypuLSKJ3_0 2024-09-12T01:07:25.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5641421896051013092', time=2024-09-12T02:55:56.332931+0000, chain.objs.size()=1 2024-09-12T01:07:25.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0qIFQAJaIBIn7N9C4fvzCuZycyDbh_T_0 2024-09-12T01:07:25.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8549734366539542629', time=2024-09-12T02:55:56.494683+0000, chain.objs.size()=1 2024-09-12T01:07:25.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uCkN7Y_k3Hwkjc2NiYiIUOHeoSGkQDF_0 2024-09-12T01:07:25.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3884384560221314622', time=2024-09-12T02:55:56.528539+0000, chain.objs.size()=1 2024-09-12T01:07:25.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ijQrw2aGuGfgZAPO-4XdmuyJduEQ-pN_0 2024-09-12T01:07:25.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4893306150482985741', time=2024-09-12T02:55:56.559396+0000, chain.objs.size()=1 2024-09-12T01:07:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5Ot0t9rfrIEe8dboS1KWlP0kdEwebNG_0 2024-09-12T01:07:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14704559859498366531', time=2024-09-12T02:55:56.564655+0000, chain.objs.size()=1 2024-09-12T01:07:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Hzi1EpJA1fmmBHtBxYZ8HH9j1fU9-i-_0 2024-09-12T01:07:25.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48617 2024-09-12T01:07:25.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:07:25.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17737793245254157', time=2024-09-12T02:55:56.570939+0000, chain.objs.size()=1 2024-09-12T01:07:25.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lZjHszG_kd2K8vKjcvfaYFH_aLJ4fOF_0 2024-09-12T01:07:25.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2175432106755239138', time=2024-09-12T02:55:56.621883+0000, chain.objs.size()=1 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gdvhpgnhbH0ZGghn_Y6lAdzU5Gx3V6a_0 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1911813141695536314', time=2024-09-12T02:55:56.660413+0000, chain.objs.size()=1 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.quUBqUzYS6J1YSmXTDAxHmYx_CYiLrp_0 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11373786886473906967', time=2024-09-12T02:55:56.778245+0000, chain.objs.size()=1 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0B21AriIo_a9PlRGUNLbdYbKtGtnnYi_0 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13105343212444487241', time=2024-09-12T02:55:56.782049+0000, chain.objs.size()=1 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nRPYXjUn8eor28JcI0Vi5zrbICeQL-K_0 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7516361001108463915', time=2024-09-12T02:55:56.809766+0000, chain.objs.size()=1 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GCqkiI9xsjJkyQG_lwOsvvhx6gqvJjE_0 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15832914985963506226', time=2024-09-12T02:55:56.812084+0000, chain.objs.size()=1 2024-09-12T01:07:25.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XfZAaZEez7OHM2mwl6vFhZ5uNSNf_r7_0 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.584129713988803072', time=2024-09-12T02:55:56.900361+0000, chain.objs.size()=1 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-hZvJTE-PMgnpM4eqehwjcuridoLT5U_0 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15312644176531685457', time=2024-09-12T02:56:51.362097+0000, chain.objs.size()=1 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.407__shadow_.U8hvdJZzhBs_-DPMQdWtluNAwGq3Uky_0 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15715114080537013570', time=2024-09-12T02:57:35.036632+0000, chain.objs.size()=1 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.464__shadow_.2eMCocNWAzN4V_rgFuBMy0uZLHKk6qU_0 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11918482951592041235', time=2024-09-12T02:57:35.109575+0000, chain.objs.size()=1 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.464__shadow_.V24xizqz4acTufp2y8Tfoz_nBfaz4Xs_0 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8612112642549129610', time=2024-09-12T02:59:32.321495+0000, chain.objs.size()=1 2024-09-12T01:07:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.552__shadow_.BBkXG5ONsOWxwIllmi66ZM7sjqtpvq3_0 2024-09-12T01:07:25.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2643076529930153162', time=2024-09-12T02:59:52.325617+0000, chain.objs.size()=1 2024-09-12T01:07:25.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:vh5PdXL1dbNN.Hb9lU5x2etyG6hrhKd_.R8RixyYaJUCbzr8jzlCT92I9EXg64XP_0 2024-09-12T01:07:25.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4888270506735433069', time=2024-09-12T03:00:00.649218+0000, chain.objs.size()=1 2024-09-12T01:07:25.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.570__shadow:zkL2ihdX7XCnICG91xubznAtQH53mDe_.JqdwVJeO4ZXWHIM07z6F-m1T10LU4u5_0 2024-09-12T01:07:25.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2883000874792681671', time=2024-09-12T03:00:12.802088+0000, chain.objs.size()=1 2024-09-12T01:07:25.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:6kj2PiL-o0eh6QXwgbJCpOYqk7Etows_.PG2ZNxA-OBHXtuZ-V-cgGGPeky9uoKR_0 2024-09-12T01:07:25.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12446273100715450374', time=2024-09-12T03:00:16.106593+0000, chain.objs.size()=1 2024-09-12T01:07:25.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:egrs4ULlN.h92FMzyXaD0lTRkLDIEM4_.e4UDEkrdgL3nKKLmWTOTgUWj6RdTfCp_0 2024-09-12T01:07:25.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2935554035579125216', time=2024-09-12T03:00:17.330362+0000, chain.objs.size()=1 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:E6lDznh0XOkNV-RQ313hlxwllMO.B7v_.0oSqE4f30qHtKvlKvTmGPfkPJ5H8GR5_0 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10663173899104106270', time=2024-09-12T03:00:29.007939+0000, chain.objs.size()=1 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:kLqWAsS0fa3wydc1bvZVp0N1bNUJldJ_.afAKkwFC7xuBxKq2Z4MJu414GedVYN__0 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3398422108506216306', time=2024-09-12T03:03:12.526680+0000, chain.objs.size()=1 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.618__shadow_.5D7boUD_Zn99jFmH3W-COftqbSeFzKx_0 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9041377130900715564', time=2024-09-12T03:03:27.541168+0000, chain.objs.size()=1 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.633__shadow_.Vl2b7QZwGNRkBMODgZt8SL5pYZb8xYi_0 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2046393773842601754', time=2024-09-12T03:03:33.912514+0000, chain.objs.size()=1 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.643__shadow_.wxnDZVIG_VocAJG0zYV3LJR1zb3nWkh_0 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11603375661698081687', time=2024-09-12T03:03:44.192827+0000, chain.objs.size()=1 2024-09-12T01:07:25.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.655__shadow_.4y61BGR5OVdbfIkRyF_dFXYMNNz-CT7_0 2024-09-12T01:07:25.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12722241230623378267', time=2024-09-12T03:03:52.647106+0000, chain.objs.size()=1 2024-09-12T01:07:25.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.664__shadow_.akWzM8ROBXs4dDHyWULeyHHSRq9Y7M9_0 2024-09-12T01:07:25.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1024881701959318310', time=2024-09-12T03:03:54.592460+0000, chain.objs.size()=1 2024-09-12T01:07:25.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.666__shadow_.791R-8lJSoamm4QOjAHP75YhixYuevL_0 2024-09-12T01:07:25.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5202683838300456608', time=2024-09-12T03:03:54.723228+0000, chain.objs.size()=1 2024-09-12T01:07:25.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.666__shadow_.rb4NB915BQSTIiI3qLsNm6qPnt1sXsx_0 2024-09-12T01:07:25.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9769832181252782187', time=2024-09-12T03:04:15.791925+0000, chain.objs.size()=1 2024-09-12T01:07:25.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.702__multipart_file1.2~5pa1nSH68XPCtl3jE2iOliFlbR6zQnp.1 2024-09-12T01:07:25.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:25.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:07:25.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:25.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:25.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54992' 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_KnhmjFAGssoCvwFP3xhU8EIh1kd9SE0', time=2024-09-12T02:51:35.102357+0000, chain.objs.size()=3 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.RIMvxILf_mz21au2KF7efkEL1uPE0mZ_0 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.RIMvxILf_mz21au2KF7efkEL1uPE0mZ_1 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.RIMvxILf_mz21au2KF7efkEL1uPE0mZ_2 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3956509346494947074', time=2024-09-12T02:51:37.853518+0000, chain.objs.size()=1 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.166__shadow_.RGnPCsxz05sTEk58Q3mKCCQzwUSBEo0_0 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10360584780196539244', time=2024-09-12T02:53:38.514350+0000, chain.objs.size()=1 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.230__shadow_.hYSehqyEiimxGij_jIxVL0suk3AwChj_0 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8835319737921747658', time=2024-09-12T02:54:23.410571+0000, chain.objs.size()=1 2024-09-12T01:07:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Lr06OaWpK_Cuqoh0ObtWe4zXGCfYJn4_0 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14886406959438865785', time=2024-09-12T02:54:23.418820+0000, chain.objs.size()=1 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ZarkHWPZziF4445Ckz3Da75CCboTjn7_0 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8643493332225579568', time=2024-09-12T02:54:23.435771+0000, chain.objs.size()=1 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.EZUgQEHewzKmFowjpH1U_OUY4lB6JSC_0 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16884299854310076212', time=2024-09-12T02:54:23.474333+0000, chain.objs.size()=1 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IBxsuPilzNBRmhhMC4AZi5f149CKFdg_0 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8643942402487841369', time=2024-09-12T02:54:23.505560+0000, chain.objs.size()=1 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bUUbFi7mv532gD7_peihsGgExsuYGC0_0 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6447388220015772807', time=2024-09-12T02:54:23.522568+0000, chain.objs.size()=1 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.KQnajbEDz0ydL7tVqIy-4mjiGkDhGsD_0 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17035835477147529', time=2024-09-12T02:54:23.559121+0000, chain.objs.size()=1 2024-09-12T01:07:25.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.U_0F6me7cGn-Xxo_yQfJw2dOBWjZGPd_0 2024-09-12T01:07:25.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5368742824149607152', time=2024-09-12T02:54:23.560958+0000, chain.objs.size()=1 2024-09-12T01:07:25.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-dZR_AzDqyhDa7NFz3FcnIICY-yfLOI_0 2024-09-12T01:07:25.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15639639361061534780', time=2024-09-12T02:54:23.573597+0000, chain.objs.size()=1 2024-09-12T01:07:25.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.awM7VpobWwoH3Jq6XxE_7nyF6L50Ayy_0 2024-09-12T01:07:25.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12351007450859005058', time=2024-09-12T02:54:23.609140+0000, chain.objs.size()=1 2024-09-12T01:07:25.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4PbSAuRthuSJZmsbaqkn9LzhWsTHH3H_0 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3755851817635361546', time=2024-09-12T02:54:23.730929+0000, chain.objs.size()=1 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.biwCak7wv4QiOV7nZJGXgzAn_ba8EM2_0 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8795068887818662434', time=2024-09-12T02:54:23.732970+0000, chain.objs.size()=1 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bz6y51dpq7zbpVZzYkJB2a6ZSKCx_Zm_0 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16270135271998798688', time=2024-09-12T02:54:23.995971+0000, chain.objs.size()=1 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AbalCiZ41vNtambslzY212aTsjPCpbw_0 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9701792507781127417', time=2024-09-12T02:54:24.046647+0000, chain.objs.size()=1 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.J0OReS30ccIsPGOP1sQwyqVBWyTyKGO_0 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4251960420858857239', time=2024-09-12T02:54:24.119364+0000, chain.objs.size()=1 2024-09-12T01:07:25.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.95k-z_Qe3QZ08Tn7_PElThtEhVWk2JK_0 2024-09-12T01:07:25.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.725674986460446982', time=2024-09-12T02:54:24.151416+0000, chain.objs.size()=1 2024-09-12T01:07:25.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5cp1b3Ye8SHKMz__QekdP9Oag9cqXeb_0 2024-09-12T01:07:25.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14865261435164573248', time=2024-09-12T02:54:24.161417+0000, chain.objs.size()=1 2024-09-12T01:07:25.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HQ3K3TqwViib6D1Z2UESY5j7PJ51jgE_0 2024-09-12T01:07:25.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8460972587162946038', time=2024-09-12T02:54:24.167218+0000, chain.objs.size()=1 2024-09-12T01:07:25.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jtysrebiuVwgGh5YM8vYcR3FfsOmJeO_0 2024-09-12T01:07:25.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8945310491292756719', time=2024-09-12T02:54:24.172701+0000, chain.objs.size()=1 2024-09-12T01:07:25.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wX2KRSDHRSb6mYxQYzBByP3QPcYCdy6_0 2024-09-12T01:07:25.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10011997440690666997', time=2024-09-12T02:54:24.214767+0000, chain.objs.size()=1 2024-09-12T01:07:25.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3y6suwNU7spqHnstHQp3Mqeql8kAjKG_0 2024-09-12T01:07:25.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9359492190601844508', time=2024-09-12T02:54:24.345320+0000, chain.objs.size()=1 2024-09-12T01:07:25.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XA_DEqPcBEiUHek_k05WMgilnYGqWS7_0 2024-09-12T01:07:25.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9603871654004417593', time=2024-09-12T02:54:24.456419+0000, chain.objs.size()=1 2024-09-12T01:07:25.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HiIKtScXH7UWDdzPoInDZcMAK4-gsNE_0 2024-09-12T01:07:25.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15966026029862988411', time=2024-09-12T02:54:24.491834+0000, chain.objs.size()=1 2024-09-12T01:07:25.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AAsh69kRx8-nhxQCRG90EA3NniuINAn_0 2024-09-12T01:07:25.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1817212815396969899', time=2024-09-12T02:54:24.628725+0000, chain.objs.size()=1 2024-09-12T01:07:25.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CbHuw9PjMaQ6nn0869LuzzSI6X-_GJv_0 2024-09-12T01:07:25.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10212217757785475384', time=2024-09-12T02:54:24.758517+0000, chain.objs.size()=1 2024-09-12T01:07:25.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uCfUD5slCr71SMEALJ_1PqFct2CWK48_0 2024-09-12T01:07:25.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8256184792156874856', time=2024-09-12T02:54:24.782413+0000, chain.objs.size()=1 2024-09-12T01:07:25.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GDCrMUbIghtMoVMJGej98e5JvxVVUtY_0 2024-09-12T01:07:25.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17101276733038104484', time=2024-09-12T02:54:24.911183+0000, chain.objs.size()=1 2024-09-12T01:07:25.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ubKV8hHJI1Jj1VCGpuK9h6z-rvgVpCS_0 2024-09-12T01:07:25.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8345847544611075750', time=2024-09-12T02:54:24.918894+0000, chain.objs.size()=1 2024-09-12T01:07:25.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IL2yHpyGmG7jd_lkRTiZ_B6Bg48RgIa_0 2024-09-12T01:07:25.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7575727695497594232', time=2024-09-12T02:54:25.219674+0000, chain.objs.size()=1 2024-09-12T01:07:25.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FKPKes6hDfR3Cn_A9rTV8eUVLKg92Gt_0 2024-09-12T01:07:25.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.269943542874214226', time=2024-09-12T02:54:25.222510+0000, chain.objs.size()=1 2024-09-12T01:07:25.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qZ7CNG_zlnXruWEVCo6PSqUaEX1kNwF_0 2024-09-12T01:07:25.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8874848744402531474', time=2024-09-12T02:54:25.283158+0000, chain.objs.size()=1 2024-09-12T01:07:25.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.q9Yyduuv-0Fdvy-cz_gQCEXHIBTvaV3_0 2024-09-12T01:07:25.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16602284734643708956', time=2024-09-12T02:54:25.332634+0000, chain.objs.size()=1 2024-09-12T01:07:25.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ijNxmR7yjrgcNXmYnCbdDdnjwV1Lj4R_0 2024-09-12T01:07:25.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12157746199177582347', time=2024-09-12T02:54:25.640930+0000, chain.objs.size()=1 2024-09-12T01:07:25.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5L8wcIfn-3-6iOO3-DWuzZuRJCLZbje_0 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13315260423952891793', time=2024-09-12T02:54:25.676563+0000, chain.objs.size()=1 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.364X2eHUlGIpGiQS5St-QtdX_Z5U_Z8_0 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8810464848999772461', time=2024-09-12T02:54:25.859591+0000, chain.objs.size()=1 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3yoJPOXOi3fkUA4YbjtYmrcEmpzvaL9_0 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12889972286095324077', time=2024-09-12T02:54:27.967749+0000, chain.objs.size()=1 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.265__shadow_._CggDOTwQuRS_ytDvaAg6O7MfhAu2X2_0 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17836629050183003995', time=2024-09-12T02:54:29.990751+0000, chain.objs.size()=1 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.268__shadow_.o1-XLMNXpidP1Lh2QVwSS210I9I2jq5_0 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12454103694827746076', time=2024-09-12T02:54:31.399471+0000, chain.objs.size()=1 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.270__shadow_.nehnGh3_XDG-6A7SDQoX0z1bIRFXeWj_0 2024-09-12T01:07:25.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4589650490507855405', time=2024-09-12T02:54:39.016632+0000, chain.objs.size()=1 2024-09-12T01:07:25.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.281__shadow_.VVhuwPAcuBJv19RR80cdz1wQUgfQIFT_0 2024-09-12T01:07:25.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8837901641209049917', time=2024-09-12T02:54:39.771685+0000, chain.objs.size()=1 2024-09-12T01:07:25.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.282__shadow_.JHhMWVQsYA5-KX7dD_4czOjDbkmjQJe_0 2024-09-12T01:07:25.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.792+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15148439701206365212', time=2024-09-12T02:54:49.328907+0000, chain.objs.size()=1 2024-09-12T01:07:25.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.792+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.1n8uDjFZt2S4tbCwr1DH_lHd0QQQyn4_0 2024-09-12T01:07:25.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18195464841676353180', time=2024-09-12T02:54:51.454580+0000, chain.objs.size()=1 2024-09-12T01:07:25.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.296__shadow_.7NF8k1xXqjm1TAv4Vw44i9Bn2k8i9nZ_0 2024-09-12T01:07:25.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16249194185472647651', time=2024-09-12T02:55:30.856600+0000, chain.objs.size()=1 2024-09-12T01:07:25.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sO71hoKmIRhnHWiEcpVdIXuz82j6ciO_0 2024-09-12T01:07:25.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.817343354012852614', time=2024-09-12T02:55:30.869933+0000, chain.objs.size()=1 2024-09-12T01:07:25.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.c2NnaILfvioJ-xAJ8crAbi2CHfNm88z_0 2024-09-12T01:07:25.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14725287735737042369', time=2024-09-12T02:55:30.888360+0000, chain.objs.size()=1 2024-09-12T01:07:25.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qtocyBVFO8glAwW-dLfDE6HP1qb5Vp6_0 2024-09-12T01:07:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17870520455654222909', time=2024-09-12T02:55:30.963989+0000, chain.objs.size()=1 2024-09-12T01:07:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kpfRoNANXmkCjkiGOtsr-FcMUpmscaj_0 2024-09-12T01:07:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6802937466078130049', time=2024-09-12T02:55:31.006824+0000, chain.objs.size()=1 2024-09-12T01:07:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MHNHi_wkexrwlIRRrenPNtJ3GiHbv7u_0 2024-09-12T01:07:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6089070785739301015', time=2024-09-12T02:55:31.101236+0000, chain.objs.size()=1 2024-09-12T01:07:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xSiQ8HsUlfh0MhVFuBcrMI-f85XGKPX_0 2024-09-12T01:07:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1184420481292657352', time=2024-09-12T02:55:31.323411+0000, chain.objs.size()=1 2024-09-12T01:07:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.82OyHbN0ZJPRHjEdz8T1a60zjapW6Ih_0 2024-09-12T01:07:25.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9101225294891425287', time=2024-09-12T02:55:31.380105+0000, chain.objs.size()=1 2024-09-12T01:07:25.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GjGsraGXx0jx-A3Zn6loT-Tqk7ptKz5_0 2024-09-12T01:07:25.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1184410826130620664', time=2024-09-12T02:55:31.653763+0000, chain.objs.size()=1 2024-09-12T01:07:25.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8On9NN4X_6vWiqfBJ9fzixN4O02bBks_0 2024-09-12T01:07:25.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.621412316883089525', time=2024-09-12T02:55:31.748830+0000, chain.objs.size()=1 2024-09-12T01:07:25.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.n2wcXH-dUxMx1Jmz0u9xAt5ll3DbExE_0 2024-09-12T01:07:25.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13564107240205607001', time=2024-09-12T02:55:31.753902+0000, chain.objs.size()=1 2024-09-12T01:07:25.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jsOvfsm5klHatpvrXOcrZ0DrFCD-uGX_0 2024-09-12T01:07:25.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11897716394575205961', time=2024-09-12T02:55:31.758929+0000, chain.objs.size()=1 2024-09-12T01:07:25.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9uqI8JHGwGgTGflXGHsYi2Y8-LSp0SP_0 2024-09-12T01:07:25.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2945411915216680073', time=2024-09-12T02:55:31.760810+0000, chain.objs.size()=1 2024-09-12T01:07:25.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gFcvJ644utt_74CcEZWtNPoHd8ZIarx_0 2024-09-12T01:07:25.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15890493701540340637', time=2024-09-12T02:55:31.934392+0000, chain.objs.size()=1 2024-09-12T01:07:25.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vm6cx-9bO5SE3kIZRvRsIk5FFGkkK_0_0 2024-09-12T01:07:25.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10156615741213229260', time=2024-09-12T02:55:31.951498+0000, chain.objs.size()=1 2024-09-12T01:07:25.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QHqv8q3xl_XVEvKVorPOS-S7J7w9jzd_0 2024-09-12T01:07:25.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4003292935926470702', time=2024-09-12T02:55:32.240301+0000, chain.objs.size()=1 2024-09-12T01:07:25.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mAD8xZghvgsyV54LmUmWeJDwuxl-bgT_0 2024-09-12T01:07:25.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14680664727183895606', time=2024-09-12T02:55:32.293251+0000, chain.objs.size()=1 2024-09-12T01:07:25.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8uTq0V7VwaNcCGWUfqu53Oz-D8j6Nr6_0 2024-09-12T01:07:25.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8420393064262996005', time=2024-09-12T02:55:32.356516+0000, chain.objs.size()=1 2024-09-12T01:07:25.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._ZdTcKV5ih91bGcknVaqbpDnuuygXd1_0 2024-09-12T01:07:25.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14053461061143809097', time=2024-09-12T02:55:32.359167+0000, chain.objs.size()=1 2024-09-12T01:07:25.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sTSKV3e4ngTosrKCPGdQpuIxrFw95Cb_0 2024-09-12T01:07:25.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16283007776264952110', time=2024-09-12T02:55:32.539594+0000, chain.objs.size()=1 2024-09-12T01:07:25.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.50Q73rxq24lXc3eEYpo54QMIuOIByoR_0 2024-09-12T01:07:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13541687865907520800', time=2024-09-12T02:55:32.575965+0000, chain.objs.size()=1 2024-09-12T01:07:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pMWRsX82_kpdHWo65enLq2OqBU9lzF5_0 2024-09-12T01:07:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.617023992049634608', time=2024-09-12T02:55:32.623488+0000, chain.objs.size()=1 2024-09-12T01:07:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.__WZGiPvcSyCn1obZUa0F2BamWQ8veL_0 2024-09-12T01:07:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4585868974139936045', time=2024-09-12T02:55:32.675796+0000, chain.objs.size()=1 2024-09-12T01:07:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YTC9u7avSpcD2G0XRZRkQEyoxerMdcD_0 2024-09-12T01:07:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13432498982763210998', time=2024-09-12T02:55:32.926407+0000, chain.objs.size()=1 2024-09-12T01:07:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.BiWoZTBhXC86V3NLV7TqF97cCE4Jn1Y_0 2024-09-12T01:07:25.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.607624041113710177', time=2024-09-12T02:55:32.935751+0000, chain.objs.size()=1 2024-09-12T01:07:25.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.cUGAgljD-781a6eqL11MkbI_7pX9uh5_0 2024-09-12T01:07:25.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14237688231541518599', time=2024-09-12T02:55:32.951654+0000, chain.objs.size()=1 2024-09-12T01:07:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.804+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VvmRKeDYKSqJXBDxw6Xij1_y5TN1VSJ_0 2024-09-12T01:07:25.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1662465023674541439', time=2024-09-12T02:55:32.972899+0000, chain.objs.size()=1 2024-09-12T01:07:25.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pm5QNcMqnyGBGt6pSIOoy4fnZckolYa_0 2024-09-12T01:07:25.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15495887375106765853', time=2024-09-12T02:55:33.002867+0000, chain.objs.size()=1 2024-09-12T01:07:25.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.te2-_nou2ESK9ARJyvuHT-C122i6aS0_0 2024-09-12T01:07:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2837273829814095831', time=2024-09-12T02:55:33.168395+0000, chain.objs.size()=1 2024-09-12T01:07:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8NGxUPWbq5zo5YH_CPcPf0jk482ST5z_0 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2632340623257334307', time=2024-09-12T02:55:33.251583+0000, chain.objs.size()=1 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.EnwI04h-Zcj08Oze8l34cPhtr0meoRK_0 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8926977614934440385', time=2024-09-12T02:55:33.283395+0000, chain.objs.size()=1 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VzPI5vwb6TJaVtnQFaI6n9eHw0PLJdz_0 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5756813937334221676', time=2024-09-12T02:55:54.607714+0000, chain.objs.size()=1 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.c1Ym6r04gYh-ZVBijj2CAYhHzneuvig_0 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17183137732311110272', time=2024-09-12T02:55:54.648415+0000, chain.objs.size()=1 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gQkDqIqCDZKyY4Qf2pbg1QMkl7A7HVB_0 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15921355563697330801', time=2024-09-12T02:55:54.674582+0000, chain.objs.size()=1 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bQPzVQhVFKr-EIdtsAyshvL7_qZbq9e_0 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9772761764863441952', time=2024-09-12T02:55:54.683889+0000, chain.objs.size()=1 2024-09-12T01:07:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.u5W3roTy2bJ15kOdjwK3W-ck_zFUNWl_0 2024-09-12T01:07:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9308548411752489512', time=2024-09-12T02:55:54.843480+0000, chain.objs.size()=1 2024-09-12T01:07:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.tJlReglaUxxVNd0Vj2l_x_UGTHSzfkA_0 2024-09-12T01:07:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2982965811843210822', time=2024-09-12T02:55:54.954225+0000, chain.objs.size()=1 2024-09-12T01:07:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.db4TqKqWmxQQRcNITVI9UeFIvpTyo5h_0 2024-09-12T01:07:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5887607302107171428', time=2024-09-12T02:55:54.976063+0000, chain.objs.size()=1 2024-09-12T01:07:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Xr9jaxaeYmrTqMGzh1GjO2sOu786Ets_0 2024-09-12T01:07:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15922979557227501562', time=2024-09-12T02:55:54.989612+0000, chain.objs.size()=1 2024-09-12T01:07:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Po-KO2QkrVQXRxIyvjiUnAD1tybMf-b_0 2024-09-12T01:07:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11827346893566956137', time=2024-09-12T02:55:55.176746+0000, chain.objs.size()=1 2024-09-12T01:07:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9B0jTXarMhV_Td3YwYzMU0Vhijh8yWo_0 2024-09-12T01:07:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1428096414956792213', time=2024-09-12T02:55:55.180892+0000, chain.objs.size()=1 2024-09-12T01:07:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DJJKNhp2Ub9dw3ZnfY64AAImxnCVy7L_0 2024-09-12T01:07:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3766018198598026183', time=2024-09-12T02:55:55.183519+0000, chain.objs.size()=1 2024-09-12T01:07:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XVT2nQA7hzjxn5mC1Dbwje36UJtZF1g_0 2024-09-12T01:07:25.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11435503309286313483', time=2024-09-12T02:55:55.194330+0000, chain.objs.size()=1 2024-09-12T01:07:25.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sB8NSIr35VDfoEekbGNpkQmR044xnlh_0 2024-09-12T01:07:25.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8744387600097194887', time=2024-09-12T02:55:55.285953+0000, chain.objs.size()=1 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JMhRBo9nW58lxMC9ph85XMk2ZLEoRfP_0 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15937202459171095833', time=2024-09-12T02:55:55.286880+0000, chain.objs.size()=1 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xsY1_dr7Wis1CnoSQJBz0rfLwB17H6c_0 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6388581187867232885', time=2024-09-12T02:55:55.313182+0000, chain.objs.size()=1 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FZvibofU36THoZrgjivNTRuELNbcp_L_0 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.149310898252735003', time=2024-09-12T02:55:55.514267+0000, chain.objs.size()=1 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TurJXV4SXNcjLVvv5HbXKbMblw35MlZ_0 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11801765052119068233', time=2024-09-12T02:55:55.562626+0000, chain.objs.size()=1 2024-09-12T01:07:25.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.aoBWj6ey9ge7PLR-Z63qI-THRCpNxEw_0 2024-09-12T01:07:25.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12531091474402478200', time=2024-09-12T02:55:55.623794+0000, chain.objs.size()=1 2024-09-12T01:07:25.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VUb0WNM62h4aJs8RWMht_tFPBZiqjXI_0 2024-09-12T01:07:25.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7148095580222929839', time=2024-09-12T02:55:55.832459+0000, chain.objs.size()=1 2024-09-12T01:07:25.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.d-Ci9NKH8Zix4PCcyLox1SDb0TFPsn2_0 2024-09-12T01:07:25.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9296074331097897533', time=2024-09-12T02:55:55.927934+0000, chain.objs.size()=1 2024-09-12T01:07:25.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-v9phv1awci18BNll0fwfKgDmzfF-2i_0 2024-09-12T01:07:25.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1489384342708793927', time=2024-09-12T02:55:55.943060+0000, chain.objs.size()=1 2024-09-12T01:07:25.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PdY2NsestcnQAgBYvs_GU4glpEAS8yl_0 2024-09-12T01:07:25.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.918592217159284099', time=2024-09-12T02:55:55.999652+0000, chain.objs.size()=1 2024-09-12T01:07:25.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GzvbLFOQcgJkotW4p_4r18zagrT92qo_0 2024-09-12T01:07:25.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2537275442568176541', time=2024-09-12T02:55:56.173533+0000, chain.objs.size()=1 2024-09-12T01:07:25.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mE6FfpH2BRoQJDjtwS2MDtrPgzJF9Sm_0 2024-09-12T01:07:25.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.820+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8107217021526553805', time=2024-09-12T02:55:56.192774+0000, chain.objs.size()=1 2024-09-12T01:07:25.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.820+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.aeST0qLXCMTrBKidhXUxT-IzgCKOXxU_0 2024-09-12T01:07:25.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.820+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54992 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15011321320528811646', time=2024-09-12T02:55:56.206483+0000, chain.objs.size()=1 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BWUHKTE_Eao9Ju2AJY1Sy2HloCnNrIr_0 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3450561731572893388', time=2024-09-12T02:55:56.209548+0000, chain.objs.size()=1 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.h7alOzADHQi1y7SK2fJ9uZYt4FEheru_0 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5462066502231289644', time=2024-09-12T02:55:56.240384+0000, chain.objs.size()=1 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hfBi8Nhc8VMTjMDCKIsOqaVJV0HaGv4_0 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6696761998519663773', time=2024-09-12T02:55:56.259601+0000, chain.objs.size()=1 2024-09-12T01:07:25.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7Cs-N7-RdR7ZcwHu3S-Qq64SR_4LPua_0 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15034554844461187360', time=2024-09-12T02:55:56.265208+0000, chain.objs.size()=1 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lVTbYmeS41GK78O9fEVsBcB_WeOIhfT_0 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5245243844100793114', time=2024-09-12T02:55:56.289762+0000, chain.objs.size()=1 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VMyu-IMogvNxLCBz-21sCHjUMGSSLtx_0 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2450389096812307022', time=2024-09-12T02:55:56.322784+0000, chain.objs.size()=1 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8A_z-t4LNeYSigXigWaUDSXMkROFsCH_0 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3196482730183666495', time=2024-09-12T02:55:56.476503+0000, chain.objs.size()=1 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uC4_B0DY0VdvIc-9z6WA5ma7GqzzqAU_0 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14171030264156408965', time=2024-09-12T02:55:56.548856+0000, chain.objs.size()=1 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.b8pcsFMnyCyen5_oIQTUGF-LMQGK_1A_0 2024-09-12T01:07:25.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3071187477675840677', time=2024-09-12T02:55:56.583728+0000, chain.objs.size()=1 2024-09-12T01:07:25.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OueV31wNqmGkYkOCf6YYfk59QwvmVdz_0 2024-09-12T01:07:25.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7026041655376540790', time=2024-09-12T02:55:56.588641+0000, chain.objs.size()=1 2024-09-12T01:07:25.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._8CqUNxdb0gwMmw9FosshDVdaj-GFZ2_0 2024-09-12T01:07:25.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17622388731282401683', time=2024-09-12T02:55:56.592132+0000, chain.objs.size()=1 2024-09-12T01:07:25.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.J0f0CPk0g55tCsniKue8bYY5IrIvsmu_0 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16703024120487653009', time=2024-09-12T02:55:56.663770+0000, chain.objs.size()=1 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sgZg-lXFgyKFXtsApq-xj8oHwQhioox_0 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5417439447787289429', time=2024-09-12T02:55:56.844715+0000, chain.objs.size()=1 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uwn4b-2J3pFPDwCnunLD-m6PFJjrhsO_0 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12692732409716886595', time=2024-09-12T02:55:56.859182+0000, chain.objs.size()=1 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Rhkf16ketqh2flpuDfMmNwX2UGQzEfa_0 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.137344280545222348', time=2024-09-12T02:55:56.892026+0000, chain.objs.size()=1 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.puvfNU24Ow0AyaM5vy8iGWNIAsGlplz_0 2024-09-12T01:07:25.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17271809887903818167', time=2024-09-12T02:55:59.837014+0000, chain.objs.size()=1 2024-09-12T01:07:25.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.329__shadow_.TuCQ1poVSGi-n-KsTc598KyMTKAUgf__0 2024-09-12T01:07:25.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14590229671289232357', time=2024-09-12T02:57:45.047434+0000, chain.objs.size()=1 2024-09-12T01:07:25.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.c6rwn4LnxbNVFYSAgNrpSzXwjLpbIrs_0 2024-09-12T01:07:25.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12903368589344502794', time=2024-09-12T02:57:53.417793+0000, chain.objs.size()=1 2024-09-12T01:07:25.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.496__shadow_.IhbO4oFPeOxJ5dWbHlUVosgiN_F3EvG_0 2024-09-12T01:07:25.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11138010924071685620', time=2024-09-12T02:58:23.122388+0000, chain.objs.size()=6 2024-09-12T01:07:25.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.vNqiOjJHlaBQPya2-H_hZwgn979s5xb2.1 2024-09-12T01:07:25.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~tYYBEiVfqvifsPTBOYuNcvo3Nj2uSAa.2 2024-09-12T01:07:25.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~tYYBEiVfqvifsPTBOYuNcvo3Nj2uSAa.3 2024-09-12T01:07:25.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~tYYBEiVfqvifsPTBOYuNcvo3Nj2uSAa.4 2024-09-12T01:07:25.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~tYYBEiVfqvifsPTBOYuNcvo3Nj2uSAa.5 2024-09-12T01:07:25.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~tYYBEiVfqvifsPTBOYuNcvo3Nj2uSAa.6 2024-09-12T01:07:25.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9080399174802025605', time=2024-09-12T02:59:07.536236+0000, chain.objs.size()=4 2024-09-12T01:07:25.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.535__multipart_mymultipart.2~983JjYgsx6LjRGNjLCOOYNNLILzyTqv.1 2024-09-12T01:07:25.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.535__multipart_mymultipart.2~983JjYgsx6LjRGNjLCOOYNNLILzyTqv.2 2024-09-12T01:07:25.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.535__multipart_mymultipart.2X5EmPwSxoXBu5SpRuHVuZHvSZyfbhXT.3 2024-09-12T01:07:25.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.535__multipart_mymultipart.2~983JjYgsx6LjRGNjLCOOYNNLILzyTqv.4 2024-09-12T01:07:25.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8808594328860081853', time=2024-09-12T02:59:34.808725+0000, chain.objs.size()=1 2024-09-12T01:07:25.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.554__shadow_.DCZLxcM_F-A1SSooPu3zLM-BBv-J1LO_0 2024-09-12T01:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4911159990357719112', time=2024-09-12T02:59:43.035578+0000, chain.objs.size()=1 2024-09-12T01:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.562__shadow_.UMzr7lKhPJ5Kv-5_kGzsCQeLPfSbscP_0 2024-09-12T01:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15094612900851189203', time=2024-09-12T02:59:55.960800+0000, chain.objs.size()=1 2024-09-12T01:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:WK4HZQMU1P3BWfQSqb5eMeSeK.PNVZL_.J7RdTqwvWwawYJ-NuAgl0d-A_BVOGmO_0 2024-09-12T01:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8761490873531051169', time=2024-09-12T03:00:19.923056+0000, chain.objs.size()=1 2024-09-12T01:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:k6mvWZeuXII9AvDxzxYCTEtHLt470Z._.-bJlH6Xj_FiGY94IK6ej-lk_hdy-Jki_0 2024-09-12T01:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4861199803223413041', time=2024-09-12T03:00:35.203491+0000, chain.objs.size()=1 2024-09-12T01:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:bGBrn8pHzUAsbQr1ROenWJbjO6AlwBg_.1QbSS_UBgB2RrL_r61KjqOSinvb5DJd_0 2024-09-12T01:07:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11332367018729141727', time=2024-09-12T03:03:13.971391+0000, chain.objs.size()=1 2024-09-12T01:07:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.620__shadow_.nAw5tJm3OGIzKilPM-K2qo0uIsIrnY__0 2024-09-12T01:07:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3963247685369255245', time=2024-09-12T03:04:14.420374+0000, chain.objs.size()=1 2024-09-12T01:07:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.700__shadow:RKjfRBE4nkNvfb3utZ1u57osEANm0PS_.S1STf1jS9YM1uduHBxgVZG8-H7SzyZM_0 2024-09-12T01:07:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3791401449941489300', time=2024-09-12T03:04:22.041241+0000, chain.objs.size()=1 2024-09-12T01:07:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.711__multipart_file1.2~1jNrtIXAQg_K-dxEHhtFrikxpOwlmEL.1 2024-09-12T01:07:25.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.840+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:25.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.840+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:07:25.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:25.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:25.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54800' 2024-09-12T01:07:25.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9746675870699210894', time=2024-09-12T02:51:30.506619+0000, chain.objs.size()=5 2024-09-12T01:07:25.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-FROZEN.2~h5HrpazK9lNXHhDU36DNhvtIOaLcKS0.1 2024-09-12T01:07:25.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__shadow_mymultipart-FROZEN.2~h5HrpazK9lNXHhDU36DNhvtIOaLcKS0.1_1 2024-09-12T01:07:25.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-FROZEN.2~h5HrpazK9lNXHhDU36DNhvtIOaLcKS0.2 2024-09-12T01:07:25.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__shadow_mymultipart-FROZEN.2~h5HrpazK9lNXHhDU36DNhvtIOaLcKS0.2_1 2024-09-12T01:07:25.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-FROZEN.2~h5HrpazK9lNXHhDU36DNhvtIOaLcKS0.3 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_WOsI5T_CA8YaTdmjSKaG96kZ_GHd7Rh', time=2024-09-12T02:51:34.002406+0000, chain.objs.size()=3 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.Fm4bZ8jgGgRzJeC96RVQxCgloqp5R_1_0 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.Fm4bZ8jgGgRzJeC96RVQxCgloqp5R_1_1 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.Fm4bZ8jgGgRzJeC96RVQxCgloqp5R_1_2 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7257235734434460618', time=2024-09-12T02:51:54.637402+0000, chain.objs.size()=1 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.189__shadow_.Fpd3htRPTzJHu9euPMEhg3p489kuAKT_0 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4593498371082273824', time=2024-09-12T02:53:46.344443+0000, chain.objs.size()=1 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.240__shadow_.wcIe_diyecPN_xNgymecA4pe39QSRIa_0 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.691873539783204238', time=2024-09-12T02:53:53.566613+0000, chain.objs.size()=1 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.249__shadow_.WyOZBkCsLnDcsk39PFFsMbPoHTq4w0O_0 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6681738184134589087', time=2024-09-12T02:53:54.964392+0000, chain.objs.size()=1 2024-09-12T01:07:25.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.251__shadow_.ZH3GxhXD-rE8uC2KAmqK1wvL0ALtF32_0 2024-09-12T01:07:25.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4372794125210265393', time=2024-09-12T02:53:56.422971+0000, chain.objs.size()=1 2024-09-12T01:07:25.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.253__shadow_.pmMczIHuowjG3F5zv-d85Eims6eXVYc_0 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13875222462049732805', time=2024-09-12T02:53:56.425073+0000, chain.objs.size()=1 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.253__shadow_.fbbBEeiqAFhyET3fgQxzkQQ29U-xJLM_0 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1976630823599833127', time=2024-09-12T02:53:58.496929+0000, chain.objs.size()=1 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.256__shadow_.PaDn25O78a8LgZ6P42y3A6SAJ3ySOcy_0 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2272166009113985943', time=2024-09-12T02:54:23.011252+0000, chain.objs.size()=1 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Enwrn8sldv-dVHmId6FAy4H67aHvaii_0 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2330822381220728391', time=2024-09-12T02:54:23.016881+0000, chain.objs.size()=1 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.O510XnR_hwOsPnRBr6z8P8Aq5JY1mlv_0 2024-09-12T01:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5598943145225316747', time=2024-09-12T02:54:23.031182+0000, chain.objs.size()=1 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MxVBMBIzdJfkE8kx12kEqKUT32xzwTS_0 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16306811498075140637', time=2024-09-12T02:54:23.103476+0000, chain.objs.size()=1 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.h3J2lPbwQSYh81U9k8phkJs48E2LDW9_0 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14036508254476709519', time=2024-09-12T02:54:23.136007+0000, chain.objs.size()=1 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IttiwVdydMzA0U4AfBgle-AnwqDTryu_0 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14443464806623733154', time=2024-09-12T02:54:23.398303+0000, chain.objs.size()=1 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6ePITqMh84hc3U-Ts5vCvbbRPZJDvpQ_0 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7316106268171395750', time=2024-09-12T02:54:23.400263+0000, chain.objs.size()=1 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4MLDEMsPwhOfuZnhtykpGz7B8ZOohON_0 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6213121806549580945', time=2024-09-12T02:54:23.475314+0000, chain.objs.size()=1 2024-09-12T01:07:25.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.aen4zL3q7E7YkZwrdGr2RKdSJP4xNFF_0 2024-09-12T01:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4016030991631763153', time=2024-09-12T02:54:23.545091+0000, chain.objs.size()=1 2024-09-12T01:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Xa_F3X4JObIznSYpQUWx3TmS2Mh2CqK_0 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9236949007169716216', time=2024-09-12T02:54:23.578565+0000, chain.objs.size()=1 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xuTcv6yHZYA1Y4y-NSC-nhNxDiHoVQm_0 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3822909306004780912', time=2024-09-12T02:54:23.598005+0000, chain.objs.size()=1 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.c7acB0kKP0nSNzQIy4-17UkKBHzJOj__0 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1803351337779649140', time=2024-09-12T02:54:23.752905+0000, chain.objs.size()=1 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.b9RkvKlhizXC6YtBzrpSdnRUYREpLj4_0 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.240607436839172338', time=2024-09-12T02:54:24.078036+0000, chain.objs.size()=1 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0xjIqeEI00GT8nac3rRXhHyVYj4IyRp_0 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.790068212752691086', time=2024-09-12T02:54:24.110227+0000, chain.objs.size()=1 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ZafCuOkC0J4yLVqjVyaYjFhC7GcMPSx_0 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1041112890491664045', time=2024-09-12T02:54:24.128804+0000, chain.objs.size()=1 2024-09-12T01:07:25.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.q1MNH6vXZMUYob2ihJuyn3Qpgn7hVl7_0 2024-09-12T01:07:25.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13340120522710982774', time=2024-09-12T02:54:24.192576+0000, chain.objs.size()=1 2024-09-12T01:07:25.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.QK5Ov214zK3cJltuvl_Js6-65U6an6H_0 2024-09-12T01:07:25.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1346685697136286912', time=2024-09-12T02:54:24.202700+0000, chain.objs.size()=1 2024-09-12T01:07:25.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AkXnsoCsaEa1ClOwyV11QgJWBAIwfya_0 2024-09-12T01:07:25.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6758633498782316390', time=2024-09-12T02:54:24.208340+0000, chain.objs.size()=1 2024-09-12T01:07:25.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4c7nwDUGTYRXxdBC5dNIUT0lV4Mw7FD_0 2024-09-12T01:07:25.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.856+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5892724726966958440', time=2024-09-12T02:54:24.318155+0000, chain.objs.size()=1 2024-09-12T01:07:25.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.856+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6rVU6dDLE3cPiosiepma9WtdIh1bo2a_0 2024-09-12T01:07:25.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1446392936279939710', time=2024-09-12T02:54:24.462859+0000, chain.objs.size()=1 2024-09-12T01:07:25.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pQSU-c8VabUht8Mnx2Vz_qwWCQgDREg_0 2024-09-12T01:07:25.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16863415998670997625', time=2024-09-12T02:54:24.536312+0000, chain.objs.size()=1 2024-09-12T01:07:25.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.oiY2HIkge8a35z1gEwpA4WJszYnbQRn_0 2024-09-12T01:07:25.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18062642776175345746', time=2024-09-12T02:54:24.787751+0000, chain.objs.size()=1 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PT-JQTNRfY7l_5Uu89kf_62nlSqFGdE_0 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9523818996142969445', time=2024-09-12T02:54:24.823965+0000, chain.objs.size()=1 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eGgajSj1XG1NhGXWpez6h-v_30O_izj_0 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2324205605904563191', time=2024-09-12T02:54:25.149009+0000, chain.objs.size()=1 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Ahrr8xLfUC3auvFXQcpG2OGTCemfAKt_0 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7554138454679669223', time=2024-09-12T02:54:25.157613+0000, chain.objs.size()=1 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.A8dHM_Rnjt19-uMl4YO-Oje9wEoD67n_0 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12250876204930894228', time=2024-09-12T02:54:25.179010+0000, chain.objs.size()=1 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Wo7UJ8Pv7rUlhSbEjhZBdxjR6mJk0Or_0 2024-09-12T01:07:25.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15466186275599714373', time=2024-09-12T02:54:25.268473+0000, chain.objs.size()=1 2024-09-12T01:07:25.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3PmPpZZGEiBtyZkcCil8Pv6USJA6zWZ_0 2024-09-12T01:07:25.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12579177336026307753', time=2024-09-12T02:54:25.278565+0000, chain.objs.size()=1 2024-09-12T01:07:25.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._ncPKoGLtfqMAsmTUFdEah8Uuxg5z_S_0 2024-09-12T01:07:25.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13016247181064848947', time=2024-09-12T02:54:25.293725+0000, chain.objs.size()=1 2024-09-12T01:07:25.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Zq5f9FVLnziMUgSv6RAlGyywwTqdE_J_0 2024-09-12T01:07:25.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1085666427405139452', time=2024-09-12T02:54:25.517324+0000, chain.objs.size()=1 2024-09-12T01:07:25.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Dbjg0f3z_Nv9bF2gnPgPFd89iB7jG3y_0 2024-09-12T01:07:25.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9817547903993499954', time=2024-09-12T02:54:25.610952+0000, chain.objs.size()=1 2024-09-12T01:07:25.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.lfhGaTzFjGdCcMDtJmyj8X_OyVum-C__0 2024-09-12T01:07:25.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14540803363505077963', time=2024-09-12T02:54:25.624951+0000, chain.objs.size()=1 2024-09-12T01:07:25.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-HZ5_2N0BEqyt6lW6lKxOTbfnY7AFKw_0 2024-09-12T01:07:25.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7507739774639356309', time=2024-09-12T02:54:25.642718+0000, chain.objs.size()=1 2024-09-12T01:07:25.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GOUD_hAwSpZtgqUohJ4ad-buaYd8XTm_0 2024-09-12T01:07:25.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18438878258442595156', time=2024-09-12T02:54:25.739649+0000, chain.objs.size()=1 2024-09-12T01:07:25.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RtlXk1Pxs_2Oo9nSWNhlzUsQoZm3ISp_0 2024-09-12T01:07:25.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6963035256959439033', time=2024-09-12T02:54:25.908802+0000, chain.objs.size()=1 2024-09-12T01:07:25.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JeePsYP9wt5F-QG8SSzjG9hdoe0b_JB_0 2024-09-12T01:07:25.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8476944767813139090', time=2024-09-12T02:54:25.918933+0000, chain.objs.size()=1 2024-09-12T01:07:25.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2uZEctjCIgSN2DxslM90bMBpAdp85be_0 2024-09-12T01:07:25.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8499945092523806275', time=2024-09-12T02:54:26.007513+0000, chain.objs.size()=1 2024-09-12T01:07:25.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Q91qDgpmrVOaOhQpndvWbQVC6s2r-fY_0 2024-09-12T01:07:25.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8227427697341504893', time=2024-09-12T02:54:26.630626+0000, chain.objs.size()=1 2024-09-12T01:07:25.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.263__shadow_.sLDOwJvBQmV1BKPsCjAne0L9T-SS3Gs_0 2024-09-12T01:07:25.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9924064675946478779', time=2024-09-12T02:54:41.171585+0000, chain.objs.size()=1 2024-09-12T01:07:25.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.284__shadow_.hXecWeCNWN5xTB3ilzlI3bH4Tlorsdt_0 2024-09-12T01:07:25.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11465080712767272163', time=2024-09-12T02:54:41.176097+0000, chain.objs.size()=1 2024-09-12T01:07:25.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.284__shadow_.4dKZ-Hci3b_eVA1W2OR3Qa9BNwPul0C_0 2024-09-12T01:07:25.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14819720496870245294', time=2024-09-12T02:54:47.966863+0000, chain.objs.size()=1 2024-09-12T01:07:25.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.YtvBF8zBgkGU25WJF1gI5urLjAonDmv_0 2024-09-12T01:07:25.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1014795566646097730', time=2024-09-12T02:54:49.362169+0000, chain.objs.size()=1 2024-09-12T01:07:25.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.lyPGagPjnqwhcS9bFg5PG9Bn8U2OmS6_0 2024-09-12T01:07:25.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8642628845180671735', time=2024-09-12T02:54:50.109510+0000, chain.objs.size()=1 2024-09-12T01:07:25.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.294__shadow_.u4Ag3Z2h8XcNGhDDpmW9XTplA4Jk1wN_0 2024-09-12T01:07:25.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14525392275330760198', time=2024-09-12T02:54:53.653465+0000, chain.objs.size()=1 2024-09-12T01:07:25.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.299__shadow_.KntdOXPkG_RDcKXOv_RQ3xpxvngbbF6_0 2024-09-12T01:07:25.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13936716972902828566', time=2024-09-12T02:54:54.441536+0000, chain.objs.size()=1 2024-09-12T01:07:25.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.300__shadow_.Rz2TTwMo_XLtIF_zoxGUMKApJ_bHt4v_0 2024-09-12T01:07:25.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12348916341620265937', time=2024-09-12T02:55:30.886068+0000, chain.objs.size()=1 2024-09-12T01:07:25.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kA-0oFAb-xezxWqXPAZw4JYb3Q4b_hT_0 2024-09-12T01:07:25.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3081132466374270573', time=2024-09-12T02:55:30.972929+0000, chain.objs.size()=1 2024-09-12T01:07:25.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dijDO0X25ERdIxCmkngPCkVGvKKNwi7_0 2024-09-12T01:07:25.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16673307271212262421', time=2024-09-12T02:55:31.078919+0000, chain.objs.size()=1 2024-09-12T01:07:25.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QyTGHztonQHgjrLhAuZnQGNle-7l-Z7_0 2024-09-12T01:07:25.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6683101430307240235', time=2024-09-12T02:55:31.238991+0000, chain.objs.size()=1 2024-09-12T01:07:25.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ffX-xMvlPNjuS6nQ6vf-afXp_gexGt5_0 2024-09-12T01:07:25.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9026718408772671308', time=2024-09-12T02:55:31.286478+0000, chain.objs.size()=1 2024-09-12T01:07:25.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.S1jY2bfoyOxnrDGs1_UuSM-AQK7G_CZ_0 2024-09-12T01:07:25.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12711579318226167980', time=2024-09-12T02:55:31.294268+0000, chain.objs.size()=1 2024-09-12T01:07:25.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.46DMD63X5kQ1oSpOOwDMPiMyrMHdvj4_0 2024-09-12T01:07:25.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3131256791263217146', time=2024-09-12T02:55:31.301249+0000, chain.objs.size()=1 2024-09-12T01:07:25.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rt89CHGCbW8M2ig7La3IT6YSDVN-3tE_0 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15434940227759166156', time=2024-09-12T02:55:31.367056+0000, chain.objs.size()=1 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yLnEkpJ5xZqMToJ4d-jub6qA5j09yUo_0 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5086103209203956625', time=2024-09-12T02:55:31.385853+0000, chain.objs.size()=1 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.aM1rOMGDVkmld1ZWStHnYuhiB_HOxAb_0 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2858102236991477958', time=2024-09-12T02:55:31.422829+0000, chain.objs.size()=1 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eUdl9SodzACE6-qUc_WKMp9d3Iivu48_0 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1420616249968450663', time=2024-09-12T02:55:31.568891+0000, chain.objs.size()=1 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9eRgSTIRugtnFC9DLeRhmGPnMystFTX_0 2024-09-12T01:07:25.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.738913673913860958', time=2024-09-12T02:55:31.617236+0000, chain.objs.size()=1 2024-09-12T01:07:25.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4yEew-VfJ9ArJQry366ufnw3zsqsv3v_0 2024-09-12T01:07:25.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18130435897267475233', time=2024-09-12T02:55:31.629489+0000, chain.objs.size()=1 2024-09-12T01:07:25.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IF527HvwrkKIbDmHZMNYXPc-lAxlGf9_0 2024-09-12T01:07:25.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9393154934519812082', time=2024-09-12T02:55:31.657617+0000, chain.objs.size()=1 2024-09-12T01:07:25.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.CjrFovw7K4x_Ks43o5J9IsRIzGHHOll_0 2024-09-12T01:07:25.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10170973435317756982', time=2024-09-12T02:55:31.663788+0000, chain.objs.size()=1 2024-09-12T01:07:25.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TTQAFw08Educqpt5gEu4ZF3bsyc0ste_0 2024-09-12T01:07:25.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16774605224071549033', time=2024-09-12T02:55:31.687664+0000, chain.objs.size()=1 2024-09-12T01:07:25.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.O8oCk0vPGdXtDX48QPoC3I5aiPkXHAu_0 2024-09-12T01:07:25.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16708655869558466680', time=2024-09-12T02:55:31.740855+0000, chain.objs.size()=1 2024-09-12T01:07:25.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HNn5qEWqiwdzvO66_QDTPbIFLUU1mBP_0 2024-09-12T01:07:25.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8273133447705598785', time=2024-09-12T02:55:31.957192+0000, chain.objs.size()=1 2024-09-12T01:07:25.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Buhyo5fwPf3vkiODG8Ns8yHdBTiy9FJ_0 2024-09-12T01:07:25.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11599365350631899707', time=2024-09-12T02:55:32.265069+0000, chain.objs.size()=1 2024-09-12T01:07:25.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bx3H7fCF72DglNaNWAiEzd9NV92wANl_0 2024-09-12T01:07:25.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5996696236285380898', time=2024-09-12T02:55:32.317092+0000, chain.objs.size()=1 2024-09-12T01:07:25.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.D1x2Lj1DScMCc-iV1N9iLiq9R7Y7c84_0 2024-09-12T01:07:25.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15345478691802410456', time=2024-09-12T02:55:32.366069+0000, chain.objs.size()=1 2024-09-12T01:07:25.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5RnniSvfVLpPcGbsEcfkklK1ytf1QcV_0 2024-09-12T01:07:25.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.706114893050690685', time=2024-09-12T02:55:32.379895+0000, chain.objs.size()=1 2024-09-12T01:07:25.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.nvM-GXPldL2H3zxCAUm9rUIAYESi7iC_0 2024-09-12T01:07:25.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12840213044873422928', time=2024-09-12T02:55:32.380901+0000, chain.objs.size()=1 2024-09-12T01:07:25.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lxsC6qbwsEPDyfYV-SV9x-3EpFXM_8s_0 2024-09-12T01:07:25.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11290331600044479961', time=2024-09-12T02:55:32.410197+0000, chain.objs.size()=1 2024-09-12T01:07:25.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LLi1vLOoshY-mGuNuUJqF5QlAJ7XbBW_0 2024-09-12T01:07:25.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6333396153605463030', time=2024-09-12T02:55:32.444757+0000, chain.objs.size()=1 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Ci9KyS41vkOnc2zpslTXf8fkpixLE0Z_0 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2679157505388397600', time=2024-09-12T02:55:32.574875+0000, chain.objs.size()=1 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Om1uCI3r0injyM_3j01oFqMEvU6tao1_0 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.702294328682034426', time=2024-09-12T02:55:32.670639+0000, chain.objs.size()=1 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sFbFl06eliR_pa0jnrQSH6Z3IxEi5-2_0 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8367552922253515805', time=2024-09-12T02:55:32.697031+0000, chain.objs.size()=1 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._vn2wXtcSV3xiMiDZX9wZuA41fdidAD_0 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3937385846369803842', time=2024-09-12T02:55:32.753964+0000, chain.objs.size()=1 2024-09-12T01:07:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6laQYBqGTMECqRywGs9jm24I432lUNq_0 2024-09-12T01:07:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2674337676846386422', time=2024-09-12T02:55:33.222364+0000, chain.objs.size()=1 2024-09-12T01:07:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hv178WykahjOV1ndpX07KyieGFXtk1B_0 2024-09-12T01:07:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11664843691723091505', time=2024-09-12T02:55:33.223975+0000, chain.objs.size()=1 2024-09-12T01:07:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IFqhE_WV8KAFUKkNnMcReGy5FxkB6Rd_0 2024-09-12T01:07:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11729320466520459574', time=2024-09-12T02:55:33.293615+0000, chain.objs.size()=1 2024-09-12T01:07:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.aLJBQ-a_rG4gDFSyKcRZH29FniW6her_0 2024-09-12T01:07:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16431202457469645008', time=2024-09-12T02:55:54.493373+0000, chain.objs.size()=1 2024-09-12T01:07:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QMYwVSHp-zrnHO7DYWPK6upuZf4GKo7_0 2024-09-12T01:07:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3457667883587322746', time=2024-09-12T02:55:54.798601+0000, chain.objs.size()=1 2024-09-12T01:07:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.b20cDD2M9RnaI3IMsAvi3XrzBt3sHui_0 2024-09-12T01:07:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17353714859396099583', time=2024-09-12T02:55:54.840995+0000, chain.objs.size()=1 2024-09-12T01:07:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.L2B56qIv4Ok-Ez_D1Jwr6Byd63d1g7v_0 2024-09-12T01:07:25.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14590900685723311708', time=2024-09-12T02:55:54.880830+0000, chain.objs.size()=1 2024-09-12T01:07:25.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.iRoUzDEmvgAI2qRQSXQsGpfhgIFU85m_0 2024-09-12T01:07:25.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8189964457446597539', time=2024-09-12T02:55:55.193151+0000, chain.objs.size()=1 2024-09-12T01:07:25.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.e0YG2jauwRNM5id8UxIbDIQzzyVEs4n_0 2024-09-12T01:07:25.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15604560984844848770', time=2024-09-12T02:55:55.229021+0000, chain.objs.size()=1 2024-09-12T01:07:25.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ficSKxV991UMK1esX9ywmldLd4FPbp6_0 2024-09-12T01:07:25.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.540995844527380482', time=2024-09-12T02:55:55.268931+0000, chain.objs.size()=1 2024-09-12T01:07:25.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NS2ztNd6ulZovnwzhlSFdHKhpVHG5IK_0 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14291798033801408660', time=2024-09-12T02:55:55.294442+0000, chain.objs.size()=1 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2Nl3LU8KA9L0aV-eVILdn4gx9of946y_0 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13766544205120652789', time=2024-09-12T02:55:55.306418+0000, chain.objs.size()=1 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XU1HRy_avjbEygaBLheX5CZcs9iz1Ch_0 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2808971940669781890', time=2024-09-12T02:55:55.327163+0000, chain.objs.size()=1 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WgbXpF4B4aus3LKP198yAo7f7jpklNo_0 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9828773891744731551', time=2024-09-12T02:55:55.330085+0000, chain.objs.size()=1 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nGtMPI5c-ixLd09dDfqXZfrIsemF9G1_0 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16810930688161383421', time=2024-09-12T02:55:55.544499+0000, chain.objs.size()=1 2024-09-12T01:07:25.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.04yO-YQCwzix45eF5Txop9kSWobm5gR_0 2024-09-12T01:07:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3072864020542096348', time=2024-09-12T02:55:55.584148+0000, chain.objs.size()=1 2024-09-12T01:07:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5zwrSperaHC-EgDms7bQ-TP_9t1DUVm_0 2024-09-12T01:07:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18202638972817622253', time=2024-09-12T02:55:55.611252+0000, chain.objs.size()=1 2024-09-12T01:07:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4yXvTI9r8Y1RVpOVDuHIOWFSKguurJY_0 2024-09-12T01:07:25.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54800 2024-09-12T01:07:25.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=43, truncated=0, next_marker='' 2024-09-12T01:07:25.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14580672327897590297', time=2024-09-12T02:55:55.891155+0000, chain.objs.size()=1 2024-09-12T01:07:25.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.C3GDioQCXP-MpV_jYPC5beD718gFFDo_0 2024-09-12T01:07:25.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18288924265409170255', time=2024-09-12T02:55:55.902215+0000, chain.objs.size()=1 2024-09-12T01:07:25.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GUYpqka7WnYSB7cXmDuRq7d9NPtwODq_0 2024-09-12T01:07:25.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17095211092238230816', time=2024-09-12T02:55:55.934091+0000, chain.objs.size()=1 2024-09-12T01:07:25.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6leRFrA38u1FlfeaVDylO9RJbXJX-Ov_0 2024-09-12T01:07:25.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14759154032632964807', time=2024-09-12T02:55:55.993124+0000, chain.objs.size()=1 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dIGbHid680xM39wJ_NR9EpxzW5KFo5f_0 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7777309027512083100', time=2024-09-12T02:55:56.144283+0000, chain.objs.size()=1 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HkTTgljTaco-T24ZfmO7Zph6MvlpmAd_0 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15765413394500389654', time=2024-09-12T02:55:56.151884+0000, chain.objs.size()=1 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jE1TGW_0410tyIoitaOiUck-GuCIa7c_0 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14310265519783119940', time=2024-09-12T02:55:56.238465+0000, chain.objs.size()=1 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GzbkQyJsshv-xBpQHStujjIIE6QiDav_0 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11622305079322267785', time=2024-09-12T02:55:56.309982+0000, chain.objs.size()=1 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Q5ka-kGaQZ2Br5-QQfwY-wAuvxwu0aP_0 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14636545545859561238', time=2024-09-12T02:55:56.319677+0000, chain.objs.size()=1 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mazDKr80evGie9pchOQFaAhYW_FV2gq_0 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15760879546446220839', time=2024-09-12T02:55:56.328985+0000, chain.objs.size()=1 2024-09-12T01:07:25.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pdYrBtCP67iIVHFu08dBNlYufwTR1KT_0 2024-09-12T01:07:25.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11205187149888651809', time=2024-09-12T02:55:56.349877+0000, chain.objs.size()=1 2024-09-12T01:07:25.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Gz4OZBXqK0MPBPcAMJOsS3YPU4z52Gy_0 2024-09-12T01:07:25.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12668913500783511258', time=2024-09-12T02:55:56.515460+0000, chain.objs.size()=1 2024-09-12T01:07:25.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QIuFZX1RRBJPMqwE0223RJlRiLoKfzG_0 2024-09-12T01:07:25.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16081555818267753774', time=2024-09-12T02:55:56.608542+0000, chain.objs.size()=1 2024-09-12T01:07:25.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FqUXFsCqYmLz8kIBUyWjEmN4f2RS1RX_0 2024-09-12T01:07:25.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1161671334677491212', time=2024-09-12T02:55:56.631575+0000, chain.objs.size()=1 2024-09-12T01:07:25.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OiQqlz9LpMBnd_oZDUBTRaJaSl-lOCW_0 2024-09-12T01:07:25.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16019062629508926763', time=2024-09-12T02:55:56.823885+0000, chain.objs.size()=1 2024-09-12T01:07:25.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.obfziRQ8FxJ45El6__KPbEywFT55Mtp_0 2024-09-12T01:07:25.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12367229201126859858', time=2024-09-12T02:55:56.837362+0000, chain.objs.size()=1 2024-09-12T01:07:25.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.81zqqXUUXp9vEtVZf8Iq8ESJpmlDGd9_0 2024-09-12T01:07:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8641915456267636982', time=2024-09-12T02:55:58.065839+0000, chain.objs.size()=1 2024-09-12T01:07:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.326__shadow_.Mb4TjnXrHksDxskTA4pjBWma5p1crMp_0 2024-09-12T01:07:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13666903377428525822', time=2024-09-12T02:56:33.452316+0000, chain.objs.size()=1 2024-09-12T01:07:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.382__shadow_.BiN-TRKlZ8AiPuY_uPrucNuDimpgi2R_0 2024-09-12T01:07:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18377286760026523750', time=2024-09-12T02:56:34.807696+0000, chain.objs.size()=1 2024-09-12T01:07:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.384__shadow_.-VrEETVwBTJTPrUwnvdqwH0rS89zBVw_0 2024-09-12T01:07:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14404299477197181241', time=2024-09-12T02:57:09.000843+0000, chain.objs.size()=1 2024-09-12T01:07:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.432__shadow_.WuB_y3j9xls16EmyDzq3XKqBwnUqrCF_0 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2350975730220661362', time=2024-09-12T02:57:11.624679+0000, chain.objs.size()=1 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.436__shadow_.FjgVj9h9peSoRkRAKUOJS55Oe2yRxQi_0 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12971714414775754956', time=2024-09-12T02:57:35.341034+0000, chain.objs.size()=1 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.464__shadow_._G1Riu0UjqM4N8yOFESaoJSydQSuug__0 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16454317332001975666', time=2024-09-12T02:57:50.984696+0000, chain.objs.size()=1 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.491__shadow_.kshXiRpm6xlPVNOK8ikv5ZqLXpKtps1_0 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16502879339573761638', time=2024-09-12T02:57:54.493690+0000, chain.objs.size()=1 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.497__shadow_.JcAUcNrB1q8y2kFOT33sQKp-LxNJqKl_0 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.226498590792154156', time=2024-09-12T02:57:58.338221+0000, chain.objs.size()=1 2024-09-12T01:07:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.503__shadow:9LDvWGdmQQQ9l1.sKobe4w5aXdN6o1o_.IhjeMTusnwtlTOOsBJp3rTYo2SIwJCh_0 2024-09-12T01:07:25.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4047727146977275164', time=2024-09-12T02:58:01.999372+0000, chain.objs.size()=6 2024-09-12T01:07:25.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.1 2024-09-12T01:07:25.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.2 2024-09-12T01:07:25.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.3 2024-09-12T01:07:25.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.4 2024-09-12T01:07:25.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.5 2024-09-12T01:07:25.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.6 2024-09-12T01:07:25.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9989382169253740877', time=2024-09-12T02:58:06.628250+0000, chain.objs.size()=1 2024-09-12T01:07:25.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.516__multipart_mymultipartcopy.2~i2ZGUOiXI0PJ52TO2VuUou1unJnRUUV.1 2024-09-12T01:07:25.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12914155200650517432', time=2024-09-12T02:58:41.082767+0000, chain.objs.size()=2 2024-09-12T01:07:25.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~AIGg67bvfZBZm4vY8n9g6CXLsCPBukj.1 2024-09-12T01:07:25.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~AIGg67bvfZBZm4vY8n9g6CXLsCPBukj.2 2024-09-12T01:07:25.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4639915100863911010', time=2024-09-12T02:58:42.320956+0000, chain.objs.size()=3 2024-09-12T01:07:25.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~wpZAM9-FNS1rmWnaUq4uMjTVoBxuJJL.1 2024-09-12T01:07:25.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~wpZAM9-FNS1rmWnaUq4uMjTVoBxuJJL.2 2024-09-12T01:07:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~wpZAM9-FNS1rmWnaUq4uMjTVoBxuJJL.3 2024-09-12T01:07:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12213240821399674394', time=2024-09-12T02:58:42.707903+0000, chain.objs.size()=1 2024-09-12T01:07:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.524__shadow_.eHANvXbGPYg50okZI8gRCeF8iY9EQiu_0 2024-09-12T01:07:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~983JjYgsx6LjRGNjLCOOYNNLILzyTqv', time=2024-09-12T02:58:52.378375+0000, chain.objs.size()=1 2024-09-12T01:07:25.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.535__multipart_mymultipart.2~983JjYgsx6LjRGNjLCOOYNNLILzyTqv.3 2024-09-12T01:07:25.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2246152936690116115', time=2024-09-12T02:59:47.739508+0000, chain.objs.size()=2 2024-09-12T01:07:25.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.563__shadow_.PsuXme_t8kHoeEJFq3OUHm8vd7Rx68P_0 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.563__shadow_.PsuXme_t8kHoeEJFq3OUHm8vd7Rx68P_1 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10381941438125385735', time=2024-09-12T02:59:56.984453+0000, chain.objs.size()=1 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:Fzp9DtP1fpP4a9spba4zLMwY-RqgERK_.-Iak2yMh2oflX73hNSE5KHd67VcDd1B_0 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.784107391449928348', time=2024-09-12T03:00:04.808408+0000, chain.objs.size()=1 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow_.fXml6jrJxLOgPZkCP4D0cpfco2tRgAM_0 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.484889197561152541', time=2024-09-12T03:00:05.149891+0000, chain.objs.size()=1 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow:2Z0oFLX.uby.R7PSnujpC6Oseci5Uxv_.mm74w9jn-wfHpGUsPOyb_BQEwUZeQqj_0 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11346641542288625212', time=2024-09-12T03:00:05.630212+0000, chain.objs.size()=1 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow:.gf8HtbjJxn2BKFT64rsnvSFq.28pac_.a_Qvu8qrOW7TAKG5XT0q1j_iwH2cZFP_0 2024-09-12T01:07:25.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6303372594020374076', time=2024-09-12T03:00:11.158980+0000, chain.objs.size()=1 2024-09-12T01:07:25.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:xrOZ66VPa8vyM9oqA4XYQ0QvANxauIr_.uz0nzha_nVpWn1vFZnrlj1J188F-BPw_0 2024-09-12T01:07:25.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17959171827737546670', time=2024-09-12T03:00:17.512129+0000, chain.objs.size()=1 2024-09-12T01:07:25.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:9CvinvxRP.4MEnjOsHMTA6QQSkhS5bY_.yqlY4cz4Hg8zp3KjioN3MfT_cG5cyTD_0 2024-09-12T01:07:25.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5879419632357036345', time=2024-09-12T03:00:23.317848+0000, chain.objs.size()=1 2024-09-12T01:07:25.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:GK97OKuTT9zZH56-r-UdWaCLiHaRlvI_.4tbS-KfsmfRVDrOnEiwnWAS4lVz3DYc_0 2024-09-12T01:07:25.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12639137474985637802', time=2024-09-12T03:00:36.986457+0000, chain.objs.size()=1 2024-09-12T01:07:25.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:W-mewxtomywZEo0nDXvZ4U1mzh.uRP9_.f4gwS6pL03CGlmxsJbvIJxtmuAsKfgt_0 2024-09-12T01:07:25.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2317524156464755443', time=2024-09-12T03:01:02.760155+0000, chain.objs.size()=12 2024-09-12T01:07:25.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__multipart_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.1 2024-09-12T01:07:25.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__shadow_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.1_1 2024-09-12T01:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__multipart_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.2 2024-09-12T01:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__shadow_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.2_1 2024-09-12T01:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__multipart_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.3 2024-09-12T01:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__shadow_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.3_1 2024-09-12T01:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__multipart_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.4 2024-09-12T01:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__shadow_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.4_1 2024-09-12T01:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__multipart_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.5 2024-09-12T01:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__shadow_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.5_1 2024-09-12T01:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__multipart_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.6 2024-09-12T01:07:25.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.613__shadow_multipart_enc.2~5XDZH2Vf1PPf7ypqqlMv0OH7QX0sdS7.6_1 2024-09-12T01:07:25.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5285720387911520438', time=2024-09-12T03:03:12.681674+0000, chain.objs.size()=1 2024-09-12T01:07:25.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.618__shadow_.KTuVAgJq2Wj5VuYvwJUtKSk1OtASFCL_0 2024-09-12T01:07:25.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.978125450208544566', time=2024-09-12T03:07:07.833992+0000, chain.objs.size()=1 2024-09-12T01:07:25.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.782__shadow_.iaey9diUe8dYHQXW1Cyte9z-r-prcew_0 2024-09-12T01:07:25.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.920+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:25.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:07:25.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:25.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:25.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43215' 2024-09-12T01:07:25.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16706870873624333603', time=2024-09-12T02:53:38.510890+0000, chain.objs.size()=1 2024-09-12T01:07:25.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.230__shadow_.8Tcn5sFdDSmxj5yZuKyAyy_0s9vS-Mp_0 2024-09-12T01:07:25.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4865096032623030302', time=2024-09-12T02:53:48.909928+0000, chain.objs.size()=1 2024-09-12T01:07:25.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.243__shadow_.sIX7jarOo4xGvXv4xkHDoFk0z6rYjcT_0 2024-09-12T01:07:25.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3773111012487125152', time=2024-09-12T02:54:00.574330+0000, chain.objs.size()=1 2024-09-12T01:07:25.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.259__shadow_.ITX0gFqLceBGZ7jJHqx7hUlcaI091RY_0 2024-09-12T01:07:25.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10498235382353894771', time=2024-09-12T02:54:01.260996+0000, chain.objs.size()=1 2024-09-12T01:07:25.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.260__shadow_.Pqqys1KR1N063LCeCrK0i-jpA5gaE8v_0 2024-09-12T01:07:25.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12985305687443577896', time=2024-09-12T02:54:01.263472+0000, chain.objs.size()=1 2024-09-12T01:07:25.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.260__shadow_.8IhO1hEfGJbLNqpJI6i5ajFlJ5Ijma2_0 2024-09-12T01:07:25.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3451576292391975026', time=2024-09-12T02:54:23.009183+0000, chain.objs.size()=1 2024-09-12T01:07:25.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nAuynqDxLVgXNU_6HYoH8MCczXQpybH_0 2024-09-12T01:07:25.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9893463900452096608', time=2024-09-12T02:54:23.022876+0000, chain.objs.size()=1 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.igB_ARg5PVQj_MN9lFOHbcxp6yNrjBV_0 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12004047336871468531', time=2024-09-12T02:54:23.167444+0000, chain.objs.size()=1 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.36c4idJVrg-tG4E7tiS7IZElxCn5_3S_0 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18097355813172432425', time=2024-09-12T02:54:23.173539+0000, chain.objs.size()=1 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RSx2X1U28wDb0JNCh7_muvdhKrmRuqp_0 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12835965278239617767', time=2024-09-12T02:54:23.188104+0000, chain.objs.size()=1 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2vkc3zXnGT1YnPtZg-o0yKgDK-cHfT7_0 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13483861618690954538', time=2024-09-12T02:54:23.408192+0000, chain.objs.size()=1 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.I6Ore-aLetoji7BxC0hora6TrzMUMbs_0 2024-09-12T01:07:25.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5705943409725318510', time=2024-09-12T02:54:23.465217+0000, chain.objs.size()=1 2024-09-12T01:07:25.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.924+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jpQ11uyIQDtRDEm-K6zZFVuoSNXiCdL_0 2024-09-12T01:07:25.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12588353425072493299', time=2024-09-12T02:54:23.488094+0000, chain.objs.size()=1 2024-09-12T01:07:25.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.BKf3DZd0VCNcVggasNRvZO9MPJMdgaj_0 2024-09-12T01:07:25.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13695410247638595872', time=2024-09-12T02:54:23.602764+0000, chain.objs.size()=1 2024-09-12T01:07:25.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LFRCgS6UoLt2TRbtAIpgEuXb3wC17kj_0 2024-09-12T01:07:25.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16334454617832941427', time=2024-09-12T02:54:24.224654+0000, chain.objs.size()=1 2024-09-12T01:07:25.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qc7s9ktb0mibJMzXtPFg6_8FnwWlujJ_0 2024-09-12T01:07:25.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1056090144919417238', time=2024-09-12T02:54:24.401381+0000, chain.objs.size()=1 2024-09-12T01:07:25.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pyaoC1B38VR8hr73MOV4CyqJieMIGwi_0 2024-09-12T01:07:25.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7489391251592739417', time=2024-09-12T02:54:24.502294+0000, chain.objs.size()=1 2024-09-12T01:07:25.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kF6D5VJqbTXAJFZD3DD3wNWQ-Vlkhqf_0 2024-09-12T01:07:25.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18237645214494075187', time=2024-09-12T02:54:24.513220+0000, chain.objs.size()=1 2024-09-12T01:07:25.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eDJTEHd1YhxoJVJwlSIq1R-ELX51WEt_0 2024-09-12T01:07:25.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3972751343397072758', time=2024-09-12T02:54:24.941930+0000, chain.objs.size()=1 2024-09-12T01:07:25.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XbBfwN6WZE5Rjh2-dKI455UR2ScJ7aH_0 2024-09-12T01:07:25.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13326979217960610989', time=2024-09-12T02:54:24.947335+0000, chain.objs.size()=1 2024-09-12T01:07:25.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.J88A1gi2Fo-omL98RfcKE3NEQSSZTk2_0 2024-09-12T01:07:25.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11817682669077751461', time=2024-09-12T02:54:24.953757+0000, chain.objs.size()=1 2024-09-12T01:07:25.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5luSJBwYwz1yJ9Qob_FJ-MkQ2cDAb7y_0 2024-09-12T01:07:25.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4700824372746021146', time=2024-09-12T02:54:24.977568+0000, chain.objs.size()=1 2024-09-12T01:07:25.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vJkk77ZiQfiewHkOvrU8PIcalYuDpYl_0 2024-09-12T01:07:25.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11677160822307059173', time=2024-09-12T02:54:24.995853+0000, chain.objs.size()=1 2024-09-12T01:07:25.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qQWpTFmJisHorYOQq3Zo_Idd9KYB5JV_0 2024-09-12T01:07:25.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6924811604334094391', time=2024-09-12T02:54:25.004229+0000, chain.objs.size()=1 2024-09-12T01:07:25.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bgYj5RACGkIBRIMw0N5bB-LpEE3rhEk_0 2024-09-12T01:07:25.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5130042387040320533', time=2024-09-12T02:54:25.201255+0000, chain.objs.size()=1 2024-09-12T01:07:25.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Mcwq2Pogr5n3MC3fZvZtJTrIgePQJp0_0 2024-09-12T01:07:25.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5323501406333477726', time=2024-09-12T02:54:25.230549+0000, chain.objs.size()=1 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9YuXGev79oQA08x_jQXff73w86xhKPo_0 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.121755518920925628', time=2024-09-12T02:54:25.289079+0000, chain.objs.size()=1 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vT-x5HbzloWNkKWniL8sZZ3CZ7W6qZb_0 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2184799149394221797', time=2024-09-12T02:54:25.293195+0000, chain.objs.size()=1 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GDHJdKWOoRV4U8DNnfQB8qDra5hDD52_0 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11108039166492523932', time=2024-09-12T02:54:25.713313+0000, chain.objs.size()=1 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.G_UqhN67eBxoC2k-ECOOnqa2hDvMcgb_0 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14000681287519563180', time=2024-09-12T02:54:25.733116+0000, chain.objs.size()=1 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wfxUqEGgXCJqerYF546jYeuCZVSSsDO_0 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8824791498837751615', time=2024-09-12T02:54:25.742460+0000, chain.objs.size()=1 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PlqzghJiRI97PdO3QdwPhFE7pkikIvn_0 2024-09-12T01:07:25.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10087639721036491565', time=2024-09-12T02:54:25.745100+0000, chain.objs.size()=1 2024-09-12T01:07:25.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MsvSrYkUaHtnN-STYiW_ksA0dC-X74N_0 2024-09-12T01:07:25.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2441383323879548453', time=2024-09-12T02:54:25.853968+0000, chain.objs.size()=1 2024-09-12T01:07:25.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ctBOfcWnaWelxR-8IhwHQJU0IpKBRLu_0 2024-09-12T01:07:25.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17611359780992750548', time=2024-09-12T02:54:25.885087+0000, chain.objs.size()=1 2024-09-12T01:07:25.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AiFS0xYA_J0TI1FRoKUlwVVNxyx5iKG_0 2024-09-12T01:07:25.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8685151873170708034', time=2024-09-12T02:54:25.902599+0000, chain.objs.size()=1 2024-09-12T01:07:25.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.YubCI_aZ9w9iVfaqiU78bIQj5ne9P_W_0 2024-09-12T01:07:25.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13429607042688008676', time=2024-09-12T02:54:25.945533+0000, chain.objs.size()=1 2024-09-12T01:07:25.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0P9588fFN13DXxxVtFVys0TxvVr5XuK_0 2024-09-12T01:07:25.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4668687049939914374', time=2024-09-12T02:54:26.001185+0000, chain.objs.size()=1 2024-09-12T01:07:25.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.y03y2eT94S2yEB_Xwl_L4EWhAhl5htW_0 2024-09-12T01:07:25.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7879561162067714802', time=2024-09-12T02:54:27.970734+0000, chain.objs.size()=1 2024-09-12T01:07:25.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.265__shadow_.tcA6zg4jAsDxqUCc2pDCMBr9tt4lHst_0 2024-09-12T01:07:25.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2578387487597991955', time=2024-09-12T02:54:36.265967+0000, chain.objs.size()=1 2024-09-12T01:07:25.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.277__shadow_.ZipCpNK7dtJbJx91CanmqJGVzlDwYF-_0 2024-09-12T01:07:25.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5795080808406182943', time=2024-09-12T02:54:46.503719+0000, chain.objs.size()=1 2024-09-12T01:07:25.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.291__shadow_.97Vvqjzgqg9mh-gJdIF8K3VK_neVixd_0 2024-09-12T01:07:25.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3615534808047895016', time=2024-09-12T02:54:47.903754+0000, chain.objs.size()=1 2024-09-12T01:07:25.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.aq1NrCZmBwymBFXxZOq2WXyLh_0AIJv_0 2024-09-12T01:07:25.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2490769855660312381', time=2024-09-12T02:54:50.110531+0000, chain.objs.size()=1 2024-09-12T01:07:25.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.294__shadow_.79W5YkBOlmB9y_DQT5JeUFWm_D17NJG_0 2024-09-12T01:07:25.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4437666980696200682', time=2024-09-12T02:54:51.460545+0000, chain.objs.size()=1 2024-09-12T01:07:25.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.296__shadow_.PIxdjS1MrnY4H5yuC8T0dRC7E0xkUjE_0 2024-09-12T01:07:25.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14404837670875742995', time=2024-09-12T02:54:52.944783+0000, chain.objs.size()=1 2024-09-12T01:07:25.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.298__shadow_.Wu3-Y1RVrm09n4sf9xL6GlUMOAUGcED_0 2024-09-12T01:07:25.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11102716799221988965', time=2024-09-12T02:54:55.129526+0000, chain.objs.size()=1 2024-09-12T01:07:25.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.301__shadow_.Qznw3TJoQ5Bx7UAKkGoqnxcJ3g1XPct_0 2024-09-12T01:07:25.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8124044250957163755', time=2024-09-12T02:54:56.470349+0000, chain.objs.size()=1 2024-09-12T01:07:25.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.303__shadow_.9f1MmF4XrEUNGyvPrordZ6ZPqgJEm2x_0 2024-09-12T01:07:25.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8339113264512623749', time=2024-09-12T02:55:30.951488+0000, chain.objs.size()=1 2024-09-12T01:07:25.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eBOvTybBcYN6xMWscBk93VFsYXkZLx3_0 2024-09-12T01:07:25.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8983383082293735982', time=2024-09-12T02:55:30.993693+0000, chain.objs.size()=1 2024-09-12T01:07:25.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Uh2U5ubMiGAuyvUQS6rzjCzJy5FfDRs_0 2024-09-12T01:07:25.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1181906879257279564', time=2024-09-12T02:55:31.025179+0000, chain.objs.size()=1 2024-09-12T01:07:25.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Gix2KZjEiWz5VNdciu6elN9y9TVFM37_0 2024-09-12T01:07:25.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11391627330240814524', time=2024-09-12T02:55:31.231044+0000, chain.objs.size()=1 2024-09-12T01:07:25.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PQtO6bZ67Tj8A3TuhYHsG5DRWca2nAC_0 2024-09-12T01:07:25.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12163506864848106867', time=2024-09-12T02:55:31.407274+0000, chain.objs.size()=1 2024-09-12T01:07:25.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VdLPAZX6Ld3JoauWimGZNH9Umx44oOs_0 2024-09-12T01:07:25.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18024097065054531535', time=2024-09-12T02:55:31.419363+0000, chain.objs.size()=1 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rE2AwEvXK2ibIGqCimWijIlPYSc6Yaz_0 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.575524003210468391', time=2024-09-12T02:55:31.965633+0000, chain.objs.size()=1 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lIy88VejTXGnjRn3oFBq43W_zxCR6ZO_0 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2840892737447697225', time=2024-09-12T02:55:32.006224+0000, chain.objs.size()=1 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lz7_nByLcWt91I9ljGhNqPtcTN2uTwW_0 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18443243162636109655', time=2024-09-12T02:55:32.261742+0000, chain.objs.size()=1 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7q5_6uYCBfR0x5Enz7C8ioMUpcpZEOv_0 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.355070666996404380', time=2024-09-12T02:55:32.304970+0000, chain.objs.size()=1 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hS0VXiLyxviq6j4LC0lIDWNFNG0W5bE_0 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10184879282441953980', time=2024-09-12T02:55:32.601702+0000, chain.objs.size()=1 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jXSpFoIfGU4A6hb02_5RdvYp2iW3t_D_0 2024-09-12T01:07:25.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6210019604705008587', time=2024-09-12T02:55:32.649633+0000, chain.objs.size()=1 2024-09-12T01:07:25.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3yEqiD9jHO8ukJaNJVc41ZzEoWNuAS3_0 2024-09-12T01:07:25.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8053501891194933796', time=2024-09-12T02:55:32.661168+0000, chain.objs.size()=1 2024-09-12T01:07:25.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.JG3eDgh3lmmcTLfOZjT21UoNsfcnqV2_0 2024-09-12T01:07:25.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18431826257799588646', time=2024-09-12T02:55:32.739338+0000, chain.objs.size()=1 2024-09-12T01:07:25.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.nwKQSA6JPE5DoDh0cN1Dj36iw3YBdrh_0 2024-09-12T01:07:25.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.650609954236422426', time=2024-09-12T02:55:32.942842+0000, chain.objs.size()=1 2024-09-12T01:07:25.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6TV7TW3WLpC5k03ovVTjZ2HyWLIf8J-_0 2024-09-12T01:07:25.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13284737619904957146', time=2024-09-12T02:55:33.023044+0000, chain.objs.size()=1 2024-09-12T01:07:25.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.EPX7fwKIbbc6hU8D6NmmCptfYEV7BGo_0 2024-09-12T01:07:25.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8930864212794525941', time=2024-09-12T02:55:54.489306+0000, chain.objs.size()=1 2024-09-12T01:07:25.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bHd6GQhSYH2wMNPsGbneNqAS7vLkKJG_0 2024-09-12T01:07:25.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1219025170449388822', time=2024-09-12T02:55:54.522186+0000, chain.objs.size()=1 2024-09-12T01:07:25.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0Fu3T9EAAJmNkuABR9k2fyzWDOjsRmm_0 2024-09-12T01:07:25.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11079844639485857273', time=2024-09-12T02:55:54.523141+0000, chain.objs.size()=1 2024-09-12T01:07:25.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XgAQ-YSQwnBlU72mi62ZtEDPxbgDylg_0 2024-09-12T01:07:25.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1575788566022946328', time=2024-09-12T02:55:54.542417+0000, chain.objs.size()=1 2024-09-12T01:07:25.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XAa3jqyofugzUeAtxk8KXJ-qfYuUu3q_0 2024-09-12T01:07:25.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3724531824911715180', time=2024-09-12T02:55:54.655143+0000, chain.objs.size()=1 2024-09-12T01:07:25.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PbQJaNxEwiS9sJi3MxVX1YG2lBRrVLl_0 2024-09-12T01:07:25.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15464647585082537678', time=2024-09-12T02:55:54.870011+0000, chain.objs.size()=1 2024-09-12T01:07:25.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YSd1rFh2ua4DjE54JsWqt03u-OMA7pT_0 2024-09-12T01:07:25.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8987279056140799336', time=2024-09-12T02:55:54.895401+0000, chain.objs.size()=1 2024-09-12T01:07:25.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Yi2qoWc9dG_2cPVoLOTGsAed9iOfR5__0 2024-09-12T01:07:25.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17365867753440405911', time=2024-09-12T02:55:54.934086+0000, chain.objs.size()=1 2024-09-12T01:07:25.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.k0mXvao05BuSmnohMGGsHQVjLA4qnmv_0 2024-09-12T01:07:25.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13761957532850341080', time=2024-09-12T02:55:55.156774+0000, chain.objs.size()=1 2024-09-12T01:07:25.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MxQG0elIv9wIJj-KUyTo7qYA0pIQeUL_0 2024-09-12T01:07:25.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1792801563561093607', time=2024-09-12T02:55:55.187506+0000, chain.objs.size()=1 2024-09-12T01:07:25.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xb59SXYdlsLeGcYNI3A46lasxLr9Rfu_0 2024-09-12T01:07:25.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14947004038442604240', time=2024-09-12T02:55:55.210492+0000, chain.objs.size()=1 2024-09-12T01:07:25.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zDqOiJqMLQBxnVJ3utpfPebEAjO6SZk_0 2024-09-12T01:07:25.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3623451744563404036', time=2024-09-12T02:55:55.300553+0000, chain.objs.size()=1 2024-09-12T01:07:25.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nDL-Nun4JttRl7emL37P7TvzdqfHWZq_0 2024-09-12T01:07:25.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17015532601970744282', time=2024-09-12T02:55:55.456644+0000, chain.objs.size()=1 2024-09-12T01:07:25.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qN3GkUOI72kRK2o1aYtc9y3jQavNFcn_0 2024-09-12T01:07:25.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16845129143247405887', time=2024-09-12T02:55:55.549269+0000, chain.objs.size()=1 2024-09-12T01:07:25.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bGwzZxWXy81L5DdsTSQeCDAfw6UQ3Oz_0 2024-09-12T01:07:25.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11650394213449202563', time=2024-09-12T02:55:55.595854+0000, chain.objs.size()=1 2024-09-12T01:07:25.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pF1UwceXEeWNeSkga6TF4AeRhMjqrsz_0 2024-09-12T01:07:25.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13592373236027349500', time=2024-09-12T02:55:55.603845+0000, chain.objs.size()=1 2024-09-12T01:07:25.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1NJlRN3batOHqYqf_-jkrKBJemjHIjS_0 2024-09-12T01:07:25.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.670971892102872546', time=2024-09-12T02:55:55.666150+0000, chain.objs.size()=1 2024-09-12T01:07:25.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZWEXjyuxIu2Z2QoLvaHWmU-bpZKOlnb_0 2024-09-12T01:07:25.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12868947193646452586', time=2024-09-12T02:55:55.920801+0000, chain.objs.size()=1 2024-09-12T01:07:25.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zXUWiEUdC72WZwLF_NF7VbszgJVReQF_0 2024-09-12T01:07:25.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14168231566403375450', time=2024-09-12T02:55:55.995962+0000, chain.objs.size()=1 2024-09-12T01:07:25.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XOdapITq2nKo6iTun8DJ6Rus1aP5tGP_0 2024-09-12T01:07:25.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2988296189290435479', time=2024-09-12T02:55:56.195227+0000, chain.objs.size()=1 2024-09-12T01:07:25.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XGLGpxZK2_0phjVloXRIM09x1nt-y1n_0 2024-09-12T01:07:25.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8369741012612695600', time=2024-09-12T02:55:56.197353+0000, chain.objs.size()=1 2024-09-12T01:07:25.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-m75DUoW073TnlLyTuQB2HORPGn5DoH_0 2024-09-12T01:07:25.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.883297705759505904', time=2024-09-12T02:55:56.232070+0000, chain.objs.size()=1 2024-09-12T01:07:25.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9g8xyWLSZIWINKiyMgi-LcywuAP0AwG_0 2024-09-12T01:07:25.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1437880381923755716', time=2024-09-12T02:55:56.273896+0000, chain.objs.size()=1 2024-09-12T01:07:25.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.X4IPrLvZ-TUquzZot-5SFGqJp8X40jx_0 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.472239689742055445', time=2024-09-12T02:55:56.279738+0000, chain.objs.size()=1 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pliH6rwXSpfZlBWAQfMrVakRQUY96cy_0 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14916858481504264003', time=2024-09-12T02:55:56.310738+0000, chain.objs.size()=1 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-Q6eo1XChQBpWq-CgcsPjQvn8yMn7ES_0 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11502342252977115592', time=2024-09-12T02:55:56.312518+0000, chain.objs.size()=1 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8OyN152rF0y93wVRn0D7fP8a2Sb3qLA_0 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1909872722563601009', time=2024-09-12T02:55:56.317115+0000, chain.objs.size()=1 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.X4cly1dbIRfbQqGSH_H-qKrMr1B5APl_0 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7850177916250229111', time=2024-09-12T02:55:56.891617+0000, chain.objs.size()=1 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NEtjpBZkXfH1CSDb_eekdKqRAGKvVon_0 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7080793869511993501', time=2024-09-12T02:55:56.892335+0000, chain.objs.size()=1 2024-09-12T01:07:25.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FnHsMwWrC3dOWqvwYACiJPzzR2ndENc_0 2024-09-12T01:07:25.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8023235127183525786', time=2024-09-12T02:56:02.443081+0000, chain.objs.size()=1 2024-09-12T01:07:25.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.333__shadow_.PRn7qh6yYik4zHRRpHmtAoUHe3nLtH6_0 2024-09-12T01:07:25.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16406108571074738182', time=2024-09-12T02:56:05.127023+0000, chain.objs.size()=1 2024-09-12T01:07:25.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.337__shadow_.vw8loQnbX19tEMkhCDQBLNDdxwHgry__0 2024-09-12T01:07:25.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7179936966729094140', time=2024-09-12T02:56:09.426787+0000, chain.objs.size()=1 2024-09-12T01:07:25.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.344__shadow_.gE80j9wVUoP4YQPwicgNN5Sb7Q2E_x5_0 2024-09-12T01:07:25.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18120257346419760251', time=2024-09-12T02:57:35.337272+0000, chain.objs.size()=1 2024-09-12T01:07:25.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.464__shadow_.pigvDDE2-ON05WGSGs5KeHvIu7QQwhz_0 2024-09-12T01:07:25.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20248128932442932', time=2024-09-12T02:57:45.041313+0000, chain.objs.size()=1 2024-09-12T01:07:25.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.uwNZ_0xL3v0c6ACesxxKue9v_JTggIB_0 2024-09-12T01:07:25.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3630544936412599539', time=2024-09-12T02:57:46.269974+0000, chain.objs.size()=1 2024-09-12T01:07:25.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.485__shadow_.VrVAF081PPQWh3uXYGjW-kFnTgZ4Y0Q_0 2024-09-12T01:07:25.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8257895576917853612', time=2024-09-12T02:58:03.407271+0000, chain.objs.size()=1 2024-09-12T01:07:25.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.511__multipart_mymultipart.2~6XPd854ABuK2zU7Z7Zl63q1N_-Sbn1R.1 2024-09-12T01:07:25.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15734388360963962838', time=2024-09-12T02:58:05.411503+0000, chain.objs.size()=1 2024-09-12T01:07:25.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.514__shadow_.BaTt_Tp49WCyE9NqUrq0gQDyyXuoqwj_0 2024-09-12T01:07:25.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3835900485440968020', time=2024-09-12T02:58:41.675358+0000, chain.objs.size()=3 2024-09-12T01:07:25.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~rhszL9JV4069ZfQdtw4Ye4P6Rr2a8Em.1 2024-09-12T01:07:25.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~rhszL9JV4069ZfQdtw4Ye4P6Rr2a8Em.2 2024-09-12T01:07:25.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~rhszL9JV4069ZfQdtw4Ye4P6Rr2a8Em.3 2024-09-12T01:07:25.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43215 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.188902497929222410', time=2024-09-12T03:00:03.453313+0000, chain.objs.size()=1 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.573__shadow_.nXPWXBSIu6gDCH3309Tm-3CYbS1Qh8J_0 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8525231242486786544', time=2024-09-12T03:00:03.581367+0000, chain.objs.size()=1 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.573__shadow_.qdd1Him4zcE9NXpcxGHML2VpU5UfFrD_0 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6553871460896678490', time=2024-09-12T03:00:07.475464+0000, chain.objs.size()=1 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow:cfSn1bPq6DSnW0yhasRhHoHTV7d-05p_.sqXlLfkVfMdFYkOvbwUJbk9kaNv7tRy_0 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10714213808663739358', time=2024-09-12T03:03:24.884554+0000, chain.objs.size()=1 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.629__shadow_.IdvzrBQMwwR40rdD7Hda6idITdNKdCR_0 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.291934037709297732', time=2024-09-12T03:03:50.637032+0000, chain.objs.size()=6 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.660__multipart_bar.2~gx8usmDZuM5eJNdZ1S1FBud2BtQrb3i.1 2024-09-12T01:07:25.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.660__multipart_bar.2~gx8usmDZuM5eJNdZ1S1FBud2BtQrb3i.2 2024-09-12T01:07:25.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.660__multipart_bar.2~gx8usmDZuM5eJNdZ1S1FBud2BtQrb3i.3 2024-09-12T01:07:25.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.660__multipart_bar.2~gx8usmDZuM5eJNdZ1S1FBud2BtQrb3i.4 2024-09-12T01:07:25.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.660__multipart_bar.2~gx8usmDZuM5eJNdZ1S1FBud2BtQrb3i.5 2024-09-12T01:07:25.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.660__multipart_bar.2~gx8usmDZuM5eJNdZ1S1FBud2BtQrb3i.6 2024-09-12T01:07:25.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:25.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:07:25.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:25.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:25.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46825' 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4482690656998882273', time=2024-09-12T02:51:47.847556+0000, chain.objs.size()=1 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.178__shadow_.xr69W7K40q_1b0YM6UEuusNbnHGUkJJ_0 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4236406300564367862', time=2024-09-12T02:53:41.238297+0000, chain.objs.size()=1 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.234__shadow_.UWWRBIxabB17LuidNbI-RPZZvZCuZ2G_0 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.363065955065941105', time=2024-09-12T02:53:51.491376+0000, chain.objs.size()=1 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.246__shadow_.9uxRC5Ys5aRi-duayFQnpi58fFaZRM6_0 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14265294966199144210', time=2024-09-12T02:53:55.673925+0000, chain.objs.size()=1 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.252__shadow_.sU6D9Bzca6aFM6TI7vOb258EuAn2u_s_0 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4487679878229142444', time=2024-09-12T02:53:57.092523+0000, chain.objs.size()=1 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.254__shadow_.BvNztrwD_rulAlxXY8kr0n7BeefQ193_0 2024-09-12T01:07:25.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17744776392731706909', time=2024-09-12T02:54:23.126687+0000, chain.objs.size()=1 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iTKonvTyL_Fl09I9lzWjRAWOBf4IAWR_0 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2504387596271218546', time=2024-09-12T02:54:23.175370+0000, chain.objs.size()=1 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dGb1oTPfQPqXg1H42kSrodymEU7qk-k_0 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7904849687166196089', time=2024-09-12T02:54:23.242277+0000, chain.objs.size()=1 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.24r7TPBO6nV_c9-2o7RKO8hzhd0cEQx_0 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4154665456089207877', time=2024-09-12T02:54:23.248916+0000, chain.objs.size()=1 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-bodM2Dy2w1IoIL4XIJ7CDMlc06Lbiz_0 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12129078620771095236', time=2024-09-12T02:54:23.741029+0000, chain.objs.size()=1 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wnG_gYN_vXwEbfnoFMAdmYIm-L2N7yW_0 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12682238124762552935', time=2024-09-12T02:54:24.024110+0000, chain.objs.size()=1 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kR9gCK7wbtKLaWw5THehb5eMewMQCdB_0 2024-09-12T01:07:25.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10854669740055527264', time=2024-09-12T02:54:24.097845+0000, chain.objs.size()=1 2024-09-12T01:07:25.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._13fGUlmxFN4732zwfhd3C5RJVmeRFd_0 2024-09-12T01:07:25.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9003748250000867414', time=2024-09-12T02:54:24.104330+0000, chain.objs.size()=1 2024-09-12T01:07:25.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.BSZpLJqDOs1HppZNaxdjcsVQ1wcTH-W_0 2024-09-12T01:07:25.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1599050421928798471', time=2024-09-12T02:54:24.533595+0000, chain.objs.size()=1 2024-09-12T01:07:25.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iMfDy4eNczbBrF8PvOV5o3ZcZdmGu7w_0 2024-09-12T01:07:25.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6747016006665982916', time=2024-09-12T02:54:24.632150+0000, chain.objs.size()=1 2024-09-12T01:07:25.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._ES4C_okj6dsFRS5vjEN-ghfSsSkWVQ_0 2024-09-12T01:07:25.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7094848963622673093', time=2024-09-12T02:54:24.906948+0000, chain.objs.size()=1 2024-09-12T01:07:25.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wKqsvGcnW-_zsu1g5He2rHB5jPEEkoS_0 2024-09-12T01:07:25.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18429445938232325850', time=2024-09-12T02:54:25.138389+0000, chain.objs.size()=1 2024-09-12T01:07:25.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.7N91u1AW9STna047Ud_SSwiWUMct6D9_0 2024-09-12T01:07:25.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5331201406648208786', time=2024-09-12T02:54:25.154578+0000, chain.objs.size()=1 2024-09-12T01:07:25.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vwqU7pECbs9Emu2__-2QV1b9tFH8-BN_0 2024-09-12T01:07:25.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7024143898488621589', time=2024-09-12T02:54:25.158552+0000, chain.objs.size()=1 2024-09-12T01:07:25.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6P95wdEKuCgs11QoZfMe4Q2RBXZCj_t_0 2024-09-12T01:07:25.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11828180074350260136', time=2024-09-12T02:54:25.188534+0000, chain.objs.size()=1 2024-09-12T01:07:25.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.llZECXzdfW4SmDFautHiN8KusEWY_rq_0 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12155755457667515087', time=2024-09-12T02:54:25.248545+0000, chain.objs.size()=1 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.sL8-x1xeuEeM2PSFFq1uJSUDZCMN09s_0 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15828669774855240135', time=2024-09-12T02:54:25.278153+0000, chain.objs.size()=1 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qmWw3Pjt06kAvJz8Dei0umu-pe-3z5j_0 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.990476977307267935', time=2024-09-12T02:54:25.306205+0000, chain.objs.size()=1 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.a04Ao4IMI0OZiRdAoUlEVFzBy1mr_-Y_0 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16986962243057264934', time=2024-09-12T02:54:25.561395+0000, chain.objs.size()=1 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vjVcKBIutdgwdW_v682gtvTCecWCZkn_0 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15587635642561042609', time=2024-09-12T02:54:25.603412+0000, chain.objs.size()=1 2024-09-12T01:07:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.N6YBdABHMgTALmuvCdSyy2JBU6ayRFe_0 2024-09-12T01:07:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9143375482442796732', time=2024-09-12T02:54:25.685224+0000, chain.objs.size()=1 2024-09-12T01:07:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2TVYsKOXyTQlmoAMMk3Nl3Cjf0wsz8I_0 2024-09-12T01:07:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18039801267713179723', time=2024-09-12T02:54:25.860890+0000, chain.objs.size()=1 2024-09-12T01:07:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nZnSvvjiaXS-AAffA3pxZgR8ejK4kZn_0 2024-09-12T01:07:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8546069871766324951', time=2024-09-12T02:54:25.897601+0000, chain.objs.size()=1 2024-09-12T01:07:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IfYrGxazUptAf6VFYLfIuFNzsvtwswM_0 2024-09-12T01:07:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1019797312098982991', time=2024-09-12T02:54:25.922322+0000, chain.objs.size()=1 2024-09-12T01:07:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.S432CNor2lABqHPQ8qpNi-5kPjj7eKe_0 2024-09-12T01:07:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16561246320961942359', time=2024-09-12T02:54:25.956884+0000, chain.objs.size()=1 2024-09-12T01:07:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._DKoC61thrAu5dT-b4uytpRrp_Vmh4m_0 2024-09-12T01:07:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9644730686973345100', time=2024-09-12T02:54:25.963855+0000, chain.objs.size()=1 2024-09-12T01:07:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dfJHHp_KSUkmaCi7Lj8cqB67g7ipT4W_0 2024-09-12T01:07:25.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11276151551472442111', time=2024-09-12T02:54:25.977025+0000, chain.objs.size()=1 2024-09-12T01:07:25.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ePKHPlOdxKuYL4hm3MxfugTyOfcuSZa_0 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5282270911621159385', time=2024-09-12T02:54:25.980276+0000, chain.objs.size()=1 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DMyg85VMnUxhnMq-vBlIcqHtYeAc7GY_0 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14633607318559594954', time=2024-09-12T02:54:26.011099+0000, chain.objs.size()=1 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4HOvaL9jftCuiX8o8-1pWxDMzxD2Smi_0 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7015227422919699666', time=2024-09-12T02:54:32.067775+0000, chain.objs.size()=1 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.271__shadow_.bqfOSFyn2OskxYrLPkfe3takRsJMS11_0 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7711450965390758230', time=2024-09-12T02:54:32.752614+0000, chain.objs.size()=1 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.272__shadow_.GzAi--pqz4U0GBuifDoOoJXrbJO1Zj8_0 2024-09-12T01:07:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3326198724044285265', time=2024-09-12T02:54:40.468350+0000, chain.objs.size()=1 2024-09-12T01:07:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.283__shadow_.T-H3CcPtcYrdXKFAA7gPlBKyqi-zkhU_0 2024-09-12T01:07:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6937327670770026167', time=2024-09-12T02:54:57.156461+0000, chain.objs.size()=1 2024-09-12T01:07:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.304__shadow_.SVdTV2a4gHNSxKYthqopZ-vdUCF-JwE_0 2024-09-12T01:07:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2209962165976227952', time=2024-09-12T02:54:58.786175+0000, chain.objs.size()=1 2024-09-12T01:07:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.306__shadow_.IPQLj0ml7QdGdNjoE0uzCbWN3KXj3eS_0 2024-09-12T01:07:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9848299930092304174', time=2024-09-12T02:54:58.788737+0000, chain.objs.size()=1 2024-09-12T01:07:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.306__shadow_._1k7y7lWTTkxYq4KYnG2Cvr4nKA61L6_0 2024-09-12T01:07:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17009246994846953471', time=2024-09-12T02:55:31.032180+0000, chain.objs.size()=1 2024-09-12T01:07:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:25.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mocMbO4VzoInIBQM1zZ7Cb9x3s7fQbd_0 2024-09-12T01:07:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8392897531473827640', time=2024-09-12T02:55:31.075628+0000, chain.objs.size()=1 2024-09-12T01:07:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.noASd-e0JsM6o9aEA3kl5djJV1ZtGy9_0 2024-09-12T01:07:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12495414256946937263', time=2024-09-12T02:55:31.227425+0000, chain.objs.size()=1 2024-09-12T01:07:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1bJsCZJqJZ88o0NMOesBUqcYQjRjSms_0 2024-09-12T01:07:26.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18417267667175166421', time=2024-09-12T02:55:31.375064+0000, chain.objs.size()=1 2024-09-12T01:07:26.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MrBzWvxhK4nhYvvZrZuwu3d2bJkxYbg_0 2024-09-12T01:07:26.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9881763128268178988', time=2024-09-12T02:55:31.378309+0000, chain.objs.size()=1 2024-09-12T01:07:26.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.z2Sa213hpdBMn8gH_b4RvV5kjQ82C3u_0 2024-09-12T01:07:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2193396214335732700', time=2024-09-12T02:55:31.396907+0000, chain.objs.size()=1 2024-09-12T01:07:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KreRS4RClwDDvxi8Fyoy8n0LpG6Z77Q_0 2024-09-12T01:07:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10922840720294880266', time=2024-09-12T02:55:31.405134+0000, chain.objs.size()=1 2024-09-12T01:07:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.j6GSbk4baOs7Eqv_aM4Wmq-eSl7Invm_0 2024-09-12T01:07:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18445313722442997213', time=2024-09-12T02:55:31.414937+0000, chain.objs.size()=1 2024-09-12T01:07:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TEEWmbX3s3_ozyflXakb6A2dATgSJwx_0 2024-09-12T01:07:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16602718183987675635', time=2024-09-12T02:55:31.551026+0000, chain.objs.size()=1 2024-09-12T01:07:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.UFRrztVMKp8rBNnoRUotbV2apG8l_tF_0 2024-09-12T01:07:26.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17495447608657307199', time=2024-09-12T02:55:31.630113+0000, chain.objs.size()=1 2024-09-12T01:07:26.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hIZXVeWi9NyYqc2ETpjUdoY0ew2tjKW_0 2024-09-12T01:07:26.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17664227902785649691', time=2024-09-12T02:55:31.674097+0000, chain.objs.size()=1 2024-09-12T01:07:26.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.igXs_DAE2OuFls-h2DTtEGOeDxpXXVc_0 2024-09-12T01:07:26.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4964097693312795908', time=2024-09-12T02:55:31.898914+0000, chain.objs.size()=1 2024-09-12T01:07:26.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tJtbWHDXXgQEh5i2SeGqVX9OC5-lqfF_0 2024-09-12T01:07:26.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3603841328775515784', time=2024-09-12T02:55:31.922701+0000, chain.objs.size()=1 2024-09-12T01:07:26.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.NGJXaCBCjqMlJ4sLVdR4uh-hQwW_D0O_0 2024-09-12T01:07:26.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5458592696908296554', time=2024-09-12T02:55:31.941201+0000, chain.objs.size()=1 2024-09-12T01:07:26.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pS3dW04_bh4p-7i3GtVJe_nFgykB_D__0 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14304279443875046728', time=2024-09-12T02:55:31.973629+0000, chain.objs.size()=1 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9yEkhZUTUCKRYIsSMFOxBdeJxdbvXVJ_0 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8516304136790639077', time=2024-09-12T02:55:32.034249+0000, chain.objs.size()=1 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WNmvdJNI35_bcMQyuYnx6UOUMFYbMWN_0 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16822030527440988086', time=2024-09-12T02:55:32.099530+0000, chain.objs.size()=1 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.o898Guy7YvksA424bliITBonVFN9xIY_0 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14200736193391979242', time=2024-09-12T02:55:32.309559+0000, chain.objs.size()=1 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.35uoW6ssHhm0ipd4-7xh3vLICq2zB6W_0 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7799256808563156436', time=2024-09-12T02:55:32.344198+0000, chain.objs.size()=1 2024-09-12T01:07:26.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eVo_5WSQfnPXTWZdW7inb77fRvmK4dJ_0 2024-09-12T01:07:26.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.298563577768172370', time=2024-09-12T02:55:32.414260+0000, chain.objs.size()=1 2024-09-12T01:07:26.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9vdsnIG9Ee2XqpMp0MIv14-yusxz8EZ_0 2024-09-12T01:07:26.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11507026393850487612', time=2024-09-12T02:55:32.551518+0000, chain.objs.size()=1 2024-09-12T01:07:26.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hlRh-yJzAxfb01i4_eQCHnKIi6KkhsD_0 2024-09-12T01:07:26.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17081599143436046392', time=2024-09-12T02:55:32.651098+0000, chain.objs.size()=1 2024-09-12T01:07:26.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pfN006k-rWGUpLlloQ_X49ZOVLaCgtR_0 2024-09-12T01:07:26.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16155457897391394392', time=2024-09-12T02:55:32.659491+0000, chain.objs.size()=1 2024-09-12T01:07:26.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9ZfV0HDP3vQInKxaOYuML1lxt7JHaTF_0 2024-09-12T01:07:26.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11405475126132749220', time=2024-09-12T02:55:32.721540+0000, chain.objs.size()=1 2024-09-12T01:07:26.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1i_9msxt1929oEa-hGqJ2WVULXK6mhB_0 2024-09-12T01:07:26.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5659924070607558487', time=2024-09-12T02:55:32.743770+0000, chain.objs.size()=1 2024-09-12T01:07:26.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pMMe7xbQsNE-ncvBAJ5fUv3_52UBxPI_0 2024-09-12T01:07:26.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9964677343368420414', time=2024-09-12T02:55:32.852462+0000, chain.objs.size()=1 2024-09-12T01:07:26.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.JPqiIp2Ht5553CCNjQi8jvp9mn1d3jL_0 2024-09-12T01:07:26.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7999735663237535105', time=2024-09-12T02:55:32.912752+0000, chain.objs.size()=1 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zuANWR7xHW0il6dKo3Y-xmpRHp246yP_0 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15146008700628411616', time=2024-09-12T02:55:33.192868+0000, chain.objs.size()=1 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PKr0kwBaG3YhKYbWD4h0xEgWhRtG-1N_0 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9453493952689097627', time=2024-09-12T02:55:33.312947+0000, chain.objs.size()=1 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.nm4-Yf-6IpHN5i6CnxRZ2S57w6ffkRe_0 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.362457890312623737', time=2024-09-12T02:55:54.436461+0000, chain.objs.size()=1 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.tUaxT8CgB1z_QUbhBeMXJSGrG_HYYB4_0 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8096471171926637560', time=2024-09-12T02:55:54.453763+0000, chain.objs.size()=1 2024-09-12T01:07:26.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.i1ulHZd8rQqv5RScrDGTHzme8PrhqS1_0 2024-09-12T01:07:26.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6621666944239306277', time=2024-09-12T02:55:54.472114+0000, chain.objs.size()=1 2024-09-12T01:07:26.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HFi2NECR2ChLJfLzJLkOI13xoPu3mk3_0 2024-09-12T01:07:26.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.261780114109209413', time=2024-09-12T02:55:54.506188+0000, chain.objs.size()=1 2024-09-12T01:07:26.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.x1JoMb3yHdARBsVusJ2zg4KdPP-fruP_0 2024-09-12T01:07:26.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10911730525768091235', time=2024-09-12T02:55:54.582041+0000, chain.objs.size()=1 2024-09-12T01:07:26.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BGZPlT_m-P-traIBwa2vpdT2z6m3ImO_0 2024-09-12T01:07:26.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15912199347620337317', time=2024-09-12T02:55:54.602031+0000, chain.objs.size()=1 2024-09-12T01:07:26.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.53odMmmby9qVakh3bPGrzk4eByxNUPd_0 2024-09-12T01:07:26.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6167747769842959698', time=2024-09-12T02:55:54.649051+0000, chain.objs.size()=1 2024-09-12T01:07:26.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xx7AFbpjapQk1-zAn07yEaB3hhzgdpH_0 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16232875765471884250', time=2024-09-12T02:55:54.869867+0000, chain.objs.size()=1 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FiwDPOQHXLLguqRGJb-zKBxVEAuZDwZ_0 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8389023762781448306', time=2024-09-12T02:55:54.875009+0000, chain.objs.size()=1 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.aBR2L_BAL6x53EsYqPftfWu5pmsQ-Bo_0 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15529177886328713578', time=2024-09-12T02:55:54.878724+0000, chain.objs.size()=1 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.okYBQjWMtE3xMZZ57khBdrvuL_2VlBX_0 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4804647176248075166', time=2024-09-12T02:55:54.881944+0000, chain.objs.size()=1 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lVhCyKEdMul4QmT5JfY-3Z8yhvZvf7i_0 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5620747569883650068', time=2024-09-12T02:55:54.918357+0000, chain.objs.size()=1 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Q3bo_iBLSYLXzZoBPazNrTBTBVKaPij_0 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.650013627720581156', time=2024-09-12T02:55:54.925108+0000, chain.objs.size()=1 2024-09-12T01:07:26.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xYNpwJZnOjWntDKz7nPlu7Bwp7g5HqS_0 2024-09-12T01:07:26.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7353262155653935679', time=2024-09-12T02:55:54.984624+0000, chain.objs.size()=1 2024-09-12T01:07:26.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xVsPwouhoMqbEtVbeLVeGuSVflVNL40_0 2024-09-12T01:07:26.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4307293643389386359', time=2024-09-12T02:55:55.147935+0000, chain.objs.size()=1 2024-09-12T01:07:26.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.40topkzI-1i0yQxxIA6MTnqFRf5Y7f1_0 2024-09-12T01:07:26.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14229993200542835781', time=2024-09-12T02:55:55.201839+0000, chain.objs.size()=1 2024-09-12T01:07:26.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.cVvg_b0ifFqYl6cvVw4pTRns7FjVDSF_0 2024-09-12T01:07:26.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3428369030242639049', time=2024-09-12T02:55:55.232033+0000, chain.objs.size()=1 2024-09-12T01:07:26.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Tj_ol6yaFJqDPKDl22aJ_VyN0uenhiX_0 2024-09-12T01:07:26.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2310042421653565944', time=2024-09-12T02:55:55.237557+0000, chain.objs.size()=1 2024-09-12T01:07:26.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.N1mSAyTawhYQ6ojWiPiEVFJaQggoVNX_0 2024-09-12T01:07:26.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16024139230385102245', time=2024-09-12T02:55:55.248459+0000, chain.objs.size()=1 2024-09-12T01:07:26.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._vomUh4vEsOhiXJ7t0_-DiUGo0DlkGP_0 2024-09-12T01:07:26.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10590238102841846591', time=2024-09-12T02:55:55.537136+0000, chain.objs.size()=1 2024-09-12T01:07:26.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.C1PwOW6qv9ichffO2Dhwg1SO3dop38i_0 2024-09-12T01:07:26.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9207904770068742010', time=2024-09-12T02:55:55.885956+0000, chain.objs.size()=1 2024-09-12T01:07:26.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.q8-m-TaHgiiOri-VPQhxToFak2eN1MB_0 2024-09-12T01:07:26.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10822356494012293926', time=2024-09-12T02:55:55.997210+0000, chain.objs.size()=1 2024-09-12T01:07:26.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IftPCBw2blZ5DW6a3azzlMhLt-2elLV_0 2024-09-12T01:07:26.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8187129473378409683', time=2024-09-12T02:55:56.247226+0000, chain.objs.size()=1 2024-09-12T01:07:26.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ThWGHg7iIP_YCG9Ep9lrVg4CMJrn9uq_0 2024-09-12T01:07:26.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.784422938724007615', time=2024-09-12T02:55:56.285056+0000, chain.objs.size()=1 2024-09-12T01:07:26.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.67Yyx9QMJbgIhwFSsewnJ3Czrl3ewhD_0 2024-09-12T01:07:26.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17676494904266526174', time=2024-09-12T02:55:56.340974+0000, chain.objs.size()=1 2024-09-12T01:07:26.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZrR_fJIacIw_99BCXCugt56Awm_ALdW_0 2024-09-12T01:07:26.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16009913364890899640', time=2024-09-12T02:55:56.368621+0000, chain.objs.size()=1 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jqhG5l1aBo2G_9c2GcZVN6rkM6LLiRx_0 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6787541049626923986', time=2024-09-12T02:55:56.499787+0000, chain.objs.size()=1 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3aL-ytool9g6RcV4nlraGgaDcmYKRDV_0 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7942205872016004134', time=2024-09-12T02:55:56.533570+0000, chain.objs.size()=1 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8Ej7hykPmovYbZxor8YfrAulN4STLUz_0 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11324225833773812282', time=2024-09-12T02:55:56.542036+0000, chain.objs.size()=1 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Cj8yLVr8wWq7V5DRvm0s8s0F9-dHDel_0 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1414837487311608712', time=2024-09-12T02:55:56.550596+0000, chain.objs.size()=1 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._zjv0J3qhkw7_j0gMYvPmvnU_6nz-Ua_0 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2751753998726550120', time=2024-09-12T02:55:56.562014+0000, chain.objs.size()=1 2024-09-12T01:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.B3DI3g3P93n881oqKhD-EN2WIO8ELJc_0 2024-09-12T01:07:26.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46825 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5480330811047625335', time=2024-09-12T02:55:56.615678+0000, chain.objs.size()=1 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.d66TfqjGSupW-axMohxH554OFR-uyfc_0 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7423447439778326257', time=2024-09-12T02:55:56.648971+0000, chain.objs.size()=1 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dZNcKKuM47bdi7vaHhKLRbrjFeNIaiF_0 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8393953285646598724', time=2024-09-12T02:55:56.759186+0000, chain.objs.size()=1 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.cPr8yw2s4UGImKd76NGhgoVjAiMEBZl_0 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9635362111019038999', time=2024-09-12T02:55:56.881535+0000, chain.objs.size()=1 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mfT6fWr1vcgZ6PRIf_Qje9e1Y9BFXhU_0 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13859822474305273403', time=2024-09-12T02:56:02.281650+0000, chain.objs.size()=1 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.333__shadow_.n_DXQ2BjxKSDd0qvzv3NzOAP822yc_w_0 2024-09-12T01:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12460766306393580108', time=2024-09-12T02:57:22.548956+0000, chain.objs.size()=1 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.450__shadow_.Dmt5B-IGN-Q_b4wcVcwe_fjuB7Q-RmT_0 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15929516198564263067', time=2024-09-12T02:57:37.118960+0000, chain.objs.size()=1 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.466__shadow_.v9zDW2mHC55xn7qjQxhu71Jv2czafpb_0 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5756524447830639111', time=2024-09-12T02:58:42.845566+0000, chain.objs.size()=2 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~S7IDu2alODfVEQU-wTeBUByLPziesXV.1 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~S7IDu2alODfVEQU-wTeBUByLPziesXV.2 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.664915427572434547', time=2024-09-12T02:59:53.013413+0000, chain.objs.size()=1 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:2GKb0WV6SjBxuYo6Adp-iH6.aDhjpcC_.A6yCzVMj8yOJ4xe2Ymf7ckMk0mnf2Q1_0 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7784576568480573120', time=2024-09-12T02:59:57.285951+0000, chain.objs.size()=1 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:jotIqgrS4-.a5cVrCz65QZ3P0I.8eP7_.ZqdyEJQvL-kn4VA1L5MhpB1coBrUOiX_0 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12293693517793024641', time=2024-09-12T02:59:58.130236+0000, chain.objs.size()=1 2024-09-12T01:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:uYslLPcdv9RU5u4H2sMle3jgEAjybe0_.ayi6KFsKvZktyGSDoXufy8RqlW-M8BD_0 2024-09-12T01:07:26.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4559912619350547206', time=2024-09-12T03:00:15.206166+0000, chain.objs.size()=1 2024-09-12T01:07:26.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:cyCJEbMNwoaUzHEoloxcaiNMgoz.QIm_.LslNfF6AylzJDia4nmtwVbKpuNyjuuG_0 2024-09-12T01:07:26.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11278385823828880477', time=2024-09-12T03:00:20.903314+0000, chain.objs.size()=1 2024-09-12T01:07:26.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:XT7M39nn234Zn8XASr7QFOM65B6rRUZ_.Cmw6tYl6Zi1ANfkrFmbuynxYuJibnTv_0 2024-09-12T01:07:26.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17889985616658953888', time=2024-09-12T03:00:41.660227+0000, chain.objs.size()=1 2024-09-12T01:07:26.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.586__shadow:Z05lB..iGEUVx5PjJ.4pPry13xV-fFW_.GjE5uZQeDLGLqobZqTH-s2UZzIBDSmv_0 2024-09-12T01:07:26.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13538280770538616508', time=2024-09-12T03:00:42.258749+0000, chain.objs.size()=1 2024-09-12T01:07:26.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:PuvB2cUzHR7a8b4F8O-8v50wp-KkSdO_.LGIZLFQGTl9afjb1T4JiodxPc2Zz5y6_0 2024-09-12T01:07:26.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8882803090375931754', time=2024-09-12T03:00:42.313511+0000, chain.objs.size()=1 2024-09-12T01:07:26.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:xlqGjhN8EoYaQeMTSxl-L.TauD-maLS_.XVPj8Qi_tDBms8isMhXOrDh2HDPcFhg_0 2024-09-12T01:07:26.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9267356507623328387', time=2024-09-12T03:03:52.643253+0000, chain.objs.size()=1 2024-09-12T01:07:26.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.664__shadow_.hiwPvEYBGK0Y-d2agkEOU2H83zYBm8t_0 2024-09-12T01:07:26.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2520223696260189541', time=2024-09-12T03:03:54.594157+0000, chain.objs.size()=1 2024-09-12T01:07:26.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.666__shadow_.i9OLHTWKQtXipWC5ah8FErd8XYMx8S2_0 2024-09-12T01:07:26.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7776745519098181382', time=2024-09-12T03:04:08.665262+0000, chain.objs.size()=1 2024-09-12T01:07:26.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.691__shadow_.I9hB_PJYra9pZDW7sytaMkD_Dp6Wv5m_0 2024-09-12T01:07:26.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.040+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:07:26.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52164' 2024-09-12T01:07:26.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4097569350436693415', time=2024-09-12T02:53:41.241147+0000, chain.objs.size()=1 2024-09-12T01:07:26.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.234__shadow_.bUiKBUzPeqXr3ClXW1F0A_8zVCOaFaD_0 2024-09-12T01:07:26.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17363185267674403297', time=2024-09-12T02:53:41.981044+0000, chain.objs.size()=1 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.235__shadow_.ZxpCEwQIsjZXFNO9eoe6ZRVND1SVn5S_0 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2460524953203515911', time=2024-09-12T02:53:43.849180+0000, chain.objs.size()=1 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.237__shadow_.UPHty-qeTi4VeA4eBB4KLQBXdorldkl_0 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7732467147860267030', time=2024-09-12T02:53:45.023733+0000, chain.objs.size()=1 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.238__shadow_.D7Q0Hf88EHcVxQp-OHE5ekqW1maj2WU_0 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4374969682756818286', time=2024-09-12T02:53:51.493911+0000, chain.objs.size()=1 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.246__shadow_.vSLdsJlw8obYs18jSVRFbGPygBYHgQo_0 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11300004650760546467', time=2024-09-12T02:53:54.252798+0000, chain.objs.size()=1 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.250__shadow_.rKQ-Hr-_Ln190Ghl3oLi7Bxwi3F0YvH_0 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5496647721355570277', time=2024-09-12T02:53:54.254861+0000, chain.objs.size()=1 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.250__shadow_.XUmupOeMVb9-i_Tcd70_pVB5olL3rWs_0 2024-09-12T01:07:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9771617112761918480', time=2024-09-12T02:54:23.032981+0000, chain.objs.size()=1 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mMew4g7Tg6vFOgfZCPXIO0H-SJ6THNc_0 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2072083220095688129', time=2024-09-12T02:54:23.065504+0000, chain.objs.size()=1 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5q8N6IKVZhVoigWX1KyZ8EUDkc-MsXZ_0 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7424010162207062177', time=2024-09-12T02:54:23.069378+0000, chain.objs.size()=1 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Y8B8bxdbb46U28Sdq8x3w-M3IE5J_JV_0 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3539617701331564161', time=2024-09-12T02:54:23.217063+0000, chain.objs.size()=1 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gL61wsbYW0RhdxtuFVFoFfDffZnedqN_0 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7170449868077286516', time=2024-09-12T02:54:23.414211+0000, chain.objs.size()=1 2024-09-12T01:07:26.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5nhDsGtElBxNwtsZlDXUAT03_5k-Yay_0 2024-09-12T01:07:26.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13537738818734262004', time=2024-09-12T02:54:23.476730+0000, chain.objs.size()=1 2024-09-12T01:07:26.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5YGaSUUwvfylHi1Z7itCGcnL5vHKX86_0 2024-09-12T01:07:26.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15852488475481088337', time=2024-09-12T02:54:23.481916+0000, chain.objs.size()=1 2024-09-12T01:07:26.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.a0GVl4ekLRvHXmRZhwgXp5vEoeex3lA_0 2024-09-12T01:07:26.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17197396677902307695', time=2024-09-12T02:54:23.485946+0000, chain.objs.size()=1 2024-09-12T01:07:26.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hm0FY6j1NJ0pLrsFTg4oA6oZeA53SDb_0 2024-09-12T01:07:26.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3339456111931643965', time=2024-09-12T02:54:23.508380+0000, chain.objs.size()=1 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8HVSXhmt3Qidj6CR4zR73oIgQD51xqy_0 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11494776020465601902', time=2024-09-12T02:54:23.513657+0000, chain.objs.size()=1 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.tDtfq0DuLjk515Otlc4DyXS5oWAP0Dt_0 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9169055572036409386', time=2024-09-12T02:54:23.534942+0000, chain.objs.size()=1 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3ARmYiCCTnihm72v_W2rXKjFBUDePUc_0 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5689152067174778643', time=2024-09-12T02:54:23.549048+0000, chain.objs.size()=1 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.oj_f_PVKXIMbGgF7bU9NcKKRMEWYMrh_0 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6272828012170328750', time=2024-09-12T02:54:23.557836+0000, chain.objs.size()=1 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9hcqorIobvUPw18jtcyBDhXnDPAtI-5_0 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11804644287581607413', time=2024-09-12T02:54:23.563245+0000, chain.objs.size()=1 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HCbF8srx245-mht7Pl6QtNQ-QsfjK9K_0 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8508540909767553985', time=2024-09-12T02:54:23.749633+0000, chain.objs.size()=1 2024-09-12T01:07:26.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Na2A5PqJOJjMqoeuxbEeAYq2rBeFZ5b_0 2024-09-12T01:07:26.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16663218857401078014', time=2024-09-12T02:54:23.755479+0000, chain.objs.size()=1 2024-09-12T01:07:26.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.91rYDEv3HahzXXiSV-nDagU8DmaKa67_0 2024-09-12T01:07:26.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14756802822434359232', time=2024-09-12T02:54:23.765560+0000, chain.objs.size()=1 2024-09-12T01:07:26.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RckhfRE0wozRpLhz4zeQdlgaDclM6tP_0 2024-09-12T01:07:26.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7988446397237955410', time=2024-09-12T02:54:24.112494+0000, chain.objs.size()=1 2024-09-12T01:07:26.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.lS30nz1JNJOFZy6nth82rg7lWARnCVU_0 2024-09-12T01:07:26.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11224470707517558037', time=2024-09-12T02:54:24.123724+0000, chain.objs.size()=1 2024-09-12T01:07:26.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.lN4Izxdj9B1lbuP8iOZqL3-gCQIfFoQ_0 2024-09-12T01:07:26.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9026801074655109090', time=2024-09-12T02:54:24.130068+0000, chain.objs.size()=1 2024-09-12T01:07:26.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6G4MXDNFsHCjAq1aLSciBK96as8wxCu_0 2024-09-12T01:07:26.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1562437130500748946', time=2024-09-12T02:54:24.142912+0000, chain.objs.size()=1 2024-09-12T01:07:26.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.w3v4nRslqGxvTig0v63UEH3kHaNIrkb_0 2024-09-12T01:07:26.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.471699805980637180', time=2024-09-12T02:54:24.186676+0000, chain.objs.size()=1 2024-09-12T01:07:26.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Pva77Vk6v67aow17slZs0nt9w9nBUwB_0 2024-09-12T01:07:26.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7903387262980124042', time=2024-09-12T02:54:24.215650+0000, chain.objs.size()=1 2024-09-12T01:07:26.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.J3FMgfXjhuDV42N4-RexVggqtPt0j0m_0 2024-09-12T01:07:26.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11120130764431400281', time=2024-09-12T02:54:24.399404+0000, chain.objs.size()=1 2024-09-12T01:07:26.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GXzvFN8Eg67sKw6gComMM-IEkrYkjhG_0 2024-09-12T01:07:26.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3977278405349793287', time=2024-09-12T02:54:24.473871+0000, chain.objs.size()=1 2024-09-12T01:07:26.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IjoxNm0XqFiehFG5KvaAungbg0-qsZt_0 2024-09-12T01:07:26.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1412957928342511427', time=2024-09-12T02:54:24.503629+0000, chain.objs.size()=1 2024-09-12T01:07:26.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xqCgfrSJnoQqWvlWQmysTVUpn4c-xSj_0 2024-09-12T01:07:26.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10610230816660394709', time=2024-09-12T02:54:24.750080+0000, chain.objs.size()=1 2024-09-12T01:07:26.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RuWjEDflCioT2MHp4h78iCAS5qKr2i6_0 2024-09-12T01:07:26.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10300344989433185017', time=2024-09-12T02:54:24.987539+0000, chain.objs.size()=1 2024-09-12T01:07:26.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.YmTgax3itGEKinX27FgiwYGv1pLGNW-_0 2024-09-12T01:07:26.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14197899875726010073', time=2024-09-12T02:54:24.994663+0000, chain.objs.size()=1 2024-09-12T01:07:26.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.tEnNQ8yQFEE8M2DfGYaxiSxNXbiOzIc_0 2024-09-12T01:07:26.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12666412405790754936', time=2024-09-12T02:54:25.122632+0000, chain.objs.size()=1 2024-09-12T01:07:26.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WEfT1XPSXOUtU-V5_jzujQuI2UqU9cU_0 2024-09-12T01:07:26.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2250012478192011130', time=2024-09-12T02:54:25.137920+0000, chain.objs.size()=1 2024-09-12T01:07:26.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FSaQY-lc_xKM1SgdXEK8Z_BSefUMY0t_0 2024-09-12T01:07:26.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14337762439857597749', time=2024-09-12T02:54:25.258147+0000, chain.objs.size()=1 2024-09-12T01:07:26.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Xg0tn9CPPRmbp5kZxIzVGeGi6FvJduc_0 2024-09-12T01:07:26.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7192518639303881872', time=2024-09-12T02:54:25.348529+0000, chain.objs.size()=1 2024-09-12T01:07:26.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DjgL2Meql85t2ywYrbdJ0sijnH1mXb5_0 2024-09-12T01:07:26.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12049109678919823193', time=2024-09-12T02:54:25.355404+0000, chain.objs.size()=1 2024-09-12T01:07:26.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ys8yq7s1nRvQIdmVRJAngWSzJemLQPU_0 2024-09-12T01:07:26.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7373859998592665108', time=2024-09-12T02:54:25.560540+0000, chain.objs.size()=1 2024-09-12T01:07:26.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fOGP8BIKXkZtrkCKGgejKVVxPQd8Sqj_0 2024-09-12T01:07:26.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.204293522006790990', time=2024-09-12T02:54:25.616619+0000, chain.objs.size()=1 2024-09-12T01:07:26.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xyF0Pz1vPQUY8WRX89P3SvIcuUnK3r5_0 2024-09-12T01:07:26.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6561830774038626559', time=2024-09-12T02:54:26.025395+0000, chain.objs.size()=1 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.l2AyAyoTsYyRPPvUtVFZ7Q6OjGVkKHc_0 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10975471109492614597', time=2024-09-12T02:54:26.033101+0000, chain.objs.size()=1 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ei4o21mqNa51UEZhTZ_i9tFXdZt3G2e_0 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14170296023013975582', time=2024-09-12T02:54:26.628296+0000, chain.objs.size()=1 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.263__shadow_.G2iAOOYE0P7zZuuKGYPdcLkUDFb30Is_0 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14942884494765863609', time=2024-09-12T02:54:32.752072+0000, chain.objs.size()=1 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.272__shadow_.BdKali_lN5gNF9EmxnYE2P60X44phWI_0 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5853323421600629075', time=2024-09-12T02:54:47.929485+0000, chain.objs.size()=1 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.PEr5Buuaaov4QJQ-qNe4n-NRbcnow2v_0 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14455538157251260362', time=2024-09-12T02:54:47.970125+0000, chain.objs.size()=1 2024-09-12T01:07:26.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.h5FZl5Xv8wFZLagShngeDCrn0HQaMhp_0 2024-09-12T01:07:26.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1465980844115563263', time=2024-09-12T02:54:59.865599+0000, chain.objs.size()=1 2024-09-12T01:07:26.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.307__shadow:EObUhXtcwVdnUiv0siSY.Q.eWJi6SmN_.apzeoVNiXIvQg5XVSzo08254Cd-uRaa_0 2024-09-12T01:07:26.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7822852446169434269', time=2024-09-12T02:55:08.010681+0000, chain.objs.size()=1 2024-09-12T01:07:26.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.319__shadow:5IxnPhS-UeqNtdzx8wLSHxlt2QrVGpz_.mTfVwtnPolDvFGa5EjSykMg5qddiodX_0 2024-09-12T01:07:26.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6742911617899939106', time=2024-09-12T02:55:30.901945+0000, chain.objs.size()=1 2024-09-12T01:07:26.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0BeCVBJ-SGiu1UmPw7vmHOyPloLKDAk_0 2024-09-12T01:07:26.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2264209326660092799', time=2024-09-12T02:55:31.004602+0000, chain.objs.size()=1 2024-09-12T01:07:26.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zFvvvQqMnIx395v8GXVPRdxul-FrkYM_0 2024-09-12T01:07:26.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11334167107296458488', time=2024-09-12T02:55:31.065654+0000, chain.objs.size()=1 2024-09-12T01:07:26.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TALIGiC5LJYZ51d-Tond8r06kfu9uSE_0 2024-09-12T01:07:26.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1940997535413558758', time=2024-09-12T02:55:31.337152+0000, chain.objs.size()=1 2024-09-12T01:07:26.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.A2D_CC9Sa4ydNQSkr-vcc5lIeJIANv4_0 2024-09-12T01:07:26.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7963379122668662160', time=2024-09-12T02:55:31.358873+0000, chain.objs.size()=1 2024-09-12T01:07:26.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7XEQsWq5dst6iIbcTjaD59CEp2VYK-X_0 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4251968325808024732', time=2024-09-12T02:55:31.378384+0000, chain.objs.size()=1 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.c0G84fYw1alNyJr3X3Gk6RhkvClNwnI_0 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2413546862508446814', time=2024-09-12T02:55:31.681842+0000, chain.objs.size()=1 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eRm9Uju6aFy7zyrNAve5wsRlrxw1UBi_0 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15804753322156271826', time=2024-09-12T02:55:31.723774+0000, chain.objs.size()=1 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PJOQJkEg9pEwFEwHwVWtBMqJ6BHtd7F_0 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4279895014410659166', time=2024-09-12T02:55:31.729003+0000, chain.objs.size()=1 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KLAKu4_O5tnQIWDFsyVJ_yMCFgV85hj_0 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16981169966180072254', time=2024-09-12T02:55:31.734221+0000, chain.objs.size()=1 2024-09-12T01:07:26.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.i8vsi9qflee9lDY18SU9t2TsOsvk-my_0 2024-09-12T01:07:26.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11907092246261046826', time=2024-09-12T02:55:31.895880+0000, chain.objs.size()=1 2024-09-12T01:07:26.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._h1mKbuQ92WFXYDfLmucAqDxzNENKd8_0 2024-09-12T01:07:26.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8891044138397326605', time=2024-09-12T02:55:31.905824+0000, chain.objs.size()=1 2024-09-12T01:07:26.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ry0PUtC-a98SkHfjMiDFFRQGvnurqzP_0 2024-09-12T01:07:26.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7272308986427480623', time=2024-09-12T02:55:31.948345+0000, chain.objs.size()=1 2024-09-12T01:07:26.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OY0F_oUBHQ38a0j59OlPeqdy3bWT1co_0 2024-09-12T01:07:26.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3651201221428656910', time=2024-09-12T02:55:32.015972+0000, chain.objs.size()=1 2024-09-12T01:07:26.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.L9H51CLABKLhXisLMpBBf9RqXacr4kk_0 2024-09-12T01:07:26.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.342957914030548722', time=2024-09-12T02:55:32.034136+0000, chain.objs.size()=1 2024-09-12T01:07:26.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WYSzojSKkdzeSJt1gmIr2knLVrBDcuy_0 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6538448529257362430', time=2024-09-12T02:55:32.043368+0000, chain.objs.size()=1 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1-jxfRZycIwOMInmVKDUfnuo8DyrR_A_0 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12733778021820188454', time=2024-09-12T02:55:32.052131+0000, chain.objs.size()=1 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IrHVls9MB55nhXDgvqIl_3eAHgf4PCg_0 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14492043027823939276', time=2024-09-12T02:55:32.089524+0000, chain.objs.size()=1 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.l8D872SWHNF6Tbh98yS6TtDpO_AYdJs_0 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2576130990759365492', time=2024-09-12T02:55:32.220810+0000, chain.objs.size()=1 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.JHNSyE-uGqQ9Rk2m2oWnI9Gai2ONgAc_0 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14164556944018004618', time=2024-09-12T02:55:32.276635+0000, chain.objs.size()=1 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.AZ2__Y4JLTF1pHGt2S8iCW0L0iWWvzn_0 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17132562496752030483', time=2024-09-12T02:55:32.280358+0000, chain.objs.size()=1 2024-09-12T01:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.elXzWUbsVZSMKCPtvQSlZHMyW0pS00h_0 2024-09-12T01:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12632231796433513706', time=2024-09-12T02:55:32.333791+0000, chain.objs.size()=1 2024-09-12T01:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.JHgDgfE0KQUnuxUWk6QG9N-KMJPduxJ_0 2024-09-12T01:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4234125992240718535', time=2024-09-12T02:55:32.430503+0000, chain.objs.size()=1 2024-09-12T01:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.FWPsnNMhQaIi0fzCebSADUPjPhPqF_c_0 2024-09-12T01:07:26.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4881611691950399941', time=2024-09-12T02:55:32.606189+0000, chain.objs.size()=1 2024-09-12T01:07:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.K0S-L7zvQ1pTbk7rImWkRCAXaN70NMC_0 2024-09-12T01:07:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6278407944202728790', time=2024-09-12T02:55:32.611310+0000, chain.objs.size()=1 2024-09-12T01:07:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.D__fIfhYcNYEU_cfrlsIcFNtpsalEA9_0 2024-09-12T01:07:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8106375474081484918', time=2024-09-12T02:55:32.619759+0000, chain.objs.size()=1 2024-09-12T01:07:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kDvDQducdW7jt9f8diYddLMFN3ix80C_0 2024-09-12T01:07:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1946820890917324060', time=2024-09-12T02:55:32.665427+0000, chain.objs.size()=1 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Nt3zdH6uj3Ikwx4lO8U0fs2lAh2zsHG_0 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6228315492515505643', time=2024-09-12T02:55:32.694640+0000, chain.objs.size()=1 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.c8WmiZ1-xiROIUxzzDCCuECVA-xw_IO_0 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8472030485758703613', time=2024-09-12T02:55:32.875437+0000, chain.objs.size()=1 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.oc7ldRteJG_6aMDZu6kU5SklKTiqzt7_0 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11244676547871080493', time=2024-09-12T02:55:32.907592+0000, chain.objs.size()=1 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KYMNWvk8PlHBnlUSjHmDWI7VK0Oyhcx_0 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.791688546942089935', time=2024-09-12T02:55:32.962573+0000, chain.objs.size()=1 2024-09-12T01:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.37HI6XIgYYLg0phQRiMPPKNC_op1ij0_0 2024-09-12T01:07:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4276957910253429801', time=2024-09-12T02:55:32.965030+0000, chain.objs.size()=1 2024-09-12T01:07:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6kKPvzWQR9QCCCDDvY0s7e0V7QC16sL_0 2024-09-12T01:07:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6631815092923108138', time=2024-09-12T02:55:33.188297+0000, chain.objs.size()=1 2024-09-12T01:07:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lEZCO_5FSspPZij6pOjWCZ8F9Mq6Wc4_0 2024-09-12T01:07:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6519283951743571020', time=2024-09-12T02:55:33.250352+0000, chain.objs.size()=1 2024-09-12T01:07:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4iQeA1vIMMnYJ0PB6_rvlUqtfzl15vV_0 2024-09-12T01:07:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18257079618997318300', time=2024-09-12T02:55:33.290315+0000, chain.objs.size()=1 2024-09-12T01:07:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.BC48cr2D5hutriUHJO-bWhXTRTLtRXw_0 2024-09-12T01:07:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2318760942778213974', time=2024-09-12T02:55:54.464985+0000, chain.objs.size()=1 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.q8JeMoQbHrkDRv4O_DAT3Hen_wl6t3S_0 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14911418418323885112', time=2024-09-12T02:55:54.838274+0000, chain.objs.size()=1 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1aAhE2MlgUw7SuRrW3eOlAwDvk-g8a2_0 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16464270603609669589', time=2024-09-12T02:55:54.906333+0000, chain.objs.size()=1 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.36aSinzNDwjDZXkRFEIqF8jcRGWU7Ie_0 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11868486536125076248', time=2024-09-12T02:55:54.911457+0000, chain.objs.size()=1 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GosME_UdizsjuV37wywW3G1n3onEb1A_0 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14323716848436405876', time=2024-09-12T02:55:55.480143+0000, chain.objs.size()=1 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hhtfbToqeP9PJlaYovkvQDLwyvmQXL-_0 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3396649076297090086', time=2024-09-12T02:55:55.482751+0000, chain.objs.size()=1 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6ddgfROBHRtOX-TWgwhFtl9icF9xnGT_0 2024-09-12T01:07:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6664084250782024580', time=2024-09-12T02:55:55.502203+0000, chain.objs.size()=1 2024-09-12T01:07:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4HVb9zILoamUz8PARiz0ASR1RmbOgwg_0 2024-09-12T01:07:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6134518838196518554', time=2024-09-12T02:55:55.536174+0000, chain.objs.size()=1 2024-09-12T01:07:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.un2WntFdHArBysDt2WaeaWIVm0gvS4f_0 2024-09-12T01:07:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11494085706444951440', time=2024-09-12T02:55:55.618179+0000, chain.objs.size()=1 2024-09-12T01:07:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8n7c6bI5kfu8FSIQN0zBPhh8PtGQTHl_0 2024-09-12T01:07:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.169686719709613768', time=2024-09-12T02:55:55.627358+0000, chain.objs.size()=1 2024-09-12T01:07:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Qp_5wFxnpk8WjhSbFYIulMoRGUyxGsJ_0 2024-09-12T01:07:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6014381175249485819', time=2024-09-12T02:55:55.656969+0000, chain.objs.size()=1 2024-09-12T01:07:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.csmACtC6W6_Ui1cmhyGHOHNz0fNyRvA_0 2024-09-12T01:07:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2667867698218686943', time=2024-09-12T02:55:55.836238+0000, chain.objs.size()=1 2024-09-12T01:07:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7kUibq-WYpFlJ3Q9zSMSHir6Pxy197T_0 2024-09-12T01:07:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14176306788734773741', time=2024-09-12T02:55:55.840056+0000, chain.objs.size()=1 2024-09-12T01:07:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.cOk-5JBQgAakgPDReeATgWeJC8icnj6_0 2024-09-12T01:07:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8637760094430840764', time=2024-09-12T02:55:55.959429+0000, chain.objs.size()=1 2024-09-12T01:07:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WAF3OD9n93t6Ld8J6a1_bxJZzUbzTwM_0 2024-09-12T01:07:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.088+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52164 2024-09-12T01:07:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:07:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10818895603757025178', time=2024-09-12T02:55:56.015606+0000, chain.objs.size()=1 2024-09-12T01:07:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vRCAq1E3NL65RjzCgk0WMCPwx_RAf0R_0 2024-09-12T01:07:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17706714738950551581', time=2024-09-12T02:55:56.196585+0000, chain.objs.size()=1 2024-09-12T01:07:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IC8OzmissJiz8wBhJ-B0-H_6cx7BEAl_0 2024-09-12T01:07:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10781198432342771628', time=2024-09-12T02:55:56.215498+0000, chain.objs.size()=1 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vewOKXtXHiGDZrxCUyhgwRNuCABSj9x_0 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5319965557574897013', time=2024-09-12T02:55:56.216590+0000, chain.objs.size()=1 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fSfNXe-uemHPGAvlxRgILUdQnZ08uwS_0 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14325100659073394952', time=2024-09-12T02:55:56.242197+0000, chain.objs.size()=1 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.EF65gOoKq9tB2jZgdmoFrHGuyPf6r5e_0 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4668876047159798804', time=2024-09-12T02:55:56.295020+0000, chain.objs.size()=1 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7jlLywdu7PpgHcX2iBZLAMALLlDTIIv_0 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.68350311559715285', time=2024-09-12T02:55:56.358468+0000, chain.objs.size()=1 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.rCzzsWhbANFhnAsjfLcP-zSuPdHZhFY_0 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7827134523417977011', time=2024-09-12T02:55:56.497854+0000, chain.objs.size()=1 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Hr4E5qvEj-42jffIVVVEDBpEANjpcuz_0 2024-09-12T01:07:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7094821323144342530', time=2024-09-12T02:55:56.532924+0000, chain.objs.size()=1 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sladFWGWtNASE5x-j0ycVFnk6-Grov4_0 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11937298506594692014', time=2024-09-12T02:55:56.549200+0000, chain.objs.size()=1 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.AdFd4kuXeBy1Uk9NV1OXJXu7XZOZdR1_0 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5187099202024546907', time=2024-09-12T02:55:56.567396+0000, chain.objs.size()=1 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-Q3fgHGuuQe4yrQU8AdCKshkrToHtnc_0 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15343119658259654602', time=2024-09-12T02:55:56.656534+0000, chain.objs.size()=1 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.s7kaO9BXmvzj38RHZEQbtlnR7b-TATY_0 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2982486395252047678', time=2024-09-12T02:55:56.773442+0000, chain.objs.size()=1 2024-09-12T01:07:26.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ezy9w2K754PWrm6BATYbgsyVS4_u8VQ_0 2024-09-12T01:07:26.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18141780742726279021', time=2024-09-12T02:55:56.804852+0000, chain.objs.size()=1 2024-09-12T01:07:26.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qt4UHq8TP__z3A2qVUoOVvh7AVH5lNe_0 2024-09-12T01:07:26.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18270470654427885808', time=2024-09-12T02:55:56.854623+0000, chain.objs.size()=1 2024-09-12T01:07:26.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3kfllDIBB0FBTIPHcxHYSefG3DuYlKr_0 2024-09-12T01:07:26.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14207375272647849300', time=2024-09-12T02:55:59.237782+0000, chain.objs.size()=1 2024-09-12T01:07:26.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.328__shadow_.aPZhR14naBB-eRj-nWznJitG5Hp4CsA_0 2024-09-12T01:07:26.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9887485712313170459', time=2024-09-12T02:57:30.381554+0000, chain.objs.size()=1 2024-09-12T01:07:26.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.459__shadow_.HiXyyeH_5us2SYEvPy3oQTGItJ6erVS_0 2024-09-12T01:07:26.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16036196704541780424', time=2024-09-12T02:58:09.505723+0000, chain.objs.size()=1 2024-09-12T01:07:26.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.517__shadow_.vqsTxKhI5xWRqKP0Ys4L44CSE6MypLM_0 2024-09-12T01:07:26.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14746484271737095468', time=2024-09-12T02:59:55.253652+0000, chain.objs.size()=1 2024-09-12T01:07:26.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:noupQYjlgcgRqM83mLMMipvzzQcBn-N_.cCNixPxz1CSEV5-zDRH3Uqzv9XfVLyS_0 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3924797346891076023', time=2024-09-12T03:00:07.294858+0000, chain.objs.size()=1 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow:DVRlTqwPgZJ99qSIQIYAdtLczR5P.37_.8tUkckqtKrtJXsXHhqSGGWH3k2JA0i5_0 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14699096195288009170', time=2024-09-12T03:00:19.501237+0000, chain.objs.size()=1 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:ND0qF9K7Xzw18JxWatjOIRkWNJ5kmyC_.x-l4Pr4Ht9zMHdI_48GT7hu5fa2TWKT_0 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4784764811740304453', time=2024-09-12T03:00:28.590368+0000, chain.objs.size()=1 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:PKiiKCC-9fwS51a.bzWGuRHXa4myJzS_.jCZIDD6fCgk8fRWUf2aqVxAtyrAfH29_0 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8108408345255422326', time=2024-09-12T03:00:35.175343+0000, chain.objs.size()=1 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:CxIlvH4vYG.AQx8Dqx9gCHj71lAuiZp_.39aConWa7BHJLbO95V_khXRnk9tZM3l_0 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.911455587818425765', time=2024-09-12T03:00:36.949622+0000, chain.objs.size()=1 2024-09-12T01:07:26.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:jtKEtOLS43kp.2pO8svYPd3j0R8MyKK_.xrdWwwhmVkC7mZTJ44ZRqj0taSzUiIO_0 2024-09-12T01:07:26.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4200832014953039668', time=2024-09-12T03:03:23.532314+0000, chain.objs.size()=1 2024-09-12T01:07:26.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.627__shadow_.O3DzJlls1eyIHwFEIzlNw-yHalTWk8P_0 2024-09-12T01:07:26.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:07:26.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50118' 2024-09-12T01:07:26.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11723688805497164476', time=2024-09-12T02:51:30.521606+0000, chain.objs.size()=5 2024-09-12T01:07:26.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-LUKEWARM.2~5zchCQZQAGtlD2ddB5_38N4xTjw_d8g.1 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__shadow_mymultipart-LUKEWARM.2~5zchCQZQAGtlD2ddB5_38N4xTjw_d8g.1_1 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-LUKEWARM.2~5zchCQZQAGtlD2ddB5_38N4xTjw_d8g.2 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__shadow_mymultipart-LUKEWARM.2~5zchCQZQAGtlD2ddB5_38N4xTjw_d8g.2_1 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159__multipart_mymultipart-LUKEWARM.2~5zchCQZQAGtlD2ddB5_38N4xTjw_d8g.3 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.61152381818409260', time=2024-09-12T02:51:31.390644+0000, chain.objs.size()=3 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.dtHE3JefvSA1til0rz0RIj0oghSSLMJ_0 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.dtHE3JefvSA1til0rz0RIj0oghSSLMJ_1 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.dtHE3JefvSA1til0rz0RIj0oghSSLMJ_2 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9419365325727821715', time=2024-09-12T02:52:10.923204+0000, chain.objs.size()=1 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.200__shadow_.S8ZGq-O-mUd4hjN4uBYWxNnd2Ki8xh__0 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.302103088015008642', time=2024-09-12T02:53:47.047307+0000, chain.objs.size()=1 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.241__shadow_.U5iC6-FyW2QRCMHEVg5cdEKcjAwHNh-_0 2024-09-12T01:07:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6853221133353205575', time=2024-09-12T02:53:50.780195+0000, chain.objs.size()=1 2024-09-12T01:07:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.245__shadow_.pzIu1o3NKzgmioypulnVuyUdUt6mFxS_0 2024-09-12T01:07:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5097573393526716564', time=2024-09-12T02:53:55.672319+0000, chain.objs.size()=1 2024-09-12T01:07:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.252__shadow_.hFPGwioUQRqAiXsG0DNt2u6Onmjiwre_0 2024-09-12T01:07:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13528111395960337195', time=2024-09-12T02:53:56.424318+0000, chain.objs.size()=1 2024-09-12T01:07:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.253__shadow_.D415yWm5YgiLZcG9i5fVTA4s4jdVgba_0 2024-09-12T01:07:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3603191570300920227', time=2024-09-12T02:53:59.199265+0000, chain.objs.size()=1 2024-09-12T01:07:26.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.257__shadow_.IRmYWUag5ac3qMzD77Q6whb93iJltxB_0 2024-09-12T01:07:26.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7971100316665363877', time=2024-09-12T02:54:23.106951+0000, chain.objs.size()=1 2024-09-12T01:07:26.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._wM_EwZbaWyhfYuHU_epnqsOSDa1TFG_0 2024-09-12T01:07:26.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10615611705465774379', time=2024-09-12T02:54:23.107741+0000, chain.objs.size()=1 2024-09-12T01:07:26.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.EKH-QzbL-Ax5vldOVou-c4c7gp_jRYa_0 2024-09-12T01:07:26.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5319511006891479156', time=2024-09-12T02:54:23.140384+0000, chain.objs.size()=1 2024-09-12T01:07:26.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eeA_jB0Z_Vc-iY3SMwJ4uuW0NnrsXgU_0 2024-09-12T01:07:26.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9320826481450717563', time=2024-09-12T02:54:23.153273+0000, chain.objs.size()=1 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vjyf336Ebfm3JkRPD0jGwYRM-M6RIIM_0 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18114237112369464815', time=2024-09-12T02:54:23.193290+0000, chain.objs.size()=1 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._bps-5LQn-08ZKWLrlnHoxHzQGTmVAW_0 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.73613564585280521', time=2024-09-12T02:54:23.210839+0000, chain.objs.size()=1 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.odPFbYdEqpdSd6k_fXbdEqA63kfPQpq_0 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12038293030524955638', time=2024-09-12T02:54:23.403759+0000, chain.objs.size()=1 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.BXz3Gh52DRF1iPe1WR3ffxsGzMI5igd_0 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13041709423917491569', time=2024-09-12T02:54:23.453739+0000, chain.objs.size()=1 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pqteI3T0GreAeV5hbeNtIJ5ldLyuyqg_0 2024-09-12T01:07:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6225019601162559050', time=2024-09-12T02:54:24.312812+0000, chain.objs.size()=1 2024-09-12T01:07:26.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zcVX2JBSZmNgS-k7WGZVcM71YsHpsUv_0 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6240848393207505292', time=2024-09-12T02:54:24.502962+0000, chain.objs.size()=1 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.If5oP_unw-IhiPDHSvbY9TmqevZl8-1_0 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1568198824823990453', time=2024-09-12T02:54:24.510053+0000, chain.objs.size()=1 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CvND-W7JpkHh4fhrgs5Qc4qe7PjjGD0_0 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12106440774809423986', time=2024-09-12T02:54:24.845650+0000, chain.objs.size()=1 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Urp1nCsp2VDxwwSImS8EPj0sJan7Wxc_0 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14139143788730733476', time=2024-09-12T02:54:24.964862+0000, chain.objs.size()=1 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pkCe9qFCb5uEmMXvv-WXC-H7eRy21SK_0 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16182413900756719237', time=2024-09-12T02:54:24.981584+0000, chain.objs.size()=1 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.h4o3rph_l-GzCp3B2FvaKqnWwPnp6Vp_0 2024-09-12T01:07:26.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.980353769693727216', time=2024-09-12T02:54:25.158742+0000, chain.objs.size()=1 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.r4j7DIUkcGkV5tB3OyReIlSrA5TwzLX_0 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17008820234966897887', time=2024-09-12T02:54:25.184387+0000, chain.objs.size()=1 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.URT9e16MkAZeH0K5T_TfflHCvvDSsJ-_0 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7566213626387580575', time=2024-09-12T02:54:25.215302+0000, chain.objs.size()=1 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mht4n_aNvjl2p2uTA7QgzF3Vy3P0_1p_0 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10816477022174191281', time=2024-09-12T02:54:25.224804+0000, chain.objs.size()=1 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Q6CB5WqfmbM0leZHbatxgPbt5hb-Uyx_0 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10821269577460449359', time=2024-09-12T02:54:25.301550+0000, chain.objs.size()=1 2024-09-12T01:07:26.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LhoFeYivjv2G5uPf9MvcX1hcauNRLwt_0 2024-09-12T01:07:26.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3186981876791440600', time=2024-09-12T02:54:25.304685+0000, chain.objs.size()=1 2024-09-12T01:07:26.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XVi8Wr8YFUTvfS3yc3NCC9obTJBISfs_0 2024-09-12T01:07:26.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9332750462684219550', time=2024-09-12T02:54:25.366039+0000, chain.objs.size()=1 2024-09-12T01:07:26.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.skf1k2onNAoiPmPLAhhvKamiJ6_qLMy_0 2024-09-12T01:07:26.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12707835035221102734', time=2024-09-12T02:54:25.569649+0000, chain.objs.size()=1 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GZ8vlMTZSHmTS7cOqpzb0dgD9PX0kK7_0 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5223948050629802355', time=2024-09-12T02:54:25.655798+0000, chain.objs.size()=1 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IhT0JcTMVL9sagR3AfXEtN6jzms0jbI_0 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9118320244613542547', time=2024-09-12T02:54:25.732553+0000, chain.objs.size()=1 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5xXlunrwG4ANQLvyzovNZ-tn182YU2y_0 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6481635498524577422', time=2024-09-12T02:54:25.750101+0000, chain.objs.size()=1 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ebd10aJdM7Bbs46QFpZo8vQRanta38a_0 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16173412704147426011', time=2024-09-12T02:54:25.889554+0000, chain.objs.size()=1 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.tpMk0kwT9TkI8WLWhQx40AUigtWa1l7_0 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9701612575160655100', time=2024-09-12T02:54:25.901602+0000, chain.objs.size()=1 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4d_x2K_WJ4ik3v2RN4XbGTqgD-2iuIr_0 2024-09-12T01:07:26.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1823744120195105699', time=2024-09-12T02:54:25.917181+0000, chain.objs.size()=1 2024-09-12T01:07:26.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AFGIXiIJQBfgOywy5ab00cSXN57Fh-E_0 2024-09-12T01:07:26.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1022318426090945373', time=2024-09-12T02:54:26.016685+0000, chain.objs.size()=1 2024-09-12T01:07:26.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.z6Yq0RQyUt4TD0Fxr74kWq60oM6E3ui_0 2024-09-12T01:07:26.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10694896603997718720', time=2024-09-12T02:54:26.030567+0000, chain.objs.size()=1 2024-09-12T01:07:26.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mWCAkpYZpCMkqAqml4or_tSd4hV99GQ_0 2024-09-12T01:07:26.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11940224873249673185', time=2024-09-12T02:54:36.264667+0000, chain.objs.size()=1 2024-09-12T01:07:26.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.277__shadow_.UyB5005ouupokIIM0hDHKQLxaxzcOZe_0 2024-09-12T01:07:26.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10790122265248228723', time=2024-09-12T02:54:43.313576+0000, chain.objs.size()=1 2024-09-12T01:07:26.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.287__shadow_.iwSciBoD7SyHha4ySTcRjqXmVLXOo0D_0 2024-09-12T01:07:26.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6664252988482635408', time=2024-09-12T02:54:49.328864+0000, chain.objs.size()=1 2024-09-12T01:07:26.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.PV338fPb4COvs9r8Er6_bwRPrtjRug3_0 2024-09-12T01:07:26.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.575369447602849175', time=2024-09-12T02:55:04.063255+0000, chain.objs.size()=1 2024-09-12T01:07:26.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.313__shadow_.kEq2_s01LAbQh1g5eGUXCFs1Oqguk86_0 2024-09-12T01:07:26.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5996111066034409769', time=2024-09-12T02:55:08.774938+0000, chain.objs.size()=1 2024-09-12T01:07:26.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.321__shadow_.hv1FZ1n6r4U31wLuvur0L_UnQSk6cHd_0 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5606732266808864113', time=2024-09-12T02:55:30.922946+0000, chain.objs.size()=1 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9sY5Fag7x8_YlH31-D5oIzZpI1IQN1E_0 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12056120782564185965', time=2024-09-12T02:55:31.256950+0000, chain.objs.size()=1 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.cnxJXVxVQKKq0aLxvWsBUDT_FdK7vyv_0 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2276439876468296866', time=2024-09-12T02:55:31.351662+0000, chain.objs.size()=1 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xwv6RdxJfXoHz3lw6En4bBfVF-LC0qb_0 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2854990195299813148', time=2024-09-12T02:55:31.551752+0000, chain.objs.size()=1 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6qLEykok4gpUFA75hVtkNZk72DItK3Q_0 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7762017353247988465', time=2024-09-12T02:55:31.648866+0000, chain.objs.size()=1 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hZvBNNptzVdiajw062yw94hR63q-btP_0 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.616288159609382358', time=2024-09-12T02:55:31.675735+0000, chain.objs.size()=1 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XN509m0x4bjb-d-RV0zYwBsTykTMS3l_0 2024-09-12T01:07:26.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13975597331166751026', time=2024-09-12T02:55:31.689477+0000, chain.objs.size()=1 2024-09-12T01:07:26.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HuAugPD88uK1gornttkVJc2KWrQe5HE_0 2024-09-12T01:07:26.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8452535590462700396', time=2024-09-12T02:55:31.747813+0000, chain.objs.size()=1 2024-09-12T01:07:26.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kvqZ4R8IeOmS1S0ajoQZVb2BYnGkKQZ_0 2024-09-12T01:07:26.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7851651436571141809', time=2024-09-12T02:55:31.749919+0000, chain.objs.size()=1 2024-09-12T01:07:26.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.I1qlRnmdzBFH56YesyvOF5L4lIE456n_0 2024-09-12T01:07:26.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.250316000770230105', time=2024-09-12T02:55:31.998913+0000, chain.objs.size()=1 2024-09-12T01:07:26.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8R5cCGY7J7_OCdjaP9TXt3QH3gCETwV_0 2024-09-12T01:07:26.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5111276342660596863', time=2024-09-12T02:55:32.010064+0000, chain.objs.size()=1 2024-09-12T01:07:26.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yzk2raBDqHB-NdQQxorg83EggXIJ29L_0 2024-09-12T01:07:26.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5315672289701493688', time=2024-09-12T02:55:32.027663+0000, chain.objs.size()=1 2024-09-12T01:07:26.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.r7qsw0VO_HKgFeJCwgSxLQXs74vZZmQ_0 2024-09-12T01:07:26.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2107100044654390253', time=2024-09-12T02:55:32.058667+0000, chain.objs.size()=1 2024-09-12T01:07:26.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LQUTWts3ftiU5ZXa4EUmknbIIHa7T1o_0 2024-09-12T01:07:26.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5051750920070483957', time=2024-09-12T02:55:32.220788+0000, chain.objs.size()=1 2024-09-12T01:07:26.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8VZeNm16eHjRNPUoLgUb2NyBVflRgI4_0 2024-09-12T01:07:26.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9411864205430042985', time=2024-09-12T02:55:32.282742+0000, chain.objs.size()=1 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.K9Tbeiuw66aHKH4iaLBHYyWIJR_TvWe_0 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1091328694604907512', time=2024-09-12T02:55:32.288715+0000, chain.objs.size()=1 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.iTdwmIszp5f8fHuKBzRkOgVjCWL_I5r_0 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1484208677636721555', time=2024-09-12T02:55:32.306628+0000, chain.objs.size()=1 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jGHbBrXDaGdSlPTH7IcR_OOKfaBY1mf_0 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17943416755088151012', time=2024-09-12T02:55:32.307332+0000, chain.objs.size()=1 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9BKlwpt7NA9hHPD3GZvkpmJoMJUw9Lm_0 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2764807670425936334', time=2024-09-12T02:55:32.380239+0000, chain.objs.size()=1 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.oVKXwqaKpjGMz3XzKkZIi6x6rH9OjiL_0 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4760022771819633953', time=2024-09-12T02:55:32.398111+0000, chain.objs.size()=1 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.aoijGvk95EBiGlewxNk1ugI_s5c205z_0 2024-09-12T01:07:26.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17991832277359036948', time=2024-09-12T02:55:32.402422+0000, chain.objs.size()=1 2024-09-12T01:07:26.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.DRdYPg7HEAQAIYPDWKjoWnQx9XPujln_0 2024-09-12T01:07:26.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3277203909231168061', time=2024-09-12T02:55:32.572717+0000, chain.objs.size()=1 2024-09-12T01:07:26.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RjIHVYIDpdzjBmouzJR2oc_4EFLfUgz_0 2024-09-12T01:07:26.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13926303008760438012', time=2024-09-12T02:55:32.591845+0000, chain.objs.size()=1 2024-09-12T01:07:26.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.2KZj0UREm5k1PsGRYpQ-4svgrg-hDVt_0 2024-09-12T01:07:26.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18230574878492217769', time=2024-09-12T02:55:32.637907+0000, chain.objs.size()=1 2024-09-12T01:07:26.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZxWzfWWU25F7tR557hOS2YtN-lHSanP_0 2024-09-12T01:07:26.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12671062225311887110', time=2024-09-12T02:55:32.714925+0000, chain.objs.size()=1 2024-09-12T01:07:26.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3wWaLBe0_dqfIKVjvYICSOCi5Pil5z2_0 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15307700566063563359', time=2024-09-12T02:55:32.876379+0000, chain.objs.size()=1 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.wHoD8yyDSdq1asqSNGI9D5Y84-qDkAN_0 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5675272773893699796', time=2024-09-12T02:55:32.940181+0000, chain.objs.size()=1 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ztFgdrCIWzxRQD9eJUDOBwZHJ0PpfkW_0 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5471907382255258553', time=2024-09-12T02:55:32.957274+0000, chain.objs.size()=1 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sYKEkDUVwTDyUWZ7YUVRGEvMMVrYA0L_0 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15476920786397238778', time=2024-09-12T02:55:32.979779+0000, chain.objs.size()=1 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0Hngqf0FKLj_zCeKymwa2YkDsCPTn2s_0 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5699802696604608868', time=2024-09-12T02:55:33.013680+0000, chain.objs.size()=1 2024-09-12T01:07:26.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Jkh3_nHTCaJBkdIVgUPANpj9lDMJWdY_0 2024-09-12T01:07:26.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574965176347554213', time=2024-09-12T02:55:33.041240+0000, chain.objs.size()=1 2024-09-12T01:07:26.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.umBDrmdOR8NsL2HDB1q_2AstlwlDT4j_0 2024-09-12T01:07:26.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9248056551680946245', time=2024-09-12T02:55:33.212771+0000, chain.objs.size()=1 2024-09-12T01:07:26.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.JJ4RevqBZP76z0qfRZnWOziKGGVaOwM_0 2024-09-12T01:07:26.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1951161766728253136', time=2024-09-12T02:55:33.214266+0000, chain.objs.size()=1 2024-09-12T01:07:26.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sIqJLKamW1wC-98hxwXTIamONimGbAX_0 2024-09-12T01:07:26.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.107290026736158665', time=2024-09-12T02:55:33.309409+0000, chain.objs.size()=1 2024-09-12T01:07:26.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.91pSQpP5Y3qAr-NFlFVPg_guQW154nj_0 2024-09-12T01:07:26.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15022658396330993286', time=2024-09-12T02:55:33.318272+0000, chain.objs.size()=1 2024-09-12T01:07:26.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-esLxWKAdsTZibawhtU0XfcdVv6JwFW_0 2024-09-12T01:07:26.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4732517203760848719', time=2024-09-12T02:55:33.332665+0000, chain.objs.size()=1 2024-09-12T01:07:26.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TwJM35AAToc1q11HXfjvxj3chGwUkvw_0 2024-09-12T01:07:26.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9481623556462069190', time=2024-09-12T02:55:54.487513+0000, chain.objs.size()=1 2024-09-12T01:07:26.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HGm0DEWRQgCVAWJObf0NBqyyONjaC-Q_0 2024-09-12T01:07:26.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4998265997492441448', time=2024-09-12T02:55:54.559245+0000, chain.objs.size()=1 2024-09-12T01:07:26.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2aiyOQCBsk3dQRaKIo7bDgrvfuNZ_1Q_0 2024-09-12T01:07:26.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6120360795061622595', time=2024-09-12T02:55:54.582142+0000, chain.objs.size()=1 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.f33mtd8GtdwQnG-oS1z6o21HQFHYCHf_0 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14324866154171427805', time=2024-09-12T02:55:54.697754+0000, chain.objs.size()=1 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Y3C9029knVQfdje_l1uFdSst_hSu4a1_0 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16477980903637583701', time=2024-09-12T02:55:54.813337+0000, chain.objs.size()=1 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GqIYU2NP0JKsVlfjOO9121jft3W99N-_0 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7246481475222770425', time=2024-09-12T02:55:54.898839+0000, chain.objs.size()=1 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dOhObvAFB5zBGih0vWawdIDZp1plvBo_0 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4608169615285476329', time=2024-09-12T02:55:54.972188+0000, chain.objs.size()=1 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4EFbazY2ETuEgQ4-rW2AQ2FmDVV_6I1_0 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10325419924136610924', time=2024-09-12T02:55:55.143684+0000, chain.objs.size()=1 2024-09-12T01:07:26.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Xh7NilkfGfO9uZj04oW6nnH_4DqhxGj_0 2024-09-12T01:07:26.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12948148867945824559', time=2024-09-12T02:55:55.165139+0000, chain.objs.size()=1 2024-09-12T01:07:26.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0OJ7OX5VXKXY6X4Vreaw7xAZbHxnGnw_0 2024-09-12T01:07:26.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9932509339223341631', time=2024-09-12T02:55:55.201537+0000, chain.objs.size()=1 2024-09-12T01:07:26.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qLkevJTRJZ3g5l9wYyQbEw-Rqe-y_0A_0 2024-09-12T01:07:26.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8420686026274811071', time=2024-09-12T02:55:55.333267+0000, chain.objs.size()=1 2024-09-12T01:07:26.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SVWk9j6XhTqb7fPVVQ5mtf-7O-jR50g_0 2024-09-12T01:07:26.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2318405767678275498', time=2024-09-12T02:55:55.543210+0000, chain.objs.size()=1 2024-09-12T01:07:26.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YdlYdogl5hWvCAh2f5p2o-4XBDXNsUC_0 2024-09-12T01:07:26.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3025362291926535931', time=2024-09-12T02:55:55.569769+0000, chain.objs.size()=1 2024-09-12T01:07:26.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.e_i_5IEo-WtC3SOQ4FnG-BkgNRD4tw5_0 2024-09-12T01:07:26.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10288491959467149697', time=2024-09-12T02:55:55.662732+0000, chain.objs.size()=1 2024-09-12T01:07:26.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nbMcC3yftr_JmauWE-HW87ZAh4nmZS__0 2024-09-12T01:07:26.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1373059452998773967', time=2024-09-12T02:55:55.665528+0000, chain.objs.size()=1 2024-09-12T01:07:26.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1uQP35PsbGOP5v3OpGsY3tFZmn7eEsP_0 2024-09-12T01:07:26.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8269521485088462393', time=2024-09-12T02:55:55.848145+0000, chain.objs.size()=1 2024-09-12T01:07:26.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.aqacCqXuabktezSrcqe6dZf77IsaqeA_0 2024-09-12T01:07:26.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6549809792357146209', time=2024-09-12T02:55:55.857659+0000, chain.objs.size()=1 2024-09-12T01:07:26.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xvtNvGi-p96e2hwxfz7xEbwunkGQT1D_0 2024-09-12T01:07:26.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3647756650029347315', time=2024-09-12T02:55:55.958106+0000, chain.objs.size()=1 2024-09-12T01:07:26.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.q-z4DOHGHUGiD1LyBHLLSGqTCVmzXsS_0 2024-09-12T01:07:26.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10563187965941648138', time=2024-09-12T02:55:55.984762+0000, chain.objs.size()=1 2024-09-12T01:07:26.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SSP9InJTukcProtC8zLTSPW_f7aYEc8_0 2024-09-12T01:07:26.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13492368993276045896', time=2024-09-12T02:55:56.150547+0000, chain.objs.size()=1 2024-09-12T01:07:26.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ynAQLHcF3_AYA0NX4Jm4-xF5_T5yZVR_0 2024-09-12T01:07:26.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15902368154970911891', time=2024-09-12T02:55:56.222790+0000, chain.objs.size()=1 2024-09-12T01:07:26.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3HgG7YJaT9QMUIyl662PbukFbRDovse_0 2024-09-12T01:07:26.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50118 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7888612247260031671', time=2024-09-12T02:55:56.248512+0000, chain.objs.size()=1 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eL-DFMiW-afW1i8Q83EwCpdr2f5RA-C_0 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16263759800571051639', time=2024-09-12T02:55:56.255632+0000, chain.objs.size()=1 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.X5iQ-GRGX-20b8TRh8j1nvv6WMb4VUs_0 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16970716524536854201', time=2024-09-12T02:55:56.285361+0000, chain.objs.size()=1 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FFJefqWkkZKKUbW-OfCY3aouxeDgiyM_0 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5200433575655645204', time=2024-09-12T02:55:56.359576+0000, chain.objs.size()=1 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uZs7nZfsTNZ7VO1OeY0JaXK3fGolCWw_0 2024-09-12T01:07:26.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10973143171756401377', time=2024-09-12T02:55:56.525185+0000, chain.objs.size()=1 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZbIJC27nUn7v6_i-Aso3uqZYNtp_guS_0 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2832352480335669531', time=2024-09-12T02:55:56.800667+0000, chain.objs.size()=1 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LEKNoYBpjaE7GcFzjvqnAhgZkk72ZxQ_0 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8603951591067109462', time=2024-09-12T02:55:56.801945+0000, chain.objs.size()=1 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JAc9IPmZVxdLS331ieHDkb_GXBcmbuL_0 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12714603598016803233', time=2024-09-12T02:55:56.816755+0000, chain.objs.size()=1 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.K3O3tCULml0tBn9ZXm_NtoY3nYQCrZM_0 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9033624138864806276', time=2024-09-12T02:55:56.909260+0000, chain.objs.size()=1 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hxKAox-g4MKLo8TUHWzhLGkhQSGOAWK_0 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14248446785754114792', time=2024-09-12T02:56:06.252899+0000, chain.objs.size()=1 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.339__shadow_.mboHlXMpHrrKP72ArV143FaGgcU6vEe_0 2024-09-12T01:07:26.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12515503966918446032', time=2024-09-12T02:56:08.798169+0000, chain.objs.size()=1 2024-09-12T01:07:26.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.343__shadow_.uxc4zzPyrtRNhDbX2XP-ripwmhREsU-_0 2024-09-12T01:07:26.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15551770544585852802', time=2024-09-12T02:56:52.663104+0000, chain.objs.size()=1 2024-09-12T01:07:26.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.409__shadow_.ZZfL95XhgJj4zYyqMosE_CKZXVWyx-n_0 2024-09-12T01:07:26.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7124878068053948499', time=2024-09-12T02:57:43.365329+0000, chain.objs.size()=1 2024-09-12T01:07:26.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.481__shadow_.1WuwTbHuXwREINTXPEtYRWwhoX6Axdc_0 2024-09-12T01:07:26.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10744640769766456615', time=2024-09-12T02:57:45.061490+0000, chain.objs.size()=1 2024-09-12T01:07:26.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.3iPHE_e4Iovkn1uTeLOZJtQzodTC898_0 2024-09-12T01:07:26.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.349721316382660662', time=2024-09-12T02:57:54.491801+0000, chain.objs.size()=1 2024-09-12T01:07:26.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.497__shadow_.JcAUcNrB1q8y2kFOT33sQKp-LxNJqKl_0 2024-09-12T01:07:26.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4766228356634044625', time=2024-09-12T02:57:58.082498+0000, chain.objs.size()=1 2024-09-12T01:07:26.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.503__shadow:9LDvWGdmQQQ9l1.sKobe4w5aXdN6o1o_.IhjeMTusnwtlTOOsBJp3rTYo2SIwJCh_0 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13557490209336887894', time=2024-09-12T02:58:08.619792+0000, chain.objs.size()=1 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.518__multipart_mymultipart.2~4YmRgtH48knCFhfasnmqWtoZ-Fd_RIc.1 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12752567007947234717', time=2024-09-12T02:59:38.134839+0000, chain.objs.size()=1 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.557__shadow_.i-Q_T8ICdb-OamSv_L1PLN2NmSMJ7ZX_0 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4993909794970762505', time=2024-09-12T02:59:52.602934+0000, chain.objs.size()=1 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:4AnFpfKLdH1GpbLdsawk7lOlPBhXe7X_.hamopWQ20bAm-ySr0LsftmY2iOJD7T3_0 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18231103253798708407', time=2024-09-12T03:00:20.622547+0000, chain.objs.size()=1 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:m8yk6hPhq1oS58GPrwmj2YunaLbcmEn_.4vYDd3y0-r4d7sVMYNid4RbJxDX7CSV_0 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17949254013509832230', time=2024-09-12T03:00:26.685743+0000, chain.objs.size()=1 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:B.el4J8JzFp1Xq56hLFzWWE6cGdB.B3_.sSLCz6S-F6oIn14n3LB20KHzw4rHimh_0 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2104344814458025911', time=2024-09-12T03:00:37.721328+0000, chain.objs.size()=1 2024-09-12T01:07:26.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.582__shadow:H08aDTOhmGJZYYkra0tV7yvOdo7U6NF_.tAE-rNfuL0u9SUwouJPrmLR9gGhV-Ed_0 2024-09-12T01:07:26.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10583625268189012646', time=2024-09-12T03:00:38.649147+0000, chain.objs.size()=1 2024-09-12T01:07:26.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.583__shadow:mAfGD6e4qQ67xYalebZSarRoTd8sLxd_.ecSeon2gNQlmONLti4t3fMZLUIbbveN_0 2024-09-12T01:07:26.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6514397473377500534', time=2024-09-12T03:00:42.325229+0000, chain.objs.size()=1 2024-09-12T01:07:26.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:ae6BgtaBCjhoq0UCtIoj.N4ZzE8sJLx_.LmWBcvzHwdt5KtkEdLUhR4vLfEac7DU_0 2024-09-12T01:07:26.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7540204400137022070', time=2024-09-12T03:01:09.843795+0000, chain.objs.size()=12 2024-09-12T01:07:26.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__multipart_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.1 2024-09-12T01:07:26.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__shadow_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.1_1 2024-09-12T01:07:26.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__multipart_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.2 2024-09-12T01:07:26.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__shadow_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.2_1 2024-09-12T01:07:26.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__multipart_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.3 2024-09-12T01:07:26.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__shadow_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.3_1 2024-09-12T01:07:26.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__multipart_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.4 2024-09-12T01:07:26.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__shadow_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.4_1 2024-09-12T01:07:26.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__multipart_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.5 2024-09-12T01:07:26.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__shadow_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.5_1 2024-09-12T01:07:26.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__multipart_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.6 2024-09-12T01:07:26.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.615__shadow_multipart_enc.2~s5_QALVrN-U59k9H76hTLFlYAIIFqkn.6_1 2024-09-12T01:07:26.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12708401747705680328', time=2024-09-12T03:03:54.593997+0000, chain.objs.size()=1 2024-09-12T01:07:26.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.666__shadow_.rb4NB915BQSTIiI3qLsNm6qPnt1sXsx_0 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7743518588922162434', time=2024-09-12T03:03:56.416044+0000, chain.objs.size()=1 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.670__shadow_.z8TDipn4kxo3kzmWhjgGy03w87kWVDj_0 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17882768778176176004', time=2024-09-12T03:04:01.851131+0000, chain.objs.size()=1 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.679__shadow_.l4JBPWCUoMEJA-r0We-B2rkxq_UF2Y4_0 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3200727539709331069', time=2024-09-12T03:04:09.346735+0000, chain.objs.size()=1 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.692__shadow:g6DC4bo6Z.VCZxjTe5dg9mt4w6Fw3I4_.LXyNnkryCxb20lO40_UhkfK57k0s_u7_0 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12259713577320613090', time=2024-09-12T03:04:12.407909+0000, chain.objs.size()=1 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.697__shadow:-.wPOQrLqiT3yIMKN6E9eTdyLQgQ.R._.Se52haFDf6C02mQ7JFvOt4-xm7opaUp_0 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17007625851049883841', time=2024-09-12T03:04:16.533698+0000, chain.objs.size()=1 2024-09-12T01:07:26.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.703__shadow:ccHs9-2jCaR-kAdYDo5sqy2AkS8kzoi_.ekgefXNTeBfUZ63GCt7BYqNix_7gk-u_0 2024-09-12T01:07:26.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2677580612985662488', time=2024-09-12T03:04:18.006181+0000, chain.objs.size()=1 2024-09-12T01:07:26.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.705__shadow:xx.jkJ0igbXnOSGZLqgHZz7oi0k-4zz_.iDpusc48_ijjvVJKx2r8Ou3QC4YPFDN_0 2024-09-12T01:07:26.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6397473718806103858', time=2024-09-12T03:04:21.258055+0000, chain.objs.size()=1 2024-09-12T01:07:26.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.710__shadow:PsNgVQhaJOWi75YpEoTMFx8zLZko9Wa_.rxElKKGnesKTglR27ece1aun9P2Sum9_0 2024-09-12T01:07:26.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.620117646842404026', time=2024-09-12T03:04:45.038050+0000, chain.objs.size()=1 2024-09-12T01:07:26.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.717__shadow:IAKHg660sAZKbkGS3mVBDPXqrZJxc3v_.CoK1Wm4GoBDRZ6U_kghNxD37vwcak-2_0 2024-09-12T01:07:26.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.176+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.176+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:07:26.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48050' 2024-09-12T01:07:26.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_FmbwWRFEmwnCYpPeMQxZmNmZUgBQM6X', time=2024-09-12T02:51:31.040170+0000, chain.objs.size()=1 2024-09-12T01:07:26.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.BQLoXuX-wXokfN7KHmGq54tYrrM3S5M_0 2024-09-12T01:07:26.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_YlZ4rI519RFEObI3m16HwpZn-t1lFUe', time=2024-09-12T02:51:37.429195+0000, chain.objs.size()=3 2024-09-12T01:07:26.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.165__shadow_.IS-W9Q7tghpLOm-XOHJ0tKiz2XcJ270_0 2024-09-12T01:07:26.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.165__shadow_.IS-W9Q7tghpLOm-XOHJ0tKiz2XcJ270_1 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.165__shadow_.IS-W9Q7tghpLOm-XOHJ0tKiz2XcJ270_2 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1052589994060883550', time=2024-09-12T02:53:43.839513+0000, chain.objs.size()=1 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.237__shadow_.mH73zHCZNsavHEBzIJ8raJhbwhLd016_0 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12104976780800503990', time=2024-09-12T02:53:43.844865+0000, chain.objs.size()=1 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.237__shadow_.kqVPFeDUoYkEQr4LYY0Oy8gMiszwlp4_0 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7722612354180863134', time=2024-09-12T02:53:54.964241+0000, chain.objs.size()=1 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.251__shadow_.QaPFYUne6VaAdU31yy7HODfJakCaRoV_0 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17725805066636180516', time=2024-09-12T02:53:57.793320+0000, chain.objs.size()=1 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.255__shadow_.PE0hGGYYueWU0rVK0dKfo2njiCln96O_0 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13127590058703663069', time=2024-09-12T02:53:59.200852+0000, chain.objs.size()=1 2024-09-12T01:07:26.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.257__shadow_.3g_mgVn6moK8IAxo9xfkpmDu9hO10iz_0 2024-09-12T01:07:26.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2770818423261731775', time=2024-09-12T02:53:59.863727+0000, chain.objs.size()=1 2024-09-12T01:07:26.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.258__shadow_.kDGBEXYoIfoovNUtCFhc547xAhEIw8p_0 2024-09-12T01:07:26.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7429695238009141550', time=2024-09-12T02:54:23.108433+0000, chain.objs.size()=1 2024-09-12T01:07:26.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.G6Bg7M5EYW24lE5w3e65IwGnSXY1x2B_0 2024-09-12T01:07:26.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17821777746656819252', time=2024-09-12T02:54:23.114494+0000, chain.objs.size()=1 2024-09-12T01:07:26.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iv_UZPjTm_mFy9RySnrmM7y6qYPFrww_0 2024-09-12T01:07:26.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1084134988997009344', time=2024-09-12T02:54:23.141857+0000, chain.objs.size()=1 2024-09-12T01:07:26.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.180+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.F3PbfgpbKuG-hybLNei99vWDeBzJ9F__0 2024-09-12T01:07:26.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17483556355330692126', time=2024-09-12T02:54:23.179562+0000, chain.objs.size()=1 2024-09-12T01:07:26.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GmADUzHrSFaa9vVotzkHPErMVDwM_m2_0 2024-09-12T01:07:26.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6035292733644408106', time=2024-09-12T02:54:23.191015+0000, chain.objs.size()=1 2024-09-12T01:07:26.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eMCpKp-tl7aRogE_lCjNhun8D05xYbm_0 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13710011719552063601', time=2024-09-12T02:54:23.199305+0000, chain.objs.size()=1 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ce021dmvhhPfsQcg-MwBYyVojC6Keyj_0 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6794586186858482708', time=2024-09-12T02:54:23.222248+0000, chain.objs.size()=1 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ENBaD_tpO71dlu-oanKFmlUECK7oIBT_0 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18446596972076273658', time=2024-09-12T02:54:23.594823+0000, chain.objs.size()=1 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Aik7CJ6wPPXpHpp5LbpN4mvd_tLTxUO_0 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15163121921284383000', time=2024-09-12T02:54:23.785253+0000, chain.objs.size()=1 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.E7HKQjAkbFJngDj1gXZJVNv3Al5_SuT_0 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11894573836902120827', time=2024-09-12T02:54:24.059423+0000, chain.objs.size()=1 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eoaQDIv81RWi8_APal6oB5kKHryAnMG_0 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15381745662274889224', time=2024-09-12T02:54:24.114120+0000, chain.objs.size()=1 2024-09-12T01:07:26.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.B6EfuAaw6NuZOqhLYQx2N-lSnXxVMbP_0 2024-09-12T01:07:26.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.585546426480232561', time=2024-09-12T02:54:24.171434+0000, chain.objs.size()=1 2024-09-12T01:07:26.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gux6DkCkYnxPOCrzQwWHIEjyxV5Tj54_0 2024-09-12T01:07:26.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.139745482406890116', time=2024-09-12T02:54:24.405006+0000, chain.objs.size()=1 2024-09-12T01:07:26.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PC2KB6mydEfHzvgIUoenGzA0CLzzgia_0 2024-09-12T01:07:26.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1701435727282521609', time=2024-09-12T02:54:24.414148+0000, chain.objs.size()=1 2024-09-12T01:07:26.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Xxg2OFeXT13yVNni89SThiiUwnbFtxf_0 2024-09-12T01:07:26.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4668222835504474823', time=2024-09-12T02:54:24.421251+0000, chain.objs.size()=1 2024-09-12T01:07:26.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TQbtxfzmuv87OB475a9zUlE7QxDS8n5_0 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17168256033063513767', time=2024-09-12T02:54:24.469531+0000, chain.objs.size()=1 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uExRo3hz7T6l3VMk6YWqTq2hyfpcc2d_0 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1483108122309499985', time=2024-09-12T02:54:24.479311+0000, chain.objs.size()=1 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.plWFBVyjebMT_hU7AIaoMuJ2FJzhUwc_0 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11895275440332652710', time=2024-09-12T02:54:24.628531+0000, chain.objs.size()=1 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HNRnft8Rxw5yNr_C5Otjv2nZ2rvvLpI_0 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14588253017382136777', time=2024-09-12T02:54:24.630296+0000, chain.objs.size()=1 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.atX6g17irE1VZmYtpfNjuGzjHeIY1ab_0 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7159059126238784406', time=2024-09-12T02:54:24.805005+0000, chain.objs.size()=1 2024-09-12T01:07:26.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XnZgfzVu_-Hatjy2_BKfeW4B0QXY19i_0 2024-09-12T01:07:26.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5416937510358875674', time=2024-09-12T02:54:24.829164+0000, chain.objs.size()=1 2024-09-12T01:07:26.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.EZd0aVsye_6wBi21CBbQ8JHJbl_A6Iv_0 2024-09-12T01:07:26.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4422014461930954845', time=2024-09-12T02:54:24.874041+0000, chain.objs.size()=1 2024-09-12T01:07:26.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XB0bm6-xUVwxMKmwNcwziGW-GpOD3Fm_0 2024-09-12T01:07:26.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11038668001937416525', time=2024-09-12T02:54:25.163959+0000, chain.objs.size()=1 2024-09-12T01:07:26.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.11r9J3t6yWaZQEP2ScICAE46cPdUF-0_0 2024-09-12T01:07:26.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17545370805096310345', time=2024-09-12T02:54:25.214535+0000, chain.objs.size()=1 2024-09-12T01:07:26.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._vulvsJ--9I2vUEbAjXRvwYWj5FmQZz_0 2024-09-12T01:07:26.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6624848438243104754', time=2024-09-12T02:54:25.294264+0000, chain.objs.size()=1 2024-09-12T01:07:26.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2s41YdzqBcZIGH6ZukNvR-Gpv6KmUAt_0 2024-09-12T01:07:26.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16410091660425177934', time=2024-09-12T02:54:25.530574+0000, chain.objs.size()=1 2024-09-12T01:07:26.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mJdlDIrXQjgwZSVymp8UgQEfuIBL_rk_0 2024-09-12T01:07:26.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12954838849404948882', time=2024-09-12T02:54:25.650245+0000, chain.objs.size()=1 2024-09-12T01:07:26.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.C1wmB2Q2s5H8yn1T2TGNOOpcDW_X2zY_0 2024-09-12T01:07:26.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1149509184906232454', time=2024-09-12T02:54:25.674396+0000, chain.objs.size()=1 2024-09-12T01:07:26.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iDZvUfox4EqnoNr0qGuXev_xz75910g_0 2024-09-12T01:07:26.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7638479101858390416', time=2024-09-12T02:54:25.893450+0000, chain.objs.size()=1 2024-09-12T01:07:26.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5gYjpXrwDX88TWO3EjqZwBbxiiEdc01_0 2024-09-12T01:07:26.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6423349048403401007', time=2024-09-12T02:54:25.927462+0000, chain.objs.size()=1 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bErmvzr361WQ6yz1Je9KRtIeCGzOp8y_0 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11211777257544191655', time=2024-09-12T02:54:25.932687+0000, chain.objs.size()=1 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qbPRYWqWrtKqfdQRo5cu4aq8aevtDHd_0 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4009321343363490256', time=2024-09-12T02:54:26.014643+0000, chain.objs.size()=1 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FTwAg7nUlJXQW3BFMBir03Agq4JB5-K_0 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15425120210702098142', time=2024-09-12T02:54:26.029326+0000, chain.objs.size()=1 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XIAhd0H8iR-S0oiutEeG0xMF8m5mN3H_0 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8295113174973427755', time=2024-09-12T02:54:27.970166+0000, chain.objs.size()=1 2024-09-12T01:07:26.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.265__shadow_.zthygvfUbpeYOIK2vjBpCZG5h33U_r9_0 2024-09-12T01:07:26.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4576223598262224156', time=2024-09-12T02:54:29.329227+0000, chain.objs.size()=1 2024-09-12T01:07:26.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.267__shadow_.eRrEKYkLbevbRxV692fNgXXNBy1K5Yj_0 2024-09-12T01:07:26.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17385836224126340112', time=2024-09-12T02:54:36.938671+0000, chain.objs.size()=1 2024-09-12T01:07:26.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.278__shadow_.X9E5jSmbz_nwQRjqf41v52BscXLjs--_0 2024-09-12T01:07:26.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18348116967164081253', time=2024-09-12T02:54:43.308766+0000, chain.objs.size()=1 2024-09-12T01:07:26.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.287__shadow_.U_bhu_c8InpQBkj6IAC0KJx8a4EaBbc_0 2024-09-12T01:07:26.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.675393243345794150', time=2024-09-12T02:54:44.007668+0000, chain.objs.size()=1 2024-09-12T01:07:26.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.288__shadow_.2cYRcjjEOlQeOe_DqZ0y1Bk4ZylCL-g_0 2024-09-12T01:07:26.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11160771527601768515', time=2024-09-12T02:54:47.923874+0000, chain.objs.size()=1 2024-09-12T01:07:26.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.xj1BCoqEYwOJlHJmn6mD4H-g4ZfK9vn_0 2024-09-12T01:07:26.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14523997205348896043', time=2024-09-12T02:54:47.930660+0000, chain.objs.size()=1 2024-09-12T01:07:26.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.RhtjvgqJEGhCeheULgQkc7jskfeFsFY_0 2024-09-12T01:07:26.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12792077575989129075', time=2024-09-12T02:54:49.386418+0000, chain.objs.size()=1 2024-09-12T01:07:26.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.nA0OpBls4MV8izakjNrBSwoV3La6AFw_0 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13700520658761903386', time=2024-09-12T02:54:51.453682+0000, chain.objs.size()=1 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.296__shadow_.q0dbwNGGKiS4kf3RlGUniJIsDb8ATSp_0 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10657701881116986739', time=2024-09-12T02:54:52.182551+0000, chain.objs.size()=1 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.297__shadow_.ihj3HSoBGtLfbzNgdvDhlXSPltzULcX_0 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10802381271584935493', time=2024-09-12T02:55:31.360987+0000, chain.objs.size()=1 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.t7mCCo_jV9xLVc1c3CKaQeI1Mth47bB_0 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14156431066445920963', time=2024-09-12T02:55:31.403534+0000, chain.objs.size()=1 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Y9WkMpx734WfMHUjn1_1eoqS49WY2M0_0 2024-09-12T01:07:26.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13320083649840619617', time=2024-09-12T02:55:31.631462+0000, chain.objs.size()=1 2024-09-12T01:07:26.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.T7i5EyJFZnngEY9mFZcYD5yuHwS-WYw_0 2024-09-12T01:07:26.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17172112385527219271', time=2024-09-12T02:55:31.714163+0000, chain.objs.size()=1 2024-09-12T01:07:26.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hZg8V5qY8p4NohAhWS5ddu147kTuTqY_0 2024-09-12T01:07:26.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16276881219467228644', time=2024-09-12T02:55:31.719263+0000, chain.objs.size()=1 2024-09-12T01:07:26.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zGJhQgLDcMMdz8AV-glaaS1zjqz4t8L_0 2024-09-12T01:07:26.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.348436576384069835', time=2024-09-12T02:55:31.721880+0000, chain.objs.size()=1 2024-09-12T01:07:26.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.CWdGzBzZAkInIH3JAcLIwiXHYmpNeEO_0 2024-09-12T01:07:26.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10843247773560438534', time=2024-09-12T02:55:31.953397+0000, chain.objs.size()=1 2024-09-12T01:07:26.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WAVnESMaxW5WI8RrqKL3vp80t-W_DwL_0 2024-09-12T01:07:26.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6241890177889829611', time=2024-09-12T02:55:32.063871+0000, chain.objs.size()=1 2024-09-12T01:07:26.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.o1pP8hUh5HT8Tpj5cOERZEipNN3aSxc_0 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14162966062797335470', time=2024-09-12T02:55:32.227202+0000, chain.objs.size()=1 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.P0JsX-rX2uLoFNtvuesydJaUEOoqef-_0 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13323835571504779378', time=2024-09-12T02:55:32.270639+0000, chain.objs.size()=1 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.on_KShwtbChcD6AKibGljqq_XJVkpv5_0 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9747484149067261905', time=2024-09-12T02:55:32.294340+0000, chain.objs.size()=1 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jHz-WjBsxmMQ1YZbdoqVBfopidto-YL_0 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4105497065256976042', time=2024-09-12T02:55:32.388932+0000, chain.objs.size()=1 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lFIrxv7MHFWEXoCjcDA0kFLln0oCAjB_0 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8699836388926710079', time=2024-09-12T02:55:32.421426+0000, chain.objs.size()=1 2024-09-12T01:07:26.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.x4bOih0I_SMQJp7hxMnL8CIzJB1b_Iv_0 2024-09-12T01:07:26.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6385376580316058769', time=2024-09-12T02:55:32.544524+0000, chain.objs.size()=1 2024-09-12T01:07:26.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.O_5FQsmfhGYmvQ3APe48lCBIdhWc_t6_0 2024-09-12T01:07:26.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3681533001016296301', time=2024-09-12T02:55:32.587969+0000, chain.objs.size()=1 2024-09-12T01:07:26.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eKMIXaFnAtKnPSnKmMxBmtRIiAJ3JQz_0 2024-09-12T01:07:26.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13127046455471460208', time=2024-09-12T02:55:32.619048+0000, chain.objs.size()=1 2024-09-12T01:07:26.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TChl3WU5yEh7f_DXuhqfN65-rssUFKH_0 2024-09-12T01:07:26.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2751438782167540615', time=2024-09-12T02:55:32.671096+0000, chain.objs.size()=1 2024-09-12T01:07:26.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.d7ulhGva3t-HzPspPjjEG3KW63Trouz_0 2024-09-12T01:07:26.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285000768071353492', time=2024-09-12T02:55:32.877649+0000, chain.objs.size()=1 2024-09-12T01:07:26.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gJlT93pXD3Wu_wquPJid35XwAfnbMGi_0 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12900074349419404558', time=2024-09-12T02:55:32.895874+0000, chain.objs.size()=1 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4iK_RHvAc9vDIkKJWXNJnYlP0nDhz-c_0 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3090297021195539862', time=2024-09-12T02:55:33.064943+0000, chain.objs.size()=1 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.X9LbhwVkXdYXE735YI0-oamQK4QErse_0 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14164704593264166986', time=2024-09-12T02:55:33.206752+0000, chain.objs.size()=1 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.SjNsb8RVjyhWwYFHKuAkQIvdDNB4Wai_0 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13095585213053018220', time=2024-09-12T02:55:33.240729+0000, chain.objs.size()=1 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7lqwTrpW2nEHGptIf3MW2q0gM9hyD53_0 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8350384059860807191', time=2024-09-12T02:55:33.314356+0000, chain.objs.size()=1 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7cAdNqUd2ifRiuY_tf1WPpBN8UCgqGd_0 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6795101571934733149', time=2024-09-12T02:55:54.472646+0000, chain.objs.size()=1 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lE0g8mSlji5d6PqdZ0bY2SEWm_ia250_0 2024-09-12T01:07:26.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10934535707112577504', time=2024-09-12T02:55:54.537739+0000, chain.objs.size()=1 2024-09-12T01:07:26.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wUCAhru2W635ODrJfBuoVIM_QUu_QS3_0 2024-09-12T01:07:26.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10769330260351042205', time=2024-09-12T02:55:54.557494+0000, chain.objs.size()=1 2024-09-12T01:07:26.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.shCrhYeMS00yc7_2V0m2IZANY_ZV-gy_0 2024-09-12T01:07:26.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6341744089166921856', time=2024-09-12T02:55:54.846766+0000, chain.objs.size()=1 2024-09-12T01:07:26.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OsTnWL8qTwSAqpzn2uh_D3gUV8g6-B0_0 2024-09-12T01:07:26.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11840800882973303340', time=2024-09-12T02:55:54.935033+0000, chain.objs.size()=1 2024-09-12T01:07:26.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zlNYSQLQbS_JA8l9Cb1vYK4Re-8ugJY_0 2024-09-12T01:07:26.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13438162166945672489', time=2024-09-12T02:55:54.943509+0000, chain.objs.size()=1 2024-09-12T01:07:26.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.yIxmwHyu3N6j9O2yRtmUzHd1PdxUBiX_0 2024-09-12T01:07:26.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13618939880380525015', time=2024-09-12T02:55:54.952110+0000, chain.objs.size()=1 2024-09-12T01:07:26.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fIKU0T-fKTetzuyIBOe25abeQb5CXlo_0 2024-09-12T01:07:26.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14580593540400970633', time=2024-09-12T02:55:54.958263+0000, chain.objs.size()=1 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5nOOTY2965iwq-CVLGaeXNDUU2E1swP_0 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4666311298106131915', time=2024-09-12T02:55:55.133331+0000, chain.objs.size()=1 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wLUXNzjAEUU5ETO_uFgK2WYxTr2kZ8l_0 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7919513088697744238', time=2024-09-12T02:55:55.150257+0000, chain.objs.size()=1 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4xoTppMUmc9GmNIW4MAt2S_ONhGIiO4_0 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18145675638528114969', time=2024-09-12T02:55:55.268990+0000, chain.objs.size()=1 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.KZ5bSyLsyQgLqA2zKoG-dQreP5dtWF9_0 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14212053997525078854', time=2024-09-12T02:55:55.281874+0000, chain.objs.size()=1 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DVJJ-l1F9IHuH_S-Rv_bPInGhnV8Xgk_0 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15528039988116097985', time=2024-09-12T02:55:55.287905+0000, chain.objs.size()=1 2024-09-12T01:07:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RzeG2HGWbnFcwtScn7j_azJu1BlvXf8_0 2024-09-12T01:07:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17268548517620653549', time=2024-09-12T02:55:55.501762+0000, chain.objs.size()=1 2024-09-12T01:07:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wZFi_8vvVeQVtRFIrwUV5rER-owoGAX_0 2024-09-12T01:07:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5487071097704861183', time=2024-09-12T02:55:55.525046+0000, chain.objs.size()=1 2024-09-12T01:07:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UkiCMLk76keGT_hJZG5sUhLXOXPtC7N_0 2024-09-12T01:07:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13653824771101379825', time=2024-09-12T02:55:55.562778+0000, chain.objs.size()=1 2024-09-12T01:07:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7gnOniH0WZVDr52WSg4ouLh2aCxyQAt_0 2024-09-12T01:07:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.694135570730498082', time=2024-09-12T02:55:55.639697+0000, chain.objs.size()=1 2024-09-12T01:07:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LaX2_Uzje8S9fgvjP-nHyMUBmhcFRP3_0 2024-09-12T01:07:26.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17598501845369670278', time=2024-09-12T02:55:55.683779+0000, chain.objs.size()=1 2024-09-12T01:07:26.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nTK6O6BUxzRLJ2EeIRM3kj9tvdRaQaY_0 2024-09-12T01:07:26.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5956827570395431531', time=2024-09-12T02:55:55.820806+0000, chain.objs.size()=1 2024-09-12T01:07:26.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Bpn6xSJ_h3y4GzzQRKjN_98UnkligXE_0 2024-09-12T01:07:26.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1815573630448594616', time=2024-09-12T02:55:55.864314+0000, chain.objs.size()=1 2024-09-12T01:07:26.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9QEe3Q0evPQpAJXa3XjYnUnfHQeFT5u_0 2024-09-12T01:07:26.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14748586185050613632', time=2024-09-12T02:55:55.882994+0000, chain.objs.size()=1 2024-09-12T01:07:26.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vcUyuj4BGShUhaGsvOJwBKyWvrE1804_0 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18373245597968833972', time=2024-09-12T02:55:55.894734+0000, chain.objs.size()=1 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4Eo-7t2gE2Fu-P8thBsty_U1LKTnLEf_0 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17843329605934342084', time=2024-09-12T02:55:55.952107+0000, chain.objs.size()=1 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RAx1NwW32mk3m3VMFQ2pML-wc-G-L2d_0 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4334913467062289811', time=2024-09-12T02:55:55.976057+0000, chain.objs.size()=1 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wqMO6MgEWCjm7Ck8MWZe6WLdauy7TNK_0 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.844551327901345661', time=2024-09-12T02:55:56.004975+0000, chain.objs.size()=1 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IXit6I0kN7vJxbfeR8H093OFjvSI4n3_0 2024-09-12T01:07:26.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15052600131853822034', time=2024-09-12T02:55:56.011946+0000, chain.objs.size()=1 2024-09-12T01:07:26.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NgiKWTmXvlN-rfqVB4gH0aOZlu3EWSa_0 2024-09-12T01:07:26.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48050 2024-09-12T01:07:26.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T01:07:26.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.315776987910261210', time=2024-09-12T02:55:56.161979+0000, chain.objs.size()=1 2024-09-12T01:07:26.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YgIqMj6ZQ9aLxijFR0go1I4kWozsTab_0 2024-09-12T01:07:26.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17913972251820243496', time=2024-09-12T02:55:56.238214+0000, chain.objs.size()=1 2024-09-12T01:07:26.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kM-H_ZKVRekU2uJB9GGXfs1OmGsNzCv_0 2024-09-12T01:07:26.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1881049738139332100', time=2024-09-12T02:55:56.541164+0000, chain.objs.size()=1 2024-09-12T01:07:26.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.iJydOHBGm5AAgY-yse8jioKKXk-xSvb_0 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11484809288325085381', time=2024-09-12T02:55:56.583172+0000, chain.objs.size()=1 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.p6IjLuGY8o8EulmkjF6EYm6yrLZWk_i_0 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10660664398794593712', time=2024-09-12T02:55:56.600483+0000, chain.objs.size()=1 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fIicoTPgWnXhTDXwa-tXCMsayHW1bn8_0 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4997612480892053141', time=2024-09-12T02:55:56.641711+0000, chain.objs.size()=1 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Bkj_D2bB5MYyCda1U8eArPxkca5Hzpo_0 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7413838799043363386', time=2024-09-12T02:55:56.653632+0000, chain.objs.size()=1 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-sP9gR8WS-dPgfaBqP_QbKNBkXUFNDy_0 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13328671682395225202', time=2024-09-12T02:55:56.852080+0000, chain.objs.size()=1 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NxjKjkdO-hvbqCkKAAVDIwYXTl02h9D_0 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2861121929721145603', time=2024-09-12T02:55:56.870268+0000, chain.objs.size()=1 2024-09-12T01:07:26.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.H1KNWqtuCIhLlU-4et5YPpL16ZKG3Nv_0 2024-09-12T01:07:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18249517947776783588', time=2024-09-12T02:56:06.842111+0000, chain.objs.size()=1 2024-09-12T01:07:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.340__shadow_.3FOZUX5DMFqS7o1Acsl9S6PG5y0yxdh_0 2024-09-12T01:07:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16579193736021414752', time=2024-09-12T02:56:32.422324+0000, chain.objs.size()=1 2024-09-12T01:07:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.381__shadow_.bze03Z79ZwRZu_UxHh8-dr4Kp3UQ49n_0 2024-09-12T01:07:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17675799210757240947', time=2024-09-12T02:56:38.965241+0000, chain.objs.size()=1 2024-09-12T01:07:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.390__shadow_.p87NyN_sJJ4MiabUaFG4mgCoYW6Jcsy_0 2024-09-12T01:07:26.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12150566871085200208', time=2024-09-12T02:57:32.366056+0000, chain.objs.size()=1 2024-09-12T01:07:26.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.461__shadow_.B6w9PsLuzliLUeuIq0yWan9xMz3_XL8_0 2024-09-12T01:07:26.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6139486279477167593', time=2024-09-12T02:57:43.368125+0000, chain.objs.size()=1 2024-09-12T01:07:26.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.481__shadow_.Wttv0iwlk0BQfit2u0-UhQrfHs5HL6O_0 2024-09-12T01:07:26.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8889462351841075912', time=2024-09-12T02:57:48.168953+0000, chain.objs.size()=1 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.487__shadow_.d-d5DavhcqfuaaaZaPdx8ILQR_7t-3m_0 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7067164740706185077', time=2024-09-12T02:57:49.991235+0000, chain.objs.size()=1 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.490__shadow_.vPpHiNwd3LgBOkgoidoZNMKlpmxCAB0_0 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7067164740706185077', time=2024-09-12T02:57:50.199886+0000, chain.objs.size()=1 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.490__shadow_.vPpHiNwd3LgBOkgoidoZNMKlpmxCAB0_0 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16278347771149171357', time=2024-09-12T02:58:13.861022+0000, chain.objs.size()=6 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.519__multipart_mymultipart.2~8EmRcPRo1fSyca4oIvvTZQBhmmGhIvj.1 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.519__multipart_mymultipart.2~8EmRcPRo1fSyca4oIvvTZQBhmmGhIvj.2 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.519__multipart_mymultipart.2~8EmRcPRo1fSyca4oIvvTZQBhmmGhIvj.3 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.519__multipart_mymultipart.2~8EmRcPRo1fSyca4oIvvTZQBhmmGhIvj.4 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.519__multipart_mymultipart.2~8EmRcPRo1fSyca4oIvvTZQBhmmGhIvj.5 2024-09-12T01:07:26.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.519__multipart_mymultipart.2~8EmRcPRo1fSyca4oIvvTZQBhmmGhIvj.6 2024-09-12T01:07:26.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.232+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tYYBEiVfqvifsPTBOYuNcvo3Nj2uSAa', time=2024-09-12T02:58:19.623190+0000, chain.objs.size()=1 2024-09-12T01:07:26.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.232+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~tYYBEiVfqvifsPTBOYuNcvo3Nj2uSAa.1 2024-09-12T01:07:26.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.232+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15402583200624197507', time=2024-09-12T02:58:37.704733+0000, chain.objs.size()=2 2024-09-12T01:07:26.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.232+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~qDM1KWqN62Nz3EZcvulhxF-j9xV-AiY.1 2024-09-12T01:07:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~qDM1KWqN62Nz3EZcvulhxF-j9xV-AiY.2 2024-09-12T01:07:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2385574500871287', time=2024-09-12T02:59:39.317344+0000, chain.objs.size()=1 2024-09-12T01:07:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.558__shadow_.yorXAlM-gyBFAygQSFdNBah03VJ7LOd_0 2024-09-12T01:07:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7167011320416730780', time=2024-09-12T03:00:08.419901+0000, chain.objs.size()=1 2024-09-12T01:07:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.575__shadow_.eTmwuV0cTqsqFg7edfq2UNRtbpEBIMm_0 2024-09-12T01:07:26.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17209113640092140482', time=2024-09-12T03:00:11.589522+0000, chain.objs.size()=1 2024-09-12T01:07:26.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:JSvtePnH33ZzS6Gph3W2cWMlJ.KHyMh_.itkBlUMnBWlMorvCFYW8yon5sLBQ0rs_0 2024-09-12T01:07:26.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5917240727432447519', time=2024-09-12T03:00:14.678326+0000, chain.objs.size()=1 2024-09-12T01:07:26.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:q.UEeJQsagz0LpTyMbCD8aaNZtipXma_.K10_Aw3Gxk11oSu3AvSyGsOqGL5WCy1_0 2024-09-12T01:07:26.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17684801255629213108', time=2024-09-12T03:00:35.153879+0000, chain.objs.size()=1 2024-09-12T01:07:26.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:T8bknUxHu2mQe7A9t2a3CCu0FMxUrX0_.OsfKG2SvEbNgLrZvnQcvlgWP78a9T2i_0 2024-09-12T01:07:26.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15560171684471034703', time=2024-09-12T03:03:22.848577+0000, chain.objs.size()=1 2024-09-12T01:07:26.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.626__shadow_.YaMMEr1B0AX2oywQ9QFENN9_JP6wJKn_0 2024-09-12T01:07:26.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11277285231994151206', time=2024-09-12T03:03:31.186741+0000, chain.objs.size()=1 2024-09-12T01:07:26.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.639__shadow_.ooXPVdwh1em2AOor5WwhU1IVnlmzGLl_0 2024-09-12T01:07:26.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4681861168497207999', time=2024-09-12T03:03:50.762874+0000, chain.objs.size()=6 2024-09-12T01:07:26.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.661__multipart_baz.2~1_P8IxpgopOTXEG3IugShnOTulF6uS1.1 2024-09-12T01:07:26.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.661__multipart_baz.2~1_P8IxpgopOTXEG3IugShnOTulF6uS1.2 2024-09-12T01:07:26.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.661__multipart_baz.2~1_P8IxpgopOTXEG3IugShnOTulF6uS1.3 2024-09-12T01:07:26.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.661__multipart_baz.2~1_P8IxpgopOTXEG3IugShnOTulF6uS1.4 2024-09-12T01:07:26.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.661__multipart_baz.2~1_P8IxpgopOTXEG3IugShnOTulF6uS1.5 2024-09-12T01:07:26.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.661__multipart_baz.2~1_P8IxpgopOTXEG3IugShnOTulF6uS1.6 2024-09-12T01:07:26.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9088953880297117889', time=2024-09-12T03:03:51.727745+0000, chain.objs.size()=1 2024-09-12T01:07:26.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.663__shadow_.gg1kbl6Ant1btQuDorXHHTqJ_aLGnhR_0 2024-09-12T01:07:26.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6893315331888246261', time=2024-09-12T03:04:17.250705+0000, chain.objs.size()=1 2024-09-12T01:07:26.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.704__shadow:W0zYZpjVzRIYVhC3ZsUf5fT7Ww3RFV0_.X74nYo0-wnhSWpfoipINYePBpy8Dibj_0 2024-09-12T01:07:26.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7049533253028372132', time=2024-09-12T03:04:23.114606+0000, chain.objs.size()=1 2024-09-12T01:07:26.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.713__shadow:yhQ2QY3ATMboa2GCZnnRgFSSaPn6HKe_.5umnXE6kyi0qs59QqOwyxmEU1QQ7i5b_0 2024-09-12T01:07:26.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.244+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QpSVnI262vIhH1_rVeICYBnj6_QsT5m', time=2024-09-12T03:05:02.820330+0000, chain.objs.size()=1 2024-09-12T01:07:26.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.244+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.742__multipart_mymultipart2.2~QpSVnI262vIhH1_rVeICYBnj6_QsT5m.1 2024-09-12T01:07:26.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.244+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:07:26.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47247' 2024-09-12T01:07:26.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2001736869142321645', time=2024-09-12T02:51:28.796159+0000, chain.objs.size()=3 2024-09-12T01:07:26.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.vmcgizZh5ZF76LT1-LmM1OaMIvLucpD_0 2024-09-12T01:07:26.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.vmcgizZh5ZF76LT1-LmM1OaMIvLucpD_1 2024-09-12T01:07:26.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.vmcgizZh5ZF76LT1-LmM1OaMIvLucpD_2 2024-09-12T01:07:26.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15028336649524116672', time=2024-09-12T02:53:40.556557+0000, chain.objs.size()=1 2024-09-12T01:07:26.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.233__shadow_.WYoaFtQULv5Ej9poL8TmNrtFPOhfPIT_0 2024-09-12T01:07:26.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10843168474958711056', time=2024-09-12T02:53:51.495723+0000, chain.objs.size()=1 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.246__shadow_.BFWYRFBSfUy4fu8LW0I4qpyvUDQH2cw_0 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14932882569387906518', time=2024-09-12T02:53:55.674837+0000, chain.objs.size()=1 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.252__shadow_.P1b1KqQuj-mbIUuKYiC5SyaRaOkNqJZ_0 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4141274345496124514', time=2024-09-12T02:54:01.986115+0000, chain.objs.size()=1 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.261__shadow_.dmG10RsMnCF5wH8WcgkJALrnwSqmZVQ_0 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3023219934736986418', time=2024-09-12T02:54:23.082566+0000, chain.objs.size()=1 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Ex1NhY7VIuQCUiBnOiQl3gc6HGZS9pf_0 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2127283265385624454', time=2024-09-12T02:54:23.184805+0000, chain.objs.size()=1 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.BML2LDujWAJ7s1rJ5c1msBLR_-tnIIW_0 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1471068738696637878', time=2024-09-12T02:54:23.250849+0000, chain.objs.size()=1 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.sgByaEGQ_O0g1fe6HOnrMoSyDiDkTiT_0 2024-09-12T01:07:26.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3556109433208903280', time=2024-09-12T02:54:23.253937+0000, chain.objs.size()=1 2024-09-12T01:07:26.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WEDu2hKabD-hQQsr9crpFGLxeEkOFqt_0 2024-09-12T01:07:26.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3011999081659354750', time=2024-09-12T02:54:23.567026+0000, chain.objs.size()=1 2024-09-12T01:07:26.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.lqRlD3MgXES5Uyd_d99cz_Ci-kuw5ew_0 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15095055814229635447', time=2024-09-12T02:54:23.585193+0000, chain.objs.size()=1 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.r1YETDOGrr6S05DLVehsBdpO5bx-MNx_0 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.231668107570446395', time=2024-09-12T02:54:24.012253+0000, chain.objs.size()=1 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NfWTnxem77UmYXeV5Y4Wexav1fnPuFO_0 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18110212090925162979', time=2024-09-12T02:54:24.033129+0000, chain.objs.size()=1 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0szNY_VwK5I9yvt9w9m_IfBXmjC5_6r_0 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4930508651610358488', time=2024-09-12T02:54:24.082334+0000, chain.objs.size()=1 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IZ-5is9ZAQ_CaS3Yn129mSpr3CIw2Wh_0 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13461266800048342790', time=2024-09-12T02:54:24.187183+0000, chain.objs.size()=1 2024-09-12T01:07:26.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.E0ZvRtBxA0d5deeLCoEbFpYrWHqqcYd_0 2024-09-12T01:07:26.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14190122720015003629', time=2024-09-12T02:54:24.206080+0000, chain.objs.size()=1 2024-09-12T01:07:26.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jntO0PNpRRhj598MBVEaBzUo5_J92hD_0 2024-09-12T01:07:26.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10874445311513253934', time=2024-09-12T02:54:24.349415+0000, chain.objs.size()=1 2024-09-12T01:07:26.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HB6hF9pOJA4xz7xxD9pC39TsZsS0I6c_0 2024-09-12T01:07:26.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12584746199841356225', time=2024-09-12T02:54:24.418170+0000, chain.objs.size()=1 2024-09-12T01:07:26.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cIgkV6R1S1riMqw0V8tzFGpTASjmCZT_0 2024-09-12T01:07:26.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8892723567504191108', time=2024-09-12T02:54:24.444794+0000, chain.objs.size()=1 2024-09-12T01:07:26.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.T-S0Tiin0hGWXrfviSzBgDl1iNjxh7M_0 2024-09-12T01:07:26.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17047155735858352934', time=2024-09-12T02:54:24.628437+0000, chain.objs.size()=1 2024-09-12T01:07:26.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bT6yg60xYF7Vefg_PGXksDoDsXPqRhR_0 2024-09-12T01:07:26.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17718232294985787441', time=2024-09-12T02:54:24.629943+0000, chain.objs.size()=1 2024-09-12T01:07:26.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.USYB4l3Pqk-6ualJgtsPKsnLu6cYQhh_0 2024-09-12T01:07:26.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17972290244428073575', time=2024-09-12T02:54:24.761726+0000, chain.objs.size()=1 2024-09-12T01:07:26.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kgyRlbuRamwwMX0eNR1HO6KzQsTaD3f_0 2024-09-12T01:07:26.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.102950106562914368', time=2024-09-12T02:54:24.972389+0000, chain.objs.size()=1 2024-09-12T01:07:26.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Pr1_6TxoMAYyP0rq_0lSnV9x_-Ymlr__0 2024-09-12T01:07:26.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11933936936087890869', time=2024-09-12T02:54:25.162445+0000, chain.objs.size()=1 2024-09-12T01:07:26.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iimq0GOvLYqp2meUZ-dC8bPJvdDRIQK_0 2024-09-12T01:07:26.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7310156755606018510', time=2024-09-12T02:54:25.253156+0000, chain.objs.size()=1 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8NLyBocVV7eFVddsPCd6xnCxjn6Z9xs_0 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14233456279101049330', time=2024-09-12T02:54:25.273490+0000, chain.objs.size()=1 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.e2gbdTa4bmigvMd-uwva4megfL6EH9R_0 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11879121070039011238', time=2024-09-12T02:54:25.324510+0000, chain.objs.size()=1 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JPvmD9bA_xanBFNzHF3QwBw4a9insZv_0 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13437686691017840600', time=2024-09-12T02:54:25.592659+0000, chain.objs.size()=1 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Yr_XOFDy2aZvxFpaH8eBy6sxYqHV0ad_0 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17745231533977749341', time=2024-09-12T02:54:25.598259+0000, chain.objs.size()=1 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ES9yokaIxgVdES1a4uQXkFJ0ERueasF_0 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6188679753114707274', time=2024-09-12T02:54:25.620817+0000, chain.objs.size()=1 2024-09-12T01:07:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.62AsksTXnDKz92fYcOHm7f0_e6-muwJ_0 2024-09-12T01:07:26.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14145786265332320180', time=2024-09-12T02:54:25.667748+0000, chain.objs.size()=1 2024-09-12T01:07:26.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iWkYQWoWpYb-9UWbtmLuX3XAVlN3QQf_0 2024-09-12T01:07:26.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7205394740633294069', time=2024-09-12T02:54:25.718085+0000, chain.objs.size()=1 2024-09-12T01:07:26.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ZjtMzix46WZ_Wcq4ZyDjkHWbunpZB21_0 2024-09-12T01:07:26.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13652405702801953395', time=2024-09-12T02:54:25.753858+0000, chain.objs.size()=1 2024-09-12T01:07:26.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1wgZUaB64Hg6hpe3YGiW_ZROHOxL7K8_0 2024-09-12T01:07:26.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2901368441873315767', time=2024-09-12T02:54:25.851732+0000, chain.objs.size()=1 2024-09-12T01:07:26.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ZwW2o-_AsnKUFCIhmFe5NlW8-rnlDHO_0 2024-09-12T01:07:26.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.804913718027652729', time=2024-09-12T02:54:25.853960+0000, chain.objs.size()=1 2024-09-12T01:07:26.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.os8OZai_krRQyrRbRwAb79CcADyrOjI_0 2024-09-12T01:07:26.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.274987875408599736', time=2024-09-12T02:54:25.888135+0000, chain.objs.size()=1 2024-09-12T01:07:26.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bq6a4bCYsjk1ue8DNm6osN3U-HVWHRM_0 2024-09-12T01:07:26.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13404110807050695517', time=2024-09-12T02:54:25.906739+0000, chain.objs.size()=1 2024-09-12T01:07:26.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.O9xuL4LNDBPqD444qq7G7b8lj3RWoF1_0 2024-09-12T01:07:26.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10037204300641904794', time=2024-09-12T02:54:39.017686+0000, chain.objs.size()=1 2024-09-12T01:07:26.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.281__shadow_.uro4g4UrCsZ5PD07zie499D1aun0HXT_0 2024-09-12T01:07:26.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9809190261729993568', time=2024-09-12T02:54:47.963647+0000, chain.objs.size()=1 2024-09-12T01:07:26.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.f92zrgb5GVzf5DOYfO60rdTsuAnLEVc_0 2024-09-12T01:07:26.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12165768472737811470', time=2024-09-12T02:54:49.397154+0000, chain.objs.size()=1 2024-09-12T01:07:26.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.KRWx3lZjDX4gdzgDpjgw6bzD91kmKzQ_0 2024-09-12T01:07:26.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17834204477073906228', time=2024-09-12T02:54:52.184125+0000, chain.objs.size()=1 2024-09-12T01:07:26.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.297__shadow_.79XKb54DW8d3lH_6izH0utNHt6Gt6QZ_0 2024-09-12T01:07:26.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2932074176452355119', time=2024-09-12T02:54:54.440873+0000, chain.objs.size()=1 2024-09-12T01:07:26.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.300__shadow_.O-Miu3z2wSAIn4K6p-4KUF1B4WI1oGE_0 2024-09-12T01:07:26.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4978594015014082945', time=2024-09-12T02:54:55.135226+0000, chain.objs.size()=1 2024-09-12T01:07:26.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.301__shadow_.c7LyAOaTf-CAKfBh6I3hxPT9_9ssU0p_0 2024-09-12T01:07:26.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5678097628202250851', time=2024-09-12T02:55:31.022940+0000, chain.objs.size()=1 2024-09-12T01:07:26.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qKVSzVOkZlKIiZeoVTBaobWFxXQPs_H_0 2024-09-12T01:07:26.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6953760434432409553', time=2024-09-12T02:55:31.036454+0000, chain.objs.size()=1 2024-09-12T01:07:26.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qtZb3FQTYGBTqGjrEzv5UqSSUPm_GWP_0 2024-09-12T01:07:26.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9226137199240886529', time=2024-09-12T02:55:31.228410+0000, chain.objs.size()=1 2024-09-12T01:07:26.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6IA3h3jTLCsrbDrGbLnyEE1Nl0SnO8V_0 2024-09-12T01:07:26.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14752613420567865705', time=2024-09-12T02:55:31.293879+0000, chain.objs.size()=1 2024-09-12T01:07:26.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.b8M5tqWCVD_bnpJNUNdt9rhNkSbFTF__0 2024-09-12T01:07:26.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15729354430921788466', time=2024-09-12T02:55:31.295705+0000, chain.objs.size()=1 2024-09-12T01:07:26.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dleGzjRX-dXKnNbUBfutXoFs71_xQuo_0 2024-09-12T01:07:26.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9844970874889861902', time=2024-09-12T02:55:31.333692+0000, chain.objs.size()=1 2024-09-12T01:07:26.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OfbDRw4paCl8lqLP8jhWQ8zn5OJ9H1r_0 2024-09-12T01:07:26.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13593382249852761039', time=2024-09-12T02:55:31.390176+0000, chain.objs.size()=1 2024-09-12T01:07:26.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.H4Qtg6X1HYHSR9wHAf61XK6mJAK1ow7_0 2024-09-12T01:07:26.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7578452356025010119', time=2024-09-12T02:55:31.408045+0000, chain.objs.size()=1 2024-09-12T01:07:26.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0V4osQlzROErcAMevX7N0U8xt0JCPXS_0 2024-09-12T01:07:26.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1735067680339010875', time=2024-09-12T02:55:31.434160+0000, chain.objs.size()=1 2024-09-12T01:07:26.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GEz8kIvvOb4blu7U0nRfF44XipnTUVe_0 2024-09-12T01:07:26.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7320291246186939291', time=2024-09-12T02:55:31.552679+0000, chain.objs.size()=1 2024-09-12T01:07:26.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8uxO7KnpOv1XbHC3Q1Y5540Sl6lbEEN_0 2024-09-12T01:07:26.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12416130904615319082', time=2024-09-12T02:55:31.599547+0000, chain.objs.size()=1 2024-09-12T01:07:26.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.AoXfhF3vpWYBF7hIImeyUOlcLDeLEAF_0 2024-09-12T01:07:26.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.429412167662754664', time=2024-09-12T02:55:31.620288+0000, chain.objs.size()=1 2024-09-12T01:07:26.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bmEQuasMvAKXH-KAlM5DCO7dsRTpqZM_0 2024-09-12T01:07:26.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7745553633366575084', time=2024-09-12T02:55:31.678591+0000, chain.objs.size()=1 2024-09-12T01:07:26.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PN8wgM3Eg4ppC_Tey9i0MwH1GR8wLaY_0 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12539347627942059453', time=2024-09-12T02:55:31.744361+0000, chain.objs.size()=1 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.UM4wd680wF9-Lfhe_imG72LKUB-DQIr_0 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1159144847639395424', time=2024-09-12T02:55:31.748114+0000, chain.objs.size()=1 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Ij47WLSwKyy-wJPU5Uyk525tvOJjGkN_0 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14220823515342984275', time=2024-09-12T02:55:31.908544+0000, chain.objs.size()=1 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bymc6aSX2HjpDWOj6tiN-AHMM1QrBSf_0 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12439164167687934381', time=2024-09-12T02:55:31.915841+0000, chain.objs.size()=1 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xrvOZM1zyisH0iyhEq5RAxs4GNZcIxC_0 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.686076231312450179', time=2024-09-12T02:55:31.967261+0000, chain.objs.size()=1 2024-09-12T01:07:26.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.SuzdGw0r52xmCNk_k3fj3DToaetwFef_0 2024-09-12T01:07:26.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7860487945665695371', time=2024-09-12T02:55:32.274670+0000, chain.objs.size()=1 2024-09-12T01:07:26.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yNBTcn6nray5plsDyNJGKtoGNNc29eA_0 2024-09-12T01:07:26.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5096560544265512773', time=2024-09-12T02:55:32.319289+0000, chain.objs.size()=1 2024-09-12T01:07:26.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9ceI_aXwKxF-CcrmtwO-oNQKuZJ3ef5_0 2024-09-12T01:07:26.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5572296317500227118', time=2024-09-12T02:55:32.424853+0000, chain.objs.size()=1 2024-09-12T01:07:26.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4sAwpxOwL4tcBOYRJ_84C6IaXWZyJic_0 2024-09-12T01:07:26.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5276880341883737591', time=2024-09-12T02:55:32.553859+0000, chain.objs.size()=1 2024-09-12T01:07:26.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GtSGPnW_3lAZPSY8WM3wc9wvYP0N2Ij_0 2024-09-12T01:07:26.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12913733929781636522', time=2024-09-12T02:55:32.579183+0000, chain.objs.size()=1 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Rbhi3DpJvSXyxgAWECCLI47dxsawp9O_0 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7507350402742204261', time=2024-09-12T02:55:32.644695+0000, chain.objs.size()=1 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QukPzbXf6qXb3houXNUNudZOYXDXbXm_0 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.415114567063403241', time=2024-09-12T02:55:32.700633+0000, chain.objs.size()=1 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Zpypz5fx7bj1ljQ0E2yACtEr8mR0jeb_0 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9517293517513579440', time=2024-09-12T02:55:32.731240+0000, chain.objs.size()=1 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-qoKAxAk052jKfrpanSd6hLA59F1UTZ_0 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14792276873462026845', time=2024-09-12T02:55:32.734299+0000, chain.objs.size()=1 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tWIRfvRmwZYW7b8VbAp8D456ggeIUgu_0 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12753736399253993555', time=2024-09-12T02:55:32.918831+0000, chain.objs.size()=1 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9olW7R13KaMKhhE8wYIMYIbXvM1R8d8_0 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4635414027961672687', time=2024-09-12T02:55:32.931116+0000, chain.objs.size()=1 2024-09-12T01:07:26.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5xhBkEGGX_cVVV7XkREDif85AkqSHxX_0 2024-09-12T01:07:26.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14927618798814732109', time=2024-09-12T02:55:32.984667+0000, chain.objs.size()=1 2024-09-12T01:07:26.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zd8ytg2Wd-MrXPcn_Bgb7jxc0R1SomD_0 2024-09-12T01:07:26.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12495292519441257599', time=2024-09-12T02:55:33.002853+0000, chain.objs.size()=1 2024-09-12T01:07:26.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.FrUrN2vMqnAt1CLVhCTJEKLr2izbELP_0 2024-09-12T01:07:26.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11032174826009840546', time=2024-09-12T02:55:33.049548+0000, chain.objs.size()=1 2024-09-12T01:07:26.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Oq3m4MJQBP7XF-M5OCLc4SNEFsfEZNV_0 2024-09-12T01:07:26.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6307821809081673355', time=2024-09-12T02:55:33.078133+0000, chain.objs.size()=1 2024-09-12T01:07:26.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.AfmL0XdOxTlzojpJpLNmmQKMhM71y24_0 2024-09-12T01:07:26.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17127673417762911414', time=2024-09-12T02:55:33.178425+0000, chain.objs.size()=1 2024-09-12T01:07:26.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IjjhvhrINAO1bPE8pV6xG317lnSD81F_0 2024-09-12T01:07:26.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6802868471183576065', time=2024-09-12T02:55:33.224311+0000, chain.objs.size()=1 2024-09-12T01:07:26.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.iGHHN7Q1yvuMRp91LGG5mklU_RYaYjt_0 2024-09-12T01:07:26.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10423087349237344959', time=2024-09-12T02:55:33.308615+0000, chain.objs.size()=1 2024-09-12T01:07:26.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.x8OHFcXWoPUlSX00aqGR_FL9G6mY37q_0 2024-09-12T01:07:26.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12413293184631554104', time=2024-09-12T02:55:54.504885+0000, chain.objs.size()=1 2024-09-12T01:07:26.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0nxDWdI_6UBnV98JAAg6oQNnM6v2335_0 2024-09-12T01:07:26.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4127875218283850102', time=2024-09-12T02:55:54.648913+0000, chain.objs.size()=1 2024-09-12T01:07:26.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MiDZNlTigMnhPK46qcQjQVA-FGqbCMm_0 2024-09-12T01:07:26.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2631308315494509077', time=2024-09-12T02:55:54.689645+0000, chain.objs.size()=1 2024-09-12T01:07:26.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9J0N9jaxaDAaLeDXkxvC8DVcV59sYBs_0 2024-09-12T01:07:26.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18150204405596211986', time=2024-09-12T02:55:54.859695+0000, chain.objs.size()=1 2024-09-12T01:07:26.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dMqc5a4EvLcvHTr-ZQQk5SaXghwjxgo_0 2024-09-12T01:07:26.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11231190567150484949', time=2024-09-12T02:55:54.902121+0000, chain.objs.size()=1 2024-09-12T01:07:26.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pbiI1QYZLYp0R0E2MyoUiUeQmauUeiv_0 2024-09-12T01:07:26.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15630818440672786351', time=2024-09-12T02:55:55.134215+0000, chain.objs.size()=1 2024-09-12T01:07:26.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1TzGnDi4otpTBeevV0yhLPOkUiaXFZD_0 2024-09-12T01:07:26.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11112221470870003488', time=2024-09-12T02:55:55.175544+0000, chain.objs.size()=1 2024-09-12T01:07:26.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BQ6z2CvDYbnxPNgtp4kJt9DqvSoLsUw_0 2024-09-12T01:07:26.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3834464554967984634', time=2024-09-12T02:55:55.291435+0000, chain.objs.size()=1 2024-09-12T01:07:26.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4kgvezVEMVXoG429irMQ8B_Wx8eblaL_0 2024-09-12T01:07:26.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4107702183147264480', time=2024-09-12T02:55:55.531253+0000, chain.objs.size()=1 2024-09-12T01:07:26.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MUebUzrgnvqJhKTn9h6CDMrAGwIT1U5_0 2024-09-12T01:07:26.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6551518899920271172', time=2024-09-12T02:55:55.560295+0000, chain.objs.size()=1 2024-09-12T01:07:26.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1pDvgh_rQEV-x3RqZrDlqttotNV8Uz3_0 2024-09-12T01:07:26.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13620323261517423491', time=2024-09-12T02:55:55.589043+0000, chain.objs.size()=1 2024-09-12T01:07:26.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fgnbX9crFDJc1IkXztgk85Jkx1aMEDl_0 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11022513975243847533', time=2024-09-12T02:55:55.598858+0000, chain.objs.size()=1 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mfx3usOJ7fjGlTwoKngaN_YEhInn3ep_0 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10489920447431897196', time=2024-09-12T02:55:55.604260+0000, chain.objs.size()=1 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7RGjoK8oDS-2f_ow6uJ4meiUaRV2PQs_0 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6084172251305687387', time=2024-09-12T02:55:55.640224+0000, chain.objs.size()=1 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HTgmvL9zcd88lZCr5m9-y7q5XZW3kcN_0 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6012085907437664088', time=2024-09-12T02:55:55.656668+0000, chain.objs.size()=1 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Nigsv2c2-XAC6bwgi6G_eEmj9jBznCC_0 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8876715643856458324', time=2024-09-12T02:55:55.954037+0000, chain.objs.size()=1 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.O4nvt0Lq3dMBUazw2swGiYlaOjxb4JS_0 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16534119241268013369', time=2024-09-12T02:55:55.970065+0000, chain.objs.size()=1 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xUncKPvsuABMOmJawewf0Y1jk8TQmpm_0 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9980221091235721801', time=2024-09-12T02:55:55.999173+0000, chain.objs.size()=1 2024-09-12T01:07:26.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TZEU66HnpiMwLDPHMP6i6GL8JZ_Ueic_0 2024-09-12T01:07:26.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7584089828184531035', time=2024-09-12T02:55:56.005404+0000, chain.objs.size()=1 2024-09-12T01:07:26.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TXtyBAElckKQaeY-MO4g0VZ0yjw97Zk_0 2024-09-12T01:07:26.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7282993819097025779', time=2024-09-12T02:55:56.136689+0000, chain.objs.size()=1 2024-09-12T01:07:26.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kgR9DDx3iz42MJm2SLZ2jaV6KUH_gBa_0 2024-09-12T01:07:26.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15551793316680656414', time=2024-09-12T02:55:56.157972+0000, chain.objs.size()=1 2024-09-12T01:07:26.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3xZAdfuB4Dqp1cIsCDXlSImdXNMjv0C_0 2024-09-12T01:07:26.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47247 2024-09-12T01:07:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T01:07:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13558134611945353669', time=2024-09-12T02:55:56.234772+0000, chain.objs.size()=1 2024-09-12T01:07:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4bDdCRYNUfYSGe04vfWnpDxeZEFWE6F_0 2024-09-12T01:07:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7301361510732686149', time=2024-09-12T02:55:56.354956+0000, chain.objs.size()=1 2024-09-12T01:07:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.P-WHMH3WyIX-8t4ZHwxdqQCgDvS3JLg_0 2024-09-12T01:07:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4720354716832018840', time=2024-09-12T02:55:56.458302+0000, chain.objs.size()=1 2024-09-12T01:07:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.aHVPFNfSkwXKcWcQN0J0DoZ3ocx7m_K_0 2024-09-12T01:07:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18409451875783510054', time=2024-09-12T02:55:56.516059+0000, chain.objs.size()=1 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sDX6ZV7JUpK8Nggtw_Zd_NY7mYqrrCE_0 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11628351731923136027', time=2024-09-12T02:55:56.618963+0000, chain.objs.size()=1 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Gi2IZYaNjizW83LB069E4YxlDzWPXEb_0 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7940543124692658535', time=2024-09-12T02:55:56.656021+0000, chain.objs.size()=1 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DRlfqRMTdsrHlqFeMeVtQhCWOJ7MXyN_0 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16428799758800161499', time=2024-09-12T02:55:56.813605+0000, chain.objs.size()=1 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0c89p8lKILyHaFt6T6h0G1ERC1qYF1d_0 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1229074652224877598', time=2024-09-12T02:55:56.824359+0000, chain.objs.size()=1 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kca_7qCFwsvjxaz6HaZRvCGbfB12EbV_0 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16171294476272983212', time=2024-09-12T02:55:56.874038+0000, chain.objs.size()=1 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.x04cg6-hUsXgQn6OUK2RKCFEV4B1piF_0 2024-09-12T01:07:26.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1356422038985704234', time=2024-09-12T02:55:56.922562+0000, chain.objs.size()=1 2024-09-12T01:07:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.moopLBrGv98PusrCCKcK70Z4D1i5631_0 2024-09-12T01:07:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9695279031531752423', time=2024-09-12T02:56:01.649402+0000, chain.objs.size()=1 2024-09-12T01:07:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.332__shadow_.32BP2cjJoYBMexNOHFVDRaf0r9q_LIX_0 2024-09-12T01:07:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1764048720796620584', time=2024-09-12T02:56:03.765244+0000, chain.objs.size()=1 2024-09-12T01:07:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.335__shadow_.hRpnCLbgNm7AG6Yw13rYO9ZYNPuCtNt_0 2024-09-12T01:07:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.300+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5693944517233514524', time=2024-09-12T02:56:08.157423+0000, chain.objs.size()=1 2024-09-12T01:07:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.342__shadow_.vc7acFnTkzddiwhyFKsJFvUcThY40aR_0 2024-09-12T01:07:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.300+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11865529352838611333', time=2024-09-12T02:56:28.369825+0000, chain.objs.size()=1 2024-09-12T01:07:26.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.375__shadow_.6yH6el1n6ZW3x1cYeRffSu2N5QK1zqE_0 2024-09-12T01:07:26.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.300+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7827999721285534787', time=2024-09-12T02:57:08.400152+0000, chain.objs.size()=1 2024-09-12T01:07:26.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.431__shadow_.CmUtDzkxUJIrRz-x5cmIRbgdr331I93_0 2024-09-12T01:07:26.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.300+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11247411836378238277', time=2024-09-12T02:57:37.116701+0000, chain.objs.size()=1 2024-09-12T01:07:26.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.466__shadow_.P5MJ2J9iX2drXTuyMv2-zIIhBmZiZRI_0 2024-09-12T01:07:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10975791145042640634', time=2024-09-12T02:57:37.118584+0000, chain.objs.size()=1 2024-09-12T01:07:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.466__shadow_.qCipon2HL-TE5T_uV1vHUo8uBX8f3BK_0 2024-09-12T01:07:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3973369602335023711', time=2024-09-12T02:57:45.818631+0000, chain.objs.size()=1 2024-09-12T01:07:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.484__shadow_.FtarGDCx6uEc1xw2BKDgIIrKYQ9gCv0_0 2024-09-12T01:07:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12388899211584322650', time=2024-09-12T02:57:45.828013+0000, chain.objs.size()=1 2024-09-12T01:07:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.484__shadow_.PFueG7kdq2zyczavw-x9RXtHhzQaV-Z_0 2024-09-12T01:07:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13120471008801512993', time=2024-09-12T03:00:36.941363+0000, chain.objs.size()=1 2024-09-12T01:07:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:W-mewxtomywZEo0nDXvZ4U1mzh.uRP9_.f4gwS6pL03CGlmxsJbvIJxtmuAsKfgt_0 2024-09-12T01:07:26.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11466056431745660390', time=2024-09-12T03:00:37.730514+0000, chain.objs.size()=1 2024-09-12T01:07:26.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.582__shadow:l.ySVNA5V1h4LX3WprqcAk8TMYPRzjN_.kaErJjJSU2-bypOpMVjA6v_vvY0PRkn_0 2024-09-12T01:07:26.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14763293859451484023', time=2024-09-12T03:03:45.169063+0000, chain.objs.size()=1 2024-09-12T01:07:26.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.656__shadow_.kQouaAoU8iNS_Gzdx1BnPAUipsWjK_f_0 2024-09-12T01:07:26.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18105577905207328645', time=2024-09-12T03:04:19.267537+0000, chain.objs.size()=1 2024-09-12T01:07:26.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.304+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.707__shadow:CAfcC8SmXt4Slc7CWwpH57ItermgYzl_.6kjLF0PwgSDcFXo49M2l57iaOElKJo0_0 2024-09-12T01:07:26.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:07:26.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45066' 2024-09-12T01:07:26.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10034829115748241927', time=2024-09-12T02:51:31.887826+0000, chain.objs.size()=3 2024-09-12T01:07:26.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.zLpS3nyFcOXXzDI_2iHdLRQDzadbili_0 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.zLpS3nyFcOXXzDI_2iHdLRQDzadbili_1 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.zLpS3nyFcOXXzDI_2iHdLRQDzadbili_2 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_nyk6xn7gs7dBX5_7fcmewRnPdoduZhV', time=2024-09-12T02:51:32.196008+0000, chain.objs.size()=3 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.xXV_dZJaQABC9zPL6tWoli-JTRl1xG3_0 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.xXV_dZJaQABC9zPL6tWoli-JTRl1xG3_1 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.xXV_dZJaQABC9zPL6tWoli-JTRl1xG3_2 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_nVMDhZWvt7gDrp_y_-FzvCZCgEqwn_T', time=2024-09-12T02:51:35.131718+0000, chain.objs.size()=3 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.Zaha8i3_V1-vnQWM11_j3JufRXKAemu_0 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.Zaha8i3_V1-vnQWM11_j3JufRXKAemu_1 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.Zaha8i3_V1-vnQWM11_j3JufRXKAemu_2 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10769045544740966659', time=2024-09-12T02:51:50.312061+0000, chain.objs.size()=1 2024-09-12T01:07:26.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.182__shadow_.XDSPfsXxpknknn38GYPr96dybj6pBWL_0 2024-09-12T01:07:26.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12343200668231749026', time=2024-09-12T02:53:40.561106+0000, chain.objs.size()=1 2024-09-12T01:07:26.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.233__shadow_.935GDfD3W8ChuaEyewhOHW_lOugxzPf_0 2024-09-12T01:07:26.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11126732017614291197', time=2024-09-12T02:53:41.237369+0000, chain.objs.size()=1 2024-09-12T01:07:26.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.234__shadow_.nS6x9AO_MI7OWCoHYrZnXw93buxJCAu_0 2024-09-12T01:07:26.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11999583585379602895', time=2024-09-12T02:53:48.905594+0000, chain.objs.size()=1 2024-09-12T01:07:26.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.243__shadow_.cyFB2btFqJpx2K2yRsKk7F_1yqNBE7R_0 2024-09-12T01:07:26.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8699408961174013612', time=2024-09-12T02:53:57.088180+0000, chain.objs.size()=1 2024-09-12T01:07:26.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.254__shadow_.oGQJoaD0Qhn_eeMQEakGkhHP0PlCZ-J_0 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1240348123358625478', time=2024-09-12T02:53:58.501004+0000, chain.objs.size()=1 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.256__shadow_.Bh8NHfDxCKleoI9YJdKHfa8jWexYHJB_0 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15020148157281308090', time=2024-09-12T02:54:01.262865+0000, chain.objs.size()=1 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.260__shadow_.UMynSUBqwke7wvPiVsrq6grjD06_W_i_0 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3149188039939296161', time=2024-09-12T02:54:23.054202+0000, chain.objs.size()=1 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.V7U1C_-TcslYaa-pYYvxFW3nCoKM5ft_0 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1550567601288716421', time=2024-09-12T02:54:23.082702+0000, chain.objs.size()=1 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ge77pS_BBtroPWVuYj9OIhuFBk2Jvu7_0 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11718520721101674388', time=2024-09-12T02:54:23.125968+0000, chain.objs.size()=1 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Q1duYbDSA8-FzXO_MeOF3ARsDgaN9b1_0 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5970856888058173764', time=2024-09-12T02:54:23.170728+0000, chain.objs.size()=1 2024-09-12T01:07:26.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.A1uwmyNTDm_pNiJ0oX6BGuh2ggGeBPl_0 2024-09-12T01:07:26.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5042517381092179755', time=2024-09-12T02:54:23.204050+0000, chain.objs.size()=1 2024-09-12T01:07:26.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.41cL4R_hDZ5XkEyDLvEVEwzBKrnCv96_0 2024-09-12T01:07:26.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16619568739568206071', time=2024-09-12T02:54:23.248022+0000, chain.objs.size()=1 2024-09-12T01:07:26.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1MdVmD19GNyov2WbPQepWx1HinotW3u_0 2024-09-12T01:07:26.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2532523921720591193', time=2024-09-12T02:54:23.420804+0000, chain.objs.size()=1 2024-09-12T01:07:26.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.myWGAXqR3S98H3ZC_s3lqszr55aUNBD_0 2024-09-12T01:07:26.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15975762897849999912', time=2024-09-12T02:54:23.456885+0000, chain.objs.size()=1 2024-09-12T01:07:26.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.n2xYpMv6hrZYvEc0iLVEuOAn2TJCMPh_0 2024-09-12T01:07:26.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15082346861450498858', time=2024-09-12T02:54:23.465816+0000, chain.objs.size()=1 2024-09-12T01:07:26.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.aarL6ZWFGwlIj8Sfc0HRtJayH8hu1Zy_0 2024-09-12T01:07:26.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14244948967081056256', time=2024-09-12T02:54:23.514109+0000, chain.objs.size()=1 2024-09-12T01:07:26.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.49IfMER4scSnruceq_aXFXynYGmYVjn_0 2024-09-12T01:07:26.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1533954634420820446', time=2024-09-12T02:54:24.357318+0000, chain.objs.size()=1 2024-09-12T01:07:26.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1proIG_lAfctuQtR0L4w85ZDD0DogX3_0 2024-09-12T01:07:26.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16191285444173663041', time=2024-09-12T02:54:24.377177+0000, chain.objs.size()=1 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bHLiazQvLvmit5qrr69UXVGHwKcwiIr_0 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14109483253359738713', time=2024-09-12T02:54:24.404156+0000, chain.objs.size()=1 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.BvnweTBZuebQWDqDNH3lOZTkEc1quPb_0 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3075993061847347106', time=2024-09-12T02:54:24.523087+0000, chain.objs.size()=1 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4qBpxZm6PsZbV14gjLYNR7gYzB4ZkVD_0 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16418158971364907373', time=2024-09-12T02:54:24.531227+0000, chain.objs.size()=1 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1drrn1Lb5k6VCLmtkS8SH1YKy7vdWoS_0 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3620457448174093569', time=2024-09-12T02:54:24.812818+0000, chain.objs.size()=1 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RYAtAg2HX7UTaYy18rdIsrgH0Z7QjoE_0 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8263685783604609600', time=2024-09-12T02:54:24.828007+0000, chain.objs.size()=1 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uUx9npQBI7KcSv042DI1WU8Q15uDG3W_0 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3679548025544945346', time=2024-09-12T02:54:24.890874+0000, chain.objs.size()=1 2024-09-12T01:07:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XyPa7C6EylQoX77ZS3TRGSJvTPf7fBD_0 2024-09-12T01:07:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12406123921873811982', time=2024-09-12T02:54:24.895205+0000, chain.objs.size()=1 2024-09-12T01:07:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qhzSIMSC2DC-y2xfosoLFLpW40MH_dC_0 2024-09-12T01:07:26.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18069485981791791619', time=2024-09-12T02:54:25.337201+0000, chain.objs.size()=1 2024-09-12T01:07:26.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9qUWQwW-g_wDa2hE7bUcJ1NnCNvL0Bp_0 2024-09-12T01:07:26.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6688628926821062568', time=2024-09-12T02:54:25.546585+0000, chain.objs.size()=1 2024-09-12T01:07:26.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2AdIPlf3JwSUlgP2RQNA819gd1bz2wU_0 2024-09-12T01:07:26.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12947147426207027104', time=2024-09-12T02:54:25.588543+0000, chain.objs.size()=1 2024-09-12T01:07:26.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VN0FG3uFkFt1ABKJUUZx5Aa6Et4O4NT_0 2024-09-12T01:07:26.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13326766943983316492', time=2024-09-12T02:54:25.608371+0000, chain.objs.size()=1 2024-09-12T01:07:26.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PyrQWpyr-QjJWPtdNRw3XZohb6f5rLp_0 2024-09-12T01:07:26.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10448125724893042188', time=2024-09-12T02:54:25.623182+0000, chain.objs.size()=1 2024-09-12T01:07:26.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cjLWToC7j-Elq11X_2iZZ_tN1ua_3w6_0 2024-09-12T01:07:26.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13671332090303000310', time=2024-09-12T02:54:25.703389+0000, chain.objs.size()=1 2024-09-12T01:07:26.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-ftOBtezXV4amhUQq6xJfPFnNMio8ai_0 2024-09-12T01:07:26.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11040683422522689661', time=2024-09-12T02:54:25.705576+0000, chain.objs.size()=1 2024-09-12T01:07:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JFyp2oPzk9kz6lOpOJAkKYmWNuwm_I2_0 2024-09-12T01:07:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16044188606003119574', time=2024-09-12T02:54:25.923412+0000, chain.objs.size()=1 2024-09-12T01:07:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Dgk7gB4pFRonA5PLvADZX-vq6VCSRNu_0 2024-09-12T01:07:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6190213871603402726', time=2024-09-12T02:54:25.946715+0000, chain.objs.size()=1 2024-09-12T01:07:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1cuzJ62_eSn4CqBfp6wiOwK_rJ71lxy_0 2024-09-12T01:07:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16379905210783211671', time=2024-09-12T02:54:32.067781+0000, chain.objs.size()=1 2024-09-12T01:07:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.271__shadow_.Y_SLQWonbqlpagqlaHtJRbn7nNsIcnF_0 2024-09-12T01:07:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5806871008951464842', time=2024-09-12T02:54:45.462286+0000, chain.objs.size()=1 2024-09-12T01:07:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.290__shadow_.hJxBPznM3wB8Rhg5AZrXj3mnj87pEUm_0 2024-09-12T01:07:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16063534112577593493', time=2024-09-12T02:54:49.336666+0000, chain.objs.size()=1 2024-09-12T01:07:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.ru2UM7JRqEnyzPrRLKJjrS1rJ2fA9-w_0 2024-09-12T01:07:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3983017664735802303', time=2024-09-12T02:54:49.365581+0000, chain.objs.size()=1 2024-09-12T01:07:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.RkCKqh-9isZlAXQAim_H9k5UhbvKnbs_0 2024-09-12T01:07:26.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15571564124982378330', time=2024-09-12T02:54:49.374263+0000, chain.objs.size()=1 2024-09-12T01:07:26.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.CICvceIxID88ZoQgI7ToGOjvk-3Xekl_0 2024-09-12T01:07:26.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8038533989131636612', time=2024-09-12T02:54:52.941337+0000, chain.objs.size()=1 2024-09-12T01:07:26.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.298__shadow_.JDnU-r1Z9_vqxVThrBxGt-wzkvb3S-h_0 2024-09-12T01:07:26.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5302631739229892110', time=2024-09-12T02:54:55.802207+0000, chain.objs.size()=1 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.302__shadow_.kC0DlUZj-HWMzFVz1zv41P1ONasfLMA_0 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4010192225664747123', time=2024-09-12T02:55:30.902462+0000, chain.objs.size()=1 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.d2f7VHl3kKcBvdysaa2FZhNq_NqdON7_0 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8978955142519424574', time=2024-09-12T02:55:31.088502+0000, chain.objs.size()=1 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.o8B1OWA4vngP-BQ2evwaqpintj8CYjm_0 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3768718860807862989', time=2024-09-12T02:55:31.242082+0000, chain.objs.size()=1 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._NsM6Kr88w4UBaWljXU0EgwjNBC4ZoU_0 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4145936014924756342', time=2024-09-12T02:55:31.366781+0000, chain.objs.size()=1 2024-09-12T01:07:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5Lw6uD9PtwJQtx82dkDMaG37ctGfNmT_0 2024-09-12T01:07:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4767646782830835608', time=2024-09-12T02:55:31.399624+0000, chain.objs.size()=1 2024-09-12T01:07:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.O2pTPMQOZiw0PITwcliYEMKgIDoERWg_0 2024-09-12T01:07:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13160030859831303248', time=2024-09-12T02:55:31.409100+0000, chain.objs.size()=1 2024-09-12T01:07:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rovwah930xRG4tLTZ_f-LqUdhVjUfAP_0 2024-09-12T01:07:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13713206714891210089', time=2024-09-12T02:55:31.577055+0000, chain.objs.size()=1 2024-09-12T01:07:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.D_P5wQNflG-B5W54cNbuC9RjjbMCdoP_0 2024-09-12T01:07:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16612444514189981071', time=2024-09-12T02:55:31.913017+0000, chain.objs.size()=1 2024-09-12T01:07:26.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.CxCW_Y2OAnkO0kDoaSc2eKrwBsC8B7t_0 2024-09-12T01:07:26.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2357237343321890804', time=2024-09-12T02:55:31.928511+0000, chain.objs.size()=1 2024-09-12T01:07:26.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HOQU7xIkx1DBkojvrOTD0xBQSkdxccJ_0 2024-09-12T01:07:26.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2402163512366503930', time=2024-09-12T02:55:31.936309+0000, chain.objs.size()=1 2024-09-12T01:07:26.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zeA402ngIk83Mvzo5OCBCRQupcswm25_0 2024-09-12T01:07:26.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16147373934733152391', time=2024-09-12T02:55:31.952375+0000, chain.objs.size()=1 2024-09-12T01:07:26.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qB0os-UEkrsctRcuCLNPELH-ruw_fbW_0 2024-09-12T01:07:26.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11956175467225312681', time=2024-09-12T02:55:31.985854+0000, chain.objs.size()=1 2024-09-12T01:07:26.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gBlgtGsoLDIpvK30p6gzhjQR_bS7Glv_0 2024-09-12T01:07:26.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11638184539492902109', time=2024-09-12T02:55:32.100140+0000, chain.objs.size()=1 2024-09-12T01:07:26.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8iKIRuZcFUcxBK-ehnG_h-79Qe4qaXu_0 2024-09-12T01:07:26.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10844946358371343797', time=2024-09-12T02:55:32.345395+0000, chain.objs.size()=1 2024-09-12T01:07:26.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OGGnvgEK6eCuWOzbF9nfMMcb3MHOJVQ_0 2024-09-12T01:07:26.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14781197660924273245', time=2024-09-12T02:55:32.386662+0000, chain.objs.size()=1 2024-09-12T01:07:26.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pkuIlOREY9KGDLy3ulAZaGAwTd1VY_J_0 2024-09-12T01:07:26.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5231789966364469467', time=2024-09-12T02:55:32.563124+0000, chain.objs.size()=1 2024-09-12T01:07:26.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.n4rAeoT72XtvvDNcfM7a_tgktVEg2PY_0 2024-09-12T01:07:26.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17883428202550327320', time=2024-09-12T02:55:32.644097+0000, chain.objs.size()=1 2024-09-12T01:07:26.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.h2QHaWe5C2LKkcoIN_pi5os57xqR_du_0 2024-09-12T01:07:26.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3468763565306050403', time=2024-09-12T02:55:32.682715+0000, chain.objs.size()=1 2024-09-12T01:07:26.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Ht76c7ZZXIYNB4OVbJkDiKzQm8GajSe_0 2024-09-12T01:07:26.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1223261636935810297', time=2024-09-12T02:55:32.710599+0000, chain.objs.size()=1 2024-09-12T01:07:26.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.NbzMtFghqE4HjXBGNUCoyWtFzpxXeM8_0 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16700548606520309629', time=2024-09-12T02:55:32.726825+0000, chain.objs.size()=1 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.K5oinK_NUw7GBufOqBVjuIMX-bgMxXO_0 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5927776572963048088', time=2024-09-12T02:55:32.884339+0000, chain.objs.size()=1 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.j9DPtHc4kThyNQCPAVsQ6BZD5g6Iw9F_0 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2720245932208214114', time=2024-09-12T02:55:32.895176+0000, chain.objs.size()=1 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kMvZCaWUB5-xnaP7tEZNH3Ixaet_3ZL_0 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13448595467182141855', time=2024-09-12T02:55:32.905714+0000, chain.objs.size()=1 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.CtcT_et-Ivo4qSAHinaLLE-xaAu1zH8_0 2024-09-12T01:07:26.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15384326262029416512', time=2024-09-12T02:55:32.992319+0000, chain.objs.size()=1 2024-09-12T01:07:26.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.S1RcY1Lkx4bjLCu1KgTlmI7mBg_2YKT_0 2024-09-12T01:07:26.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13282880027717993598', time=2024-09-12T02:55:33.166339+0000, chain.objs.size()=1 2024-09-12T01:07:26.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Z8RwZhDPW8n1ijWN99UU3xn_JiiOfrx_0 2024-09-12T01:07:26.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8321950672821237895', time=2024-09-12T02:55:33.184598+0000, chain.objs.size()=1 2024-09-12T01:07:26.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.SvrkCwclDQeMVHfFGk_ULEhlKm8lyqv_0 2024-09-12T01:07:26.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11444193099002400826', time=2024-09-12T02:55:33.330427+0000, chain.objs.size()=1 2024-09-12T01:07:26.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MgVGkWxwfNnv1BcaQhLx2xb63vWrT_9_0 2024-09-12T01:07:26.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8367748467202264626', time=2024-09-12T02:55:54.469423+0000, chain.objs.size()=1 2024-09-12T01:07:26.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.v6a8U3eFtuRJ5jBHQfziZ_PTzba25-0_0 2024-09-12T01:07:26.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4223729296149470554', time=2024-09-12T02:55:54.547467+0000, chain.objs.size()=1 2024-09-12T01:07:26.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fmnHqrfUg_SVIZTvqsrDzqEZ_X9jIm2_0 2024-09-12T01:07:26.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.467656401932457664', time=2024-09-12T02:55:54.628143+0000, chain.objs.size()=1 2024-09-12T01:07:26.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lOEza9kYJkVEFjbqeTLLgyPDL1WFDBl_0 2024-09-12T01:07:26.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18748851491096952', time=2024-09-12T02:55:54.639306+0000, chain.objs.size()=1 2024-09-12T01:07:26.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7hSdAfztnmx6w1yvoTzsjnhvW0fkNHC_0 2024-09-12T01:07:26.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5441522885826498918', time=2024-09-12T02:55:54.654477+0000, chain.objs.size()=1 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qPCFd9gGMf5miX4FxZi_VuUTbBL22d5_0 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16648642721697937973', time=2024-09-12T02:55:54.661436+0000, chain.objs.size()=1 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.v14yR143bYakX1mLAh30PBn7rTeIvrt_0 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17966584196136587010', time=2024-09-12T02:55:54.812853+0000, chain.objs.size()=1 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wBxtaPIVLiGf5fXgALmX8P5aAHN3TOT_0 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12582633402995542257', time=2024-09-12T02:55:54.851907+0000, chain.objs.size()=1 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WxYKOACG0ixOjOrUH32yl-D4Sqor2M0_0 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.424115059292547883', time=2024-09-12T02:55:54.890492+0000, chain.objs.size()=1 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vbJcFTypK48y1MCVr-iOcYHmsGKTqF6_0 2024-09-12T01:07:26.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8613905887032502660', time=2024-09-12T02:55:54.907968+0000, chain.objs.size()=1 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kz0JKRzEFt83qlfqKlV_F6NxXxfW3k1_0 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5755110146982218341', time=2024-09-12T02:55:54.963683+0000, chain.objs.size()=1 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QsyphFvyxUSwWQsyVwfaOG3lSZmi-AQ_0 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10837387212611341813', time=2024-09-12T02:55:54.998669+0000, chain.objs.size()=1 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ygftH88AnihCGhmsHzSEq_t703Ijgt__0 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4700890047604891598', time=2024-09-12T02:55:55.214501+0000, chain.objs.size()=1 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ETINkqnuwoZnKgEtDh1xoIMfe7D4LHS_0 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9026103261562876752', time=2024-09-12T02:55:55.219529+0000, chain.objs.size()=1 2024-09-12T01:07:26.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sy2YJ0DHkgNmeZUgdShpGuKSAJFAKxl_0 2024-09-12T01:07:26.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17098207327820450342', time=2024-09-12T02:55:55.306450+0000, chain.objs.size()=1 2024-09-12T01:07:26.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-DI7rRqdprBrro5ulovwRBil6-SBeF5_0 2024-09-12T01:07:26.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9692753180153790723', time=2024-09-12T02:55:55.337687+0000, chain.objs.size()=1 2024-09-12T01:07:26.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8cFhyBskZIsqMxKhfC3FBAE4uTQFsdk_0 2024-09-12T01:07:26.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9225653202031257136', time=2024-09-12T02:55:55.516370+0000, chain.objs.size()=1 2024-09-12T01:07:26.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sa8Y95RLIFFhVKcot6RRLalCbQf9rKb_0 2024-09-12T01:07:26.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3661878662401642840', time=2024-09-12T02:55:55.524778+0000, chain.objs.size()=1 2024-09-12T01:07:26.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JVx2N7O35L9DGeohXWooJZqbv5qstaj_0 2024-09-12T01:07:26.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15914564261019333485', time=2024-09-12T02:55:55.554673+0000, chain.objs.size()=1 2024-09-12T01:07:26.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.06SjP-C7rSCO7IvUYu3mbOK0MIZ2ksv_0 2024-09-12T01:07:26.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16495722500106140121', time=2024-09-12T02:55:55.564849+0000, chain.objs.size()=1 2024-09-12T01:07:26.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WpoFN3Mzd4bO6i0yc_S5UpFxF-PPIen_0 2024-09-12T01:07:26.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16834601647198549776', time=2024-09-12T02:55:55.569329+0000, chain.objs.size()=1 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xY8dcwGaQa2f8RFrVRbWaX2j8MskMoz_0 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4676913144915654986', time=2024-09-12T02:55:55.622210+0000, chain.objs.size()=1 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.daA2Sel3pxnNdzWdSuUtSDPu3RaQZN7_0 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.610864634329992020', time=2024-09-12T02:55:55.795416+0000, chain.objs.size()=1 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1N9Af0ok8CF8yh6cilOaEM9BxUeJKnM_0 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16218458259184739572', time=2024-09-12T02:55:55.809128+0000, chain.objs.size()=1 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.R4suBspsT00BqEhLnrPn13lfwQN66qH_0 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14389311053619555189', time=2024-09-12T02:55:55.927440+0000, chain.objs.size()=1 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-5f3QWxas4-K8MXuaDJ1RBypuBtFHOW_0 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13295919137216808019', time=2024-09-12T02:55:56.159214+0000, chain.objs.size()=1 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lkssru8cCjazyMWfX9nICW8v9wBOfo7_0 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2273800044356274932', time=2024-09-12T02:55:56.188526+0000, chain.objs.size()=1 2024-09-12T01:07:26.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4VcggxLoAVgC9hk3T4r8U9zfaJdFciA_0 2024-09-12T01:07:26.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6603894870444320881', time=2024-09-12T02:55:56.355608+0000, chain.objs.size()=1 2024-09-12T01:07:26.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nLHZUjoBW98o8H9BNbR51tHUgFBW1u7_0 2024-09-12T01:07:26.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45066 2024-09-12T01:07:26.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:07:26.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5488993888005577811', time=2024-09-12T02:55:56.474658+0000, chain.objs.size()=1 2024-09-12T01:07:26.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MBhmhTC0fFZfr_Fe1Jze7lsfL-PnLP4_0 2024-09-12T01:07:26.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11643304884953322007', time=2024-09-12T02:55:56.813665+0000, chain.objs.size()=1 2024-09-12T01:07:26.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uSFGcOGNMH0RxB50-TSecJ0IsRv0q9o_0 2024-09-12T01:07:26.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9231860204195949982', time=2024-09-12T02:57:26.321540+0000, chain.objs.size()=1 2024-09-12T01:07:26.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.455__shadow_.n7CHkY55YRnuKDq85f-zDnVmunfoNOq_0 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14352666436602397753', time=2024-09-12T02:57:35.337757+0000, chain.objs.size()=1 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.464__shadow_.96tyUhHIJIhK3pR6xO3hejh6IPOAoEg_0 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7670375561013688708', time=2024-09-12T02:57:36.225247+0000, chain.objs.size()=1 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.465__shadow_.6ae-3ugKWQ2NBnf6J8UIfG5awm-QddZ_0 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11195607983597406363', time=2024-09-12T02:58:09.171618+0000, chain.objs.size()=1 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.518__multipart_mymultipart.2~Vq09nr3-qQHM7qMhOeOhPUiDJZJgJ0e.1 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~y3RS6fI-RmMHpZvROrS7ribGEQStwid', time=2024-09-12T02:58:48.862265+0000, chain.objs.size()=2 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.531__multipart_mymultipart.2~y3RS6fI-RmMHpZvROrS7ribGEQStwid.1 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.531__multipart_mymultipart.2~y3RS6fI-RmMHpZvROrS7ribGEQStwid.2 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14368385457014171641', time=2024-09-12T02:59:10.084428+0000, chain.objs.size()=1 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.536__multipart_mymultipart.2~_A3kJBKoV9hGeMaajX2eb3KCDzYXRdd.1 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7542395623699379598', time=2024-09-12T02:59:42.380937+0000, chain.objs.size()=1 2024-09-12T01:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.561__multipart_mymultipart.x6enhJxSMP46J1OY-X05F1OjU7xq0f6q.1 2024-09-12T01:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2050744626940652274', time=2024-09-12T03:00:10.162366+0000, chain.objs.size()=1 2024-09-12T01:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:hlMh1iEKVGVmA.1oCAOAy8tB1EmBHSj_.Rd9waedv080eTXVWliGWIBXj47Ig_Tm_0 2024-09-12T01:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5681544398642041124', time=2024-09-12T03:00:22.845254+0000, chain.objs.size()=1 2024-09-12T01:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:enyTnKddbJwJ0WzfsRQXTC2Ae.ya2X8_.O0chJAJDXP7UbAPiQ7G5jW-of11FrBe_0 2024-09-12T01:07:26.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.364+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9330809545332179149', time=2024-09-12T03:00:24.735036+0000, chain.objs.size()=1 2024-09-12T01:07:26.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.364+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:-OLjqfb2mzewArbbUDb2TpLPwmNEXu3_.5F-YPOnjGdnrZhjnrj808IToQCQvM0H_0 2024-09-12T01:07:26.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.364+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7085170829773051142', time=2024-09-12T03:00:35.160896+0000, chain.objs.size()=1 2024-09-12T01:07:26.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.364+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:HjPhid6P7HwoAdpeZ1jOoPtPsyrcUGh_.XlezTT3Rl5NoU_0qBSpHOKmR1ey8Wnj_0 2024-09-12T01:07:26.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.364+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16606408152411283605', time=2024-09-12T03:03:32.081063+0000, chain.objs.size()=1 2024-09-12T01:07:26.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.364+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.640__shadow_.Wiwl35p_6YVIkiWz5axy4l8SWQkYRbr_0 2024-09-12T01:07:26.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:07:26.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45454' 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1790866068647697031', time=2024-09-12T02:51:28.782244+0000, chain.objs.size()=3 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.ipBtd2_PJydv97vuZ2HmBsKbCsxeR7c_0 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.ipBtd2_PJydv97vuZ2HmBsKbCsxeR7c_1 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.ipBtd2_PJydv97vuZ2HmBsKbCsxeR7c_2 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_lObhFQqOX4NCHzKwSpmXJ2UenoHI6A8', time=2024-09-12T02:51:31.536501+0000, chain.objs.size()=3 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.309hMT5Po8-mPll5WPeyqOx1zP4gYwx_0 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.309hMT5Po8-mPll5WPeyqOx1zP4gYwx_1 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.309hMT5Po8-mPll5WPeyqOx1zP4gYwx_2 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_qIWmV9CBp1Rv07r1ftFO8c63XVqHJkV', time=2024-09-12T02:51:36.114119+0000, chain.objs.size()=1 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.163__shadow_.46It6yb6EYBdjDjtpjG81MjDi-6f5MU_0 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.815238434198717056', time=2024-09-12T02:53:38.514457+0000, chain.objs.size()=1 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.230__shadow_.COJIG1ME0gjW3tRGFBiGiNOTjQA3GRE_0 2024-09-12T01:07:26.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2493870597204576699', time=2024-09-12T02:53:45.011069+0000, chain.objs.size()=1 2024-09-12T01:07:26.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.238__shadow_.GuoW5Z-OtByoTouVsOVx0ySvILXu2dv_0 2024-09-12T01:07:26.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2777194012802003739', time=2024-09-12T02:53:53.567163+0000, chain.objs.size()=1 2024-09-12T01:07:26.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.249__shadow_.WfgqQUVirnNvA2D_Hrqbfjc8Z5NmaC7_0 2024-09-12T01:07:26.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12491353105955014155', time=2024-09-12T02:54:22.995338+0000, chain.objs.size()=1 2024-09-12T01:07:26.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uB69bXWVeiXq4-iCz9PX6SFLC7dK6Oh_0 2024-09-12T01:07:26.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16761798128374209891', time=2024-09-12T02:54:23.233596+0000, chain.objs.size()=1 2024-09-12T01:07:26.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.UJ3ZFw_M2EbVlaVqUzByoq0hsDfzwLX_0 2024-09-12T01:07:26.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3395607527839832403', time=2024-09-12T02:54:23.457861+0000, chain.objs.size()=1 2024-09-12T01:07:26.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.SmRvotqerBqScQqczknuzq4ZGqFCwH0_0 2024-09-12T01:07:26.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14434072515821924574', time=2024-09-12T02:54:23.731766+0000, chain.objs.size()=1 2024-09-12T01:07:26.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kYwiyROIXW3VuKhTFsHoT6aS1iS90Co_0 2024-09-12T01:07:26.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14865013405304736301', time=2024-09-12T02:54:23.757546+0000, chain.objs.size()=1 2024-09-12T01:07:26.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IaccdSpdufadbZ7dYomCtzKluRF1je4_0 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2601622751005734599', time=2024-09-12T02:54:23.778651+0000, chain.objs.size()=1 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iOF2HOVNAi8HRmaA88TA8CcUUqRBrzv_0 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6831667038527694364', time=2024-09-12T02:54:24.142797+0000, chain.objs.size()=1 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vqOuHlL4WVjjsp46vGlbm-5wiMwlDwL_0 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8079588938566908115', time=2024-09-12T02:54:24.179845+0000, chain.objs.size()=1 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.7XVQqmhX_L3rdfUUQWtDmjPrk7QmD2G_0 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4694930897057481294', time=2024-09-12T02:54:24.180595+0000, chain.objs.size()=1 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jc5p5vcsbPMMXVRtrKAfjCmxonQxSOM_0 2024-09-12T01:07:26.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8802405986326808318', time=2024-09-12T02:54:24.333872+0000, chain.objs.size()=1 2024-09-12T01:07:26.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dWRZpGj2_FhrcojA1IAgdzrZQvkcMsU_0 2024-09-12T01:07:26.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4764641547074217559', time=2024-09-12T02:54:24.343234+0000, chain.objs.size()=1 2024-09-12T01:07:26.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.sCXaAMPYlA6ZtkGRiq0TfDin6jLUOT3_0 2024-09-12T01:07:26.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.450911275739166810', time=2024-09-12T02:54:24.374252+0000, chain.objs.size()=1 2024-09-12T01:07:26.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.OjEqz2xtTs7v3GuqToTKBHZGDeu6KRp_0 2024-09-12T01:07:26.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6328380636232172680', time=2024-09-12T02:54:24.489685+0000, chain.objs.size()=1 2024-09-12T01:07:26.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.376+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bf2_FrjDABtNSJwpOrcwevOeAtvI8iv_0 2024-09-12T01:07:26.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2953763836538962861', time=2024-09-12T02:54:24.772761+0000, chain.objs.size()=1 2024-09-12T01:07:26.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.b2-G3stPCBs68Mtn6g1jHyAOiwO5h8E_0 2024-09-12T01:07:26.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15743069741068276233', time=2024-09-12T02:54:24.782845+0000, chain.objs.size()=1 2024-09-12T01:07:26.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.d0orjwE_Q4P7vK6FPZVynTse1rt32cn_0 2024-09-12T01:07:26.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15775219972499605988', time=2024-09-12T02:54:24.792517+0000, chain.objs.size()=1 2024-09-12T01:07:26.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.SAzGVwh1rAyHENT8LvSeA1mkXUcbkOV_0 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4944169473227852286', time=2024-09-12T02:54:24.896952+0000, chain.objs.size()=1 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LnyMSV82FdEofP6pjjZemivc3N5F5uk_0 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9344499291633274404', time=2024-09-12T02:54:24.901190+0000, chain.objs.size()=1 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mM2j63fOFNtgSM_RVMjv9fJegZE8Kb8_0 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5084607565333377121', time=2024-09-12T02:54:24.925701+0000, chain.objs.size()=1 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NFuUjAawzmS9-6l9KmxTpPPVvfcfFTJ_0 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6248018933728016949', time=2024-09-12T02:54:24.965254+0000, chain.objs.size()=1 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.61AfYLQAI-CxNxkFXiK_AFF65csG9mR_0 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11616678080522456150', time=2024-09-12T02:54:25.001462+0000, chain.objs.size()=1 2024-09-12T01:07:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wtp5NzVzuAB-6WkgxS3Eg1Zp2i48An5_0 2024-09-12T01:07:26.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4435812659152443859', time=2024-09-12T02:54:25.215280+0000, chain.objs.size()=1 2024-09-12T01:07:26.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.c7NYqma3oZOTnFf4nurKSZv-Apnk8T8_0 2024-09-12T01:07:26.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18161084465384438919', time=2024-09-12T02:54:25.296799+0000, chain.objs.size()=1 2024-09-12T01:07:26.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.SSlIMwHAGNQ9ZPpUd3keLrOkhFl7jGj_0 2024-09-12T01:07:26.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17338747524272921991', time=2024-09-12T02:54:25.313823+0000, chain.objs.size()=1 2024-09-12T01:07:26.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gtTal366weR1DwL-CA5Vu3DJMgy4G6B_0 2024-09-12T01:07:26.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12461021530379934605', time=2024-09-12T02:54:25.637723+0000, chain.objs.size()=1 2024-09-12T01:07:26.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.x4UPqbqDMMI58HcylK_SMqhLIgZHp09_0 2024-09-12T01:07:26.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14458332124060795918', time=2024-09-12T02:54:25.668807+0000, chain.objs.size()=1 2024-09-12T01:07:26.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NORCTMp948NgxRjBv_FnCy-sK2eB-RH_0 2024-09-12T01:07:26.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13659701876393966458', time=2024-09-12T02:54:25.684364+0000, chain.objs.size()=1 2024-09-12T01:07:26.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cVwympfGBxrD-DVQu-BpFXKiZZ1uaxk_0 2024-09-12T01:07:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12047294931514397448', time=2024-09-12T02:54:25.711029+0000, chain.objs.size()=1 2024-09-12T01:07:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.7M9ZZtLmn3lPKWvDelGJAZFkUfOxt4V_0 2024-09-12T01:07:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16223595956448802904', time=2024-09-12T02:54:25.750114+0000, chain.objs.size()=1 2024-09-12T01:07:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.W9ssyy3sifk8cWfW6F7oCnLWRrdRwgd_0 2024-09-12T01:07:26.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6290810601139737636', time=2024-09-12T02:54:25.855790+0000, chain.objs.size()=1 2024-09-12T01:07:26.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rorU3itfE-r4HXQROJO2jIuy3Ywf4m3_0 2024-09-12T01:07:26.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16400296522160857925', time=2024-09-12T02:54:25.866214+0000, chain.objs.size()=1 2024-09-12T01:07:26.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cznRNFPivKeCCbYf3GNExPlS33zgvDW_0 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9393093320584315059', time=2024-09-12T02:54:25.916168+0000, chain.objs.size()=1 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6gAZSzuJdKwYhi4jjzlV-d_uPJdmQPf_0 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1667176886631261236', time=2024-09-12T02:54:25.921627+0000, chain.objs.size()=1 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nXOYL-KRmzoHpttwDv9hVKDTPx2w6Rz_0 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10784186058595675077', time=2024-09-12T02:54:26.014180+0000, chain.objs.size()=1 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.I09PWQ5i_CBTGWdZmYqyLItZZvZR4Wp_0 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3469258927088077072', time=2024-09-12T02:54:44.005531+0000, chain.objs.size()=1 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.288__shadow_.F2D1u1HZHOGc2blNsrprz7cmWcxzxHm_0 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16324202504357208930', time=2024-09-12T02:54:44.007700+0000, chain.objs.size()=1 2024-09-12T01:07:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.288__shadow_.J1qMoRIoetJhbeTB_ue-5m5-DRsQLHH_0 2024-09-12T01:07:26.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1352128783997303627', time=2024-09-12T02:54:44.009343+0000, chain.objs.size()=1 2024-09-12T01:07:26.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.288__shadow_.w_BRGopBrCeOXxeupxAykTgbpPOkY1z_0 2024-09-12T01:07:26.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5704551844464193651', time=2024-09-12T02:54:47.905400+0000, chain.objs.size()=1 2024-09-12T01:07:26.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.p65wWkrU1Oz8tXph1Y_fritNr5-wMW3_0 2024-09-12T01:07:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16091449535392868295', time=2024-09-12T02:54:50.775938+0000, chain.objs.size()=1 2024-09-12T01:07:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.295__shadow_.07OUMj-8pBgcHUwh0v3ymmwz7HpzUT2_0 2024-09-12T01:07:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7601902663685614824', time=2024-09-12T02:54:55.798451+0000, chain.objs.size()=1 2024-09-12T01:07:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.302__shadow_.KnGhVO4P5541rUbzXFIg2Po-eRhksyr_0 2024-09-12T01:07:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18030491848953852413', time=2024-09-12T02:55:30.859046+0000, chain.objs.size()=1 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.udr7E4w0bondVjCEWzZtAXMGnv1gND__0 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8943883990494262456', time=2024-09-12T02:55:30.939291+0000, chain.objs.size()=1 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xCpqFG64xox1TOoyLPi5Q2n2gMX_EyJ_0 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7560261171746582725', time=2024-09-12T02:55:31.026784+0000, chain.objs.size()=1 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bousqsyHE21UpsDAl-H9K369G3MpjmI_0 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14140486545601562551', time=2024-09-12T02:55:31.283836+0000, chain.objs.size()=1 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vXDKMYmu8GEgInjewIccBBpvsNERUdu_0 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16335723131318109386', time=2024-09-12T02:55:31.322867+0000, chain.objs.size()=1 2024-09-12T01:07:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pY9PnLCeoFzU_SkrNhOYFYUYi0Ap4PC_0 2024-09-12T01:07:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16583815833459199149', time=2024-09-12T02:55:31.413248+0000, chain.objs.size()=1 2024-09-12T01:07:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.E7c3_JIbqwGks3s9VtW11GfIKzj9v_k_0 2024-09-12T01:07:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17716704168023355859', time=2024-09-12T02:55:31.586096+0000, chain.objs.size()=1 2024-09-12T01:07:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Qus6d3cOp8fJtHtLQbl0ywAu4E1lw4Y_0 2024-09-12T01:07:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16566929502668622186', time=2024-09-12T02:55:31.618850+0000, chain.objs.size()=1 2024-09-12T01:07:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.oTuOPjlljNHkPoNCGkyKw8kZ7Z_xu2o_0 2024-09-12T01:07:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11440699057782639117', time=2024-09-12T02:55:31.676779+0000, chain.objs.size()=1 2024-09-12T01:07:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xumQNqZtCAuHvpWOcQxjOOkIIGAogq__0 2024-09-12T01:07:26.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17832650631646032712', time=2024-09-12T02:55:31.746448+0000, chain.objs.size()=1 2024-09-12T01:07:26.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.aM6pMdqR2B0ejzEvp44MEqQMOzIFwoV_0 2024-09-12T01:07:26.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16094787386757166055', time=2024-09-12T02:55:31.991727+0000, chain.objs.size()=1 2024-09-12T01:07:26.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lh4-8aevkWQfXPmtNMw_jy_WU8-1Ywb_0 2024-09-12T01:07:26.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9128614766928220888', time=2024-09-12T02:55:32.033982+0000, chain.objs.size()=1 2024-09-12T01:07:26.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zt9ci0hTBlarN-WoDE0BUMt3yFH9VEo_0 2024-09-12T01:07:26.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.455180558179993772', time=2024-09-12T02:55:32.245161+0000, chain.objs.size()=1 2024-09-12T01:07:26.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.34Lk--HxerRtGE-kPoF8EVwRuUW56oS_0 2024-09-12T01:07:26.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9135299680286276131', time=2024-09-12T02:55:32.335926+0000, chain.objs.size()=1 2024-09-12T01:07:26.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.G9Yxt6wfBmjyQHVHW4rHr8QYsxsUqkx_0 2024-09-12T01:07:26.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5972373345503143744', time=2024-09-12T02:55:32.361042+0000, chain.objs.size()=1 2024-09-12T01:07:26.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0tC7u6Ck1LF341uCD8u7yq1w85pRD4K_0 2024-09-12T01:07:26.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16682695294930687696', time=2024-09-12T02:55:32.371248+0000, chain.objs.size()=1 2024-09-12T01:07:26.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.fWNXOxOA-yG03Bv2hjpP-yobbndkU-e_0 2024-09-12T01:07:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14740373617180226467', time=2024-09-12T02:55:32.441094+0000, chain.objs.size()=1 2024-09-12T01:07:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qO5af3ex8FRSvZ8XMlJcLWdlqxduWbE_0 2024-09-12T01:07:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9781124395770483851', time=2024-09-12T02:55:32.612641+0000, chain.objs.size()=1 2024-09-12T01:07:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.DZLLYqZz8WdIAYXiVRa9dsWtrzh9AHe_0 2024-09-12T01:07:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11420192747755734713', time=2024-09-12T02:55:32.655196+0000, chain.objs.size()=1 2024-09-12T01:07:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ory6ymz24YHGYW57PEM2Od0_9TE1x2g_0 2024-09-12T01:07:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4782079985198791263', time=2024-09-12T02:55:32.696420+0000, chain.objs.size()=1 2024-09-12T01:07:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.cGSzw-k0eGLCe0y2XsytFiCcpwhcteV_0 2024-09-12T01:07:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17237957974965913117', time=2024-09-12T02:55:32.942358+0000, chain.objs.size()=1 2024-09-12T01:07:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.EXYQEpS0bppTZoIltswKEpvdNHtZkma_0 2024-09-12T01:07:26.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7528092014393760681', time=2024-09-12T02:55:32.945088+0000, chain.objs.size()=1 2024-09-12T01:07:26.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rFMeFvK9KllLRPE_Lo4LYGXzgaEWAUs_0 2024-09-12T01:07:26.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14509789125453445184', time=2024-09-12T02:55:33.034883+0000, chain.objs.size()=1 2024-09-12T01:07:26.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.uw_UibyUffOuRYvpDuMZ0Hb50O_E-ry_0 2024-09-12T01:07:26.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2299248324160972148', time=2024-09-12T02:55:33.072489+0000, chain.objs.size()=1 2024-09-12T01:07:26.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.UvA3XwxoqfJjpun8nf15sy5qoItYsxp_0 2024-09-12T01:07:26.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10724779143670560523', time=2024-09-12T02:55:33.234234+0000, chain.objs.size()=1 2024-09-12T01:07:26.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.p3_pcJwGugBDQrQbR9zfWEdnJ93KwxN_0 2024-09-12T01:07:26.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10811247280893195110', time=2024-09-12T02:55:33.274557+0000, chain.objs.size()=1 2024-09-12T01:07:26.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8yM0HxGPpPJeviRPdmXQuI2CSlWv4pI_0 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3511964917821724871', time=2024-09-12T02:55:33.316340+0000, chain.objs.size()=1 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.wJXEgORZDZjG9NpDQukgoC6yTH0QrNr_0 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14649870629403716663', time=2024-09-12T02:55:33.333913+0000, chain.objs.size()=1 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.osmvvB8nnfCyL7D5KiKBFCBIEM4Xku3_0 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7406463696219683955', time=2024-09-12T02:55:54.437034+0000, chain.objs.size()=1 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QVh7-9bEZXXKyc-Ntw9594Mw_73QhdF_0 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11460741385304152894', time=2024-09-12T02:55:54.512223+0000, chain.objs.size()=1 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4Z7fpAiBSF7c-moIiYpMk_UTmAhIYqk_0 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2072644428536604684', time=2024-09-12T02:55:54.635591+0000, chain.objs.size()=1 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vLPETNbEBHJ4gqxCKLRlYBv1bgS7Pto_0 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.436541871314652073', time=2024-09-12T02:55:54.695092+0000, chain.objs.size()=1 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5saLn_eNrZygHk4lyrdE5j8Gjc_8yHa_0 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2875745885964356242', time=2024-09-12T02:55:54.817692+0000, chain.objs.size()=1 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UmDsGecLJL4gfo6qR3Lx1jQEYNBq6FV_0 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14041091849378855273', time=2024-09-12T02:55:54.892107+0000, chain.objs.size()=1 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mzaRJGSJCs41H9vEDJsl_BbdTlGJ-oN_0 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15077849759276598132', time=2024-09-12T02:55:54.942965+0000, chain.objs.size()=1 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PwxqDNxiP1O67HhbO0IsTqHAYwHT1ls_0 2024-09-12T01:07:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17892592229086468365', time=2024-09-12T02:55:55.012149+0000, chain.objs.size()=1 2024-09-12T01:07:26.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hz37Gflg3aZrFoQzUVI8P2vNFYaPl_9_0 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7499717307804086416', time=2024-09-12T02:55:55.228121+0000, chain.objs.size()=1 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7YR3bXUCFVp7NXL8zedP6kaXEbHuOGX_0 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10950460885420355745', time=2024-09-12T02:55:55.323877+0000, chain.objs.size()=1 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ke5b2uQY5-RpbsJUYfcSPP5fqfHMlDR_0 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16718942772541554583', time=2024-09-12T02:55:55.500822+0000, chain.objs.size()=1 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GTDMuKZFDpeQsJO1rpTD5PcMoLeYJzu_0 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16319171123398072269', time=2024-09-12T02:55:55.581364+0000, chain.objs.size()=1 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fjeOWNwMrI6BSumLhtgcd4A0fyE3r6L_0 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12601963617219307169', time=2024-09-12T02:55:55.802413+0000, chain.objs.size()=1 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Ul17kVqy37D3c_WlUJoZOcF2kUMulcs_0 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14675348113067074226', time=2024-09-12T02:55:55.848968+0000, chain.objs.size()=1 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.oz1npOboI0e92hLEgp7bAFhkMvNcxfZ_0 2024-09-12T01:07:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10626881296066220494', time=2024-09-12T02:55:55.902768+0000, chain.objs.size()=1 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pvYqz2YIS9bAg7dkQXuDSMuZRqyNbKI_0 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7561928650013426283', time=2024-09-12T02:55:55.907966+0000, chain.objs.size()=1 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.70GRa62JdiZauPc4YXLgs_QGAixwtJx_0 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4852682547988737430', time=2024-09-12T02:55:55.911347+0000, chain.objs.size()=1 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.i3TS_AGeKoHml_jNAQlic2S8pHsuQMx_0 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17248525047300617565', time=2024-09-12T02:55:55.940433+0000, chain.objs.size()=1 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OhW1uM32LGtHDEiPuRHbenGu4NOlByz_0 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11528712443988833861', time=2024-09-12T02:55:55.997771+0000, chain.objs.size()=1 2024-09-12T01:07:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.x71nWOZDWgeJ2zqrDEqzJZU6dA4Rode_0 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14090910750310858021', time=2024-09-12T02:55:56.357370+0000, chain.objs.size()=1 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.f5ikEytOLpOxyOTiIBXa-SEZJfPBcf-_0 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15080901086835438920', time=2024-09-12T02:55:56.521160+0000, chain.objs.size()=1 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PHEmsaua7zajhB9rrR4Vp1xq1I8qWTd_0 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8468121845953968465', time=2024-09-12T02:55:56.545008+0000, chain.objs.size()=1 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Xm4oJB_3lKw4b0ZP6iw77lJm2vweM9P_0 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12183565910660647249', time=2024-09-12T02:55:56.601299+0000, chain.objs.size()=1 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.O19TqLnZ_7X2kFjftrjvTwnV2_50MRl_0 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4143695102496917300', time=2024-09-12T02:55:56.624207+0000, chain.objs.size()=1 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zDc4S7yTfw161z5F9NuTsYqcyK1M8Xh_0 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9152360121823597328', time=2024-09-12T02:55:56.643625+0000, chain.objs.size()=1 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mZYVGkcc0U7VKVzTDKcJHssQVkEhx9k_0 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5952255846875773155', time=2024-09-12T02:55:56.647781+0000, chain.objs.size()=1 2024-09-12T01:07:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8_nKy-whCAu7FiovMBFBTxMJRhRW3Ei_0 2024-09-12T01:07:26.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45454 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7611611732279279046', time=2024-09-12T02:55:56.653793+0000, chain.objs.size()=1 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.KHyoZeZYnBFVXFn5HeBlvscuoFwBNSp_0 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3968082312336888046', time=2024-09-12T02:57:25.303471+0000, chain.objs.size()=1 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.454__shadow_.kiqOGN5f8bYm-t392cSd17PPtvijSi-_0 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15593250535900800683', time=2024-09-12T02:57:48.834853+0000, chain.objs.size()=1 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.488__shadow_.HrSRJCQk5uh3ncY9koKTsJUS8zvDNuO_0 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14959375582393050022', time=2024-09-12T02:57:52.865570+0000, chain.objs.size()=1 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.495__shadow_.iIXM-jiINexVf54hHh7Ldty7wNv5qNz_0 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.565066646673924519', time=2024-09-12T02:57:53.633007+0000, chain.objs.size()=1 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.496__shadow_.IhbO4oFPeOxJ5dWbHlUVosgiN_F3EvG_0 2024-09-12T01:07:26.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8698986745404916576', time=2024-09-12T02:57:55.563096+0000, chain.objs.size()=1 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.500__shadow_.EInWv_RagXct-RKjWvxfcdLWBi-mTaf_0 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13391494548981112220', time=2024-09-12T02:58:09.502130+0000, chain.objs.size()=1 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.517__shadow_.mr54-DsYCihLF3VRelVKPLaZRCpl6zi_0 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.653266762339508519', time=2024-09-12T02:58:17.899881+0000, chain.objs.size()=1 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.520__shadow:ZyEVSmr2DKNQvvnxUtrGab7UPG7rm7U_.FkPdse4XMAh1ckbv2iCyz_q3JFTsyad_0 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17522688583185261497', time=2024-09-12T02:59:10.810724+0000, chain.objs.size()=1 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.537__shadow_.6ikFhwIy0wabWhBObRbE7hUEeUy1ML0_0 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12228553850408290467', time=2024-09-12T02:59:39.385243+0000, chain.objs.size()=1 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.558__shadow_.1kwYnKI70TgtA76y4Axb2_N26JGVzLp_0 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3804680450273406992', time=2024-09-12T03:00:10.688898+0000, chain.objs.size()=1 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:77Rgd2SeUz7UJP3UU8MVuynaboD5rfH_.g5ITeQu35I_G-mtLTnJRU87ZbS5arel_0 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13302100854711167243', time=2024-09-12T03:00:12.293241+0000, chain.objs.size()=1 2024-09-12T01:07:26.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:VuquuXHoXgYX1knTnvuOpXPkEX8M8r4_.K0e69dusySKRjMse27JRxiAu25mpoiV_0 2024-09-12T01:07:26.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16466633302935698714', time=2024-09-12T03:00:18.509905+0000, chain.objs.size()=1 2024-09-12T01:07:26.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:eGM0NPOMtEekCbjUdyb.B8jjjyqIQN5_.rppQf1M4E8rsUDu1IYCQTAmmFs3DM5Y_0 2024-09-12T01:07:26.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.91499415101766310', time=2024-09-12T03:00:20.297781+0000, chain.objs.size()=1 2024-09-12T01:07:26.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:GVgzRyb.jiBDBhzg-VaUanwQLiVyMV5_.XUU636J1wGI5td9u-GTL7KCYTHG5VV5_0 2024-09-12T01:07:26.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4250984446327915105', time=2024-09-12T03:00:35.225153+0000, chain.objs.size()=1 2024-09-12T01:07:26.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:WnG7BUgctA0XGAt2apB1G8S738ioXS-_.yG1XzEndzyCJBMxKjYPz4VeZNdfeWzr_0 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11824014305726251874', time=2024-09-12T03:00:53.263831+0000, chain.objs.size()=1 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.605__shadow_.cflOaXH2bBGsBgV-QNOyPomACGkapPe_0 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2971982343465653774', time=2024-09-12T03:03:13.344387+0000, chain.objs.size()=1 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.619__shadow_.ju8C0lJHumNrsgY41juUKgmrSoOvuvB_0 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3736357515049483357', time=2024-09-12T03:03:40.224537+0000, chain.objs.size()=2 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.650__shadow_.J8lx8MNZAP6rQ2whMK7N1c16YG5udAb_0 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.650__shadow_.J8lx8MNZAP6rQ2whMK7N1c16YG5udAb_1 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10793668574481515999', time=2024-09-12T03:04:46.453882+0000, chain.objs.size()=1 2024-09-12T01:07:26.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.719__shadow_.do8cj_PQtqjYNwB-t-I5CwoB5LQjfiR_0 2024-09-12T01:07:26.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:07:26.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43356' 2024-09-12T01:07:26.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1942807682873014177', time=2024-09-12T02:51:23.326155+0000, chain.objs.size()=1 2024-09-12T01:07:26.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.148__shadow_.xJ9SBr_ymuPvd7W19AV7EgIFdTLAWKJ_0 2024-09-12T01:07:26.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6179232222158729369', time=2024-09-12T02:53:37.736476+0000, chain.objs.size()=1 2024-09-12T01:07:26.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.228__shadow_.RYf0Pmd3EfiUwFBSowqwjsJQAF3qD9T_0 2024-09-12T01:07:26.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13846086331256891083', time=2024-09-12T02:53:40.554571+0000, chain.objs.size()=1 2024-09-12T01:07:26.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.233__shadow_.2IRuBrBF__ZPqIKoU-WWKdnjvfwS3x3_0 2024-09-12T01:07:26.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13828833759296507722', time=2024-09-12T02:53:43.851058+0000, chain.objs.size()=1 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.237__shadow_.cdLubIG3ar6WatpFItixyvDVNr04iiX_0 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7960170376884098307', time=2024-09-12T02:54:23.074536+0000, chain.objs.size()=1 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DzLyqp-cF7kpNRKrHLvgHAUPMDRblD1_0 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5342346770789916598', time=2024-09-12T02:54:23.088869+0000, chain.objs.size()=1 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nkLqJFE79VhINRkjdX_XNniyLNGr31R_0 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16504196667891726740', time=2024-09-12T02:54:23.148222+0000, chain.objs.size()=1 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jFwt8Hmsu0v4Du7tvZiuNiEnLGqKbzB_0 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3299767331417140143', time=2024-09-12T02:54:23.238309+0000, chain.objs.size()=1 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.W_A3YzTK2f7Fy36UV7Y6P-q7zZhm7oh_0 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11751912817685050825', time=2024-09-12T02:54:23.256861+0000, chain.objs.size()=1 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eSjT6wIJyqIb5Rm0x4lITQ2Ku9PJHWm_0 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3768487353816528230', time=2024-09-12T02:54:23.552159+0000, chain.objs.size()=1 2024-09-12T01:07:26.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bH7rlyU3xICZbdRx7_4V-AWxRmBZ_K8_0 2024-09-12T01:07:26.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4269100792363039096', time=2024-09-12T02:54:23.598649+0000, chain.objs.size()=1 2024-09-12T01:07:26.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bEUaBzCtZNzRUQwSoqnkcEax-K1FJzJ_0 2024-09-12T01:07:26.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4395417116911303242', time=2024-09-12T02:54:23.786080+0000, chain.objs.size()=1 2024-09-12T01:07:26.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fqsIW0L_yBU-xijc_jgphWJcj0H_UxK_0 2024-09-12T01:07:26.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14290452764355049575', time=2024-09-12T02:54:23.788396+0000, chain.objs.size()=1 2024-09-12T01:07:26.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.S17Cv2O8YiNNiGDr5-ygyygutuCa_KB_0 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2436785656406917384', time=2024-09-12T02:54:24.099828+0000, chain.objs.size()=1 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.e87UgHmBUUm3O3Zpfs_iJuJ73-CrpeG_0 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14741279658358899850', time=2024-09-12T02:54:24.104218+0000, chain.objs.size()=1 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._p0dSlv1tlAaWnlLyuShI4w6PWgwNjS_0 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2161564702036651293', time=2024-09-12T02:54:24.154712+0000, chain.objs.size()=1 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gf9ZxDcVY81SFIzEj9VJsfJvLIBHvwx_0 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12664949582169598631', time=2024-09-12T02:54:24.336741+0000, chain.objs.size()=1 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vg7UFGI2oKg22m890uBZbaXAOlJ1dB5_0 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4135381206965155783', time=2024-09-12T02:54:24.380768+0000, chain.objs.size()=1 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TZoRWRRVEPFf_weyCmS5UpheSLOtblm_0 2024-09-12T01:07:26.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7161705615602210640', time=2024-09-12T02:54:24.415270+0000, chain.objs.size()=1 2024-09-12T01:07:26.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.glhIWusCGG_vXZXk_pBK9lUoDsvHKxK_0 2024-09-12T01:07:26.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3348054572748449318', time=2024-09-12T02:54:24.770600+0000, chain.objs.size()=1 2024-09-12T01:07:26.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8hrhn6y7iNm5iREnQ25MIPatpni6rDJ_0 2024-09-12T01:07:26.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15615993942247255954', time=2024-09-12T02:54:24.820898+0000, chain.objs.size()=1 2024-09-12T01:07:26.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mo11hwNQJGYE1bb31FhNwsH1wQFpApp_0 2024-09-12T01:07:26.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16282001156902545666', time=2024-09-12T02:54:24.843220+0000, chain.objs.size()=1 2024-09-12T01:07:26.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4tLdlqb88vom139yZu8Q4TP4lBxPIOj_0 2024-09-12T01:07:26.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4406194904137973309', time=2024-09-12T02:54:24.953456+0000, chain.objs.size()=1 2024-09-12T01:07:26.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kyUAQpHgL2F-t8gfxCmVRBy_oBuRy7c_0 2024-09-12T01:07:26.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10313201572130979897', time=2024-09-12T02:54:24.963608+0000, chain.objs.size()=1 2024-09-12T01:07:26.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.le65y92JErLnk-ZnrZZ66DTEijNBsTE_0 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17654290084591215556', time=2024-09-12T02:54:24.972690+0000, chain.objs.size()=1 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6Eza-0U7GXedDwAbPGmIkcdGF-_N1jR_0 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16714162309830347348', time=2024-09-12T02:54:25.215979+0000, chain.objs.size()=1 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JofHvpAfIa4Xi1M0FfGkce6Bt_fKWSG_0 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3429691445989177308', time=2024-09-12T02:54:25.242905+0000, chain.objs.size()=1 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iLpuJq-q75boB3kdpCgZBMzZB2QrXxP_0 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10617582960556731117', time=2024-09-12T02:54:25.578229+0000, chain.objs.size()=1 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fu1nfbcZVwqW39zn0H6m1zpShwLBkNG_0 2024-09-12T01:07:26.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13154652588828975785', time=2024-09-12T02:54:25.635522+0000, chain.objs.size()=1 2024-09-12T01:07:26.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1OWvoPkkFA7oLq1Md_YxqJJD4UNJYay_0 2024-09-12T01:07:26.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17796507430214678952', time=2024-09-12T02:54:25.843429+0000, chain.objs.size()=1 2024-09-12T01:07:26.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3a9OQ08ds5J1AJ9O4TEW6SvA4JoN4xE_0 2024-09-12T01:07:26.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9614438889549156469', time=2024-09-12T02:54:25.869193+0000, chain.objs.size()=1 2024-09-12T01:07:26.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.7d9-yY-DJp57-KIH7vKmgUffsIFQEO0_0 2024-09-12T01:07:26.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10901682652470441756', time=2024-09-12T02:54:25.890963+0000, chain.objs.size()=1 2024-09-12T01:07:26.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.QwD3pB71XDb9w0w6n_0-0ZNtvWAzU2p_0 2024-09-12T01:07:26.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16207976189212965770', time=2024-09-12T02:54:25.928241+0000, chain.objs.size()=1 2024-09-12T01:07:26.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hV0ncfa_rcqdZz-u-iNzNZ6sUfb35NX_0 2024-09-12T01:07:26.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10920873932004882574', time=2024-09-12T02:54:25.951901+0000, chain.objs.size()=1 2024-09-12T01:07:26.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DvzjXyZXrOB58OoP60Jy_y17uwavcBU_0 2024-09-12T01:07:26.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12368136457790789639', time=2024-09-12T02:54:26.030139+0000, chain.objs.size()=1 2024-09-12T01:07:26.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8TtqC0AXLps0j1wo6-PND6HY7N-Bj_c_0 2024-09-12T01:07:26.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1200428430710395572', time=2024-09-12T02:54:26.628511+0000, chain.objs.size()=1 2024-09-12T01:07:26.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.263__shadow_.CzoHZlB4Z0pAnqgZHZR5lrVz9F2lQqD_0 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3431039687576163345', time=2024-09-12T02:54:39.773693+0000, chain.objs.size()=1 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.282__shadow_.MLZIrNdQMaNZS363RWmq8Oish_XHgHl_0 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11275539073605693828', time=2024-09-12T02:54:42.629980+0000, chain.objs.size()=1 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.286__shadow_.tBkTbweg1MpKwkHQm8-rlX12w8Q17lO_0 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7034145413693975351', time=2024-09-12T02:54:47.922833+0000, chain.objs.size()=1 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.h3CRSEmZEP8uV9CgGNOURhaxpyA1KDF_0 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14162163432355475849', time=2024-09-12T02:54:47.939747+0000, chain.objs.size()=1 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.is6iZECeTlrmL3oHAvDpkhQypEMy_Wy_0 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15527816130521376812', time=2024-09-12T02:54:49.330866+0000, chain.objs.size()=1 2024-09-12T01:07:26.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.LOff0JvfKig0tVplnXgbBheBi8XtzNJ_0 2024-09-12T01:07:26.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10192356498912173561', time=2024-09-12T02:54:56.469720+0000, chain.objs.size()=1 2024-09-12T01:07:26.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.303__shadow_.1yAw3BdnbT5TU5byM1_yUyIosMWnEpP_0 2024-09-12T01:07:26.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16238928845541608321', time=2024-09-12T02:54:57.156762+0000, chain.objs.size()=1 2024-09-12T01:07:26.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.304__shadow_.vFciX4IYkr2H4Cs0LVOUwcTbnRvonr8_0 2024-09-12T01:07:26.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7703356449915290187', time=2024-09-12T02:55:08.006187+0000, chain.objs.size()=1 2024-09-12T01:07:26.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.319__shadow:-5nJCk77pQMvwdopdcG57.oZHmorRvC_.-kFAiGWmHbTk7LtbcEEj9UbL_3OHzDg_0 2024-09-12T01:07:26.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10538234051478767399', time=2024-09-12T02:55:08.777678+0000, chain.objs.size()=1 2024-09-12T01:07:26.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.321__shadow_.54_JRDuX8l14k5LxE14bDGFD8F-SifZ_0 2024-09-12T01:07:26.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7261627954833737277', time=2024-09-12T02:55:30.922114+0000, chain.objs.size()=1 2024-09-12T01:07:26.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sI6Vbi05uKpoQq4NuzD50Fkh4Hauv6M_0 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6436679711153733326', time=2024-09-12T02:55:30.934059+0000, chain.objs.size()=1 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YZ_x3N2qi_ASWyPu_VPh3zUfUOrf_2U_0 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2669602032469650103', time=2024-09-12T02:55:30.998278+0000, chain.objs.size()=1 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TWq7KPw0ZNp5hs_D6AQImDhW9q3I8I6_0 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7113281017994410326', time=2024-09-12T02:55:31.035246+0000, chain.objs.size()=1 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6uLcnQpBFN5jPMNFDFKvVNYR1GTQNVx_0 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5830816869521653339', time=2024-09-12T02:55:31.074600+0000, chain.objs.size()=1 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ed6B8tOb5eHDzj_jUIQY3w_uFDC6vhZ_0 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.319041942371681885', time=2024-09-12T02:55:31.093776+0000, chain.objs.size()=1 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IX85EskqnnMlokevu0uTsIdndEMQs-v_0 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3803275581246975798', time=2024-09-12T02:55:31.099923+0000, chain.objs.size()=1 2024-09-12T01:07:26.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sAE9UbxVHJ8oaOrEpjgEDygBJ3zNaYD_0 2024-09-12T01:07:26.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17110574121499894088', time=2024-09-12T02:55:31.227356+0000, chain.objs.size()=1 2024-09-12T01:07:26.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.CTKHthVhD11rYj7os2K82iD2dQSnvM5_0 2024-09-12T01:07:26.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17701924097087197126', time=2024-09-12T02:55:31.283652+0000, chain.objs.size()=1 2024-09-12T01:07:26.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-tGKqpVaiCloMUm4tyYMTAZYfuTJ840_0 2024-09-12T01:07:26.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9094504037235720278', time=2024-09-12T02:55:31.372154+0000, chain.objs.size()=1 2024-09-12T01:07:26.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lcumPo8jqg_4ZAq6LT0N75y4e-AXeyO_0 2024-09-12T01:07:26.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17657696847097566439', time=2024-09-12T02:55:31.582272+0000, chain.objs.size()=1 2024-09-12T01:07:26.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.wtdC-fTtW6_UuXEXtnRwPwD96BLsRlK_0 2024-09-12T01:07:26.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.453680675143520046', time=2024-09-12T02:55:31.602715+0000, chain.objs.size()=1 2024-09-12T01:07:26.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.x8F2bHXiU4TeCfxlu3RLRcL3ZY0A2L7_0 2024-09-12T01:07:26.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5703476485759787130', time=2024-09-12T02:55:31.642745+0000, chain.objs.size()=1 2024-09-12T01:07:26.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eGL0SvCmMb08gDbh6Ie6MhbE-iSWpvW_0 2024-09-12T01:07:26.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4115505250598736822', time=2024-09-12T02:55:31.671992+0000, chain.objs.size()=1 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.D7S9avWn6-Rf5mOgndtNCRNk15zOR2C_0 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17315173640846249854', time=2024-09-12T02:55:31.716719+0000, chain.objs.size()=1 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GOIlRQJOrge8fKtMPbG-FyNJPTOJCvr_0 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3769485335932095902', time=2024-09-12T02:55:31.971246+0000, chain.objs.size()=1 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zUuMBmf6F9H1-e5vL68GiGkKSPZl2t1_0 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.697506764186845926', time=2024-09-12T02:55:32.039136+0000, chain.objs.size()=1 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lCOd2hZclFw0ocfcPnQg4KJaccwrIkT_0 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12775037548591114096', time=2024-09-12T02:55:32.071551+0000, chain.objs.size()=1 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MNHPESmoCQP7exeFdkVQR4w27YlZIpe_0 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15695585235406348876', time=2024-09-12T02:55:32.095997+0000, chain.objs.size()=1 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.FOfeZEjLecfJ2M_-jk6qhPYKxfO6ZcV_0 2024-09-12T01:07:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15314180822628430896', time=2024-09-12T02:55:32.298480+0000, chain.objs.size()=1 2024-09-12T01:07:26.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.m6JFCefGVqYsCGNdnMe8Lt59gQ3Y8oH_0 2024-09-12T01:07:26.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13752818316386933544', time=2024-09-12T02:55:32.541058+0000, chain.objs.size()=1 2024-09-12T01:07:26.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gJpaVp6JXAr186mQoL9VW68PV2j6C26_0 2024-09-12T01:07:26.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11110131218483961920', time=2024-09-12T02:55:32.602316+0000, chain.objs.size()=1 2024-09-12T01:07:26.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.456+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-uo_FcZtohzCbi9We4cy4M-_z964TiU_0 2024-09-12T01:07:26.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9984444180941804733', time=2024-09-12T02:55:32.679078+0000, chain.objs.size()=1 2024-09-12T01:07:26.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jIjFCRux4643sAgox--YEaE_fsIdeXi_0 2024-09-12T01:07:26.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12383710975044581610', time=2024-09-12T02:55:32.862339+0000, chain.objs.size()=1 2024-09-12T01:07:26.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.B23zbP7x8ysJkoAw8poqVag3LZwct1H_0 2024-09-12T01:07:26.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14516345498024352047', time=2024-09-12T02:55:33.011041+0000, chain.objs.size()=1 2024-09-12T01:07:26.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.UqrRN3CGUlX3OVBFEZKVnBx0eQAMSzY_0 2024-09-12T01:07:26.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2523520081538240324', time=2024-09-12T02:55:33.027558+0000, chain.objs.size()=1 2024-09-12T01:07:26.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KyVJBzF37ZttSi6VO_owAFRS-uVbGHu_0 2024-09-12T01:07:26.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14352197250703392701', time=2024-09-12T02:55:33.231069+0000, chain.objs.size()=1 2024-09-12T01:07:26.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bk0ltHKTRdS9QaYvDRYQC0yV3EEjXJx_0 2024-09-12T01:07:26.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12369210787842479173', time=2024-09-12T02:55:33.291430+0000, chain.objs.size()=1 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8gyTYZMImUY9e_tpwC4ezUW1TonzDvj_0 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14415995623665123099', time=2024-09-12T02:55:54.513735+0000, chain.objs.size()=1 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6fr7K362riddQpxZnSTWTLhY_WlYZ0w_0 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14935166622952362683', time=2024-09-12T02:55:54.575104+0000, chain.objs.size()=1 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.y5ZfLubQmuY_qVGIj69DbZPrcW0stsi_0 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13218447536527466842', time=2024-09-12T02:55:54.655116+0000, chain.objs.size()=1 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.I5WCMCWDqqW7cozz1ft4ucfpQxP_GzJ_0 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16153872060649272535', time=2024-09-12T02:55:54.868511+0000, chain.objs.size()=1 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.taCoJOt7SvjhixMQ-s2F3FV0QU3w0Pf_0 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15620695213731741555', time=2024-09-12T02:55:54.927192+0000, chain.objs.size()=1 2024-09-12T01:07:26.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xnv8QPFQq7aV4pZwZtQ6dCV_Yugb04k_0 2024-09-12T01:07:26.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17646858773090679303', time=2024-09-12T02:55:54.972838+0000, chain.objs.size()=1 2024-09-12T01:07:26.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.CB6wp52vaWlDq05XmyyZZZ8yuN5hgLZ_0 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2002087182301234529', time=2024-09-12T02:55:55.156774+0000, chain.objs.size()=1 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Zlr6F84Y174Y_anXK_L9nx9NEkk7AaQ_0 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9532257594878553025', time=2024-09-12T02:55:55.182163+0000, chain.objs.size()=1 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.tgeXUhAXXZ5NOESOyS9Rnpxppmlyh_O_0 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3742412302382067563', time=2024-09-12T02:55:55.254399+0000, chain.objs.size()=1 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gSaCSRicDGnXrBFRYGZU_J6Cd0eliXe_0 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16961368083546795428', time=2024-09-12T02:55:55.257539+0000, chain.objs.size()=1 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vLG5C8qun6VBTIRze5vNG5QpNCL0xZj_0 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9797265687786366553', time=2024-09-12T02:55:55.310874+0000, chain.objs.size()=1 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.AYcxM0jtgOtx2o1agZgCPE1HJ_GZZSs_0 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17598929522232419293', time=2024-09-12T02:55:55.316641+0000, chain.objs.size()=1 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.e38aBmqoteNP9ZWDwcSO_XI7fwNIbBK_0 2024-09-12T01:07:26.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16991497182041663873', time=2024-09-12T02:55:55.541792+0000, chain.objs.size()=1 2024-09-12T01:07:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PKakdp2siquP4yTRFSCXMko-83xND1u_0 2024-09-12T01:07:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5000936212440872426', time=2024-09-12T02:55:55.570372+0000, chain.objs.size()=1 2024-09-12T01:07:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xvTkNq7o7hmZmtdTqJnvgW8erHI7ZRr_0 2024-09-12T01:07:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2120018284237691216', time=2024-09-12T02:55:55.644806+0000, chain.objs.size()=1 2024-09-12T01:07:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WMm84bZlgc8qZLgA1vHww1NYlj3tq3O_0 2024-09-12T01:07:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17358803308032291072', time=2024-09-12T02:55:55.917504+0000, chain.objs.size()=1 2024-09-12T01:07:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.l8MXtFS9TLfdJVRYHyIOq7E9Xx4yQcw_0 2024-09-12T01:07:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8059959053539929771', time=2024-09-12T02:55:55.949431+0000, chain.objs.size()=1 2024-09-12T01:07:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RYauwnsznMJxCJu0vQus3hcPQ0XTAq4_0 2024-09-12T01:07:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.467325551570150319', time=2024-09-12T02:55:56.176756+0000, chain.objs.size()=1 2024-09-12T01:07:26.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.76M838leDNq6T1ZqJGVw9aq20waI4uE_0 2024-09-12T01:07:26.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15660990102626633256', time=2024-09-12T02:55:56.185329+0000, chain.objs.size()=1 2024-09-12T01:07:26.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3ZiWOlWDGqjvu5rglsxtXb_TYNpcXT3_0 2024-09-12T01:07:26.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14882016023244860020', time=2024-09-12T02:55:56.203572+0000, chain.objs.size()=1 2024-09-12T01:07:26.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.EZgKTguI8YSvfNJFxvpR9_QOfld-7uq_0 2024-09-12T01:07:26.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1218954723844528610', time=2024-09-12T02:55:56.320586+0000, chain.objs.size()=1 2024-09-12T01:07:26.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nXqdMr9NcC8cGO68lnq2BsZFdh5vDSk_0 2024-09-12T01:07:26.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2156900296692442343', time=2024-09-12T02:55:56.480034+0000, chain.objs.size()=1 2024-09-12T01:07:26.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IdkK3dQ7cMHgCm_QqfID_fc5QkPKFRT_0 2024-09-12T01:07:26.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12070921830284769602', time=2024-09-12T02:55:56.489781+0000, chain.objs.size()=1 2024-09-12T01:07:26.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.cfQpbfrX3KR4b-2gVZ9kC3z_bNEllrG_0 2024-09-12T01:07:26.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1031824553744283836', time=2024-09-12T02:55:56.807288+0000, chain.objs.size()=1 2024-09-12T01:07:26.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bet0gtZeEo7W2JNr9fsIqco6FwawOpZ_0 2024-09-12T01:07:26.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15014193142819787070', time=2024-09-12T02:55:56.810491+0000, chain.objs.size()=1 2024-09-12T01:07:26.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HBU-hFatat06lT718Azdi4csjBTapgY_0 2024-09-12T01:07:26.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6415270458791292412', time=2024-09-12T02:55:56.862284+0000, chain.objs.size()=1 2024-09-12T01:07:26.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Y1aulXm75xA4u7lJZAya1oDE9TTT275_0 2024-09-12T01:07:26.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4019282562870360732', time=2024-09-12T02:55:56.896819+0000, chain.objs.size()=1 2024-09-12T01:07:26.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.AM0L90qtemkvX8J6fqrX5p91glf_aZD_0 2024-09-12T01:07:26.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43356 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10115858422455757645', time=2024-09-12T02:56:14.689101+0000, chain.objs.size()=1 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.353__shadow_.bQkzuNN0ugIVBF8j2JQj2xWQeC8C_0O_0 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12325795183501609801', time=2024-09-12T02:57:45.071284+0000, chain.objs.size()=1 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.1FfpjLHJfA5AU3SrMzlCJl1z5McVuPj_0 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16130702658932939754', time=2024-09-12T02:57:51.787915+0000, chain.objs.size()=1 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.493__shadow_.uaCUwiaMFyeqLdyhcv_Xt-A23VjMTE4_0 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13252263444472776894', time=2024-09-12T02:58:45.115553+0000, chain.objs.size()=7 2024-09-12T01:07:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.527__multipart_mymultipart.2~yu5GNchVs2bJJr2q7KEzOtmeXFi5Xun.1 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.527__shadow_mymultipart.2~yu5GNchVs2bJJr2q7KEzOtmeXFi5Xun.1_1 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.527__multipart_mymultipart.2~yu5GNchVs2bJJr2q7KEzOtmeXFi5Xun.2 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.527__shadow_mymultipart.2~yu5GNchVs2bJJr2q7KEzOtmeXFi5Xun.2_1 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.527__multipart_mymultipart.2~yu5GNchVs2bJJr2q7KEzOtmeXFi5Xun.3 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.527__shadow_mymultipart.2~yu5GNchVs2bJJr2q7KEzOtmeXFi5Xun.3_1 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.527__multipart_mymultipart.2~yu5GNchVs2bJJr2q7KEzOtmeXFi5Xun.4 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2502888688199933676', time=2024-09-12T02:59:30.419344+0000, chain.objs.size()=1 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.550__shadow_.PohIHoWaADjhOPTuydF1NhuALKmt_cE_0 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2823643135480457170', time=2024-09-12T02:59:38.188981+0000, chain.objs.size()=1 2024-09-12T01:07:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.557__shadow_.pVK9DWS625__YGVETF7443boMN_FEm8_0 2024-09-12T01:07:26.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8052784675436091797', time=2024-09-12T02:59:40.397875+0000, chain.objs.size()=1 2024-09-12T01:07:26.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.559__shadow_.1f4_isqeOaBGg4ROkMumvKhI0LJsvlM_0 2024-09-12T01:07:26.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1020769784056686282', time=2024-09-12T02:59:54.972585+0000, chain.objs.size()=1 2024-09-12T01:07:26.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:D1RKI00jxWuYn4UHrMTvX1E4IcNoPXJ_.RBbv5yY8g4qvD3YUJdZKnqU3f8EvE2X_0 2024-09-12T01:07:26.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3253946790711315236', time=2024-09-12T03:00:17.099053+0000, chain.objs.size()=1 2024-09-12T01:07:26.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:4JsTLNW62.3rUG17QQ.D3TqTZWyrWSj_.V59oA4NX_MTISgpQp61fuJYJmTQ8eIH_0 2024-09-12T01:07:26.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10625361960970626688', time=2024-09-12T03:00:21.314587+0000, chain.objs.size()=1 2024-09-12T01:07:26.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:9Q.MYKDHAYgDQEbOaHqfXYcMVYdiD7-_.SXuH_JFfykIxL1eunQj6Xh7DPc2JOLs_0 2024-09-12T01:07:26.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6703650638803210573', time=2024-09-12T03:03:25.536576+0000, chain.objs.size()=1 2024-09-12T01:07:26.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.630__shadow_.ALDZ4PxNckPRC3Gw6t3MTcf6IvZuOLi_0 2024-09-12T01:07:26.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14276006784359398570', time=2024-09-12T03:03:31.046093+0000, chain.objs.size()=1 2024-09-12T01:07:26.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.638__shadow_.dPq8s4camKvauRN7yytRDkzbdspfhEb_0 2024-09-12T01:07:26.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4067255094452750504', time=2024-09-12T03:04:01.852360+0000, chain.objs.size()=1 2024-09-12T01:07:26.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.679__shadow_.VbTKAVO35Mbv5zh5hUtKddr1nnUHzYp_0 2024-09-12T01:07:26.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13742327104505748127', time=2024-09-12T03:04:45.769674+0000, chain.objs.size()=1 2024-09-12T01:07:26.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.718__shadow_.v5iV6BPs-dx9T7HMYaHQWL1xVuUA0K6_0 2024-09-12T01:07:26.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:07:26.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55196' 2024-09-12T01:07:26.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17707569289510863383', time=2024-09-12T02:53:39.206446+0000, chain.objs.size()=1 2024-09-12T01:07:26.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.231__shadow_.GFiDLqD4e5KuKs-21oXDGDdAORs0OUE_0 2024-09-12T01:07:26.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5916700777098515211', time=2024-09-12T02:53:51.493382+0000, chain.objs.size()=1 2024-09-12T01:07:26.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.246__shadow_.Vrc_kAPOhfXJeuI_lXoy2Fl86uCrwdT_0 2024-09-12T01:07:26.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6358781902491969792', time=2024-09-12T02:53:57.792766+0000, chain.objs.size()=1 2024-09-12T01:07:26.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.255__shadow_.eD9M73WjXAV0Lbg5W4m0305jEQa8COY_0 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16784611637725452894', time=2024-09-12T02:53:57.794829+0000, chain.objs.size()=1 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.255__shadow_.ntl9BNNERQ6eCAvl60F6uO-rpOv9MMf_0 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1284905362562881857', time=2024-09-12T02:54:23.064803+0000, chain.objs.size()=1 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.os4_JYRH1RIVj-mxZk0ePmbOJMj0Xsy_0 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2726119356685041111', time=2024-09-12T02:54:23.095315+0000, chain.objs.size()=1 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.UrmmuxgQa36Sa97q6bNe1IZVFseUkd5_0 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10447906351279250073', time=2024-09-12T02:54:23.097280+0000, chain.objs.size()=1 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3sTEw_9cSxqDFe3tHaOExzSfGSJih6R_0 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2009125649396386233', time=2024-09-12T02:54:23.473379+0000, chain.objs.size()=1 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.UmqhwPM8CnukbLEKxrGCe5Cfx8cFMlX_0 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17956438340983268953', time=2024-09-12T02:54:23.496332+0000, chain.objs.size()=1 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ELJVIvN04iGtPtObEIR-yeus241JMFd_0 2024-09-12T01:07:26.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2247525408524713351', time=2024-09-12T02:54:23.531630+0000, chain.objs.size()=1 2024-09-12T01:07:26.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TJH6N--BrYpxkvhrj4s7GmbSn3u6i-1_0 2024-09-12T01:07:26.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16172485256684237124', time=2024-09-12T02:54:23.539458+0000, chain.objs.size()=1 2024-09-12T01:07:26.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1FSGywBAN4TnxQlxvFTc8eVS-MLm-5J_0 2024-09-12T01:07:26.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17321643789126468314', time=2024-09-12T02:54:23.607800+0000, chain.objs.size()=1 2024-09-12T01:07:26.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.p6rGAKzwk7iZrBy4gKkjoeOAcN-G-jC_0 2024-09-12T01:07:26.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2476468638670198106', time=2024-09-12T02:54:23.749171+0000, chain.objs.size()=1 2024-09-12T01:07:26.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.KMyD-M_AGZZXzJbqH0dDR_CfgH35WFD_0 2024-09-12T01:07:26.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8350643896678134732', time=2024-09-12T02:54:23.998338+0000, chain.objs.size()=1 2024-09-12T01:07:26.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6PoUBTdZPq-uyvs-ce4a5OzGDOwIlrZ_0 2024-09-12T01:07:26.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.144437498164423287', time=2024-09-12T02:54:24.044121+0000, chain.objs.size()=1 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zCTaBwABUJuRi1bYuZF3MsGchmkRVAC_0 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17056930790698419681', time=2024-09-12T02:54:24.070080+0000, chain.objs.size()=1 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Gwwuv_v4mE8zHsNvW4g_ocop81noSof_0 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3158190591621358424', time=2024-09-12T02:54:24.179728+0000, chain.objs.size()=1 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qAhypLzVKWZ93Ca2kWIH3jnOhf5iBNT_0 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4603714410845396827', time=2024-09-12T02:54:24.217862+0000, chain.objs.size()=1 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.t-5eh9EUUh1TOCHyvVHyF8AydYHyT1S_0 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1308275186201509028', time=2024-09-12T02:54:24.371475+0000, chain.objs.size()=1 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nsLzWnZLT5vjpPFvbwCu7SQ1PXexE8C_0 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15509201723296156731', time=2024-09-12T02:54:24.440396+0000, chain.objs.size()=1 2024-09-12T01:07:26.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XEgQ2TysAzrI2n6XckqlFqJedmu5eXI_0 2024-09-12T01:07:26.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12884694900369277648', time=2024-09-12T02:54:24.531982+0000, chain.objs.size()=1 2024-09-12T01:07:26.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wLt8NNDIPrdSZAjFe0wLIyr6eK-k_4r_0 2024-09-12T01:07:26.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18149100141535708085', time=2024-09-12T02:54:24.629291+0000, chain.objs.size()=1 2024-09-12T01:07:26.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.G4mmF_dz-6Mo1X7hAN6i2Bhoh-IAExQ_0 2024-09-12T01:07:26.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15128200703445848436', time=2024-09-12T02:54:24.847834+0000, chain.objs.size()=1 2024-09-12T01:07:26.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.exk5XCVbJ0mb77LBP-Tb-WyoCjFwdZ0_0 2024-09-12T01:07:26.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14766827496284598146', time=2024-09-12T02:54:24.934738+0000, chain.objs.size()=1 2024-09-12T01:07:26.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Opc9Y96u5VPmmx9EkbYsAQ85UbU4Bdk_0 2024-09-12T01:07:26.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16255992415987089539', time=2024-09-12T02:54:24.936134+0000, chain.objs.size()=1 2024-09-12T01:07:26.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xnyjRbbWDWDjVhACx2ut6e_OHS4lbWw_0 2024-09-12T01:07:26.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12402381833614209702', time=2024-09-12T02:54:25.006952+0000, chain.objs.size()=1 2024-09-12T01:07:26.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0xY9K4Gm4PZafKARMGNs6-_68OLtI9l_0 2024-09-12T01:07:26.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17056723340007159428', time=2024-09-12T02:54:25.015418+0000, chain.objs.size()=1 2024-09-12T01:07:26.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ocVpP9YEIDKp7xOuBaSFf0Y4GAP4QDQ_0 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11958293954947327099', time=2024-09-12T02:54:25.125997+0000, chain.objs.size()=1 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JFTRYCNVsBgdThz0Co35x9jyf87bBL8_0 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5158377502311643290', time=2024-09-12T02:54:25.319662+0000, chain.objs.size()=1 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pstV36IoH9RmoOHo270qRscJxXUwG6c_0 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5105026654629382930', time=2024-09-12T02:54:25.601726+0000, chain.objs.size()=1 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.YmZnq52TRTLdorRKtze5SN570BIliDn_0 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17134760676068355278', time=2024-09-12T02:54:25.896973+0000, chain.objs.size()=1 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1NJaVtn3pdOQEDQd4oNgeu-Rf4p-4pE_0 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8962248634826780019', time=2024-09-12T02:54:25.983531+0000, chain.objs.size()=1 2024-09-12T01:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.BO50pnC57DEelo6-_NxXDpGMKLROVB3_0 2024-09-12T01:07:26.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4817927853777846651', time=2024-09-12T02:54:47.948366+0000, chain.objs.size()=1 2024-09-12T01:07:26.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.vFdh7yvzDqIgUDGqMmZWYSJmStXFxIl_0 2024-09-12T01:07:26.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8980242377913524981', time=2024-09-12T02:55:30.946680+0000, chain.objs.size()=1 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5i9fC0vsf9TiOQpi3dJiIwpyo7lCk3s_0 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7885811180813998497', time=2024-09-12T02:55:30.977499+0000, chain.objs.size()=1 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pasD2t211RKjEpuDox8TM3wUsln1PwV_0 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7896381603249392819', time=2024-09-12T02:55:31.082289+0000, chain.objs.size()=1 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.iKvf58V98Nwt4M2sHwCpKJbaWwCA2Ga_0 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11880436553654087213', time=2024-09-12T02:55:31.279699+0000, chain.objs.size()=1 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.UTcBgsOtIi7w_NtHv_rJzpVgalWVmjd_0 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12916017916773561838', time=2024-09-12T02:55:31.308173+0000, chain.objs.size()=1 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lnwMHNBSBuZ0XQ3OYnNca4ShJJDzA0i_0 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15615608745090984538', time=2024-09-12T02:55:31.344805+0000, chain.objs.size()=1 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IHcPG4BQhr9zLUHrioDFLuyL9HHbaR6_0 2024-09-12T01:07:26.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17852071502601421019', time=2024-09-12T02:55:31.363376+0000, chain.objs.size()=1 2024-09-12T01:07:26.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gHtdeRm9iiMxtdbPWCq3ZLidzo0OSEa_0 2024-09-12T01:07:26.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15893855987164809437', time=2024-09-12T02:55:31.370575+0000, chain.objs.size()=1 2024-09-12T01:07:26.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.S4iAYY5dJq6-mSWfgUebH5lVKtp3TfC_0 2024-09-12T01:07:26.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8770408446472704575', time=2024-09-12T02:55:31.397340+0000, chain.objs.size()=1 2024-09-12T01:07:26.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Sh1IlFD_Wipfl2rDCvroElpBUny7-cV_0 2024-09-12T01:07:26.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4148543095507369573', time=2024-09-12T02:55:31.583884+0000, chain.objs.size()=1 2024-09-12T01:07:26.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1kEIvsTgZJQZvITv9-z3y9AxGDvKXi2_0 2024-09-12T01:07:26.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1873823961759668830', time=2024-09-12T02:55:31.585037+0000, chain.objs.size()=1 2024-09-12T01:07:26.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mVj2I0lkEQk69OD8U3RedG6HEGVwUPZ_0 2024-09-12T01:07:26.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9264338728316564365', time=2024-09-12T02:55:31.599757+0000, chain.objs.size()=1 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QWszzi7PhJfKpWKv3E7683b2NZNqTG2_0 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9600680859176157173', time=2024-09-12T02:55:31.629150+0000, chain.objs.size()=1 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LIp244gZR5ndPVeubCzixWt9B1OgLdS_0 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16444083132975022095', time=2024-09-12T02:55:31.645301+0000, chain.objs.size()=1 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.2J-RlrbyZ4VUBLPburijMHyvTV0Vir8_0 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18123040416811997285', time=2024-09-12T02:55:31.646107+0000, chain.objs.size()=1 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eyj6XQ7mF1tXYva2udLOeBqKEuSdVIL_0 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1934125467391024565', time=2024-09-12T02:55:31.671214+0000, chain.objs.size()=1 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.BN6fya6MsPTlJA3OHayTC-jfPAZqI51_0 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3432797176176993945', time=2024-09-12T02:55:31.705063+0000, chain.objs.size()=1 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QEA6XlAOBUfhG6OEOjCJfGkipc5Rje__0 2024-09-12T01:07:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3600282057229511006', time=2024-09-12T02:55:31.733321+0000, chain.objs.size()=1 2024-09-12T01:07:26.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hv3mWY83S518yCe_NArq8jGBdM9CND1_0 2024-09-12T01:07:26.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17340035081792107154', time=2024-09-12T02:55:31.998707+0000, chain.objs.size()=1 2024-09-12T01:07:26.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KHQ613pU6oIXl-fBj8s9mDj1byWqepT_0 2024-09-12T01:07:26.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6641328951578060595', time=2024-09-12T02:55:32.057278+0000, chain.objs.size()=1 2024-09-12T01:07:26.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zvuIvBhkqAmiVipWPW0kfJh7UsH9uNf_0 2024-09-12T01:07:26.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1462522807888413358', time=2024-09-12T02:55:32.067160+0000, chain.objs.size()=1 2024-09-12T01:07:26.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Dhafe_lTwOYq8YmEfcwIEC3QSWF0Lyw_0 2024-09-12T01:07:26.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6086541625063141242', time=2024-09-12T02:55:32.226794+0000, chain.objs.size()=1 2024-09-12T01:07:26.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rd25U0_Lp3ckjSuoIp2g06-NIv3zTvl_0 2024-09-12T01:07:26.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4501453310475390656', time=2024-09-12T02:55:32.236637+0000, chain.objs.size()=1 2024-09-12T01:07:26.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hxsBSY62Syb1SYzHN6vzMz6gLOVRNFD_0 2024-09-12T01:07:26.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3757920579984386749', time=2024-09-12T02:55:32.375458+0000, chain.objs.size()=1 2024-09-12T01:07:26.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9Ex8kikziVW7-nItI-I3oPzMMvQTY6u_0 2024-09-12T01:07:26.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6600530259076878288', time=2024-09-12T02:55:32.390151+0000, chain.objs.size()=1 2024-09-12T01:07:26.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Cqjgk_NjUzwzHjEZvyzcBJovV3XNxWw_0 2024-09-12T01:07:26.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16662608773997334826', time=2024-09-12T02:55:32.406964+0000, chain.objs.size()=1 2024-09-12T01:07:26.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yP_1CY3q_5ZnYCoqs0eq9nRVL4iK8r8_0 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.989095211090710115', time=2024-09-12T02:55:32.541487+0000, chain.objs.size()=1 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-Dhima3cDuV_pMQ32wEbOh41z2BShJ8_0 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.188737655794433324', time=2024-09-12T02:55:32.605784+0000, chain.objs.size()=1 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ROWNLsyGkRJ7zCTcbTua7WaENp4vPWW_0 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7677138284755640694', time=2024-09-12T02:55:32.616576+0000, chain.objs.size()=1 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9EBZ2l0_KvKw-HKS_w3vZduNH27CdnJ_0 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9067291250798712058', time=2024-09-12T02:55:32.724366+0000, chain.objs.size()=1 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KPMeDrXacRPDhByplAwaLYsAGqDj_n1_0 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10730778053041357669', time=2024-09-12T02:55:32.748560+0000, chain.objs.size()=1 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jnzBNoz6eQgOOev2pWF_UeID7rH_SE0_0 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16773659885782086203', time=2024-09-12T02:55:33.029026+0000, chain.objs.size()=1 2024-09-12T01:07:26.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.512+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qZ9_wuxb5WiXA2NrMKaOjght0dCwVVd_0 2024-09-12T01:07:26.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2848522851655186306', time=2024-09-12T02:55:33.225954+0000, chain.objs.size()=1 2024-09-12T01:07:26.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6naE9BywCSB_iW1UsfweP7K8KB30wDc_0 2024-09-12T01:07:26.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3667808576877886002', time=2024-09-12T02:55:33.245980+0000, chain.objs.size()=1 2024-09-12T01:07:26.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.fsUi3MQvH3ZOAgaBuQHRXPlJskD9zwZ_0 2024-09-12T01:07:26.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8167404501326356599', time=2024-09-12T02:55:33.262049+0000, chain.objs.size()=1 2024-09-12T01:07:26.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dktMdB3PPtRletLD24TlcELjOvDEp-x_0 2024-09-12T01:07:26.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15140389512287747542', time=2024-09-12T02:55:33.272730+0000, chain.objs.size()=1 2024-09-12T01:07:26.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MGr5RT3ewN_tYD8dMg9pppAAlhPWF2o_0 2024-09-12T01:07:26.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15834758922195072341', time=2024-09-12T02:55:54.503313+0000, chain.objs.size()=1 2024-09-12T01:07:26.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JH48CREHiaWRFyCg7btZslcMgKjOEjN_0 2024-09-12T01:07:26.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.785152839768025485', time=2024-09-12T02:55:54.512404+0000, chain.objs.size()=1 2024-09-12T01:07:26.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2Nf7HmDfcFJQnxR0Zw_me-IEpSab9nz_0 2024-09-12T01:07:26.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12945931189325386524', time=2024-09-12T02:55:54.565163+0000, chain.objs.size()=1 2024-09-12T01:07:26.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.L6YlXJi6W2oJNAbiH-U8V7ngqIeHsCq_0 2024-09-12T01:07:26.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11339406772177047972', time=2024-09-12T02:55:54.675799+0000, chain.objs.size()=1 2024-09-12T01:07:26.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.G9VGQXrv7uAFCKGk2GambvCyxbvux8T_0 2024-09-12T01:07:26.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10095533275567068321', time=2024-09-12T02:55:54.849021+0000, chain.objs.size()=1 2024-09-12T01:07:26.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fUAFdb5Nx3UQxaVHvAmn-EmyVr2OJFk_0 2024-09-12T01:07:26.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16669105594233196352', time=2024-09-12T02:55:54.851982+0000, chain.objs.size()=1 2024-09-12T01:07:26.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uqoXBXNCQT_ex79PmiV5cejqTaFy3-5_0 2024-09-12T01:07:26.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6514319403146032172', time=2024-09-12T02:55:54.862026+0000, chain.objs.size()=1 2024-09-12T01:07:26.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mpjfDIjK7RDkjdKiEw9_ryUIvNm0ZiK_0 2024-09-12T01:07:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8076870394120782372', time=2024-09-12T02:55:54.990349+0000, chain.objs.size()=1 2024-09-12T01:07:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.CUzquGv3BfLXiCn1ukOPHoXH-eZwIBS_0 2024-09-12T01:07:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3237128630175118305', time=2024-09-12T02:55:55.167119+0000, chain.objs.size()=1 2024-09-12T01:07:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jAYrCwEnIpyuGFsJfWyw1o_ptqPGzqC_0 2024-09-12T01:07:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17264438332750887092', time=2024-09-12T02:55:55.187195+0000, chain.objs.size()=1 2024-09-12T01:07:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dPwzkHYPNg6p7RUq3W37I8Zr9WZ66Yk_0 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13147860611835836227', time=2024-09-12T02:55:55.221220+0000, chain.objs.size()=1 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gDY0i5X3uwYegCnDN-6UkY45AGPoFQJ_0 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8708680959737947397', time=2024-09-12T02:55:55.298510+0000, chain.objs.size()=1 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ycug_79m6o9WWW8VL7RmhflmgFAtWzb_0 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8704241681161244149', time=2024-09-12T02:55:55.514138+0000, chain.objs.size()=1 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TQRzSlA5dHT3Elddl_OGOZmnBjppU7B_0 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14463575061732075774', time=2024-09-12T02:55:55.531297+0000, chain.objs.size()=1 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.H5LjcINsT7eHECfH4UVX-AcxCs8Q3HW_0 2024-09-12T01:07:26.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7033789035993783195', time=2024-09-12T02:55:55.564796+0000, chain.objs.size()=1 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DBJJBj2IWTLvGJJmYk5FADdhyVKJg55_0 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13395917482931867685', time=2024-09-12T02:55:55.660942+0000, chain.objs.size()=1 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lvsUlCo9dBEEmGkPOSr7OMWYjmlXy9z_0 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6961875606714751809', time=2024-09-12T02:55:55.676618+0000, chain.objs.size()=1 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mIjU1-1C7JiE-cBP9-H0OhdPRSkqjsL_0 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5883796730058122978', time=2024-09-12T02:55:55.817453+0000, chain.objs.size()=1 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._ePOVEefura9YxSkypdQmR57hnARHoA_0 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9536906890409574667', time=2024-09-12T02:55:55.864794+0000, chain.objs.size()=1 2024-09-12T01:07:26.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pf9G_Rr2PTk6ah_lTr_GgCQNmfComwR_0 2024-09-12T01:07:26.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7981095531104388537', time=2024-09-12T02:55:56.014309+0000, chain.objs.size()=1 2024-09-12T01:07:26.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.AqxbiUW3XAyouHsU64LlFc84QtoTZmS_0 2024-09-12T01:07:26.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17932339337860776120', time=2024-09-12T02:55:56.340419+0000, chain.objs.size()=1 2024-09-12T01:07:26.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PZpypIX-HsOFNodvTB-2w4z9rvwAFli_0 2024-09-12T01:07:26.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5431798930759694500', time=2024-09-12T02:55:56.540680+0000, chain.objs.size()=1 2024-09-12T01:07:26.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MSzksAQSxPvi_XoDvV6x7b_76kvScEZ_0 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6923931947345969760', time=2024-09-12T02:55:56.557607+0000, chain.objs.size()=1 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lgjGBpswPbiI3J2ZI95KekNL0_k6iwW_0 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12267059873573215979', time=2024-09-12T02:55:56.574942+0000, chain.objs.size()=1 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qoEPT5wKPSeV7NYP6_b64DPywRF-m6m_0 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3744157127172743628', time=2024-09-12T02:55:56.671951+0000, chain.objs.size()=1 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.y_jBPypF1rpGvAaMed9RWwlVfFaD9Eo_0 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18189911807087126965', time=2024-09-12T02:55:56.876897+0000, chain.objs.size()=1 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.x_2RfcIXnIkRytYpTq7e_EBT5yJzWJ3_0 2024-09-12T01:07:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12748768004483143384', time=2024-09-12T02:55:56.907346+0000, chain.objs.size()=1 2024-09-12T01:07:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.V5R3cf5mzRC4KVYGZIgEEp0qO77EudY_0 2024-09-12T01:07:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17094066571134234977', time=2024-09-12T02:55:56.911521+0000, chain.objs.size()=1 2024-09-12T01:07:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.G_atBXTvau_xuzLKsMKx76xAMHVEOPf_0 2024-09-12T01:07:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14847763030237333166', time=2024-09-12T02:56:53.476281+0000, chain.objs.size()=1 2024-09-12T01:07:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.410__shadow_.ZFTgTfw-xuMeBTbcm-MaB3RpkXS2Tku_0 2024-09-12T01:07:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15375052380107585446', time=2024-09-12T02:57:13.594668+0000, chain.objs.size()=1 2024-09-12T01:07:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.439__shadow_.E6jOd5Hq85H-Rj79XMJzgLGz0O0wdMc_0 2024-09-12T01:07:26.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.329095594593050387', time=2024-09-12T02:57:16.449005+0000, chain.objs.size()=1 2024-09-12T01:07:26.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.443__shadow_.7JGGACKj2OfjKti1PQryVRdiFg7Gnng_0 2024-09-12T01:07:26.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/55196 2024-09-12T01:07:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2036193361440275232', time=2024-09-12T02:57:35.996521+0000, chain.objs.size()=1 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.465__shadow_.pz9ynGzJFf7xxewS4VJh3DYCpWgeBjV_0 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8033902002454282956', time=2024-09-12T02:58:09.498655+0000, chain.objs.size()=2 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.517__shadow_.PgXb44bcYnmxIpRsWcDEZZ59Nmtw6Ms_0 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.517__shadow_.PgXb44bcYnmxIpRsWcDEZZ59Nmtw6Ms_1 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9612716997915817991', time=2024-09-12T02:58:09.632430+0000, chain.objs.size()=1 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.518__multipart_mymultipart.2~I9IdTRmfUM_Z8hN3olbFOMtLG3HwsnD.1 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7314853371309522007', time=2024-09-12T02:58:17.887573+0000, chain.objs.size()=4 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.520__shadow:0qlX6CI6GboC2ywPuHMmV6mJDNBIUbg_.JltPLrRQjSMdpu3Iah8c3WTUWrUEq2G_0 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.520__shadow:0qlX6CI6GboC2ywPuHMmV6mJDNBIUbg_.JltPLrRQjSMdpu3Iah8c3WTUWrUEq2G_1 2024-09-12T01:07:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.520__shadow:0qlX6CI6GboC2ywPuHMmV6mJDNBIUbg_.JltPLrRQjSMdpu3Iah8c3WTUWrUEq2G_2 2024-09-12T01:07:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.520__shadow:0qlX6CI6GboC2ywPuHMmV6mJDNBIUbg_.JltPLrRQjSMdpu3Iah8c3WTUWrUEq2G_3 2024-09-12T01:07:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6282190016773265477', time=2024-09-12T02:58:37.243113+0000, chain.objs.size()=2 2024-09-12T01:07:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~zj8zxxFSqFnYfyhqxNhy1gXpuwMJm2Q.1 2024-09-12T01:07:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~zj8zxxFSqFnYfyhqxNhy1gXpuwMJm2Q.2 2024-09-12T01:07:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17742185248749972197', time=2024-09-12T02:59:33.567828+0000, chain.objs.size()=1 2024-09-12T01:07:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.553__shadow_.hQ5WhxUfgT2fbNZH1hIgQVOpIo9Ly9y_0 2024-09-12T01:07:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3247161793094664734', time=2024-09-12T02:59:52.833667+0000, chain.objs.size()=1 2024-09-12T01:07:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:9DXRHykU9s4JeEGRXdt7s9WRitiH-kV_.x6-j3GxAyhHX1PeUIuHf7MCY0oLWZ5l_0 2024-09-12T01:07:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14488938332731340985', time=2024-09-12T02:59:56.293722+0000, chain.objs.size()=1 2024-09-12T01:07:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:rnpARxCtJ5dQ9QvvWwTMniMcyrjG-Yr_.knK9I2j-NOTbnSmDbzTyH-6MRZf83WG_0 2024-09-12T01:07:26.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.83557662071022422', time=2024-09-12T03:00:12.573170+0000, chain.objs.size()=1 2024-09-12T01:07:26.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:Gex1CLpN2ygKEIiOPEHv7b1g8tJ7t8S_.NZVnopI4xqmIoCpCo1MmgSi3acrvqEC_0 2024-09-12T01:07:26.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5415560436430807659', time=2024-09-12T03:00:24.123117+0000, chain.objs.size()=1 2024-09-12T01:07:26.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:GHKPHHw5X2-KcK601rGOm0z82.56g1Y_.ewDDv8nCFDqBUN1iVCebnvJddgQ9G8L_0 2024-09-12T01:07:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3711064003454950204', time=2024-09-12T03:00:33.071853+0000, chain.objs.size()=4 2024-09-12T01:07:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~4Yvy1Vd-Szkildtoo5Xw4C63UEmwqLc.1 2024-09-12T01:07:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~4Yvy1Vd-Szkildtoo5Xw4C63UEmwqLc.2 2024-09-12T01:07:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~4Yvy1Vd-Szkildtoo5Xw4C63UEmwqLc.3 2024-09-12T01:07:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~4Yvy1Vd-Szkildtoo5Xw4C63UEmwqLc.4 2024-09-12T01:07:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14702395211254114878', time=2024-09-12T03:03:50.905386+0000, chain.objs.size()=6 2024-09-12T01:07:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.662__multipart_foo.2~ABnqFJER1C-y9DhDqXtwOFSM929JgG_.1 2024-09-12T01:07:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.662__multipart_foo.2~ABnqFJER1C-y9DhDqXtwOFSM929JgG_.2 2024-09-12T01:07:26.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.662__multipart_foo.2~ABnqFJER1C-y9DhDqXtwOFSM929JgG_.3 2024-09-12T01:07:26.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.662__multipart_foo.2~ABnqFJER1C-y9DhDqXtwOFSM929JgG_.4 2024-09-12T01:07:26.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.662__multipart_foo.2~ABnqFJER1C-y9DhDqXtwOFSM929JgG_.5 2024-09-12T01:07:26.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.662__multipart_foo.2~ABnqFJER1C-y9DhDqXtwOFSM929JgG_.6 2024-09-12T01:07:26.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11551989791962953946', time=2024-09-12T03:04:20.552613+0000, chain.objs.size()=1 2024-09-12T01:07:26.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.709__shadow_.i9ysH1YDfwKA7pB5aKL--QM3KXzi6l7_0 2024-09-12T01:07:26.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:07:26.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51277' 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_iK7P4Q9Hanu_xz8KkbmE8SBQuYJUBat', time=2024-09-12T02:51:36.129525+0000, chain.objs.size()=1 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.163__shadow_.rmTFzyIY2gylPyZAKymk9vuCu7Uw9I8_0 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5236336014368711775', time=2024-09-12T02:51:39.055153+0000, chain.objs.size()=1 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.170__shadow_.EF_xk0O5bt3u5LfkfSqL7xnZGxaFAd1_0 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14772939239624213624', time=2024-09-12T02:51:50.968555+0000, chain.objs.size()=1 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.183__shadow_.RHrPtAyzMzRjw01fzLajSPw_wGtWCci_0 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~PaRoVUxN5iQd8Pu8IfsK7NafBQyv6WW', time=2024-09-12T02:52:12.375573+0000, chain.objs.size()=1 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.202__multipart_mymultipart.2~PaRoVUxN5iQd8Pu8IfsK7NafBQyv6WW.1 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14725856580689569792', time=2024-09-12T02:53:39.208931+0000, chain.objs.size()=1 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.231__shadow_.7x-0oowYVjmE_FKpiGo_80NUJtc4tn0_0 2024-09-12T01:07:26.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7598933508084107628', time=2024-09-12T02:53:41.982474+0000, chain.objs.size()=1 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.235__shadow_.WsUJrC5tgqv-PvmZRlFQdb4e-9oEGcV_0 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17243353554821908566', time=2024-09-12T02:53:45.020268+0000, chain.objs.size()=1 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.238__shadow_.-7SSWV3Y1yul5Ca05qL-GwbzG0Iph9h_0 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16722615127166430241', time=2024-09-12T02:53:48.912921+0000, chain.objs.size()=1 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.243__shadow_.Apmg1ms8EJBy-CawY8xkMCrhNiFG2y5_0 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2272368078169127784', time=2024-09-12T02:53:53.568552+0000, chain.objs.size()=1 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.249__shadow_.u7HLGwmlcheWJAeKQxudJasvrqeUp5q_0 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17004523451635253001', time=2024-09-12T02:54:23.003519+0000, chain.objs.size()=1 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2-7UtMhrz7Nk273yEi_TDLoCnM09o5p_0 2024-09-12T01:07:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1890780964642653570', time=2024-09-12T02:54:23.051824+0000, chain.objs.size()=1 2024-09-12T01:07:26.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CRk2RhAzevq6ussNWQQOMmbUIoatY00_0 2024-09-12T01:07:26.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9041565423740451410', time=2024-09-12T02:54:23.171199+0000, chain.objs.size()=1 2024-09-12T01:07:26.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TUz--ZEuI_e7QM6_h7QEULxMt287wcJ_0 2024-09-12T01:07:26.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10217745748224401907', time=2024-09-12T02:54:23.176908+0000, chain.objs.size()=1 2024-09-12T01:07:26.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ScGioyRv31RbFozRLbotmGdGfHvGGKs_0 2024-09-12T01:07:26.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3439526622251943049', time=2024-09-12T02:54:23.396170+0000, chain.objs.size()=1 2024-09-12T01:07:26.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-foWg1W09ObmLQxPqhLBMMbEfZAXoWa_0 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8677731215419919114', time=2024-09-12T02:54:23.409995+0000, chain.objs.size()=1 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5j5Ja383X4J05R5fYQik28HHB0Zu8rN_0 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13465011525438501354', time=2024-09-12T02:54:23.435567+0000, chain.objs.size()=1 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.R3Rk1mwMn-iuD6XA0HPNl1nBDvRCXGn_0 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11001611754180894890', time=2024-09-12T02:54:23.605787+0000, chain.objs.size()=1 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._YQA7Bsnc17BV9sEH6Fbm6ZfPNiZl0m_0 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8248955208258891611', time=2024-09-12T02:54:23.618834+0000, chain.objs.size()=1 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.65MQ3MO2BOFHUF0xJ7zNMYAVngy9vNN_0 2024-09-12T01:07:26.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7478302403220453206', time=2024-09-12T02:54:23.741880+0000, chain.objs.size()=1 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qKKvBjWk1v3NlR3C_I5osywm_phalBQ_0 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11036635087813470057', time=2024-09-12T02:54:23.762295+0000, chain.objs.size()=1 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3noPJ6SI1eDpRlVQ7rO24Cv6jIWiiJC_0 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13873866590393637259', time=2024-09-12T02:54:23.765344+0000, chain.objs.size()=1 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xrBVoDwsuTCdRj3kTif9afNW_4JCOF6_0 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8125085685596914235', time=2024-09-12T02:54:23.787531+0000, chain.objs.size()=1 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pTlMDZOxz6b953skpspBlBM3EdsjAoh_0 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2280216082067595957', time=2024-09-12T02:54:24.033985+0000, chain.objs.size()=1 2024-09-12T01:07:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-0rdaczROkV1SfG47eHnWV1DWhhtgr3_0 2024-09-12T01:07:26.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10130176937562020835', time=2024-09-12T02:54:24.120001+0000, chain.objs.size()=1 2024-09-12T01:07:26.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TIebXth1q8dqE5IatEOlAkIGtcOvbdj_0 2024-09-12T01:07:26.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17591685500688890529', time=2024-09-12T02:54:24.158481+0000, chain.objs.size()=1 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.O7S8WOgNYDNRjYEjumTkb4KLSDRe9yA_0 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11403408075341601864', time=2024-09-12T02:54:24.207435+0000, chain.objs.size()=1 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jWMWZUoifcWh9Okl4Rx6fUH9TvlR4dV_0 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17644309520400281262', time=2024-09-12T02:54:24.356495+0000, chain.objs.size()=1 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.224oiHFGfZEMyyNi144EA_W8ML4xAic_0 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11638974783152148826', time=2024-09-12T02:54:24.524687+0000, chain.objs.size()=1 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9trSQYlHT7SZNud8nFzUY4LLHdaGUY2_0 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4812013384124878271', time=2024-09-12T02:54:24.527269+0000, chain.objs.size()=1 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1vhq4nlzI0x0G4oG3OQfl_1LbzqBgJq_0 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14269873697012780725', time=2024-09-12T02:54:24.838450+0000, chain.objs.size()=1 2024-09-12T01:07:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.G4uYIR3IooW_Z6wRySol5q0mb58bWvW_0 2024-09-12T01:07:26.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5179219754424445908', time=2024-09-12T02:54:24.869280+0000, chain.objs.size()=1 2024-09-12T01:07:26.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zCjDL1Somdhrrq5GksFgZ-cP2uzlrwZ_0 2024-09-12T01:07:26.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17316294904520339703', time=2024-09-12T02:54:24.871830+0000, chain.objs.size()=1 2024-09-12T01:07:26.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.X1ukdkrbptpy4mrP4nmXmdn2F3R_Ub0_0 2024-09-12T01:07:26.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8387049806134938500', time=2024-09-12T02:54:24.904053+0000, chain.objs.size()=1 2024-09-12T01:07:26.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ULS8vKOjR_jlHDc3ZtIEoJg0W1xQA5J_0 2024-09-12T01:07:26.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9487893491127554007', time=2024-09-12T02:54:25.219973+0000, chain.objs.size()=1 2024-09-12T01:07:26.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FCMwG-l_40YlVE9KuB-WYKhspLy_MK0_0 2024-09-12T01:07:26.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8681704872948369290', time=2024-09-12T02:54:25.321947+0000, chain.objs.size()=1 2024-09-12T01:07:26.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JIH9nbExRzxUvJXfpZpYOH1VKnq7jlN_0 2024-09-12T01:07:26.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8412820479445142341', time=2024-09-12T02:54:25.556072+0000, chain.objs.size()=1 2024-09-12T01:07:26.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nK548DHEMGlTL_-4EM9dgpWnLZbKWVY_0 2024-09-12T01:07:26.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15329774564306278123', time=2024-09-12T02:54:25.612392+0000, chain.objs.size()=1 2024-09-12T01:07:26.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mNKw6GR_882g-SRtR2AiYwd-d_GVyOW_0 2024-09-12T01:07:26.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2985647522361566709', time=2024-09-12T02:54:25.635971+0000, chain.objs.size()=1 2024-09-12T01:07:26.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3ZZzBx-Tyui7eFrl05kXBgnyvUEfCm-_0 2024-09-12T01:07:26.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.113918707794835297', time=2024-09-12T02:54:25.649947+0000, chain.objs.size()=1 2024-09-12T01:07:26.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.515Df3JQTsNx6KO2JN6BKga9NgqfTi8_0 2024-09-12T01:07:26.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2591569678609488407', time=2024-09-12T02:54:25.717620+0000, chain.objs.size()=1 2024-09-12T01:07:26.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qUuDsp3ytx8Nt1SWiMBNox6xsnd4Fsa_0 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8408090339112067061', time=2024-09-12T02:54:25.884494+0000, chain.objs.size()=1 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.U58eRA-6ztgkoFwDSM4wlq9geeTtlZT_0 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11293474935112745887', time=2024-09-12T02:54:25.951843+0000, chain.objs.size()=1 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qC_ePRG3asZMOtgU0WK6M99ZESTO_Dt_0 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3234677975673018853', time=2024-09-12T02:54:25.983184+0000, chain.objs.size()=1 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RfBVIjbWjIal5YVU1QRW8m1NNhAkmTi_0 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4587715706417108772', time=2024-09-12T02:54:28.661270+0000, chain.objs.size()=1 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.266__shadow_.oRoJ5RRKVHhCverQbUod0drR08AwJis_0 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9375876528128995938', time=2024-09-12T02:54:34.804974+0000, chain.objs.size()=1 2024-09-12T01:07:26.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.275__shadow_._XXQRMn3QmQ6mOo2tzKIJjAa21-IprC_0 2024-09-12T01:07:26.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14191588629594310895', time=2024-09-12T02:54:42.627963+0000, chain.objs.size()=1 2024-09-12T01:07:26.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.286__shadow_._fvZFByYu02NWR_PnqjTZy9M9xPk6JA_0 2024-09-12T01:07:26.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6849940695413518770', time=2024-09-12T02:54:49.345162+0000, chain.objs.size()=1 2024-09-12T01:07:26.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.yHew0bTzP3hKSIVA6tqx0MF5KPk3YOe_0 2024-09-12T01:07:26.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15936952210943290937', time=2024-09-12T02:55:30.873512+0000, chain.objs.size()=1 2024-09-12T01:07:26.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PSL07Nu-bURbhCnUi07Bt97qGa6ppUs_0 2024-09-12T01:07:26.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14381825234262520890', time=2024-09-12T02:55:30.929736+0000, chain.objs.size()=1 2024-09-12T01:07:26.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HSHmmSo8xp4RmIuSg0iHX7SHvj5ygGz_0 2024-09-12T01:07:26.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.213878306159221484', time=2024-09-12T02:55:30.937296+0000, chain.objs.size()=1 2024-09-12T01:07:26.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jubHUYkF_Q46LdPzTBdn6c0wFZBhDIR_0 2024-09-12T01:07:26.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4550099379804908860', time=2024-09-12T02:55:30.946623+0000, chain.objs.size()=1 2024-09-12T01:07:26.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.l-z-b3ZjmyCq5lUJ5dvdNbwfL74nFQu_0 2024-09-12T01:07:26.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16448340739455886096', time=2024-09-12T02:55:30.957693+0000, chain.objs.size()=1 2024-09-12T01:07:26.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3uMoJVxcMTzrBdTBHJdqIedhUdaT4Xv_0 2024-09-12T01:07:26.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15128472957110795223', time=2024-09-12T02:55:30.970406+0000, chain.objs.size()=1 2024-09-12T01:07:26.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GYycA0vKSQVxMb9BS_h2eqxOoYvsNkK_0 2024-09-12T01:07:26.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1498468016220501877', time=2024-09-12T02:55:30.984256+0000, chain.objs.size()=1 2024-09-12T01:07:26.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._ehToEerrIIMcISVWsUpfCKCry-w4Cg_0 2024-09-12T01:07:26.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6924692836821524420', time=2024-09-12T02:55:30.985171+0000, chain.objs.size()=1 2024-09-12T01:07:26.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KspWhfZj0hrhMSdpoKlPS9-Oc5o9ppM_0 2024-09-12T01:07:26.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6323508382909102866', time=2024-09-12T02:55:30.991981+0000, chain.objs.size()=1 2024-09-12T01:07:26.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.p7b6N80f3LLiFWRGm_tuYOCZx4gIWEp_0 2024-09-12T01:07:26.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17613046099281068275', time=2024-09-12T02:55:31.044773+0000, chain.objs.size()=1 2024-09-12T01:07:26.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.FuZ4dwRLY2Tmtw1cWJEVmsvdYoYTkZm_0 2024-09-12T01:07:26.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8282255151302828912', time=2024-09-12T02:55:31.056435+0000, chain.objs.size()=1 2024-09-12T01:07:26.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KgoigFuN1SpgzuF7KZEDvQ2iSwdiGva_0 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6036368302803859021', time=2024-09-12T02:55:31.323010+0000, chain.objs.size()=1 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6JiBfe9VH-qSLvZc4EfMzj8SKL_XrHb_0 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7939088760075786597', time=2024-09-12T02:55:31.328483+0000, chain.objs.size()=1 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.K0bgMiYfbIceEbV0UiBuOdXm6n0S5kq_0 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14375286404622797778', time=2024-09-12T02:55:31.329892+0000, chain.objs.size()=1 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WCOZ7clF-wFR3C8lTF35MQ_7REfjmgR_0 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1108690789088377066', time=2024-09-12T02:55:31.354344+0000, chain.objs.size()=1 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Oj1tM5rFO1vqL__hu0eqy6Xmn_Ls_Nb_0 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3924257894777248811', time=2024-09-12T02:55:31.376960+0000, chain.objs.size()=1 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kft0-nyn702qYnHmAAsydkPpVsb-wqh_0 2024-09-12T01:07:26.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14947806007454324337', time=2024-09-12T02:55:31.443188+0000, chain.objs.size()=1 2024-09-12T01:07:26.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MAo2cAUt1slqRjIHaj1oZFi_qicXZcl_0 2024-09-12T01:07:26.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13000472400803812914', time=2024-09-12T02:55:31.717219+0000, chain.objs.size()=1 2024-09-12T01:07:26.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.UyLoM7CbeQW1teXgT3Ln2WLBXpEbTIY_0 2024-09-12T01:07:26.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.438229134503185926', time=2024-09-12T02:55:31.899609+0000, chain.objs.size()=1 2024-09-12T01:07:26.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7UYoe19VPENGgCm5oc9ud-WR8g3ynFq_0 2024-09-12T01:07:26.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10601147821758846713', time=2024-09-12T02:55:31.945225+0000, chain.objs.size()=1 2024-09-12T01:07:26.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tICAWqAYnL-K0Ex6N6CUqEKl7mFBLi4_0 2024-09-12T01:07:26.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3903587116280634143', time=2024-09-12T02:55:31.948690+0000, chain.objs.size()=1 2024-09-12T01:07:26.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8o5sU6nUiZV6SWF_bfp-h8YTISfWj95_0 2024-09-12T01:07:26.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6416127970754728901', time=2024-09-12T02:55:32.082225+0000, chain.objs.size()=1 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3qEZfwPmUqd-4XF_nxnrQkPoacp9JN5_0 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12826396913875650911', time=2024-09-12T02:55:32.374455+0000, chain.objs.size()=1 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eBArdpfQXSCYeYy2DdZswjFDwwha4D3_0 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16050266214823017811', time=2024-09-12T02:55:32.558838+0000, chain.objs.size()=1 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jyXY3VJ51JXtNkUaGp2-qboVT84YmnL_0 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5952749662457473664', time=2024-09-12T02:55:32.634369+0000, chain.objs.size()=1 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LxzXz_0iWMHKM_n4Zi-LzQVKNhE5eGy_0 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1027107815961535729', time=2024-09-12T02:55:32.718740+0000, chain.objs.size()=1 2024-09-12T01:07:26.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.j79baOX2EqMasb-qVn4jPNx5NVd0QEC_0 2024-09-12T01:07:26.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.304820754133449108', time=2024-09-12T02:55:32.743503+0000, chain.objs.size()=1 2024-09-12T01:07:26.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LIFKjqINz9y0OUSrCGvSIlZpCRi2ymF_0 2024-09-12T01:07:26.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8426152170848191647', time=2024-09-12T02:55:32.928338+0000, chain.objs.size()=1 2024-09-12T01:07:26.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KfVuw3ohQWc6jpolDyQ2MQFhV8yvBsH_0 2024-09-12T01:07:26.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14626759601044697328', time=2024-09-12T02:55:32.938490+0000, chain.objs.size()=1 2024-09-12T01:07:26.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8mUKyb_Wv42JhNt8vQFcawS2RVDqE28_0 2024-09-12T01:07:26.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17732761724701558379', time=2024-09-12T02:55:33.023950+0000, chain.objs.size()=1 2024-09-12T01:07:26.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KyG0kp93hBFiNgLpFfe_aBgBAp261Mk_0 2024-09-12T01:07:26.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18268098282759799565', time=2024-09-12T02:55:33.069576+0000, chain.objs.size()=1 2024-09-12T01:07:26.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bKwFNHM74VSa5WTLURLjn5XJ2BHiIim_0 2024-09-12T01:07:26.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9738723502573727827', time=2024-09-12T02:55:33.162992+0000, chain.objs.size()=1 2024-09-12T01:07:26.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.juxUk4Zn-98cjCqccj8pvljFYzCoc1h_0 2024-09-12T01:07:26.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15894629750905563026', time=2024-09-12T02:55:33.200490+0000, chain.objs.size()=1 2024-09-12T01:07:26.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pEBNkz2eDPxYz85qKKN5AB_HWh4nBXt_0 2024-09-12T01:07:26.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5336042806832253543', time=2024-09-12T02:55:33.217085+0000, chain.objs.size()=1 2024-09-12T01:07:26.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dkcROiH2vZmgNfOu82iHvwJmxEVzcYG_0 2024-09-12T01:07:26.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.377497286961002197', time=2024-09-12T02:55:33.230371+0000, chain.objs.size()=1 2024-09-12T01:07:26.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Byn55Zx5twUsvAicaq8aLSvJ6Na92_y_0 2024-09-12T01:07:26.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1669152299283094982', time=2024-09-12T02:55:33.274674+0000, chain.objs.size()=1 2024-09-12T01:07:26.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MescuE3_n1C1miW0mBRpMnjErfiXV05_0 2024-09-12T01:07:26.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8002586362714038015', time=2024-09-12T02:55:54.522975+0000, chain.objs.size()=1 2024-09-12T01:07:26.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Z55qoLxPCsEBDvOIQHPixsjH232f1Vj_0 2024-09-12T01:07:26.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.39571479744760056', time=2024-09-12T02:55:54.539622+0000, chain.objs.size()=1 2024-09-12T01:07:26.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JY52JyG35L-ErLJi5NweXOtRSwR_whj_0 2024-09-12T01:07:26.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9952468659409845599', time=2024-09-12T02:55:54.680723+0000, chain.objs.size()=1 2024-09-12T01:07:26.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.KOADZO3nsRuQ2aU1jlmKt4i1jK_Ko_P_0 2024-09-12T01:07:26.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10373110231209467436', time=2024-09-12T02:55:54.805619+0000, chain.objs.size()=1 2024-09-12T01:07:26.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mVzBUKibrZesiEUBjKaOu4Lhya0N252_0 2024-09-12T01:07:26.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.706254858540215413', time=2024-09-12T02:55:54.814676+0000, chain.objs.size()=1 2024-09-12T01:07:26.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VNkyIwuZTl_UzIpZGTrWpQtWDZ4HKgx_0 2024-09-12T01:07:26.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10276429479486915575', time=2024-09-12T02:55:54.914538+0000, chain.objs.size()=1 2024-09-12T01:07:26.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.v6xgqEeYSM5tWErl4Q4uW68q67rYCun_0 2024-09-12T01:07:26.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8293641370505360198', time=2024-09-12T02:55:54.990368+0000, chain.objs.size()=1 2024-09-12T01:07:26.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jegulm8q4LkXLA7TZXtVu6q24Ken9_Q_0 2024-09-12T01:07:26.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18141719528225866256', time=2024-09-12T02:55:55.202741+0000, chain.objs.size()=1 2024-09-12T01:07:26.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.niAiGOONo7eBkeler6_f74C1xsVveXv_0 2024-09-12T01:07:26.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10297526176043408251', time=2024-09-12T02:55:55.279307+0000, chain.objs.size()=1 2024-09-12T01:07:26.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jSXQFzlDFRB36oJVFH46ij8D_7rYrFu_0 2024-09-12T01:07:26.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3729671115621131444', time=2024-09-12T02:55:55.281203+0000, chain.objs.size()=1 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zOJHzOOPUOC0jh9DqmYVdbD_HFguyf4_0 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18195886947922910307', time=2024-09-12T02:55:55.483429+0000, chain.objs.size()=1 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.J48FNyP9Ot3rNHfeHqObUwXA-tbYa1M_0 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14432904084447868227', time=2024-09-12T02:55:55.531098+0000, chain.objs.size()=1 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5i2lxPCekTq5nnYNEdD5nAd_YJRUnsL_0 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17510582012873226832', time=2024-09-12T02:55:55.558121+0000, chain.objs.size()=1 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pn3PA7yjgzW0bcA5L3WtlX7NGSM4QW6_0 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13327649092071949797', time=2024-09-12T02:55:55.619611+0000, chain.objs.size()=1 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GcHK8jgVXiLckIC_RqvB1ihTei_d6ls_0 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5091774521675632721', time=2024-09-12T02:55:55.635969+0000, chain.objs.size()=1 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jrJBLJVxZYcI3rvVbyYxCBwv-EJ9mP8_0 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12946596291690735572', time=2024-09-12T02:55:55.673524+0000, chain.objs.size()=1 2024-09-12T01:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eaPeSTnoU3hTAIgEmPxgSAX61zkWiu1_0 2024-09-12T01:07:26.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17210202581736912228', time=2024-09-12T02:55:55.925452+0000, chain.objs.size()=1 2024-09-12T01:07:26.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.t9yceNdl7QWv9Djf1XGynrcCfLNWfX-_0 2024-09-12T01:07:26.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51277 2024-09-12T01:07:26.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11913784458973141816', time=2024-09-12T02:55:55.942727+0000, chain.objs.size()=1 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MM47EHLJS6vod4pOiMeaQ4ySHtxRs9u_0 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10639449987000753035', time=2024-09-12T02:55:56.003812+0000, chain.objs.size()=1 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FE9vYJahzON03BBKW8AWBaM3QfXYekC_0 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15342807136813696806', time=2024-09-12T02:55:56.194143+0000, chain.objs.size()=1 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SzRzeS4lXhVwKTQ6UL6XxK108zqEe1L_0 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5787597033469579900', time=2024-09-12T02:55:56.205633+0000, chain.objs.size()=1 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5gY1DtMH8XQV04jVCWoSCR92BGCnAv2_0 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2348192092888304736', time=2024-09-12T02:55:56.364918+0000, chain.objs.size()=1 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XjK5bl7LKQ9NrXmMkHNXMf53B2pGVPn_0 2024-09-12T01:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1060546315734700590', time=2024-09-12T02:55:56.461748+0000, chain.objs.size()=1 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DHJGwTU0FBNB2WHW4qHBDHRlebBpPjq_0 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17122432936832149790', time=2024-09-12T02:55:56.464318+0000, chain.objs.size()=1 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.23mzn5NSWzuwCLP-DS0KZZETVYDz_qt_0 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1404867752965442091', time=2024-09-12T02:55:56.517432+0000, chain.objs.size()=1 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4O7wu-vwt3M6Px1ZP6cfv2Z4xfX2yhO_0 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16760350066671167508', time=2024-09-12T02:55:56.522173+0000, chain.objs.size()=1 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Saoxx8KB0qq5CmwC5YbQON9pK1ebx6l_0 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12643884159662202994', time=2024-09-12T02:55:56.640687+0000, chain.objs.size()=1 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.EjRePg-noNzlydUVLWDTXjVvMRtVZw2_0 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18341424090874363092', time=2024-09-12T02:55:56.644713+0000, chain.objs.size()=1 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Wnzpod8htWj7nV9eIqc8_rSvv43Tnq__0 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15669839262646338635', time=2024-09-12T02:55:56.646980+0000, chain.objs.size()=1 2024-09-12T01:07:26.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3Me0ehrLBwnkF0FMEAdPPzJpE2Uk8St_0 2024-09-12T01:07:26.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17562848684214203847', time=2024-09-12T02:55:56.670512+0000, chain.objs.size()=1 2024-09-12T01:07:26.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MjLf_J89eRDytUUmN7WyK-EVGuxNPqs_0 2024-09-12T01:07:26.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.853185132280623294', time=2024-09-12T02:55:56.833384+0000, chain.objs.size()=1 2024-09-12T01:07:26.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.K8xKnK_k6nXn4MEFYYgeFKO1fFMQlbR_0 2024-09-12T01:07:26.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3576150781470210489', time=2024-09-12T02:55:56.918711+0000, chain.objs.size()=1 2024-09-12T01:07:26.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.U5Slvi8ny9Sp4T_iEUakjKpX8cf9BNP_0 2024-09-12T01:07:26.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10538765480530902203', time=2024-09-12T02:55:56.928742+0000, chain.objs.size()=1 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0PN2gl5PdAIM8HvztwGYP6-DOJDS2Io_0 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4010875506621430816', time=2024-09-12T02:56:31.229098+0000, chain.objs.size()=1 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.379__shadow_.ZgdXOoLIgHRSUcuR1M3TfxIVyc-MKp1_0 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12309968472384602516', time=2024-09-12T02:57:36.224839+0000, chain.objs.size()=1 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.465__shadow_.Nwtzxjn-l1_HMTTjo23H_CYAg4fqLj__0 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14280495863471606888', time=2024-09-12T02:58:06.492707+0000, chain.objs.size()=1 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.515__shadow_.a2Y3JeEWr-qF3FBnZWFwUqIHwEi71rT_0 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13358174281992904533', time=2024-09-12T02:58:08.039311+0000, chain.objs.size()=1 2024-09-12T01:07:26.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.518__multipart_mymultipart.2~2-N3qNe-HZhbEnNxdhCcWsm2rghKOAL.1 2024-09-12T01:07:26.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5103909505566161029', time=2024-09-12T02:59:30.143004+0000, chain.objs.size()=1 2024-09-12T01:07:26.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.550__shadow_.ntbpbpnkKNHbgTvnxeXrBS3CUIY7VbW_0 2024-09-12T01:07:26.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8473204427618922358', time=2024-09-12T02:59:36.873755+0000, chain.objs.size()=1 2024-09-12T01:07:26.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.556__shadow_.s1cJy04fgeml6QmCmpT9A1C4kRrMwDG_0 2024-09-12T01:07:26.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2198564665953800251', time=2024-09-12T03:00:01.466132+0000, chain.objs.size()=1 2024-09-12T01:07:26.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.571__shadow_.KgHoj6tOQ6qUeBik7m7IG1HPZ6aaS-u_0 2024-09-12T01:07:26.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17718041313475501245', time=2024-09-12T03:00:14.107425+0000, chain.objs.size()=1 2024-09-12T01:07:26.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:xBXANBqWS3zrb356A-vWBqEYzWJOk90_.i3wrt7f-S050J7eArBQd71nHFceT3BZ_0 2024-09-12T01:07:26.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14816409525769117735', time=2024-09-12T03:00:25.582885+0000, chain.objs.size()=1 2024-09-12T01:07:26.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:qSqrXQummc54D3mqzJH2M6xyx1lN7tP_.CyDKkl1geacTfOePXhx8D8lVuKnRz5N_0 2024-09-12T01:07:26.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1332204004208102517', time=2024-09-12T03:00:37.109308+0000, chain.objs.size()=1 2024-09-12T01:07:26.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:jtKEtOLS43kp.2pO8svYPd3j0R8MyKK_.xrdWwwhmVkC7mZTJ44ZRqj0taSzUiIO_0 2024-09-12T01:07:26.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13370104160262650458', time=2024-09-12T03:00:42.306683+0000, chain.objs.size()=1 2024-09-12T01:07:26.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:eICMV1cx3jNn33Usdu-Q4N0XXl3DXF-_.2sg7WFzh8zYHKn3Wrnr25RQP-_MQOFM_0 2024-09-12T01:07:26.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3957293912162996059', time=2024-09-12T03:00:51.347424+0000, chain.objs.size()=1 2024-09-12T01:07:26.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.602__shadow_.OEguuWejyXIfsOkCtFpEuVf1_PN92Uq_0 2024-09-12T01:07:26.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9253211158363593305', time=2024-09-12T03:04:01.854390+0000, chain.objs.size()=1 2024-09-12T01:07:26.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.679__shadow_.nzlqBQd7rXQVJcomoFvi4vbzdTaCNhb_0 2024-09-12T01:07:26.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gDRlZN_mttyBMM-DbQKanOr1WtA0C31', time=2024-09-12T03:05:02.807334+0000, chain.objs.size()=1 2024-09-12T01:07:26.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.742__multipart_mymultipart.2~gDRlZN_mttyBMM-DbQKanOr1WtA0C31.1 2024-09-12T01:07:26.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:07:26.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47500' 2024-09-12T01:07:26.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_HvN-MZkqlnBGiYuofT2tvHlI8zeAWLz', time=2024-09-12T02:51:37.414553+0000, chain.objs.size()=3 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.165__shadow_.Iopj3N5KC0gzKBzKs6RlXQpjA7Api7Y_0 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.165__shadow_.Iopj3N5KC0gzKBzKs6RlXQpjA7Api7Y_1 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.165__shadow_.Iopj3N5KC0gzKBzKs6RlXQpjA7Api7Y_2 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16673608842553393564', time=2024-09-12T02:51:46.567577+0000, chain.objs.size()=1 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.176__shadow_.rFQec_F3y48JBELddp-j9vF7i-pAbOm_0 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7818811071509199644', time=2024-09-12T02:52:10.013896+0000, chain.objs.size()=1 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.199__shadow_._RpjePJ1ercQchqwDIZCcWLkgNz48cU_0 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1302273457162633899', time=2024-09-12T02:53:47.724979+0000, chain.objs.size()=1 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.242__shadow_.fz9xW8OoKEeESV6ygDm3ABWr8OyjQ9z_0 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5378291566801918141', time=2024-09-12T02:53:50.088024+0000, chain.objs.size()=1 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.244__shadow_.-81MOvY7GHnM7VI7qkMs7GO-0TDaDrj_0 2024-09-12T01:07:26.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5066155768989975459', time=2024-09-12T02:53:55.673168+0000, chain.objs.size()=1 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.252__shadow_.jkOKB8E1wLcMCq2gQxrOjtn3EHitBee_0 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6570449202314643906', time=2024-09-12T02:53:59.863000+0000, chain.objs.size()=1 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.258__shadow_.fEV78ymeJw3ecwZ-PNLc4f7TF3SZhms_0 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7404283974669752695', time=2024-09-12T02:54:01.988717+0000, chain.objs.size()=1 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.261__shadow_.OCmnyI9FLfIMNrocSmjj476mAn6C6ig_0 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7056199442329960862', time=2024-09-12T02:54:23.198234+0000, chain.objs.size()=1 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jKAxazSrXnnGZDYIRiGQLynmM47Fe4P_0 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9184720415306754990', time=2024-09-12T02:54:23.221310+0000, chain.objs.size()=1 2024-09-12T01:07:26.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uIOx1BJ1Ph4vmGCFC3tvvPhAQfEMBWP_0 2024-09-12T01:07:26.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8587731580274621592', time=2024-09-12T02:54:23.226904+0000, chain.objs.size()=1 2024-09-12T01:07:26.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.7DnglSLfQQwYzNIQw4LV3-4BzVcE4wD_0 2024-09-12T01:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15715313325629059716', time=2024-09-12T02:54:23.243527+0000, chain.objs.size()=1 2024-09-12T01:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fYxCwuCiMmqPivBcAaIQqyn7uSPzKfJ_0 2024-09-12T01:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13203391932693169591', time=2024-09-12T02:54:23.386271+0000, chain.objs.size()=1 2024-09-12T01:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nxdLZlvUSMh49HwPwf98GbP4tUFGOtv_0 2024-09-12T01:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5838515516911099009', time=2024-09-12T02:54:23.402348+0000, chain.objs.size()=1 2024-09-12T01:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.lY7hm2T9IkXIZsCHVC3p8cPSr0uSXpH_0 2024-09-12T01:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13470351714815295768', time=2024-09-12T02:54:23.498220+0000, chain.objs.size()=1 2024-09-12T01:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VEPDvODDb6Izs1Kni-jIRvAK4MWPJgd_0 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6414224155768014981', time=2024-09-12T02:54:23.538400+0000, chain.objs.size()=1 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ChGWgrTBnPUJ9Wcm-zYT8jOp12gNY7r_0 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5415064894258742938', time=2024-09-12T02:54:23.770028+0000, chain.objs.size()=1 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nKQp0TKc7jnUF4KeW4TICtVPAYJVl0B_0 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1119889984623957035', time=2024-09-12T02:54:24.059555+0000, chain.objs.size()=1 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9C61E7xjd1_uZqz5oyrkieo5hgUsS6W_0 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15882502016976564046', time=2024-09-12T02:54:24.145482+0000, chain.objs.size()=1 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dfmLrbzfsiZAsyIEeqGF5uaYi3Pc0_o_0 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5254384686222060377', time=2024-09-12T02:54:24.197645+0000, chain.objs.size()=1 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Sd0R5Qw3CTZ9s8n2gztg3HJbpPqmfQa_0 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14115596912269741461', time=2024-09-12T02:54:24.347311+0000, chain.objs.size()=1 2024-09-12T01:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rdwk8uk5rSWEbEHwDyIt4GVZLktTg7C_0 2024-09-12T01:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.620+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18382723288421157003', time=2024-09-12T02:54:24.361358+0000, chain.objs.size()=1 2024-09-12T01:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.620+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Dv8iU6m5k4EIR7rZB8BJskBwmoZB8JZ_0 2024-09-12T01:07:26.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.620+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8747932008792581258', time=2024-09-12T02:54:24.390294+0000, chain.objs.size()=1 2024-09-12T01:07:26.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.620+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Qv_RcU-qdrMoeaFEOHxSbqCqoOFg56V_0 2024-09-12T01:07:26.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.620+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6776069892486458838', time=2024-09-12T02:54:24.405635+0000, chain.objs.size()=1 2024-09-12T01:07:26.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.620+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kPqQ-IM-h9NwkU5vXkeEmCihRTNzC2I_0 2024-09-12T01:07:26.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11054510553017765138', time=2024-09-12T02:54:24.437246+0000, chain.objs.size()=1 2024-09-12T01:07:26.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eh0IOTveIQFTljvoFTbsWqf0rWwqZeD_0 2024-09-12T01:07:26.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17697040260146683830', time=2024-09-12T02:54:24.497143+0000, chain.objs.size()=1 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vmcC_MeJf2rcw8jaosgSsF8_wzHOTxY_0 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17572018798914145953', time=2024-09-12T02:54:24.808666+0000, chain.objs.size()=1 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0onf9oxAzdJ4T4ilpnz8ikc8cuvNI7m_0 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14147490124404338011', time=2024-09-12T02:54:24.822513+0000, chain.objs.size()=1 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.t_C9DyxJfk9IItTalp80uOuo0tX7EZ__0 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15376334233865567441', time=2024-09-12T02:54:24.946450+0000, chain.objs.size()=1 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2_z6qpRxXmtQl-BUxJSljd8LQaLz37s_0 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9655192351395797690', time=2024-09-12T02:54:24.971616+0000, chain.objs.size()=1 2024-09-12T01:07:26.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pVY2BnmAWnfN0FMwwYO9Vdvc-8J0AOS_0 2024-09-12T01:07:26.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8657946978797864589', time=2024-09-12T02:54:24.996790+0000, chain.objs.size()=1 2024-09-12T01:07:26.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.I1Zxu2iv_4ifPFdWgqJWZs7h_frL6Gx_0 2024-09-12T01:07:26.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16434481836691608484', time=2024-09-12T02:54:25.142688+0000, chain.objs.size()=1 2024-09-12T01:07:26.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vlAI4vQzxbxPCzhCowO5VsUJ7XJNE1N_0 2024-09-12T01:07:26.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.990378054846400943', time=2024-09-12T02:54:25.206082+0000, chain.objs.size()=1 2024-09-12T01:07:26.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PhgU-QC8wWyBmCkj3JBGb9tbj_991kn_0 2024-09-12T01:07:26.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6906218081550779735', time=2024-09-12T02:54:25.274259+0000, chain.objs.size()=1 2024-09-12T01:07:26.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1tqQmJXJT7PRRdF8GHA8MWeIxXSV-iy_0 2024-09-12T01:07:26.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2805469397495726754', time=2024-09-12T02:54:25.277692+0000, chain.objs.size()=1 2024-09-12T01:07:26.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XmB02Bh8-gE1r0LwBjg7GCcxcV9KPnW_0 2024-09-12T01:07:26.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8571305336423613514', time=2024-09-12T02:54:25.582746+0000, chain.objs.size()=1 2024-09-12T01:07:26.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.I2xPpGOH5FvYrRC_z3J7IZXaTCI3HHR_0 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.156504603860633171', time=2024-09-12T02:54:25.623287+0000, chain.objs.size()=1 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.QjNxPAKvww0SNA96dGZVyk6abgPL4cu_0 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15468437006399624531', time=2024-09-12T02:54:25.752971+0000, chain.objs.size()=1 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jRtS8P3R-ylI4yJeXznbzDf3WWBm4lN_0 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11977332411907014272', time=2024-09-12T02:54:25.851398+0000, chain.objs.size()=1 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uPG5-cEzvAawWV_2WYw6vDWtHUyBSDA_0 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1573624091726231368', time=2024-09-12T02:54:25.858431+0000, chain.objs.size()=1 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wSLnMeyvaKj2qxIR2pfqk1k9Nsmvui6_0 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7505791807043328709', time=2024-09-12T02:54:29.994005+0000, chain.objs.size()=1 2024-09-12T01:07:26.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.268__shadow_.8I9aIwLzlzkQo_t8MaiobCSVrvLZKQf_0 2024-09-12T01:07:26.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15370402006531336398', time=2024-09-12T02:54:41.884463+0000, chain.objs.size()=1 2024-09-12T01:07:26.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285__shadow_.DYT9mqueFF97yL28H_K7pDpGvbUVyHy_0 2024-09-12T01:07:26.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.163657247112369526', time=2024-09-12T02:54:44.770678+0000, chain.objs.size()=1 2024-09-12T01:07:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.289__shadow_.M8j0FXYoDza63SJT-5OkNdj5o-7u59Z_0 2024-09-12T01:07:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12262305198047465174', time=2024-09-12T02:54:49.398236+0000, chain.objs.size()=1 2024-09-12T01:07:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.eTV0Fm6GchJwEUke0t9Bf3IGVJ2V7iC_0 2024-09-12T01:07:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9662097357780279997', time=2024-09-12T02:54:49.416486+0000, chain.objs.size()=1 2024-09-12T01:07:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.CjPilbessW62GzKDclaLVb7oNeO_JvT_0 2024-09-12T01:07:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4238929035919172259', time=2024-09-12T02:54:50.108969+0000, chain.objs.size()=1 2024-09-12T01:07:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.294__shadow_.Xg6Ng3Td2FCWWc7cNnvkPzG6mre9kjn_0 2024-09-12T01:07:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7415844272406521420', time=2024-09-12T02:54:57.823671+0000, chain.objs.size()=1 2024-09-12T01:07:26.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.305__shadow_.JwCHFZ7KN9RcVZA9GNCnLKRmk6B0Dra_0 2024-09-12T01:07:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13926254305597664425', time=2024-09-12T02:55:08.004180+0000, chain.objs.size()=1 2024-09-12T01:07:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.319__shadow:MhYraI8P-vyR1kEQaDMJuj6qUp0toAz_.3JLhrgsXIUq4mTQ-LyVpn7TK1jdZ9xf_0 2024-09-12T01:07:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3873489908167492748', time=2024-09-12T02:55:09.620964+0000, chain.objs.size()=1 2024-09-12T01:07:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.322__shadow_.hzuso_cNgkvMsBJwo1tha0pq3Y3U9LL_0 2024-09-12T01:07:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2500719906017309998', time=2024-09-12T02:55:30.982064+0000, chain.objs.size()=1 2024-09-12T01:07:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.B3WDR6K_BAwHBDhWqAfhbo4T_sO12uE_0 2024-09-12T01:07:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2487440568527821185', time=2024-09-12T02:55:31.040203+0000, chain.objs.size()=1 2024-09-12T01:07:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.DKdDlRoZnEEvkflPBPabxhcWW40AMT3_0 2024-09-12T01:07:26.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2557586770291450810', time=2024-09-12T02:55:31.074665+0000, chain.objs.size()=1 2024-09-12T01:07:26.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9zvmsw3WMTQa8vr4jk27UMg1udIiOxK_0 2024-09-12T01:07:26.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6205260262660756607', time=2024-09-12T02:55:31.585255+0000, chain.objs.size()=1 2024-09-12T01:07:26.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QezEo2xetn1HX1qIC60uTEje1mAQ3Yw_0 2024-09-12T01:07:26.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13320171364496622402', time=2024-09-12T02:55:31.614205+0000, chain.objs.size()=1 2024-09-12T01:07:26.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qE0ma1kwvF9Q55SssxVB808dGum6Ae__0 2024-09-12T01:07:26.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18406933843454680921', time=2024-09-12T02:55:31.658770+0000, chain.objs.size()=1 2024-09-12T01:07:26.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Li-MykTyMX4NAnTkYbwSvJ0oRmJNRjD_0 2024-09-12T01:07:26.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2765205189939807064', time=2024-09-12T02:55:31.690761+0000, chain.objs.size()=1 2024-09-12T01:07:26.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZbcL43r_8fRWQvnMkxhqkN5DObplFag_0 2024-09-12T01:07:26.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9314431532193844998', time=2024-09-12T02:55:31.762751+0000, chain.objs.size()=1 2024-09-12T01:07:26.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lkKTb-xDN6v8jmu2k0JDKL7BQktNEN2_0 2024-09-12T01:07:26.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18158984862781424989', time=2024-09-12T02:55:31.764622+0000, chain.objs.size()=1 2024-09-12T01:07:26.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.K-7SFQTri9Ik-IYeOISGFHgxUPQeTXw_0 2024-09-12T01:07:26.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14780785257084745966', time=2024-09-12T02:55:31.893135+0000, chain.objs.size()=1 2024-09-12T01:07:26.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0aDeVOwGA7pbaXHJFeEqKKMVnl-CHf__0 2024-09-12T01:07:26.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12669263008629754267', time=2024-09-12T02:55:31.919601+0000, chain.objs.size()=1 2024-09-12T01:07:26.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dEtwIurRoqE3vrlNYHls3pGKRXng_bq_0 2024-09-12T01:07:26.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2280935009384282191', time=2024-09-12T02:55:31.928104+0000, chain.objs.size()=1 2024-09-12T01:07:26.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9ppZabne8wZ4Cort9tqzunTfyU1aB0W_0 2024-09-12T01:07:26.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5119668879658964046', time=2024-09-12T02:55:31.942092+0000, chain.objs.size()=1 2024-09-12T01:07:26.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.iszP-_vDupokm2AcnUUciWE2rA67h0G_0 2024-09-12T01:07:26.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10243097061941144814', time=2024-09-12T02:55:32.072415+0000, chain.objs.size()=1 2024-09-12T01:07:26.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tXWl_36y5_dSU8mUmxVsG-JkAfPvZtA_0 2024-09-12T01:07:26.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18296622968633627703', time=2024-09-12T02:55:32.102198+0000, chain.objs.size()=1 2024-09-12T01:07:26.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.oQDLJg0bgYDV1eP4_7-LU1fAif5v5u7_0 2024-09-12T01:07:26.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17330866871925083665', time=2024-09-12T02:55:32.245462+0000, chain.objs.size()=1 2024-09-12T01:07:26.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.636+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.cv1X43CoC-EW5gPBVagAqIIwsPQf4oT_0 2024-09-12T01:07:26.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15479006024369739397', time=2024-09-12T02:55:32.308830+0000, chain.objs.size()=1 2024-09-12T01:07:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ii0_NDGdnFmSm7PQ9H2bgGgWpyia8DC_0 2024-09-12T01:07:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16457071091160529703', time=2024-09-12T02:55:32.319643+0000, chain.objs.size()=1 2024-09-12T01:07:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7zX8GirfW8KcsgzbMcqg14iHv6HXlxw_0 2024-09-12T01:07:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6476053257929207213', time=2024-09-12T02:55:32.336331+0000, chain.objs.size()=1 2024-09-12T01:07:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-WDIQc36YV8SHRMAp9dmwZOfrhBBXYK_0 2024-09-12T01:07:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2452676730260001532', time=2024-09-12T02:55:32.351016+0000, chain.objs.size()=1 2024-09-12T01:07:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8yBMjgntzhXz9zQAt2f61xJzlULslQH_0 2024-09-12T01:07:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12369882422904206247', time=2024-09-12T02:55:32.354471+0000, chain.objs.size()=1 2024-09-12T01:07:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5f02mBzbOtVWy91jjOvqsSvMUBuAGip_0 2024-09-12T01:07:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.478019779554177350', time=2024-09-12T02:55:32.362769+0000, chain.objs.size()=1 2024-09-12T01:07:26.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.fWAqaywjfjM9x3962K0aJLR8kZ8T-Xb_0 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2664215671833099383', time=2024-09-12T02:55:32.392688+0000, chain.objs.size()=1 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IKnGGHGXG7Iw1AYbG2vE7MJ2hWT5rAx_0 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4112309475716925895', time=2024-09-12T02:55:32.413397+0000, chain.objs.size()=1 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XacqyZFAn6SHGZNOOGQNIKZToKwi4zk_0 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14490716372911506795', time=2024-09-12T02:55:32.594624+0000, chain.objs.size()=1 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._uK9Nt7cXapMxoafNXZ0wx8iA04RC-j_0 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.305207856122639141', time=2024-09-12T02:55:32.621687+0000, chain.objs.size()=1 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xcCXFnFKIqW6mldDiWtkxd8Zq86fBk3_0 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13424247025439514907', time=2024-09-12T02:55:32.745386+0000, chain.objs.size()=1 2024-09-12T01:07:26.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GnsShjMGKQqFCLz9aNUBcVkMwp8GKfx_0 2024-09-12T01:07:26.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7214526320585090737', time=2024-09-12T02:55:32.902297+0000, chain.objs.size()=1 2024-09-12T01:07:26.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hyiNdrr3T9FNjsgJN1o_VY3T2bhEOO2_0 2024-09-12T01:07:26.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13057015720512187487', time=2024-09-12T02:55:32.950387+0000, chain.objs.size()=1 2024-09-12T01:07:26.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pWSr0mGL0SpbtRPZi08-oAGkkp8ab07_0 2024-09-12T01:07:26.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7299622256558201972', time=2024-09-12T02:55:32.967663+0000, chain.objs.size()=1 2024-09-12T01:07:26.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._jmBb8rLLac2xbL3FUnFwcrg-wNnU6Q_0 2024-09-12T01:07:26.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13633472370284441478', time=2024-09-12T02:55:33.176452+0000, chain.objs.size()=1 2024-09-12T01:07:26.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.AWOsvmQn5CjnQgYHP3roe2RbdoF92nm_0 2024-09-12T01:07:26.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7170560361270594272', time=2024-09-12T02:55:33.204100+0000, chain.objs.size()=1 2024-09-12T01:07:26.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tM_n97wpoGR9sQ58-JuUGhqV4lsX58t_0 2024-09-12T01:07:26.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2486291715915411645', time=2024-09-12T02:55:33.220269+0000, chain.objs.size()=1 2024-09-12T01:07:26.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.JSia5cKcULrDT9DCtXKyqmJr0h-IjG6_0 2024-09-12T01:07:26.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11760615599778862012', time=2024-09-12T02:55:33.299427+0000, chain.objs.size()=1 2024-09-12T01:07:26.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.I41eOkCVQnXcOj1yP7KyapuqAwbG0bZ_0 2024-09-12T01:07:26.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2019816666867236029', time=2024-09-12T02:55:33.319027+0000, chain.objs.size()=1 2024-09-12T01:07:26.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rjEYwBhJcLFbeaXioruMjlT1uUAAMfc_0 2024-09-12T01:07:26.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14625138867420214221', time=2024-09-12T02:55:54.551455+0000, chain.objs.size()=1 2024-09-12T01:07:26.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fyELrEsE92jqfwN5CP_OC54lABLx5PO_0 2024-09-12T01:07:26.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11091316632003998638', time=2024-09-12T02:55:54.618604+0000, chain.objs.size()=1 2024-09-12T01:07:26.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.z0BV4Yyn2Heo_-GGaI02SvSa0SkGGlK_0 2024-09-12T01:07:26.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.950296386976503512', time=2024-09-12T02:55:54.691136+0000, chain.objs.size()=1 2024-09-12T01:07:26.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eOBuOdRJQS0FG6QDCV_gblCmXgTOdL2_0 2024-09-12T01:07:26.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7162707441743605988', time=2024-09-12T02:55:54.838023+0000, chain.objs.size()=1 2024-09-12T01:07:26.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4F04OO5ShyigqycuJA8NHG4WmIjImNo_0 2024-09-12T01:07:26.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8250125110670758263', time=2024-09-12T02:55:54.943616+0000, chain.objs.size()=1 2024-09-12T01:07:26.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.njRrMqfwHGGOQq6Th0bGQMjJmJ74KEQ_0 2024-09-12T01:07:26.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13155254060755885637', time=2024-09-12T02:55:54.947867+0000, chain.objs.size()=1 2024-09-12T01:07:26.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZAKgrDAMZmmQuA1HgQCEBx---oKC5yK_0 2024-09-12T01:07:26.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14438985889483651626', time=2024-09-12T02:55:55.010222+0000, chain.objs.size()=1 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.yJI9BAerx7fGMdDs7_420p4SKtdUg0W_0 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2717905362874353154', time=2024-09-12T02:55:55.181999+0000, chain.objs.size()=1 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bFwvkZX41asOoGz-45YGyEtxnPoHy5p_0 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6493067919051871356', time=2024-09-12T02:55:55.214898+0000, chain.objs.size()=1 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TQ6XDp9LmZBJY7QZKJRQu1K_IV_hed-_0 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6634535894392209984', time=2024-09-12T02:55:55.249974+0000, chain.objs.size()=1 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SsnQc0-k0lVCtLtwDgUvMkVZ4mCjbEz_0 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4257094727219705284', time=2024-09-12T02:55:55.274522+0000, chain.objs.size()=1 2024-09-12T01:07:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RReOCXb1JtFGItddXnUIddlsWWfGOpa_0 2024-09-12T01:07:26.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6741225376921620881', time=2024-09-12T02:55:55.332200+0000, chain.objs.size()=1 2024-09-12T01:07:26.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WCzcAofVDwym3Kq__TZOUNDo04pXez5_0 2024-09-12T01:07:26.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7304083497622038051', time=2024-09-12T02:55:55.582458+0000, chain.objs.size()=1 2024-09-12T01:07:26.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YjHWifHCdb42omGh4qjdgRNLK0wgUN8_0 2024-09-12T01:07:26.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6447588483023016869', time=2024-09-12T02:55:55.866023+0000, chain.objs.size()=1 2024-09-12T01:07:26.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._UAxW0wzoL8oCYPJUq-jUaq8ZzC01wF_0 2024-09-12T01:07:26.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10111091903465008545', time=2024-09-12T02:55:55.926848+0000, chain.objs.size()=1 2024-09-12T01:07:26.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2acjqSdwoH7tpt9bvPIDBaehqxGI1Xo_0 2024-09-12T01:07:26.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2220274491069661663', time=2024-09-12T02:55:55.985041+0000, chain.objs.size()=1 2024-09-12T01:07:26.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6cg3tnLbcJQ1iE9qfHaiuvKlLbt9QTN_0 2024-09-12T01:07:26.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47500 2024-09-12T01:07:26.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T01:07:26.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3593158486838907365', time=2024-09-12T02:55:56.019425+0000, chain.objs.size()=1 2024-09-12T01:07:26.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DDSn1S7w9Yp__uZ6uIrHhviA0B-5aYV_0 2024-09-12T01:07:26.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12464933462302864202', time=2024-09-12T02:55:56.160089+0000, chain.objs.size()=1 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2UA17kszI_X_PmlJtRhsYuFcJrCSg4i_0 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3137242933743821207', time=2024-09-12T02:55:56.249263+0000, chain.objs.size()=1 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Sld8lilwSr9pQUESiN1Blmu9eYId8gt_0 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16656206435191420294', time=2024-09-12T02:55:56.298319+0000, chain.objs.size()=1 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NEiJMmuHTvTQXn_G4FOfHfWZCF-ZPbQ_0 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15588999107778739963', time=2024-09-12T02:55:56.573746+0000, chain.objs.size()=1 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1tS0CD9gUR3Z2toedJhXvm3dPbMkzxV_0 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3571740161287035720', time=2024-09-12T02:55:56.603723+0000, chain.objs.size()=1 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.G2g740md8gdXjDwOO7dY4decbO-63Zp_0 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13643624751691636202', time=2024-09-12T02:55:56.612012+0000, chain.objs.size()=1 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ky4fZxTRk8qxHa1XqUD4mG3tltck-TJ_0 2024-09-12T01:07:26.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8337707278785956995', time=2024-09-12T02:55:56.627684+0000, chain.objs.size()=1 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.021dU--Yoq4OruO7uk4ka0h4ECTsV0W_0 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2955560693118114663', time=2024-09-12T02:55:56.774101+0000, chain.objs.size()=1 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.T4mGfmoDXk_Lm5ES5H07HIo7Ld69yDk_0 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14009143130800050032', time=2024-09-12T02:55:56.836700+0000, chain.objs.size()=1 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.KQuzyKvVF0EnslaOuXmhVQPZ6Yk9CzZ_0 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8518613245242863587', time=2024-09-12T02:55:56.837775+0000, chain.objs.size()=1 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.tesu9chNXjBux_v_nBytrZcgdCCK0B7_0 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6587728905795733662', time=2024-09-12T02:55:56.923214+0000, chain.objs.size()=1 2024-09-12T01:07:26.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IvN1XcmMwyp-Pzjr7HjBZNFoNU9cd5h_0 2024-09-12T01:07:26.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15603080601112488284', time=2024-09-12T02:57:36.804504+0000, chain.objs.size()=1 2024-09-12T01:07:26.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.466__shadow_.mf9-GhoyFWVqO8PIuXs5xnyUytV5sBX_0 2024-09-12T01:07:26.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1373631171306907504', time=2024-09-12T02:57:45.050377+0000, chain.objs.size()=1 2024-09-12T01:07:26.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.wrk1oM_4xG_8Zxhi-qxDMLQpwREnQ_O_0 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9689894519893108542', time=2024-09-12T02:57:47.453070+0000, chain.objs.size()=1 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.486__shadow_.dUwj8YJ43zZkfYq4Oeu9SoUgDxJAqJT_0 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2492243992313855090', time=2024-09-12T02:57:58.080722+0000, chain.objs.size()=1 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.503__shadow:9LDvWGdmQQQ9l1.sKobe4w5aXdN6o1o_.IhjeMTusnwtlTOOsBJp3rTYo2SIwJCh_0 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12388431696440670032', time=2024-09-12T02:57:58.215049+0000, chain.objs.size()=1 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.503__shadow:9LDvWGdmQQQ9l1.sKobe4w5aXdN6o1o_.IhjeMTusnwtlTOOsBJp3rTYo2SIwJCh_0 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.341332075797488834', time=2024-09-12T02:58:02.000342+0000, chain.objs.size()=6 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.1 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.2 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.3 2024-09-12T01:07:26.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.4 2024-09-12T01:07:26.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.5 2024-09-12T01:07:26.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.6 2024-09-12T01:07:26.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11913673458969710346', time=2024-09-12T02:59:33.300239+0000, chain.objs.size()=1 2024-09-12T01:07:26.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.553__shadow_.8Spwo41s6tr8A_6jCsg8XbdcidzosR-_0 2024-09-12T01:07:26.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2021215376862368019', time=2024-09-12T02:59:39.683668+0000, chain.objs.size()=2 2024-09-12T01:07:26.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.558__shadow_.kosCJDimA3ZLAOf0zGl4hOOeU9BJv6s_0 2024-09-12T01:07:26.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.558__shadow_.kosCJDimA3ZLAOf0zGl4hOOeU9BJv6s_1 2024-09-12T01:07:26.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11441472134323264552', time=2024-09-12T02:59:40.591139+0000, chain.objs.size()=1 2024-09-12T01:07:26.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.559__shadow_.XcE4Ep0Wn4m4Tb6j7XDfcTtQq4bV9i1_0 2024-09-12T01:07:26.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6998696585059128223', time=2024-09-12T03:00:08.505241+0000, chain.objs.size()=1 2024-09-12T01:07:26.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.575__shadow_.eTmwuV0cTqsqFg7edfq2UNRtbpEBIMm_0 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3400470488928425280', time=2024-09-12T03:00:27.163207+0000, chain.objs.size()=1 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:p8LirBGcaLmuRVI9lwPnteF7HKEpc0l_.ptcTkEL_wh4OLVrxkg2FcxTrPaTzE36_0 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.721469139035501187', time=2024-09-12T03:00:47.916752+0000, chain.objs.size()=1 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.596__shadow_.Gu_RsmJovyTWy0Ue7XZ6W1MBAfaT_9q_0 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7181242657742104435', time=2024-09-12T03:03:51.726219+0000, chain.objs.size()=1 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.663__shadow_.DVFn0C_BI1VYK6xYxAJZEI5m927my5__0 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6386690264325738324', time=2024-09-12T03:03:55.753790+0000, chain.objs.size()=1 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.668__shadow_.FGVPTQFyuHKidk_o4LkeB5_mgJL9Myf_0 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4464624921106950939', time=2024-09-12T03:04:45.769472+0000, chain.objs.size()=1 2024-09-12T01:07:26.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.718__shadow_.v5iV6BPs-dx9T7HMYaHQWL1xVuUA0K6_0 2024-09-12T01:07:26.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:07:26.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58306' 2024-09-12T01:07:26.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Q6eW41Cxb4UOXaKVa80c6puuNPZHlWj', time=2024-09-12T02:51:32.210030+0000, chain.objs.size()=3 2024-09-12T01:07:26.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.MgTg8NqOX0csYIQ5iLnqCuT4G-KGZ4C_0 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.MgTg8NqOX0csYIQ5iLnqCuT4G-KGZ4C_1 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.MgTg8NqOX0csYIQ5iLnqCuT4G-KGZ4C_2 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5656412986824201770', time=2024-09-12T02:53:42.663264+0000, chain.objs.size()=1 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.236__shadow_.CCbdsRCNdxUYT4qPuOR3n-NVTKTrbSu_0 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14437197539153810963', time=2024-09-12T02:53:52.185829+0000, chain.objs.size()=1 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.247__shadow_.ebNjy3noEFwmjDrv9H62Vv2seY6uFzl_0 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7049898040340338236', time=2024-09-12T02:53:52.882034+0000, chain.objs.size()=1 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.248__shadow_.dptkr4OmlQBAWJy7mBUBs-Q1TNjY2A-_0 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11620641140136170771', time=2024-09-12T02:54:23.010575+0000, chain.objs.size()=1 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Lt4kTqfHuJ4Rzzfukgk-AUuXH7JyZo9_0 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11089436529717286744', time=2024-09-12T02:54:23.130170+0000, chain.objs.size()=1 2024-09-12T01:07:26.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IOjcrLde2e_gxXECa2vaRyXK5RXaq1O_0 2024-09-12T01:07:26.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9817632893471427882', time=2024-09-12T02:54:23.152486+0000, chain.objs.size()=1 2024-09-12T01:07:26.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.76qY2WJzmSJxDFLK8TzPSS8qV8ohPFO_0 2024-09-12T01:07:26.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17434371656380020209', time=2024-09-12T02:54:23.451129+0000, chain.objs.size()=1 2024-09-12T01:07:26.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jo4UUdwwERfjxTS8oMXLxjQXBSYdbZ8_0 2024-09-12T01:07:26.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16671753187411855428', time=2024-09-12T02:54:23.590887+0000, chain.objs.size()=1 2024-09-12T01:07:26.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.sCh8nQC0ttE9nI_HaWvH8SWJwpiLuvj_0 2024-09-12T01:07:26.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16469157470673305262', time=2024-09-12T02:54:23.604750+0000, chain.objs.size()=1 2024-09-12T01:07:26.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eMEM6CDbRe4bXU8J6qHNqeqmcCMHKUh_0 2024-09-12T01:07:26.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.25633417966267605', time=2024-09-12T02:54:23.729097+0000, chain.objs.size()=1 2024-09-12T01:07:26.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.f-oUs102iildxUriByfoI7xt-crPekC_0 2024-09-12T01:07:26.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.99995450884465828', time=2024-09-12T02:54:24.040925+0000, chain.objs.size()=1 2024-09-12T01:07:26.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qmD1EilPHSXqVolN8mD3cjBw6EPmckg_0 2024-09-12T01:07:26.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15140023157300433942', time=2024-09-12T02:54:24.068653+0000, chain.objs.size()=1 2024-09-12T01:07:26.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VfRP9bg3HwyFJcPqVl1Un4GxC0bOPW1_0 2024-09-12T01:07:26.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7114996918101484934', time=2024-09-12T02:54:24.128134+0000, chain.objs.size()=1 2024-09-12T01:07:26.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0MgKmENGCZC8aIRD6zBCJnvXoePk1LO_0 2024-09-12T01:07:26.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9042039460842979789', time=2024-09-12T02:54:24.156819+0000, chain.objs.size()=1 2024-09-12T01:07:26.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mO2_vPbRHdmN5iDq9MCn64P4jJcCeJd_0 2024-09-12T01:07:26.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11011155465239661306', time=2024-09-12T02:54:24.186045+0000, chain.objs.size()=1 2024-09-12T01:07:26.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.i_n3ZFmSxR3QnZ6Z45CU3jGJDY-IqQm_0 2024-09-12T01:07:26.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7968842907139028083', time=2024-09-12T02:54:24.191743+0000, chain.objs.size()=1 2024-09-12T01:07:26.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0vW3QltRcDCw0kC2Kdq6uKE1nNnDMrJ_0 2024-09-12T01:07:26.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14119741794304327039', time=2024-09-12T02:54:24.197007+0000, chain.objs.size()=1 2024-09-12T01:07:26.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dxUPSIP7zk3wyZsdgXmoEYtQRN6i-T4_0 2024-09-12T01:07:26.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.228434521648142691', time=2024-09-12T02:54:24.380143+0000, chain.objs.size()=1 2024-09-12T01:07:26.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WAOqy2RkmNFQwOgtzBE30rO7lhNKL9z_0 2024-09-12T01:07:26.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13794810413544940135', time=2024-09-12T02:54:24.447827+0000, chain.objs.size()=1 2024-09-12T01:07:26.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bzed1M18lVM83DZvqpQLnaKWn4QyCnr_0 2024-09-12T01:07:26.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15145471030939960394', time=2024-09-12T02:54:24.751209+0000, chain.objs.size()=1 2024-09-12T01:07:26.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.UNZpgzcXbeEzF4Q2uyp5Kasor-amS-9_0 2024-09-12T01:07:26.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7364853310824713561', time=2024-09-12T02:54:24.957407+0000, chain.objs.size()=1 2024-09-12T01:07:26.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.e8UFGv7JHrcRKQXG4AjsPLHSxGsMXnU_0 2024-09-12T01:07:26.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17618783606306707643', time=2024-09-12T02:54:25.144456+0000, chain.objs.size()=1 2024-09-12T01:07:26.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.o2OhHPanQXErcqfGXhDg0dhkwfpQ75__0 2024-09-12T01:07:26.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6157257898002056953', time=2024-09-12T02:54:25.168016+0000, chain.objs.size()=1 2024-09-12T01:07:26.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FQh004CQI2Nl063k97kWOvlObGZp_T0_0 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14947976542612797520', time=2024-09-12T02:54:25.194036+0000, chain.objs.size()=1 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LS0Pr0c_HsCGriwLzIXUMlYWruK33bM_0 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12442449332276118239', time=2024-09-12T02:54:25.207407+0000, chain.objs.size()=1 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MFbG4KoPAxjUBYcBqymiynEX-smXJZq_0 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12992129917746021061', time=2024-09-12T02:54:25.224874+0000, chain.objs.size()=1 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.j008F0n9-3FpuDXrHq_APLskhsbDrTS_0 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15339839649820058397', time=2024-09-12T02:54:25.268800+0000, chain.objs.size()=1 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WNY6D9YOR6FTJ6cSmURaWSnczl4fb_j_0 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7780889018142475228', time=2024-09-12T02:54:25.329648+0000, chain.objs.size()=1 2024-09-12T01:07:26.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zAG7jZY4Bz8drYRAC2WL0v2CwD1nujH_0 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5874667501619305539', time=2024-09-12T02:54:25.341614+0000, chain.objs.size()=1 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8bPHatcrkdZbto5xDCgB2VWGCEboTo3_0 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1328425610305841819', time=2024-09-12T02:54:25.563352+0000, chain.objs.size()=1 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kOFpPV_LhvCZgR3Ss3rzxStd6CUISkM_0 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14131768436797001497', time=2024-09-12T02:54:25.574984+0000, chain.objs.size()=1 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1RNHspQZKZl4IEEG-QGN_peJV4YuS3N_0 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3180739312019246074', time=2024-09-12T02:54:25.602472+0000, chain.objs.size()=1 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NITMAiQFtODkCE82220760ZDq-vKoXY_0 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17162810154451908152', time=2024-09-12T02:54:25.644925+0000, chain.objs.size()=1 2024-09-12T01:07:26.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8yRFLoL_si_dj71e5uxSrOzaYDqyFti_0 2024-09-12T01:07:26.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15724314696185889635', time=2024-09-12T02:54:25.757349+0000, chain.objs.size()=1 2024-09-12T01:07:26.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LSGCpQJHh7hxhGbMZmtt_zAUcRi_S0S_0 2024-09-12T01:07:26.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3650665340608083037', time=2024-09-12T02:54:25.864188+0000, chain.objs.size()=1 2024-09-12T01:07:26.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rAhZ_oSEbbfMt2wBu8OVj_APUjoxqjv_0 2024-09-12T01:07:26.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12714320490884566984', time=2024-09-12T02:54:25.910605+0000, chain.objs.size()=1 2024-09-12T01:07:26.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kfQg0DjqBXEh4zHK6QLwOivKsyElLUX_0 2024-09-12T01:07:26.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16049231001492079672', time=2024-09-12T02:54:25.953247+0000, chain.objs.size()=1 2024-09-12T01:07:26.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cRAygwVMEonoxscnwnJ6z1nhgGCn-uA_0 2024-09-12T01:07:26.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5276757957980404768', time=2024-09-12T02:54:25.964287+0000, chain.objs.size()=1 2024-09-12T01:07:26.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2JlhGqX8-Swmi0ZnOzAZXSs_cD0wu9b_0 2024-09-12T01:07:26.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6693255695072332240', time=2024-09-12T02:54:26.029006+0000, chain.objs.size()=1 2024-09-12T01:07:26.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5NeB_GlYXdhd3IAvfDv1k9E-pbtAxSV_0 2024-09-12T01:07:26.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12761102620015799378', time=2024-09-12T02:54:26.035150+0000, chain.objs.size()=1 2024-09-12T01:07:26.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PSlspvo0GINDzSYgihb6kZ_Y4Q1U6ts_0 2024-09-12T01:07:26.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12272749706088798747', time=2024-09-12T02:54:37.645712+0000, chain.objs.size()=1 2024-09-12T01:07:26.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.279__shadow_.zak0K8AvxGqo99DrKnZ6XMxkWit2IYx_0 2024-09-12T01:07:26.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17379888399496318930', time=2024-09-12T02:54:47.939369+0000, chain.objs.size()=1 2024-09-12T01:07:26.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.jDpWtJKD03uoFYyOnmAQFObR31BkY9D_0 2024-09-12T01:07:26.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9767051934823640848', time=2024-09-12T02:54:49.389763+0000, chain.objs.size()=1 2024-09-12T01:07:26.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.xvAWl40WQuKNyvnFUJR3LWQqK3UQtsW_0 2024-09-12T01:07:26.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9818892859904792901', time=2024-09-12T02:55:30.883698+0000, chain.objs.size()=1 2024-09-12T01:07:26.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Nd7LmWjI_6hvQhfQpegTM9UgcrX5PLP_0 2024-09-12T01:07:26.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3832313401616579633', time=2024-09-12T02:55:30.941527+0000, chain.objs.size()=1 2024-09-12T01:07:26.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.s-_TDQQANJCSonHZyQXXdHG0TGQwfOQ_0 2024-09-12T01:07:26.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12900178894036457504', time=2024-09-12T02:55:30.966422+0000, chain.objs.size()=1 2024-09-12T01:07:26.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ET8Zaj6HfJOmQd7bHH6RoWpJn_vXT5t_0 2024-09-12T01:07:26.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12681492121760138471', time=2024-09-12T02:55:31.004250+0000, chain.objs.size()=1 2024-09-12T01:07:26.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1yOUuTo4NUVZ0m9-_2UXsJ5Ujonssxl_0 2024-09-12T01:07:26.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12528364707177117920', time=2024-09-12T02:55:31.283207+0000, chain.objs.size()=1 2024-09-12T01:07:26.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mW4o5w6usQhiexkEUjYpXt5dEikpltI_0 2024-09-12T01:07:26.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1594466461951558901', time=2024-09-12T02:55:31.307950+0000, chain.objs.size()=1 2024-09-12T01:07:26.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tPxXxw35FiYg5TxYIVIgupC-HIC-twj_0 2024-09-12T01:07:26.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8479187499173861823', time=2024-09-12T02:55:31.313814+0000, chain.objs.size()=1 2024-09-12T01:07:26.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._shQUH8Rglt_5EmE3P4mELGp8CVRHVl_0 2024-09-12T01:07:26.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6719896861986227761', time=2024-09-12T02:55:31.328886+0000, chain.objs.size()=1 2024-09-12T01:07:26.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lkDPLhyD8iEQs2ZoZ204exoYTd-Wici_0 2024-09-12T01:07:26.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2955152285776930417', time=2024-09-12T02:55:31.619526+0000, chain.objs.size()=1 2024-09-12T01:07:26.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.o86ZZ1OH1CfFDge079_Ho3ZNZgukIhK_0 2024-09-12T01:07:26.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6025562370436251936', time=2024-09-12T02:55:31.651799+0000, chain.objs.size()=1 2024-09-12T01:07:26.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9y9mAcXk9aIx2axY4C7niDKL6eefKRj_0 2024-09-12T01:07:26.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6028483370487601060', time=2024-09-12T02:55:31.655894+0000, chain.objs.size()=1 2024-09-12T01:07:26.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.27osqoI0u_YG1cQ9XaIpsc71j0QGS31_0 2024-09-12T01:07:26.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5634006080913745687', time=2024-09-12T02:55:31.898629+0000, chain.objs.size()=1 2024-09-12T01:07:26.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8ab1N6sK4NclDGQFEqJ-p_zXVz_x07L_0 2024-09-12T01:07:26.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3327366951405781771', time=2024-09-12T02:55:31.906206+0000, chain.objs.size()=1 2024-09-12T01:07:26.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1V2RwzEI0ElqqaOEeWo6HfQ-qmM3AOs_0 2024-09-12T01:07:26.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14665081813203332405', time=2024-09-12T02:55:31.972770+0000, chain.objs.size()=1 2024-09-12T01:07:26.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XYZtQSORR9su_v9dzfsWmWEyXI_WgDD_0 2024-09-12T01:07:26.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8539192194472607522', time=2024-09-12T02:55:32.001353+0000, chain.objs.size()=1 2024-09-12T01:07:26.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hiArk3_3Xsa7DRFGHIFR8L6Fm9Xfuhb_0 2024-09-12T01:07:26.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11853058433304686170', time=2024-09-12T02:55:32.011001+0000, chain.objs.size()=1 2024-09-12T01:07:26.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.V5lH7B6AJHawQNmka7CER40c3TOWin1_0 2024-09-12T01:07:26.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17147834076854403203', time=2024-09-12T02:55:32.016392+0000, chain.objs.size()=1 2024-09-12T01:07:26.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.700+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kF2qrzUhJY3Kq6iy5S-t_dG3jPMe7at_0 2024-09-12T01:07:26.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9662230923718471591', time=2024-09-12T02:55:32.083963+0000, chain.objs.size()=1 2024-09-12T01:07:26.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.u--yy_s5Gm5QBp0c3KBm7njmXpD6lZX_0 2024-09-12T01:07:26.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7267315212496276898', time=2024-09-12T02:55:32.084714+0000, chain.objs.size()=1 2024-09-12T01:07:26.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RmZ65w7AyCacGSSBUNEZPi41Zk_FVP4_0 2024-09-12T01:07:26.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2377221080588545382', time=2024-09-12T02:55:32.329766+0000, chain.objs.size()=1 2024-09-12T01:07:26.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Hk9juuGR-8SOUt9V-y2I6cSTu7sI7Ee_0 2024-09-12T01:07:26.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16257781487877099216', time=2024-09-12T02:55:32.349797+0000, chain.objs.size()=1 2024-09-12T01:07:26.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.biGpsYRCxE4ttMo9tFf5owZHCzAPVWr_0 2024-09-12T01:07:26.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1583007764608738865', time=2024-09-12T02:55:32.391483+0000, chain.objs.size()=1 2024-09-12T01:07:26.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.aF59ZPMYuOS63dtI9HLNBOK4UAQC0KL_0 2024-09-12T01:07:26.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5851992783074856279', time=2024-09-12T02:55:32.406887+0000, chain.objs.size()=1 2024-09-12T01:07:26.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rrMdDMEaX0a2OwHL28oofLBUspjKQif_0 2024-09-12T01:07:26.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9477755167258324621', time=2024-09-12T02:55:32.419053+0000, chain.objs.size()=1 2024-09-12T01:07:26.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Ja_X3eOvc3QKC3T6s6Wl73BbX2V0Z4S_0 2024-09-12T01:07:26.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7326708900966084619', time=2024-09-12T02:55:32.446517+0000, chain.objs.size()=1 2024-09-12T01:07:26.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pgnASHdTVd1EPucMXmbBl3SoKJgWLPI_0 2024-09-12T01:07:26.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16011579404332439688', time=2024-09-12T02:55:32.596495+0000, chain.objs.size()=1 2024-09-12T01:07:26.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Z5aRIk3ngOatQvZ7RytwcYTDhZ4nQoC_0 2024-09-12T01:07:26.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18393626062321692123', time=2024-09-12T02:55:32.727142+0000, chain.objs.size()=1 2024-09-12T01:07:26.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5h5IWBU5Bzns3n91f47ikGxVvyyyckZ_0 2024-09-12T01:07:26.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15566452045251202029', time=2024-09-12T02:55:32.738364+0000, chain.objs.size()=1 2024-09-12T01:07:26.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.po_ndk3H5GWLYzEc_aWm9byNTBeFosl_0 2024-09-12T01:07:26.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4701650342222803971', time=2024-09-12T02:55:32.874533+0000, chain.objs.size()=1 2024-09-12T01:07:26.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.v0r_9KUWWdeRh3rhn6VCxFv48ywQ_5b_0 2024-09-12T01:07:26.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4027325207619887013', time=2024-09-12T02:55:32.922049+0000, chain.objs.size()=1 2024-09-12T01:07:26.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.704+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.EQGitIDCLDb-yA1OHtRox4hHaCd8z2m_0 2024-09-12T01:07:26.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15435026875107443800', time=2024-09-12T02:55:33.022857+0000, chain.objs.size()=1 2024-09-12T01:07:26.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ENCRrhr7NMCfWZ7ypFZywSs2tVUNgBb_0 2024-09-12T01:07:26.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7092157516337263304', time=2024-09-12T02:55:33.070345+0000, chain.objs.size()=1 2024-09-12T01:07:26.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZT_yox2xRcOjN0GPnLorDTFVj3QEjQd_0 2024-09-12T01:07:26.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.792495397222339701', time=2024-09-12T02:55:33.196449+0000, chain.objs.size()=1 2024-09-12T01:07:26.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.I3KgwnKD42Iw59Jt404URivvep0vHB6_0 2024-09-12T01:07:26.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14900373666725900803', time=2024-09-12T02:55:33.210165+0000, chain.objs.size()=1 2024-09-12T01:07:26.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mRjxMCQSuXOK5xB0kmcHwgp2bbStqzb_0 2024-09-12T01:07:26.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10637667714097194362', time=2024-09-12T02:55:33.216791+0000, chain.objs.size()=1 2024-09-12T01:07:26.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dCj5aZcKOl1mUJB1XXy30OgMphl5fGy_0 2024-09-12T01:07:26.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11431018145067430984', time=2024-09-12T02:55:33.333800+0000, chain.objs.size()=1 2024-09-12T01:07:26.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.trYbPdawCq7obE0nqmVrJJec3a-mEbK_0 2024-09-12T01:07:26.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5903786491063531415', time=2024-09-12T02:55:54.556875+0000, chain.objs.size()=1 2024-09-12T01:07:26.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.708+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.c3IZ-SnGeaB-ha4BJfpA9tGIVCsYDUj_0 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1256604718968830656', time=2024-09-12T02:55:54.597744+0000, chain.objs.size()=1 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XBWjILeQegRvwV5yU2vk0DZhk733Mvw_0 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17366236172175654844', time=2024-09-12T02:55:54.611674+0000, chain.objs.size()=1 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UD-YLXY3m7CjRQdH9XU8GFmAaWV5Pfv_0 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15468185877696633905', time=2024-09-12T02:55:54.623557+0000, chain.objs.size()=1 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lzPJA5MgmVUeSIJXQDNKZboJeOqxEkY_0 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12123396038217041796', time=2024-09-12T02:55:54.686652+0000, chain.objs.size()=1 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Zqc3M_ds-rv68RgkASFUNwtx5-EI0cH_0 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3078024006713378173', time=2024-09-12T02:55:54.831906+0000, chain.objs.size()=1 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jfUfUEHCdHy5HNRK9lpCT4vsHQH8-yV_0 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8108411804878652109', time=2024-09-12T02:55:54.894043+0000, chain.objs.size()=1 2024-09-12T01:07:26.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PWf4c35mTCWtH-xecAXw8yJTKtKZ4fZ_0 2024-09-12T01:07:26.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4739839014213286502', time=2024-09-12T02:55:54.965898+0000, chain.objs.size()=1 2024-09-12T01:07:26.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Yf5C40DfoPGTn8YiDJiPLTdCBTxh9uB_0 2024-09-12T01:07:26.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11942861439013506106', time=2024-09-12T02:55:55.205761+0000, chain.objs.size()=1 2024-09-12T01:07:26.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kmUNintyxHNJ6F3u9MAnnHfZjqO5qA4_0 2024-09-12T01:07:26.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3309585727111366142', time=2024-09-12T02:55:55.233879+0000, chain.objs.size()=1 2024-09-12T01:07:26.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XtKJWiYxAOU2TKstRUA-JY0H-wdWoR4_0 2024-09-12T01:07:26.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5886315269197042213', time=2024-09-12T02:55:55.247582+0000, chain.objs.size()=1 2024-09-12T01:07:26.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1zc6JKWTUeh_h4cuI-95jjnm5GgQ8Ms_0 2024-09-12T01:07:26.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.270149595542696382', time=2024-09-12T02:55:55.274052+0000, chain.objs.size()=1 2024-09-12T01:07:26.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.712+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xa0G0ULOcC_y39FEFrDGBgxfY3Zwa0Z_0 2024-09-12T01:07:26.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15619357842792048604', time=2024-09-12T02:55:55.523543+0000, chain.objs.size()=1 2024-09-12T01:07:26.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.maI2FBLpL5Rt-Wgj8O0tbks35epkcJR_0 2024-09-12T01:07:26.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5475539325216609657', time=2024-09-12T02:55:55.549773+0000, chain.objs.size()=1 2024-09-12T01:07:26.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gHoI5BYIiIUhGayWHS4pBXAJzla738J_0 2024-09-12T01:07:26.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14973454962586352591', time=2024-09-12T02:55:55.571716+0000, chain.objs.size()=1 2024-09-12T01:07:26.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dWX5h4kBKZzCsJs6e1Ay9Jm3bzP2EyU_0 2024-09-12T01:07:26.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4199046649648828675', time=2024-09-12T02:55:55.626027+0000, chain.objs.size()=1 2024-09-12T01:07:26.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._rFxsXjU1_mOmhLsQwsenldZrgobFRJ_0 2024-09-12T01:07:26.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4339224593549460284', time=2024-09-12T02:55:55.645445+0000, chain.objs.size()=1 2024-09-12T01:07:26.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5vMsNl5-80zwbLXFHbX-0WZxIpuVk2a_0 2024-09-12T01:07:26.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17568059574736223584', time=2024-09-12T02:55:55.646205+0000, chain.objs.size()=1 2024-09-12T01:07:26.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.w5_kKieTa3Bl0Y3tasBipeO3lofJxFg_0 2024-09-12T01:07:26.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4066394752083716961', time=2024-09-12T02:55:55.966014+0000, chain.objs.size()=1 2024-09-12T01:07:26.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.716+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.j-sDIvsmmpdJRHP5rYx5g7AlCe4m3Cf_0 2024-09-12T01:07:26.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.720+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1854592420886718362', time=2024-09-12T02:55:55.989224+0000, chain.objs.size()=1 2024-09-12T01:07:26.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.720+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MEmH4CP9XMG8D6UZ8TFS9yY9_fy9Pki_0 2024-09-12T01:07:26.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/58306 2024-09-12T01:07:26.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:07:26.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6625381364103055299', time=2024-09-12T02:55:56.200135+0000, chain.objs.size()=1 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-xGCgNkaSSIgDufs2CDFU6xEOY9J3aA_0 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15242922312267583626', time=2024-09-12T02:55:56.305198+0000, chain.objs.size()=1 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.u8cNQCCBnjFO2te6dljZ3V2LqLw7Hrc_0 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17776960153087626159', time=2024-09-12T02:55:56.353213+0000, chain.objs.size()=1 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eRb9ckakg09tQ0wsyjVF6YgpBho86aT_0 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3823843964774490973', time=2024-09-12T02:55:56.492306+0000, chain.objs.size()=1 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nxw9vv36cLlVn_cbPfIfoyVmoJa38v0_0 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18186362435518210517', time=2024-09-12T02:55:56.550229+0000, chain.objs.size()=1 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.l-eHt2ieDl6f9F3GPh6VWr3zoLJZ67n_0 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3508461502762485817', time=2024-09-12T02:55:56.589152+0000, chain.objs.size()=1 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.CwL0eD9xdlfi4-xZT1VSyzcsL3Eac3e_0 2024-09-12T01:07:26.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2991498818993709188', time=2024-09-12T02:55:56.598445+0000, chain.objs.size()=1 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kgbE3TQ_ddXRo0GDSltfDrJRjMYOiva_0 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14883169022680644303', time=2024-09-12T02:55:56.617439+0000, chain.objs.size()=1 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DGP5VT3kbEbP3rNIUTp8C2-sa3592yb_0 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3323111896155439128', time=2024-09-12T02:56:27.718930+0000, chain.objs.size()=1 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.374__shadow_.ZQafUWoghng9Kf95IMgdOFN9lythCd5_0 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10718702314393326725', time=2024-09-12T02:56:43.127498+0000, chain.objs.size()=1 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.394__shadow:ImaMaM58twugnblH2Z51P1XswFFL-Px_.xKVi5rKbHh4NT_AiBsdsApj-MdexFlK_0 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.20305583159579300', time=2024-09-12T02:57:09.608166+0000, chain.objs.size()=1 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.433__shadow_.3rJOWD59W8zS2Ahi8IFS_lr-2znrPAI_0 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.508182409121118937', time=2024-09-12T02:57:15.004419+0000, chain.objs.size()=1 2024-09-12T01:07:26.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.724+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.441__shadow_.ocM4P1_s_cwlpLkojbOczQt1BRo4RKH_0 2024-09-12T01:07:26.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3720602227650059205', time=2024-09-12T02:57:31.359869+0000, chain.objs.size()=1 2024-09-12T01:07:26.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.460__shadow_.ZyNnLBRf7MjVQdKBkUL8oImjPhUUAmJ_0 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4953892144089385810', time=2024-09-12T02:57:45.055071+0000, chain.objs.size()=1 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.2aJnDHmtW1MgsGza5pgIUWzr6oDCQHf_0 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8480105014447472391', time=2024-09-12T02:57:45.818093+0000, chain.objs.size()=1 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.484__shadow_.Va8sUhmegE8bKoaDw5jZ6Y6Vqse8Bzw_0 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3213913957001719025', time=2024-09-12T02:57:58.085913+0000, chain.objs.size()=1 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.503__shadow:9LDvWGdmQQQ9l1.sKobe4w5aXdN6o1o_.IhjeMTusnwtlTOOsBJp3rTYo2SIwJCh_0 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2284174842385403672', time=2024-09-12T02:58:38.033960+0000, chain.objs.size()=3 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~gAYt0jUtbd7D0CMiE7kmQD_TSnXgaZv.1 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~gAYt0jUtbd7D0CMiE7kmQD_TSnXgaZv.2 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~gAYt0jUtbd7D0CMiE7kmQD_TSnXgaZv.3 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8240369507889777984', time=2024-09-12T02:59:49.103398+0000, chain.objs.size()=1 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.565__shadow_.6XSu5LCL_mONFJkYFeV9wcZTS4bRTQr_0 2024-09-12T01:07:26.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14947557316164347866', time=2024-09-12T02:59:53.937305+0000, chain.objs.size()=1 2024-09-12T01:07:26.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:zP0WEmtgu13pBFsJajfDv5i7cxqkTQQ_.pmuxYlD4uwpDh5UbclsMO0wkvA30yfM_0 2024-09-12T01:07:26.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16752571274564799072', time=2024-09-12T02:59:54.646033+0000, chain.objs.size()=1 2024-09-12T01:07:26.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:PdsxC5NVgQ7ccd51ZbW92lbblcSZRGL_.Mjml-ZsiTzfW5GSZHV5mJjyzuC_8Sy9_0 2024-09-12T01:07:26.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9887871656799599519', time=2024-09-12T02:59:58.314363+0000, chain.objs.size()=1 2024-09-12T01:07:26.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.728+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:uvxFtMwUVW5.0R0CR5ykRmjI.tFO1LJ_.8bRyZuo5RLqVCbpMrGWd7r73GoIXMMV_0 2024-09-12T01:07:26.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17612978880369388922', time=2024-09-12T03:00:12.986017+0000, chain.objs.size()=1 2024-09-12T01:07:26.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:GvLdGxo4bhF6aMqcSByBYHp7Lgzpqst_.UHPoa8E8s0FRBgzrXdeOSbTrPFzD4WS_0 2024-09-12T01:07:26.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12429530630980219881', time=2024-09-12T03:00:26.169729+0000, chain.objs.size()=1 2024-09-12T01:07:26.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:K1u.Gu9Fr3K.dBdMcB92CxBUuUAdRml_.V-0VLeyyB7rzjjh0PQPtUpWQKJOzEBE_0 2024-09-12T01:07:26.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5668798326317557624', time=2024-09-12T03:00:33.406519+0000, chain.objs.size()=7 2024-09-12T01:07:26.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~yWqR-KMCwu9opFwf0PC9_MtL1pt-fuB.1 2024-09-12T01:07:26.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__shadow_testobj.2~yWqR-KMCwu9opFwf0PC9_MtL1pt-fuB.1_1 2024-09-12T01:07:26.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~yWqR-KMCwu9opFwf0PC9_MtL1pt-fuB.2 2024-09-12T01:07:26.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__shadow_testobj.2~yWqR-KMCwu9opFwf0PC9_MtL1pt-fuB.2_1 2024-09-12T01:07:26.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~yWqR-KMCwu9opFwf0PC9_MtL1pt-fuB.3 2024-09-12T01:07:26.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__shadow_testobj.2~yWqR-KMCwu9opFwf0PC9_MtL1pt-fuB.3_1 2024-09-12T01:07:26.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~yWqR-KMCwu9opFwf0PC9_MtL1pt-fuB.4 2024-09-12T01:07:26.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5641455650463133346', time=2024-09-12T03:00:37.109825+0000, chain.objs.size()=1 2024-09-12T01:07:26.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:W-mewxtomywZEo0nDXvZ4U1mzh.uRP9_.f4gwS6pL03CGlmxsJbvIJxtmuAsKfgt_0 2024-09-12T01:07:26.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5802304082947835274', time=2024-09-12T03:02:11.246728+0000, chain.objs.size()=1 2024-09-12T01:07:26.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.732+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.617__shadow_.ohdjFaJ28t5BqWLRVFxzNpLSrnoeGRf_0 2024-09-12T01:07:26.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.736+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10810929240371089910', time=2024-09-12T03:02:11.402272+0000, chain.objs.size()=1 2024-09-12T01:07:26.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.736+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.617__shadow_.I7Ntm0ATSg-zwsKEQm4SOAho55K2mxX_0 2024-09-12T01:07:26.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.740+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1190233492286723747', time=2024-09-12T03:03:26.816605+0000, chain.objs.size()=1 2024-09-12T01:07:26.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.632__shadow_.fe_ETO9Zpa6o_CI6KJcxwj2KpwL_S0P_0 2024-09-12T01:07:26.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.740+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:07:26.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/63057' 2024-09-12T01:07:26.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_i_qFRz6LagiFD2tEiqyvgP3TZYJuTnx', time=2024-09-12T02:51:34.900736+0000, chain.objs.size()=3 2024-09-12T01:07:26.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.UsAOeDl_Ckg0mYmP3J2t5qeg_ubePAX_0 2024-09-12T01:07:26.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.UsAOeDl_Ckg0mYmP3J2t5qeg_ubePAX_1 2024-09-12T01:07:26.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.UsAOeDl_Ckg0mYmP3J2t5qeg_ubePAX_2 2024-09-12T01:07:26.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9819872689199031364', time=2024-09-12T02:53:40.557410+0000, chain.objs.size()=1 2024-09-12T01:07:26.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.233__shadow_.Hd4T7wPSVp2B4CEnBEsDyyJXQSMGoH0_0 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7848008599339992636', time=2024-09-12T02:53:54.247386+0000, chain.objs.size()=1 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.250__shadow_.HwVtAOxxQpKumNTQ2w-3VIHqMgpzSvP_0 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11995469184966447199', time=2024-09-12T02:53:54.249157+0000, chain.objs.size()=1 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.250__shadow_.ExkSwA9gphEgbcD7k2a2Ce3gPLQQhvU_0 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.546411640952640473', time=2024-09-12T02:54:22.998300+0000, chain.objs.size()=1 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6IMSFmoDaHvv011sORwFKUUDA2ozMSA_0 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2657358814556273789', time=2024-09-12T02:54:23.182430+0000, chain.objs.size()=1 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.w1dY8SP9RkrLP85NbjPg6r4ONilN8WA_0 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6046305549763155852', time=2024-09-12T02:54:23.214706+0000, chain.objs.size()=1 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.sfX6Fe2Q2JbkSiTfZ9xJ1xq5KeYsjQw_0 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6217620205813755283', time=2024-09-12T02:54:23.428871+0000, chain.objs.size()=1 2024-09-12T01:07:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dSzo9wpR94hUY-OfTppYK9pPQF5eRcP_0 2024-09-12T01:07:26.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3189119565315005291', time=2024-09-12T02:54:23.570901+0000, chain.objs.size()=1 2024-09-12T01:07:26.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ixYsNRzXRZ-eXP796upQo0c2GVzpaZG_0 2024-09-12T01:07:26.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12149266533790836048', time=2024-09-12T02:54:24.405591+0000, chain.objs.size()=1 2024-09-12T01:07:26.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.744+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.J8X9zsB8p6rUU8OECdtMHoQ3LsS_909_0 2024-09-12T01:07:26.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4420778249000117265', time=2024-09-12T02:54:24.449985+0000, chain.objs.size()=1 2024-09-12T01:07:26.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.t5pMOn5QK44-eKVDJmo5muFvHTb_9iA_0 2024-09-12T01:07:26.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1377417427208309829', time=2024-09-12T02:54:24.451060+0000, chain.objs.size()=1 2024-09-12T01:07:26.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._MmLPBQxahxp-o-7K5ev5GC--w8nAsq_0 2024-09-12T01:07:26.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.739073864562668846', time=2024-09-12T02:54:24.490536+0000, chain.objs.size()=1 2024-09-12T01:07:26.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NdKtROE-NexPPPX8agI9cG4bvXHubCw_0 2024-09-12T01:07:26.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12963335022627677392', time=2024-09-12T02:54:24.496373+0000, chain.objs.size()=1 2024-09-12T01:07:26.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.p5DGJ1YKS6eWSiLxAAqRmZ-x1ZAN9rv_0 2024-09-12T01:07:26.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1590850977433679589', time=2024-09-12T02:54:24.518663+0000, chain.objs.size()=1 2024-09-12T01:07:26.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.748+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DTdTN0rlmAJNMxQLyKeOzYFRHq1fzxl_0 2024-09-12T01:07:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6238294652241160481', time=2024-09-12T02:54:24.864159+0000, chain.objs.size()=1 2024-09-12T01:07:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.UwmyF4jyvbP7r-WZpBETtrgwvFOUyEO_0 2024-09-12T01:07:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3958548881362790141', time=2024-09-12T02:54:24.870826+0000, chain.objs.size()=1 2024-09-12T01:07:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WzXLdMu7FEx5zOiHO--IoANNAztkNeG_0 2024-09-12T01:07:26.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2285897850718960904', time=2024-09-12T02:54:24.931071+0000, chain.objs.size()=1 2024-09-12T01:07:26.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GQRdkJA_t9zXriokeX6ozfczPAFfYZP_0 2024-09-12T01:07:26.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6966126281064153526', time=2024-09-12T02:54:24.975723+0000, chain.objs.size()=1 2024-09-12T01:07:26.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Mf0aU76j5CH5BXrIsFAsqSmJnMTcdwH_0 2024-09-12T01:07:26.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12307042913189808479', time=2024-09-12T02:54:25.143381+0000, chain.objs.size()=1 2024-09-12T01:07:26.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MpWPPwKOJdmuaAnu3qCgeNbCtmSroGQ_0 2024-09-12T01:07:26.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17138623574113441526', time=2024-09-12T02:54:25.167148+0000, chain.objs.size()=1 2024-09-12T01:07:26.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4PCMMrNVvySmhaVB1-_Zp2qWiFiuxaO_0 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1495197987215510763', time=2024-09-12T02:54:25.231994+0000, chain.objs.size()=1 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NZ7szMoLMKcv0jwRspN6apCkQrePOo-_0 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9650587489796649071', time=2024-09-12T02:54:25.257822+0000, chain.objs.size()=1 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bn7F5rA4v6X444JbmDdUQdjY6lsSCd3_0 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12019057098013595591', time=2024-09-12T02:54:25.325884+0000, chain.objs.size()=1 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jtpNugnRMUwJMAY1e0UgLzRDD4PdH4p_0 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9700848011311842163', time=2024-09-12T02:54:25.327586+0000, chain.objs.size()=1 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ZknqzT_i7788t8uyma2485ILL1soxTA_0 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7246003686436950655', time=2024-09-12T02:54:25.843948+0000, chain.objs.size()=1 2024-09-12T01:07:26.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.j9LsmFY9G3ONxI5SZhothRqiaq2QhpM_0 2024-09-12T01:07:26.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16699775654534710468', time=2024-09-12T02:54:25.940456+0000, chain.objs.size()=1 2024-09-12T01:07:26.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.752+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DksIf87ydXyzZYBnC6ti1M8E1lLlUS1_0 2024-09-12T01:07:26.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4566240845768328255', time=2024-09-12T02:54:25.964456+0000, chain.objs.size()=1 2024-09-12T01:07:26.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cNbm9Y89yyrveSMBg_VuP9LZziX5XoG_0 2024-09-12T01:07:26.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8208267243028566437', time=2024-09-12T02:54:25.977997+0000, chain.objs.size()=1 2024-09-12T01:07:26.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.QQtOItg9k8P6o8oTx6tdvt5omLnVyQ8_0 2024-09-12T01:07:26.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12397202908636432870', time=2024-09-12T02:54:34.110473+0000, chain.objs.size()=1 2024-09-12T01:07:26.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.274__shadow_.arz22zUgvFr1i_Q_vwea10lAQ8Hyq_X_0 2024-09-12T01:07:26.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14859756167427939918', time=2024-09-12T02:54:40.468858+0000, chain.objs.size()=1 2024-09-12T01:07:26.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.283__shadow_.tdQ3nXiPM7LqTIr6IjngTC0m10eGUvU_0 2024-09-12T01:07:26.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1610990404188192567', time=2024-09-12T02:54:41.886871+0000, chain.objs.size()=1 2024-09-12T01:07:26.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.756+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285__shadow_.bQwK9fZhZPMCdxlMXpfwP6mdqnPgaPe_0 2024-09-12T01:07:26.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10765027455428127107', time=2024-09-12T02:54:43.308139+0000, chain.objs.size()=1 2024-09-12T01:07:26.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.287__shadow_.GA989EpUSQFq5feKLsqdUfFL3d2wp_B_0 2024-09-12T01:07:26.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15297709777622972332', time=2024-09-12T02:54:57.828024+0000, chain.objs.size()=1 2024-09-12T01:07:26.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.305__shadow_.71pFvOHx_IL94GwYjLuGBF0vXzD_Zfw_0 2024-09-12T01:07:26.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9862729028586910952', time=2024-09-12T02:55:30.965646+0000, chain.objs.size()=1 2024-09-12T01:07:26.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-3BN4jDMGgUIMo4I84jPWBJAzd4vhRz_0 2024-09-12T01:07:26.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10821867209656549247', time=2024-09-12T02:55:31.058607+0000, chain.objs.size()=1 2024-09-12T01:07:26.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yldtDhMv6IXOho7kl8zV_9LuNWGFdHN_0 2024-09-12T01:07:26.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.238765358195498068', time=2024-09-12T02:55:31.087391+0000, chain.objs.size()=1 2024-09-12T01:07:26.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.clqjLgaf046cNQFSczBWO16l4ADRtH5_0 2024-09-12T01:07:26.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12795396898719535157', time=2024-09-12T02:55:31.090214+0000, chain.objs.size()=1 2024-09-12T01:07:26.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.O1JKuRSpZzgtoA15pVJvC4f9pFV1U1J_0 2024-09-12T01:07:26.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4577302659257411649', time=2024-09-12T02:55:31.219449+0000, chain.objs.size()=1 2024-09-12T01:07:26.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.isQwdPQorE7kuMe7SgOXL1TTu_yfJGl_0 2024-09-12T01:07:26.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10693055878279329840', time=2024-09-12T02:55:31.248499+0000, chain.objs.size()=1 2024-09-12T01:07:26.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RVouNdprz3sDzOeE6HasI7HMAfyKJUt_0 2024-09-12T01:07:26.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8424952974382662428', time=2024-09-12T02:55:31.305969+0000, chain.objs.size()=1 2024-09-12T01:07:26.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.r7NGuCX77W0cFIBJFp6nDQ0Dh2Fwm4E_0 2024-09-12T01:07:26.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8662224140417853608', time=2024-09-12T02:55:31.323704+0000, chain.objs.size()=1 2024-09-12T01:07:26.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Fjd3Wg2DFFUZnQ69EAaBaDAjQJPbGgT_0 2024-09-12T01:07:26.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15994177428618040665', time=2024-09-12T02:55:31.367568+0000, chain.objs.size()=1 2024-09-12T01:07:26.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WTeIp3XNSPawXF2e93qi3j3YMEsAObS_0 2024-09-12T01:07:26.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17669827954749777082', time=2024-09-12T02:55:31.557420+0000, chain.objs.size()=1 2024-09-12T01:07:26.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.760+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qr9gvzBD1W7qlVKCBWjZXVkktXDews__0 2024-09-12T01:07:26.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4896469921165545609', time=2024-09-12T02:55:31.930195+0000, chain.objs.size()=1 2024-09-12T01:07:26.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pZI-jhfdZISiP9ZMgoQFxm07RLWMKx4_0 2024-09-12T01:07:26.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7301072201619141636', time=2024-09-12T02:55:32.313458+0000, chain.objs.size()=1 2024-09-12T01:07:26.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bP2MxoDLbT6wQFHcoZH65tRI3dVKMPy_0 2024-09-12T01:07:26.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8875572020407651839', time=2024-09-12T02:55:32.327315+0000, chain.objs.size()=1 2024-09-12T01:07:26.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.m0ur031WEwdpS-2x_DNGI454mMZy4CG_0 2024-09-12T01:07:26.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2986107340863578969', time=2024-09-12T02:55:32.351832+0000, chain.objs.size()=1 2024-09-12T01:07:26.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OrtpBzI5JALKqedsU0_cyqmLIUMGsTW_0 2024-09-12T01:07:26.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10747191530002172662', time=2024-09-12T02:55:32.385911+0000, chain.objs.size()=1 2024-09-12T01:07:26.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XD7pmLq9PykJzXnGUt03pf5t6ECspKK_0 2024-09-12T01:07:26.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6003227534641015339', time=2024-09-12T02:55:32.413112+0000, chain.objs.size()=1 2024-09-12T01:07:26.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.i1dAmzJQ4sf8Y0o_oR-qbcxOY4w9CDa_0 2024-09-12T01:07:26.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7017252359079463239', time=2024-09-12T02:55:32.548009+0000, chain.objs.size()=1 2024-09-12T01:07:26.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.764+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.oZSvYRILuRm6GLSGtNScBWZ5agZ2jTe_0 2024-09-12T01:07:26.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4710003326557827800', time=2024-09-12T02:55:32.554386+0000, chain.objs.size()=1 2024-09-12T01:07:26.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.38hBOfpmDclweeArettsllXzHztG3QV_0 2024-09-12T01:07:26.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6507881720777645360', time=2024-09-12T02:55:32.691447+0000, chain.objs.size()=1 2024-09-12T01:07:26.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1yySt88lC_tHJPLrdjJWwbf41E3JOTO_0 2024-09-12T01:07:26.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11803342374021893945', time=2024-09-12T02:55:32.731751+0000, chain.objs.size()=1 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Asej3lT-NMjVzbHUnmq4q-cLqSOASgf_0 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14210955624058317532', time=2024-09-12T02:55:32.744396+0000, chain.objs.size()=1 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.X6CT0RuCLxgOrf7LbUdAbRbNngIlJSv_0 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11482463526335129067', time=2024-09-12T02:55:32.752002+0000, chain.objs.size()=1 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Lk2BqyX-FQd89Q8VeYk8NOa2DEBFgFx_0 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15474316177587663756', time=2024-09-12T02:55:32.860336+0000, chain.objs.size()=1 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.EvcSSAVQY-AQGpJZnQzzRVMKG3yhH8m_0 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14400993879142187088', time=2024-09-12T02:55:32.876246+0000, chain.objs.size()=1 2024-09-12T01:07:26.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GfEVfvgw4LrWzagXMV30pd7_fwmiIFY_0 2024-09-12T01:07:26.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17873851454344591952', time=2024-09-12T02:55:32.885595+0000, chain.objs.size()=1 2024-09-12T01:07:26.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eTDd02WzBLqHlc0AgHsSHBnZwO5YfN5_0 2024-09-12T01:07:26.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6376901164832708957', time=2024-09-12T02:55:32.891036+0000, chain.objs.size()=1 2024-09-12T01:07:26.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.afolr6tVSA0IcgZbJBqmLwEwFsUZNU__0 2024-09-12T01:07:26.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14136233285661598616', time=2024-09-12T02:55:32.971397+0000, chain.objs.size()=1 2024-09-12T01:07:26.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4i0cOqdo_kyTud6g-XWBTfKt5YJ7DvS_0 2024-09-12T01:07:26.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5429007719193240143', time=2024-09-12T02:55:32.980500+0000, chain.objs.size()=1 2024-09-12T01:07:26.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.768+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bMV0266DKVswP3qYxW8zqSYLr4jopD3_0 2024-09-12T01:07:26.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6410316235375914782', time=2024-09-12T02:55:32.993229+0000, chain.objs.size()=1 2024-09-12T01:07:26.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6g-mx24XszlzxUllKNZ5at26WWOV8n5_0 2024-09-12T01:07:26.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13143006285846548057', time=2024-09-12T02:55:33.009838+0000, chain.objs.size()=1 2024-09-12T01:07:26.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.trdgC0kSFfcNqeysdwURIfS1s28ARPN_0 2024-09-12T01:07:26.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1029705254267098184', time=2024-09-12T02:55:33.282381+0000, chain.objs.size()=1 2024-09-12T01:07:26.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KKkVg_3MF2rmTik6pWqQ1VAp_tyZla3_0 2024-09-12T01:07:26.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4890132711753369661', time=2024-09-12T02:55:33.301542+0000, chain.objs.size()=1 2024-09-12T01:07:26.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8F8XWBJCc1_PIM2hNIhIxF6iFE4xb-A_0 2024-09-12T01:07:26.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2025802674055294745', time=2024-09-12T02:55:33.322735+0000, chain.objs.size()=1 2024-09-12T01:07:26.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.64wG5oFFcE-fwWk-5DLYI90fyeXZGU-_0 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.435769952276787611', time=2024-09-12T02:55:54.458531+0000, chain.objs.size()=1 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LR7xnqGbOdgyKW0ZtL5jarmC2pWGyVe_0 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3288633145015290196', time=2024-09-12T02:55:54.528594+0000, chain.objs.size()=1 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1mwhIKLt3m6pEOhLcWmAfaH91bqp6lL_0 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6380118777646626441', time=2024-09-12T02:55:54.530930+0000, chain.objs.size()=1 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XmmqnOpNtpS6aN2eWiCAdPg_vFFzfDI_0 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6935273897974179710', time=2024-09-12T02:55:54.621431+0000, chain.objs.size()=1 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HDE0ihTkHDUh6v_tMcFwfi_6lEVB5BO_0 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6307306954438034805', time=2024-09-12T02:55:54.626526+0000, chain.objs.size()=1 2024-09-12T01:07:26.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.iQ7wqYAMzgLSUgPsws3ZiY2J70x8EWQ_0 2024-09-12T01:07:26.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12844072987957885848', time=2024-09-12T02:55:54.670473+0000, chain.objs.size()=1 2024-09-12T01:07:26.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gmleP9C7cN6i0X8fxMpNjUmx2ajYN85_0 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14715186533560643541', time=2024-09-12T02:55:54.816237+0000, chain.objs.size()=1 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.g--eMp-7mQg6wq4HtzME0_LmgRHkl93_0 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6655607340638359480', time=2024-09-12T02:55:54.819930+0000, chain.objs.size()=1 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.w4b9GKU2t6ZTW3eA7HAqJJgBEP9Hz8t_0 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3530107063927291204', time=2024-09-12T02:55:54.820791+0000, chain.objs.size()=1 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.w0BniGx_tK8wuVzx5RM23R7v0XZNI0H_0 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15676235876216062275', time=2024-09-12T02:55:54.821793+0000, chain.objs.size()=1 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.772+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FqYcel0PEPfu9fzympZoCxSkMYSbSbl_0 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12886056364116552806', time=2024-09-12T02:55:54.871974+0000, chain.objs.size()=1 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vx2f2DxwusrIQmMCvYnUDR2r-UjjNDG_0 2024-09-12T01:07:26.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.530378503502072210', time=2024-09-12T02:55:54.923406+0000, chain.objs.size()=1 2024-09-12T01:07:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bsa9fn4h_DNoISBQB9bz0f73I43QIHq_0 2024-09-12T01:07:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10052573800322432955', time=2024-09-12T02:55:54.959411+0000, chain.objs.size()=1 2024-09-12T01:07:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.A4C831KluL7pZqvB0pDIKrYn1zbIF1W_0 2024-09-12T01:07:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10167365705424013453', time=2024-09-12T02:55:54.974864+0000, chain.objs.size()=1 2024-09-12T01:07:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RqYyYy2SWRqu3I_rlwqhlbEcE6haUwM_0 2024-09-12T01:07:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1660344027672014723', time=2024-09-12T02:55:54.985575+0000, chain.objs.size()=1 2024-09-12T01:07:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dO_nD-WxNab23JNWaKsp7YxCmDEaF_W_0 2024-09-12T01:07:26.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8096157647597968213', time=2024-09-12T02:55:55.117828+0000, chain.objs.size()=1 2024-09-12T01:07:26.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SPl0Lcy1Wtlh61FHBsCZPDbMrsKf44l_0 2024-09-12T01:07:26.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11139112469396616023', time=2024-09-12T02:55:55.165249+0000, chain.objs.size()=1 2024-09-12T01:07:26.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Fw1Ppxa8m_SXUoPUZsWXJ0v5ITDldCE_0 2024-09-12T01:07:26.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4014061774518736312', time=2024-09-12T02:55:55.196680+0000, chain.objs.size()=1 2024-09-12T01:07:26.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WNBaRSMHKhg2o4NMum6-EJ-IXC7TO5H_0 2024-09-12T01:07:26.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9126355583566527722', time=2024-09-12T02:55:55.256360+0000, chain.objs.size()=1 2024-09-12T01:07:26.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MoajZ15FfURhohxIoI5oE3Z2O__6iWw_0 2024-09-12T01:07:26.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8225556253776619495', time=2024-09-12T02:55:55.471685+0000, chain.objs.size()=1 2024-09-12T01:07:26.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HOcqnUMI52aMiid6JmQpVY7oioTV3pw_0 2024-09-12T01:07:26.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9347243438579800813', time=2024-09-12T02:55:55.518932+0000, chain.objs.size()=1 2024-09-12T01:07:26.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uQv_uxhdu517yEIKps-nKrHQPyhcyq3_0 2024-09-12T01:07:26.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.422032275913081849', time=2024-09-12T02:55:55.588282+0000, chain.objs.size()=1 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.776+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.EacvKEqaSoQ3Y9gD3IwZ6dV3kTqcGOQ_0 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2038904524927344014', time=2024-09-12T02:55:55.596175+0000, chain.objs.size()=1 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GOr5bEjcf2Og8FzcWtrTxItM6azn_qw_0 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18431024561520426080', time=2024-09-12T02:55:55.647085+0000, chain.objs.size()=1 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QAnrvwRF6XpFOzwFx6VZh5hYw2oPfae_0 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15156351556735802434', time=2024-09-12T02:55:55.687774+0000, chain.objs.size()=1 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.KuzRzk1utC6D_mQmc-lq7exNAeFv4Db_0 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1418809536362219591', time=2024-09-12T02:55:55.837922+0000, chain.objs.size()=1 2024-09-12T01:07:26.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dZ4Tqb83LkfEfr7Zd0P6T8Pno4HjSuw_0 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17820593211176882664', time=2024-09-12T02:55:55.899328+0000, chain.objs.size()=1 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.824PN6Osg_X4uhh43rPLftz8aZFA3ve_0 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18019171201530153029', time=2024-09-12T02:55:55.900406+0000, chain.objs.size()=1 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OY29D-8JL7UFQgd3MtmODenqffg-fRj_0 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10396168317239818962', time=2024-09-12T02:55:56.140282+0000, chain.objs.size()=1 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ywjKmzavhs8EqSzeN6qDzQZs-zFe_wb_0 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7226398454715172751', time=2024-09-12T02:55:56.159751+0000, chain.objs.size()=1 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hA3yrcc33ql9NYwh5DOSorrJdpRfpjo_0 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9929239348873358671', time=2024-09-12T02:55:56.368038+0000, chain.objs.size()=1 2024-09-12T01:07:26.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.780+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1UyyihHL-0lZWR2bo1jSMvc1PLvxbQo_0 2024-09-12T01:07:26.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6299683965637048778', time=2024-09-12T02:55:56.466851+0000, chain.objs.size()=1 2024-09-12T01:07:26.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hyhiCqYXY8wBVXMRbRRvSsO3ZNotXEt_0 2024-09-12T01:07:26.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.784+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12648765103919606099', time=2024-09-12T02:55:56.505518+0000, chain.objs.size()=1 2024-09-12T01:07:26.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.784+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.oZLQwVXJieyFDCvTO7i-h0BTDn1BlWq_0 2024-09-12T01:07:26.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/63057 2024-09-12T01:07:26.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:07:26.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.590136938481354234', time=2024-09-12T02:55:56.591134+0000, chain.objs.size()=1 2024-09-12T01:07:26.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uv919WGoVx-5UKA18kfasv6TkgnhIIl_0 2024-09-12T01:07:26.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8603980352540676491', time=2024-09-12T02:55:56.608628+0000, chain.objs.size()=1 2024-09-12T01:07:26.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PMBBMQr6X22XK9LKaLtp_910qBnV6cR_0 2024-09-12T01:07:26.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9194439173422446342', time=2024-09-12T02:55:56.769104+0000, chain.objs.size()=1 2024-09-12T01:07:26.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.rqrn_GYju7jZUyYGIPkBrMVEyVN0eBl_0 2024-09-12T01:07:26.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8421663615726093861', time=2024-09-12T02:55:56.772856+0000, chain.objs.size()=1 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.p3Z7E74nS73jxmUS_Wy8rgWVOdi9zQT_0 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6011877829676254753', time=2024-09-12T02:55:56.925996+0000, chain.objs.size()=1 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sgi9GVbDhJ6P6ie17AdDPBlkl2IhYTR_0 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4614659582847392333', time=2024-09-12T02:56:10.111552+0000, chain.objs.size()=1 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.345__shadow_.ToMf8NsNzQqqlztUWTqNpLAo2LpsGR9_0 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17423696996420120914', time=2024-09-12T02:57:06.969439+0000, chain.objs.size()=1 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.429__shadow_.585bcZe7to2gjXYpBy-f6HJj4ggHpac_0 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15696058368411186542', time=2024-09-12T02:57:31.357763+0000, chain.objs.size()=1 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.460__shadow_.8gjhE29ET_Ax7QKtPQ4V9oodI7Eb3qr_0 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13671132596100901616', time=2024-09-12T02:57:48.168881+0000, chain.objs.size()=1 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.487__shadow_.d-d5DavhcqfuaaaZaPdx8ILQR_7t-3m_0 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13524274611520759427', time=2024-09-12T02:58:33.721112+0000, chain.objs.size()=6 2024-09-12T01:07:26.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~RRsFKDa9DErjuiG1o1MOWvi8sKTpPkv.1 2024-09-12T01:07:26.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.PxQD3H8yJaTTvJKZBKe_znbqwmeyNka4.2 2024-09-12T01:07:26.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.788+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.kzb-bFCyu_M7_bm_4cJ1owTkf7KfqoNN.3 2024-09-12T01:07:26.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.792+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~RRsFKDa9DErjuiG1o1MOWvi8sKTpPkv.4 2024-09-12T01:07:26.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.792+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~RRsFKDa9DErjuiG1o1MOWvi8sKTpPkv.5 2024-09-12T01:07:26.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.792+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~RRsFKDa9DErjuiG1o1MOWvi8sKTpPkv.6 2024-09-12T01:07:26.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.792+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10145025747840179645', time=2024-09-12T02:58:38.360067+0000, chain.objs.size()=3 2024-09-12T01:07:26.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.792+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~dqVkc3lgI9meYV45ksZYc8bHtFsVZMx.1 2024-09-12T01:07:26.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.792+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~dqVkc3lgI9meYV45ksZYc8bHtFsVZMx.2 2024-09-12T01:07:26.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.792+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~dqVkc3lgI9meYV45ksZYc8bHtFsVZMx.3 2024-09-12T01:07:26.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7466161118563578990', time=2024-09-12T02:59:35.979768+0000, chain.objs.size()=1 2024-09-12T01:07:26.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.555__shadow_.4sEyN3ZB77u8hsWZihWhC_fKOmci3dT_0 2024-09-12T01:07:26.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17140376497128325854', time=2024-09-12T02:59:53.659008+0000, chain.objs.size()=1 2024-09-12T01:07:26.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:M3sQhJq7GFD0ZDx2xIHWUlJeBeGCcWa_.KkhvpPytGCPlAw-GEvVgG5aQz59Cpnr_0 2024-09-12T01:07:26.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6065882567623982242', time=2024-09-12T02:59:59.638373+0000, chain.objs.size()=1 2024-09-12T01:07:26.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:O8hlzq70nQt7DqpWpflkGN2SQrxLRT._.clHAo45XSwN7RyMHyJW2TOL0OQkRLSi_0 2024-09-12T01:07:26.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9491473226205392228', time=2024-09-12T03:00:07.066006+0000, chain.objs.size()=1 2024-09-12T01:07:26.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow:orrZZXTTVIUC0P0BuTupAMUeX9DPxnj_.A_HdgLoynvCJDLPLZxtsAhSAGdUl0CY_0 2024-09-12T01:07:26.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2727338009504674510', time=2024-09-12T03:00:21.133394+0000, chain.objs.size()=1 2024-09-12T01:07:26.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:B2k7LfOhHu3cv7GL28Ng3XME0B2UGcK_.6Y_uJJn5Z86uNsP2M49emTPcCQ7LaGi_0 2024-09-12T01:07:26.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4452693211019301799', time=2024-09-12T03:00:35.241911+0000, chain.objs.size()=1 2024-09-12T01:07:26.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:vUnvWfPxG0qoLytlc729NN525K7bwnv_.RpX4zRWR42VGuvxDKkPedH3iKegGLcv_0 2024-09-12T01:07:26.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4188551570119310599', time=2024-09-12T03:00:36.971312+0000, chain.objs.size()=1 2024-09-12T01:07:26.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.796+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:OWXWUOeiW0f1dDrybyO5kQ5JrSa1ayc_.H8tWYD1GaDycZWJ3RVa_PoqT_M6vbgD_0 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4373006491530079369', time=2024-09-12T03:00:37.109148+0000, chain.objs.size()=1 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:jtKEtOLS43kp.2pO8svYPd3j0R8MyKK_.xrdWwwhmVkC7mZTJ44ZRqj0taSzUiIO_0 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10591086009035756811', time=2024-09-12T03:00:42.397827+0000, chain.objs.size()=1 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:u9oyBXsPUWIashfU75WK4Rv1bdYZ6hO_.c9FVwvuHKfT4C5cG_VdSC__3T3kYmey_0 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13646041776336641674', time=2024-09-12T03:00:51.996032+0000, chain.objs.size()=1 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.603__shadow_.ElJbleCbuJwHylQndb0_N9mZpqlxOE5_0 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1955315105619639434', time=2024-09-12T03:03:26.192000+0000, chain.objs.size()=1 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.631__shadow_.SOqu6pBzQkA0Rltt-diW-ydWcYP-ARU_0 2024-09-12T01:07:26.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15518189012692516329', time=2024-09-12T03:03:34.768101+0000, chain.objs.size()=2 2024-09-12T01:07:26.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.644__shadow_.4U1WX15n5NZ0Gt5ad-M-3mdTVWGWkjr_0 2024-09-12T01:07:26.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.644__shadow_.4U1WX15n5NZ0Gt5ad-M-3mdTVWGWkjr_1 2024-09-12T01:07:26.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13455210896015523024', time=2024-09-12T03:03:54.724548+0000, chain.objs.size()=1 2024-09-12T01:07:26.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.800+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.666__shadow_.791R-8lJSoamm4QOjAHP75YhixYuevL_0 2024-09-12T01:07:26.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.804+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.804+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:07:26.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56273' 2024-09-12T01:07:26.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18223436017898388768', time=2024-09-12T02:51:33.011044+0000, chain.objs.size()=5 2024-09-12T01:07:26.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-STANDARD.2~-_05PehA3q4EIOL6v516VsIMhQfpO8b.1 2024-09-12T01:07:26.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_foo-STANDARD.2~-_05PehA3q4EIOL6v516VsIMhQfpO8b.1_1 2024-09-12T01:07:26.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-STANDARD.2~-_05PehA3q4EIOL6v516VsIMhQfpO8b.2 2024-09-12T01:07:26.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_foo-STANDARD.2~-_05PehA3q4EIOL6v516VsIMhQfpO8b.2_1 2024-09-12T01:07:26.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-STANDARD.2~-_05PehA3q4EIOL6v516VsIMhQfpO8b.3 2024-09-12T01:07:26.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14299417713304196614', time=2024-09-12T02:51:33.847225+0000, chain.objs.size()=5 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-LUKEWARM.2~KpdtXOfS9McpgtxoOWC3ep9ADLl7Z7n.1 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_foo-LUKEWARM.2~KpdtXOfS9McpgtxoOWC3ep9ADLl7Z7n.1_1 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-LUKEWARM.2~KpdtXOfS9McpgtxoOWC3ep9ADLl7Z7n.2 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_foo-LUKEWARM.2~KpdtXOfS9McpgtxoOWC3ep9ADLl7Z7n.2_1 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-LUKEWARM.2~KpdtXOfS9McpgtxoOWC3ep9ADLl7Z7n.3 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8667545552050703796', time=2024-09-12T02:53:58.504957+0000, chain.objs.size()=1 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.256__shadow_.Hxvdp9yMxcuPns2y8qnwKed4Z18pQQ-_0 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12482580813566523458', time=2024-09-12T02:54:23.063368+0000, chain.objs.size()=1 2024-09-12T01:07:26.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.808+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.V_t6WFLJWuKQsX8DQYiYMM6Oz4pKW7w_0 2024-09-12T01:07:26.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7461606517065049189', time=2024-09-12T02:54:23.181565+0000, chain.objs.size()=1 2024-09-12T01:07:26.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.X7CLR_xvdSQZuDo5GtTvV7K-vKwr2bQ_0 2024-09-12T01:07:26.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1382034426480018804', time=2024-09-12T02:54:23.240714+0000, chain.objs.size()=1 2024-09-12T01:07:26.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bjO4yYEqdsDvg4Lh5P2dLut5kikdxlW_0 2024-09-12T01:07:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5743671816533677751', time=2024-09-12T02:54:23.624412+0000, chain.objs.size()=1 2024-09-12T01:07:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3Y-AA-aQHVllM641O_xSddAxAaTdTYI_0 2024-09-12T01:07:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17183331342361967746', time=2024-09-12T02:54:24.129621+0000, chain.objs.size()=1 2024-09-12T01:07:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.brJQhV5hRbjmoy_Yi-xfFK2m6d4MFpD_0 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4074759942811315642', time=2024-09-12T02:54:24.155491+0000, chain.objs.size()=1 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2VGRn2ljkMfWQTVph8rgQUvXTLNagWY_0 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2720934910483599616', time=2024-09-12T02:54:24.169633+0000, chain.objs.size()=1 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1urRhq3zgIhlNO4W1q_XYDFaC2H3aMM_0 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17228432036620895729', time=2024-09-12T02:54:24.366258+0000, chain.objs.size()=1 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xosJJUpF-nQrBAPuX-sRvtr_zAvGnIm_0 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14219464918508813872', time=2024-09-12T02:54:24.369238+0000, chain.objs.size()=1 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ep_QGoCWO-03tDWSaXfTMvB53I4_G98_0 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6171655503402520486', time=2024-09-12T02:54:24.378937+0000, chain.objs.size()=1 2024-09-12T01:07:26.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6mxAU8gYMrYIA2HMCBCT8dW_R4uuyh7_0 2024-09-12T01:07:26.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14279339486017610036', time=2024-09-12T02:54:24.412322+0000, chain.objs.size()=1 2024-09-12T01:07:26.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fesAx-M61xak_OVa7YJuga3l55GH5Mf_0 2024-09-12T01:07:26.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10945666908488797781', time=2024-09-12T02:54:24.622611+0000, chain.objs.size()=1 2024-09-12T01:07:26.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.812+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.A-Q9hvVasHfIP2KLYlDQBLeUHf7i-2n_0 2024-09-12T01:07:26.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16219276617919916965', time=2024-09-12T02:54:24.748547+0000, chain.objs.size()=1 2024-09-12T01:07:26.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VEv81PJ1pyMojrar86jDc0yMJzmQ1eY_0 2024-09-12T01:07:26.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13411668662162925248', time=2024-09-12T02:54:24.850199+0000, chain.objs.size()=1 2024-09-12T01:07:26.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FwxGBn22OeFVYXUYVoG50L1KoqSc6N5_0 2024-09-12T01:07:26.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10768429295863422908', time=2024-09-12T02:54:24.863073+0000, chain.objs.size()=1 2024-09-12T01:07:26.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RO6B53O2Meocq77NhJ22ehWrPSFcwNX_0 2024-09-12T01:07:26.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8948239121413215352', time=2024-09-12T02:54:24.877839+0000, chain.objs.size()=1 2024-09-12T01:07:26.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eFjNstwRqY_1WsdEh5gSOPbp34iKdaJ_0 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7099765202050021253', time=2024-09-12T02:54:25.144373+0000, chain.objs.size()=1 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jkWk30zuGJzBTuBfsF29BSd4Gu6pusG_0 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10490482877800571508', time=2024-09-12T02:54:25.202563+0000, chain.objs.size()=1 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AXCMWfq_STiuYCivCeLn3o79hHRwn_q_0 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.408858924013449945', time=2024-09-12T02:54:25.539332+0000, chain.objs.size()=1 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0Jri1Ui1Vk8dk2NmtgA0oFXpsoVYJEq_0 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11792272019923508970', time=2024-09-12T02:54:25.731010+0000, chain.objs.size()=1 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.07DBbdKEG4rFowIYfRmxsku9poIK_kZ_0 2024-09-12T01:07:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14732194625479421957', time=2024-09-12T02:54:25.859497+0000, chain.objs.size()=1 2024-09-12T01:07:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CXfHz_SKo7387ZePJnqCtAqHgbQltKT_0 2024-09-12T01:07:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12476967286037053492', time=2024-09-12T02:54:26.002000+0000, chain.objs.size()=1 2024-09-12T01:07:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fEMPdh0K0wREjgGmo4JUnMjvNVqC7EO_0 2024-09-12T01:07:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4398450815638925353', time=2024-09-12T02:54:30.711289+0000, chain.objs.size()=1 2024-09-12T01:07:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.816+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.269__shadow_.gMLFEQwr5ax7SuM6noFr567vB0jYUso_0 2024-09-12T01:07:26.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.820+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11436376740670624867', time=2024-09-12T02:54:32.754570+0000, chain.objs.size()=1 2024-09-12T01:07:26.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.820+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.272__shadow_.sfkKEbtUlSI9pj_sgn0xOQiietQFYrU_0 2024-09-12T01:07:26.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.820+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16271011896716266877', time=2024-09-12T02:54:34.803345+0000, chain.objs.size()=1 2024-09-12T01:07:26.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.820+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.275__shadow_._ANeRyuZZTaViXpZuknSO4w41g-c67U_0 2024-09-12T01:07:26.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.820+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10329613279551421618', time=2024-09-12T02:54:44.774588+0000, chain.objs.size()=1 2024-09-12T01:07:26.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.820+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.289__shadow_.y7wt-UxBy-G04YmN2bXKbGe-BYoJpVj_0 2024-09-12T01:07:26.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.820+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7241186892313096372', time=2024-09-12T02:54:47.926893+0000, chain.objs.size()=1 2024-09-12T01:07:26.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.820+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.IqMBdLadcYaRAC8IGuwaqqLGBcsdclU_0 2024-09-12T01:07:26.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14338034375692477492', time=2024-09-12T02:54:47.940873+0000, chain.objs.size()=1 2024-09-12T01:07:26.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.2vjxKZkvpy2wSacv1ksfwgG2g3i0lAu_0 2024-09-12T01:07:26.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8403885470947327834', time=2024-09-12T02:54:49.381786+0000, chain.objs.size()=1 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.SU_vEys6yWdWiE4YtqQFVRaMjuE9Fqp_0 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2830406649502592666', time=2024-09-12T02:54:53.656197+0000, chain.objs.size()=1 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.299__shadow_.GMlvTf3s7n0dObnzt9vX6enYmUfrkmF_0 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5856467338641500958', time=2024-09-12T02:54:57.829506+0000, chain.objs.size()=1 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.305__shadow_.85doF3aP182FYGm8PMBobrKd4IrHi5X_0 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17418596629156415275', time=2024-09-12T02:55:09.620217+0000, chain.objs.size()=1 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.322__shadow_.LGPNL-Vz44OuBSoSFRaVfeGYTD8H65q_0 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16633666545315412186', time=2024-09-12T02:55:30.888048+0000, chain.objs.size()=1 2024-09-12T01:07:26.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.S9ifvHR3XJp1sFEzCeROAkkyLaOY_mZ_0 2024-09-12T01:07:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15195480271279613891', time=2024-09-12T02:55:30.932847+0000, chain.objs.size()=1 2024-09-12T01:07:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZEbIwd5abO6Z6EomyKWWAvDpKL3nY2l_0 2024-09-12T01:07:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8657553749989882147', time=2024-09-12T02:55:31.052291+0000, chain.objs.size()=1 2024-09-12T01:07:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dFK3BWOlkRfutiiZezATNDyH3Y-fYNU_0 2024-09-12T01:07:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4456154419104637591', time=2024-09-12T02:55:31.073202+0000, chain.objs.size()=1 2024-09-12T01:07:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.824+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.F26oV29I4yvMQy1fRFzkrjkZ_JJXIn__0 2024-09-12T01:07:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3067162398249043416', time=2024-09-12T02:55:31.223738+0000, chain.objs.size()=1 2024-09-12T01:07:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rlV_Phhjjctumjqw8P5ddtGxHL2FvJ1_0 2024-09-12T01:07:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14966980487092721336', time=2024-09-12T02:55:31.404298+0000, chain.objs.size()=1 2024-09-12T01:07:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.BmodjRirkZnMfBIpfBZwGVRQvWV4dz6_0 2024-09-12T01:07:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11752895913327478301', time=2024-09-12T02:55:31.443627+0000, chain.objs.size()=1 2024-09-12T01:07:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pRWQH8mpYgLI9tx2nzkMCZ4LcSIeUi1_0 2024-09-12T01:07:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5038931381755520133', time=2024-09-12T02:55:31.619847+0000, chain.objs.size()=1 2024-09-12T01:07:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.o2gWyJXmKGFLFafRX_UsdtnH-4Io8hP_0 2024-09-12T01:07:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7583400267936539576', time=2024-09-12T02:55:31.644484+0000, chain.objs.size()=1 2024-09-12T01:07:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.l1140etszrqjG6buQH13uuSLp89fMKc_0 2024-09-12T01:07:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.519477136214350611', time=2024-09-12T02:55:31.957454+0000, chain.objs.size()=1 2024-09-12T01:07:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.q-2pnHRWd42p1YVk0ZEbkI_m8s7Js3W_0 2024-09-12T01:07:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9074079495436047496', time=2024-09-12T02:55:32.054788+0000, chain.objs.size()=1 2024-09-12T01:07:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4iUUk3eH_l-pZZk8CFIKv1re-I0nzkS_0 2024-09-12T01:07:26.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13338403207401109639', time=2024-09-12T02:55:32.078689+0000, chain.objs.size()=1 2024-09-12T01:07:26.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Ou9VQ6hBCMlKmjskUN2NvUFciyoNfCK_0 2024-09-12T01:07:26.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10812133908667790179', time=2024-09-12T02:55:32.302264+0000, chain.objs.size()=1 2024-09-12T01:07:26.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MQgUbJ1NU1XqcgkTGCWM_PuGyjQh9_m_0 2024-09-12T01:07:26.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9014577989558496457', time=2024-09-12T02:55:32.421824+0000, chain.objs.size()=1 2024-09-12T01:07:26.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.U5Xvu3z3EH33DyIkZ8e3ibDnfUXMalT_0 2024-09-12T01:07:26.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3910962861206949021', time=2024-09-12T02:55:32.635426+0000, chain.objs.size()=1 2024-09-12T01:07:26.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.828+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.o50v69inbQxYOH7qH1AwYPtvIiG8LEa_0 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3300674959598665099', time=2024-09-12T02:55:32.689375+0000, chain.objs.size()=1 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LZvVgBSKrTBFtCC2-8yAPuB6BV1qqYE_0 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15535531483316846369', time=2024-09-12T02:55:32.693414+0000, chain.objs.size()=1 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jYy2NeX91wfLc_qMtmVde2Tk_KYNqk0_0 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13280183269663963540', time=2024-09-12T02:55:32.919247+0000, chain.objs.size()=1 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.z-VLtSVN_w6wwMJ5stXFbhvl5hEQISM_0 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10844761686217388515', time=2024-09-12T02:55:32.959882+0000, chain.objs.size()=1 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GWEsmwYpgoWQ8JiAXUiW7oDoEWwSNMN_0 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6664434679905978732', time=2024-09-12T02:55:33.161773+0000, chain.objs.size()=1 2024-09-12T01:07:26.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-_Flg-ypv6gaOhPzFV1e_IohRMrZ1BE_0 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2905251745467723227', time=2024-09-12T02:55:33.275998+0000, chain.objs.size()=1 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hCPcGtP87wqoTW6Iwjh2iuPCys-YyKD_0 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4401641900379763734', time=2024-09-12T02:55:54.453607+0000, chain.objs.size()=1 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7hKNQeOjoWvXCFtboa6icqE91JLyK3F_0 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11157147895467170521', time=2024-09-12T02:55:54.647328+0000, chain.objs.size()=1 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SxFRMFhhfb49eHf6T3ValjHd3hqQaGG_0 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11329746155488621142', time=2024-09-12T02:55:54.671108+0000, chain.objs.size()=1 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TT3qu5C8NFgk8hmWUgO49eMkbduiwFT_0 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1496664830957515084', time=2024-09-12T02:55:54.688314+0000, chain.objs.size()=1 2024-09-12T01:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1tDc1aLjdRGVXZGH-_3WceyelWIvwLl_0 2024-09-12T01:07:26.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6468087373435872964', time=2024-09-12T02:55:54.694382+0000, chain.objs.size()=1 2024-09-12T01:07:26.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.832+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.iKmaC5qXrxRgWhAA82t2iXZFdAmYkqF_0 2024-09-12T01:07:26.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2069447109601951244', time=2024-09-12T02:55:54.799953+0000, chain.objs.size()=1 2024-09-12T01:07:26.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sTmAS119iCLlDWbgSO5hMW_HH4US1pg_0 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1484795885865622581', time=2024-09-12T02:55:54.839692+0000, chain.objs.size()=1 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6ugPhz7N7VLBXJ0B9lrE3i4GCF8bni3_0 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1893841137755860265', time=2024-09-12T02:55:54.920084+0000, chain.objs.size()=1 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zv82WzzEylelNlhEQB2yogsiXPKQ6pd_0 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9583154901818105101', time=2024-09-12T02:55:55.146649+0000, chain.objs.size()=1 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7-H2UwOn0YB-PTwi59vTcji9BEKry4j_0 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12285370141046763129', time=2024-09-12T02:55:55.243175+0000, chain.objs.size()=1 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uY_n6vKJ0POors-4vWOJ5WSpr2C6kyG_0 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2124277698913936643', time=2024-09-12T02:55:55.255132+0000, chain.objs.size()=1 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._40ijiu4FzvoMTsifMNpraexpM1_FaR_0 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14384744071780913843', time=2024-09-12T02:55:55.266179+0000, chain.objs.size()=1 2024-09-12T01:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LuLgIMB5uhnkT12z10DZ3sDlwjL3Fnv_0 2024-09-12T01:07:26.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13856201528693742112', time=2024-09-12T02:55:55.275672+0000, chain.objs.size()=1 2024-09-12T01:07:26.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OgM5pCYSpaET_SoIJR_fIcpde7ribMH_0 2024-09-12T01:07:26.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13672422316153042950', time=2024-09-12T02:55:55.288320+0000, chain.objs.size()=1 2024-09-12T01:07:26.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fyphDiRYFcUoPXy63lDZlc0mkLeKh9j_0 2024-09-12T01:07:26.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5862678764657143790', time=2024-09-12T02:55:55.327777+0000, chain.objs.size()=1 2024-09-12T01:07:26.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.836+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BELxYHVO_-ZCWxpYrGMs8nRxWgtZ76p_0 2024-09-12T01:07:26.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6272955058297145036', time=2024-09-12T02:55:55.482387+0000, chain.objs.size()=1 2024-09-12T01:07:26.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3StTtln-l-1ILnmx-a61yTs3uPx9k-q_0 2024-09-12T01:07:26.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2255090331060950711', time=2024-09-12T02:55:55.504966+0000, chain.objs.size()=1 2024-09-12T01:07:26.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.INI4MyJhpeHx0dMQOMTGIXgBTqHJ7O3_0 2024-09-12T01:07:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6946364636146864561', time=2024-09-12T02:55:55.594583+0000, chain.objs.size()=1 2024-09-12T01:07:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.duDxhuYC7DMTw0Y2rnHRKRhbkVQqncZ_0 2024-09-12T01:07:26.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5539662823304422896', time=2024-09-12T02:55:55.601384+0000, chain.objs.size()=1 2024-09-12T01:07:26.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SegJGkyBfvZvXWig5v1UFMcYK54Fn6G_0 2024-09-12T01:07:26.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14075947546978552001', time=2024-09-12T02:55:55.613399+0000, chain.objs.size()=1 2024-09-12T01:07:26.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.840+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.iSMAaLj02LWKpNhrC2GtT9CUnoSK1AY_0 2024-09-12T01:07:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2399642804252127165', time=2024-09-12T02:55:55.805447+0000, chain.objs.size()=1 2024-09-12T01:07:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1aadBqbdYylrCHPE7Tj5Q_GqJC4G32I_0 2024-09-12T01:07:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.955807476586864925', time=2024-09-12T02:55:55.813940+0000, chain.objs.size()=1 2024-09-12T01:07:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NRTvpqUKcn7ypQYVkKtuspCs1mEsPj7_0 2024-09-12T01:07:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4016492188829066239', time=2024-09-12T02:55:55.847438+0000, chain.objs.size()=1 2024-09-12T01:07:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BrsYzQrCud3SKAQbExRknij5lrUMVsL_0 2024-09-12T01:07:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6854316607694355347', time=2024-09-12T02:55:55.851118+0000, chain.objs.size()=1 2024-09-12T01:07:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9o0OBSgPQ673th0E8cIGkROuWJE3wMq_0 2024-09-12T01:07:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14945897399246599321', time=2024-09-12T02:55:55.877969+0000, chain.objs.size()=1 2024-09-12T01:07:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.rLBjMqQu5MXZshsH_14sBBNK8Hz6Mup_0 2024-09-12T01:07:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13766559888316461048', time=2024-09-12T02:55:55.913125+0000, chain.objs.size()=1 2024-09-12T01:07:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mnJ7mzEbQxZcMQXsHSCRbtjOwTv5_Z0_0 2024-09-12T01:07:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13065898012168881750', time=2024-09-12T02:55:56.176430+0000, chain.objs.size()=1 2024-09-12T01:07:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OMiANYoEWQbmaDp256eE4Flqfu1bRDR_0 2024-09-12T01:07:26.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1559615014255258660', time=2024-09-12T02:55:56.228891+0000, chain.objs.size()=1 2024-09-12T01:07:26.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.844+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mnESdijbyos6jb0UGj7nmFbSYoxohox_0 2024-09-12T01:07:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2326022348337909773', time=2024-09-12T02:55:56.298569+0000, chain.objs.size()=1 2024-09-12T01:07:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BbyocHuxrdGFL3nZfmx_7AE07Dtqnh4_0 2024-09-12T01:07:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15263037147994409301', time=2024-09-12T02:55:56.301578+0000, chain.objs.size()=1 2024-09-12T01:07:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.H-_-EQjoxcEFXqbPE4cTnAnzoE08_4Q_0 2024-09-12T01:07:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6601535632889005186', time=2024-09-12T02:55:56.317498+0000, chain.objs.size()=1 2024-09-12T01:07:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qS5EgMM31aPYO-mGEG9nuZEFAtHUaqX_0 2024-09-12T01:07:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1499320391362854790', time=2024-09-12T02:55:56.511320+0000, chain.objs.size()=1 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.R5lIE-9lj6rDqnp57qGM3xz6aAkO05k_0 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1288686623378247310', time=2024-09-12T02:55:56.571829+0000, chain.objs.size()=1 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.P6DzMRfDFKdOQVwVxeY3rWVy6CBq5LZ_0 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11761881158303406643', time=2024-09-12T02:55:56.585964+0000, chain.objs.size()=1 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.487y9pS3LuUitUExNGXeF0h1wLvOmsO_0 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4256992506198142484', time=2024-09-12T02:55:56.642156+0000, chain.objs.size()=1 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QCxOBJSTTbST6q5FXvFwyjA2nuxNDH9_0 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2653585868862662352', time=2024-09-12T02:55:56.799357+0000, chain.objs.size()=1 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.spsOeK6PpF5O98CKlWcOZM497xFILgu_0 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5739025725073331985', time=2024-09-12T02:55:56.825762+0000, chain.objs.size()=1 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Caiv4HbJ9bh07lTk3OOQkmHjtCIh0CH_0 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1051591646870222062', time=2024-09-12T02:55:56.865578+0000, chain.objs.size()=1 2024-09-12T01:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Okubqz2uQgKwqN0fJbEkQy_BAk_0Wsn_0 2024-09-12T01:07:26.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8498571634986501112', time=2024-09-12T02:55:56.866371+0000, chain.objs.size()=1 2024-09-12T01:07:26.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.848+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.EyX69pKXbgY2W9Jx58fKZK4CKukhD0P_0 2024-09-12T01:07:26.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12611795411168842629', time=2024-09-12T02:55:56.890317+0000, chain.objs.size()=1 2024-09-12T01:07:26.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fSW3sGE7IBwilE6bUxbjq8KLru4MbAz_0 2024-09-12T01:07:26.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17876481863224609316', time=2024-09-12T02:57:28.359910+0000, chain.objs.size()=1 2024-09-12T01:07:26.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.457__shadow_.sHKweus3V8zsLzkt2jMwFRU0kxCpE8z_0 2024-09-12T01:07:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2114076781849003666', time=2024-09-12T02:57:55.433154+0000, chain.objs.size()=1 2024-09-12T01:07:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.499__shadow_.EzZotzh5ubG_ia3si95PyNHYAHD53iW_0 2024-09-12T01:07:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1563648907023931839', time=2024-09-12T02:58:18.034533+0000, chain.objs.size()=3 2024-09-12T01:07:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~OHgfkaZIcqUkrpDAtfNl15wf1ycQcol.1 2024-09-12T01:07:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~OHgfkaZIcqUkrpDAtfNl15wf1ycQcol.2 2024-09-12T01:07:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~OHgfkaZIcqUkrpDAtfNl15wf1ycQcol.3 2024-09-12T01:07:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~5ZDlq49vQfi_Wd09ZCI_f1HQmtFSSAy', time=2024-09-12T02:58:48.844242+0000, chain.objs.size()=1 2024-09-12T01:07:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.852+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.531__multipart_mymultipart.2~5ZDlq49vQfi_Wd09ZCI_f1HQmtFSSAy.1 2024-09-12T01:07:26.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/56273 2024-09-12T01:07:26.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:07:26.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14197703628544596315', time=2024-09-12T02:59:57.613784+0000, chain.objs.size()=1 2024-09-12T01:07:26.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:-9YZCyKIoojWpzGJUV0alJZ.twaBMaw_.l3u4Sx9lwifVCwTj4XT5qZSboC3GSW9_0 2024-09-12T01:07:26.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10884384347340428114', time=2024-09-12T03:00:00.613979+0000, chain.objs.size()=1 2024-09-12T01:07:26.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.570__shadow:D9PvXpwtKLKnCnt0xAuf8A1GW4dT6wq_.H15XEKi9gTFJOeJQHTInabV8Ct6NEak_0 2024-09-12T01:07:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11760826825775935445', time=2024-09-12T03:00:16.484038+0000, chain.objs.size()=1 2024-09-12T01:07:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:d.xQZm8.bXyhewSVQu1DtVVs2yqbnnO_.d539ebavb_he6YM6x_ZBu_DccJ66mw3_0 2024-09-12T01:07:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10364247329334346504', time=2024-09-12T03:00:41.687995+0000, chain.objs.size()=1 2024-09-12T01:07:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.586__shadow:TCJJzLjFCO3sA24NcRY1Tc0rTDj1-EQ_.rZCIHQIMfL1NkHuGt_1mbs90ZL4ae7A_0 2024-09-12T01:07:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18241442321715283327', time=2024-09-12T03:04:11.889729+0000, chain.objs.size()=1 2024-09-12T01:07:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.696__shadow:tucPLxAHGYWnsovDudCSWU.YhDwqGMG_.Bc9h-Z1ze5TFPt_lpqVYKsobDSbbRnw_0 2024-09-12T01:07:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16368976797874768184', time=2024-09-12T03:05:00.394726+0000, chain.objs.size()=1 2024-09-12T01:07:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.856+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.739__shadow_.dySjalBsJaSh-5NNyStc_vp5d1UsaP2_0 2024-09-12T01:07:26.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.860+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:07:26.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47885' 2024-09-12T01:07:26.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3444634497177215570', time=2024-09-12T02:51:30.956462+0000, chain.objs.size()=1 2024-09-12T01:07:26.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.eanQim05TROv--CUiGrgar6uxV3SLex_0 2024-09-12T01:07:26.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3602168544035052863', time=2024-09-12T02:53:52.180953+0000, chain.objs.size()=1 2024-09-12T01:07:26.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.247__shadow_.BXWd-K0ujq8mIQ0bpRKPW3Z4KqE4JF1_0 2024-09-12T01:07:26.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.787354910355171116', time=2024-09-12T02:54:01.989571+0000, chain.objs.size()=1 2024-09-12T01:07:26.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.261__shadow_.xq8O7ZTjm0nj7TbmvUILVK7Gc93AHux_0 2024-09-12T01:07:26.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7702099979612662652', time=2024-09-12T02:54:23.012207+0000, chain.objs.size()=1 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Mss6lM7B6yL6Ya6RZdNh4__s5XNl1z9_0 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1792436340306535544', time=2024-09-12T02:54:23.056287+0000, chain.objs.size()=1 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gYjkz9VkucuMY-MQ9p0yzRIrWaTWqHj_0 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7546330325569629160', time=2024-09-12T02:54:23.134751+0000, chain.objs.size()=1 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uNJrhdy5ThOJnzsvNWx3fCfGIynKEXS_0 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4887888453519824845', time=2024-09-12T02:54:23.166485+0000, chain.objs.size()=1 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.y9UcOz6Pycw33TNAs7vCb8GbfTh8c0i_0 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9950849347430662378', time=2024-09-12T02:54:23.249389+0000, chain.objs.size()=1 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0JRNZ2juhwwhrAgdyKjJ9ZYGqpKYBiZ_0 2024-09-12T01:07:26.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18204155524752612165', time=2024-09-12T02:54:23.256505+0000, chain.objs.size()=1 2024-09-12T01:07:26.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WASnPEc4HCWe_YhEseoG8ohsCT_ZWDe_0 2024-09-12T01:07:26.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7942071262392609188', time=2024-09-12T02:54:23.257430+0000, chain.objs.size()=1 2024-09-12T01:07:26.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ujCzfzO4r2YlzUwdLoh3_HRgfCrSU4g_0 2024-09-12T01:07:26.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11772348258049505776', time=2024-09-12T02:54:23.403122+0000, chain.objs.size()=1 2024-09-12T01:07:26.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gVnyQuWpn0loy1GqEEDqbVyybNs0YDx_0 2024-09-12T01:07:26.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5735254020634982382', time=2024-09-12T02:54:23.436453+0000, chain.objs.size()=1 2024-09-12T01:07:26.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.864+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Wbpa4JakGm8MXAmWgTj2lK4Cou5WLsZ_0 2024-09-12T01:07:26.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.472163440590954421', time=2024-09-12T02:54:23.444133+0000, chain.objs.size()=1 2024-09-12T01:07:26.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.EbiKbQYl9lNrCX4z_OOBfJMPq89jKxh_0 2024-09-12T01:07:26.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.779307732232188552', time=2024-09-12T02:54:23.445749+0000, chain.objs.size()=1 2024-09-12T01:07:26.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RNirpQAU4DK7pAOo-7wMLbNe--2sFOD_0 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2589664137032410275', time=2024-09-12T02:54:23.504307+0000, chain.objs.size()=1 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.D7sMgiU19DLdXEmnzMEkCmML0a1WrXb_0 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7278991775907571043', time=2024-09-12T02:54:23.518792+0000, chain.objs.size()=1 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IEvmLVpAI4H9v9ku0qEGqfoFa8lKSyN_0 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10437426965683059327', time=2024-09-12T02:54:23.583453+0000, chain.objs.size()=1 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pEa43bKarVqHSkX-glfaZ_gvQc9-WRN_0 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13168201162745274920', time=2024-09-12T02:54:23.591328+0000, chain.objs.size()=1 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.U67lVQ-3pG5RYz5ryyHHO_BeFAxqiZD_0 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2019798127495825280', time=2024-09-12T02:54:23.777140+0000, chain.objs.size()=1 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.R8dzc_P0q312BOtfAM5uJ4bQ0G8OmPG_0 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17893527525663812967', time=2024-09-12T02:54:23.782927+0000, chain.objs.size()=1 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eRfLFgvUyE2Ua_Jf6Kep-CUsNSKgp8p_0 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13911373242010202008', time=2024-09-12T02:54:24.003305+0000, chain.objs.size()=1 2024-09-12T01:07:26.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Y9MIkaW_76IlCR0D64na6WkjEijRoxl_0 2024-09-12T01:07:26.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16143231286099021127', time=2024-09-12T02:54:24.135120+0000, chain.objs.size()=1 2024-09-12T01:07:26.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.p1pDV2nJJ1X-_7-REcpsUl7Xnm7dQ3G_0 2024-09-12T01:07:26.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13784920879750708058', time=2024-09-12T02:54:24.941133+0000, chain.objs.size()=1 2024-09-12T01:07:26.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.868+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2-GjHmAp10Ja_JrqUtfJqMfmJ-lwfP1_0 2024-09-12T01:07:26.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17158900453781949222', time=2024-09-12T02:54:25.175960+0000, chain.objs.size()=1 2024-09-12T01:07:26.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CeRBT3U3ar0cLEmv6eEu74_F_jF57CD_0 2024-09-12T01:07:26.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5265472158046556215', time=2024-09-12T02:54:25.198023+0000, chain.objs.size()=1 2024-09-12T01:07:26.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nqcMKm4YndL-9XLXEwPnVKEgqEdqNOt_0 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10367796393810714979', time=2024-09-12T02:54:25.247818+0000, chain.objs.size()=1 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eXpIwvFC6FvcFWmBmMM2E4mWf6f4M4p_0 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5089596445111048459', time=2024-09-12T02:54:25.254616+0000, chain.objs.size()=1 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ESfJnhFq-Lm9Wfg5_An9gHqN5pDErlL_0 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1662873132513162718', time=2024-09-12T02:54:25.262713+0000, chain.objs.size()=1 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fawQ8gH6N6VkHyyAcMWleIJdTI6WuuX_0 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18433596908430712489', time=2024-09-12T02:54:25.357459+0000, chain.objs.size()=1 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9h1-jouBD0XCnqpYDX4JM1Sy5i4czS6_0 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18392379099003570019', time=2024-09-12T02:54:25.543001+0000, chain.objs.size()=1 2024-09-12T01:07:26.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.872+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PonMdkUt5jTbBTv_I1XYD2KIfUdaaNK_0 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.980394724674866379', time=2024-09-12T02:54:25.702313+0000, chain.objs.size()=1 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ztI22uU4CgRxMiDYXLr2DJ03CTsDBMu_0 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16844605735109463038', time=2024-09-12T02:54:25.906714+0000, chain.objs.size()=1 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.i1IPAM_vBYTOiX76Z9gk47M_wOQJGam_0 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11137725304363919361', time=2024-09-12T02:54:25.937254+0000, chain.objs.size()=1 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RvyyjWkG0blxjxMHPkH1OBBwU49OuSJ_0 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3408727022575586714', time=2024-09-12T02:54:25.939298+0000, chain.objs.size()=1 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2xt4mDsB5nJNeH9OyHk4DUbIcz36bHf_0 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18233740919082756458', time=2024-09-12T02:54:41.889387+0000, chain.objs.size()=1 2024-09-12T01:07:26.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285__shadow_.hB8z9nRjXreLxs8sIA6XKmHc8VbrwV6_0 2024-09-12T01:07:26.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3430840773199186961', time=2024-09-12T02:54:49.392260+0000, chain.objs.size()=1 2024-09-12T01:07:26.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.fLJ5aPe4xXxM3Fxm8pLwmzs_wvIby2A_0 2024-09-12T01:07:26.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9908527982618182303', time=2024-09-12T02:54:49.409440+0000, chain.objs.size()=1 2024-09-12T01:07:26.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.xfyQvW8Y-ADnvClVMLJe76rLa1JwZRv_0 2024-09-12T01:07:26.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3160972850258424224', time=2024-09-12T02:54:52.185141+0000, chain.objs.size()=1 2024-09-12T01:07:26.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.297__shadow_.fQJg9L2y_cfbh3QOjiu6Vgz_nzqfhxj_0 2024-09-12T01:07:26.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4195544063524764479', time=2024-09-12T02:54:52.940961+0000, chain.objs.size()=1 2024-09-12T01:07:26.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.876+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.298__shadow_.pf6mGCnXWrovFgoF2PbtDrqsY5St9uy_0 2024-09-12T01:07:26.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7198528526696994754', time=2024-09-12T02:54:54.439144+0000, chain.objs.size()=1 2024-09-12T01:07:26.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.300__shadow_.t7U6O8y9mPHjiNoat22nCbwu6wOk-n0_0 2024-09-12T01:07:26.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18090078097346812897', time=2024-09-12T02:54:55.130471+0000, chain.objs.size()=1 2024-09-12T01:07:26.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.301__shadow_.DiC2s5NRaqp5clTN4Y0AGsMpw6aRraY_0 2024-09-12T01:07:26.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12543960312885358351', time=2024-09-12T02:55:08.777101+0000, chain.objs.size()=1 2024-09-12T01:07:26.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.321__shadow_.1_gSRe4EMNufQ9KS4Pm6KWWDQbQqT4f_0 2024-09-12T01:07:26.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7253900556708226843', time=2024-09-12T02:55:30.857449+0000, chain.objs.size()=1 2024-09-12T01:07:26.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YqK049-ri_tddyXR3wORUjsNnnjSrbl_0 2024-09-12T01:07:26.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17193641066832369680', time=2024-09-12T02:55:31.024374+0000, chain.objs.size()=1 2024-09-12T01:07:26.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3Nl5W9Xa2ibUMW_1b3dI0OV5TdpovyL_0 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14512683054114066984', time=2024-09-12T02:55:31.059508+0000, chain.objs.size()=1 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._p6yFgoW5VwaiwXet8cflKIaSGxRl1p_0 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13371101249018046488', time=2024-09-12T02:55:31.068365+0000, chain.objs.size()=1 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GLeyqLnegM3e1lwZly4ADcIwlcmvTca_0 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18279891569263232425', time=2024-09-12T02:55:31.082380+0000, chain.objs.size()=1 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0OzeV5eADGrChBD6mRNhGy2ycBIBg1n_0 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16966812484678089379', time=2024-09-12T02:55:31.231419+0000, chain.objs.size()=1 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HuRtleEpdeFcGQuaEd8-HAETPWjs9_s_0 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17133677388792276281', time=2024-09-12T02:55:31.279239+0000, chain.objs.size()=1 2024-09-12T01:07:26.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.R52CAmqYbykenpwvCcV-foMJoQ_k5VT_0 2024-09-12T01:07:26.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5132495410235419644', time=2024-09-12T02:55:31.425079+0000, chain.objs.size()=1 2024-09-12T01:07:26.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.880+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dMxyEH3lic66Y5hg4XKrazHpPcK6yzs_0 2024-09-12T01:07:26.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4661964233198880487', time=2024-09-12T02:55:31.605017+0000, chain.objs.size()=1 2024-09-12T01:07:26.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.B9sGYjnqEQTMKQ44nJtXG114quqxY_-_0 2024-09-12T01:07:26.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7931003899762355242', time=2024-09-12T02:55:31.686785+0000, chain.objs.size()=1 2024-09-12T01:07:26.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hYOy6CEZasEekaIWri0ovrUqwZM_rMK_0 2024-09-12T01:07:26.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6306610451321078797', time=2024-09-12T02:55:31.735204+0000, chain.objs.size()=1 2024-09-12T01:07:26.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.G3lYYn_CWhxb_QGFNcUjWJSvJox7Bif_0 2024-09-12T01:07:26.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3612930978780984433', time=2024-09-12T02:55:31.739250+0000, chain.objs.size()=1 2024-09-12T01:07:26.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gGRVtmL5iUBqZV-CvYeEXbZv9MhyWyW_0 2024-09-12T01:07:26.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10089488791941657609', time=2024-09-12T02:55:31.897713+0000, chain.objs.size()=1 2024-09-12T01:07:26.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gGQSQgd4GzE1sO9kxqxXMrH-uOwQl9m_0 2024-09-12T01:07:26.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4705917277445652610', time=2024-09-12T02:55:31.901017+0000, chain.objs.size()=1 2024-09-12T01:07:26.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OoqloSbs8XC5SeFpPyMTJg-IBWon9Az_0 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11970711590699995620', time=2024-09-12T02:55:31.920120+0000, chain.objs.size()=1 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Pre0n4Q4Cq_Hyr3qq-UWC_pwaM5ABnd_0 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15473012805875142701', time=2024-09-12T02:55:31.946503+0000, chain.objs.size()=1 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KfGbahMSwdfWNbyiJsPawCNibuXr5AX_0 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18386167191947842521', time=2024-09-12T02:55:31.988501+0000, chain.objs.size()=1 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.EyljBLx3ycPFkdfjQIm-jQqoXJsFX4M_0 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.936827642094543746', time=2024-09-12T02:55:32.273416+0000, chain.objs.size()=1 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OlWWjbVaHtlI0vfoyegURHwfNkZtAgu_0 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3657228269497889715', time=2024-09-12T02:55:32.291857+0000, chain.objs.size()=1 2024-09-12T01:07:26.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.884+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tM9N0blsRa3jKMWQjfqcYtn4K38khkm_0 2024-09-12T01:07:26.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10704316052090272744', time=2024-09-12T02:55:32.315483+0000, chain.objs.size()=1 2024-09-12T01:07:26.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.fQ7YAbujE6IeyM3es1GwG1NtVB-2HVA_0 2024-09-12T01:07:26.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7033007238453818127', time=2024-09-12T02:55:32.340693+0000, chain.objs.size()=1 2024-09-12T01:07:26.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vlluP8lERvrLI5-O9IaSd-vH3BwPX_w_0 2024-09-12T01:07:26.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9991900590280135197', time=2024-09-12T02:55:32.360765+0000, chain.objs.size()=1 2024-09-12T01:07:26.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.B_S3COaSU0sNmjBRc20aLKK-x36t21a_0 2024-09-12T01:07:26.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8233765853801380614', time=2024-09-12T02:55:32.429132+0000, chain.objs.size()=1 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rP34BaO6WycoAxepJszeHzlMvYqnuXo_0 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7172149513753415561', time=2024-09-12T02:55:32.434788+0000, chain.objs.size()=1 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vdeRrLIiZqM2zCOAvfmz1_jCDao1HUN_0 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10546909869556907524', time=2024-09-12T02:55:32.561207+0000, chain.objs.size()=1 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kIq-L3pwnmoySeF4kJv2yXJ8gJBBceP_0 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14250403461464479307', time=2024-09-12T02:55:32.589535+0000, chain.objs.size()=1 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.CWXMfDYX0aoiJlRP0xNxvTLkTR7qaI-_0 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5396830607498740187', time=2024-09-12T02:55:32.850458+0000, chain.objs.size()=1 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XpjefTB3gSpEZz8V6W4o9G4BAnENl3b_0 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4810881962773628926', time=2024-09-12T02:55:33.005852+0000, chain.objs.size()=1 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.JxdAFp64sOFN-zP72n9u_eIc5W-k1WU_0 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4872415916767561744', time=2024-09-12T02:55:33.035126+0000, chain.objs.size()=1 2024-09-12T01:07:26.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lNOQtbmbUZeYrazFODkvumRTw9tZ5wG_0 2024-09-12T01:07:26.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8632568211435330530', time=2024-09-12T02:55:33.177068+0000, chain.objs.size()=1 2024-09-12T01:07:26.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.888+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.u9ZmAJlMP9FGG1eqbVUMRG7j-BEnDPX_0 2024-09-12T01:07:26.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18423840949164657012', time=2024-09-12T02:55:33.211164+0000, chain.objs.size()=1 2024-09-12T01:07:26.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RDsREy2lsZz8awExiUnhJEvT9SKiaNB_0 2024-09-12T01:07:26.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9912486124455859554', time=2024-09-12T02:55:33.232167+0000, chain.objs.size()=1 2024-09-12T01:07:26.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kyae0hnorehr-IIrajPtHrTa7mQGsta_0 2024-09-12T01:07:26.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.892+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9917045188460347495', time=2024-09-12T02:55:54.590653+0000, chain.objs.size()=1 2024-09-12T01:07:26.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.892+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PzWOZYkpV_Ke-7eKTQdqWHM4bWxN7k8_0 2024-09-12T01:07:26.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14284499137178804387', time=2024-09-12T02:55:54.603698+0000, chain.objs.size()=1 2024-09-12T01:07:26.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZDdfNWVdZS16Cfn_Hehadt6bGC1kOnu_0 2024-09-12T01:07:26.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10252088908333465678', time=2024-09-12T02:55:54.617420+0000, chain.objs.size()=1 2024-09-12T01:07:26.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bcQWwruNL-gQvRs-Vsv0oDp3gAFYuz9_0 2024-09-12T01:07:26.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.619931615320661995', time=2024-09-12T02:55:54.626705+0000, chain.objs.size()=1 2024-09-12T01:07:26.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.G1BZO3exx_-SUYmqcGuQ0azCdCUxxkN_0 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16643832709380514264', time=2024-09-12T02:55:54.642079+0000, chain.objs.size()=1 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZOXquA5Yu0svZFwGBEdzDb4iyVgw7Nc_0 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2189958506347870893', time=2024-09-12T02:55:54.838124+0000, chain.objs.size()=1 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UAG4VlZqqeMxI0lUi05IMQXdAryNJB4_0 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3866117436031868242', time=2024-09-12T02:55:54.845891+0000, chain.objs.size()=1 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.apiy-RWIYsv-se3YQf4ecVJXxTMLGiY_0 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15145751326994103666', time=2024-09-12T02:55:54.926543+0000, chain.objs.size()=1 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.72KKmbiVJ8jmduZ3exY3S46XRC-Gb7l_0 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3624260390154032510', time=2024-09-12T02:55:55.503369+0000, chain.objs.size()=1 2024-09-12T01:07:26.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.su-eQa-jzrvWUrR37o9rcmGAr3gM5Wg_0 2024-09-12T01:07:26.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3068891653661418425', time=2024-09-12T02:55:55.516752+0000, chain.objs.size()=1 2024-09-12T01:07:26.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NczKETiLueDS9zaMS_QUOnjYkEiFbNF_0 2024-09-12T01:07:26.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7794684322680854051', time=2024-09-12T02:55:55.575390+0000, chain.objs.size()=1 2024-09-12T01:07:26.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4M2_JkBh5_dpcyli4s3O9ZZZuVB_9KA_0 2024-09-12T01:07:26.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3981380730367901764', time=2024-09-12T02:55:55.589227+0000, chain.objs.size()=1 2024-09-12T01:07:26.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.896+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.75JVJf8tJKUC-gQDiW2O_M1cnb0KUwq_0 2024-09-12T01:07:26.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2361077357602149884', time=2024-09-12T02:55:55.638707+0000, chain.objs.size()=1 2024-09-12T01:07:26.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Na00xcLLwKsIucktic8Q9s5AVDqFILT_0 2024-09-12T01:07:26.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14334808911616887034', time=2024-09-12T02:55:55.685770+0000, chain.objs.size()=1 2024-09-12T01:07:26.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XDwr5urPZXXL2XPr-zD-ywyErsK6wpK_0 2024-09-12T01:07:26.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10342735215995207796', time=2024-09-12T02:55:55.836968+0000, chain.objs.size()=1 2024-09-12T01:07:26.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vh4kXWaYbkUN0fa2Apq97aQxB5njT1e_0 2024-09-12T01:07:26.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9314365017662314229', time=2024-09-12T02:55:55.884446+0000, chain.objs.size()=1 2024-09-12T01:07:26.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3mwsT9IL59Z_hmgZeasWW0SDYYENMq-_0 2024-09-12T01:07:26.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9252496532490314430', time=2024-09-12T02:55:55.930078+0000, chain.objs.size()=1 2024-09-12T01:07:26.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gZwwFVoe4thQYriZgNufFROayRDEgZS_0 2024-09-12T01:07:26.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15637687527964691780', time=2024-09-12T02:55:56.140019+0000, chain.objs.size()=1 2024-09-12T01:07:26.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ObuAKXAmYzwsbp1x_dcD7sLDaHJcUUl_0 2024-09-12T01:07:26.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10517178868253548472', time=2024-09-12T02:55:56.253793+0000, chain.objs.size()=1 2024-09-12T01:07:26.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.q1v_PB5YXybDGrsnJO03UQKSWCMC-o0_0 2024-09-12T01:07:26.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10466469959381254439', time=2024-09-12T02:55:56.324555+0000, chain.objs.size()=1 2024-09-12T01:07:26.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6xEj-Wj5Pebd6JuKVccQkHOio2pp9oN_0 2024-09-12T01:07:26.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15574511867856868663', time=2024-09-12T02:55:56.352175+0000, chain.objs.size()=1 2024-09-12T01:07:26.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1pmxPEL9hPyRstdWjzeFZgCzFIZ9G0H_0 2024-09-12T01:07:26.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13980262597658641629', time=2024-09-12T02:55:56.458570+0000, chain.objs.size()=1 2024-09-12T01:07:26.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JIfT1VKrDeKuO_p-qj0JpELb4ymgq2J_0 2024-09-12T01:07:26.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8305344399712253921', time=2024-09-12T02:55:56.513106+0000, chain.objs.size()=1 2024-09-12T01:07:26.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.900+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gxvUJAD5kqTtJn5uiVNiy1borKmzUPe_0 2024-09-12T01:07:26.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.904+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7411308508781965335', time=2024-09-12T02:55:56.515866+0000, chain.objs.size()=1 2024-09-12T01:07:26.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.tw9gvVTjeDo5qWuHoWgLJq6iLhJ3pVx_0 2024-09-12T01:07:26.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.904+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2358400657202367652', time=2024-09-12T02:55:56.565465+0000, chain.objs.size()=1 2024-09-12T01:07:26.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hCmY5zVyNFUpVgiriZ3LJ5zZgrMKDoS_0 2024-09-12T01:07:26.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.904+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4345885596637455019', time=2024-09-12T02:55:56.663399+0000, chain.objs.size()=1 2024-09-12T01:07:26.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OzEVFAaxPpTc9U0BOO6pC6v7Xuk8Fqn_0 2024-09-12T01:07:26.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.904+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47885 2024-09-12T01:07:26.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:07:26.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7664395283356821790', time=2024-09-12T02:55:56.808056+0000, chain.objs.size()=1 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1U2Kw6J2ZEvxF7e8eopfEwt0BB0TjZf_0 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12994032512952460871', time=2024-09-12T02:55:56.818546+0000, chain.objs.size()=1 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.98QHJqoiElIzr1tUNx-m42CYDU6dwfC_0 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17036558199082222228', time=2024-09-12T02:55:56.839922+0000, chain.objs.size()=1 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wzIaV3KW40SdADZbIj0Mfur48ruwg34_0 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8514831329439859969', time=2024-09-12T02:55:56.881852+0000, chain.objs.size()=1 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SyrzgYo9EN4fTZDJjTPjIBxKKBLhcsZ_0 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.306654826895451400', time=2024-09-12T02:55:56.883766+0000, chain.objs.size()=1 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5-ABawI6UKwmXHyEHlK7pPJBKp1JJS7_0 2024-09-12T01:07:26.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1292165466737303138', time=2024-09-12T02:55:56.916241+0000, chain.objs.size()=1 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.q0wKooxv7_Y4TvFQMy6mweJTJmWlSFX_0 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12600315000448942310', time=2024-09-12T02:56:03.120618+0000, chain.objs.size()=1 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.334__shadow_.Q0yYSOjmydKLdbviiF2r_z0ixKylBHy_0 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6943736540124835078', time=2024-09-12T02:56:34.082744+0000, chain.objs.size()=1 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.383__shadow_.ldaU8UINwfsSwjg7SJ-7sRoqMd32uFQ_0 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5053343364671499695', time=2024-09-12T02:57:14.299940+0000, chain.objs.size()=1 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.440__shadow_.aYn4oM-8Vuok0QN-nuLBwZjxdu_4WH1_0 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17674143432072865333', time=2024-09-12T02:57:20.355970+0000, chain.objs.size()=1 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.447__shadow_.OwxojBWVEUojDH7wZkpGk3eXJfiZHk2_0 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8896352665027458793', time=2024-09-12T02:57:23.247300+0000, chain.objs.size()=1 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.451__shadow_.ZoQzP6bM7gqu3qmehqYJ-z3XO5hn4-r_0 2024-09-12T01:07:26.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16228124074971763115', time=2024-09-12T02:57:34.457256+0000, chain.objs.size()=1 2024-09-12T01:07:26.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.908+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.463__shadow_._FZCrcp8V6MMwnc14I34Upl6cd-zUQe_0 2024-09-12T01:07:26.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9164094689222127003', time=2024-09-12T02:57:55.562667+0000, chain.objs.size()=1 2024-09-12T01:07:26.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.500__shadow_.EInWv_RagXct-RKjWvxfcdLWBi-mTaf_0 2024-09-12T01:07:26.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1968147492429813557', time=2024-09-12T02:58:17.426016+0000, chain.objs.size()=3 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~X9msh1rKVI-WKOORnuQQNHIu1GE4SJF.1 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~X9msh1rKVI-WKOORnuQQNHIu1GE4SJF.2 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~X9msh1rKVI-WKOORnuQQNHIu1GE4SJF.3 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1363873043065394497', time=2024-09-12T02:59:49.752439+0000, chain.objs.size()=1 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.566__shadow_.qBcw-U5OWdLFoZ-PKTh_3GTlOdJwwVT_0 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14577914404735657893', time=2024-09-12T02:59:54.341244+0000, chain.objs.size()=1 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:FP08CEiRQF6gpVE69WzLdZZYdw1AVNn_.UVJTYnc5NqTcItVJ0GQa1Y8rLPUqcEj_0 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8367663900781925939', time=2024-09-12T02:59:59.230258+0000, chain.objs.size()=1 2024-09-12T01:07:26.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:KkuSVqmLGQ5Gl9IjhgvW8lnf51YfHCT_.skBJuwkx4DlSQymW8HyOJktLcQVi9XV_0 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6837117506347768040', time=2024-09-12T03:00:00.682053+0000, chain.objs.size()=1 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.912+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.570__shadow:xVxfR-BShvKOisqmPQcXC-muoxLaDwY_.t-WhV3Yei0QDrgd7Rez1ia7Iuef9PRD_0 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8057613474087495156', time=2024-09-12T03:00:19.031185+0000, chain.objs.size()=1 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:7llooL7TzgnzgEOqGe1ZtZ14RhbOgWn_.63SMdd4Lg8_azW0ESybe2lwU-n5KHk3_0 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7679719402057777155', time=2024-09-12T03:00:27.585231+0000, chain.objs.size()=1 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:MbgcITEhIkk05GmJiXGNyB0Uok47VZT_.KwaSpgPlINngfSbpX8P9f3513-WTUed_0 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12375647035680563381', time=2024-09-12T03:00:37.107436+0000, chain.objs.size()=1 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:OWXWUOeiW0f1dDrybyO5kQ5JrSa1ayc_.H8tWYD1GaDycZWJ3RVa_PoqT_M6vbgD_0 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12459709156345514574', time=2024-09-12T03:00:41.671185+0000, chain.objs.size()=1 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.586__shadow:dl3lg4wq0y6mAkrcN64mNDkeWflhSwF_.KjyeS1ORpSgajkX8lHvwnTyYxHr2epB_0 2024-09-12T01:07:26.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1973098015701893862', time=2024-09-12T03:00:42.405743+0000, chain.objs.size()=1 2024-09-12T01:07:26.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:3WAIwEhTLktia0hI0z3vgYvgPaX6MkB_.0dJTw1-PeIr7c-hxKdaw3PX40YSaYbQ_0 2024-09-12T01:07:26.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14184312842224081355', time=2024-09-12T03:03:24.221201+0000, chain.objs.size()=1 2024-09-12T01:07:26.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.628__shadow_.jC5nwfmawT-Nj8zjz9Wg6lG5mOrVsrn_0 2024-09-12T01:07:26.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14878290653276284345', time=2024-09-12T03:03:57.366261+0000, chain.objs.size()=1 2024-09-12T01:07:26.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.672__shadow_.KsOv13B3jxfZtZbZK3eL0W1N_l4TMjF_0 2024-09-12T01:07:26.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17303890847413018695', time=2024-09-12T03:04:19.981446+0000, chain.objs.size()=1 2024-09-12T01:07:26.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.708__shadow:wgC-aK8aEqx5u4neK1gJMQkCwQAYhQA_.m4ZgsFcW1A97pmGGuqsU48jgUKAG6mS_0 2024-09-12T01:07:26.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1452081254807703113', time=2024-09-12T03:04:23.692314+0000, chain.objs.size()=1 2024-09-12T01:07:26.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.714__shadow:sYtJ54s2M0OC8ctdF7Bl4ImS4g4kN4r_.8sbi3JBxkW0hCDU7146Eamk94zHLz4W_0 2024-09-12T01:07:26.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15428163815849309942', time=2024-09-12T03:05:20.528483+0000, chain.objs.size()=1 2024-09-12T01:07:26.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.916+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.745__shadow_.RUZPLNcr9XY6egUWTcFou5vY6QKC2Cl_0 2024-09-12T01:07:26.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.920+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:07:26.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.924+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49270' 2024-09-12T01:07:26.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_BoaDajXbDwqC2DM5d-A7WC1j8Brjwxr', time=2024-09-12T02:51:32.225046+0000, chain.objs.size()=1 2024-09-12T01:07:26.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.vA0ixKdS07dVqEyQqMtgOL_VB27QDqn_0 2024-09-12T01:07:26.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8401643654421798079', time=2024-09-12T02:53:45.012989+0000, chain.objs.size()=1 2024-09-12T01:07:26.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.238__shadow_.FlJsgATy28ZA8Gn1Ppci83qEV2DnKQ0_0 2024-09-12T01:07:26.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10074283616848309361', time=2024-09-12T02:53:48.913842+0000, chain.objs.size()=1 2024-09-12T01:07:26.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.243__shadow_.IiiQVtQYU9trGZPPer5RCptWYzq7Hkm_0 2024-09-12T01:07:26.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11151088351421082920', time=2024-09-12T02:53:54.963978+0000, chain.objs.size()=1 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.251__shadow_.gyS9h4LwOcwsiVjvn_82K61TF7OT7bJ_0 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9783932014240399128', time=2024-09-12T02:53:57.087672+0000, chain.objs.size()=1 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.254__shadow_.eEbwHyghJQwzAKgaLYeVY5U0QxsvXvv_0 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16388514799947364470', time=2024-09-12T02:54:00.573148+0000, chain.objs.size()=1 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.259__shadow_.1MFlYY_mxbB5_SOmcvPPj1gkGzf4Hr1_0 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10151098423851554147', time=2024-09-12T02:54:23.044045+0000, chain.objs.size()=1 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.utL--nAE5R105LBeOFZ4DHgMf_1eFKg_0 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1008365084846729827', time=2024-09-12T02:54:23.264363+0000, chain.objs.size()=1 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zcoH0Z1yXHh_rm2mMA_hzW9cuM3e-Dn_0 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13020517683285950019', time=2024-09-12T02:54:23.429620+0000, chain.objs.size()=1 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Ho-SeRLbjbTbZbguS4JI6ZLsUO9JXeI_0 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12685803035644764097', time=2024-09-12T02:54:23.439711+0000, chain.objs.size()=1 2024-09-12T01:07:26.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.i9Ym7e_ysKnSNRJfZaJ1LTaqm8DkvOp_0 2024-09-12T01:07:26.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6673921690510267783', time=2024-09-12T02:54:23.448468+0000, chain.objs.size()=1 2024-09-12T01:07:26.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.tKO_D0f2kIjbj6M_NeDUxHFTeuFnb3y_0 2024-09-12T01:07:26.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8278835903228844287', time=2024-09-12T02:54:23.494754+0000, chain.objs.size()=1 2024-09-12T01:07:26.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nKJMszHwfxed3fXWfvculgrUYISFGv6_0 2024-09-12T01:07:26.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11061677807862583705', time=2024-09-12T02:54:23.572194+0000, chain.objs.size()=1 2024-09-12T01:07:26.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.928+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WaQylsRwrVLGR80iZXU5sxyD0C7tqIx_0 2024-09-12T01:07:26.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12783090097612746419', time=2024-09-12T02:54:23.745233+0000, chain.objs.size()=1 2024-09-12T01:07:26.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1ag2LhKdYPk_ASW5JVN3KMrz7kgCaWh_0 2024-09-12T01:07:26.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1706989584364421323', time=2024-09-12T02:54:24.070271+0000, chain.objs.size()=1 2024-09-12T01:07:26.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jd0VPZH2eN_M5eRqt2Z7ctd8pLInZFt_0 2024-09-12T01:07:26.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15792229928448777608', time=2024-09-12T02:54:24.143165+0000, chain.objs.size()=1 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qUOFoMwuEtZ0rF63TatYzF5BypWMVLi_0 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14708587898180804832', time=2024-09-12T02:54:24.162484+0000, chain.objs.size()=1 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.w8C_UYg_cUBqhQOBdjb-hIS_r0kX6IQ_0 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5064243245888924624', time=2024-09-12T02:54:24.177003+0000, chain.objs.size()=1 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uYNKitzZkFP4YBmK4LTCB8SXkfv0W0H_0 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18422951969877082714', time=2024-09-12T02:54:24.213732+0000, chain.objs.size()=1 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.w1_FznnDOvuZbRPsIBVmifkhWqs3qF7_0 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10410195852477185205', time=2024-09-12T02:54:24.362429+0000, chain.objs.size()=1 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CpBmp5_hpsuQfQS_kFYADsHu36GQKm7_0 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8208558740445072557', time=2024-09-12T02:54:24.385479+0000, chain.objs.size()=1 2024-09-12T01:07:26.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1NgfvD8hr65uMvEhYq4gUL6RPr6huWZ_0 2024-09-12T01:07:26.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10516873800781679845', time=2024-09-12T02:54:24.429055+0000, chain.objs.size()=1 2024-09-12T01:07:26.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2IDil0RrQtXZQKCOdKj2Bob_usyJud9_0 2024-09-12T01:07:26.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9474751743992088904', time=2024-09-12T02:54:24.476471+0000, chain.objs.size()=1 2024-09-12T01:07:26.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jaef8ln32JScvD0cfgY2TUWBqS17TVh_0 2024-09-12T01:07:26.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7495742168500306864', time=2024-09-12T02:54:24.479301+0000, chain.objs.size()=1 2024-09-12T01:07:26.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.932+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._feizNKgM6VXYEg5yY845ZlZbtXK6XB_0 2024-09-12T01:07:26.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1799021366976003592', time=2024-09-12T02:54:24.941920+0000, chain.objs.size()=1 2024-09-12T01:07:26.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.7ZC687QR0gcVsf9JCXmEBhrkmoGu-eJ_0 2024-09-12T01:07:26.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15756130830234227109', time=2024-09-12T02:54:25.238729+0000, chain.objs.size()=1 2024-09-12T01:07:26.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.O0W1lJrmM4-dHKgJtt2MbpKK8JWBXY-_0 2024-09-12T01:07:26.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2942534026236924924', time=2024-09-12T02:54:25.355264+0000, chain.objs.size()=1 2024-09-12T01:07:26.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.U_FyI0LbO-B1ZcESGtirLdFMwu0MirL_0 2024-09-12T01:07:26.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.905391922718968857', time=2024-09-12T02:54:25.677107+0000, chain.objs.size()=1 2024-09-12T01:07:26.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.SHO0BWHXMyGvzjbLTZPUzlwyXETOaRU_0 2024-09-12T01:07:26.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15252788925789480834', time=2024-09-12T02:54:25.970039+0000, chain.objs.size()=1 2024-09-12T01:07:26.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.myLEVhJRp0IKmgmAecg3QN4egyohENt_0 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18131935236986334350', time=2024-09-12T02:54:25.990916+0000, chain.objs.size()=1 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zGM2kvHIJWHAuy28OSBQ_4LLSgSy4-__0 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9404754709757425112', time=2024-09-12T02:54:25.998181+0000, chain.objs.size()=1 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pwYAr1SmrEdF8KqWV_GhUYCQDgq1Dtz_0 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7258705009146977735', time=2024-09-12T02:54:26.002643+0000, chain.objs.size()=1 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fB3TJl3C9qksJHeL_Vz3SGwGMt4U09j_0 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13143329061607168928', time=2024-09-12T02:54:27.304724+0000, chain.objs.size()=1 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.264__shadow_.E-4vJAkAs6Wr1_6MpYmK8cVYrxGmZL1_0 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7890383838496353928', time=2024-09-12T02:54:38.331899+0000, chain.objs.size()=1 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.280__shadow_.pJhGLfvK-iijVm5Wq84rkzAd8xJQpwQ_0 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14303031832011787818', time=2024-09-12T02:54:39.772928+0000, chain.objs.size()=1 2024-09-12T01:07:26.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.936+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.282__shadow_.9qO1gI05q4upluNwE4DS9I3wcqUphzo_0 2024-09-12T01:07:26.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15626555592143316577', time=2024-09-12T02:54:47.916375+0000, chain.objs.size()=1 2024-09-12T01:07:26.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.YRIp3NJsS18hiMwerzLIg4bsXuqOPDC_0 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8887366921831425355', time=2024-09-12T02:54:49.382164+0000, chain.objs.size()=1 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.bsH0vKEEbHeQwQzJp85ojrWzCl8uUz0_0 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2487374436251371050', time=2024-09-12T02:54:57.161157+0000, chain.objs.size()=1 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.304__shadow_.wRV_eF1W34nZsiPQ4D1oPwvm8oOdvDk_0 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13094631437234258747', time=2024-09-12T02:54:59.864426+0000, chain.objs.size()=1 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.307__shadow:XytUDsPyiuE9BB-jcLO-ZyhZwD882kM_.O_LMp8Oqz96HMimdG3Zp9kekhqs3Ind_0 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7179235425576075394', time=2024-09-12T02:55:05.608868+0000, chain.objs.size()=1 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.315__shadow_.qIiM-leWaouZ3hsAZQO2P6pzwsF-4CA_0 2024-09-12T01:07:26.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5089229164551056422', time=2024-09-12T02:55:30.853759+0000, chain.objs.size()=1 2024-09-12T01:07:26.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.t69AVTc-RMp5BTZugXEkggZ2Gy4ndRn_0 2024-09-12T01:07:26.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17901013087320809712', time=2024-09-12T02:55:30.872852+0000, chain.objs.size()=1 2024-09-12T01:07:26.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yLgNAQuSmrwaW3cApY4qqQqVecYzYCF_0 2024-09-12T01:07:26.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14894514072152007932', time=2024-09-12T02:55:30.987166+0000, chain.objs.size()=1 2024-09-12T01:07:26.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.940+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WW7kNhTJ3EYAJ3wYAdKtBPjQCjlrdQ1_0 2024-09-12T01:07:26.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16944220225856034413', time=2024-09-12T02:55:30.994343+0000, chain.objs.size()=1 2024-09-12T01:07:26.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RDQrB3UVfxNlOjC3aoO1X8qbUSB0oq1_0 2024-09-12T01:07:26.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8658397672570452052', time=2024-09-12T02:55:31.036355+0000, chain.objs.size()=1 2024-09-12T01:07:26.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1gN459nXnrQXqcx6srL0R7469HbgqlO_0 2024-09-12T01:07:26.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3186161106413254488', time=2024-09-12T02:55:31.041095+0000, chain.objs.size()=1 2024-09-12T01:07:26.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rWlT1R6fyPFXW4y4P5K4Eg2ZSBn9Wbn_0 2024-09-12T01:07:26.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1140257776576642033', time=2024-09-12T02:55:31.259361+0000, chain.objs.size()=1 2024-09-12T01:07:26.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Rb8X747NealxolfZMALR6leTlPGK3qI_0 2024-09-12T01:07:26.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11352407102112682119', time=2024-09-12T02:55:31.270469+0000, chain.objs.size()=1 2024-09-12T01:07:26.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ClBOhDCplnm_f27zSJa7qTP64hNi7rj_0 2024-09-12T01:07:26.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.992304242492834217', time=2024-09-12T02:55:31.351985+0000, chain.objs.size()=1 2024-09-12T01:07:26.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.u8CMMXISMbcpbwqzIWD3tHV4h7rPMAV_0 2024-09-12T01:07:26.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15531332301733289880', time=2024-09-12T02:55:31.422099+0000, chain.objs.size()=1 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VQ2KSBXCUBWg8aDSRw-G-Xbb-bnGeMv_0 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9221417811442545807', time=2024-09-12T02:55:31.428543+0000, chain.objs.size()=1 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.84fMlsGa0-01XdjvGid3MFUxwDZhTHP_0 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17220349832765524735', time=2024-09-12T02:55:31.593867+0000, chain.objs.size()=1 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.beTGOGSQ_fs5zXngd2hn3b538o39YbY_0 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12125061974578576906', time=2024-09-12T02:55:31.602114+0000, chain.objs.size()=1 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xNUIueZiL3nwQvzKg-jpsKBi4Bcm6wL_0 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13144872150205256561', time=2024-09-12T02:55:31.645768+0000, chain.objs.size()=1 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bh6vo47I5a5gUaHmVTs9_Ajm0hm48If_0 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6918847143018063818', time=2024-09-12T02:55:31.669325+0000, chain.objs.size()=1 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eZPB5jy29LBXGfGEjy6ir8kXZvfWYK7_0 2024-09-12T01:07:26.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13727979842958404273', time=2024-09-12T02:55:31.693385+0000, chain.objs.size()=1 2024-09-12T01:07:26.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ApJfpxo6rbilRlBNdLlQa9YmC4Ya_NU_0 2024-09-12T01:07:26.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11677639040592969543', time=2024-09-12T02:55:31.696940+0000, chain.objs.size()=1 2024-09-12T01:07:26.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.944+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.NeM9o1tkZObM8TNG8Pg6JYgziresSJA_0 2024-09-12T01:07:26.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10331721981113871715', time=2024-09-12T02:55:31.906288+0000, chain.objs.size()=1 2024-09-12T01:07:26.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gQSSeuRxztk_YserNjYYR4s-0zGeu0P_0 2024-09-12T01:07:26.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12273423626090991007', time=2024-09-12T02:55:32.069149+0000, chain.objs.size()=1 2024-09-12T01:07:26.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.nl4M8OZNwnrIJCm0Nl6eMUcdFjnTfVY_0 2024-09-12T01:07:26.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5562074161655813971', time=2024-09-12T02:55:32.264420+0000, chain.objs.size()=1 2024-09-12T01:07:26.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.llvQympSt4em0aTOTmLHowPkYh7OmxA_0 2024-09-12T01:07:26.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.948+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.50325414683881846', time=2024-09-12T02:55:32.580049+0000, chain.objs.size()=1 2024-09-12T01:07:26.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.948+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.UIjPnXeKE-wD_GsAmMqMVNfJZWpuu3U_0 2024-09-12T01:07:26.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6342692294369489441', time=2024-09-12T02:55:32.859121+0000, chain.objs.size()=1 2024-09-12T01:07:26.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kKvMHF3K00LpI8TguOXHew-_832EF0N_0 2024-09-12T01:07:26.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7884818842329604503', time=2024-09-12T02:55:32.870580+0000, chain.objs.size()=1 2024-09-12T01:07:26.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.of1n2GV5pPIVfZQDdY_8MnJIyywYm8r_0 2024-09-12T01:07:26.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10498415647836920497', time=2024-09-12T02:55:32.908536+0000, chain.objs.size()=1 2024-09-12T01:07:26.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3ttPzqYCX9wIkspNUj5hqnyAOznJwDI_0 2024-09-12T01:07:26.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8887180155864511592', time=2024-09-12T02:55:33.018311+0000, chain.objs.size()=1 2024-09-12T01:07:26.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pKOhhuWEEMX3cjj4SqgDgrmtchR4T5l_0 2024-09-12T01:07:26.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11929950949759323214', time=2024-09-12T02:55:33.042678+0000, chain.objs.size()=1 2024-09-12T01:07:26.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3qDioCF0tVswaVquyrg08Bw5iUyWDPf_0 2024-09-12T01:07:26.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2764676634243278374', time=2024-09-12T02:55:33.186822+0000, chain.objs.size()=1 2024-09-12T01:07:26.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.I5hNia2kxS5JVMJU7wNw15wFpRBX-L4_0 2024-09-12T01:07:26.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6627710412097002720', time=2024-09-12T02:55:33.244119+0000, chain.objs.size()=1 2024-09-12T01:07:26.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1PDyvBolTup6L8_57G5KzzUUkpAn37i_0 2024-09-12T01:07:26.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2910369307767539231', time=2024-09-12T02:55:33.254139+0000, chain.objs.size()=1 2024-09-12T01:07:26.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7iC-GNXuo6VdXh8CsiYZKC151_aO3fH_0 2024-09-12T01:07:26.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10451606917617593598', time=2024-09-12T02:55:33.300604+0000, chain.objs.size()=1 2024-09-12T01:07:26.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LDfuRvbKjrsgxA87GEF_jx7itOEqqGk_0 2024-09-12T01:07:26.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11497652986020162261', time=2024-09-12T02:55:54.451029+0000, chain.objs.size()=1 2024-09-12T01:07:26.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.KF8am4XqtF0IP2LOhNXZ1FTwJ0LWTqP_0 2024-09-12T01:07:26.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5942078462120804152', time=2024-09-12T02:55:54.633357+0000, chain.objs.size()=1 2024-09-12T01:07:26.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.952+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qBYIefQ7w-tC4b1IbG7pyBV8kQLzJlx_0 2024-09-12T01:07:26.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4444711400662608102', time=2024-09-12T02:55:54.851537+0000, chain.objs.size()=1 2024-09-12T01:07:26.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NtC_jqFwa4EPK7eLzX0LlH2FFjc6T1L_0 2024-09-12T01:07:26.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9140960384105697601', time=2024-09-12T02:55:54.907739+0000, chain.objs.size()=1 2024-09-12T01:07:26.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GL7ufy9fnmI2DtPOMuVmlbEoBzeGR-d_0 2024-09-12T01:07:26.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.749015612682915165', time=2024-09-12T02:55:54.974370+0000, chain.objs.size()=1 2024-09-12T01:07:26.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HHHkOI8DOmWilpdbpAizZ3GXH6eNR2V_0 2024-09-12T01:07:26.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.956+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3709116390196497349', time=2024-09-12T02:55:55.146021+0000, chain.objs.size()=1 2024-09-12T01:07:26.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.956+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.32IUm9Cm0JmWDrDxMSA1yKY6GODzBqb_0 2024-09-12T01:07:26.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15449866919288770270', time=2024-09-12T02:55:55.313919+0000, chain.objs.size()=1 2024-09-12T01:07:26.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zObk_o4J1prC0Gs5CqTzqqiWHEPHaDK_0 2024-09-12T01:07:26.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12185476844611362864', time=2024-09-12T02:55:55.459827+0000, chain.objs.size()=1 2024-09-12T01:07:26.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.emWMwIajXUuqlZySyN-DA0uWDG012zX_0 2024-09-12T01:07:26.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18414840076827932189', time=2024-09-12T02:55:55.489511+0000, chain.objs.size()=1 2024-09-12T01:07:26.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BEdWrNEjz3TmFo-Nv-r386CjJXYocIB_0 2024-09-12T01:07:26.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11098547482927232347', time=2024-09-12T02:55:55.608108+0000, chain.objs.size()=1 2024-09-12T01:07:26.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sYbwzf_roSIXfGiKuodZlJuPH9iXnz-_0 2024-09-12T01:07:26.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12126198610060909329', time=2024-09-12T02:55:55.611564+0000, chain.objs.size()=1 2024-09-12T01:07:26.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gxxkwIaNJzZWQCwCatYa4GxfA1mcO8A_0 2024-09-12T01:07:26.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13716496000532763254', time=2024-09-12T02:55:55.654316+0000, chain.objs.size()=1 2024-09-12T01:07:26.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9hEvZ68caNqMBy-xo7D3pgDP_bjDZV2_0 2024-09-12T01:07:26.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5817045196078259328', time=2024-09-12T02:55:55.673371+0000, chain.objs.size()=1 2024-09-12T01:07:26.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xucJOa7UxEZ4kxAp85UAfoNJg_BrDPL_0 2024-09-12T01:07:26.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10884304924183674362', time=2024-09-12T02:55:55.675901+0000, chain.objs.size()=1 2024-09-12T01:07:26.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Eq0MtGTvTcryN5nMv8xHyIy6t4eaMsS_0 2024-09-12T01:07:26.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7962053215086387323', time=2024-09-12T02:55:55.680055+0000, chain.objs.size()=1 2024-09-12T01:07:26.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.y7Ry3LSUfVYagQCstpzKNkssduHnZ5c_0 2024-09-12T01:07:26.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13603012470819776107', time=2024-09-12T02:55:55.682923+0000, chain.objs.size()=1 2024-09-12T01:07:26.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.960+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.oeedkz-Yiiqq6dh_HXoOb4dot-Pu2e1_0 2024-09-12T01:07:26.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.964+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6691438278323843416', time=2024-09-12T02:55:55.801563+0000, chain.objs.size()=1 2024-09-12T01:07:26.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.964+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.epXu9Oj3VchpG5VgqKJ7i9t3uulC3h__0 2024-09-12T01:07:26.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12088119915863642640', time=2024-09-12T02:55:55.821181+0000, chain.objs.size()=1 2024-09-12T01:07:26.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LVZk6lFoTheggJOf04F2HRL8Lg-BioW_0 2024-09-12T01:07:26.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16187867978525054406', time=2024-09-12T02:55:55.876822+0000, chain.objs.size()=1 2024-09-12T01:07:26.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PBai5BcHaQPG4L3OEJ5BLxCp9qngwox_0 2024-09-12T01:07:26.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10925545144925527534', time=2024-09-12T02:55:55.989837+0000, chain.objs.size()=1 2024-09-12T01:07:26.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2nW1q5gxO37kwWpCSID9ZgIKFAUAIN4_0 2024-09-12T01:07:26.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3017987146152847440', time=2024-09-12T02:55:56.147085+0000, chain.objs.size()=1 2024-09-12T01:07:26.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.675H1pZBznmExO-qMcQ-g4sHIKM8s-J_0 2024-09-12T01:07:26.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12348563361265790427', time=2024-09-12T02:55:56.181088+0000, chain.objs.size()=1 2024-09-12T01:07:26.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jARmP1yyuRgmSk_e7GQxzG5E1KjrYog_0 2024-09-12T01:07:26.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4114086543079386496', time=2024-09-12T02:55:56.244564+0000, chain.objs.size()=1 2024-09-12T01:07:26.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MdqCan14pCdTgiovyyRw_CPip1i-r84_0 2024-09-12T01:07:26.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18196292668741027850', time=2024-09-12T02:55:56.256266+0000, chain.objs.size()=1 2024-09-12T01:07:26.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UmtcMN8WpudWJz3ENvqzr3feviF07U3_0 2024-09-12T01:07:26.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4087889234444153345', time=2024-09-12T02:55:56.269464+0000, chain.objs.size()=1 2024-09-12T01:07:26.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.42A4fcx-txDI5t1TioGzeROOrRfq6rk_0 2024-09-12T01:07:26.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2345189749814796878', time=2024-09-12T02:55:56.290367+0000, chain.objs.size()=1 2024-09-12T01:07:26.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zxRlg9M3nurh40JEI05fupwSinYtbHi_0 2024-09-12T01:07:26.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7386550162890338400', time=2024-09-12T02:55:56.361034+0000, chain.objs.size()=1 2024-09-12T01:07:26.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WFS8UDEv5rZq2h-kvUOlMnYS2GeWZvI_0 2024-09-12T01:07:26.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17390162086761619071', time=2024-09-12T02:55:56.491509+0000, chain.objs.size()=1 2024-09-12T01:07:26.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.tNOTmg7jCVbzCekBUAlPL6XoyLAanYw_0 2024-09-12T01:07:26.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2994392019651677421', time=2024-09-12T02:55:56.534438+0000, chain.objs.size()=1 2024-09-12T01:07:26.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.968+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OM-9-pqjc_kuHf7tIOhkOqHihstFqpc_0 2024-09-12T01:07:26.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.972+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8095829588986249768', time=2024-09-12T02:55:56.540854+0000, chain.objs.size()=1 2024-09-12T01:07:26.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OkrN1pd_8YDChtJ1xVnjUEObpkTRgTM_0 2024-09-12T01:07:26.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.972+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49270 2024-09-12T01:07:26.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:07:26.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16275407402791236626', time=2024-09-12T02:55:56.557574+0000, chain.objs.size()=1 2024-09-12T01:07:26.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wBF5I_x-yx-pktzazkQjImtV1MvVMdw_0 2024-09-12T01:07:26.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13377875144057354980', time=2024-09-12T02:55:56.634239+0000, chain.objs.size()=1 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0R_jgNCkpZgMYW4RbcOVsYi835YiZTo_0 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11975061247640293819', time=2024-09-12T02:55:56.791061+0000, chain.objs.size()=1 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GPfd0vJexodZ4MTjDcb9A67D4kwt0DW_0 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1577039044799309993', time=2024-09-12T02:55:56.845385+0000, chain.objs.size()=1 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OlxwDf2ym5Z0We0eJd9d_oSaYH7Rdvp_0 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2935776475823564215', time=2024-09-12T02:55:56.896774+0000, chain.objs.size()=1 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nlUNgUP5lFsNWYhz_xZcmA5BEH0Leiu_0 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13193849074192099822', time=2024-09-12T02:55:56.902606+0000, chain.objs.size()=1 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.faxJ2nMD02AYquksmVcdRI_CKNgr5B-_0 2024-09-12T01:07:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1098854502567877124', time=2024-09-12T02:56:32.633987+0000, chain.objs.size()=1 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.381__shadow_.dt5bRldKLrXLUSMyw6g9VzUY-tI8fLG_0 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8443468422639491010', time=2024-09-12T02:58:46.240654+0000, chain.objs.size()=2 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.528__multipart_mymultipart.2~jXJA4ylP6o2-mfFYmLPt-UG5Bw6kgi5.1 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.528__multipart_mymultipart.2~jXJA4ylP6o2-mfFYmLPt-UG5Bw6kgi5.2 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7QiSjOdFyYBRZU4xQ6FDjAATNdn6XIe', time=2024-09-12T02:59:42.051317+0000, chain.objs.size()=1 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.561__multipart_mymultipart.2~7QiSjOdFyYBRZU4xQ6FDjAATNdn6XIe.1 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14356260920713347178', time=2024-09-12T02:59:55.661756+0000, chain.objs.size()=1 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:jwVdBoEoKartQSC6wyutB1mBvAL9bAd_._U6Rvq2WQtNDl74y5HDjA4kBo2nRmpc_0 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3934180386260933079', time=2024-09-12T02:59:57.889698+0000, chain.objs.size()=1 2024-09-12T01:07:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.976+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:MQu9tjHcreLxE-EPguPeokz6Q2O0eSw_.-LcDqPhi18HqycpGCwmxK9jLO7XDyBc_0 2024-09-12T01:07:26.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.929474375055470419', time=2024-09-12T03:00:02.392712+0000, chain.objs.size()=1 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.572__shadow:yrSrh621BjoRH5B4g19Xy2FPkLAdGh1_.uDITjabdWXRcSkyfz7rhKdFWj1k22x5_0 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9287676605738452708', time=2024-09-12T03:00:15.675418+0000, chain.objs.size()=1 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:.KLyPEAMbjWSeg63wllsjoz1Kzbrhba_.W7aTwS74g4p4qjuTwbZ6X2vWC9adhfR_0 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4225617460152866204', time=2024-09-12T03:00:53.877435+0000, chain.objs.size()=1 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.606__shadow_.wx7IHUORb1eIXa0iJJLAMc9F_v1JkNh_0 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18423899228031950526', time=2024-09-12T03:03:40.880846+0000, chain.objs.size()=1 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.651__shadow_.FEIPRb2zZEKwbxwEQgf6-4OlpxsF4-q_0 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9286981960209371739', time=2024-09-12T03:03:52.645618+0000, chain.objs.size()=1 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.664__shadow_.BWM9zR1gMIvspzCdt8bFgaOiccsIrBf_0 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3735421913527074429', time=2024-09-12T03:03:53.495457+0000, chain.objs.size()=1 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.665__shadow_.dYJjadMOZMl54qQsFX-VDqTOz3xYDVZ_0 2024-09-12T01:07:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2854160815592310959', time=2024-09-12T03:03:55.619976+0000, chain.objs.size()=1 2024-09-12T01:07:26.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.668__shadow_.8fj31Hsu1w_gTgbuJWq5yp0gfEaJIN7_0 2024-09-12T01:07:26.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13457139976345066489', time=2024-09-12T03:04:13.123817+0000, chain.objs.size()=1 2024-09-12T01:07:26.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.980+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.698__shadow:U9k8DK5i1dMUgVyGe.RjfDD6aeIy0SF_.tPAyYM_WKOwmgwDXgrofafODR4u1789_0 2024-09-12T01:07:26.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.984+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:26.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.984+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:07:26.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:26.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:26.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49106' 2024-09-12T01:07:26.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2252477327672104912', time=2024-09-12T02:51:28.809237+0000, chain.objs.size()=3 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.w6kzcJV9qqCR2Vo3TCnkHq7H2P4Hu1J_0 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.w6kzcJV9qqCR2Vo3TCnkHq7H2P4Hu1J_1 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.158__shadow_.w6kzcJV9qqCR2Vo3TCnkHq7H2P4Hu1J_2 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_eAOKcSPy6HqFPHf4c4qgMOK6iRi29y7', time=2024-09-12T02:51:33.160122+0000, chain.objs.size()=3 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_._qT8qZmJ26WEzF6Pf37DWex3XgZquqO_0 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_._qT8qZmJ26WEzF6Pf37DWex3XgZquqO_1 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_._qT8qZmJ26WEzF6Pf37DWex3XgZquqO_2 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9130368941935869315', time=2024-09-12T02:51:54.008437+0000, chain.objs.size()=1 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.188__shadow_.vwM2OAYtLdVzUAibodUGRGMEinAd0M__0 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14599268769134020580', time=2024-09-12T02:53:50.086619+0000, chain.objs.size()=1 2024-09-12T01:07:26.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.244__shadow_.zLs-p1kFQ9fPba-ewEgMSn8D9O8Wkbw_0 2024-09-12T01:07:26.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15707601112479252445', time=2024-09-12T02:53:50.781669+0000, chain.objs.size()=1 2024-09-12T01:07:26.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.245__shadow_.eckmWC9Aps7dgV10ajNrqoaWOyvppyZ_0 2024-09-12T01:07:26.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2056738592765406614', time=2024-09-12T02:53:50.786245+0000, chain.objs.size()=1 2024-09-12T01:07:26.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.245__shadow_.Jy4IDPnfA__GcFuZ8OLzHOFwKv8rGFo_0 2024-09-12T01:07:26.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3234153708534894804', time=2024-09-12T02:54:23.122260+0000, chain.objs.size()=1 2024-09-12T01:07:26.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.58viFk1n227m-J6JqHivuy50F71IX3b_0 2024-09-12T01:07:26.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16809313714810193517', time=2024-09-12T02:54:23.458931+0000, chain.objs.size()=1 2024-09-12T01:07:26.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.988+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vTyQPu0rf6nKALweDf8jBvdcNChGwFU_0 2024-09-12T01:07:26.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16978925819616550994', time=2024-09-12T02:54:23.494564+0000, chain.objs.size()=1 2024-09-12T01:07:26.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qFua9UvJPMUgNjGjXa_yeqvvo0POQr7_0 2024-09-12T01:07:26.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18434590339992820254', time=2024-09-12T02:54:23.499755+0000, chain.objs.size()=1 2024-09-12T01:07:26.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.luEdTJMGqixQGNC2bsXMelroz9Mge6s_0 2024-09-12T01:07:26.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4699327582110199740', time=2024-09-12T02:54:23.504957+0000, chain.objs.size()=1 2024-09-12T01:07:26.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.leVFkPnJq5w3YHbqMEWfC4SxfesDoYV_0 2024-09-12T01:07:26.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14325230224218242607', time=2024-09-12T02:54:23.585555+0000, chain.objs.size()=1 2024-09-12T01:07:26.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MDk2wahWOlpGd_kAzSS3-CN7nkZo30X_0 2024-09-12T01:07:26.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16237536019697717551', time=2024-09-12T02:54:23.779883+0000, chain.objs.size()=1 2024-09-12T01:07:26.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.oSLgBCLE2zA_TOpg5B97yoblP0F6TRN_0 2024-09-12T01:07:26.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1314414950127035250', time=2024-09-12T02:54:24.166341+0000, chain.objs.size()=1 2024-09-12T01:07:26.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GtOchvwg8ewf5H9R9gxCjleE3ftR12x_0 2024-09-12T01:07:26.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10322704034001045089', time=2024-09-12T02:54:24.363671+0000, chain.objs.size()=1 2024-09-12T01:07:26.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AHNs7bySfLF5Vr8wjDIMqOzEeilh9iJ_0 2024-09-12T01:07:26.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13695674068069263728', time=2024-09-12T02:54:24.460638+0000, chain.objs.size()=1 2024-09-12T01:07:26.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kQqYzl9z0x7eOT7uRcp7Ivic7npzVTc_0 2024-09-12T01:07:26.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13280379641400403572', time=2024-09-12T02:54:24.498637+0000, chain.objs.size()=1 2024-09-12T01:07:26.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-ZytgOsZ5Y6OPgLVptgX4nsZUGygg_i_0 2024-09-12T01:07:26.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14071832654787792568', time=2024-09-12T02:54:24.631285+0000, chain.objs.size()=1 2024-09-12T01:07:26.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qjINwbIp56bZjHuJi97GlFEdQdkNw-c_0 2024-09-12T01:07:26.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5735133921672148357', time=2024-09-12T02:54:24.761250+0000, chain.objs.size()=1 2024-09-12T01:07:26.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.992+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._sENcL7rgU_Gfqu0S7ICN-6xnTeawSM_0 2024-09-12T01:07:26.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6698901282636065043', time=2024-09-12T02:54:24.841785+0000, chain.objs.size()=1 2024-09-12T01:07:26.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pZ8taqlpJRsmtTbNK85RqYRdznUMnw0_0 2024-09-12T01:07:26.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1045896671091054359', time=2024-09-12T02:54:24.880188+0000, chain.objs.size()=1 2024-09-12T01:07:26.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IjaH6_sKeTGqGKqB5_tWL8XVegcZ2xi_0 2024-09-12T01:07:26.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12373112886360851289', time=2024-09-12T02:54:24.924359+0000, chain.objs.size()=1 2024-09-12T01:07:26.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2L_PF_NHNzlhrCWjXsKyDwljMYeF8_X_0 2024-09-12T01:07:26.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9505915267685212431', time=2024-09-12T02:54:24.954291+0000, chain.objs.size()=1 2024-09-12T01:07:26.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xboQOjIyt9w8x8KGLulSiLNxW1aNxzn_0 2024-09-12T01:07:26.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3529365860588389195', time=2024-09-12T02:54:25.128131+0000, chain.objs.size()=1 2024-09-12T01:07:26.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8849dEvkVE07DsfT7LWrqyObBJLsyXn_0 2024-09-12T01:07:26.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.741826869948563880', time=2024-09-12T02:54:25.195023+0000, chain.objs.size()=1 2024-09-12T01:07:26.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:26.996+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.W9mQq34SYIfCbSAxyQrYdzK2ljnTNax_0 2024-09-12T01:07:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6256359909240490796', time=2024-09-12T02:54:25.214617+0000, chain.objs.size()=1 2024-09-12T01:07:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rGH83VOq72QVOAUFW64v0bJhZGa9UKV_0 2024-09-12T01:07:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11613231185527639603', time=2024-09-12T02:54:25.327700+0000, chain.objs.size()=1 2024-09-12T01:07:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LPhdAJaWzmhLMwYWBPMHlfkM7h-qGk-_0 2024-09-12T01:07:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6972672135177858401', time=2024-09-12T02:54:25.335474+0000, chain.objs.size()=1 2024-09-12T01:07:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bNjGzhdvq0WZwfVIovc-u6wlPXEwa58_0 2024-09-12T01:07:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14035948972343699305', time=2024-09-12T02:54:25.522155+0000, chain.objs.size()=1 2024-09-12T01:07:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.aLzNQrEUgAMmxYa36P2dPD0gOUn-1u8_0 2024-09-12T01:07:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2976823305559606119', time=2024-09-12T02:54:25.536529+0000, chain.objs.size()=1 2024-09-12T01:07:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.M1qrCcEObArnDyZwXwLk9yGRSqYrXxd_0 2024-09-12T01:07:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4461439222297248682', time=2024-09-12T02:54:25.655275+0000, chain.objs.size()=1 2024-09-12T01:07:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.smuPdw2X94gPVYlLyrMRl9ClvmVr2pt_0 2024-09-12T01:07:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6072556279619674637', time=2024-09-12T02:54:25.723465+0000, chain.objs.size()=1 2024-09-12T01:07:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iTOwQk40ox8-rBrwp0KneqpM9e4OhBb_0 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6772404794265613867', time=2024-09-12T02:54:26.005239+0000, chain.objs.size()=1 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GWcUgphBiUHombb88fYTZ8KjsNicIMY_0 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6891313320295801657', time=2024-09-12T02:54:28.662304+0000, chain.objs.size()=1 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.266__shadow_.vQQSRrdEwXLwbZ0YAHiy2cGNxIW3hrK_0 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2749873398219733130', time=2024-09-12T02:54:29.325579+0000, chain.objs.size()=1 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.267__shadow_.9bDFqxI-KT5aacSoXnGqpg4TGTc5z-M_0 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13139539603782574374', time=2024-09-12T02:54:35.550990+0000, chain.objs.size()=1 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.276__shadow_.BXxcNHYE8zK0i8WRQ_g02Ldp_xJbDzr_0 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17401292813540239235', time=2024-09-12T02:54:47.952601+0000, chain.objs.size()=1 2024-09-12T01:07:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.000+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.lPjDPmJkQ0sGef-fJ4QGxrdGa2DSDEa_0 2024-09-12T01:07:27.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8930939270082875550', time=2024-09-12T02:54:47.956654+0000, chain.objs.size()=1 2024-09-12T01:07:27.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.GCAjFeyP0E_xp2ut0eKJYc-6EA_TpNX_0 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5698152503568911507', time=2024-09-12T02:54:50.109023+0000, chain.objs.size()=1 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.294__shadow_.wxC-t5wSwIGkIxrMqXi6PQnHEv_RJCO_0 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5813592520012240111', time=2024-09-12T02:55:30.885850+0000, chain.objs.size()=1 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jYpuvZ9FMvddZoKMyZ9TCeP3TU4u0JN_0 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2217277907592368751', time=2024-09-12T02:55:30.956643+0000, chain.objs.size()=1 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XYMB7tMoe6Wpa8fYbl0ker-pLTBqvDg_0 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3845535456678985124', time=2024-09-12T02:55:30.999849+0000, chain.objs.size()=1 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zur723Dplq0mhdgBjqj1mh6lSSSw8QY_0 2024-09-12T01:07:27.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13125803254574148566', time=2024-09-12T02:55:31.016144+0000, chain.objs.size()=1 2024-09-12T01:07:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.usSw5USyloEqj1Whs1NZUP0ombqrblN_0 2024-09-12T01:07:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15587301210167962854', time=2024-09-12T02:55:31.085579+0000, chain.objs.size()=1 2024-09-12T01:07:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jtPdxyT6U_MLYSiSLlzV0DJhE61Uz87_0 2024-09-12T01:07:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17528162589757800506', time=2024-09-12T02:55:31.261566+0000, chain.objs.size()=1 2024-09-12T01:07:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4Jp9oyEd6RDBvMLs_P30r5u_vMhw8Fr_0 2024-09-12T01:07:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11676433947091196386', time=2024-09-12T02:55:31.339792+0000, chain.objs.size()=1 2024-09-12T01:07:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.b18pyMAhaHwYA1_SMNwk5vpuXzpn3qA_0 2024-09-12T01:07:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7105383690305554455', time=2024-09-12T02:55:31.437327+0000, chain.objs.size()=1 2024-09-12T01:07:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.004+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.o5W33lsYbyi3FwfBaP5YVtOOk63t2Uv_0 2024-09-12T01:07:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9156047749471694722', time=2024-09-12T02:55:31.587520+0000, chain.objs.size()=1 2024-09-12T01:07:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.N9gOL8a1LPcb1f521ZtwJ1OO2TdhWDa_0 2024-09-12T01:07:27.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6702564160341458418', time=2024-09-12T02:55:31.635137+0000, chain.objs.size()=1 2024-09-12T01:07:27.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1LVoPJ1lbvgZyEqsbzbuv0tX65QdXy5_0 2024-09-12T01:07:27.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14214031136767276812', time=2024-09-12T02:55:31.684978+0000, chain.objs.size()=1 2024-09-12T01:07:27.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ha9h_qtlPz2C25Zsx_Ahx9mQ4G7JaLU_0 2024-09-12T01:07:27.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1655183972780718402', time=2024-09-12T02:55:31.759014+0000, chain.objs.size()=1 2024-09-12T01:07:27.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GSrAxn-dDMLofc6qm1d32JvETWrK0Yb_0 2024-09-12T01:07:27.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6055195484373962342', time=2024-09-12T02:55:31.761982+0000, chain.objs.size()=1 2024-09-12T01:07:27.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RFJswRIkf9fzFWEbguAaUODS3R_0KAU_0 2024-09-12T01:07:27.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16598631817045433401', time=2024-09-12T02:55:31.956584+0000, chain.objs.size()=1 2024-09-12T01:07:27.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.I9ZLyCASO82ICVNT4dw0UbpNNIsS2NU_0 2024-09-12T01:07:27.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11808083423657270465', time=2024-09-12T02:55:32.022501+0000, chain.objs.size()=1 2024-09-12T01:07:27.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pACffSU8tSu-gCPF9rIeFEuxI9TP5FM_0 2024-09-12T01:07:27.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8476132823661814808', time=2024-09-12T02:55:32.029101+0000, chain.objs.size()=1 2024-09-12T01:07:27.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LWxYd4C3mKW5CSKR1a6qdZrhjYwTq6Z_0 2024-09-12T01:07:27.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8323905503828713283', time=2024-09-12T02:55:32.336592+0000, chain.objs.size()=1 2024-09-12T01:07:27.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WoiTIrTGW2Q-6toWqT3bi4W0NRxnJy9_0 2024-09-12T01:07:27.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.937835292257150824', time=2024-09-12T02:55:32.403192+0000, chain.objs.size()=1 2024-09-12T01:07:27.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.oyZCzv0ree6OT5OFhboS46YhL6Ntgjy_0 2024-09-12T01:07:27.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6035425603792436122', time=2024-09-12T02:55:32.442018+0000, chain.objs.size()=1 2024-09-12T01:07:27.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.008+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pM8TYqiBCYFWQtheF6jvL1vQjDXJRfn_0 2024-09-12T01:07:27.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17547284958150188201', time=2024-09-12T02:55:32.863972+0000, chain.objs.size()=1 2024-09-12T01:07:27.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Xm_6fy41D5lh4j8lcDbcGUDRjzdhjuq_0 2024-09-12T01:07:27.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12399459409770077045', time=2024-09-12T02:55:32.933955+0000, chain.objs.size()=1 2024-09-12T01:07:27.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.2-_7oZAssG6AuyYRcRiji1YbdPcrEaN_0 2024-09-12T01:07:27.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10709288574356993581', time=2024-09-12T02:55:32.968680+0000, chain.objs.size()=1 2024-09-12T01:07:27.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.fVleEy7cKUGpS2A_7w9c46S8AZVBZZp_0 2024-09-12T01:07:27.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14106617414005025347', time=2024-09-12T02:55:32.997659+0000, chain.objs.size()=1 2024-09-12T01:07:27.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.w7AskqDR3JCC-z3ElK3rAlSdQg1gzeM_0 2024-09-12T01:07:27.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17546874858578663797', time=2024-09-12T02:55:33.051642+0000, chain.objs.size()=1 2024-09-12T01:07:27.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ur6AEs5Qg0-Q3CNDLqWaiJEfUZCcY43_0 2024-09-12T01:07:27.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16392938753960851916', time=2024-09-12T02:55:33.193954+0000, chain.objs.size()=1 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1lduxwwhscwKAMqmOnjn9FcMLk7R1j8_0 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16401914431822245337', time=2024-09-12T02:55:33.264967+0000, chain.objs.size()=1 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mCkD1tawyRU-xMImgw0Sn-W6VQg1XpH_0 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1077442950232451047', time=2024-09-12T02:55:33.286090+0000, chain.objs.size()=1 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.2bL4DlyjSnRNL1Xxc7ZW8omwg4owjGF_0 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5307212958996536846', time=2024-09-12T02:55:33.327316+0000, chain.objs.size()=1 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YROonkD6Tj9P8REc55H4__BpxoMuim1_0 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1408883522977792403', time=2024-09-12T02:55:54.461647+0000, chain.objs.size()=1 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2o2TQPEryGhlU80TyK_jhNXghCn0CAt_0 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1731932830045034752', time=2024-09-12T02:55:54.592993+0000, chain.objs.size()=1 2024-09-12T01:07:27.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.012+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eWnGUq_YZo-pV-ERctXo_dh43VKARO1_0 2024-09-12T01:07:27.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10267561425758224702', time=2024-09-12T02:55:54.644964+0000, chain.objs.size()=1 2024-09-12T01:07:27.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.hqHXM4lBVd3ZaWE83jf1xOrb3TvAyJ5_0 2024-09-12T01:07:27.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2290902761587530693', time=2024-09-12T02:55:54.795740+0000, chain.objs.size()=1 2024-09-12T01:07:27.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Aa924LI66Z__QzH_nduhZ34h47xQapo_0 2024-09-12T01:07:27.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4230212660147476776', time=2024-09-12T02:55:54.840870+0000, chain.objs.size()=1 2024-09-12T01:07:27.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.cAPt-AaXcTsQLMlPqoT_ZauJRWB3exQ_0 2024-09-12T01:07:27.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13196252092839134022', time=2024-09-12T02:55:54.958382+0000, chain.objs.size()=1 2024-09-12T01:07:27.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.n49ZPL3a0RhwCYMZNG4tG6wyn2iKm5__0 2024-09-12T01:07:27.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7402364974707335612', time=2024-09-12T02:55:55.006026+0000, chain.objs.size()=1 2024-09-12T01:07:27.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.L39Lv2_M0fd7FwlekGudF58wo0fj6Gp_0 2024-09-12T01:07:27.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4162143701212144445', time=2024-09-12T02:55:55.211513+0000, chain.objs.size()=1 2024-09-12T01:07:27.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.016+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0dlfSyRK6-2KFyoxl6v0hYAT6hVMDHf_0 2024-09-12T01:07:27.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16018421250581098812', time=2024-09-12T02:55:55.227879+0000, chain.objs.size()=1 2024-09-12T01:07:27.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jSxEm277xjzJhQRE5BFM4xSSkovEoRl_0 2024-09-12T01:07:27.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3128862246652953678', time=2024-09-12T02:55:55.246230+0000, chain.objs.size()=1 2024-09-12T01:07:27.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vB1MnmbM6Vz8Kzy0-mGVfz8HWrbKJP8_0 2024-09-12T01:07:27.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13339424507076612791', time=2024-09-12T02:55:55.319420+0000, chain.objs.size()=1 2024-09-12T01:07:27.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.rMZz0yypOsYE-HZXE6MUFqM-WcwOGhj_0 2024-09-12T01:07:27.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.946439280740139005', time=2024-09-12T02:55:55.335600+0000, chain.objs.size()=1 2024-09-12T01:07:27.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bu6NIwRgHPxB1OKTfKnkPlQu9gm9vkS_0 2024-09-12T01:07:27.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13228429949716307975', time=2024-09-12T02:55:55.461420+0000, chain.objs.size()=1 2024-09-12T01:07:27.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.oKa-RmLoW2KrlvhVLrM7yBfdUXEFbhv_0 2024-09-12T01:07:27.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7520760995459380434', time=2024-09-12T02:55:55.538091+0000, chain.objs.size()=1 2024-09-12T01:07:27.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JB1wREMjOel698TretdVOk9eNMQHfBn_0 2024-09-12T01:07:27.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7834496154971314773', time=2024-09-12T02:55:55.580435+0000, chain.objs.size()=1 2024-09-12T01:07:27.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jeX925eHGuge1xVPYMsJgMZcfCQ-60S_0 2024-09-12T01:07:27.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4826199054853102075', time=2024-09-12T02:55:55.663906+0000, chain.objs.size()=1 2024-09-12T01:07:27.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lqmzx9DE5Bk0Jsvd5NrCZIHlYO8wlms_0 2024-09-12T01:07:27.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15247657144889165517', time=2024-09-12T02:55:55.821001+0000, chain.objs.size()=1 2024-09-12T01:07:27.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pK7n3WkexS-Gs4PEFOfXKYdQe7xtaQT_0 2024-09-12T01:07:27.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4656054279739347960', time=2024-09-12T02:55:55.854312+0000, chain.objs.size()=1 2024-09-12T01:07:27.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.z2q_Z_LEjSFmswZ1Q5LBEupPcExHXF1_0 2024-09-12T01:07:27.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11645969857853147212', time=2024-09-12T02:55:56.225048+0000, chain.objs.size()=1 2024-09-12T01:07:27.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.020+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WfqbCAjoLoQpEp2hz_f2EJ_AX22twvO_0 2024-09-12T01:07:27.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.391430362243442782', time=2024-09-12T02:55:56.229121+0000, chain.objs.size()=1 2024-09-12T01:07:27.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ir0dUKL-6OAecGJj38LuBeiQ27vYDy6_0 2024-09-12T01:07:27.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1016748421953156358', time=2024-09-12T02:55:56.231593+0000, chain.objs.size()=1 2024-09-12T01:07:27.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.56WBb0FWcYg_s15aP0u85y1UNzkthFE_0 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13662239326421891617', time=2024-09-12T02:55:56.298516+0000, chain.objs.size()=1 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jrK5jrurRdyQA4p67EQR_QzN2w6FuRa_0 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4042346251729394135', time=2024-09-12T02:55:56.305748+0000, chain.objs.size()=1 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qCtUinO_ytqIGCS2_UCCuEkfUqjsyyU_0 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7992151840549810892', time=2024-09-12T02:55:56.335937+0000, chain.objs.size()=1 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vph6VjdoMkI4MUt5NHw5aZq972Q_D5L_0 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.668696265330210759', time=2024-09-12T02:55:56.476985+0000, chain.objs.size()=1 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Q6KRUZyJGDd9W3f_HdsOtzGbH81-aL1_0 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14250560997802727287', time=2024-09-12T02:55:56.773169+0000, chain.objs.size()=1 2024-09-12T01:07:27.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xNCzSEG3kFuwHOO-HNNWfBFvG-j-nRW_0 2024-09-12T01:07:27.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8376759774243690576', time=2024-09-12T02:55:56.788163+0000, chain.objs.size()=1 2024-09-12T01:07:27.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uWaJ8nEM-JPkat40R3-YI6IjpD6v0j4_0 2024-09-12T01:07:27.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15946079633334210597', time=2024-09-12T02:55:56.790548+0000, chain.objs.size()=1 2024-09-12T01:07:27.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.024+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5DpE-VjvnkRZj18Rk6xThrRHqKF0D9q_0 2024-09-12T01:07:27.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1853393585201265247', time=2024-09-12T02:55:56.798452+0000, chain.objs.size()=1 2024-09-12T01:07:27.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GAgxoW-Dh9PrvmQsQ0sKRHICth0bAEX_0 2024-09-12T01:07:27.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10833200136487838885', time=2024-09-12T02:55:56.862154+0000, chain.objs.size()=1 2024-09-12T01:07:27.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Br2ZS6hCaHceP_5hbJcw8584GsIrPPI_0 2024-09-12T01:07:27.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16061409908209373189', time=2024-09-12T02:55:56.899815+0000, chain.objs.size()=1 2024-09-12T01:07:27.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ps7lofToBZme5uMeVCKTD3yfomwdElp_0 2024-09-12T01:07:27.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15009754506345719269', time=2024-09-12T02:55:56.904081+0000, chain.objs.size()=1 2024-09-12T01:07:27.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9icxbqAYenBLj_bKYDg4PkIyIZwUkL0_0 2024-09-12T01:07:27.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7681092217492446871', time=2024-09-12T02:56:00.570087+0000, chain.objs.size()=1 2024-09-12T01:07:27.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.028+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.330__shadow_.mmJzcsDMbddLFF_jD7a8Iasm_T4zz4b_0 2024-09-12T01:07:27.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.032+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49106 2024-09-12T01:07:27.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:07:27.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5324781984476173833', time=2024-09-12T02:57:45.044422+0000, chain.objs.size()=1 2024-09-12T01:07:27.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.RiB2cNCKIHOVxEnf13g125kyPbc2hg__0 2024-09-12T01:07:27.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~cslulf_VCd0v1XhNlYR3OIbMZnWgxQA', time=2024-09-12T02:58:51.221621+0000, chain.objs.size()=1 2024-09-12T01:07:27.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.534__multipart_mymultipart.2~cslulf_VCd0v1XhNlYR3OIbMZnWgxQA.1 2024-09-12T01:07:27.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6144113090678446325', time=2024-09-12T02:59:51.999724+0000, chain.objs.size()=1 2024-09-12T01:07:27.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:vxWohNdVBZ6zR0lo518p7NVJTbQOGwx_.w1gUwqUaCoTs1PQDUu0hU7oQPXQdknU_0 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1358626177615786104', time=2024-09-12T02:59:56.798021+0000, chain.objs.size()=1 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:yUOzgPN005cjen5-QTdXfMRV.MqR8rl_.Vo8vS6gcsN33CfKF2gRA8dHLIefYZxp_0 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3907277935114404695', time=2024-09-12T03:00:04.877526+0000, chain.objs.size()=1 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow_.w0UJv1x6toLeeqAkjDH36H9F2KP6pm-_0 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12912828352463044181', time=2024-09-12T03:00:06.067556+0000, chain.objs.size()=1 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow:KnAMEi7auwW94kwPs9A6vf3A9bffLDZ_.VebXcfv8mjkH5jBG_eSXupDjX6FjE5y_0 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12571163113445260121', time=2024-09-12T03:00:23.738086+0000, chain.objs.size()=1 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:wJVVvVlHww9J-1v8Ku7X7kMcgAKoy35_.Z4J8mak0bejY31chZ2K8hgisOQMALAh_0 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5223448623629418157', time=2024-09-12T03:00:25.157649+0000, chain.objs.size()=1 2024-09-12T01:07:27.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:jKfkp0UaUcVtmtU9qifguN4I1A2oOCp_.Zbo8b92m-Tt8AvJhPagYudY7rqdd5aa_0 2024-09-12T01:07:27.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3303304047765903868', time=2024-09-12T03:00:42.270371+0000, chain.objs.size()=1 2024-09-12T01:07:27.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:rJZUstYs7v2mhmDENBksM-Qlx7Aj4ij_.Eli50A_vG7poyns3hGlHo0ldGkgxxij_0 2024-09-12T01:07:27.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP', time=2024-09-12T03:03:22.228861+0000, chain.objs.size()=12 2024-09-12T01:07:27.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__multipart_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.1 2024-09-12T01:07:27.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__shadow_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.1_1 2024-09-12T01:07:27.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__multipart_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.2 2024-09-12T01:07:27.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.036+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__shadow_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.2_1 2024-09-12T01:07:27.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__multipart_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.3 2024-09-12T01:07:27.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__shadow_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.3_1 2024-09-12T01:07:27.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__multipart_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.4 2024-09-12T01:07:27.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__shadow_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.4_1 2024-09-12T01:07:27.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__multipart_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.5 2024-09-12T01:07:27.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__shadow_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.5_1 2024-09-12T01:07:27.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__multipart_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.6 2024-09-12T01:07:27.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.625__shadow_multipart_enc.2~npsKTXRzMUQ51Wf4ooDYctAJxx-bLbP.6_1 2024-09-12T01:07:27.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14491395859234873231', time=2024-09-12T03:03:29.541754+0000, chain.objs.size()=1 2024-09-12T01:07:27.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.636__shadow_.MPvrOgp8ul-UIW93onyYWo4nSzRW3v__0 2024-09-12T01:07:27.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13791554186525360452', time=2024-09-12T03:04:13.789305+0000, chain.objs.size()=1 2024-09-12T01:07:27.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.040+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.699__shadow:52aU61YSzugwVnpFMqrVOXciqGHAQGK_.2L96ebcBAhex_GbZeYtpOFlEadvpcdM_0 2024-09-12T01:07:27.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.044+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5151723424912609480', time=2024-09-12T03:05:04.736391+0000, chain.objs.size()=1 2024-09-12T01:07:27.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.744__shadow_._1jvxMcX0XangMR3Thas8FYAWbeJtNi_0 2024-09-12T01:07:27.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.044+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:07:27.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46803' 2024-09-12T01:07:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5915216536455324331', time=2024-09-12T02:51:23.918812+0000, chain.objs.size()=1 2024-09-12T01:07:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.151__shadow_.3pcs89SRMbf_3nTi7vMF4dDou_vUp5r_0 2024-09-12T01:07:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7588052960813277864', time=2024-09-12T02:52:13.109349+0000, chain.objs.size()=1 2024-09-12T01:07:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.203__shadow_.LkKFw2gYXnCU3kftnIjl6JG4N3PoK6I_0 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7347393820753199098', time=2024-09-12T02:53:41.235808+0000, chain.objs.size()=1 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.234__shadow_.V7QdsW1Gir1AKLxwWSWqB6DQH19wkqG_0 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9725960885905754415', time=2024-09-12T02:53:42.665479+0000, chain.objs.size()=1 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.236__shadow_.56YXnWw0oFdAu3rIED2AxHboAo4OJo9_0 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11667922595335266072', time=2024-09-12T02:54:00.568052+0000, chain.objs.size()=1 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.259__shadow_.WFVRDbPV8srdXXOm0K7QM6ieFUqy7HM_0 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8083457153823115991', time=2024-09-12T02:54:23.136770+0000, chain.objs.size()=1 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XwtE0pyxb6V-gBex3HwdayRIwdlrtY0_0 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1464074181543248665', time=2024-09-12T02:54:23.165415+0000, chain.objs.size()=1 2024-09-12T01:07:27.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FT3ktGBiN1TDIegnWUIUCfWNl25hM49_0 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6503997802998125148', time=2024-09-12T02:54:23.207432+0000, chain.objs.size()=1 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.inm05v0dBaB3rasym1x8C7Rf0UiYRPe_0 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3757303631021712126', time=2024-09-12T02:54:23.225603+0000, chain.objs.size()=1 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Qcu1rXTUsBglnn1ff5ehemYTgsiP9fc_0 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5427162320513848729', time=2024-09-12T02:54:23.396991+0000, chain.objs.size()=1 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wCLzV03TGXk_WT3BcTXK28aVd_FMR-2_0 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11340600524728945642', time=2024-09-12T02:54:23.398713+0000, chain.objs.size()=1 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6AB2N0zueXzaMqUveWCd0HCmvMS-Fav_0 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10905594453395843720', time=2024-09-12T02:54:23.426163+0000, chain.objs.size()=1 2024-09-12T01:07:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.048+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TzU-Aoh9yfCCrqUCclPqSrDjOKsdyZ-_0 2024-09-12T01:07:27.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11970254143038466666', time=2024-09-12T02:54:23.522782+0000, chain.objs.size()=1 2024-09-12T01:07:27.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RWcwPScp4NDsByBVRP7SLD9oQ1QPn8R_0 2024-09-12T01:07:27.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18027902339219962434', time=2024-09-12T02:54:23.579038+0000, chain.objs.size()=1 2024-09-12T01:07:27.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hZ-P10RrdqEuPxLv-FLfAb3u_-cbGs4_0 2024-09-12T01:07:27.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18242810088376388040', time=2024-09-12T02:54:24.063185+0000, chain.objs.size()=1 2024-09-12T01:07:27.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xlhtbRzC3kg26LXOPfDkjHR6lHqZoPd_0 2024-09-12T01:07:27.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14490039966103789961', time=2024-09-12T02:54:24.074806+0000, chain.objs.size()=1 2024-09-12T01:07:27.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.V9kIBLwZE_CMIiFEfwf7WioQujQNbeS_0 2024-09-12T01:07:27.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.052+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17148267079518258852', time=2024-09-12T02:54:24.101201+0000, chain.objs.size()=1 2024-09-12T01:07:27.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qBd8H5hzJcx9zf7Sz71xMJrtkQ6aZo8_0 2024-09-12T01:07:27.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2596122145492584732', time=2024-09-12T02:54:24.148297+0000, chain.objs.size()=1 2024-09-12T01:07:27.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.KYs55jqWAfBDWkp_qEruPvppW-9fZ7-_0 2024-09-12T01:07:27.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7086477162888696884', time=2024-09-12T02:54:24.156152+0000, chain.objs.size()=1 2024-09-12T01:07:27.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.YcOOQh2k5lIa6K2r0z1Ec0Ip4FimuPf_0 2024-09-12T01:07:27.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15833509381876423443', time=2024-09-12T02:54:24.179667+0000, chain.objs.size()=1 2024-09-12T01:07:27.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.t9H1EB4S96IubsaPXEagCnJn78XhzN1_0 2024-09-12T01:07:27.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12529678713311882231', time=2024-09-12T02:54:24.191304+0000, chain.objs.size()=1 2024-09-12T01:07:27.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GTbVlYu9i9SuP9fWXmitiTssFwZ_17H_0 2024-09-12T01:07:27.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16879065362758078005', time=2024-09-12T02:54:24.328625+0000, chain.objs.size()=1 2024-09-12T01:07:27.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6DbIj6PNH333g0Wihp3HQFrAoORv7AL_0 2024-09-12T01:07:27.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13141591480335520832', time=2024-09-12T02:54:24.332570+0000, chain.objs.size()=1 2024-09-12T01:07:27.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0x2IaiV9d3hax-q_wUoK1YeVjlq69uO_0 2024-09-12T01:07:27.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6271087536068086816', time=2024-09-12T02:54:24.458270+0000, chain.objs.size()=1 2024-09-12T01:07:27.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.h6TwnQuXuTrWM4aS76ry5n_SVwn_KM3_0 2024-09-12T01:07:27.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7296285219096559093', time=2024-09-12T02:54:24.505862+0000, chain.objs.size()=1 2024-09-12T01:07:27.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5nUqGxbtapM35XQO_tVFjm2rDhCLwut_0 2024-09-12T01:07:27.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3025145188220722637', time=2024-09-12T02:54:24.628816+0000, chain.objs.size()=1 2024-09-12T01:07:27.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HYeMuSRtySzBi881Yh4HVLC7HZ5Pu0H_0 2024-09-12T01:07:27.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10568724069637302901', time=2024-09-12T02:54:24.797261+0000, chain.objs.size()=1 2024-09-12T01:07:27.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4i-ywY8xWfy-MBKlFAp78eTuLzTKGN-_0 2024-09-12T01:07:27.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.150628454205731317', time=2024-09-12T02:54:24.833394+0000, chain.objs.size()=1 2024-09-12T01:07:27.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qbGv4guPeunNTvsXNZS7Wb01oP052wM_0 2024-09-12T01:07:27.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6940189176468825379', time=2024-09-12T02:54:24.855006+0000, chain.objs.size()=1 2024-09-12T01:07:27.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.056+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qUrpqRxkAhxv_EUgEb4Q6Pe0L-VcHwy_0 2024-09-12T01:07:27.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2372021348478879433', time=2024-09-12T02:54:24.861892+0000, chain.objs.size()=1 2024-09-12T01:07:27.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.k9Yen40X8zYcXW4hqWAyO4AFDMaZtzH_0 2024-09-12T01:07:27.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5081558731022562266', time=2024-09-12T02:54:24.866509+0000, chain.objs.size()=1 2024-09-12T01:07:27.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.yo2DVXwW13U2RRNG_C5K5Xg2qlPpKor_0 2024-09-12T01:07:27.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17256859814389281789', time=2024-09-12T02:54:24.882947+0000, chain.objs.size()=1 2024-09-12T01:07:27.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ChpOpny7F1eusJEvrONsiKBG5XcukmD_0 2024-09-12T01:07:27.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.444108539768757722', time=2024-09-12T02:54:24.888033+0000, chain.objs.size()=1 2024-09-12T01:07:27.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.P2rCjhBo47EYAhyDm_8NxcOb1yIulfX_0 2024-09-12T01:07:27.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17606900442614315827', time=2024-09-12T02:54:24.913346+0000, chain.objs.size()=1 2024-09-12T01:07:27.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rH7lf7AmdOg2n7I5VA_TSDkDqFU3Xp4_0 2024-09-12T01:07:27.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12260760123011441710', time=2024-09-12T02:54:25.181640+0000, chain.objs.size()=1 2024-09-12T01:07:27.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GZvFyrV6leSp0V2hzExuoxqsDR6T_d8_0 2024-09-12T01:07:27.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11508144066903820045', time=2024-09-12T02:54:25.260169+0000, chain.objs.size()=1 2024-09-12T01:07:27.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dJenlBtPaPGhEBfZ5Rnvr-wxzAP40zT_0 2024-09-12T01:07:27.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14035934459535637931', time=2024-09-12T02:54:25.307435+0000, chain.objs.size()=1 2024-09-12T01:07:27.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Cm-aX-cYed1mEK_vfHPGQFPmEhBXTi1_0 2024-09-12T01:07:27.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9896138156996363326', time=2024-09-12T02:54:25.555833+0000, chain.objs.size()=1 2024-09-12T01:07:27.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.060+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.q85-v5O6Dg1d6aAo_8f71nmdUUwyh6J_0 2024-09-12T01:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1857695224031434366', time=2024-09-12T02:54:25.572331+0000, chain.objs.size()=1 2024-09-12T01:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.H0g-tUS_xeIgc9lCf0UZhOwVg1QU9qs_0 2024-09-12T01:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7843382161803792726', time=2024-09-12T02:54:25.629009+0000, chain.objs.size()=1 2024-09-12T01:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.tnXVA0BTcTTBTRBm9RWUMdZj8KDYSm1_0 2024-09-12T01:07:27.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3568981271749899466', time=2024-09-12T02:54:25.684212+0000, chain.objs.size()=1 2024-09-12T01:07:27.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uAhyARwQG15N7-_H0kQdS9iyQd_TIp7_0 2024-09-12T01:07:27.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2992893820255558847', time=2024-09-12T02:54:25.696070+0000, chain.objs.size()=1 2024-09-12T01:07:27.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2sE_hIggwCr88bqn0eV1KHl2LJjohlB_0 2024-09-12T01:07:27.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1803935374150381085', time=2024-09-12T02:54:25.723076+0000, chain.objs.size()=1 2024-09-12T01:07:27.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CVYoAQwfa2IJVNyzOFQDePwcomyf0Nu_0 2024-09-12T01:07:27.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11664820945398293329', time=2024-09-12T02:54:25.840591+0000, chain.objs.size()=1 2024-09-12T01:07:27.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GawLxpOmzLCneBsewzxMcSzTrlkbf7B_0 2024-09-12T01:07:27.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12888027584847485490', time=2024-09-12T02:54:25.895185+0000, chain.objs.size()=1 2024-09-12T01:07:27.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eAxTgv3zokedguXzgmocGgsfQQvHV_E_0 2024-09-12T01:07:27.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.557892328700116035', time=2024-09-12T02:54:25.938205+0000, chain.objs.size()=1 2024-09-12T01:07:27.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uJCKwl5IwkiKhnHfeUg0i0CaMOQ800U_0 2024-09-12T01:07:27.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3731705582387905431', time=2024-09-12T02:54:25.956944+0000, chain.objs.size()=1 2024-09-12T01:07:27.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.064+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dh-ZIVMxJpIHSpkbYrgfhPHgeOj5AVW_0 2024-09-12T01:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.866326797811071183', time=2024-09-12T02:54:25.990288+0000, chain.objs.size()=1 2024-09-12T01:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AbaQCO00Pi0d4WbRgsj3OuJ_3D_hoXp_0 2024-09-12T01:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2033062385237133127', time=2024-09-12T02:54:28.660434+0000, chain.objs.size()=1 2024-09-12T01:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.266__shadow_.NBsu9P5K8AYcbv_kz7DOr9txzUhRyYj_0 2024-09-12T01:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5916282525615254413', time=2024-09-12T02:54:36.263624+0000, chain.objs.size()=1 2024-09-12T01:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.277__shadow_.GgJF_lKsIXbDqNIb_9aO6atJMUgyf6h_0 2024-09-12T01:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10092242557542713005', time=2024-09-12T02:54:41.171949+0000, chain.objs.size()=1 2024-09-12T01:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.284__shadow_.f3Nl4dxJDjPWrr5jHpYQUXLCbmzIjqw_0 2024-09-12T01:07:27.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12553112949079113490', time=2024-09-12T02:54:47.929426+0000, chain.objs.size()=1 2024-09-12T01:07:27.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.lXelR8yd302kHUCXSbgnacSYz89Twmt_0 2024-09-12T01:07:27.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17444666103532182695', time=2024-09-12T02:54:47.973782+0000, chain.objs.size()=1 2024-09-12T01:07:27.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.aMAY5I99e2IY5KPbNO9S-uqb2GQE4nZ_0 2024-09-12T01:07:27.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14227352825113199238', time=2024-09-12T02:54:50.776268+0000, chain.objs.size()=1 2024-09-12T01:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.295__shadow_.fsae9PdswUMIGUyYw0Qjn1JNjYOmeQe_0 2024-09-12T01:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2000991557635053047', time=2024-09-12T02:54:50.778295+0000, chain.objs.size()=1 2024-09-12T01:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.295__shadow_.xPeG2FfJnp2KveftQ9cAkXAp0TRYhZM_0 2024-09-12T01:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3350105319716174304', time=2024-09-12T02:54:53.651941+0000, chain.objs.size()=1 2024-09-12T01:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.299__shadow_.HT7-8pKrcRluQUdAt79SvQqlw_EOZtC_0 2024-09-12T01:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6859936002195062909', time=2024-09-12T02:54:53.656891+0000, chain.objs.size()=1 2024-09-12T01:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.299__shadow_.yrRwtix_rcI1gvMF8oxJyZiJMbLkp82_0 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8964477327977041491', time=2024-09-12T02:55:30.915041+0000, chain.objs.size()=1 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eebEJCRGtacwfWdHxxSGJxhnXjL5Fv0_0 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13654676854183671130', time=2024-09-12T02:55:30.988534+0000, chain.objs.size()=1 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Cqm4aq4GAX0EQbC-3fDu0_G7--QovD4_0 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4713669646706430528', time=2024-09-12T02:55:31.096908+0000, chain.objs.size()=1 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.c5nIKiuKBHLHuUZ-fazpXmT2_EZjR4o_0 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12979479288931670693', time=2024-09-12T02:55:31.266287+0000, chain.objs.size()=1 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6x6BP9fY-cyLkIuRol6rfCBJVDt4mX9_0 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15932389594973053734', time=2024-09-12T02:55:31.312374+0000, chain.objs.size()=1 2024-09-12T01:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.068+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.I0OdkzDr8tCjMejRbU8eP39Pi-o6Mts_0 2024-09-12T01:07:27.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9074902883617285815', time=2024-09-12T02:55:31.416467+0000, chain.objs.size()=1 2024-09-12T01:07:27.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.cGA1bMP22-01EXFHcr1rRdPVcbWsPBQ_0 2024-09-12T01:07:27.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10277058688529693181', time=2024-09-12T02:55:31.423337+0000, chain.objs.size()=1 2024-09-12T01:07:27.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tgKH8xG6RlraItGtdcK-0QEMq_AKfiK_0 2024-09-12T01:07:27.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9451421230349253898', time=2024-09-12T02:55:31.439646+0000, chain.objs.size()=1 2024-09-12T01:07:27.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YuqPuapSVQQKpdj9hsX0uInUE3bkurZ_0 2024-09-12T01:07:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5545447461522521061', time=2024-09-12T02:55:31.610379+0000, chain.objs.size()=1 2024-09-12T01:07:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OSDvyVeuAOBYWZ-wAgEgKU_HJ2hVRo2_0 2024-09-12T01:07:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18092892809010724433', time=2024-09-12T02:55:31.629487+0000, chain.objs.size()=1 2024-09-12T01:07:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.072+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.478seO0TlrHaQI1Z5upqssarOlEaKCQ_0 2024-09-12T01:07:27.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15404398579394756434', time=2024-09-12T02:55:31.708152+0000, chain.objs.size()=1 2024-09-12T01:07:27.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Vrr51B8iEjWmJORAxXy_rZNY_TDpARS_0 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2729263273725912994', time=2024-09-12T02:55:31.709497+0000, chain.objs.size()=1 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.H65WjbMQHvt4odALVBCQtOk2-UG3ilq_0 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1916160760657904616', time=2024-09-12T02:55:31.754077+0000, chain.objs.size()=1 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.S2sEosp2gP22XlLc-X3IjUcIZb5o2HW_0 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.173131939654060169', time=2024-09-12T02:55:31.962887+0000, chain.objs.size()=1 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3uYg5atGaZl7UKW1_LTz07FBxeSR9gv_0 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15670182044521162848', time=2024-09-12T02:55:32.016823+0000, chain.objs.size()=1 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zWjWyHGhsw3czHbvPTKQIusLjoe_DTk_0 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10577039305209347090', time=2024-09-12T02:55:32.088302+0000, chain.objs.size()=1 2024-09-12T01:07:27.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vdNg2dA6kN9MuWtBArbvMu9bM3lZ-U0_0 2024-09-12T01:07:27.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1439544744167441971', time=2024-09-12T02:55:32.562003+0000, chain.objs.size()=1 2024-09-12T01:07:27.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HVX8MBQiM9aDmH36BXZV66VXVp6kXYH_0 2024-09-12T01:07:27.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17392250337677238443', time=2024-09-12T02:55:32.578644+0000, chain.objs.size()=1 2024-09-12T01:07:27.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.076+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vsRicTuvbuGfp62_lgLbd0I-47pUC35_0 2024-09-12T01:07:27.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7532803995463005393', time=2024-09-12T02:55:32.581689+0000, chain.objs.size()=1 2024-09-12T01:07:27.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._XrVlAd_TOFFrz1_fExge1FE4Y3_--s_0 2024-09-12T01:07:27.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11690641112151454267', time=2024-09-12T02:55:32.630837+0000, chain.objs.size()=1 2024-09-12T01:07:27.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9pqctThi1_VIIpfJI6eOJB4_pj_t_xA_0 2024-09-12T01:07:27.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe14df2640 0 -- 172.21.15.137:0/1809423053 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fbce0081bf0 msgr2=0x7fbce0084020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:27.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4222886939096730886', time=2024-09-12T02:55:32.673754+0000, chain.objs.size()=1 2024-09-12T01:07:27.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.awLcuBq_X6p4MaYzvxg6rsUEtL-8dhT_0 2024-09-12T01:07:27.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4945303347024602151', time=2024-09-12T02:55:32.677127+0000, chain.objs.size()=1 2024-09-12T01:07:27.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.FjNhxSYJUxowmexH-4QAEfz2iytKy92_0 2024-09-12T01:07:27.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.41405436541721080', time=2024-09-12T02:55:32.748804+0000, chain.objs.size()=1 2024-09-12T01:07:27.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._v1xQfZ2WhlBgAhVlQikJuJd2bieP5L_0 2024-09-12T01:07:27.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5412831843830062329', time=2024-09-12T02:55:32.873140+0000, chain.objs.size()=1 2024-09-12T01:07:27.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tGJqgCCYzjjhh1LqLrYvTTmF2Dl2xFm_0 2024-09-12T01:07:27.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4003561998405744331', time=2024-09-12T02:55:32.911248+0000, chain.objs.size()=1 2024-09-12T01:07:27.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kS28Y-v_8X-pbak5dSqczCUkMQv03CB_0 2024-09-12T01:07:27.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8725640597604004774', time=2024-09-12T02:55:32.912416+0000, chain.objs.size()=1 2024-09-12T01:07:27.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PVxRcBET6-dkYv3AgKrZhvt3soFxmDh_0 2024-09-12T01:07:27.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.889530235262083561', time=2024-09-12T02:55:32.922974+0000, chain.objs.size()=1 2024-09-12T01:07:27.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.080+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.00eM-bCu1Y2JSTWIlcFL43AadMSa00Y_0 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10161068677892813588', time=2024-09-12T02:55:32.973035+0000, chain.objs.size()=1 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lGHLQaEZVcmfceS4H9GcyEtW-JIJRTL_0 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9912103278812584173', time=2024-09-12T02:55:32.996177+0000, chain.objs.size()=1 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dF_YAfhsdJLxqv6WgD7n8m40P4pFNX2_0 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17150323979074781683', time=2024-09-12T02:55:33.063008+0000, chain.objs.size()=1 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.j8G18lCOgO8XPxCBezAytmPp_o1DBvn_0 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9560109127407850624', time=2024-09-12T02:55:33.176838+0000, chain.objs.size()=1 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tvDZLYTOvqL_DiVSD-Un7MJDqSUiNJr_0 2024-09-12T01:07:27.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17755461038568712654', time=2024-09-12T02:55:33.268193+0000, chain.objs.size()=1 2024-09-12T01:07:27.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.SGBhX9T-_3GKuUnvrD3BzkvtYyGBPXA_0 2024-09-12T01:07:27.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11173171652635743274', time=2024-09-12T02:55:33.286794+0000, chain.objs.size()=1 2024-09-12T01:07:27.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.fG5V6_cX9qU_WA8KhAOwOPaVd3Psi6F_0 2024-09-12T01:07:27.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15446241481106274497', time=2024-09-12T02:55:33.318077+0000, chain.objs.size()=1 2024-09-12T01:07:27.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mvpa-05XFsZr0R4hIhr08apmqU-uNu__0 2024-09-12T01:07:27.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17207121399626773834', time=2024-09-12T02:55:54.564792+0000, chain.objs.size()=1 2024-09-12T01:07:27.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.T39Lf7J5RDNM4J8pNazY0ZDOJQPsH0h_0 2024-09-12T01:07:27.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5747882869499721618', time=2024-09-12T02:55:54.825333+0000, chain.objs.size()=1 2024-09-12T01:07:27.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.yV2V-I-qdhXLNUrYhxUIv0L03Ox5Wik_0 2024-09-12T01:07:27.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5231876456945230848', time=2024-09-12T02:55:54.826653+0000, chain.objs.size()=1 2024-09-12T01:07:27.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-s-Vm6dGNKYTS0eWo-l70lOVf6gClmm_0 2024-09-12T01:07:27.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14977086091645048814', time=2024-09-12T02:55:54.844480+0000, chain.objs.size()=1 2024-09-12T01:07:27.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.084+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RPd1Bor3WWasXe-qYrXKZKTZF827BHT_0 2024-09-12T01:07:27.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16901563157330206407', time=2024-09-12T02:55:54.973483+0000, chain.objs.size()=1 2024-09-12T01:07:27.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.awpeuc4CVTX879KjN9O1-RO5BgYdlKS_0 2024-09-12T01:07:27.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3068010553553006184', time=2024-09-12T02:55:55.160405+0000, chain.objs.size()=1 2024-09-12T01:07:27.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Ku8h-eHAjDaQeIV8AEVdgIf7IAvL4SI_0 2024-09-12T01:07:27.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13801672600917890075', time=2024-09-12T02:55:55.197389+0000, chain.objs.size()=1 2024-09-12T01:07:27.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.w3l2KlXuthCu_PD_nySoMeHN-Fw7o5d_0 2024-09-12T01:07:27.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4151222302040180456', time=2024-09-12T02:55:55.217755+0000, chain.objs.size()=1 2024-09-12T01:07:27.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.R3yARGdUZRaLdy7e8l_oiHUKiDBzBJc_0 2024-09-12T01:07:27.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6715790815349834235', time=2024-09-12T02:55:55.296944+0000, chain.objs.size()=1 2024-09-12T01:07:27.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wXS4qQKw_cgvANmQiH0Z-5K38Ijx7Gz_0 2024-09-12T01:07:27.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.088+0000 7fbe14df2640 0 -- 172.21.15.137:0/1809423053 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fbe08109090 msgr2=0x7fbce0086d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:27.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.092+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46803 2024-09-12T01:07:27.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T01:07:27.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3656147737464891917', time=2024-09-12T02:55:55.474437+0000, chain.objs.size()=1 2024-09-12T01:07:27.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DcZ3Ex-XP7-dBnDyhP36HXbCwEamejc_0 2024-09-12T01:07:27.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5013518559330802400', time=2024-09-12T02:55:55.530128+0000, chain.objs.size()=1 2024-09-12T01:07:27.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Uiw1UsIv3Rg-wzLCLdTJCL9fXlewsQa_0 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15071765385830272945', time=2024-09-12T02:55:55.615546+0000, chain.objs.size()=1 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-cS1-DP-2Avyyzy_y7JEQqTDKOWhs98_0 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe155f3640 0 -- 172.21.15.137:0/1809423053 >> [v2:172.21.15.137:6800/775942033,v1:172.21.15.137:6801/775942033] conn(0x7fbe0007a440 msgr2=0x7fbe000640a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13425933567067879746', time=2024-09-12T02:55:55.830228+0000, chain.objs.size()=1 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wffiiKoyrLW3kGZ6u0Ow_C6D2Yfxum6_0 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3875465597846868125', time=2024-09-12T02:55:55.865897+0000, chain.objs.size()=1 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PXKiAtGXuuZ_EPNINWpcvrVe40edJ2N_0 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14616220510640895470', time=2024-09-12T02:55:55.914222+0000, chain.objs.size()=1 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BevZt49f1RHn8yoDsRgWekdBwkriAPd_0 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18085416870303274387', time=2024-09-12T02:55:56.007749+0000, chain.objs.size()=1 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JWXPu0kmU83j6HN41hTc4Rm-TWoaXi4_0 2024-09-12T01:07:27.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14614004496333308510', time=2024-09-12T02:55:56.278022+0000, chain.objs.size()=1 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eld8SYsLyZ62ti31q61q9AOnLwYFQtK_0 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6346204387478059068', time=2024-09-12T02:55:56.351644+0000, chain.objs.size()=1 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.McLMFFdHWs75zUBBjygrSvAi8p8xrUN_0 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3932050145268956198', time=2024-09-12T02:55:56.467472+0000, chain.objs.size()=1 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QafxR-G5VYsVJ8B3ptT6uDB7UFjRJ3x_0 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10418096955471854256', time=2024-09-12T02:55:56.758310+0000, chain.objs.size()=1 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PbuWkYOkCowMcmlpYbJKe8J_IaiBSKD_0 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10694463919163930115', time=2024-09-12T02:55:56.793760+0000, chain.objs.size()=1 2024-09-12T01:07:27.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.096+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.4m-LmRVbUJ3e0J_0I5F1hNoGAD9FNOP_0 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17996070951475907301', time=2024-09-12T02:55:56.828983+0000, chain.objs.size()=1 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.iYh-3ea8BR0E7ypV1eABRZ24Oap7Nz5_0 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8179826606027467813', time=2024-09-12T02:55:56.847547+0000, chain.objs.size()=1 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-lqqdMAR4A248Lc3vvsQOMZs-IQN6yr_0 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12893100665970435311', time=2024-09-12T02:55:56.926956+0000, chain.objs.size()=1 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qFnXNlGxNWz06zr1VQ4qf3ncNC8PKuR_0 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2078308166774183049', time=2024-09-12T02:56:01.812572+0000, chain.objs.size()=1 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.332__shadow_.zPlOFRmptlaV9SllPBmpUD5KwxcR_Lo_0 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7345611867827191116', time=2024-09-12T02:56:26.032440+0000, chain.objs.size()=1 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.373__shadow_.M1dgzV7IuHRlCRRU14pNhokOXPz1ABX_0 2024-09-12T01:07:27.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15955828018366168343', time=2024-09-12T02:57:27.354964+0000, chain.objs.size()=1 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.456__shadow_.xg9c3i49wEG_A89HESE0XvKlgkLGy8a_0 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1917509906342581366', time=2024-09-12T02:57:33.404170+0000, chain.objs.size()=1 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.462__shadow_.OUwtgtN2aekLnxXASO5X1iouHkkQsnY_0 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1187673566519074296', time=2024-09-12T02:57:35.919830+0000, chain.objs.size()=1 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.465__shadow_.jivNAzEAdakEJxENdlqQ899L7OnDalA_0 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.120676159423175168', time=2024-09-12T02:57:36.223162+0000, chain.objs.size()=1 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.465__shadow_.2YY40oalTfvUU9gS5X8x1bAOUvCvgUU_0 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2350796280787807776', time=2024-09-12T02:57:45.065821+0000, chain.objs.size()=1 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.k4eyAAJ8NVZYHihEmAAEhOaeWqAY4By_0 2024-09-12T01:07:27.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18106424190038396850', time=2024-09-12T02:57:45.068222+0000, chain.objs.size()=1 2024-09-12T01:07:27.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.100+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.k663OAcizyM3C6shRAehbjL_ldPGg8x_0 2024-09-12T01:07:27.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5516180268777015943', time=2024-09-12T02:57:45.821077+0000, chain.objs.size()=1 2024-09-12T01:07:27.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.484__shadow_.9LRTfNAPJkD5EoeMuxn6GgoLlcSEAWb_0 2024-09-12T01:07:27.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1635943371603373533', time=2024-09-12T02:57:49.503871+0000, chain.objs.size()=1 2024-09-12T01:07:27.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.489__shadow_.v28Z92QI9BWTpvgkhvPlMSNd2lDwz90_0 2024-09-12T01:07:27.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16905216130763493740', time=2024-09-12T02:57:54.627129+0000, chain.objs.size()=1 2024-09-12T01:07:27.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.498__shadow_.KX82js2Dmhc7NvuveHl5ut5EjaalADs_0 2024-09-12T01:07:27.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~srGGPKeKJDYEdtmVifc2prRKf5qu2GX', time=2024-09-12T02:58:26.547124+0000, chain.objs.size()=1 2024-09-12T01:07:27.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~srGGPKeKJDYEdtmVifc2prRKf5qu2GX.3 2024-09-12T01:07:27.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6102464303680392191', time=2024-09-12T02:58:40.391609+0000, chain.objs.size()=2 2024-09-12T01:07:27.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~if6tOGcX-TAOIiqHxiGYjQ9oU5IyRYf.1 2024-09-12T01:07:27.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~if6tOGcX-TAOIiqHxiGYjQ9oU5IyRYf.2 2024-09-12T01:07:27.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18029968376390912780', time=2024-09-12T02:59:38.472015+0000, chain.objs.size()=1 2024-09-12T01:07:27.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.557__shadow_.8lNdVa54AgdmZfX3HgWXEunMDGUTu_j_0 2024-09-12T01:07:27.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.572225648674502207', time=2024-09-12T02:59:55.482001+0000, chain.objs.size()=1 2024-09-12T01:07:27.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:BBZ0YwOD0Oi8lOOyGchEMeh7B1UdqPd_.PbbtB7ZkbxqoLza9a-y8Rl8HeKdqSmQ_0 2024-09-12T01:07:27.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17770612255565678824', time=2024-09-12T03:00:00.416933+0000, chain.objs.size()=1 2024-09-12T01:07:27.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.570__shadow:JIfNhCbWjk4qj2PUmDQwjhHifnlZwWv_.WFzaWodzwuAJnTsVrbpxfY-6uhPtcBU_0 2024-09-12T01:07:27.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1068039863945865236', time=2024-09-12T03:00:54.527938+0000, chain.objs.size()=1 2024-09-12T01:07:27.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.607__shadow_.R8pvKEeGjgNaBmaxE3ou9jHIkkAQ69E_0 2024-09-12T01:07:27.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4368402907693700285', time=2024-09-12T03:04:56.083802+0000, chain.objs.size()=1 2024-09-12T01:07:27.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.104+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.734__shadow_.7DhxwJEw6gML6uRYCbyVApTIKY4w4-Y_0 2024-09-12T01:07:27.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.108+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4590704449370247781', time=2024-09-12T03:05:04.008685+0000, chain.objs.size()=3 2024-09-12T01:07:27.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.743__multipart_mymultipart3.2~o5-1qwbJles_Opf_RztjOt9gqhuaK2V.1 2024-09-12T01:07:27.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.743__multipart_mymultipart3.2~o5-1qwbJles_Opf_RztjOt9gqhuaK2V.2 2024-09-12T01:07:27.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.108+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.743__multipart_mymultipart3.2~o5-1qwbJles_Opf_RztjOt9gqhuaK2V.3 2024-09-12T01:07:27.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.112+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.112+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:07:27.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54099' 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~6sWDfKZjItZEqOy4pB2GeOYoPyDB2sP', time=2024-09-12T02:52:11.575638+0000, chain.objs.size()=2 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.201__multipart_mymultipart.2~6sWDfKZjItZEqOy4pB2GeOYoPyDB2sP.1 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.201__shadow_mymultipart.2~6sWDfKZjItZEqOy4pB2GeOYoPyDB2sP.1_1 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1670980401993821128', time=2024-09-12T02:53:41.980715+0000, chain.objs.size()=1 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.235__shadow_.aJUOwiRTPYqhEFRPNs0ESIrLAULtcJo_0 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.492817341881525768', time=2024-09-12T02:53:45.023008+0000, chain.objs.size()=1 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.238__shadow_.SlJH2T395BrkTI8Ds5TwYfDe_elPAdR_0 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13253453851218951984', time=2024-09-12T02:53:47.045189+0000, chain.objs.size()=1 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.241__shadow_.ZjDFMIcy0JNj7T8lUbWSg4_GMjx03R5_0 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9535601143561552594', time=2024-09-12T02:54:23.156572+0000, chain.objs.size()=1 2024-09-12T01:07:27.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._jTL-rnES5FBHu9MiiIurn6ynPrSYUz_0 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14838492846311282166', time=2024-09-12T02:54:23.158226+0000, chain.objs.size()=1 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cEExAEQW9GCfvhaDZ_7B2dlvffVALNr_0 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16803568876218007607', time=2024-09-12T02:54:23.209296+0000, chain.objs.size()=1 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GjEK22_hFHeMam7wGZO29NdHncystw6_0 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7760878555232699871', time=2024-09-12T02:54:23.485343+0000, chain.objs.size()=1 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9b4wvGLvrmld9ClHC2AdJGSRkGRmbwJ_0 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8598484211680968411', time=2024-09-12T02:54:23.491595+0000, chain.objs.size()=1 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fJpfXpmWZ_3_YzYeyoco29cheUkgyti_0 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2359293426828241495', time=2024-09-12T02:54:23.515810+0000, chain.objs.size()=1 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Jsivv3bsrAjfTOiPlTWIXTPUNXOa3C5_0 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13395143702011093666', time=2024-09-12T02:54:24.329345+0000, chain.objs.size()=1 2024-09-12T01:07:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.116+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WW6i5LPzEGLGkoH-qJbSg5aYy7Pqbme_0 2024-09-12T01:07:27.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5010660285620201759', time=2024-09-12T02:54:24.358059+0000, chain.objs.size()=1 2024-09-12T01:07:27.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jAI-Yrhtw4kn76T6cuOlk9mSNYRGAe-_0 2024-09-12T01:07:27.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11713986056997333433', time=2024-09-12T02:54:24.372888+0000, chain.objs.size()=1 2024-09-12T01:07:27.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.T4BIml5yuLR_BkoQ4A2c7ecoLArPb8o_0 2024-09-12T01:07:27.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12743073739526625624', time=2024-09-12T02:54:24.414124+0000, chain.objs.size()=1 2024-09-12T01:07:27.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.QuJVGzV_VvZzifxqzO974X_EaswJN1p_0 2024-09-12T01:07:27.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18285668094224602350', time=2024-09-12T02:54:24.439354+0000, chain.objs.size()=1 2024-09-12T01:07:27.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WIbQhB1omRZS8E9FGnJo0qhX6dpCij2_0 2024-09-12T01:07:27.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6803453536207024997', time=2024-09-12T02:54:24.629623+0000, chain.objs.size()=1 2024-09-12T01:07:27.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.120+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NMjIoUjmaGwCdNH4iN4tZUO1KUE2qdA_0 2024-09-12T01:07:27.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14245635881608506425', time=2024-09-12T02:54:24.800540+0000, chain.objs.size()=1 2024-09-12T01:07:27.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.BgSzTa04Ssy4gN0297MlfHVBm5LJ73N_0 2024-09-12T01:07:27.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5474281190601131047', time=2024-09-12T02:54:24.858400+0000, chain.objs.size()=1 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1NdcQSYQ_mP4LNo0drwudO9-2ARaPpi_0 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4160961828632769577', time=2024-09-12T02:54:24.888005+0000, chain.objs.size()=1 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8-4Drbw-RTUh_wyVGXAwxJd0w3W9xQs_0 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14343685817342445173', time=2024-09-12T02:54:24.909404+0000, chain.objs.size()=1 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IcK4q9j9qq18ddf-jl3PfykEvsmL5Bo_0 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2026335400197703161', time=2024-09-12T02:54:24.984233+0000, chain.objs.size()=1 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HuMXNEnkul2zQmo5maEdfk9wrXMT7x4_0 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12446706307391865864', time=2024-09-12T02:54:25.149508+0000, chain.objs.size()=1 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.q-uGBO8uHb_-J8IOASlO_CiBuUpWyNQ_0 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15753768880385839275', time=2024-09-12T02:54:25.154329+0000, chain.objs.size()=1 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NaWyH0i7WFkbh7qxvDkQTF-0_1pznyx_0 2024-09-12T01:07:27.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15912541113727447261', time=2024-09-12T02:54:25.174969+0000, chain.objs.size()=1 2024-09-12T01:07:27.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.THECkDHiPJsc2R6Gft8qyOW1toCidHx_0 2024-09-12T01:07:27.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6573199302132426031', time=2024-09-12T02:54:25.230714+0000, chain.objs.size()=1 2024-09-12T01:07:27.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.G8Lj3k7r13qQpbbhW9OS5KsOG4lLUlv_0 2024-09-12T01:07:27.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15465838307511296165', time=2024-09-12T02:54:25.237296+0000, chain.objs.size()=1 2024-09-12T01:07:27.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._qXvtIzTW6AzxH_y4qy_t2LDnK4ECBe_0 2024-09-12T01:07:27.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4148412095832219314', time=2024-09-12T02:54:25.241325+0000, chain.objs.size()=1 2024-09-12T01:07:27.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.124+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2X_74tzxgbRtye_AgvbfE0LOoWDoWR-_0 2024-09-12T01:07:27.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6502314203445380919', time=2024-09-12T02:54:25.243903+0000, chain.objs.size()=1 2024-09-12T01:07:27.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-A3s3tqEaq67oR0n-Vl8_rcE1MHoLQb_0 2024-09-12T01:07:27.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12416849679459489959', time=2024-09-12T02:54:25.300646+0000, chain.objs.size()=1 2024-09-12T01:07:27.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8VbQ9Gsweo9j2w-1pbJZtxJTmmkA2R9_0 2024-09-12T01:07:27.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7563588373656150864', time=2024-09-12T02:54:25.344904+0000, chain.objs.size()=1 2024-09-12T01:07:27.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.s24X1Ed04j3RpBftkxXL4d-QP7Yhe2G_0 2024-09-12T01:07:27.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8629655891580829238', time=2024-09-12T02:54:25.589290+0000, chain.objs.size()=1 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.m7s7ij9klYKWkw7Bb4PD2EoD4popkYq_0 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5161586540156268751', time=2024-09-12T02:54:25.648811+0000, chain.objs.size()=1 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.i-E-eX-Ac-VpXJRbQaC6cHZ46SQFAwY_0 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13913207870974804821', time=2024-09-12T02:54:25.658561+0000, chain.objs.size()=1 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RwyjzULxwlMgAdAd9vvl5P8O82gmdTX_0 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3270694128830072680', time=2024-09-12T02:54:25.862140+0000, chain.objs.size()=1 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HdWgK662P0zvdzrOSdrWfaMavzkcWC2_0 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8820938631767281330', time=2024-09-12T02:54:25.974263+0000, chain.objs.size()=1 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.a5uQRtZYQnAb54RLXE70KmQ3jqzFQ2M_0 2024-09-12T01:07:27.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8956029709739555311', time=2024-09-12T02:54:35.549856+0000, chain.objs.size()=1 2024-09-12T01:07:27.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.276__shadow_.9KW2VXW7sogEBzf_S8wXgp1vgLdwGKM_0 2024-09-12T01:07:27.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17348000684962882060', time=2024-09-12T02:54:37.642402+0000, chain.objs.size()=1 2024-09-12T01:07:27.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.128+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.279__shadow_.E7-BkTHN1s2gPos5vxKLhQJOdhzSDcc_0 2024-09-12T01:07:27.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7089498395376189330', time=2024-09-12T02:54:41.889086+0000, chain.objs.size()=1 2024-09-12T01:07:27.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.285__shadow_.liyd67bXGs1pjZ3l_WHZ4HYHzdjQzV7_0 2024-09-12T01:07:27.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11754698162280267586', time=2024-09-12T02:54:42.620527+0000, chain.objs.size()=1 2024-09-12T01:07:27.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.286__shadow_.namaR_KTq3gwLs7zvpUpCE-7oYbFPpv_0 2024-09-12T01:07:27.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16162515277523035667', time=2024-09-12T02:54:44.768728+0000, chain.objs.size()=1 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.289__shadow_.ksBJPtvmxfprMfRLjjjrmhorETkGarH_0 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15482587784540504797', time=2024-09-12T02:54:47.911301+0000, chain.objs.size()=1 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.OzaTyYYpELq1ZIpurJ1OaQyeRoWAx6w_0 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8853063915685848584', time=2024-09-12T02:54:49.355365+0000, chain.objs.size()=1 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.KYUI0gwmnivMD30FUuC84w70QZm0qN1_0 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13890212107555116614', time=2024-09-12T02:54:49.360025+0000, chain.objs.size()=1 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.0TKguRu9MysGiMArOKCg0EF-Q2V5uEX_0 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4986068302293684634', time=2024-09-12T02:54:49.405773+0000, chain.objs.size()=1 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.X-nxgeTpegHbRgFcM9SnD4euCsiuJbs_0 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.227028611083991792', time=2024-09-12T02:54:52.183113+0000, chain.objs.size()=1 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.297__shadow_.i-0acdWifjTAIKhba8CgqpHbtttKnXr_0 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12470481493216018121', time=2024-09-12T02:54:57.824494+0000, chain.objs.size()=1 2024-09-12T01:07:27.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.305__shadow_.AO60JA5v1_vp8ffJxcdznBy9HHX1m4I_0 2024-09-12T01:07:27.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9548271301745022544', time=2024-09-12T02:55:30.948421+0000, chain.objs.size()=1 2024-09-12T01:07:27.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7UBdGJhM19NTHNQvTUfYCuIidguPEAa_0 2024-09-12T01:07:27.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12438743446579169439', time=2024-09-12T02:55:30.977789+0000, chain.objs.size()=1 2024-09-12T01:07:27.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eKazns3ULqQDpTi1oJFvaqXzP_srYdK_0 2024-09-12T01:07:27.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2167473753545993560', time=2024-09-12T02:55:31.009003+0000, chain.objs.size()=1 2024-09-12T01:07:27.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.132+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Y1C1ZCVD0UOjrGekl2yhlLFKUT2bzh9_0 2024-09-12T01:07:27.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8104573710463798011', time=2024-09-12T02:55:31.054726+0000, chain.objs.size()=1 2024-09-12T01:07:27.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.X5aEeecvDkfOW_-SWvxcEtwtS7yPaCG_0 2024-09-12T01:07:27.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9034020586775950959', time=2024-09-12T02:55:31.065750+0000, chain.objs.size()=1 2024-09-12T01:07:27.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.SxI0mCe4gFc2MjaEp9ptjcmS1eDgfd1_0 2024-09-12T01:07:27.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.136+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14231619294328449576', time=2024-09-12T02:55:31.092992+0000, chain.objs.size()=1 2024-09-12T01:07:27.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.136+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8SOj9ysOi7igfcBhctqjrvSSBtRF2t4_0 2024-09-12T01:07:27.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1142916764392704727', time=2024-09-12T02:55:31.251002+0000, chain.objs.size()=1 2024-09-12T01:07:27.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.iajmROveoh_qQw1thSKVgVt5ytXigle_0 2024-09-12T01:07:27.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10836205191854418882', time=2024-09-12T02:55:31.266196+0000, chain.objs.size()=1 2024-09-12T01:07:27.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yXhzHE4UahyH-cR_9nb1g8DdQgvQuoL_0 2024-09-12T01:07:27.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16696974562318671858', time=2024-09-12T02:55:31.410101+0000, chain.objs.size()=1 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YgXHq8VA0sbVULmp4IgvFsAPm6KUxxy_0 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7234310033217034730', time=2024-09-12T02:55:31.441591+0000, chain.objs.size()=1 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Gh7x419bo-ZNYtXleUhLDBxJBiSAJse_0 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17479239144974738304', time=2024-09-12T02:55:31.619655+0000, chain.objs.size()=1 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.d2yOaxwkZYgBKMjunBG_l33Ezjv9F8p_0 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.643302169109443186', time=2024-09-12T02:55:31.665649+0000, chain.objs.size()=1 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.CcROB1D46SotI5Tr_LPVT5KVIMaEKn5_0 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18401547375443124357', time=2024-09-12T02:55:31.727536+0000, chain.objs.size()=1 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.O9VG1SuvT060CG1Ap6Ma8vbVwEjJFBD_0 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3381715538536058614', time=2024-09-12T02:55:32.038214+0000, chain.objs.size()=1 2024-09-12T01:07:27.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pcr1AsXOfe-MNxCKOtN6Tkp0sbuTJXA_0 2024-09-12T01:07:27.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14631959457709389551', time=2024-09-12T02:55:32.054977+0000, chain.objs.size()=1 2024-09-12T01:07:27.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3BAu-JaKssG80LWa5T2UL4aKHLvU9-h_0 2024-09-12T01:07:27.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.88713982459030976', time=2024-09-12T02:55:32.093034+0000, chain.objs.size()=1 2024-09-12T01:07:27.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pf9fX7aFKhW5hyzikzU8nMHp3hzds4j_0 2024-09-12T01:07:27.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12440357988959846547', time=2024-09-12T02:55:32.096394+0000, chain.objs.size()=1 2024-09-12T01:07:27.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.140+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zxfcsThyDgEV8XkW4rlp5-aPhSwZxT5_0 2024-09-12T01:07:27.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4146908261394912068', time=2024-09-12T02:55:32.247455+0000, chain.objs.size()=1 2024-09-12T01:07:27.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.FCnta9IRHnwrv9OfiBAkQWEmX23wbdy_0 2024-09-12T01:07:27.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16813772748243563912', time=2024-09-12T02:55:32.322573+0000, chain.objs.size()=1 2024-09-12T01:07:27.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pUIaLGO5xCmz7p1P--i5qkBmd4GDy65_0 2024-09-12T01:07:27.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1330025983478530033', time=2024-09-12T02:55:32.345598+0000, chain.objs.size()=1 2024-09-12T01:07:27.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.AMCXZaS4GbK-l6_mQlbLTVHTTNlM_cZ_0 2024-09-12T01:07:27.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.487379572231630681', time=2024-09-12T02:55:32.421543+0000, chain.objs.size()=1 2024-09-12T01:07:27.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4Ypfpbai0odfyfSXmN3PI-PTWqFI-0h_0 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5665539999042534907', time=2024-09-12T02:55:32.452680+0000, chain.objs.size()=1 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.A_iFvYuM-3CimgVak8W8VRNyVhj4Dce_0 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1025331111526634879', time=2024-09-12T02:55:32.553529+0000, chain.objs.size()=1 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.K49oIUD0tpiaCi9T9Ma-MBqY0FNLECE_0 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3393519328464207097', time=2024-09-12T02:55:32.566851+0000, chain.objs.size()=1 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Arc1uC6_Vyo8oDmqAd7TCmy5sES5SYM_0 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12843265227137444010', time=2024-09-12T02:55:32.716382+0000, chain.objs.size()=1 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7s7OyZS8x27wGklN1mOIdW2BzuTWNZu_0 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3071115733980706853', time=2024-09-12T02:55:32.754780+0000, chain.objs.size()=1 2024-09-12T01:07:27.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MwsGk4hErfcOYndAeu1NFlQN2w9t2TH_0 2024-09-12T01:07:27.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7369136236335935238', time=2024-09-12T02:55:33.036815+0000, chain.objs.size()=1 2024-09-12T01:07:27.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ADvx9JiVrKFoJJWJaYaHiv_uDzTxNhu_0 2024-09-12T01:07:27.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2730930092710117481', time=2024-09-12T02:55:33.056794+0000, chain.objs.size()=1 2024-09-12T01:07:27.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.144+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xpQpUlDsLgi7DRxc5F1Qw27SvgsAJfE_0 2024-09-12T01:07:27.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17504455670825531860', time=2024-09-12T02:55:33.057638+0000, chain.objs.size()=1 2024-09-12T01:07:27.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lL4my0zOxEDgCF5Y3_X3acrierQUQqM_0 2024-09-12T01:07:27.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6935460921641131027', time=2024-09-12T02:55:33.067183+0000, chain.objs.size()=1 2024-09-12T01:07:27.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9BsNym2dk23DtTtEzlwIaEvK_qdYO_A_0 2024-09-12T01:07:27.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.440929448817949346', time=2024-09-12T02:55:33.077630+0000, chain.objs.size()=1 2024-09-12T01:07:27.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xHkpNGBJki-xDNkP08xYzNxpMqAKgab_0 2024-09-12T01:07:27.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8198100593628361981', time=2024-09-12T02:55:33.178378+0000, chain.objs.size()=1 2024-09-12T01:07:27.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ud4oe0bTwGAXriuTx0dts2stwbXVblm_0 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4720307218416982580', time=2024-09-12T02:55:54.456060+0000, chain.objs.size()=1 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mKaxiFA1rxk98zsF1lMwtaS1avEOJsh_0 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3317199870357986262', time=2024-09-12T02:55:54.552488+0000, chain.objs.size()=1 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xIPvXGDwP4Acw41oACaZRED9vymeL6K_0 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17136538016163390216', time=2024-09-12T02:55:54.576230+0000, chain.objs.size()=1 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.n-OHtzVmTVabiGOaDc1PIVxevnHcpsm_0 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16703776310438855760', time=2024-09-12T02:55:54.602310+0000, chain.objs.size()=1 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ysTNrodcSp-9BfwRyhrCA3-0QyUxRSk_0 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2226135236703814148', time=2024-09-12T02:55:54.667642+0000, chain.objs.size()=1 2024-09-12T01:07:27.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RAAe0-GEmHWr_MoSqhgdwI9b_1DMF0F_0 2024-09-12T01:07:27.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15630816757032431199', time=2024-09-12T02:55:54.683407+0000, chain.objs.size()=1 2024-09-12T01:07:27.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lwLQvpnz5BBoG904NcFRFatvebFqmnw_0 2024-09-12T01:07:27.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16727560719777470458', time=2024-09-12T02:55:54.818758+0000, chain.objs.size()=1 2024-09-12T01:07:27.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.148+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FosUvjmKpl5aefRtT3tZNxXsQgpP3WH_0 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10846623107397642956', time=2024-09-12T02:55:54.862465+0000, chain.objs.size()=1 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Il0ACuxx5SL1zKK60zS_uSofkCzkqy-_0 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12066853946878926339', time=2024-09-12T02:55:55.002821+0000, chain.objs.size()=1 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.yM9Xgd5-S5qEzrsHs9KiRiqep896jJH_0 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10736068497717658791', time=2024-09-12T02:55:55.501986+0000, chain.objs.size()=1 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VoS2v1KAh869bGYRQl7JH1DqUfot-5T_0 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10755447932651806463', time=2024-09-12T02:55:55.555138+0000, chain.objs.size()=1 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.thVXM9AYBMfwduJ9X8-lByJajrTU5YK_0 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13808994018377744959', time=2024-09-12T02:55:55.904444+0000, chain.objs.size()=1 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.829hlxgIdpBdcMqGnL-OMhaqoiFPrCJ_0 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10744343935811324790', time=2024-09-12T02:55:55.918946+0000, chain.objs.size()=1 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6L1LHSBdLD2LXtbh3rLhwuVKJZGHuql_0 2024-09-12T01:07:27.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5689104012557141862', time=2024-09-12T02:55:56.008594+0000, chain.objs.size()=1 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qqM5MTYt5xy3QgC-lEkyRNCfGcWRv9t_0 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11161407020230871599', time=2024-09-12T02:55:56.011110+0000, chain.objs.size()=1 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xD01YhtHAACVOoDFxH4WTjmehG_2ON2_0 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5271122300458766637', time=2024-09-12T02:55:56.312176+0000, chain.objs.size()=1 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ghrA9hVlrp_Uh5YEeDLWkolHRRi6tMw_0 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14743220981588525868', time=2024-09-12T02:55:56.477937+0000, chain.objs.size()=1 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YvtdZVQNChbJ8HvN51L1IpxbqqScarl_0 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.179865077282287980', time=2024-09-12T02:55:56.515969+0000, chain.objs.size()=1 2024-09-12T01:07:27.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.152+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.cFq0Fi8UpRufM_2xOLqe7ca5nVTeswo_0 2024-09-12T01:07:27.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.156+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17051412962231636754', time=2024-09-12T02:55:56.542717+0000, chain.objs.size()=1 2024-09-12T01:07:27.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.156+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sL4y9xnuuyl_MXHOkKQq2PEY09TSjUo_0 2024-09-12T01:07:27.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.156+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15607267934936028766', time=2024-09-12T02:55:56.609814+0000, chain.objs.size()=1 2024-09-12T01:07:27.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.156+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.N_l3cennKy4_ALafIbLRsBrOwOxe1Ie_0 2024-09-12T01:07:27.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.156+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1662995567956489607', time=2024-09-12T02:55:56.766909+0000, chain.objs.size()=1 2024-09-12T01:07:27.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.156+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.AoSexc5lcc8yN69GxcC-Ki_Nfnvuzrj_0 2024-09-12T01:07:27.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.156+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6519857428854575564', time=2024-09-12T02:55:56.834423+0000, chain.objs.size()=1 2024-09-12T01:07:27.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.156+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vS_lweAJmv2UyBdAeUD7swgO08ijdSc_0 2024-09-12T01:07:27.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.160+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54099 2024-09-12T01:07:27.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:07:27.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12521513615939008631', time=2024-09-12T02:55:56.863719+0000, chain.objs.size()=1 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TllxoeMdvwW-pI_ajshwOtTnUb7MxtT_0 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15856983726509598577', time=2024-09-12T02:55:56.869795+0000, chain.objs.size()=1 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LpWLGqiYHp9e_i-aDPDK7IabOGW07fO_0 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6196294121848874959', time=2024-09-12T02:56:30.456832+0000, chain.objs.size()=1 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.378__shadow_.mXd9pDjB7lR-i27jLMh7RVrWeJ1N6pr_0 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1668666949148180199', time=2024-09-12T02:57:29.397757+0000, chain.objs.size()=1 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.458__shadow_.u8R20f53tvfBGpm4_3Oo_IJqOs8JI7t_0 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6035400501659641005', time=2024-09-12T02:57:58.084627+0000, chain.objs.size()=1 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.503__shadow:9LDvWGdmQQQ9l1.sKobe4w5aXdN6o1o_.IhjeMTusnwtlTOOsBJp3rTYo2SIwJCh_0 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~JbtLdMjFmRpsogRY0sQ9XW-Kpvssb8t', time=2024-09-12T02:58:23.106890+0000, chain.objs.size()=1 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~JbtLdMjFmRpsogRY0sQ9XW-Kpvssb8t.2 2024-09-12T01:07:27.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4460007823050221126', time=2024-09-12T02:58:38.511429+0000, chain.objs.size()=2 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~duYjJHlvNwRnZdaD8Mf8yP7fTUek2fE.1 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~duYjJHlvNwRnZdaD8Mf8yP7fTUek2fE.2 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15950612777008230828', time=2024-09-12T02:58:39.915529+0000, chain.objs.size()=1 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.525__multipart_mymultipart.2~7HR73qS3I6sxnMyDNZ_JrFat5qCUBS0.1 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3502101851970576019', time=2024-09-12T02:59:58.622460+0000, chain.objs.size()=1 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:QUT1K.cx.fHbB5d6h-UvTH3NxXwLolr_.MtujSBvaWP8ITyVqO7ZxlmLuB-lkDtf_0 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17530755870502485953', time=2024-09-12T03:00:08.565269+0000, chain.objs.size()=1 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.575__shadow:wSPtZ1iNIOwFpi37aTcnxPKWbVqU6FS_.MQgGEjZxdLCRaTqPKQdzAE3xgOinkk4_0 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12147584504060922962', time=2024-09-12T03:00:22.316519+0000, chain.objs.size()=1 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:TFRj2oQouTxRFJORUAufJE1jzDegVyd_.1d8AsMNTPJu-mpU_PHnAdui6sMENG5u_0 2024-09-12T01:07:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12326254838793604439', time=2024-09-12T03:00:28.825322+0000, chain.objs.size()=1 2024-09-12T01:07:27.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:CVe7m0XmtU1FM-tAKrJ9BoUrfLs4C0w_.3ACYE2jfGhEr1h0P7d65yf1lqGdUeg1_0 2024-09-12T01:07:27.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14854423064802640404', time=2024-09-12T03:00:36.941955+0000, chain.objs.size()=1 2024-09-12T01:07:27.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:OWXWUOeiW0f1dDrybyO5kQ5JrSa1ayc_.H8tWYD1GaDycZWJ3RVa_PoqT_M6vbgD_0 2024-09-12T01:07:27.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6269276110845861862', time=2024-09-12T03:00:38.639218+0000, chain.objs.size()=1 2024-09-12T01:07:27.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.164+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.583__shadow:4Ic4aPX4XYrBuL1jIfvfDnycmB28u3i_.11Bdp_1JFCO-e6RUKmYj9fFk2YLbplZ_0 2024-09-12T01:07:27.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13540399932575773168', time=2024-09-12T03:00:47.917790+0000, chain.objs.size()=1 2024-09-12T01:07:27.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.596__shadow_.Bnjh7YCTB2KJcn6E-d9Lw2zDJQbe9OF_0 2024-09-12T01:07:27.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17090969272033180012', time=2024-09-12T03:03:36.527925+0000, chain.objs.size()=2 2024-09-12T01:07:27.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.646__shadow_.zHO-A4ZS0MnByT1bQRbnxKooJ_Vg0IF_0 2024-09-12T01:07:27.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.646__shadow_.zHO-A4ZS0MnByT1bQRbnxKooJ_Vg0IF_1 2024-09-12T01:07:27.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13847424698636794226', time=2024-09-12T03:03:39.279962+0000, chain.objs.size()=2 2024-09-12T01:07:27.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.649__shadow_.3HNBD6tLK_kmRu_Kh8ynpJwA0nUozX4_0 2024-09-12T01:07:27.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.649__shadow_.3HNBD6tLK_kmRu_Kh8ynpJwA0nUozX4_1 2024-09-12T01:07:27.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6167773350868372640', time=2024-09-12T03:04:15.059818+0000, chain.objs.size()=1 2024-09-12T01:07:27.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.701__shadow:4-LJ6Coz3KmDrGEpSiac3OL9rZrPMFo_.HvS6yQFLJ_XCcn1RBA6DtnvZZRhMLD__0 2024-09-12T01:07:27.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16348294313353184213', time=2024-09-12T03:04:57.976521+0000, chain.objs.size()=10 2024-09-12T01:07:27.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.1 2024-09-12T01:07:27.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.2 2024-09-12T01:07:27.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.3 2024-09-12T01:07:27.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.4 2024-09-12T01:07:27.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.168+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.5 2024-09-12T01:07:27.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.172+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.6 2024-09-12T01:07:27.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.172+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.7 2024-09-12T01:07:27.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.172+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.8 2024-09-12T01:07:27.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.172+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.9 2024-09-12T01:07:27.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.172+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.735__multipart_foo.2~xFAxih1vOnpvzJechXQbYRBa9JNPAxn.10 2024-09-12T01:07:27.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.172+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.197005416573963042', time=2024-09-12T03:05:01.784145+0000, chain.objs.size()=1 2024-09-12T01:07:27.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.172+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.741__shadow_.qYGSeTzfGATOY5iR3Mkh5-XAaYpsxTJ_0 2024-09-12T01:07:27.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.176+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:07:27.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48797' 2024-09-12T01:07:27.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_TArOQKxFHzjXcf19ejxU81ymLO5F_EG', time=2024-09-12T02:51:32.021005+0000, chain.objs.size()=3 2024-09-12T01:07:27.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.aaw-wI7khVpE3afNJlb1Xk-69Jaywk7_0 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.aaw-wI7khVpE3afNJlb1Xk-69Jaywk7_1 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.160__shadow_.aaw-wI7khVpE3afNJlb1Xk-69Jaywk7_2 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1965054928567274263', time=2024-09-12T02:51:49.664664+0000, chain.objs.size()=1 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.181__shadow_.cyhdhDb0P6ACPjRh1wksL4HsXbwVYy4_0 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10442758483453024527', time=2024-09-12T02:53:41.982504+0000, chain.objs.size()=1 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.235__shadow_._Y0SpqZz1vYPYS7095JFqxsAd6SU147_0 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18034108658479528032', time=2024-09-12T02:53:47.725687+0000, chain.objs.size()=1 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.242__shadow_.bOVHbaTGIeMwtVmm64D_maHBieNSY-L_0 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9882860135924652202', time=2024-09-12T02:53:50.784078+0000, chain.objs.size()=1 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.245__shadow_.9ij8-QELU-3asjU3ldmKVbjx0xLGG4h_0 2024-09-12T01:07:27.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1299967531306063929', time=2024-09-12T02:54:23.077832+0000, chain.objs.size()=1 2024-09-12T01:07:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DgQJ1Pm_Ep9eAxgp8l14nXbfGr43_H8_0 2024-09-12T01:07:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11960541000636459909', time=2024-09-12T02:54:23.089721+0000, chain.objs.size()=1 2024-09-12T01:07:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hEVJLbBsA5Qz5xX1m7YoK4ZUoaySaUC_0 2024-09-12T01:07:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11493711120088418297', time=2024-09-12T02:54:23.091388+0000, chain.objs.size()=1 2024-09-12T01:07:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Qgb8tWhvhBkDfC5eTMU84KvIR94FEn__0 2024-09-12T01:07:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8115759709609094295', time=2024-09-12T02:54:23.117937+0000, chain.objs.size()=1 2024-09-12T01:07:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.lMPTjV7JvyXeRgoVnRAGKByeEoG-76n_0 2024-09-12T01:07:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18272005150876677794', time=2024-09-12T02:54:23.387227+0000, chain.objs.size()=1 2024-09-12T01:07:27.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.184+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.BFfGmw3a0iFnIL8cAknYVxEnXp4dZeP_0 2024-09-12T01:07:27.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3451341478249925841', time=2024-09-12T02:54:23.389259+0000, chain.objs.size()=1 2024-09-12T01:07:27.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GJt4I1RJYg7xdklxq2EQ_u04E9J5CeC_0 2024-09-12T01:07:27.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2900729530423508313', time=2024-09-12T02:54:23.391416+0000, chain.objs.size()=1 2024-09-12T01:07:27.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hQ3soW_z2Amr3VeRArn9IPsGPfjDMcp_0 2024-09-12T01:07:27.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2997834033377964299', time=2024-09-12T02:54:23.433642+0000, chain.objs.size()=1 2024-09-12T01:07:27.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qhFOl5Ejp4jeN8DsgzlPYXqNM5APdjR_0 2024-09-12T01:07:27.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6420673372361318050', time=2024-09-12T02:54:23.466980+0000, chain.objs.size()=1 2024-09-12T01:07:27.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TSyYiOhFzuxKqHIRumjfB0OmVmfDrcb_0 2024-09-12T01:07:27.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5072150157872319040', time=2024-09-12T02:54:23.523606+0000, chain.objs.size()=1 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DuABwdCADJqcOusANLoIrzkBMZ1pfV9_0 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3038279023964518888', time=2024-09-12T02:54:23.552880+0000, chain.objs.size()=1 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Wpi5QGIm3TMwnNqX5xDEIEgAgOGAc6C_0 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13742419300995196323', time=2024-09-12T02:54:23.598623+0000, chain.objs.size()=1 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._AirPC-YFgwYQTvHOZAz_KEw1M8aIHv_0 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7546468899478860344', time=2024-09-12T02:54:24.136784+0000, chain.objs.size()=1 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uce2w8L20FKsEvLfttKyOIxrZCYBauh_0 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.685865765530537108', time=2024-09-12T02:54:24.163245+0000, chain.objs.size()=1 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.oxZem8CrPM4030sj1_uayZypNNNCx8z_0 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14015388386390328973', time=2024-09-12T02:54:24.399304+0000, chain.objs.size()=1 2024-09-12T01:07:27.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jYx1glFO9YHfQn8zVvBpWT3SHqFeF2q_0 2024-09-12T01:07:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5329406519326972385', time=2024-09-12T02:54:24.444353+0000, chain.objs.size()=1 2024-09-12T01:07:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.188+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.9P41VU7aPPlWL3EP3mDE2eskgQKsXfi_0 2024-09-12T01:07:27.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14695708405948177348', time=2024-09-12T02:54:24.508261+0000, chain.objs.size()=1 2024-09-12T01:07:27.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.08E_WZ7yfcGbgQj7Rhh5XLKti0FOcdq_0 2024-09-12T01:07:27.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9230699987011143166', time=2024-09-12T02:54:24.783753+0000, chain.objs.size()=1 2024-09-12T01:07:27.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.lYCTJieaW53ll_-hkgaWiqeOMC84Kxu_0 2024-09-12T01:07:27.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.192+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9775041250694417780', time=2024-09-12T02:54:24.814187+0000, chain.objs.size()=1 2024-09-12T01:07:27.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.192+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.azrBSnYIXH8oPIZyPjthXGNxRv2mCuD_0 2024-09-12T01:07:27.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4079943648125100852', time=2024-09-12T02:54:24.839465+0000, chain.objs.size()=1 2024-09-12T01:07:27.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1bG1VTRxYT7eH4YiSi_0OEI7_ntZjSF_0 2024-09-12T01:07:27.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7348119710266353958', time=2024-09-12T02:54:24.844730+0000, chain.objs.size()=1 2024-09-12T01:07:27.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.x2fcOK-eQhaXW_eVZGsb7w09VwCtMyK_0 2024-09-12T01:07:27.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15154327440921195101', time=2024-09-12T02:54:24.926757+0000, chain.objs.size()=1 2024-09-12T01:07:27.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.U_3rPSQOuU9VFF4UN_xRnhuGzw4CxzO_0 2024-09-12T01:07:27.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2093894196777903553', time=2024-09-12T02:54:25.309656+0000, chain.objs.size()=1 2024-09-12T01:07:27.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Hlyw4Q0zy73F_e2nkGbJ3FXCvMXw4xl_0 2024-09-12T01:07:27.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8071332699127308742', time=2024-09-12T02:54:25.520055+0000, chain.objs.size()=1 2024-09-12T01:07:27.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bTIUjpCQT6Qlwc7rEoub44XygQCkTNC_0 2024-09-12T01:07:27.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10055466930112903045', time=2024-09-12T02:54:25.529337+0000, chain.objs.size()=1 2024-09-12T01:07:27.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vXZ-IPPquhCZyOtLckhAElUGo13RhaF_0 2024-09-12T01:07:27.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14587607163063364774', time=2024-09-12T02:54:25.564433+0000, chain.objs.size()=1 2024-09-12T01:07:27.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rJbd7Irc6sS8jQq4aJP9Lg5rO5-bZUN_0 2024-09-12T01:07:27.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5954526929537476394', time=2024-09-12T02:54:25.628814+0000, chain.objs.size()=1 2024-09-12T01:07:27.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AW7pY10XE-XlqwGuqGqmWVv0n8OEqP8_0 2024-09-12T01:07:27.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15061847341820010034', time=2024-09-12T02:54:25.659244+0000, chain.objs.size()=1 2024-09-12T01:07:27.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.196+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.eoFLoi7pJ82g_B-r8Cjzk5YUZOjmdvd_0 2024-09-12T01:07:27.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9263856706807351732', time=2024-09-12T02:54:25.683178+0000, chain.objs.size()=1 2024-09-12T01:07:27.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cGd4TUfiUeJcIyvY52XFbnuxhwmuxM6_0 2024-09-12T01:07:27.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4983193194327016120', time=2024-09-12T02:54:25.685450+0000, chain.objs.size()=1 2024-09-12T01:07:27.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.EUusV8qqrYlXP_6J_Ml4qg9jeep1Nzc_0 2024-09-12T01:07:27.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2002259478410095978', time=2024-09-12T02:54:25.695062+0000, chain.objs.size()=1 2024-09-12T01:07:27.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FDtmebi6iySyPuagrf7joY3TqbG1H9x_0 2024-09-12T01:07:27.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.977100098199686603', time=2024-09-12T02:54:25.708902+0000, chain.objs.size()=1 2024-09-12T01:07:27.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hSGybCVFlTgyDck49179bS3xW2JUvhm_0 2024-09-12T01:07:27.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9168651427483624345', time=2024-09-12T02:54:27.304956+0000, chain.objs.size()=1 2024-09-12T01:07:27.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.264__shadow_.4qNVRAgOK27f1dsall0cyGTfXRx2ogV_0 2024-09-12T01:07:27.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8804470683457475992', time=2024-09-12T02:54:30.709824+0000, chain.objs.size()=1 2024-09-12T01:07:27.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.269__shadow_.lCldgNm5QkJEANqcomS9IEdGHTPcNZM_0 2024-09-12T01:07:27.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7765789658986448102', time=2024-09-12T02:54:35.546703+0000, chain.objs.size()=1 2024-09-12T01:07:27.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.200+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.276__shadow_.2wMjOgFlujQMi4-4VgyA4VyvSiZa53F_0 2024-09-12T01:07:27.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12443304226436502521', time=2024-09-12T02:54:41.170172+0000, chain.objs.size()=1 2024-09-12T01:07:27.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.284__shadow_.ucImYnCkURhqgfTdGV_bC8Z7muSb8jr_0 2024-09-12T01:07:27.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4670205981305423016', time=2024-09-12T02:54:44.772174+0000, chain.objs.size()=1 2024-09-12T01:07:27.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.289__shadow_.IZ9Nfd79m9FNHly4FoFg1v2jr8hFnKL_0 2024-09-12T01:07:27.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.159322699985258635', time=2024-09-12T02:54:55.130595+0000, chain.objs.size()=1 2024-09-12T01:07:27.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.301__shadow_.726v8yKWbq7VcCfekOnRT7twFJ2dsD4_0 2024-09-12T01:07:27.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3976544823490015781', time=2024-09-12T02:55:30.873058+0000, chain.objs.size()=1 2024-09-12T01:07:27.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jBBPi-ZLT4xUSm_b2nfX3XtBcvK2nzi_0 2024-09-12T01:07:27.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9712016465378420631', time=2024-09-12T02:55:31.061097+0000, chain.objs.size()=1 2024-09-12T01:07:27.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ygcX5bMFiwmqItqPxPeg7UVRZRk8v_A_0 2024-09-12T01:07:27.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.163525873772140445', time=2024-09-12T02:55:31.294215+0000, chain.objs.size()=1 2024-09-12T01:07:27.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4yM83x9GOwHHBFGQxva2597EN1T0tnF_0 2024-09-12T01:07:27.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15349360459933977215', time=2024-09-12T02:55:31.345876+0000, chain.objs.size()=1 2024-09-12T01:07:27.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KLWgHmcLksbc_aDV80i0aG2TukLHyYs_0 2024-09-12T01:07:27.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10925229423703911574', time=2024-09-12T02:55:31.385532+0000, chain.objs.size()=1 2024-09-12T01:07:27.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-KcnR-NT5HWI4g8Vi0cw-LuK8N79Nd3_0 2024-09-12T01:07:27.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15076692920110003885', time=2024-09-12T02:55:31.390142+0000, chain.objs.size()=1 2024-09-12T01:07:27.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Cwo2KQcTy7SPRzuhU21k9XJVqz63fmn_0 2024-09-12T01:07:27.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7512927014738887157', time=2024-09-12T02:55:31.573078+0000, chain.objs.size()=1 2024-09-12T01:07:27.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.204+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GAx9Psi9Ch784YMCOEMgM6eLmZDh4lf_0 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9207027535461145169', time=2024-09-12T02:55:31.587545+0000, chain.objs.size()=1 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.w-CMG5_oGa2uTRrO81yWqzeR8Ui3Osx_0 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12368562090233107398', time=2024-09-12T02:55:31.640263+0000, chain.objs.size()=1 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.r7oGASXGOC1lHj-btDw56ScQVXjH2UR_0 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.738235265635721928', time=2024-09-12T02:55:31.929163+0000, chain.objs.size()=1 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Vu2VljKn_Bt7Ni_8_hS6J2XoWwsesvx_0 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7377636610069549816', time=2024-09-12T02:55:32.001235+0000, chain.objs.size()=1 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Ssj41HGYA2klbf_f0g4wJjvtY5UzMrO_0 2024-09-12T01:07:27.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1543519451114038946', time=2024-09-12T02:55:32.029310+0000, chain.objs.size()=1 2024-09-12T01:07:27.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xUNH6_-me3lpm1sdPXse5WWkXuJMhpP_0 2024-09-12T01:07:27.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.145083011030623263', time=2024-09-12T02:55:32.048130+0000, chain.objs.size()=1 2024-09-12T01:07:27.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.208+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WwzVieoduCDO8GBX05sEwsueS6xD_Ke_0 2024-09-12T01:07:27.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5979722504373850482', time=2024-09-12T02:55:32.284024+0000, chain.objs.size()=1 2024-09-12T01:07:27.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RqQkv8Z9GeFt-GFOBKRTGWrNkFHfiqO_0 2024-09-12T01:07:27.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15390934172463711728', time=2024-09-12T02:55:32.340202+0000, chain.objs.size()=1 2024-09-12T01:07:27.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Yqn10R_wT2axMhn6cvDYmkmMdmIk0pu_0 2024-09-12T01:07:27.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17075184617565061085', time=2024-09-12T02:55:32.433834+0000, chain.objs.size()=1 2024-09-12T01:07:27.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7dPIDsS_a-uLlrR5lA9HpwlPefumRO2_0 2024-09-12T01:07:27.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14070977586679871593', time=2024-09-12T02:55:32.550770+0000, chain.objs.size()=1 2024-09-12T01:07:27.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.mNiLMd5klryP8bTHd9U7HcCLBtPCJ8G_0 2024-09-12T01:07:27.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17277495732511042908', time=2024-09-12T02:55:32.555501+0000, chain.objs.size()=1 2024-09-12T01:07:27.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.44PtwAZ_3youZ0ZfMmCILRCzhJqivxY_0 2024-09-12T01:07:27.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10950279793149638808', time=2024-09-12T02:55:32.615323+0000, chain.objs.size()=1 2024-09-12T01:07:27.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rRPwOM8UKKmoUCqOVhpCMQxFd_rjqnQ_0 2024-09-12T01:07:27.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15600071830570124597', time=2024-09-12T02:55:32.666678+0000, chain.objs.size()=1 2024-09-12T01:07:27.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9uYkkqc-kiP86_y167Fxek-0-oRM-Da_0 2024-09-12T01:07:27.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18131826833310967363', time=2024-09-12T02:55:32.690277+0000, chain.objs.size()=1 2024-09-12T01:07:27.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HBgbC29GA4BaagHyJYH-7FQt0z4sOth_0 2024-09-12T01:07:27.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9009637301838490892', time=2024-09-12T02:55:32.892861+0000, chain.objs.size()=1 2024-09-12T01:07:27.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tyffpvbmNr8xtPk3D-ZrQxUV9ownHgJ_0 2024-09-12T01:07:27.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13014761437171357773', time=2024-09-12T02:55:32.968616+0000, chain.objs.size()=1 2024-09-12T01:07:27.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4azOGdCl3EtF8INqR1aUCu73PEc3q0T_0 2024-09-12T01:07:27.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13090641926857464525', time=2024-09-12T02:55:32.974972+0000, chain.objs.size()=1 2024-09-12T01:07:27.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ohlr0r_gyJjJJ0XJW7PgyZYJh0K-iZ-_0 2024-09-12T01:07:27.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9211185190828425191', time=2024-09-12T02:55:33.011206+0000, chain.objs.size()=1 2024-09-12T01:07:27.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.212+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vgWAwYKpuUAaGRueINeEYli1yU1J9bo_0 2024-09-12T01:07:27.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1781689648886441723', time=2024-09-12T02:55:33.072078+0000, chain.objs.size()=1 2024-09-12T01:07:27.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qe_K3GJN0TCa38wf-OUCw35T_UsNfgR_0 2024-09-12T01:07:27.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6835982466458272196', time=2024-09-12T02:55:33.078125+0000, chain.objs.size()=1 2024-09-12T01:07:27.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.BdApZl5GrG_XjWOyL9PFEYcXMYJaros_0 2024-09-12T01:07:27.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15049197054458248499', time=2024-09-12T02:55:33.227258+0000, chain.objs.size()=1 2024-09-12T01:07:27.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bVMqV7Q9X8tFbqjG1Ab0T6-5XlqfRvq_0 2024-09-12T01:07:27.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2407965987723347907', time=2024-09-12T02:55:33.238199+0000, chain.objs.size()=1 2024-09-12T01:07:27.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.edSb1ytFN0JClDfKd3DTwLBhVm8aLG2_0 2024-09-12T01:07:27.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7765759525260091606', time=2024-09-12T02:55:33.269577+0000, chain.objs.size()=1 2024-09-12T01:07:27.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.nXQfo0OnuNGLgNv17wBuRLkYwFvmuhA_0 2024-09-12T01:07:27.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1839623842360795289', time=2024-09-12T02:55:33.289033+0000, chain.objs.size()=1 2024-09-12T01:07:27.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jLL25-1HU5oIj8ylkXEqpdyiCeRxhBL_0 2024-09-12T01:07:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5967254425983041444', time=2024-09-12T02:55:54.525470+0000, chain.objs.size()=1 2024-09-12T01:07:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9wn-VZjVbFTTJ3C6KBNP0VfbcaTm4l__0 2024-09-12T01:07:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16603179552985031767', time=2024-09-12T02:55:54.573698+0000, chain.objs.size()=1 2024-09-12T01:07:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5Ho61DDWkxvmqlmXluKl2sBLlpVL2lo_0 2024-09-12T01:07:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13525825396760487418', time=2024-09-12T02:55:54.585041+0000, chain.objs.size()=1 2024-09-12T01:07:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eLhzef4Xuwz-0skBRTc9b3hKuXsV_JK_0 2024-09-12T01:07:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9042661366236699936', time=2024-09-12T02:55:54.592495+0000, chain.objs.size()=1 2024-09-12T01:07:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.216+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JqLAqwRBruJAJ6AzWBAuzaFGZDhXKMb_0 2024-09-12T01:07:27.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14605028094764262428', time=2024-09-12T02:55:54.814832+0000, chain.objs.size()=1 2024-09-12T01:07:27.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XrdXI19ErDNzMjmouv2f35i2HcMM0ac_0 2024-09-12T01:07:27.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5612798380058837441', time=2024-09-12T02:55:54.818434+0000, chain.objs.size()=1 2024-09-12T01:07:27.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WavPjvt3bNy3zgQH2Zc5zchuibCIW_O_0 2024-09-12T01:07:27.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12532879498312266813', time=2024-09-12T02:55:54.980328+0000, chain.objs.size()=1 2024-09-12T01:07:27.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5u46M8SjYpiy4cynX0lsGi1bJw4FP9B_0 2024-09-12T01:07:27.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.941387492084180679', time=2024-09-12T02:55:55.126649+0000, chain.objs.size()=1 2024-09-12T01:07:27.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YYHHZQFcmi4Tu8rjk72Wx_r4PrHqlX7_0 2024-09-12T01:07:27.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6785440119868630102', time=2024-09-12T02:55:55.161320+0000, chain.objs.size()=1 2024-09-12T01:07:27.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FbxYrKqhWz7tFYBHVbrKgWmSrAPC89j_0 2024-09-12T01:07:27.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17456627105526010755', time=2024-09-12T02:55:55.467961+0000, chain.objs.size()=1 2024-09-12T01:07:27.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.f3RrjdFdM4J4JOViIc_IAkhtoS3OFJZ_0 2024-09-12T01:07:27.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4323448262793080379', time=2024-09-12T02:55:55.470240+0000, chain.objs.size()=1 2024-09-12T01:07:27.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XMdH1GeQ5CBJ5ZA0Ocd0QJbk6L_guX7_0 2024-09-12T01:07:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16546686066024669059', time=2024-09-12T02:55:55.506080+0000, chain.objs.size()=1 2024-09-12T01:07:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zAQ9XE6zPEbtCIdVZ4js-_sJf8S30W6_0 2024-09-12T01:07:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5490118585532892007', time=2024-09-12T02:55:55.539944+0000, chain.objs.size()=1 2024-09-12T01:07:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.g0-Vy1zj-yopTJQzy-SiJ_Qa1tYz8ev_0 2024-09-12T01:07:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18246540507118528718', time=2024-09-12T02:55:55.542961+0000, chain.objs.size()=1 2024-09-12T01:07:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.926jiAvADVxJ1q_0-cM9z3Bb583URo4_0 2024-09-12T01:07:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6971493273394118639', time=2024-09-12T02:55:55.627411+0000, chain.objs.size()=1 2024-09-12T01:07:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.220+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.86H_x9bZtNusbdMxYUTrcwkkibyjGvO_0 2024-09-12T01:07:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9808258469873388262', time=2024-09-12T02:55:55.662262+0000, chain.objs.size()=1 2024-09-12T01:07:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.yUWdHMCpFFwTLpl5GTOAuyw-Px1dQ8X_0 2024-09-12T01:07:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11614850147464248985', time=2024-09-12T02:55:55.931427+0000, chain.objs.size()=1 2024-09-12T01:07:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xBO6PobbifRZtuwrjEnu2hhBaCkyggZ_0 2024-09-12T01:07:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10542843394911361429', time=2024-09-12T02:55:55.947469+0000, chain.objs.size()=1 2024-09-12T01:07:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ruiD7JLpCneMcNY4Mb9EkxVsY7VraTl_0 2024-09-12T01:07:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18102468429778721976', time=2024-09-12T02:55:55.948157+0000, chain.objs.size()=1 2024-09-12T01:07:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Y67Qq8wNzTdu6azQKepWBZ9AiqLupO0_0 2024-09-12T01:07:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10839974753087316391', time=2024-09-12T02:55:55.958853+0000, chain.objs.size()=1 2024-09-12T01:07:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.a2dOuvukBq5roY23PUoOyWRdhI7D0AG_0 2024-09-12T01:07:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17383929759124067190', time=2024-09-12T02:55:56.017627+0000, chain.objs.size()=1 2024-09-12T01:07:27.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.224+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0ix-X1djBe2Xt_Ct1h0yH-CgS3_F4WB_0 2024-09-12T01:07:27.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3457531025530936703', time=2024-09-12T02:55:56.249417+0000, chain.objs.size()=1 2024-09-12T01:07:27.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.i72tFVffNeF_e3O2GkToqzwgS9WbojT_0 2024-09-12T01:07:27.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12704306850891655584', time=2024-09-12T02:55:56.458265+0000, chain.objs.size()=1 2024-09-12T01:07:27.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PtSQUNlFBSj58Wn-GJT0dHMSscjGQoZ_0 2024-09-12T01:07:27.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3826914574739899248', time=2024-09-12T02:55:56.538396+0000, chain.objs.size()=1 2024-09-12T01:07:27.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.r4bqAzxvnj9yD50SQHLPL2rUKkOTBru_0 2024-09-12T01:07:27.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.966663443567509651', time=2024-09-12T02:55:56.758558+0000, chain.objs.size()=1 2024-09-12T01:07:27.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.CKBu_VroJWcZ6WK7BeHVWYp1AZKOtkS_0 2024-09-12T01:07:27.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6990601990126126613', time=2024-09-12T02:55:56.774952+0000, chain.objs.size()=1 2024-09-12T01:07:27.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.228+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VxCN1InHaXDfCX1l83PtUniSyAKmXMI_0 2024-09-12T01:07:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.232+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48797 2024-09-12T01:07:27.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:07:27.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9032131679737398571', time=2024-09-12T02:55:58.677219+0000, chain.objs.size()=1 2024-09-12T01:07:27.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.327__shadow_.KWgtO2Ng1hVgq4aosvYWZ1mRDoetGpX_0 2024-09-12T01:07:27.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16308486176911003104', time=2024-09-12T02:56:22.269926+0000, chain.objs.size()=1 2024-09-12T01:07:27.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.367__shadow_.hg2nmJLEPmxyM1oTgSrkBsOndwrrjyz_0 2024-09-12T01:07:27.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8368866999255778259', time=2024-09-12T02:56:24.741268+0000, chain.objs.size()=1 2024-09-12T01:07:27.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.371__shadow_.p7tbSQ6D3WXejtHIc2HkMskgszuNsdK_0 2024-09-12T01:07:27.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3825275071961456921', time=2024-09-12T02:56:25.392577+0000, chain.objs.size()=1 2024-09-12T01:07:27.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.372__shadow_.9JWlsNIZcw-kfI8S5D8QDliesQ_Qnoj_0 2024-09-12T01:07:27.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17039660561989328561', time=2024-09-12T02:57:10.102323+0000, chain.objs.size()=1 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.434__shadow_.qT29Kb-N4szNH30iciHa4KxHPipc73s_0 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2774020213292311555', time=2024-09-12T02:57:17.464329+0000, chain.objs.size()=1 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.444__shadow_.7axFxnmsIRRPV_pfbObsQsJuiDLynTt_0 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17987876693194382414', time=2024-09-12T02:57:52.865318+0000, chain.objs.size()=1 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.495__shadow_.iIXM-jiINexVf54hHh7Ldty7wNv5qNz_0 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10862093309816930452', time=2024-09-12T02:59:36.265220+0000, chain.objs.size()=2 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.555__shadow_.CwJEjRtxPq4mx91xIWFX39NGOgWRM0m_0 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.555__shadow_.CwJEjRtxPq4mx91xIWFX39NGOgWRM0m_1 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11927615323971505060', time=2024-09-12T02:59:48.433055+0000, chain.objs.size()=1 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.564__shadow_.L3UjwumNU9yUk2kd3PqNIaRsm1kqybZ_0 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3152407134528526215', time=2024-09-12T02:59:58.953510+0000, chain.objs.size()=1 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:Uom6mLKo7sRO4Kfpj64ohjhnIHFOOrt_.hk2oJdqsKRleTAc4kj8-R3YQiEThLNp_0 2024-09-12T01:07:27.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12673347910976687555', time=2024-09-12T03:00:28.313890+0000, chain.objs.size()=1 2024-09-12T01:07:27.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:MsJcr4pNwnhuozgDI.SS2gCPNIhC92L_.jF6AU7RIHLAufEilTDF9lfVr-lM5wca_0 2024-09-12T01:07:27.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3918580719629352831', time=2024-09-12T03:00:32.576475+0000, chain.objs.size()=4 2024-09-12T01:07:27.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.236+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~EDQ5FTgZtS4Jb7k5yYCbviaPmbIMTK8.1 2024-09-12T01:07:27.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~EDQ5FTgZtS4Jb7k5yYCbviaPmbIMTK8.2 2024-09-12T01:07:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~EDQ5FTgZtS4Jb7k5yYCbviaPmbIMTK8.3 2024-09-12T01:07:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.578__multipart_testobj.2~EDQ5FTgZtS4Jb7k5yYCbviaPmbIMTK8.4 2024-09-12T01:07:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6933406998520252860', time=2024-09-12T03:00:55.188446+0000, chain.objs.size()=1 2024-09-12T01:07:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.608__shadow_.b9gGQ5ZFUHog0NUww2h-se4orZQqfQg_0 2024-09-12T01:07:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7096411343217346831', time=2024-09-12T03:03:32.214716+0000, chain.objs.size()=1 2024-09-12T01:07:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.641__shadow_.gnYIvITmUKVLY67mAKvgxaILq3gju-t_0 2024-09-12T01:07:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7336436889038739771', time=2024-09-12T03:03:53.493025+0000, chain.objs.size()=1 2024-09-12T01:07:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.665__shadow_.HQnJoI8ydvWjQ4PEwNrENc2fSUgkwJE_0 2024-09-12T01:07:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3747977000046254021', time=2024-09-12T03:03:57.233656+0000, chain.objs.size()=1 2024-09-12T01:07:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.240+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.671__shadow_.XZZcCCH9AqtCMyL-542leRJ2xLZ-O-a_0 2024-09-12T01:07:27.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.244+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:07:27.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50746' 2024-09-12T01:07:27.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='_RD2JjZ_zmfIdGWfjIIMiBQYNGv7t7yd', time=2024-09-12T02:51:35.116481+0000, chain.objs.size()=3 2024-09-12T01:07:27.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.CkZb2KyJzzBDlnpYVHRlYsxGwU4ssrb_0 2024-09-12T01:07:27.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.CkZb2KyJzzBDlnpYVHRlYsxGwU4ssrb_1 2024-09-12T01:07:27.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_.CkZb2KyJzzBDlnpYVHRlYsxGwU4ssrb_2 2024-09-12T01:07:27.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10783219028404119688', time=2024-09-12T02:52:08.710234+0000, chain.objs.size()=1 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.197__shadow_.y80S2Yz9YdbNaCuRRmBG2yY4sNFPUsK_0 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7377380363872979691', time=2024-09-12T02:53:43.838581+0000, chain.objs.size()=1 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.237__shadow_.JssTPikJWgK5pEetjCMCZDkrR2HHgYQ_0 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15000813059641529862', time=2024-09-12T02:53:47.044944+0000, chain.objs.size()=1 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.241__shadow_.LITnPZ5q2p14PiAMoCauWskjU1KS9sG_0 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.602753439218488720', time=2024-09-12T02:53:47.047696+0000, chain.objs.size()=1 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.241__shadow_.gJyVwWhhNjKKW6TGIN9fv4ud_SA9of7_0 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10214527132527772872', time=2024-09-12T02:54:01.988327+0000, chain.objs.size()=1 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.261__shadow_.tU4-FPfZBqS85tIWhlJHfcmTiXyHwun_0 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15661839217863298515', time=2024-09-12T02:54:23.037882+0000, chain.objs.size()=1 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Tyr30WxW5jHmV6cqnOaXePJCQi9KLWL_0 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7443446480133208913', time=2024-09-12T02:54:23.041113+0000, chain.objs.size()=1 2024-09-12T01:07:27.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Kw-kGBU8uSdjRhN1sr6Q6gKFf4qRrRZ_0 2024-09-12T01:07:27.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13200516472536443591', time=2024-09-12T02:54:23.545386+0000, chain.objs.size()=1 2024-09-12T01:07:27.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.roKCmT--9Utf9-hUQsW76THXvFT6hc7_0 2024-09-12T01:07:27.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3430132533992238502', time=2024-09-12T02:54:23.551684+0000, chain.objs.size()=1 2024-09-12T01:07:27.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.248+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Y3P5s6s4aOWmrDS1cuDMOYnlmZwA0iu_0 2024-09-12T01:07:27.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13351391268666655797', time=2024-09-12T02:54:23.563523+0000, chain.objs.size()=1 2024-09-12T01:07:27.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.s9cawMXm0HlUX2MpY5seUuYGBD0Qq8I_0 2024-09-12T01:07:27.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5979280993313200047', time=2024-09-12T02:54:24.052481+0000, chain.objs.size()=1 2024-09-12T01:07:27.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FfIYEKqXXn_DC2IOcy_jzvwXk46JbZ8_0 2024-09-12T01:07:27.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11305135750903218183', time=2024-09-12T02:54:24.083292+0000, chain.objs.size()=1 2024-09-12T01:07:27.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.OjTllcu10HUcG4gUKhe-j4fsZRxEk6P_0 2024-09-12T01:07:27.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1569103949019970405', time=2024-09-12T02:54:24.148131+0000, chain.objs.size()=1 2024-09-12T01:07:27.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3Fu4FDJYlLayGDcPtV7zYRSJMBcaWEB_0 2024-09-12T01:07:27.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1218939476591312310', time=2024-09-12T02:54:24.386399+0000, chain.objs.size()=1 2024-09-12T01:07:27.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LxJJRSFOrx5vVOlHD66pDnlPsHXnq4e_0 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1308827935638141216', time=2024-09-12T02:54:24.394222+0000, chain.objs.size()=1 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PmYl_HTH0bkEwbszABsaUkJwn7pmfBf_0 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15113870774374677551', time=2024-09-12T02:54:24.409370+0000, chain.objs.size()=1 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Ap3BLXZDgbyuJIgefPvckhmWbQ-mhCP_0 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7161289329081864337', time=2024-09-12T02:54:24.514691+0000, chain.objs.size()=1 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HAo0F-9qmgRVyR0tkTXuzKnQkrAtCGK_0 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15231550038932994122', time=2024-09-12T02:54:24.854594+0000, chain.objs.size()=1 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3vPIdZsWdwF1Fo8WzfJVwt8TJBoD8Rz_0 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15561195236874496246', time=2024-09-12T02:54:24.899011+0000, chain.objs.size()=1 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JCmKC0K0fzp67WwGl6Qs_ikY0C3WiHp_0 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17824793243170601735', time=2024-09-12T02:54:24.915572+0000, chain.objs.size()=1 2024-09-12T01:07:27.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.252+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RG_s0u0xorPI8qHn8qRzyfWT7zim62j_0 2024-09-12T01:07:27.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe14df2640 0 -- 172.21.15.137:0/1809423053 >> [v2:172.21.15.150:6824/868007963,v1:172.21.15.150:6825/868007963] conn(0x7fbce0081bf0 msgr2=0x7fbce0084020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:07:27.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12880996803656455073', time=2024-09-12T02:54:25.138025+0000, chain.objs.size()=1 2024-09-12T01:07:27.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MpwiHHo1AZdyEYd3qTr56yu5fxUKrM__0 2024-09-12T01:07:27.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11958729145914144355', time=2024-09-12T02:54:25.206654+0000, chain.objs.size()=1 2024-09-12T01:07:27.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ksdDK4dcyI-a1BmsPTw5gffrDbaS6CC_0 2024-09-12T01:07:27.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.414875962583054511', time=2024-09-12T02:54:25.286557+0000, chain.objs.size()=1 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wUpJQlwacR9FoHv0VXgGoWgHYK6MjgX_0 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16569963856383882462', time=2024-09-12T02:54:25.296488+0000, chain.objs.size()=1 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zQh7lABISu8opM-L8KuVU2oHBBF-vFD_0 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15391373426501386060', time=2024-09-12T02:54:25.349944+0000, chain.objs.size()=1 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.s5CAUgV-PYbHuW0s4VDp6l8KjUtM72H_0 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17099425748710034817', time=2024-09-12T02:54:25.536061+0000, chain.objs.size()=1 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.oPxERF37GLRIiKl0asK0XnfxPH9mCu7_0 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6399322991576295678', time=2024-09-12T02:54:25.545008+0000, chain.objs.size()=1 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.J7UQT5vAf-cq-fufXsK5jpKxl3j_sFk_0 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10544132734855922582', time=2024-09-12T02:54:25.551681+0000, chain.objs.size()=1 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.90WOL1EkClG9soDkaYss9yt-F49qMgN_0 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2029727763713516679', time=2024-09-12T02:54:25.568381+0000, chain.objs.size()=1 2024-09-12T01:07:27.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8m76ZD9tO546BAJ0yMnWKGDqIYy_g5L_0 2024-09-12T01:07:27.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15329875924180159270', time=2024-09-12T02:54:25.589472+0000, chain.objs.size()=1 2024-09-12T01:07:27.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2NrpF5opQQQ9HQeWDynLwPaZ_Wx5KZn_0 2024-09-12T01:07:27.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14700668648807307931', time=2024-09-12T02:54:25.613706+0000, chain.objs.size()=1 2024-09-12T01:07:27.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.256+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XDMlkgqsPSdQIOH2zc-oKfE12Ut_gh3_0 2024-09-12T01:07:27.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.260+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13717939316259821313', time=2024-09-12T02:54:25.667227+0000, chain.objs.size()=1 2024-09-12T01:07:27.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.260+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Qw1k7PySTEf9_c8AEncROQwHWC2yNl7_0 2024-09-12T01:07:27.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7760727190810753813', time=2024-09-12T02:54:25.722745+0000, chain.objs.size()=1 2024-09-12T01:07:27.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TmqK-sI9ULYmhhklpW_1WnZf0dfVdWy_0 2024-09-12T01:07:27.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13554166671063109379', time=2024-09-12T02:54:25.747820+0000, chain.objs.size()=1 2024-09-12T01:07:27.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.B4Un_NTr5rgD8Y9cFogiA2Yfh6GpT6v_0 2024-09-12T01:07:27.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3848230196082589362', time=2024-09-12T02:54:25.913806+0000, chain.objs.size()=1 2024-09-12T01:07:27.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rfpbIiTW_8I0k-dsY1_HviXvKJzqQfe_0 2024-09-12T01:07:27.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7776049930816418352', time=2024-09-12T02:54:25.937977+0000, chain.objs.size()=1 2024-09-12T01:07:27.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FpcQ-QSBXRUBhvJFnOjstqlWeRhSa9j_0 2024-09-12T01:07:27.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14552568919335144428', time=2024-09-12T02:54:25.956858+0000, chain.objs.size()=1 2024-09-12T01:07:27.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vkJ3uGDrzuDD5owv3huNJZgHmiTJt7u_0 2024-09-12T01:07:27.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10831708815544444', time=2024-09-12T02:54:26.016404+0000, chain.objs.size()=1 2024-09-12T01:07:27.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DvMvLYO6owdBYH6dRyn9AS5Fn80KdV-_0 2024-09-12T01:07:27.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4685854467064818119', time=2024-09-12T02:54:29.324420+0000, chain.objs.size()=1 2024-09-12T01:07:27.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.267__shadow_.gcLyuaVuy9U2cNv7L0gm9R_3rP94OEz_0 2024-09-12T01:07:27.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11570934686622904815', time=2024-09-12T02:54:33.456779+0000, chain.objs.size()=1 2024-09-12T01:07:27.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.273__shadow_.mNbUBy5O6UI7s8WZwpsnbrZmwFe820K_0 2024-09-12T01:07:27.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8527283696717371665', time=2024-09-12T02:54:34.803086+0000, chain.objs.size()=1 2024-09-12T01:07:27.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.275__shadow_.cD_X2O1d9H8CHpdfRSm3MpLJdacAzO9_0 2024-09-12T01:07:27.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18006909736305444380', time=2024-09-12T02:54:36.938453+0000, chain.objs.size()=1 2024-09-12T01:07:27.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.278__shadow_.yfDlZt7tUvy5mnEYYpa964KYAHRrqxW_0 2024-09-12T01:07:27.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17190164549216304451', time=2024-09-12T02:54:38.329821+0000, chain.objs.size()=1 2024-09-12T01:07:27.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.264+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.280__shadow_.n9mwdo9XkHnELzQMX50NjFSE8CntIwv_0 2024-09-12T01:07:27.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10716035421628096538', time=2024-09-12T02:54:39.021478+0000, chain.objs.size()=1 2024-09-12T01:07:27.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.281__shadow_.qH01l269KxHI-Hf5QEAI1Dwwtx6rDR__0 2024-09-12T01:07:27.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4558981259141516147', time=2024-09-12T02:54:40.466507+0000, chain.objs.size()=1 2024-09-12T01:07:27.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.283__shadow_.5iq_YUV-cTEHsIhoNiupehID12z1XbO_0 2024-09-12T01:07:27.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13865394342473455622', time=2024-09-12T02:54:47.943151+0000, chain.objs.size()=1 2024-09-12T01:07:27.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.fTrt_iwHhUDCBKNVDHEZPpy3eWUjqv9_0 2024-09-12T01:07:27.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9358751111817968773', time=2024-09-12T02:54:47.950183+0000, chain.objs.size()=1 2024-09-12T01:07:27.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.GYUUxgkwWFqQbbkHuUCSXxBgAzo1Csw_0 2024-09-12T01:07:27.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2452440537422661521', time=2024-09-12T02:54:49.355582+0000, chain.objs.size()=1 2024-09-12T01:07:27.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.EVWRQ7xcjoUBcOimClFlHtSrSCQ0GgF_0 2024-09-12T01:07:27.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16327998969475781623', time=2024-09-12T02:54:58.782534+0000, chain.objs.size()=1 2024-09-12T01:07:27.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.306__shadow_.nfN2hYVPM8haj2cdGgLgtzsxJVGol1U_0 2024-09-12T01:07:27.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13841518765298109715', time=2024-09-12T02:55:08.015477+0000, chain.objs.size()=1 2024-09-12T01:07:27.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.319__shadow:8Kqn6IGteRcF312KECK2JmD9qqLpeCo_.vrfpiz5aSYQFjt9G1a4Lnr_gY4qvIeM_0 2024-09-12T01:07:27.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1100823721828387612', time=2024-09-12T02:55:31.059735+0000, chain.objs.size()=1 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.p_naniEcYnk1XN-jvF3KWaPk97oC1nV_0 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11646534738519838397', time=2024-09-12T02:55:31.084114+0000, chain.objs.size()=1 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Mtwm7U6cbDiqgKzVk6DkjS0ufaaPFDm_0 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14725326659182752994', time=2024-09-12T02:55:31.101070+0000, chain.objs.size()=1 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YKCDIVOggeWpzNpgpbG3VF9Yo8JxwbL_0 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5784027647196424686', time=2024-09-12T02:55:31.300533+0000, chain.objs.size()=1 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.2U0qQ9cv1PgqBfaTgWFX5jGCf2Cs2pr_0 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14334923343326025592', time=2024-09-12T02:55:31.318725+0000, chain.objs.size()=1 2024-09-12T01:07:27.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.268+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Ci7k2sJ3vhvKcSllnUKJ6Qcu7mzDDyv_0 2024-09-12T01:07:27.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10525090418837921368', time=2024-09-12T02:55:31.332311+0000, chain.objs.size()=1 2024-09-12T01:07:27.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.SekKQdrYgdQBgWyJXccRapxnhP1-7cs_0 2024-09-12T01:07:27.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17968374977436940469', time=2024-09-12T02:55:31.337938+0000, chain.objs.size()=1 2024-09-12T01:07:27.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dVouL22BeAcwncXa5aEUJkFrL438uFK_0 2024-09-12T01:07:27.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12036488971229301280', time=2024-09-12T02:55:31.394434+0000, chain.objs.size()=1 2024-09-12T01:07:27.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._6bpd6XJKfDWxuSbJ7p0Xn4RM5_ociX_0 2024-09-12T01:07:27.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7634265280764262632', time=2024-09-12T02:55:31.433075+0000, chain.objs.size()=1 2024-09-12T01:07:27.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8Kkt1zqohwp4iXYJNspdY4wBimUMCLr_0 2024-09-12T01:07:27.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7586319176322430672', time=2024-09-12T02:55:31.549261+0000, chain.objs.size()=1 2024-09-12T01:07:27.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.m-oJ0TlUltHpiLsjbdmBwQfTpSg2reG_0 2024-09-12T01:07:27.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10288369959966414767', time=2024-09-12T02:55:31.571506+0000, chain.objs.size()=1 2024-09-12T01:07:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VMs-LXa7jjdNT7oE_SP3nMMbLu-JHJ9_0 2024-09-12T01:07:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8960425576594601164', time=2024-09-12T02:55:31.664192+0000, chain.objs.size()=1 2024-09-12T01:07:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LLB8q_hM3SW2INjDxihsSAs9a-q0v-X_0 2024-09-12T01:07:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14582667385883551281', time=2024-09-12T02:55:31.722351+0000, chain.objs.size()=1 2024-09-12T01:07:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.fuPFgUeOtCtv4NKRVNZePbuLLX54FW2_0 2024-09-12T01:07:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11883152624179691100', time=2024-09-12T02:55:31.752855+0000, chain.objs.size()=1 2024-09-12T01:07:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Cqm49fsTmXBUiS3OzD6M4Y7i7mX_hF6_0 2024-09-12T01:07:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2196331160255023606', time=2024-09-12T02:55:31.896701+0000, chain.objs.size()=1 2024-09-12T01:07:27.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.e6Iy-y2p8XqREEhiIICa8lowtkml5cY_0 2024-09-12T01:07:27.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8699735804300475659', time=2024-09-12T02:55:32.006348+0000, chain.objs.size()=1 2024-09-12T01:07:27.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.272+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.B7kZ682qX_P_oTlvgxkqqS4N6W3i3vV_0 2024-09-12T01:07:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1561376900937033810', time=2024-09-12T02:55:32.022866+0000, chain.objs.size()=1 2024-09-12T01:07:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.V_yFb0nUgtXRiTJTppYFpRTTHvPm1xu_0 2024-09-12T01:07:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15661852296141057285', time=2024-09-12T02:55:32.025426+0000, chain.objs.size()=1 2024-09-12T01:07:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lTFAEBwW31HMqMo4Ewyds4z-HS5Qa-U_0 2024-09-12T01:07:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14145494967633356189', time=2024-09-12T02:55:32.074634+0000, chain.objs.size()=1 2024-09-12T01:07:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yxE9GfHTm1h2c4oxHuMD9n-r2kU1Ayo_0 2024-09-12T01:07:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8118531378921426352', time=2024-09-12T02:55:32.085046+0000, chain.objs.size()=1 2024-09-12T01:07:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IC-_yuR5fFYb-pwUNDLWYVnLoxkmRsA_0 2024-09-12T01:07:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7625266004020374388', time=2024-09-12T02:55:32.229750+0000, chain.objs.size()=1 2024-09-12T01:07:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lK5aroCnL5sYlGJ4suOapMJ8OM-ECzD_0 2024-09-12T01:07:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16798366064592692056', time=2024-09-12T02:55:32.301676+0000, chain.objs.size()=1 2024-09-12T01:07:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.S-lo8vELxmeaeQPKYW8H8WTZIE-p8qI_0 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18175442861721631578', time=2024-09-12T02:55:32.406564+0000, chain.objs.size()=1 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8ogECNfcna5vOenlmnIQA7vHGi8ndcd_0 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6867973142900928151', time=2024-09-12T02:55:32.439214+0000, chain.objs.size()=1 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.U0Y7Q0-gJPlG6RtBDBf7vLXtS3s59VW_0 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4141967792719952709', time=2024-09-12T02:55:32.452775+0000, chain.objs.size()=1 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.K4wmJd3YLYSCV9jey6b4PbrX302d0_S_0 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11503449570783263659', time=2024-09-12T02:55:32.583257+0000, chain.objs.size()=1 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Za8Nt0K7el2PX4bZvZoL1y_5OPa4m5h_0 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4747526279850331272', time=2024-09-12T02:55:32.625038+0000, chain.objs.size()=1 2024-09-12T01:07:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.276+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XE7Kpx1GBCzqSN-xvsbrxLT3iTts8ZV_0 2024-09-12T01:07:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16587017017894667989', time=2024-09-12T02:55:32.674557+0000, chain.objs.size()=1 2024-09-12T01:07:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pQainnR3X3XmI4xd_EwG1xC05BCLwDw_0 2024-09-12T01:07:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2142382081224036971', time=2024-09-12T02:55:32.732059+0000, chain.objs.size()=1 2024-09-12T01:07:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.BGgILZOvZ4z9LK8qxaERsy7nzrJ45eT_0 2024-09-12T01:07:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9978204822387769730', time=2024-09-12T02:55:32.735808+0000, chain.objs.size()=1 2024-09-12T01:07:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.-vP94WI8DnM5-HnfwB4cNRzjDevHmXm_0 2024-09-12T01:07:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.280+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13021569309962850437', time=2024-09-12T02:55:32.955271+0000, chain.objs.size()=1 2024-09-12T01:07:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.280+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZZCyR6kh1vgVklS7KCJ2q-HXjmL835x_0 2024-09-12T01:07:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7661276369663724186', time=2024-09-12T02:55:33.002709+0000, chain.objs.size()=1 2024-09-12T01:07:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.202LOHeg8xveB04AhzoX5o4zInZRR0Y_0 2024-09-12T01:07:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17082896100564714336', time=2024-09-12T02:55:33.039964+0000, chain.objs.size()=1 2024-09-12T01:07:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sd4EIgx9r-nj7uJzkQWGj5xHZ9t_rb6_0 2024-09-12T01:07:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3903381767992300571', time=2024-09-12T02:55:33.240491+0000, chain.objs.size()=1 2024-09-12T01:07:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dXiDnTPyk7c0o32pV5dyaiIQnMMMD_x_0 2024-09-12T01:07:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10288491061811960343', time=2024-09-12T02:55:33.243326+0000, chain.objs.size()=1 2024-09-12T01:07:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.a8rLKF2avQalLXU6Wdp38Zdo2rBYJWK_0 2024-09-12T01:07:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2051853759384683126', time=2024-09-12T02:55:33.260934+0000, chain.objs.size()=1 2024-09-12T01:07:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vRvFQ2rO9JuZM484TX9-_BLWVmhW_Ez_0 2024-09-12T01:07:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18032078881853726591', time=2024-09-12T02:55:54.664882+0000, chain.objs.size()=1 2024-09-12T01:07:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.AWkPZsNKjAA9djs-Ntrw5AWnEnBEurY_0 2024-09-12T01:07:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1731170759444247748', time=2024-09-12T02:55:54.818475+0000, chain.objs.size()=1 2024-09-12T01:07:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.o7eN832kJbt5QZrvZDlr4XIBOHwwdMn_0 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2431070358830962942', time=2024-09-12T02:55:54.864507+0000, chain.objs.size()=1 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wlFjFELkwyyoczv5b8TUVQZ_0D0Qa6p_0 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10965641961263620427', time=2024-09-12T02:55:54.877836+0000, chain.objs.size()=1 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.k5VrxROyz6JNkizatWadvv_wBB_8hPB_0 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15609763278922555148', time=2024-09-12T02:55:54.951808+0000, chain.objs.size()=1 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uTZwrX_gHaZzs6igJkBIEsn3M0ZAqQQ_0 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10182490609097929014', time=2024-09-12T02:55:54.983755+0000, chain.objs.size()=1 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ufYsS9GcfUV5_9qS7jYTal7z8hIyFLU_0 2024-09-12T01:07:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12653251296791205585', time=2024-09-12T02:55:55.174349+0000, chain.objs.size()=1 2024-09-12T01:07:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Nj86xoBtPMgh47mXyPQWjda_U6_3RgA_0 2024-09-12T01:07:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4768234465657336747', time=2024-09-12T02:55:55.219859+0000, chain.objs.size()=1 2024-09-12T01:07:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.284+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.va9oHbl0IMJ3y5PcFIwJjcSSuI3_WIo_0 2024-09-12T01:07:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11000572376846578384', time=2024-09-12T02:55:55.238918+0000, chain.objs.size()=1 2024-09-12T01:07:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xMknyKJZVoBG5stVc9B4XVVyvcWz5PC_0 2024-09-12T01:07:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2254470863080244719', time=2024-09-12T02:55:55.550108+0000, chain.objs.size()=1 2024-09-12T01:07:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6aPpPC4MOEtyVSTFT9akDK0a9yWvztR_0 2024-09-12T01:07:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14778431023205502567', time=2024-09-12T02:55:55.650000+0000, chain.objs.size()=1 2024-09-12T01:07:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dvJnx8nBKe1_47SMt4BDgsvKc6kN8W4_0 2024-09-12T01:07:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14082230343024249835', time=2024-09-12T02:55:55.680186+0000, chain.objs.size()=1 2024-09-12T01:07:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7G9c8cHFA_q2gQ0PsV-xETWT7xLZQ38_0 2024-09-12T01:07:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4197469402908518818', time=2024-09-12T02:55:55.817469+0000, chain.objs.size()=1 2024-09-12T01:07:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.288+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8-JCWeN0OGgUYSzwAsCr7OcS0oxcrCk_0 2024-09-12T01:07:27.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50746 2024-09-12T01:07:27.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.379529301282275664', time=2024-09-12T02:55:55.870153+0000, chain.objs.size()=1 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.KxrgVjWUYH1UlKH2JdzXHrCFpldeDoO_0 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7853156915993812859', time=2024-09-12T02:55:55.895575+0000, chain.objs.size()=1 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6igf8j639xv3KDP8iurUeWQCW_ZjGDe_0 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14041703216987869355', time=2024-09-12T02:55:55.913720+0000, chain.objs.size()=1 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NJ0lx1XgacaeI5HaEq1CR2Cp55ghNrs_0 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11984347733242283542', time=2024-09-12T02:55:55.953653+0000, chain.objs.size()=1 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2kFyIXI05aOJYgKQ67V-w4Lez3w7aNh_0 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3497472740796312124', time=2024-09-12T02:55:56.193099+0000, chain.objs.size()=1 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Scy1DNs-hUMmgAh9f5cfe_WCZtzqoTY_0 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1201328379430300600', time=2024-09-12T02:55:56.297155+0000, chain.objs.size()=1 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uXunukUf6jrIaBwFICSi-Eo-iQ-hqPX_0 2024-09-12T01:07:27.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1321916259404837038', time=2024-09-12T02:55:56.542223+0000, chain.objs.size()=1 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1R7wSnX9P9WIJS7qf-7eRx-h3ckojvB_0 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11656098092765231598', time=2024-09-12T02:55:56.581107+0000, chain.objs.size()=1 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.K-JRto3igvtTsigUtsJElRiJ86yxCWX_0 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16783220806909482961', time=2024-09-12T02:55:56.667786+0000, chain.objs.size()=1 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ttQv8pZrxeyClT83bcq8v31q3uFloGb_0 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13236908549942829586', time=2024-09-12T02:55:56.905838+0000, chain.objs.size()=1 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8-ZQhrRCGUnk54GOJlk8qyAIooiUQdk_0 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8541581739701816406', time=2024-09-12T02:55:56.919596+0000, chain.objs.size()=1 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.l_8IaE_aNQtV_2DmuwQFF-VMBa-Ehm-_0 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15086247890513628574', time=2024-09-12T02:55:56.920470+0000, chain.objs.size()=1 2024-09-12T01:07:27.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.292+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zcpWL6kwy6o_q7o59OjIltmccUqjp44_0 2024-09-12T01:07:27.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3852236796268005364', time=2024-09-12T02:56:28.987778+0000, chain.objs.size()=1 2024-09-12T01:07:27.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.376__shadow_.7MmiVfAuRn5KpXT8dNScGejJCv1-n6j_0 2024-09-12T01:07:27.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17917077369970431028', time=2024-09-12T02:57:27.352594+0000, chain.objs.size()=1 2024-09-12T01:07:27.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.456__shadow_.hQvfifqqGuWNmm2RSFGAabca2ZWhzUv_0 2024-09-12T01:07:27.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10060203354032303803', time=2024-09-12T02:57:36.886760+0000, chain.objs.size()=1 2024-09-12T01:07:27.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.466__shadow_.uyH7-noiJJh1HruKZl2dyB94Bym5YsR_0 2024-09-12T01:07:27.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN', time=2024-09-12T02:58:43.806721+0000, chain.objs.size()=10 2024-09-12T01:07:27.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.1 2024-09-12T01:07:27.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.2 2024-09-12T01:07:27.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.3 2024-09-12T01:07:27.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.4 2024-09-12T01:07:27.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.5 2024-09-12T01:07:27.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.6 2024-09-12T01:07:27.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.7 2024-09-12T01:07:27.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.296+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.8 2024-09-12T01:07:27.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.9 2024-09-12T01:07:27.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.526__multipart_mymultipart.2~y9tY_wYGo8fydFffoIVx0yc1ZuYxXGN.10 2024-09-12T01:07:27.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5759496987892860235', time=2024-09-12T02:59:54.166194+0000, chain.objs.size()=1 2024-09-12T01:07:27.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:vgw5u2pU800ZNjOWmDiyinCL98zMAOJ_.fCzmKVYGA5X-OmAR0Wb6fljEu3qxj3t_0 2024-09-12T01:07:27.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14187550860587320051', time=2024-09-12T03:00:04.765006+0000, chain.objs.size()=1 2024-09-12T01:07:27.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow_.80W4s_bxt7Z5yR1EDjmyCykJQHD86d-_0 2024-09-12T01:07:27.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.370790945843443726', time=2024-09-12T03:00:36.950685+0000, chain.objs.size()=1 2024-09-12T01:07:27.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.580__shadow:jtKEtOLS43kp.2pO8svYPd3j0R8MyKK_.xrdWwwhmVkC7mZTJ44ZRqj0taSzUiIO_0 2024-09-12T01:07:27.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13120405001080089132', time=2024-09-12T03:04:09.829192+0000, chain.objs.size()=1 2024-09-12T01:07:27.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.300+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.693__shadow:zltEGMhxNDZsuXWKyFNnZEiTN7mn1vc_.qE-Sb0KvVuguQ-4tbxFP04GhvmSE5cg_0 2024-09-12T01:07:27.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.304+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:07:27.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/63596' 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7635927785420057042', time=2024-09-12T02:51:23.114410+0000, chain.objs.size()=1 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.147__shadow_.e7Rzn51xqfOOpbYzkGpBXQSbO-pcxzg_0 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.111419025857393855', time=2024-09-12T02:51:36.020255+0000, chain.objs.size()=1 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.162__shadow_.R9W90txeWoKy0Kw-qcQ7DcVoJUMMZOv_0 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5430995327500129670', time=2024-09-12T02:51:47.163797+0000, chain.objs.size()=1 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.177__shadow_.npDdozynIRr7aYvX5JN3pMGuA_9joVo_0 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10079527471502282648', time=2024-09-12T02:53:42.665461+0000, chain.objs.size()=1 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.236__shadow_._h3S5Eke2sma2gXlOTT4LJlaCLO2iBY_0 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6391928533331033358', time=2024-09-12T02:53:47.722107+0000, chain.objs.size()=1 2024-09-12T01:07:27.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.242__shadow_.uxPXmH9Yo_JR959KSeqJv2AnNoys-kp_0 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8086235847609429811', time=2024-09-12T02:53:50.089973+0000, chain.objs.size()=1 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.244__shadow_.k3L7Vs-QkJXIU1dFlr3yGxvCst-DzfQ_0 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10941116022166051670', time=2024-09-12T02:53:52.181530+0000, chain.objs.size()=1 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.247__shadow_.9X-eO0-zEFILcN2Mv_uCuH2Hte_DtI0_0 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13401345296769662664', time=2024-09-12T02:53:52.877645+0000, chain.objs.size()=1 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.248__shadow_.UKGb40qtsCSf_rGVG-VZ6vtmzsBzwA-_0 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.822598803021771648', time=2024-09-12T02:53:53.567630+0000, chain.objs.size()=1 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.249__shadow_.8MN5sWNV6SOm9BrU1x5BUrUpAhcG8bz_0 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10514964380818783595', time=2024-09-12T02:53:59.202521+0000, chain.objs.size()=1 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.257__shadow_.R1WFhby2CRm6rdlxB2HT9CI94xVDxBq_0 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3264912368262598341', time=2024-09-12T02:54:23.076053+0000, chain.objs.size()=1 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rWE46-YiZPO-O_B9FaQNWMPNvhOEdcL_0 2024-09-12T01:07:27.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14143842094517093484', time=2024-09-12T02:54:23.114362+0000, chain.objs.size()=1 2024-09-12T01:07:27.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.308+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.79_loH-3fnfLs4FYXjGbj_jOpmDk0RP_0 2024-09-12T01:07:27.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17090150221802856753', time=2024-09-12T02:54:23.123093+0000, chain.objs.size()=1 2024-09-12T01:07:27.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._2jBHO-2-Iey005KPqMXNJsKSXL_qQd_0 2024-09-12T01:07:27.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1762306835934081482', time=2024-09-12T02:54:23.146465+0000, chain.objs.size()=1 2024-09-12T01:07:27.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.blqxpuxJzYjMju71vsWTg-igsHq_tK9_0 2024-09-12T01:07:27.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3722546473627801756', time=2024-09-12T02:54:23.262919+0000, chain.objs.size()=1 2024-09-12T01:07:27.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mmGP9HWJ6TRH0T27HrMxlO5pvwDWvsz_0 2024-09-12T01:07:27.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.312+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9353012681367134615', time=2024-09-12T02:54:23.432077+0000, chain.objs.size()=1 2024-09-12T01:07:27.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.312+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.OYJkx5uFqPGZ4d5plBk4JL485Ocgpmc_0 2024-09-12T01:07:27.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2143262545672315124', time=2024-09-12T02:54:23.532287+0000, chain.objs.size()=1 2024-09-12T01:07:27.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dAOgkSH5PMVNp0ftVMeItzBwVbhdtLX_0 2024-09-12T01:07:27.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2223018120468578899', time=2024-09-12T02:54:24.059876+0000, chain.objs.size()=1 2024-09-12T01:07:27.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.S4OVILgWypvPamHTU4E_j6QK62xQ-zA_0 2024-09-12T01:07:27.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6248247988273851188', time=2024-09-12T02:54:24.087903+0000, chain.objs.size()=1 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xqY0sDm0U0DMJ3SgnsjwX3KRMxLXzm-_0 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7867863063521861167', time=2024-09-12T02:54:24.116519+0000, chain.objs.size()=1 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IaiYl1yCqbVetw8x8gQyEdxL7ETjJoR_0 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15362734439915946997', time=2024-09-12T02:54:24.137274+0000, chain.objs.size()=1 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qlPmysiVTBTF0tC3nI3yzm3DAbEimB4_0 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10882762106170627001', time=2024-09-12T02:54:24.213935+0000, chain.objs.size()=1 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.QyKPsxDaJ4_lvghasedkaMTqbNNNqnb_0 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10596787180353731419', time=2024-09-12T02:54:24.397954+0000, chain.objs.size()=1 2024-09-12T01:07:27.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.B-OG5v8aFWN0czu5yxrf_KKnTjM46Xt_0 2024-09-12T01:07:27.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14313916616301028157', time=2024-09-12T02:54:24.408484+0000, chain.objs.size()=1 2024-09-12T01:07:27.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hQurLRtjEydN1YG-p2XPD8eXzOnjPOB_0 2024-09-12T01:07:27.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8186927921870877015', time=2024-09-12T02:54:24.749438+0000, chain.objs.size()=1 2024-09-12T01:07:27.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.YF41HNPmopMEn29eEzyeiC5cxrJbgu-_0 2024-09-12T01:07:27.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17471676719981544589', time=2024-09-12T02:54:24.763299+0000, chain.objs.size()=1 2024-09-12T01:07:27.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GpxVCWfUstbx7raSztpSXGA4-gpQ141_0 2024-09-12T01:07:27.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14648747583304250824', time=2024-09-12T02:54:24.806695+0000, chain.objs.size()=1 2024-09-12T01:07:27.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.316+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dgVH1IP_tvSNWD1cjwDC9iiTYLKpQuX_0 2024-09-12T01:07:27.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15252425560122814616', time=2024-09-12T02:54:24.934050+0000, chain.objs.size()=1 2024-09-12T01:07:27.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.g4H6Q-kZmIxEM5PwCfmIEYgfC9JTkOV_0 2024-09-12T01:07:27.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8919822527827188516', time=2024-09-12T02:54:24.966637+0000, chain.objs.size()=1 2024-09-12T01:07:27.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PqmMPr9Pm3Vg3a8toRiGRJ7jq57QD65_0 2024-09-12T01:07:27.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4299267854370915675', time=2024-09-12T02:54:24.978095+0000, chain.objs.size()=1 2024-09-12T01:07:27.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RfT5aX_06kYINUvuamV15VFIVPMi7QX_0 2024-09-12T01:07:27.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3083914810911371299', time=2024-09-12T02:54:25.011604+0000, chain.objs.size()=1 2024-09-12T01:07:27.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.AFhuMPMYz_HGklDa-6gnk5p38ziwM34_0 2024-09-12T01:07:27.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11153954933810936218', time=2024-09-12T02:54:25.192685+0000, chain.objs.size()=1 2024-09-12T01:07:27.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.l95IK1E-6dwl3AGOr2rEPeX3odcuEUB_0 2024-09-12T01:07:27.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.502752213705321581', time=2024-09-12T02:54:25.250615+0000, chain.objs.size()=1 2024-09-12T01:07:27.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.WmB7_G0A-88FIxdbN9XZHu-DqeMIgTV_0 2024-09-12T01:07:27.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12231324920567996137', time=2024-09-12T02:54:25.264312+0000, chain.objs.size()=1 2024-09-12T01:07:27.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.r1Bp0ajaqAjGSJxqbbb-SppYwzETWoG_0 2024-09-12T01:07:27.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2112718859329975505', time=2024-09-12T02:54:25.342765+0000, chain.objs.size()=1 2024-09-12T01:07:27.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.yLGXXB7vAdL5WZwlPaYXgVnCcGBPuhM_0 2024-09-12T01:07:27.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11151266651941210957', time=2024-09-12T02:54:25.513833+0000, chain.objs.size()=1 2024-09-12T01:07:27.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LQrULN_xsLZ855GIuSuQWtQLG_EdLm3_0 2024-09-12T01:07:27.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2260013065677169196', time=2024-09-12T02:54:25.552839+0000, chain.objs.size()=1 2024-09-12T01:07:27.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hT4itbV0caluVDUW47Rx527RO1MGjA__0 2024-09-12T01:07:27.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7499847605246571738', time=2024-09-12T02:54:25.603741+0000, chain.objs.size()=1 2024-09-12T01:07:27.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XW5jJzqJHsIDY94aSi79pKS0KSMF2h6_0 2024-09-12T01:07:27.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13563376602568933752', time=2024-09-12T02:54:25.662572+0000, chain.objs.size()=1 2024-09-12T01:07:27.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.320+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6HbKROBIRR06nnwKIsX5btroQdWHhi9_0 2024-09-12T01:07:27.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8429626906038880886', time=2024-09-12T02:54:25.678038+0000, chain.objs.size()=1 2024-09-12T01:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GP1ZdnOOf6OgPI-w7Wh92ZW9_X702n2_0 2024-09-12T01:07:27.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11342342658701537292', time=2024-09-12T02:54:25.699537+0000, chain.objs.size()=1 2024-09-12T01:07:27.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CovqCYzE4XJaNOILoRC596HX5q_4NDY_0 2024-09-12T01:07:27.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12068646888564752322', time=2024-09-12T02:54:25.736514+0000, chain.objs.size()=1 2024-09-12T01:07:27.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LuOZzmYnJ4ZnWBv5aQrzM0zafickcAd_0 2024-09-12T01:07:27.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8501910564396026278', time=2024-09-12T02:54:25.970511+0000, chain.objs.size()=1 2024-09-12T01:07:27.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XQsRL9GotS5Ik-bni3sqvvKIonkjZis_0 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4476380078739823978', time=2024-09-12T02:54:30.708401+0000, chain.objs.size()=1 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.269__shadow_.3gAuDHYXupUNlVWAYedGxtFAp2idjlP_0 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4549829750385515639', time=2024-09-12T02:54:35.545713+0000, chain.objs.size()=1 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.276__shadow_.Lpjhvb_J8OmF-xUYe9t6puDwTTCzat8_0 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18442300152237121071', time=2024-09-12T02:54:49.339211+0000, chain.objs.size()=1 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.jgDLQlkwekPdpMmcuEs5pyiLiauxaHm_0 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9218198205748207939', time=2024-09-12T02:54:51.453930+0000, chain.objs.size()=1 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.296__shadow_.0lbJ2DYi7_iM0roTRPARULimH7M_UZi_0 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12821223198733989863', time=2024-09-12T02:54:52.948155+0000, chain.objs.size()=1 2024-09-12T01:07:27.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.324+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.298__shadow_.Dn5ZDdUPTbVEkfA-hzu8rDjsSDDh-OB_0 2024-09-12T01:07:27.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10136723403713354815', time=2024-09-12T02:54:59.866356+0000, chain.objs.size()=1 2024-09-12T01:07:27.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.307__shadow:flUqCZ5EGqNDuzgUsCir9QwpI7s39jV_.FI5p0slxWEP5y_F4o9SkjNiK2UPZwgv_0 2024-09-12T01:07:27.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13424031800796614794', time=2024-09-12T02:55:30.921263+0000, chain.objs.size()=1 2024-09-12T01:07:27.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ow2s2I4IdWFN6ezN_qzPtWhMKdM1ugI_0 2024-09-12T01:07:27.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11002029805946613559', time=2024-09-12T02:55:31.071318+0000, chain.objs.size()=1 2024-09-12T01:07:27.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.JBbRLOmYFoLDFyzYn-3aOo0x-TN8dzx_0 2024-09-12T01:07:27.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9760217568319059523', time=2024-09-12T02:55:31.104802+0000, chain.objs.size()=1 2024-09-12T01:07:27.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XPzaYzTeZhi9ott0DDsRevwIdTm7jpg_0 2024-09-12T01:07:27.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12612172095633335159', time=2024-09-12T02:55:31.247535+0000, chain.objs.size()=1 2024-09-12T01:07:27.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GF9035Y2VTth73zzOdbHjmoqCtlhHD3_0 2024-09-12T01:07:27.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16683369650875471915', time=2024-09-12T02:55:31.273331+0000, chain.objs.size()=1 2024-09-12T01:07:27.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ukFc92dxKu0uTTWRaz1Ut1FueLnTtWT_0 2024-09-12T01:07:27.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6654710475729121766', time=2024-09-12T02:55:31.372845+0000, chain.objs.size()=1 2024-09-12T01:07:27.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OTQtZKz00k0nXWPEiGcigw5qt02zwiR_0 2024-09-12T01:07:27.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15310569764108985217', time=2024-09-12T02:55:31.383293+0000, chain.objs.size()=1 2024-09-12T01:07:27.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OkWqteinT4R0BHgGXScFSxDfVrf4I0E_0 2024-09-12T01:07:27.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12896268327923816015', time=2024-09-12T02:55:31.699147+0000, chain.objs.size()=1 2024-09-12T01:07:27.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.G9Zp9gc6S7TN1_9J0uY6PBH4Mv2LGRX_0 2024-09-12T01:07:27.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3970057091476071351', time=2024-09-12T02:55:31.729839+0000, chain.objs.size()=1 2024-09-12T01:07:27.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QI1gHXM8Fu7aA4GIVt5m80ybHA-op0u_0 2024-09-12T01:07:27.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9513270821812268203', time=2024-09-12T02:55:31.887926+0000, chain.objs.size()=1 2024-09-12T01:07:27.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.328+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.H3ErgD13p4Y34kGCGW0xQenzQjp-v7w_0 2024-09-12T01:07:27.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4871823397770040449', time=2024-09-12T02:55:31.895636+0000, chain.objs.size()=1 2024-09-12T01:07:27.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PTFMOLVgW9IDL_7QOE9yt1mHP9PioCU_0 2024-09-12T01:07:27.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2503103479047759089', time=2024-09-12T02:55:31.937628+0000, chain.objs.size()=1 2024-09-12T01:07:27.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.RHBfQ59u9GIr4FEKStoM9u9RB-H9c56_0 2024-09-12T01:07:27.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.332+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5892933197720950674', time=2024-09-12T02:55:31.992581+0000, chain.objs.size()=1 2024-09-12T01:07:27.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.332+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6GRdvF73wZ_Y_5oC485car_pbV2AxGV_0 2024-09-12T01:07:27.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2822540187837730958', time=2024-09-12T02:55:31.998751+0000, chain.objs.size()=1 2024-09-12T01:07:27.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yXyBdRy6IGZ0y19yeYnBfFhly7oEscZ_0 2024-09-12T01:07:27.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1345692982839330449', time=2024-09-12T02:55:32.042455+0000, chain.objs.size()=1 2024-09-12T01:07:27.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.luFSo2j6qSa8ZJBB8m2CV4Ldy_hn26P_0 2024-09-12T01:07:27.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1704292867126143', time=2024-09-12T02:55:32.080132+0000, chain.objs.size()=1 2024-09-12T01:07:27.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.UGGKPi0yy41Alms9X82yabdhO732DCU_0 2024-09-12T01:07:27.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11868589689161852456', time=2024-09-12T02:55:32.092208+0000, chain.objs.size()=1 2024-09-12T01:07:27.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kH2tHVmQx3TyH91tfUy5qQS0VbNMaa4_0 2024-09-12T01:07:27.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8481042273840231035', time=2024-09-12T02:55:32.263767+0000, chain.objs.size()=1 2024-09-12T01:07:27.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eIHC_IQBLTr1Ulh91f-_ECFCNbbOSaK_0 2024-09-12T01:07:27.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8789526968691780947', time=2024-09-12T02:55:32.437156+0000, chain.objs.size()=1 2024-09-12T01:07:27.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QOMpB27l-yNnBS3-wuuXZP3Uz8BxFj5_0 2024-09-12T01:07:27.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2130117723316218131', time=2024-09-12T02:55:32.599457+0000, chain.objs.size()=1 2024-09-12T01:07:27.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.n0frSpotteuYH9UmBbd-4LerGOOmyrQ_0 2024-09-12T01:07:27.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4904596170255224439', time=2024-09-12T02:55:32.936321+0000, chain.objs.size()=1 2024-09-12T01:07:27.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KU7yJr40AARbpM8DGvgx2uvyEOU2m96_0 2024-09-12T01:07:27.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9748130815141205142', time=2024-09-12T02:55:32.949434+0000, chain.objs.size()=1 2024-09-12T01:07:27.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4TVo61sVCjUaEGm4seTTffSVIy4_aK3_0 2024-09-12T01:07:27.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17644479299638611795', time=2024-09-12T02:55:33.077679+0000, chain.objs.size()=1 2024-09-12T01:07:27.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.336+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0ARk8kd3yd0LnVMLeIgr4mZddbwMYlq_0 2024-09-12T01:07:27.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8493474491120975426', time=2024-09-12T02:55:33.249956+0000, chain.objs.size()=1 2024-09-12T01:07:27.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Y1PeqP0VmCVuf2evVUD9IDipEEapzTa_0 2024-09-12T01:07:27.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13788379538752989333', time=2024-09-12T02:55:33.281372+0000, chain.objs.size()=1 2024-09-12T01:07:27.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.AWnXRhefjqEgraOJUSpFtgk-Eca2OLk_0 2024-09-12T01:07:27.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10741199241375272115', time=2024-09-12T02:55:54.517541+0000, chain.objs.size()=1 2024-09-12T01:07:27.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1CLXwAfgjnRl8PKpytcUnPlvxbl8j2__0 2024-09-12T01:07:27.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8187978058182463051', time=2024-09-12T02:55:54.548488+0000, chain.objs.size()=1 2024-09-12T01:07:27.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UYDqxBy-TgTJI6aLuu36xU_kqZwkGLF_0 2024-09-12T01:07:27.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12055219803044080303', time=2024-09-12T02:55:54.562200+0000, chain.objs.size()=1 2024-09-12T01:07:27.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8MDmvC_l048KGLIz6bE4U7w2H8RKm7c_0 2024-09-12T01:07:27.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5947573937255371802', time=2024-09-12T02:55:54.570202+0000, chain.objs.size()=1 2024-09-12T01:07:27.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.InBJb5xcbsp0cvFWBlIByWxNxkEBxwj_0 2024-09-12T01:07:27.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6609114731075732799', time=2024-09-12T02:55:54.636683+0000, chain.objs.size()=1 2024-09-12T01:07:27.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ev1iEKyZwjaRNYzTRYFsiy35sr48aB7_0 2024-09-12T01:07:27.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5582001065322979904', time=2024-09-12T02:55:54.662717+0000, chain.objs.size()=1 2024-09-12T01:07:27.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.E4kNEEpI9RxA4__qEUPyw75-AZ1vk0k_0 2024-09-12T01:07:27.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1462802704507472372', time=2024-09-12T02:55:54.667788+0000, chain.objs.size()=1 2024-09-12T01:07:27.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.v-Sw-512r3ZmkEY18RvGW6GtHDqpKsh_0 2024-09-12T01:07:27.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14107472071940359799', time=2024-09-12T02:55:54.888519+0000, chain.objs.size()=1 2024-09-12T01:07:27.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NOx9JdN5nucpjmkCpSbsqpRYOz2BkFa_0 2024-09-12T01:07:27.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1102348953960225356', time=2024-09-12T02:55:54.929344+0000, chain.objs.size()=1 2024-09-12T01:07:27.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dSkxp981Zw2kA_I6MSJNgE8yDMJ1lJ7_0 2024-09-12T01:07:27.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9114712841139851068', time=2024-09-12T02:55:55.006907+0000, chain.objs.size()=1 2024-09-12T01:07:27.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.340+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OdGD70rZJwVFI7MkvfYUbKmSp9kCci4_0 2024-09-12T01:07:27.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4940413799880401134', time=2024-09-12T02:55:55.134360+0000, chain.objs.size()=1 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lsfwcp_rs5UI2WjdF4ndam64TyGfyFg_0 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.600268106879074224', time=2024-09-12T02:55:55.240126+0000, chain.objs.size()=1 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0OEICwrALC3JnDknE-uxnrnj80NJp-H_0 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8303616035512566907', time=2024-09-12T02:55:55.261500+0000, chain.objs.size()=1 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UbvTEC-ewliWdemW1iPjFVDZ8m-Ilaz_0 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16529557847225533923', time=2024-09-12T02:55:55.272544+0000, chain.objs.size()=1 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Fj1FmM6obGeD3F45rgwXP-BnKel1QOJ_0 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14205525707817595872', time=2024-09-12T02:55:55.299722+0000, chain.objs.size()=1 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BGG590eqXqKDKFldLQRCr3KcUsOo7LN_0 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15203703909514836271', time=2024-09-12T02:55:55.457671+0000, chain.objs.size()=1 2024-09-12T01:07:27.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.m2-AjRwaVbAxex1YLNW4ojupzFbtZxk_0 2024-09-12T01:07:27.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1077364824165970907', time=2024-09-12T02:55:55.604977+0000, chain.objs.size()=1 2024-09-12T01:07:27.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-RKAiEZmL7lwqMBSsuPxieS82g6e8uU_0 2024-09-12T01:07:27.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1953233602150426582', time=2024-09-12T02:55:55.634124+0000, chain.objs.size()=1 2024-09-12T01:07:27.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8LT8IUK9trT2faz5f_Y0u9AdOoUOcXr_0 2024-09-12T01:07:27.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15448340757289236377', time=2024-09-12T02:55:55.655957+0000, chain.objs.size()=1 2024-09-12T01:07:27.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.idVFMQCk4hDWaauGUoxoMUTR0GXUcu0_0 2024-09-12T01:07:27.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.172554186869653702', time=2024-09-12T02:55:55.797057+0000, chain.objs.size()=1 2024-09-12T01:07:27.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.344+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Ne5AaHoLPjFGPTKbDah2nJPJxT9hqs9_0 2024-09-12T01:07:27.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1818600884527357274', time=2024-09-12T02:55:55.859793+0000, chain.objs.size()=1 2024-09-12T01:07:27.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8EImp3QrugoHoDiixZWql_HzQZn3BAT_0 2024-09-12T01:07:27.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7194083711864123672', time=2024-09-12T02:55:55.868349+0000, chain.objs.size()=1 2024-09-12T01:07:27.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VUhl9Izp1oakHnQoAsZOtb9mrbNlp7g_0 2024-09-12T01:07:27.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12895840255921000454', time=2024-09-12T02:55:56.224248+0000, chain.objs.size()=1 2024-09-12T01:07:27.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nv144dncPUrBAGwJTC3qTEhWRZq4AW1_0 2024-09-12T01:07:27.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9503773166048216825', time=2024-09-12T02:55:56.329009+0000, chain.objs.size()=1 2024-09-12T01:07:27.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TIqkwh9WfOYR-aiW1vLvs30EPM_BtOm_0 2024-09-12T01:07:27.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5162496833385839074', time=2024-09-12T02:55:56.333136+0000, chain.objs.size()=1 2024-09-12T01:07:27.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IslLlFpg0OgMRxSx5z3TROtm2vTUChf_0 2024-09-12T01:07:27.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3447273300636520517', time=2024-09-12T02:55:56.370775+0000, chain.objs.size()=1 2024-09-12T01:07:27.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.348+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6PD-nXwo6EV4OnyOUx6bnq9Mh8BFW8K_0 2024-09-12T01:07:27.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.352+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/63596 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15355641913791891924', time=2024-09-12T02:55:56.463760+0000, chain.objs.size()=1 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2Lc5PriKaSpNF_s6oj4mlYD1TYprWBs_0 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10990744461282861042', time=2024-09-12T02:55:56.493626+0000, chain.objs.size()=1 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SI-Ala_V21T-UPK0sp79cy4TU-u7ahU_0 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15868410243558147214', time=2024-09-12T02:55:56.566861+0000, chain.objs.size()=1 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.CacEbQwKhs-yBJplTBbSWyzn5nxJpzY_0 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4807762181490348310', time=2024-09-12T02:55:56.603956+0000, chain.objs.size()=1 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.cjXls1_dJd3_QQdyKgeb1ZbMllS9DY-_0 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14214570981873686923', time=2024-09-12T02:55:56.661877+0000, chain.objs.size()=1 2024-09-12T01:07:27.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.AFRUdD4MFbpJTPjKNqzYrHJzbLDcdJB_0 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15485053200960718171', time=2024-09-12T02:55:56.662758+0000, chain.objs.size()=1 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7JFIRC7Zt8jxoywMYiVom0gXb5tQvSw_0 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11098114381478355860', time=2024-09-12T02:55:56.756318+0000, chain.objs.size()=1 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kIpJm4plEEUX4FsUcJ6pelYWKQel_at_0 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2786055632619337424', time=2024-09-12T02:55:56.778085+0000, chain.objs.size()=1 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.kOBkLkERonEwTDPUg07-x3MWKCqg7xl_0 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13293712784513759106', time=2024-09-12T02:55:56.802958+0000, chain.objs.size()=1 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0mYDy8gEIGTcqK2CoxkQXFhKvMFoLlw_0 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6549592325723756358', time=2024-09-12T02:55:56.830986+0000, chain.objs.size()=1 2024-09-12T01:07:27.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VlJYAkZvTOC64-sYXyaRodUDOcD6UKX_0 2024-09-12T01:07:27.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14316448040442665392', time=2024-09-12T02:56:10.716551+0000, chain.objs.size()=1 2024-09-12T01:07:27.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.346__shadow_.R6g2uC4UyKjzwDvfxgHihGETTU9k8OK_0 2024-09-12T01:07:27.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3637025351892483792', time=2024-09-12T02:56:52.004938+0000, chain.objs.size()=1 2024-09-12T01:07:27.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.356+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.408__shadow_.kBt-S7nuci_nofK8fOSTGAC9oK-O_Kh_0 2024-09-12T01:07:27.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15639227784009698712', time=2024-09-12T02:57:26.319626+0000, chain.objs.size()=1 2024-09-12T01:07:27.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.455__shadow_.LyI3fHIZUaSbkm2YXZyte-NLFDHCMjv_0 2024-09-12T01:07:27.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3453499737680329819', time=2024-09-12T02:57:30.384540+0000, chain.objs.size()=1 2024-09-12T01:07:27.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.459__shadow_.FjpacnpdDElkhyO42mrEP1nLZilYxPh_0 2024-09-12T01:07:27.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1058235289564554745', time=2024-09-12T02:57:33.404184+0000, chain.objs.size()=1 2024-09-12T01:07:27.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.462__shadow_.LJtmjLAZwTu42I89iMQnltlR8gZzOn0_0 2024-09-12T01:07:27.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15383979223808677647', time=2024-09-12T02:57:45.824270+0000, chain.objs.size()=1 2024-09-12T01:07:27.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.484__shadow_.Qcmn8a0DZZxJBu2RqnqQI54xNEl1wsP_0 2024-09-12T01:07:27.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13074236646905878633', time=2024-09-12T02:57:51.122183+0000, chain.objs.size()=1 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.491__shadow_.kshXiRpm6xlPVNOK8ikv5ZqLXpKtps1_0 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13359321906235054957', time=2024-09-12T02:57:53.634198+0000, chain.objs.size()=1 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.496__shadow_.IhbO4oFPeOxJ5dWbHlUVosgiN_F3EvG_0 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12559260706001308972', time=2024-09-12T02:57:55.436396+0000, chain.objs.size()=1 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.499__shadow_.EzZotzh5ubG_ia3si95PyNHYAHD53iW_0 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1696321762045964380', time=2024-09-12T02:58:01.737768+0000, chain.objs.size()=6 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.1 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.2 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.3 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.4 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.5 2024-09-12T01:07:27.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.6 2024-09-12T01:07:27.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3805317882095419135', time=2024-09-12T02:58:16.726210+0000, chain.objs.size()=3 2024-09-12T01:07:27.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.360+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~53_vqroMNYYo9DPv_yFN6-gRUiyDZUy.1 2024-09-12T01:07:27.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.364+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~53_vqroMNYYo9DPv_yFN6-gRUiyDZUy.2 2024-09-12T01:07:27.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.364+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.521__multipart_mymultipart.2~53_vqroMNYYo9DPv_yFN6-gRUiyDZUy.3 2024-09-12T01:07:27.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.364+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8829284230848230486', time=2024-09-12T02:59:36.844818+0000, chain.objs.size()=1 2024-09-12T01:07:27.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.364+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.556__shadow_.AXDdTbndWxtJkkXe1PtChhWg-LUBcTU_0 2024-09-12T01:07:27.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10207954597868439925', time=2024-09-12T02:59:41.351535+0000, chain.objs.size()=1 2024-09-12T01:07:27.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.560__shadow_.DOb-ys8hRAG_F1Y0zMurdl2kLzuMidw_0 2024-09-12T01:07:27.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17862246263110836456', time=2024-09-12T02:59:41.890184+0000, chain.objs.size()=1 2024-09-12T01:07:27.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.561__multipart_mymultipart.2~8KyrcuTt93Y_3XW1uLIC3UFaMDStYij.1 2024-09-12T01:07:27.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8622834330621449152', time=2024-09-12T02:59:59.456834+0000, chain.objs.size()=1 2024-09-12T01:07:27.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:T2LESXm.b2nLbXCQmMlOaciY09LHxO3_.TAccJu3KSeg5tTkJxkIxixRCqNjKJW4_0 2024-09-12T01:07:27.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16631801136226799718', time=2024-09-12T03:00:00.577809+0000, chain.objs.size()=1 2024-09-12T01:07:27.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.570__shadow:gXIvcoQZtkSlykSyj9XM.z3A8kM0Wut_.ixDcwzDNE7g85FR-9ztT9otL8uNSRFz_0 2024-09-12T01:07:27.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13689491498017207857', time=2024-09-12T03:00:21.729233+0000, chain.objs.size()=1 2024-09-12T01:07:27.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:rzca9ThCSuijjGBokvo6u7e1qv.0WXI_.cYRMZV11MfY1pl2-pQRVZP-g2B0HFIr_0 2024-09-12T01:07:27.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1703138544816819735', time=2024-09-12T03:00:40.730821+0000, chain.objs.size()=1 2024-09-12T01:07:27.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.585__shadow:6VE4h9QmAYKoya-t4WzvOHNLmvHWC1H_.kYrr8txetCEQTfWVcdINg14h_p-4W4u_0 2024-09-12T01:07:27.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3477273246306628283', time=2024-09-12T03:00:40.769328+0000, chain.objs.size()=1 2024-09-12T01:07:27.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.585__shadow:5lH8SOJeoQ4hpociyWlH0p67ccL4DyH_.h3aKcBcyPsTCHup4cjVTJfVvW3-o6yW_0 2024-09-12T01:07:27.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14620909794777852425', time=2024-09-12T03:00:42.413695+0000, chain.objs.size()=1 2024-09-12T01:07:27.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:DXQfET9kSz.dPUx0R9Ws-eaLf1ECHfh_.eHpSWo5ELKZ_P-o6xFmhHkykLqoNAHX_0 2024-09-12T01:07:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5530018967857031731', time=2024-09-12T03:03:28.872295+0000, chain.objs.size()=1 2024-09-12T01:07:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.635__shadow_.lj9PB1uqAUsQiwNb_dfzlryWu6s6AES_0 2024-09-12T01:07:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11470773201740915292', time=2024-09-12T03:03:53.492052+0000, chain.objs.size()=1 2024-09-12T01:07:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.665__shadow_.aTdZknT8WBEHly7qT70kkK-IXrXyPbY_0 2024-09-12T01:07:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6994205611851503553', time=2024-09-12T03:04:07.897120+0000, chain.objs.size()=1 2024-09-12T01:07:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.368+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.690__shadow:iIKBL8AlIoEbfK86eMocsUGLcmHwJ-K_.KGnF3VSNVGMHCyPB061pOouZW6dIiTc_0 2024-09-12T01:07:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9692958204169555892', time=2024-09-12T03:04:34.882938+0000, chain.objs.size()=1 2024-09-12T01:07:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.716__shadow:95xN3bAGYe8HY5eO6mSBXNXMVeFmQeT_.Us9KVvaHZJTjXDPI0ZgjX4L5GK0FpP4_0 2024-09-12T01:07:27.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.372+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2383767956912465885', time=2024-09-12T03:05:02.765786+0000, chain.objs.size()=1 2024-09-12T01:07:27.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.742__multipart_mymultipart3.2~AJB6rZdlp6gK17XC5Km2a9gvpcdcvBv.1 2024-09-12T01:07:27.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.372+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:07:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.376+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45791' 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12446013470058166321', time=2024-09-12T02:53:50.082664+0000, chain.objs.size()=1 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.244__shadow_.ReRSyC1EbI_AfPI7Jw9lOeO_JAyJREx_0 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9501630999986224435', time=2024-09-12T02:54:23.091733+0000, chain.objs.size()=1 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uJmOEt8CPw-y6cCO50B2udpq7boXPMO_0 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7159013801094223388', time=2024-09-12T02:54:23.131600+0000, chain.objs.size()=1 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Fis84lh07nUuPlhbbVGIG_Vr7CovaoL_0 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1575139194098432311', time=2024-09-12T02:54:23.136131+0000, chain.objs.size()=1 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kYS-6u5pOywjpPBx3zdZ_5U0Rg0SVq4_0 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6471390222690287277', time=2024-09-12T02:54:23.150212+0000, chain.objs.size()=1 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.t44hWONRFHEzDVY952MetETAlSTq1bR_0 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9245286310456415433', time=2024-09-12T02:54:23.159263+0000, chain.objs.size()=1 2024-09-12T01:07:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.wagyvRbAoqD-TCMF_TnDJh2YZjlf0T9_0 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7898099560661901401', time=2024-09-12T02:54:23.220366+0000, chain.objs.size()=1 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ewN2Q3BCTDmxuETJYbdmcwZmFkUlFd0_0 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13475622913592553910', time=2024-09-12T02:54:23.229820+0000, chain.objs.size()=1 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CSe3pvJtX2Za_WteOqcF5Q1whgSq4mE_0 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1723607825493429866', time=2024-09-12T02:54:23.236005+0000, chain.objs.size()=1 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.b7KpMWYs_XUmp5atQ6sLqgH43NeDWct_0 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10883532657250719708', time=2024-09-12T02:54:23.505526+0000, chain.objs.size()=1 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.O1ZpjP5Osy7iAX4dnxVNHjLWeqFvN4t_0 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6807313603846514191', time=2024-09-12T02:54:23.532742+0000, chain.objs.size()=1 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-oLCU6ldOHxBuGtnlXkFzf56YwehA0p_0 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1858885269997533352', time=2024-09-12T02:54:23.564760+0000, chain.objs.size()=1 2024-09-12T01:07:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.64xO8bSwiJdLPd3HGDdNVlwMCVy4g0d_0 2024-09-12T01:07:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7318078697945083473', time=2024-09-12T02:54:23.578230+0000, chain.objs.size()=1 2024-09-12T01:07:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.xwf2bt6M0g_wYpPxT6tXwYSJ1NxxQJR_0 2024-09-12T01:07:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15945799369492574120', time=2024-09-12T02:54:23.589724+0000, chain.objs.size()=1 2024-09-12T01:07:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qEWO8Oa2P2Zn744yaQ_eSs-_FZuHN7t_0 2024-09-12T01:07:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6628443781354235379', time=2024-09-12T02:54:23.617937+0000, chain.objs.size()=1 2024-09-12T01:07:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GHwK1EOvSoTDUTSYfOGgsxy8qUGM8ju_0 2024-09-12T01:07:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1376913374491966675', time=2024-09-12T02:54:23.626653+0000, chain.objs.size()=1 2024-09-12T01:07:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VlHFgidkCvCMsHXvCZ13vhP1jpXUiFn_0 2024-09-12T01:07:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11620645385744566352', time=2024-09-12T02:54:23.740613+0000, chain.objs.size()=1 2024-09-12T01:07:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dzC2VVY8PPlkDFrwb8P-k9pvomPTYjC_0 2024-09-12T01:07:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8553673848745800569', time=2024-09-12T02:54:23.748120+0000, chain.objs.size()=1 2024-09-12T01:07:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.sKTudnwi8-9LdbGwzdNozQQ0-AO0L4X_0 2024-09-12T01:07:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17219242433354359454', time=2024-09-12T02:54:24.090527+0000, chain.objs.size()=1 2024-09-12T01:07:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8xasSlxE__WGZHm0H7szHnUGF1-Z5fr_0 2024-09-12T01:07:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10097069036893627124', time=2024-09-12T02:54:24.313581+0000, chain.objs.size()=1 2024-09-12T01:07:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.380+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.7gHP4AkNYV3IdgDK1j2OdEn_Ek1LZ5J_0 2024-09-12T01:07:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11126784199727798644', time=2024-09-12T02:54:24.347399+0000, chain.objs.size()=1 2024-09-12T01:07:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.sQMslbyI0f-IsGG5v6-kv7Eu7DnpJrT_0 2024-09-12T01:07:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9665896745646969223', time=2024-09-12T02:54:24.387731+0000, chain.objs.size()=1 2024-09-12T01:07:27.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fF_gsUuhdhpNbytNCyQKujDRDlvsKb__0 2024-09-12T01:07:27.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13401433915523356162', time=2024-09-12T02:54:24.431690+0000, chain.objs.size()=1 2024-09-12T01:07:27.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0WQOFLE8GU-0jMLRllEkhi8Xk7oj_9m_0 2024-09-12T01:07:27.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8355481852271469683', time=2024-09-12T02:54:24.442810+0000, chain.objs.size()=1 2024-09-12T01:07:27.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.K5q6WkxPLvSJnNNVWOtFup36Tsp-1LY_0 2024-09-12T01:07:27.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8691393226752663874', time=2024-09-12T02:54:24.462776+0000, chain.objs.size()=1 2024-09-12T01:07:27.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.384+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.v2aLY5vjY5qdDEHDdC-gepP4ve3YtjI_0 2024-09-12T01:07:27.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6793451209246500001', time=2024-09-12T02:54:24.483571+0000, chain.objs.size()=1 2024-09-12T01:07:27.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.r8_ZgDP9rfgK-NvAg7qiNpgD0Poqv2v_0 2024-09-12T01:07:27.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9741033601023661170', time=2024-09-12T02:54:24.497368+0000, chain.objs.size()=1 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FY3fUeRd0IrxNHgh51gSM0XLd_QCNMN_0 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8580688375793470570', time=2024-09-12T02:54:24.775274+0000, chain.objs.size()=1 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Iaham5fAOTq6pBImxCAI00ARS0sDlnw_0 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3663785120961414403', time=2024-09-12T02:54:24.779219+0000, chain.objs.size()=1 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mZUrhkoa8JCk1tPvIKW7S8DyBbaR-iK_0 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1746633084831856834', time=2024-09-12T02:54:24.794150+0000, chain.objs.size()=1 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.cMSXT6BeTPPUFAiKiX9xTJucgUAGdJk_0 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7424241286943333108', time=2024-09-12T02:54:24.932769+0000, chain.objs.size()=1 2024-09-12T01:07:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.KiFnUv25iBO4GMdBxk-UYCZGT2OfuLw_0 2024-09-12T01:07:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13812116535576602697', time=2024-09-12T02:54:24.956726+0000, chain.objs.size()=1 2024-09-12T01:07:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HG7pNir_MwPj4qawJl1ddC97fFuqy_z_0 2024-09-12T01:07:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14572003091908338617', time=2024-09-12T02:54:24.991758+0000, chain.objs.size()=1 2024-09-12T01:07:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dfqyE8OfHVGyZw4oklcDAMUn73FrqTH_0 2024-09-12T01:07:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4611917362208772265', time=2024-09-12T02:54:25.003271+0000, chain.objs.size()=1 2024-09-12T01:07:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HC33Ft_rflyVczPtFAVky-ZZQEOJo_L_0 2024-09-12T01:07:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14475160762251703036', time=2024-09-12T02:54:25.257371+0000, chain.objs.size()=1 2024-09-12T01:07:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kwpH21q0F7Zu1pi5chJU0_ui5WJp8Ld_0 2024-09-12T01:07:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13448069797726221997', time=2024-09-12T02:54:25.315116+0000, chain.objs.size()=1 2024-09-12T01:07:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.388+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pJvhSQ-hZqBZDmfj9dKQ1pZyhYX8GOD_0 2024-09-12T01:07:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7664527605892234291', time=2024-09-12T02:54:25.321524+0000, chain.objs.size()=1 2024-09-12T01:07:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ycN2S6RfygjVGz2qpbE6jcEhM_IeYEL_0 2024-09-12T01:07:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1257585244053232697', time=2024-09-12T02:54:25.613765+0000, chain.objs.size()=1 2024-09-12T01:07:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.i6xcpbbsAwnJPwwLT7XrpD7nXnc6lZx_0 2024-09-12T01:07:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12299273271582870276', time=2024-09-12T02:54:25.627111+0000, chain.objs.size()=1 2024-09-12T01:07:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0aqN7FZSbx3q-sKSae7BmUrqA5LuJaW_0 2024-09-12T01:07:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4777567236336589979', time=2024-09-12T02:54:25.655562+0000, chain.objs.size()=1 2024-09-12T01:07:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kpbPK2lgQrv3WtxHHyNi-jer2Sj2Ynk_0 2024-09-12T01:07:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14089738850723586885', time=2024-09-12T02:54:25.667970+0000, chain.objs.size()=1 2024-09-12T01:07:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.rJXhHjX9xfPcgH1yv1e6IUIfC0e-UrI_0 2024-09-12T01:07:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12907892612584099134', time=2024-09-12T02:54:25.694404+0000, chain.objs.size()=1 2024-09-12T01:07:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.05axf-WXfyQQEQIQ_FKHBmjzHMhyYXF_0 2024-09-12T01:07:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18166216555524836274', time=2024-09-12T02:54:25.726504+0000, chain.objs.size()=1 2024-09-12T01:07:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.w1C_cs2lRKWVSXPHsr3_b274jSsc1JQ_0 2024-09-12T01:07:27.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16817618122684953680', time=2024-09-12T02:54:25.870278+0000, chain.objs.size()=1 2024-09-12T01:07:27.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.NtFdVoWo4d67l2pyDPfeARBfkZMdEEM_0 2024-09-12T01:07:27.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2187751698374725944', time=2024-09-12T02:54:25.926053+0000, chain.objs.size()=1 2024-09-12T01:07:27.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.IgfNeLW15SPE3-pYK9SEqreL6isX_7Y_0 2024-09-12T01:07:27.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7033713867035410030', time=2024-09-12T02:54:25.977560+0000, chain.objs.size()=1 2024-09-12T01:07:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.huHAdEFm2C3opi_SkpJqkS8xsjqQcv0_0 2024-09-12T01:07:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9574021135710830473', time=2024-09-12T02:54:26.002673+0000, chain.objs.size()=1 2024-09-12T01:07:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.392+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.4Me8aMSprAAe4sUKmU8zfCfVknxc9s6_0 2024-09-12T01:07:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4837524804737894593', time=2024-09-12T02:54:26.008698+0000, chain.objs.size()=1 2024-09-12T01:07:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VwLIp5zroTvWOFXHypYamaLrTSWhYLI_0 2024-09-12T01:07:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10800115587739371096', time=2024-09-12T02:54:27.305882+0000, chain.objs.size()=1 2024-09-12T01:07:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.264__shadow_.POsSeyOQI3BnH4Ck54s3C0LG7vcTwC4_0 2024-09-12T01:07:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7692254087322636441', time=2024-09-12T02:54:33.459194+0000, chain.objs.size()=1 2024-09-12T01:07:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.273__shadow_.3Z7Y3N7gLZEK3uw0mrSv30K_LF2QGIA_0 2024-09-12T01:07:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17380347157133124214', time=2024-09-12T02:54:34.107253+0000, chain.objs.size()=1 2024-09-12T01:07:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.274__shadow_.E2bFzHgGw26bV5uQ3pJZ-9-X4HiBmJC_0 2024-09-12T01:07:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16796138131657590946', time=2024-09-12T02:54:45.461105+0000, chain.objs.size()=1 2024-09-12T01:07:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.290__shadow_.AT9ZJjEwyRqxncSTyzYyBko8PWMTU9c_0 2024-09-12T01:07:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2025067988380284397', time=2024-09-12T02:54:45.469044+0000, chain.objs.size()=1 2024-09-12T01:07:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.290__shadow_.xShvZnxafElAHjgTJUYk6axHFyF8FZY_0 2024-09-12T01:07:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1779549430607343398', time=2024-09-12T02:54:47.901813+0000, chain.objs.size()=1 2024-09-12T01:07:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.lcVqFuXR7qUbumr0P80EJrQUdH6TrQi_0 2024-09-12T01:07:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6741373157165310882', time=2024-09-12T02:54:49.360806+0000, chain.objs.size()=1 2024-09-12T01:07:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.396+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.GMv-gQjyugF8txCST3fE37EUwJkFaJQ_0 2024-09-12T01:07:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3389930131499372958', time=2024-09-12T02:54:49.367425+0000, chain.objs.size()=1 2024-09-12T01:07:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.njxX1bFPK7V3QfMbucX-ZbKQuqLmfTC_0 2024-09-12T01:07:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6116080051410861166', time=2024-09-12T02:54:54.436924+0000, chain.objs.size()=1 2024-09-12T01:07:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.300__shadow_.2zI45yRnzACUWDW6M_KbJ4T27nFD4xu_0 2024-09-12T01:07:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5479903849302543975', time=2024-09-12T02:55:09.619548+0000, chain.objs.size()=1 2024-09-12T01:07:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.322__shadow_.LJyInN9nNR_xZfEyTWa16XH-sgvz_ZW_0 2024-09-12T01:07:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.986292199009266523', time=2024-09-12T02:55:30.934546+0000, chain.objs.size()=1 2024-09-12T01:07:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5wmUU7qTOgokM3URaEc39hxBF7-6mjk_0 2024-09-12T01:07:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17874058469093260246', time=2024-09-12T02:55:31.097729+0000, chain.objs.size()=1 2024-09-12T01:07:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.f5F-yoijuHODwCmlIBzynhzmDNyrp2Y_0 2024-09-12T01:07:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6026534348468851037', time=2024-09-12T02:55:31.294271+0000, chain.objs.size()=1 2024-09-12T01:07:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.p9JbUGHHiAI29Mzs7UIbfJIYlnMHBCt_0 2024-09-12T01:07:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12763006810815075767', time=2024-09-12T02:55:31.400298+0000, chain.objs.size()=1 2024-09-12T01:07:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.yjhTXJ7x8On7jb_jBQePkYnM-RwUcC7_0 2024-09-12T01:07:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17584546695930073306', time=2024-09-12T02:55:31.553811+0000, chain.objs.size()=1 2024-09-12T01:07:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.arumhROWSeioD6jYBwzd7tjvwq_0SGo_0 2024-09-12T01:07:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3790634981259757746', time=2024-09-12T02:55:31.557644+0000, chain.objs.size()=1 2024-09-12T01:07:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VZIGUlu0ptLGQcUr0WXTZ5KVOnEh_NX_0 2024-09-12T01:07:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9050432779531495058', time=2024-09-12T02:55:31.619405+0000, chain.objs.size()=1 2024-09-12T01:07:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.SrZ_bjF6OCTJmIYhaUTGnRrttcFpTSb_0 2024-09-12T01:07:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4429809916493338108', time=2024-09-12T02:55:31.673784+0000, chain.objs.size()=1 2024-09-12T01:07:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.oJm2QVH_CbQMJLoL-e-SJ-QgvtJhNiS_0 2024-09-12T01:07:27.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.471704045146531402', time=2024-09-12T02:55:31.893867+0000, chain.objs.size()=1 2024-09-12T01:07:27.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.400+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.67vUq85aiNiPEQp58eNpHWwbRJYIO_7_0 2024-09-12T01:07:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15194723101274860633', time=2024-09-12T02:55:32.002996+0000, chain.objs.size()=1 2024-09-12T01:07:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.EPI3lyo8JX4VSfLyLP0uAz9VBbglnwM_0 2024-09-12T01:07:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12918531276141388437', time=2024-09-12T02:55:32.217123+0000, chain.objs.size()=1 2024-09-12T01:07:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PMDVNOo9cWBHYnIVe7ZQG9tEL3xTscv_0 2024-09-12T01:07:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18124344847242241669', time=2024-09-12T02:55:32.369639+0000, chain.objs.size()=1 2024-09-12T01:07:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TVfQhno8NQiRC3Zj7POdjnkLGJ_yjfn_0 2024-09-12T01:07:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10807602347701603809', time=2024-09-12T02:55:32.391800+0000, chain.objs.size()=1 2024-09-12T01:07:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.N4AQDa2qWfCD-KjMSnmdms6d5VtBroY_0 2024-09-12T01:07:27.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14266964345003905479', time=2024-09-12T02:55:32.425759+0000, chain.objs.size()=1 2024-09-12T01:07:27.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.c_ivzBHHYicqMzh5DyimCgPVKBPBeRJ_0 2024-09-12T01:07:27.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4226902842254092478', time=2024-09-12T02:55:32.450369+0000, chain.objs.size()=1 2024-09-12T01:07:27.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hXLzjwuOzZTZUYSBN0mHgzS1oWf4ED1_0 2024-09-12T01:07:27.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15851895101778386748', time=2024-09-12T02:55:32.551573+0000, chain.objs.size()=1 2024-09-12T01:07:27.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.CrmRSbPMA07BnH9MUXx4213GgejnvQT_0 2024-09-12T01:07:27.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2467426094087182818', time=2024-09-12T02:55:32.586156+0000, chain.objs.size()=1 2024-09-12T01:07:27.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.2rkWQkqcMDYOKuXf_2L9vQDNewTMcNL_0 2024-09-12T01:07:27.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15890595432931816959', time=2024-09-12T02:55:32.648734+0000, chain.objs.size()=1 2024-09-12T01:07:27.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.404+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5TQBpd2Apo6IEsfBjIwdqbXrArrdNZj_0 2024-09-12T01:07:27.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13898210350585276667', time=2024-09-12T02:55:32.651184+0000, chain.objs.size()=1 2024-09-12T01:07:27.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._1D34roO5nTUzYGXt2qwlBiFHyCjS62_0 2024-09-12T01:07:27.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7120954206765985681', time=2024-09-12T02:55:32.662073+0000, chain.objs.size()=1 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ps91eacHX1LGNdkLdHzhrwwBhTvS_pZ_0 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14325062354107814791', time=2024-09-12T02:55:32.681786+0000, chain.objs.size()=1 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.h2EP6Lmc6iu_Rw97-khIN6nXXG77qoU_0 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.813843445821870115', time=2024-09-12T02:55:32.850533+0000, chain.objs.size()=1 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.lhwd8Nz7yGfBcxkyZU186_b31PFWYQh_0 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9891891915087896601', time=2024-09-12T02:55:32.874509+0000, chain.objs.size()=1 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.sNDFwHrO_SbCYBIxxSuq8tU55xBitZT_0 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5097936881600925409', time=2024-09-12T02:55:32.921609+0000, chain.objs.size()=1 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VXmDt95c5CWFcj5fI8-5Lr8KCcta4Ak_0 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8332360640465285416', time=2024-09-12T02:55:32.928702+0000, chain.objs.size()=1 2024-09-12T01:07:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.M1etlNA2JSBYd2JdTz4116DVeuF4slK_0 2024-09-12T01:07:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14382352263086227497', time=2024-09-12T02:55:32.954344+0000, chain.objs.size()=1 2024-09-12T01:07:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hhh7wJ_sYKLjwE7_VkI1ftijNbKq3VT_0 2024-09-12T01:07:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8671424320124137714', time=2024-09-12T02:55:32.961666+0000, chain.objs.size()=1 2024-09-12T01:07:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7-vvBIUwen3ar3bHcWsCYWjabE1Ru_8_0 2024-09-12T01:07:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17865324911170457116', time=2024-09-12T02:55:33.016759+0000, chain.objs.size()=1 2024-09-12T01:07:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.408+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.BQgISq1s4L_cZoL_O7U0Qw4_RgsYIFZ_0 2024-09-12T01:07:27.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9616706830417696969', time=2024-09-12T02:55:33.168284+0000, chain.objs.size()=1 2024-09-12T01:07:27.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.s_qwf4yPZCsGAgpVr2L1CgmbGDgtZXD_0 2024-09-12T01:07:27.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9724144695380041060', time=2024-09-12T02:55:33.206729+0000, chain.objs.size()=1 2024-09-12T01:07:27.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VETpwu7h3TH0GMODfRLPacsNaNIwlht_0 2024-09-12T01:07:27.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7027107008876336784', time=2024-09-12T02:55:33.258029+0000, chain.objs.size()=1 2024-09-12T01:07:27.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.aQ1jypQf7EVdDNvZvQPutqBCIg2JWHx_0 2024-09-12T01:07:27.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15773498995701477294', time=2024-09-12T02:55:33.264789+0000, chain.objs.size()=1 2024-09-12T01:07:27.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LBd8rfR5PK0If2xY6MV06BmC8OTdOXj_0 2024-09-12T01:07:27.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5732000273978425914', time=2024-09-12T02:55:33.294821+0000, chain.objs.size()=1 2024-09-12T01:07:27.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.h47SFBYLEh5HoSCJTyIt74rQ5nj9Fvt_0 2024-09-12T01:07:27.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3269162971744501915', time=2024-09-12T02:55:33.333350+0000, chain.objs.size()=1 2024-09-12T01:07:27.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZrSvzVmQ2emHjgmtbgEXpUHWROwnuYH_0 2024-09-12T01:07:27.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1550707371355716732', time=2024-09-12T02:55:54.440609+0000, chain.objs.size()=1 2024-09-12T01:07:27.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.NkDjjQn_rk3rxAOdUhA5ANkVpU6vKZO_0 2024-09-12T01:07:27.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6134850833176584154', time=2024-09-12T02:55:54.551556+0000, chain.objs.size()=1 2024-09-12T01:07:27.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.CD-be0t2KpOwGB4mmM6juh1Kyn1fKsY_0 2024-09-12T01:07:27.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16732360020362651409', time=2024-09-12T02:55:54.615054+0000, chain.objs.size()=1 2024-09-12T01:07:27.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.CcUbIkv15gzBgdmQSoPzAt4FzWp4Yya_0 2024-09-12T01:07:27.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17982652705067099830', time=2024-09-12T02:55:54.632567+0000, chain.objs.size()=1 2024-09-12T01:07:27.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.412+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xH-RPiEqE_2HBLFIBqIoVnN_Icf5Ic__0 2024-09-12T01:07:27.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10713642444693180566', time=2024-09-12T02:55:54.885328+0000, chain.objs.size()=1 2024-09-12T01:07:27.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ioIIkiIIKlh2Vruk1zoMvDQCzP-MYkp_0 2024-09-12T01:07:27.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9835657085967112737', time=2024-09-12T02:55:54.890518+0000, chain.objs.size()=1 2024-09-12T01:07:27.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.MlzeIhJL764woTm0sHNz5zFfFr-tSzK_0 2024-09-12T01:07:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8751435885564417707', time=2024-09-12T02:55:54.922121+0000, chain.objs.size()=1 2024-09-12T01:07:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.iNBvitMG_06DYKxeU1ldQmu5alBZoft_0 2024-09-12T01:07:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.416+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8025508715978257676', time=2024-09-12T02:55:54.936699+0000, chain.objs.size()=1 2024-09-12T01:07:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.416+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.H_HNNwwCL3OhHbz4tWwcXxYRZQTy7Bp_0 2024-09-12T01:07:27.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.420+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45791 2024-09-12T01:07:27.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=49, truncated=0, next_marker='' 2024-09-12T01:07:27.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5446580236508613708', time=2024-09-12T02:55:54.947896+0000, chain.objs.size()=1 2024-09-12T01:07:27.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UxcJg8DGjpi-yZEfamapwnizv0ZxTYY_0 2024-09-12T01:07:27.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13463477409097289549', time=2024-09-12T02:55:54.992520+0000, chain.objs.size()=1 2024-09-12T01:07:27.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VX2V0ZtX9kaViq52aVElAD8_VTygsMb_0 2024-09-12T01:07:27.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5844361515659623937', time=2024-09-12T02:55:55.003352+0000, chain.objs.size()=1 2024-09-12T01:07:27.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1mj0OE663WWEkXa4XBmSFcTD2r2cxj__0 2024-09-12T01:07:27.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12121873395970767176', time=2024-09-12T02:55:55.015762+0000, chain.objs.size()=1 2024-09-12T01:07:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gSD69uhK7WeZBAXuppQVPdIKBeiFIgu_0 2024-09-12T01:07:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12321802475496641062', time=2024-09-12T02:55:55.150050+0000, chain.objs.size()=1 2024-09-12T01:07:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gv9NNRiyi0e1vcT4AZjLnkLJRuFUMc8_0 2024-09-12T01:07:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17978853471820443220', time=2024-09-12T02:55:55.165664+0000, chain.objs.size()=1 2024-09-12T01:07:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Cyyp3phD1MEU_F2rKU2IjgcW3alp5EU_0 2024-09-12T01:07:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12936395022435711497', time=2024-09-12T02:55:55.173435+0000, chain.objs.size()=1 2024-09-12T01:07:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.l6jvyANfj3ALEcI0sgHWfcTGnMotiI1_0 2024-09-12T01:07:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.369578467087595896', time=2024-09-12T02:55:55.242053+0000, chain.objs.size()=1 2024-09-12T01:07:27.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WW0xFjdWmkU79gnqPWfKVA8VZrVcGzw_0 2024-09-12T01:07:27.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10660841254046900074', time=2024-09-12T02:55:55.305262+0000, chain.objs.size()=1 2024-09-12T01:07:27.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qDoyL18XPjFi2mi8ERiyliMXxeZE5pK_0 2024-09-12T01:07:27.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8730567738891152815', time=2024-09-12T02:55:55.317628+0000, chain.objs.size()=1 2024-09-12T01:07:27.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2k6UjS4E_ySfGl2BdR6sTK7Rx9AJpJL_0 2024-09-12T01:07:27.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1105745900241988770', time=2024-09-12T02:55:55.319362+0000, chain.objs.size()=1 2024-09-12T01:07:27.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.m04IRNtDf_Gq12MxnmypTIGYvqjriA7_0 2024-09-12T01:07:27.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16015535475979680247', time=2024-09-12T02:55:55.332668+0000, chain.objs.size()=1 2024-09-12T01:07:27.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.TSte6RPj7Zx9FHDjEQqZ82fmnsRUa8K_0 2024-09-12T01:07:27.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13034308901130949977', time=2024-09-12T02:55:55.465667+0000, chain.objs.size()=1 2024-09-12T01:07:27.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qWXQ_GhG7qA48Ar8UMaRmF2tx2ufi-q_0 2024-09-12T01:07:27.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3578506200769703944', time=2024-09-12T02:55:55.568733+0000, chain.objs.size()=1 2024-09-12T01:07:27.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.424+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Mph_cqD7yKrB7rk0HejLjNk94Z14kmc_0 2024-09-12T01:07:27.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1732870516790400349', time=2024-09-12T02:55:55.576532+0000, chain.objs.size()=1 2024-09-12T01:07:27.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.06L4-E5y86Amtn1L05jcGBxCYOGMjOg_0 2024-09-12T01:07:27.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6566534852306204231', time=2024-09-12T02:55:55.674846+0000, chain.objs.size()=1 2024-09-12T01:07:27.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.qs0OHFmj8ng6TThLy6Uyzd3CzeYwW5Q_0 2024-09-12T01:07:27.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2001268082678400851', time=2024-09-12T02:55:55.798761+0000, chain.objs.size()=1 2024-09-12T01:07:27.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.z8dkR7bPzGREW5GOzjaXlyeY4mBmugy_0 2024-09-12T01:07:27.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2881470795752338312', time=2024-09-12T02:55:55.834459+0000, chain.objs.size()=1 2024-09-12T01:07:27.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WC2QuiMQo8P7JtdP4V5CEvhPWiAVxq6_0 2024-09-12T01:07:27.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13994107056334872363', time=2024-09-12T02:55:55.851171+0000, chain.objs.size()=1 2024-09-12T01:07:27.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fIPIS326yS9Fc8ICwMEmLZrumLxmKoZ_0 2024-09-12T01:07:27.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16115609484578217268', time=2024-09-12T02:55:55.941858+0000, chain.objs.size()=1 2024-09-12T01:07:27.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.lyn49XQwtAWDk6OrzxVn7-07_UFIAfK_0 2024-09-12T01:07:27.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3721511198019350480', time=2024-09-12T02:55:55.969040+0000, chain.objs.size()=1 2024-09-12T01:07:27.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.yJb2YMrIKbYOfcJIaXks49Enmb2PgxZ_0 2024-09-12T01:07:27.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8216947145652568168', time=2024-09-12T02:55:56.010617+0000, chain.objs.size()=1 2024-09-12T01:07:27.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ymS7raGWCFw10q5UN3pvpdvRAJTgFq4_0 2024-09-12T01:07:27.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14038110878229872477', time=2024-09-12T02:55:56.142899+0000, chain.objs.size()=1 2024-09-12T01:07:27.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PA6do2OqD0lcomaApt9g52QbUkeoAs__0 2024-09-12T01:07:27.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8285188153734193047', time=2024-09-12T02:55:56.160226+0000, chain.objs.size()=1 2024-09-12T01:07:27.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9IXrryE_971oopXF2KGMSTawHxS-PpX_0 2024-09-12T01:07:27.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14303795833215498875', time=2024-09-12T02:55:56.210248+0000, chain.objs.size()=1 2024-09-12T01:07:27.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FZDEzPyEBHKmcec5ybrRizHLdibDKsO_0 2024-09-12T01:07:27.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8754948180538013110', time=2024-09-12T02:55:56.267240+0000, chain.objs.size()=1 2024-09-12T01:07:27.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.29Xwsk0ShkPCRYJVpmN348vB9LBLJtp_0 2024-09-12T01:07:27.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3875634460102505227', time=2024-09-12T02:55:56.278939+0000, chain.objs.size()=1 2024-09-12T01:07:27.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.e43ou-bcJab3HldsVO0doYe0l8McABm_0 2024-09-12T01:07:27.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15267643538613863650', time=2024-09-12T02:55:56.286539+0000, chain.objs.size()=1 2024-09-12T01:07:27.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.spxhwT2BJITqDmRqDuFkLFNVV79M1GY_0 2024-09-12T01:07:27.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7283760624936328454', time=2024-09-12T02:55:56.305735+0000, chain.objs.size()=1 2024-09-12T01:07:27.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-M7Atg1HkL0XpKrto1O9yZ2tlmUbyiP_0 2024-09-12T01:07:27.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5831515580269075031', time=2024-09-12T02:55:56.477856+0000, chain.objs.size()=1 2024-09-12T01:07:27.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.vSAaAcgw66gZHERRN4MOEhtkm7O8-OY_0 2024-09-12T01:07:27.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16936608120587344190', time=2024-09-12T02:55:56.514391+0000, chain.objs.size()=1 2024-09-12T01:07:27.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.428+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WwHs8kH6LwOKXjAOnsjCwfzyl-4VhPr_0 2024-09-12T01:07:27.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5161571685895635350', time=2024-09-12T02:55:56.571072+0000, chain.objs.size()=1 2024-09-12T01:07:27.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3-HmtBhpekweuMTbtKoB68E_nnwdbu9_0 2024-09-12T01:07:27.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11554678140405210056', time=2024-09-12T02:55:56.573359+0000, chain.objs.size()=1 2024-09-12T01:07:27.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QNlSvXN9TFA0ZleT0IjIAk1wPe87twF_0 2024-09-12T01:07:27.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1403755858835828681', time=2024-09-12T02:55:56.628569+0000, chain.objs.size()=1 2024-09-12T01:07:27.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-_sUGqpS3PByAAoc5pTt-xVs7GOy30e_0 2024-09-12T01:07:27.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2801308288947718308', time=2024-09-12T02:55:56.635139+0000, chain.objs.size()=1 2024-09-12T01:07:27.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.QsAZ7JuaCZDfZEgvPRXBM7KhWpoHKih_0 2024-09-12T01:07:27.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7201750050109253957', time=2024-09-12T02:56:23.495660+0000, chain.objs.size()=1 2024-09-12T01:07:27.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.369__shadow_.VGTHYyAKyoX9rI9wQI7Ia7AkaTxvqR0_0 2024-09-12T01:07:27.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1497198605080144564', time=2024-09-12T02:56:24.099629+0000, chain.objs.size()=1 2024-09-12T01:07:27.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.432+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.370__shadow_.3mRIi12x7ZzN9F-pkKXPK0rxU3zERAq_0 2024-09-12T01:07:27.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9338922804191617782', time=2024-09-12T02:56:29.501301+0000, chain.objs.size()=1 2024-09-12T01:07:27.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.377__shadow_.t7rkLRmqR9DqpiMTCjEEZbUK6RQNYeE_0 2024-09-12T01:07:27.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6036340494820493124', time=2024-09-12T02:56:31.018177+0000, chain.objs.size()=1 2024-09-12T01:07:27.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.379__shadow_.0t4U-7ruulOEaFTsfnBTZsUyuLRvVu8_0 2024-09-12T01:07:27.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18348150304961113625', time=2024-09-12T02:56:38.964848+0000, chain.objs.size()=1 2024-09-12T01:07:27.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.390__shadow_.GunNgbseSCrEEEa4AvXF_oAwk3cO_bY_0 2024-09-12T01:07:27.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4362642559853242809', time=2024-09-12T02:57:15.751725+0000, chain.objs.size()=1 2024-09-12T01:07:27.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.442__shadow_.MDzQ8xRuHC_2Fhgfb6A2FOs1TEiRQxG_0 2024-09-12T01:07:27.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14035200961428361286', time=2024-09-12T02:57:32.364696+0000, chain.objs.size()=1 2024-09-12T01:07:27.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.461__shadow_.XX4fnn8qLa_DdPgebPALmdd0yhRKvJ2_0 2024-09-12T01:07:27.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9420299761157484664', time=2024-09-12T02:57:54.629784+0000, chain.objs.size()=1 2024-09-12T01:07:27.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.498__shadow_.KX82js2Dmhc7NvuveHl5ut5EjaalADs_0 2024-09-12T01:07:27.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13913094474360884609', time=2024-09-12T02:58:04.519803+0000, chain.objs.size()=1 2024-09-12T01:07:27.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.512__shadow_.NI3-UfjeZph-FUCP9yW56cwNYtHve9__0 2024-09-12T01:07:27.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13508042039998121960', time=2024-09-12T02:58:26.563345+0000, chain.objs.size()=6 2024-09-12T01:07:27.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~JbtLdMjFmRpsogRY0sQ9XW-Kpvssb8t.1 2024-09-12T01:07:27.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.XAfSZuk9X5_wdpWAhL9geiv7p_8fq2Sd.2 2024-09-12T01:07:27.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.436+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~JbtLdMjFmRpsogRY0sQ9XW-Kpvssb8t.3 2024-09-12T01:07:27.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~JbtLdMjFmRpsogRY0sQ9XW-Kpvssb8t.4 2024-09-12T01:07:27.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~JbtLdMjFmRpsogRY0sQ9XW-Kpvssb8t.5 2024-09-12T01:07:27.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~JbtLdMjFmRpsogRY0sQ9XW-Kpvssb8t.6 2024-09-12T01:07:27.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2904699210781119533', time=2024-09-12T02:58:36.987659+0000, chain.objs.size()=1 2024-09-12T01:07:27.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.523__multipart_mymultipart.2~3Q9coAW6UTjvGT9q5e3xGcaKNE2URrm.1 2024-09-12T01:07:27.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3580429046905432350', time=2024-09-12T02:59:31.097458+0000, chain.objs.size()=1 2024-09-12T01:07:27.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.551__shadow_.KgOB334GZnUOOJZ9cT9ERH8b3cZn-iG_0 2024-09-12T01:07:27.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12853592462326539706', time=2024-09-12T02:59:56.569839+0000, chain.objs.size()=1 2024-09-12T01:07:27.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569__shadow:.kHP4mTjlhKhqdNO5ykN1AnaRZ.BxDo_.lZ6ZTL1qzslorb_XS4Tz5CPZCdj0h45_0 2024-09-12T01:07:27.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6010146117523361512', time=2024-09-12T03:04:22.470785+0000, chain.objs.size()=1 2024-09-12T01:07:27.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.440+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.712__shadow:NwA-dZu9bbSGScnvFrLkJ7gk.vJnamT_.Mb_9EI5pCMptnznZeiq7ufhshX8uXTF_0 2024-09-12T01:07:27.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.444+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:07:27.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48773' 2024-09-12T01:07:27.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6250342597938311893', time=2024-09-12T02:51:37.588715+0000, chain.objs.size()=1 2024-09-12T01:07:27.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.166__shadow_.DkTFPWxUvqCH0Qn4cIKLEJR07gNMJGI_0 2024-09-12T01:07:27.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5188136262205857820', time=2024-09-12T02:53:42.668329+0000, chain.objs.size()=1 2024-09-12T01:07:27.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.236__shadow_.VQoEW4hdIG4W5Q_kuq1eYK36g9yLIA5_0 2024-09-12T01:07:27.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10633717185148606190', time=2024-09-12T02:53:50.082419+0000, chain.objs.size()=1 2024-09-12T01:07:27.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.244__shadow_.wA-jQKTwwA8YdzXzzrV0ns5Y8I1YWeD_0 2024-09-12T01:07:27.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11365497360777269288', time=2024-09-12T02:53:52.881205+0000, chain.objs.size()=1 2024-09-12T01:07:27.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.248__shadow_.LAxNvnvBK8v2wMueYOdt6tjvp2RSCTl_0 2024-09-12T01:07:27.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12293507780478827865', time=2024-09-12T02:53:54.960247+0000, chain.objs.size()=1 2024-09-12T01:07:27.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.251__shadow_.9RHJ5vJjFSQ5QJ3Inxts5P9ybMULJ3Y_0 2024-09-12T01:07:27.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10668016924945993948', time=2024-09-12T02:54:01.265481+0000, chain.objs.size()=1 2024-09-12T01:07:27.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.260__shadow_.4FU25FaYipPUSdYKFElyNdsDzfUHvQd_0 2024-09-12T01:07:27.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10051251494098434605', time=2024-09-12T02:54:23.051504+0000, chain.objs.size()=1 2024-09-12T01:07:27.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.65YJJgoekR3NThH0gCeARQGBWPY2wyj_0 2024-09-12T01:07:27.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1733876700210214834', time=2024-09-12T02:54:23.202783+0000, chain.objs.size()=1 2024-09-12T01:07:27.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FOmAaxkduJ_NGcqP_pV-34y2jDxnwzY_0 2024-09-12T01:07:27.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7813741175129421622', time=2024-09-12T02:54:23.419599+0000, chain.objs.size()=1 2024-09-12T01:07:27.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8avdqJw4U515Ca_VWEyzIVivMZ27HSd_0 2024-09-12T01:07:27.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10571726640345841971', time=2024-09-12T02:54:23.466997+0000, chain.objs.size()=1 2024-09-12T01:07:27.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zn-vRFrZvVLedSvWU4xTSthvh_H0gSK_0 2024-09-12T01:07:27.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.736476275932074681', time=2024-09-12T02:54:23.596523+0000, chain.objs.size()=1 2024-09-12T01:07:27.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mPyGqnu3xOAKIhdX8dL96mgxrm8RSeG_0 2024-09-12T01:07:27.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2014047703254961117', time=2024-09-12T02:54:23.613096+0000, chain.objs.size()=1 2024-09-12T01:07:27.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.448+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.KBKdzSNqLj_HArO_aoeOPVIe4Lfms8s_0 2024-09-12T01:07:27.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3010868669633318315', time=2024-09-12T02:54:23.759648+0000, chain.objs.size()=1 2024-09-12T01:07:27.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.bbv8iFg5dGFxM-XHOxQIRh44AOWrO1N_0 2024-09-12T01:07:27.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13387302484214073779', time=2024-09-12T02:54:24.010838+0000, chain.objs.size()=1 2024-09-12T01:07:27.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5AGN0hneKzElKp7KJM8jmmn7Hmpdst__0 2024-09-12T01:07:27.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16899879482614946323', time=2024-09-12T02:54:24.126689+0000, chain.objs.size()=1 2024-09-12T01:07:27.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.siXrIwSbr4qiWRsZaK2rDCbDKNtGl8-_0 2024-09-12T01:07:27.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9988137198816055963', time=2024-09-12T02:54:24.320018+0000, chain.objs.size()=1 2024-09-12T01:07:27.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.T-so1faj_EKKPhv7koL-tfxeHAutnoC_0 2024-09-12T01:07:27.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14235014252024793512', time=2024-09-12T02:54:24.331187+0000, chain.objs.size()=1 2024-09-12T01:07:27.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5XBOb-q2wj7QnoKx3HY5TWADu2hik7J_0 2024-09-12T01:07:27.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7944538710348251100', time=2024-09-12T02:54:24.350758+0000, chain.objs.size()=1 2024-09-12T01:07:27.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MThVbo8YJ7gq600TKtbW2Mif-9yhU1B_0 2024-09-12T01:07:27.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7836687440811185438', time=2024-09-12T02:54:24.353540+0000, chain.objs.size()=1 2024-09-12T01:07:27.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.-npyvaIFN9_2TdHzrgzNhlqJIVaRLsh_0 2024-09-12T01:07:27.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9522773519907383225', time=2024-09-12T02:54:24.384633+0000, chain.objs.size()=1 2024-09-12T01:07:27.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VTG61IJM_pti1SHrAAkFML6QR5GUnCO_0 2024-09-12T01:07:27.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5169540037866990096', time=2024-09-12T02:54:24.484569+0000, chain.objs.size()=1 2024-09-12T01:07:27.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mouikdB5fPjxyN7s-MNpC7HOO_woBxw_0 2024-09-12T01:07:27.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1489822742041304771', time=2024-09-12T02:54:24.820415+0000, chain.objs.size()=1 2024-09-12T01:07:27.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.HZbNq8JX6ro_UAQ-vrUpMNrdnMpu8zr_0 2024-09-12T01:07:27.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4480808770139310742', time=2024-09-12T02:54:24.857821+0000, chain.objs.size()=1 2024-09-12T01:07:27.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5Xd8IIO-XrbEkA9QoNU5k2NxyBKZyGJ_0 2024-09-12T01:07:27.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3031333069041398777', time=2024-09-12T02:54:24.905767+0000, chain.objs.size()=1 2024-09-12T01:07:27.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.452+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.isKvwInCqZYhH5UN-k2i0sNCJTbLyvR_0 2024-09-12T01:07:27.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3249003659135794157', time=2024-09-12T02:54:24.918646+0000, chain.objs.size()=1 2024-09-12T01:07:27.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3y2aw9cdsWFUN9fnHoE8rLx9xEu3Jq2_0 2024-09-12T01:07:27.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507293481373538705', time=2024-09-12T02:54:24.923360+0000, chain.objs.size()=1 2024-09-12T01:07:27.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.crBc4CXKKPqvTnbrA3L79pBUQNNRC-c_0 2024-09-12T01:07:27.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3185108133253570039', time=2024-09-12T02:54:24.961968+0000, chain.objs.size()=1 2024-09-12T01:07:27.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zDqYTwISS1NC53aVivg-caixy5Papd5_0 2024-09-12T01:07:27.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7611606140188099434', time=2024-09-12T02:54:24.981755+0000, chain.objs.size()=1 2024-09-12T01:07:27.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6ziENK5K0ZnUmC_0V8X6oorrnRuENR__0 2024-09-12T01:07:27.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2230624515533564595', time=2024-09-12T02:54:25.177803+0000, chain.objs.size()=1 2024-09-12T01:07:27.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.N6-JcO7DghCaF36oNtfL40C3FVHS4oS_0 2024-09-12T01:07:27.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5669066897019227516', time=2024-09-12T02:54:25.186713+0000, chain.objs.size()=1 2024-09-12T01:07:27.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Ib0VUb7jshwA9MvDcoupLfCNIvT7mYq_0 2024-09-12T01:07:27.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1055179946179866847', time=2024-09-12T02:54:25.221050+0000, chain.objs.size()=1 2024-09-12T01:07:27.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ZEHVghxO0DankOk72cZmT84bKorGyMC_0 2024-09-12T01:07:27.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3047297269579908481', time=2024-09-12T02:54:25.346863+0000, chain.objs.size()=1 2024-09-12T01:07:27.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.OluCIV3z5nQ6ppVEADNqs32_IVuXtvW_0 2024-09-12T01:07:27.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17522735834637728856', time=2024-09-12T02:54:25.354338+0000, chain.objs.size()=1 2024-09-12T01:07:27.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CUKTwj1aL0y2UcAD3o_bkS5poTQnow4_0 2024-09-12T01:07:27.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15111547571876980002', time=2024-09-12T02:54:25.530439+0000, chain.objs.size()=1 2024-09-12T01:07:27.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.yA3k6BAJMBtkmmGv9XqxeOrNKesXIQd_0 2024-09-12T01:07:27.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7254910841853906558', time=2024-09-12T02:54:25.571447+0000, chain.objs.size()=1 2024-09-12T01:07:27.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.kF-SjirEgU36asv0HMVZp2YRkh3BVeE_0 2024-09-12T01:07:27.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9075529431907002154', time=2024-09-12T02:54:25.601678+0000, chain.objs.size()=1 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.460+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ONDY7PF0CQGt7c7rRkQK9W0KySJrImm_0 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17236101578936701890', time=2024-09-12T02:54:25.650763+0000, chain.objs.size()=1 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.frVsk1CuMgCsfDo3kgbj4GNL9HPMtGM_0 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10684194932777121591', time=2024-09-12T02:54:25.691353+0000, chain.objs.size()=1 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Y0lkUM2OSdqmN0scCp8Ghp0DwFW9zls_0 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6514899387183409306', time=2024-09-12T02:54:25.880032+0000, chain.objs.size()=1 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JcnK1cVvvkf___0a1HO0ej-G1Ynd0vI_0 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15544438578603772782', time=2024-09-12T02:54:25.946182+0000, chain.objs.size()=1 2024-09-12T01:07:27.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mslv6_XXBOHDauiFQ1fO1a9njuT1j5o_0 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14637744871175134443', time=2024-09-12T02:54:29.993309+0000, chain.objs.size()=1 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.268__shadow_.E-hVcaVKGXOj1OpyhE3s_ube488IT72_0 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3584481876333100083', time=2024-09-12T02:54:32.068527+0000, chain.objs.size()=1 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.271__shadow_.hvnOoJ37zGt5zsfqNFzEKcHuvNWdpMw_0 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2778942673028472056', time=2024-09-12T02:54:38.328470+0000, chain.objs.size()=1 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.280__shadow_.edfVcvX3dwah3PkdCPTsXoWxFGYb2PX_0 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5629610967831358837', time=2024-09-12T02:54:42.619695+0000, chain.objs.size()=1 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.286__shadow_.llUr34vYvVSevxuE8cFGNfTXaiEoQYp_0 2024-09-12T01:07:27.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17563201707518688417', time=2024-09-12T02:54:43.310475+0000, chain.objs.size()=1 2024-09-12T01:07:27.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.287__shadow_.wzgqFrRcrWd5SkiYc-G773PrmOCWIJb_0 2024-09-12T01:07:27.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7905391714133066448', time=2024-09-12T02:54:49.339729+0000, chain.objs.size()=1 2024-09-12T01:07:27.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.ndlWo1W2sao5yzNRB9_MWtxmkHPLql1_0 2024-09-12T01:07:27.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7417509420635373473', time=2024-09-12T02:54:49.348542+0000, chain.objs.size()=1 2024-09-12T01:07:27.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.464+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.293__shadow_.Pj3y1KPw0NrKs5lDk-jr15aapIJIw9E_0 2024-09-12T01:07:27.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7429788394431292237', time=2024-09-12T02:54:50.773441+0000, chain.objs.size()=1 2024-09-12T01:07:27.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.295__shadow_.QQMkOaKf4sg9iD4qcm-GNRIoxAT3rTj_0 2024-09-12T01:07:27.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3531545083918215359', time=2024-09-12T02:54:57.160751+0000, chain.objs.size()=1 2024-09-12T01:07:27.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.304__shadow_.8uLT1IAVRakcm2l8Ihrrwtl8f68rDGc_0 2024-09-12T01:07:27.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4105095240004680241', time=2024-09-12T02:55:30.858915+0000, chain.objs.size()=1 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.51KJdpemrPW0_XoNZLRyWA8t0UmieFf_0 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14838408597721010523', time=2024-09-12T02:55:30.888694+0000, chain.objs.size()=1 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6bZrHdvFSfeDdSt-vakWVecr8st7ZkZ_0 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.949909579194875540', time=2024-09-12T02:55:30.965703+0000, chain.objs.size()=1 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.xwECTFz1uF2YIQdLCgsfc8BGzjHcQEU_0 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10302511216090269625', time=2024-09-12T02:55:30.994862+0000, chain.objs.size()=1 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0JYGXQD0_Uo86FY5ZKnL8oMYsceQdc2_0 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17907680567270170695', time=2024-09-12T02:55:31.018877+0000, chain.objs.size()=1 2024-09-12T01:07:27.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WN1XOQlq3QjED8CboHSdOWZ2zV98iuF_0 2024-09-12T01:07:27.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10723053697923989136', time=2024-09-12T02:55:31.030988+0000, chain.objs.size()=1 2024-09-12T01:07:27.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.kmXI4NoQe3jJQta0PZN1M5S7hUVkRLL_0 2024-09-12T01:07:27.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13208271891247864769', time=2024-09-12T02:55:31.077074+0000, chain.objs.size()=1 2024-09-12T01:07:27.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7RuH1hFw05vi9a00u728VryoEvSeBCQ_0 2024-09-12T01:07:27.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8591863646026503666', time=2024-09-12T02:55:31.248847+0000, chain.objs.size()=1 2024-09-12T01:07:27.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.F8bfyVYuWp4g10uiFLJ5pKFcHg4wo0t_0 2024-09-12T01:07:27.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17191936037372588158', time=2024-09-12T02:55:31.414570+0000, chain.objs.size()=1 2024-09-12T01:07:27.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.468+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.f6aGdUhIDRLanq9P_9IEOzFvHr6-YYL_0 2024-09-12T01:07:27.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11070370782321842847', time=2024-09-12T02:55:31.557662+0000, chain.objs.size()=1 2024-09-12T01:07:27.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ocd7nrCoaY4_4-bhqgnXp_V6b3DXYwD_0 2024-09-12T01:07:27.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15067880896815615429', time=2024-09-12T02:55:31.565819+0000, chain.objs.size()=1 2024-09-12T01:07:27.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.30QjDYUdYEv8UN3wuxBpJBqslxtrgmN_0 2024-09-12T01:07:27.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13185069924834662696', time=2024-09-12T02:55:31.641750+0000, chain.objs.size()=1 2024-09-12T01:07:27.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.p5gt5n0V13dvSO4x0QzcXjdess7ehlF_0 2024-09-12T01:07:27.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.472+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7195561602348458225', time=2024-09-12T02:55:31.695959+0000, chain.objs.size()=1 2024-09-12T01:07:27.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.472+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.gYeqmoRgxjPcKuW3c0j8zAqWCgOyjAF_0 2024-09-12T01:07:27.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13342499946770539863', time=2024-09-12T02:55:31.735591+0000, chain.objs.size()=1 2024-09-12T01:07:27.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IgSD4lgfxmr6XrgHpFFlcBAIE3Yj1PG_0 2024-09-12T01:07:27.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6030420267718793445', time=2024-09-12T02:55:31.959296+0000, chain.objs.size()=1 2024-09-12T01:07:27.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.V63SMWG5wdPfPU3DeinjiwmaBrWNU69_0 2024-09-12T01:07:27.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4365848662064749019', time=2024-09-12T02:55:31.976025+0000, chain.objs.size()=1 2024-09-12T01:07:27.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._wevMyQn8V0CzQUV1LhZyuoTLGbZT56_0 2024-09-12T01:07:27.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18324312777198793972', time=2024-09-12T02:55:31.978021+0000, chain.objs.size()=1 2024-09-12T01:07:27.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ENv81LLvEWRkehR61TTYRD9eD7I-L8f_0 2024-09-12T01:07:27.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5350984290344977921', time=2024-09-12T02:55:32.042662+0000, chain.objs.size()=1 2024-09-12T01:07:27.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.oheHEkutJEMu6lCbGO51fCL0ye4MaYW_0 2024-09-12T01:07:27.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12941993038569426250', time=2024-09-12T02:55:32.265428+0000, chain.objs.size()=1 2024-09-12T01:07:27.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1gGV7dW_OaJmwVqYxtfAjhcza96cO1V_0 2024-09-12T01:07:27.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4373754186762833991', time=2024-09-12T02:55:32.416415+0000, chain.objs.size()=1 2024-09-12T01:07:27.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.o4-KpqJPvmOesX7Sg4Xu9z2a_TyCUWj_0 2024-09-12T01:07:27.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4767745269349110641', time=2024-09-12T02:55:32.550902+0000, chain.objs.size()=1 2024-09-12T01:07:27.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.J-CrTqK7hykPNjJvWv0IJ-S5KrDKrcx_0 2024-09-12T01:07:27.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17647973851963464512', time=2024-09-12T02:55:32.560507+0000, chain.objs.size()=1 2024-09-12T01:07:27.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YQmXdCfA9rudun8Pzb5q0N6gRdDU6Zi_0 2024-09-12T01:07:27.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.476+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1920970455145261281', time=2024-09-12T02:55:32.622276+0000, chain.objs.size()=1 2024-09-12T01:07:27.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6rzUuN6knH5CUtT871iXTmAtJh7ijlM_0 2024-09-12T01:07:27.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.229868263818164470', time=2024-09-12T02:55:32.630912+0000, chain.objs.size()=1 2024-09-12T01:07:27.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.qsfTHJ8G0Xzz0Ujft-tYcJJyQUssL15_0 2024-09-12T01:07:27.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4089316843352881356', time=2024-09-12T02:55:32.706952+0000, chain.objs.size()=1 2024-09-12T01:07:27.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.h6lx13i9AtwgVp451Au3BOhPlEI4QOI_0 2024-09-12T01:07:27.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8734214186070563481', time=2024-09-12T02:55:32.987249+0000, chain.objs.size()=1 2024-09-12T01:07:27.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.DgM5EiPv710Cr6TZsO21w72zh3qQfkP_0 2024-09-12T01:07:27.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12967837622402737798', time=2024-09-12T02:55:33.046342+0000, chain.objs.size()=1 2024-09-12T01:07:27.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OkjdOxzlblhwdV7pjaVLntfclsCFQ22_0 2024-09-12T01:07:27.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4191374221092413682', time=2024-09-12T02:55:33.047153+0000, chain.objs.size()=1 2024-09-12T01:07:27.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.z9n1Wa63jvEexJMeJUq-GziEo9k2wPZ_0 2024-09-12T01:07:27.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16150246689039307611', time=2024-09-12T02:55:33.058563+0000, chain.objs.size()=1 2024-09-12T01:07:27.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QlbcbVojkHZMLWcjCYKPyyzdbu6uX4__0 2024-09-12T01:07:27.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18270886200060575826', time=2024-09-12T02:55:33.063670+0000, chain.objs.size()=1 2024-09-12T01:07:27.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7AGdOOIvTeVpZiQ2y9fKz7i-kPFKA8i_0 2024-09-12T01:07:27.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3102173508309023301', time=2024-09-12T02:55:33.064412+0000, chain.objs.size()=1 2024-09-12T01:07:27.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._FjvWxEoYc2nlk2LzgqMW2UdKLrcYTm_0 2024-09-12T01:07:27.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1432058207545256370', time=2024-09-12T02:55:33.181437+0000, chain.objs.size()=1 2024-09-12T01:07:27.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.W8ZWuuz63znBAoAcshoK8MMHkXIvj75_0 2024-09-12T01:07:27.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10749528858757850045', time=2024-09-12T02:55:33.197649+0000, chain.objs.size()=1 2024-09-12T01:07:27.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.480+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WNGihmZnxdzvm6ENfGlh9Mxgj8pr910_0 2024-09-12T01:07:27.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4724955334970255525', time=2024-09-12T02:55:33.291706+0000, chain.objs.size()=1 2024-09-12T01:07:27.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7rF0Bua1ksD2j9d--9q8_2TlpeWMcIr_0 2024-09-12T01:07:27.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7068575674273895543', time=2024-09-12T02:55:33.302439+0000, chain.objs.size()=1 2024-09-12T01:07:27.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YoWz3hoH3eVZBkY80HYw16UF23q4ftc_0 2024-09-12T01:07:27.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13375874221247656853', time=2024-09-12T02:55:33.313244+0000, chain.objs.size()=1 2024-09-12T01:07:27.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hIEq1EL0Ob4D-x3_rj3umudx1XIkMlo_0 2024-09-12T01:07:27.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7011218784756353767', time=2024-09-12T02:55:33.341738+0000, chain.objs.size()=1 2024-09-12T01:07:27.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_._fheyuidanmr_SQV-K8IjpDO8f4l-pK_0 2024-09-12T01:07:27.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12220254051069485636', time=2024-09-12T02:55:54.436668+0000, chain.objs.size()=1 2024-09-12T01:07:27.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.R0HPa8qjoU_QSye0TalBn5GK1z60biT_0 2024-09-12T01:07:27.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14907774264674958250', time=2024-09-12T02:55:54.498071+0000, chain.objs.size()=1 2024-09-12T01:07:27.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IBq7axJl6uvc05vQdRmnlo8ooU-yNhA_0 2024-09-12T01:07:27.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17693763786492833263', time=2024-09-12T02:55:54.531494+0000, chain.objs.size()=1 2024-09-12T01:07:27.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5s7lYTebzfufjQVD33M9VgZ5kezvwqT_0 2024-09-12T01:07:27.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11918386848799252226', time=2024-09-12T02:55:54.538741+0000, chain.objs.size()=1 2024-09-12T01:07:27.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.oQ3ScsaFdfcc2uPurVK4mnoxjKLTuk5_0 2024-09-12T01:07:27.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18349430511586248169', time=2024-09-12T02:55:54.559693+0000, chain.objs.size()=1 2024-09-12T01:07:27.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.iu83b8ZmDiZwzcLs_56bOnXlsecjUjP_0 2024-09-12T01:07:27.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14122213356870836899', time=2024-09-12T02:55:54.586559+0000, chain.objs.size()=1 2024-09-12T01:07:27.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.484+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fJ7i9izG_jA_FkLShr7oAJs4Gxg2Rhv_0 2024-09-12T01:07:27.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1073436204017021047', time=2024-09-12T02:55:54.659951+0000, chain.objs.size()=1 2024-09-12T01:07:27.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.h4p1hRiA3STC07GZl24P5nSK_YGDpwN_0 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7118635829701806023', time=2024-09-12T02:55:54.861100+0000, chain.objs.size()=1 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dcoNGBkVxeT9EIDYx-lNvIaugjkG7Ro_0 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7978298952934302133', time=2024-09-12T02:55:54.914723+0000, chain.objs.size()=1 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3XsUb6nf3kOuo5mrNzwVjuG2cxwlUWK_0 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.708122629879326181', time=2024-09-12T02:55:55.012224+0000, chain.objs.size()=1 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.G_zUOYtq4-0NaWu7KpGEy1YIDMkiT-7_0 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5462368515957514105', time=2024-09-12T02:55:55.249067+0000, chain.objs.size()=1 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.RYVki6y20nzh2cf32-JZ-EQAr82uv9m_0 2024-09-12T01:07:27.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5794872945394835714', time=2024-09-12T02:55:55.282815+0000, chain.objs.size()=1 2024-09-12T01:07:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IZyn0Heossra2aid3-RqbLM8y-c4NOG_0 2024-09-12T01:07:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9293901097146851592', time=2024-09-12T02:55:55.616559+0000, chain.objs.size()=1 2024-09-12T01:07:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Ceaz97J6qNkQ1DS-ZrEuARTwJREebm0_0 2024-09-12T01:07:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17226125378466688092', time=2024-09-12T02:55:55.858042+0000, chain.objs.size()=1 2024-09-12T01:07:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.488+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Tv3BEQetNESMUKgHn_uBhs3j0r4THGQ_0 2024-09-12T01:07:27.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.492+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48773 2024-09-12T01:07:27.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T01:07:27.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3180410364342323281', time=2024-09-12T02:55:55.878622+0000, chain.objs.size()=1 2024-09-12T01:07:27.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1liwH2g7SB-DfqoRNWXy8crjEN8XUDg_0 2024-09-12T01:07:27.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5441934318995804635', time=2024-09-12T02:55:55.979253+0000, chain.objs.size()=1 2024-09-12T01:07:27.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xU5lKTXYEys_cM0TVIsaRvW0ZvgsHuv_0 2024-09-12T01:07:27.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13478849807903429260', time=2024-09-12T02:55:56.215725+0000, chain.objs.size()=1 2024-09-12T01:07:27.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dV-ZPAPxeDYciS2h52Qu-DRi4M8GnrE_0 2024-09-12T01:07:27.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7828733824987939178', time=2024-09-12T02:55:56.339321+0000, chain.objs.size()=1 2024-09-12T01:07:27.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.aAnuXAyqKkHt8JPQJvnBQY7H7GPBZXE_0 2024-09-12T01:07:27.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1057335388089676489', time=2024-09-12T02:55:56.552486+0000, chain.objs.size()=1 2024-09-12T01:07:27.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.uGxA5n4TZqcK5fpT1fVhcgiP56Z1YIn_0 2024-09-12T01:07:27.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11202947865266156141', time=2024-09-12T02:55:56.594471+0000, chain.objs.size()=1 2024-09-12T01:07:27.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.3PWdd9objV-_r5o3b4mDH2ZhAV9Jb8V_0 2024-09-12T01:07:27.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15971506556246902728', time=2024-09-12T02:55:56.650204+0000, chain.objs.size()=1 2024-09-12T01:07:27.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ZQ7Xqx8HyWWRGC-ImgJi6RxLBpQ6FPZ_0 2024-09-12T01:07:27.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13940150527624831077', time=2024-09-12T02:55:56.673603+0000, chain.objs.size()=1 2024-09-12T01:07:27.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.B6iO4-85GQSfSJ-2dZczUhto_4W7wZV_0 2024-09-12T01:07:27.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8772395910897063751', time=2024-09-12T02:55:56.785234+0000, chain.objs.size()=1 2024-09-12T01:07:27.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YtxlOeqpHDIW9YHCF6Qz-GPoW58lO4r_0 2024-09-12T01:07:27.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16103611429611573146', time=2024-09-12T02:55:56.828428+0000, chain.objs.size()=1 2024-09-12T01:07:27.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.EDDGv4s6m75qV5BUeoLxTfkc_vLEBMv_0 2024-09-12T01:07:27.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12764386075193622648', time=2024-09-12T02:55:56.915721+0000, chain.objs.size()=1 2024-09-12T01:07:27.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sB8ZzPKB570gZVTBKL8zfCOdg_TnAYG_0 2024-09-12T01:07:27.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15758067403192851091', time=2024-09-12T02:55:59.904488+0000, chain.objs.size()=1 2024-09-12T01:07:27.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.329__shadow_.r_kLmWcjvN3HbgH2YShtunXBRRRWJas_0 2024-09-12T01:07:27.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18004343885584028296', time=2024-09-12T02:56:07.487705+0000, chain.objs.size()=1 2024-09-12T01:07:27.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.341__shadow_.CDG3zlF5m67szBXJ3ymJSM9YAYGbwzv_0 2024-09-12T01:07:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RRsFKDa9DErjuiG1o1MOWvi8sKTpPkv', time=2024-09-12T02:58:30.094937+0000, chain.objs.size()=1 2024-09-12T01:07:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.496+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~RRsFKDa9DErjuiG1o1MOWvi8sKTpPkv.2 2024-09-12T01:07:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RRsFKDa9DErjuiG1o1MOWvi8sKTpPkv', time=2024-09-12T02:58:30.098765+0000, chain.objs.size()=1 2024-09-12T01:07:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~RRsFKDa9DErjuiG1o1MOWvi8sKTpPkv.3 2024-09-12T01:07:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM', time=2024-09-12T02:58:33.690511+0000, chain.objs.size()=1 2024-09-12T01:07:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM.1 2024-09-12T01:07:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM', time=2024-09-12T02:58:33.693844+0000, chain.objs.size()=1 2024-09-12T01:07:27.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM.2 2024-09-12T01:07:27.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM', time=2024-09-12T02:58:33.696965+0000, chain.objs.size()=1 2024-09-12T01:07:27.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM.3 2024-09-12T01:07:27.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM', time=2024-09-12T02:58:33.700040+0000, chain.objs.size()=1 2024-09-12T01:07:27.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM.4 2024-09-12T01:07:27.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM', time=2024-09-12T02:58:33.703266+0000, chain.objs.size()=1 2024-09-12T01:07:27.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM.5 2024-09-12T01:07:27.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM', time=2024-09-12T02:58:33.706739+0000, chain.objs.size()=1 2024-09-12T01:07:27.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~zkcqoYf1tZB_Td5dJP4qFZvn2gdC5YM.6 2024-09-12T01:07:27.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14763334756450127761', time=2024-09-12T02:58:36.055624+0000, chain.objs.size()=6 2024-09-12T01:07:27.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.bqHUdaFiu2KZxIFGfs6jQ81xMa_cPLAk.1 2024-09-12T01:07:27.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.PZ8SFUxkifbTpF5c4M_H-alynpiptA_J.2 2024-09-12T01:07:27.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.mdTP7_jsnjn7G1W642iZEgc6-bcnWvu2.3 2024-09-12T01:07:27.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.500+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.Xi_Q19lf-9-pj6GRhlots0CSw6J1XP5O.4 2024-09-12T01:07:27.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.b6bMpCWca2m3Fv1WXGEOL9vrMrNRVord.5 2024-09-12T01:07:27.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.bTtw9NaSkc2TJHWs6vfCZBn6qm3Jljc4.6 2024-09-12T01:07:27.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5530654604368665166', time=2024-09-12T02:59:34.529033+0000, chain.objs.size()=1 2024-09-12T01:07:27.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.554__shadow_.ZV9l6oNMUVB_DADo4b3aBZmxR0gbZ1F_0 2024-09-12T01:07:27.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5635860213477479452', time=2024-09-12T03:00:17.938536+0000, chain.objs.size()=1 2024-09-12T01:07:27.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:dRnx6RIW0EG2dcL7csplxkS-cYIJ7xr_.-wm2DrDE0oOeVQnBETup1L718jiyyk__0 2024-09-12T01:07:27.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15089988651617950900', time=2024-09-12T03:00:35.185209+0000, chain.objs.size()=1 2024-09-12T01:07:27.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:AvDiczFkaAWeNPBpiSAuFrMxMXawIuI_.YxbCzt4_7eLQBOMonbmOAnWjrlVTkjh_0 2024-09-12T01:07:27.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14750187449435989841', time=2024-09-12T03:00:40.754805+0000, chain.objs.size()=1 2024-09-12T01:07:27.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.585__shadow:SNIjGaKYzeYx-V9VQeY6hliYIi.7Oxg_.5gDaYIgAtv-GIdFlI_GOGCfM0dRzw6Y_0 2024-09-12T01:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15592432009660587956', time=2024-09-12T03:01:10.483557+0000, chain.objs.size()=1 2024-09-12T01:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.616__shadow_.tpDqzIgWxX3Y4yC8v7pOoFszop2YQmB_0 2024-09-12T01:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13408463642291664156', time=2024-09-12T03:03:30.291382+0000, chain.objs.size()=1 2024-09-12T01:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.637__shadow_.tFzx0PgtViwcenuimhYhm_Bek0L5H8k_0 2024-09-12T01:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16312184819088923935', time=2024-09-12T03:03:55.617349+0000, chain.objs.size()=1 2024-09-12T01:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.504+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.668__shadow_.FGVPTQFyuHKidk_o4LkeB5_mgJL9Myf_0 2024-09-12T01:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16078488618533064863', time=2024-09-12T03:04:11.159571+0000, chain.objs.size()=1 2024-09-12T01:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.695__shadow_.2I-VeuUTS2XJoFoBhSaf-mPVESUp3pM_0 2024-09-12T01:07:27.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.508+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15005409206683840207', time=2024-09-12T03:04:17.191364+0000, chain.objs.size()=1 2024-09-12T01:07:27.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.704__shadow:u4Td6BhxkgThieg7IYJDn6Pm3oqR-fQ_.rbWyCGcSCn3gf6QS1qcG0niKCZh1BsN_0 2024-09-12T01:07:27.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.508+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:07:27.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.512+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44075' 2024-09-12T01:07:27.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.192391288510376534', time=2024-09-12T02:51:34.740234+0000, chain.objs.size()=5 2024-09-12T01:07:27.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-FROZEN.2~3Fs7Jm1BWL1IONXqtaudAkLr2z5nAEt.1 2024-09-12T01:07:27.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_foo-FROZEN.2~3Fs7Jm1BWL1IONXqtaudAkLr2z5nAEt.1_1 2024-09-12T01:07:27.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-FROZEN.2~3Fs7Jm1BWL1IONXqtaudAkLr2z5nAEt.2 2024-09-12T01:07:27.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__shadow_foo-FROZEN.2~3Fs7Jm1BWL1IONXqtaudAkLr2z5nAEt.2_1 2024-09-12T01:07:27.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.161__multipart_foo-FROZEN.2~3Fs7Jm1BWL1IONXqtaudAkLr2z5nAEt.3 2024-09-12T01:07:27.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12046861617462976114', time=2024-09-12T02:53:48.909618+0000, chain.objs.size()=1 2024-09-12T01:07:27.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.243__shadow_.e1vUifhyZlKfhd0lmW4fZPpx3hBRjtl_0 2024-09-12T01:07:27.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16390763507801864708', time=2024-09-12T02:53:52.881825+0000, chain.objs.size()=1 2024-09-12T01:07:27.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.248__shadow_.dPEgzfK9VftS3l9pg6MEbHQb9pLle66_0 2024-09-12T01:07:27.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5621619594655147931', time=2024-09-12T02:53:58.498507+0000, chain.objs.size()=1 2024-09-12T01:07:27.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.256__shadow_.bFYt1DjUJTieqmEyN7EzJkUQPNg0c8q_0 2024-09-12T01:07:27.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1872213695052393645', time=2024-09-12T02:54:23.023226+0000, chain.objs.size()=1 2024-09-12T01:07:27.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qSML5nBTihqLo2fUaHH4R2v94Tr7FjH_0 2024-09-12T01:07:27.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1307178764812659483', time=2024-09-12T02:54:23.043821+0000, chain.objs.size()=1 2024-09-12T01:07:27.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.KM6GArHzJdoTSejWRBck2yciAbBHfOO_0 2024-09-12T01:07:27.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11719232576699385699', time=2024-09-12T02:54:23.103156+0000, chain.objs.size()=1 2024-09-12T01:07:27.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.0duiXKm_azIxPaQIZpBqABK0PtKOcq-_0 2024-09-12T01:07:27.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2714353523827399403', time=2024-09-12T02:54:23.150422+0000, chain.objs.size()=1 2024-09-12T01:07:27.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.516+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.vniluux1CG4MGemj6jh5NMQlqRPXx1H_0 2024-09-12T01:07:27.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14751787345863560683', time=2024-09-12T02:54:23.395204+0000, chain.objs.size()=1 2024-09-12T01:07:27.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MiPf3nXrY21J3vo_0LKPELNGJK--uHK_0 2024-09-12T01:07:27.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7000046428681452198', time=2024-09-12T02:54:23.444604+0000, chain.objs.size()=1 2024-09-12T01:07:27.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CkkmnGScdN7xzMYRD9Qf-MsfND0jGDI_0 2024-09-12T01:07:27.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7208607031941105825', time=2024-09-12T02:54:23.480527+0000, chain.objs.size()=1 2024-09-12T01:07:27.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.lkWDJZPt9uDb8TZv6PLXAfeiSE5x4od_0 2024-09-12T01:07:27.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8523921518467925515', time=2024-09-12T02:54:23.497425+0000, chain.objs.size()=1 2024-09-12T01:07:27.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.W0NMLEUnnKT5Ay8IKrzhEr0Vw1G9yh4_0 2024-09-12T01:07:27.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8328172028878975399', time=2024-09-12T02:54:23.588633+0000, chain.objs.size()=1 2024-09-12T01:07:27.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.G2aTXVctG66C4Loa1-AXFYjxLcUAlWM_0 2024-09-12T01:07:27.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.856205522947938164', time=2024-09-12T02:54:23.605236+0000, chain.objs.size()=1 2024-09-12T01:07:27.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.71aix-ZM30XH4CHeKeMiTSzF01TX_MG_0 2024-09-12T01:07:27.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6873737549517241797', time=2024-09-12T02:54:23.749210+0000, chain.objs.size()=1 2024-09-12T01:07:27.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.QVXMDLa5HDbV0Edez07Zcz7e7RuDxjp_0 2024-09-12T01:07:27.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5966507411507913617', time=2024-09-12T02:54:23.777802+0000, chain.objs.size()=1 2024-09-12T01:07:27.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.dOU4poqVNFjf3xN6-wDpN9SAiKNLxB9_0 2024-09-12T01:07:27.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18027858472228209003', time=2024-09-12T02:54:24.173809+0000, chain.objs.size()=1 2024-09-12T01:07:27.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.SfGwVfoPi14Kadg9LWeCiYmYfZX5fAq_0 2024-09-12T01:07:27.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1170427095607494715', time=2024-09-12T02:54:24.197914+0000, chain.objs.size()=1 2024-09-12T01:07:27.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.FsVDf3pG7hjglR50Y0b4_GYr1n14teh_0 2024-09-12T01:07:27.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9781212419666568674', time=2024-09-12T02:54:24.209558+0000, chain.objs.size()=1 2024-09-12T01:07:27.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.520+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.RtKRt2SyTli-cA7Az1DJFHfbxcDQaZb_0 2024-09-12T01:07:27.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1246777359607713835', time=2024-09-12T02:54:24.311567+0000, chain.objs.size()=1 2024-09-12T01:07:27.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.E3cxFiY5yMfOnlzNXhvcLa-WifTebbI_0 2024-09-12T01:07:27.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6352011344668348456', time=2024-09-12T02:54:24.335778+0000, chain.objs.size()=1 2024-09-12T01:07:27.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uhy202ExfEXSwjDd8lTA1551ax6t_Hw_0 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3073369849241330939', time=2024-09-12T02:54:24.344119+0000, chain.objs.size()=1 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.jfUsmQM1--sRKgeAteG3LrU6qOBGwrP_0 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17993988419353977462', time=2024-09-12T02:54:24.513970+0000, chain.objs.size()=1 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.LtMXRJnQU7VtosrKoWTekHLAoe-vqvT_0 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12419156737048781854', time=2024-09-12T02:54:24.875440+0000, chain.objs.size()=1 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.s8PMb74rRT1-yPH3ezZI4KHbM0ExGVy_0 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15494050600789210493', time=2024-09-12T02:54:24.882458+0000, chain.objs.size()=1 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.b9Urnn_UIEMAGXsBztDzWB41Avmii3C_0 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.520380310479919239', time=2024-09-12T02:54:24.995152+0000, chain.objs.size()=1 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.MBmDLMKPd7P8-1FpOW40HBsEwALKfm4_0 2024-09-12T01:07:27.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2401839581250656151', time=2024-09-12T02:54:25.271860+0000, chain.objs.size()=1 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Z_D5Nz03tNVgzowvxYg34nUVvM3sVZM_0 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14527959036592368354', time=2024-09-12T02:54:25.651653+0000, chain.objs.size()=1 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ibVpu3AlQg5-DIVmfGSWe5b-IOe75wK_0 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12988754966163880467', time=2024-09-12T02:54:25.677874+0000, chain.objs.size()=1 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.iHQmHCJYr8TN5RpE_YzcV1VoQUpkkdI_0 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7044536051686445419', time=2024-09-12T02:54:25.689599+0000, chain.objs.size()=1 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CI7zzEzJbLWkgXIVik7-_EZinM_VONy_0 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13030353475881345771', time=2024-09-12T02:54:25.756178+0000, chain.objs.size()=1 2024-09-12T01:07:27.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.524+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.JTPUJlbNgC7G5HFN5VPBvrO8XlQTRdt_0 2024-09-12T01:07:27.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7521087181450720669', time=2024-09-12T02:54:25.988471+0000, chain.objs.size()=1 2024-09-12T01:07:27.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.56aAjqGDU_D0-dtPuX4WH_P6-A2vyid_0 2024-09-12T01:07:27.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5205855181069630560', time=2024-09-12T02:54:25.997375+0000, chain.objs.size()=1 2024-09-12T01:07:27.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GCCd2i2xbLlp1Ilizrspj-txACzWeJa_0 2024-09-12T01:07:27.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16838548398693841121', time=2024-09-12T02:54:34.107646+0000, chain.objs.size()=1 2024-09-12T01:07:27.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.274__shadow_.mLiHNZFGNg3UEPfvabeREhIBZmj4Fos_0 2024-09-12T01:07:27.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17979948628331525948', time=2024-09-12T02:54:36.941128+0000, chain.objs.size()=1 2024-09-12T01:07:27.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.278__shadow_.F2tumaJI7FGpZ948_5Qy-He3ZZ8GtX9_0 2024-09-12T01:07:27.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17919646736150088673', time=2024-09-12T02:54:37.650132+0000, chain.objs.size()=1 2024-09-12T01:07:27.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.279__shadow_.Ydr8vnbciF19YiHP7liMPIVPTuQbuyD_0 2024-09-12T01:07:27.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.288766919073531637', time=2024-09-12T02:54:47.916457+0000, chain.objs.size()=1 2024-09-12T01:07:27.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.Ii4tZcvDhDs9cwp_Y2yowyfcrdwFJxK_0 2024-09-12T01:07:27.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17546022988098917339', time=2024-09-12T02:54:47.929394+0000, chain.objs.size()=1 2024-09-12T01:07:27.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.Z3YL0NS1aXXTCfE7UlL47SLe_oLlGPR_0 2024-09-12T01:07:27.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17046621905900711676', time=2024-09-12T02:54:47.967737+0000, chain.objs.size()=1 2024-09-12T01:07:27.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.292__shadow_.EjFCjv1QthQAwQmK5pndUW8DJQpoN8z_0 2024-09-12T01:07:27.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9968949696734911972', time=2024-09-12T02:55:30.976472+0000, chain.objs.size()=1 2024-09-12T01:07:27.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1S3jXgxWX5-hAKr7skQ06fhjseOc-EM_0 2024-09-12T01:07:27.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.146838214690988677', time=2024-09-12T02:55:31.004932+0000, chain.objs.size()=1 2024-09-12T01:07:27.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.dix6jyjZwd34wiwCKPJN8ncR8We4sgw_0 2024-09-12T01:07:27.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1352475347620442379', time=2024-09-12T02:55:31.031979+0000, chain.objs.size()=1 2024-09-12T01:07:27.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.528+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.thY7ji985KBoM-KLFCuyefZpu5Cr7a8_0 2024-09-12T01:07:27.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4504361453441510863', time=2024-09-12T02:55:31.049841+0000, chain.objs.size()=1 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Q6KBzkicJyEie6yNVd8kj4inbys6y2v_0 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16655770610711952597', time=2024-09-12T02:55:31.229190+0000, chain.objs.size()=1 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.IKgIo7kG9f8tmX201Xhpoimm3tegN9c_0 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18003146851651455248', time=2024-09-12T02:55:31.252933+0000, chain.objs.size()=1 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Fc5_-wsr0ITkO9a13Op5mplCjy9gCpy_0 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14250563091615668962', time=2024-09-12T02:55:31.318972+0000, chain.objs.size()=1 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.wXOrNx6NsAf7QHFfVWX94A_hEbIVuN2_0 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9842771804360849112', time=2024-09-12T02:55:31.359227+0000, chain.objs.size()=1 2024-09-12T01:07:27.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.v6yNmeNAbBxas_2yokZOexv-mZqOu96_0 2024-09-12T01:07:27.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14026158204242801151', time=2024-09-12T02:55:31.391116+0000, chain.objs.size()=1 2024-09-12T01:07:27.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MnsCuMM6ff9vx-EV3qExD7dimBvYd0I_0 2024-09-12T01:07:27.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.592254236488117690', time=2024-09-12T02:55:31.570829+0000, chain.objs.size()=1 2024-09-12T01:07:27.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.HYbRy_kEGHfUu4bmEGCGzF1Cu1zBK-T_0 2024-09-12T01:07:27.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1885725003393331871', time=2024-09-12T02:55:31.701965+0000, chain.objs.size()=1 2024-09-12T01:07:27.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.532+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jfk8pesKmWA5ymtgjJzSoA35x1G6vy1_0 2024-09-12T01:07:27.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11025567153948078807', time=2024-09-12T02:55:31.711628+0000, chain.objs.size()=1 2024-09-12T01:07:27.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MXn0LEXVmgAD1p3X0TxJoSMTIuu_Rtx_0 2024-09-12T01:07:27.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2306677279853511460', time=2024-09-12T02:55:31.723937+0000, chain.objs.size()=1 2024-09-12T01:07:27.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pOt1jQ5LDlVJPlWIJH7d85eHeFU1Ijp_0 2024-09-12T01:07:27.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14674493949056843964', time=2024-09-12T02:55:32.012641+0000, chain.objs.size()=1 2024-09-12T01:07:27.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.idMxD3BiTT2e8btwq2PcamuNOpNiZCL_0 2024-09-12T01:07:27.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4126478533381645291', time=2024-09-12T02:55:32.077424+0000, chain.objs.size()=1 2024-09-12T01:07:27.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.YBfMhfQ3v9cnXatS-dK5sOFIwcMS7kZ_0 2024-09-12T01:07:27.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17466569800693956847', time=2024-09-12T02:55:32.101457+0000, chain.objs.size()=1 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.hDL-_2tiyyskr4fUBBDGh3x23zRqpp1_0 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1954770641239754920', time=2024-09-12T02:55:32.295980+0000, chain.objs.size()=1 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Z1QNwevVNKF088FEZZ5aLEa1iELE4EJ_0 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16624485246433110856', time=2024-09-12T02:55:32.301672+0000, chain.objs.size()=1 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Y1wb2Ciy47hWpdFYmgUUa2WM3mWQJl7_0 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11834540603469855211', time=2024-09-12T02:55:32.449050+0000, chain.objs.size()=1 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1Se5momENx194mdGCqExF828Jr9ZkPP_0 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16165914156555206781', time=2024-09-12T02:55:32.592488+0000, chain.objs.size()=1 2024-09-12T01:07:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.536+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.nbaVBCJ-qgZ2QMqEuvneItn4MUc1ODl_0 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10137763652932855239', time=2024-09-12T02:55:32.608414+0000, chain.objs.size()=1 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6MtrzzYMaSFLwuT3L34IKWaHa17TAQm_0 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13332734847742573224', time=2024-09-12T02:55:32.651804+0000, chain.objs.size()=1 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.9tDBtT6k-vRVpZY0tMWaTblUJbVxYYx_0 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1218728342936758356', time=2024-09-12T02:55:32.703559+0000, chain.objs.size()=1 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7Jrg4bgObd_LKG0w3dl7zxJB1Tsa-3H_0 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11445994774572569160', time=2024-09-12T02:55:32.723457+0000, chain.objs.size()=1 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3MebR8EyYOvrFNkWb1PQNma8UCyCJ4t_0 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2692515978269579463', time=2024-09-12T02:55:32.915549+0000, chain.objs.size()=1 2024-09-12T01:07:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.X0vTkaOC0O_AIoOLVNPBiOPuji5-9gd_0 2024-09-12T01:07:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5932482457278506733', time=2024-09-12T02:55:32.978537+0000, chain.objs.size()=1 2024-09-12T01:07:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QNQG91yOw150Prlw4-y3bIVzVb0dHTz_0 2024-09-12T01:07:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4721101114974499850', time=2024-09-12T02:55:32.992321+0000, chain.objs.size()=1 2024-09-12T01:07:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.540+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.0WAzfJ32O9vMx2LzOgbvSSkhvgw0nOV_0 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6232733777127780363', time=2024-09-12T02:55:32.998132+0000, chain.objs.size()=1 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.adfuDGmLJN2XiQHeEvPVFWCY8KWKfCg_0 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15622246516519078719', time=2024-09-12T02:55:33.008659+0000, chain.objs.size()=1 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ohVdL1hRMzIfqeMFjuUVjbjM5q0YyyH_0 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16689117981303394403', time=2024-09-12T02:55:33.327043+0000, chain.objs.size()=1 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3jFy5piY8TBIRz_P76DuwpgVkvMXf4A_0 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14463826508265133444', time=2024-09-12T02:55:54.469841+0000, chain.objs.size()=1 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8sQsklwUslsvp74wnmN4VHJvuAyjipg_0 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18387475998984010119', time=2024-09-12T02:55:54.490764+0000, chain.objs.size()=1 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UvCXxpvkmJQea6_P808qbH9hFVMTe_u_0 2024-09-12T01:07:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12642914728565157957', time=2024-09-12T02:55:54.568456+0000, chain.objs.size()=1 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.__cVHVyiKw5g6Yy872jTZM539KdC4gS_0 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2027264466876250416', time=2024-09-12T02:55:54.597043+0000, chain.objs.size()=1 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BNLGcXS6tgxbOWaJefuXduMpT_jhiFf_0 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17269101466774827866', time=2024-09-12T02:55:54.606367+0000, chain.objs.size()=1 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xCZEC8ZMVcTlP3WdkRWleB_nQGxRcj-_0 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17717555183797922023', time=2024-09-12T02:55:54.639745+0000, chain.objs.size()=1 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Ci6z99d4_dGc3jcUUy7RgEXBJysmMkZ_0 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17484577710841207056', time=2024-09-12T02:55:54.697870+0000, chain.objs.size()=1 2024-09-12T01:07:27.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9FeDmPYpboKsj28R0Lsm9aT7PnW3pU7_0 2024-09-12T01:07:27.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.790509910645880932', time=2024-09-12T02:55:54.912279+0000, chain.objs.size()=1 2024-09-12T01:07:27.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.544+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gFQF-m0s6Ca-lYSnSJ6O-mPgAUf1tZ7_0 2024-09-12T01:07:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15575504706708851400', time=2024-09-12T02:55:54.932831+0000, chain.objs.size()=1 2024-09-12T01:07:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.SNGekueeMeWwxKsha0s9zaCjhCOawxV_0 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15116784674789529057', time=2024-09-12T02:55:54.995828+0000, chain.objs.size()=1 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YxbGPt7k9PhF5mWsVAiqIhA6ENxqwB3_0 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13442618812358539148', time=2024-09-12T02:55:55.001837+0000, chain.objs.size()=1 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.W55KV7TUjfv7Y6YtMjtsjO0Ad2Jkm7Y_0 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3013908258954683005', time=2024-09-12T02:55:55.147139+0000, chain.objs.size()=1 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.A7CONBYhVATO8CoWFsswn7ik_Jv9q-0_0 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2935834106145720923', time=2024-09-12T02:55:55.208953+0000, chain.objs.size()=1 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gCCbfkQ5gwY3n4Ixn3gPgspOMFOdaK1_0 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6156169542624908876', time=2024-09-12T02:55:55.235250+0000, chain.objs.size()=1 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bYPO_7DboegTRFl8CbTupcFzu2pig2J_0 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.298304202663442224', time=2024-09-12T02:55:55.575841+0000, chain.objs.size()=1 2024-09-12T01:07:27.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.6vbG5TnJ6t8FNmvlN-Ej8Cg-5PMkosg_0 2024-09-12T01:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7356027758277488011', time=2024-09-12T02:55:55.634292+0000, chain.objs.size()=1 2024-09-12T01:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LKMWJhdHoy1f9pkPckF_RVrLKkJp4Vd_0 2024-09-12T01:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12336445626098900615', time=2024-09-12T02:55:55.806421+0000, chain.objs.size()=1 2024-09-12T01:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ISTrTRgiw4O0x5i1TMoU6xsExtR9atu_0 2024-09-12T01:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1648036689690112735', time=2024-09-12T02:55:55.886072+0000, chain.objs.size()=1 2024-09-12T01:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.VCoxLuLtaLuItT0IlWS4cGv_fwvfHZ7_0 2024-09-12T01:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16276257858068184557', time=2024-09-12T02:55:55.900164+0000, chain.objs.size()=1 2024-09-12T01:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.548+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Y_5v_xgPk3IrHRlD8IvU4nX_ai7av3Z_0 2024-09-12T01:07:27.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6518663807300205527', time=2024-09-12T02:55:55.962709+0000, chain.objs.size()=1 2024-09-12T01:07:27.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PM6IRiPqbdTGCCAV_2BdEWh19UvuHXg_0 2024-09-12T01:07:27.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3724573061215413686', time=2024-09-12T02:55:55.963422+0000, chain.objs.size()=1 2024-09-12T01:07:27.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.UWAi5yj0YrfFunOKj5pQtJpeTdAM9Iw_0 2024-09-12T01:07:27.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17859385994372314978', time=2024-09-12T02:55:55.967158+0000, chain.objs.size()=1 2024-09-12T01:07:27.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.mDDvP6mKpA7r4HChtxFASoekyzYmVhT_0 2024-09-12T01:07:27.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16709742298627708416', time=2024-09-12T02:55:55.974342+0000, chain.objs.size()=1 2024-09-12T01:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.2_IRWSlO6ayTN4l0Og3BTp6U_Fj6fCf_0 2024-09-12T01:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6044587459205635990', time=2024-09-12T02:55:55.978031+0000, chain.objs.size()=1 2024-09-12T01:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.XzQo3-yfpNqdt-le5tFoFvgRVmqi-M9_0 2024-09-12T01:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13285687047035282488', time=2024-09-12T02:55:56.229043+0000, chain.objs.size()=1 2024-09-12T01:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.EstUUkTSTFp5hZZ6w3LGXxojsq6f51i_0 2024-09-12T01:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11520483619540017486', time=2024-09-12T02:55:56.239922+0000, chain.objs.size()=1 2024-09-12T01:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JYH8qNFPOOiVkWWVr7TRUsXL6kadqIN_0 2024-09-12T01:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14199642252366152912', time=2024-09-12T02:55:56.364643+0000, chain.objs.size()=1 2024-09-12T01:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Z9Tcc3OwW3TrFO1B6M3C9Ed-7B1Ch2v_0 2024-09-12T01:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1268903696731469115', time=2024-09-12T02:55:56.598834+0000, chain.objs.size()=1 2024-09-12T01:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.fsGPHR5uCzN15raVbSA5vbpPzucsX78_0 2024-09-12T01:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8950578668536860684', time=2024-09-12T02:55:56.625446+0000, chain.objs.size()=1 2024-09-12T01:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.xC_Tq0X7dsXTlZqlJtlq_zbzJKSkhmQ_0 2024-09-12T01:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12439284507170835948', time=2024-09-12T02:55:56.846901+0000, chain.objs.size()=1 2024-09-12T01:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.552+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.YYaY8CfPMPsZMHe_9YQQcSu9fwdLHxi_0 2024-09-12T01:07:27.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.556+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2263279995839006631', time=2024-09-12T02:55:56.879336+0000, chain.objs.size()=1 2024-09-12T01:07:27.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.556+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bzWEFkHF94jHnBmRuNZOJe0y75KAC7d_0 2024-09-12T01:07:27.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44075 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16345856095026208084', time=2024-09-12T02:55:56.889078+0000, chain.objs.size()=1 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ICv3dT6nfRq_lMJ9FRbHC-etQ0wba3P_0 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17610476050196283382', time=2024-09-12T02:55:56.907883+0000, chain.objs.size()=1 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.D4PiIlDmuWsMYr1Fj9Gsh4LJcQBs9QS_0 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15835647388230055178', time=2024-09-12T02:57:28.361327+0000, chain.objs.size()=1 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.457__shadow_.nNDPQSVRz_qPWX_Wy3H00WkkF2SLkyK_0 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4166729102162187978', time=2024-09-12T02:57:29.396467+0000, chain.objs.size()=1 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.458__shadow_.Y6-fbwyp-p_XYuY8GcI9_cFZPImd_aT_0 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16355268370467232282', time=2024-09-12T02:57:45.042146+0000, chain.objs.size()=1 2024-09-12T01:07:27.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.POSTFHb1-ri0etorS2ASatArnsBm19h_0 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7185548441248147844', time=2024-09-12T02:57:47.454604+0000, chain.objs.size()=1 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.486__shadow_.dUwj8YJ43zZkfYq4Oeu9SoUgDxJAqJT_0 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9137359511180900501', time=2024-09-12T02:58:30.114362+0000, chain.objs.size()=6 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~srGGPKeKJDYEdtmVifc2prRKf5qu2GX.1 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~srGGPKeKJDYEdtmVifc2prRKf5qu2GX.2 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.SjffgH3O-5awRIUzsNypfKKTG_bhPIak.3 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~srGGPKeKJDYEdtmVifc2prRKf5qu2GX.4 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~srGGPKeKJDYEdtmVifc2prRKf5qu2GX.5 2024-09-12T01:07:27.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.560+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.522__multipart_mymultipart.2~srGGPKeKJDYEdtmVifc2prRKf5qu2GX.6 2024-09-12T01:07:27.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3903313840405471728', time=2024-09-12T02:58:45.971108+0000, chain.objs.size()=1 2024-09-12T01:07:27.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.528__shadow_.c_g4WAsKKfqcZYCrwMfVzErp1rFJAJw_0 2024-09-12T01:07:27.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8158101533658390101', time=2024-09-12T02:59:31.391261+0000, chain.objs.size()=1 2024-09-12T01:07:27.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.551__shadow_.0uD0m5mE0vwvf9V3-xUClzaJZ8DyS5O_0 2024-09-12T01:07:27.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16359033286656649952', time=2024-09-12T03:00:06.445848+0000, chain.objs.size()=1 2024-09-12T01:07:27.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow:ms.cF8DQPi6ijFAv8kZZYYx9sCcT9ge_.O_yTcBdoV6m4dMg_4KQE4BzpJh2TmFz_0 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17207287702061854154', time=2024-09-12T03:00:11.967497+0000, chain.objs.size()=1 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:PyxMck8ukuQnC0pyrt-TTkCFBLxkpIl_.uYAtFV7pAJm32ISM-G_cZNGUd3vQteB_0 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6250092570903070462', time=2024-09-12T03:00:27.972706+0000, chain.objs.size()=1 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:VKESGoSU5jc3PG2aW9nk7JTJoff82TR_.rSDlR6Vmmt3pY58mEbNcHmlE0i6AL9I_0 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3665940910766297431', time=2024-09-12T03:03:18.997063+0000, chain.objs.size()=12 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__multipart_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.1 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__shadow_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.1_1 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__multipart_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.2 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__shadow_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.2_1 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__multipart_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.3 2024-09-12T01:07:27.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.564+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__shadow_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.3_1 2024-09-12T01:07:27.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__multipart_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.4 2024-09-12T01:07:27.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.568+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__shadow_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.4_1 2024-09-12T01:07:27.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__multipart_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.5 2024-09-12T01:07:27.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__shadow_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.5_1 2024-09-12T01:07:27.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__multipart_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.6 2024-09-12T01:07:27.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.623__shadow_multipart_enc.2~6s_g-ZPCHvOY6DPewmogDtmEz-H2xQg.6_1 2024-09-12T01:07:27.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6952786435601884179', time=2024-09-12T03:03:35.653020+0000, chain.objs.size()=1 2024-09-12T01:07:27.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.645__shadow_.IpdsjcEL67TBb0Xrb1u44KMid9d-Qmo_0 2024-09-12T01:07:27.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13487237145803199730', time=2024-09-12T03:03:43.122986+0000, chain.objs.size()=1 2024-09-12T01:07:27.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.654__shadow_.soJVoT63YK9xZETU1bq7m8TG0okpzyz_0 2024-09-12T01:07:27.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16662233457490647663', time=2024-09-12T03:04:18.584945+0000, chain.objs.size()=1 2024-09-12T01:07:27.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.572+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.706__shadow_.QLgSIw1DNnJWALJNZgL0gmxLlEuCXOc_0 2024-09-12T01:07:27.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.576+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:07:27.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42024' 2024-09-12T01:07:27.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6450724531622245766', time=2024-09-12T02:51:27.868188+0000, chain.objs.size()=1 2024-09-12T01:07:27.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.157__shadow:S26Y.I0mpA9qgNVYiE-ys6ZoCvCVdT0_.K1xl2pT_mlXYDe3-twGX7oQ8M5RQr0-_0 2024-09-12T01:07:27.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5191414120997500572', time=2024-09-12T02:53:45.644886+0000, chain.objs.size()=1 2024-09-12T01:07:27.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.239__shadow_.c5PTKb-Qq3ba0ExVHYdKMoBJzTrH_Rf_0 2024-09-12T01:07:27.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11699888749470249220', time=2024-09-12T02:53:56.420551+0000, chain.objs.size()=1 2024-09-12T01:07:27.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.253__shadow_.sHZo4Bm5BAjOLwqpJBPy-q5OsOcvtJk_0 2024-09-12T01:07:27.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9809380287602594985', time=2024-09-12T02:54:23.082069+0000, chain.objs.size()=1 2024-09-12T01:07:27.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.DOlNxx6upbPIoKdfy25fzEG69KrY5-i_0 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10735147097615745552', time=2024-09-12T02:54:23.213863+0000, chain.objs.size()=1 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.Nyx00pLlteZevEmfPgaa0i7EeiXsB5I_0 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6737301270818623227', time=2024-09-12T02:54:23.236555+0000, chain.objs.size()=1 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.afEd6gna_0BPFoB2ugKesg4ppjGdZZC_0 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16113681432901390790', time=2024-09-12T02:54:23.270901+0000, chain.objs.size()=1 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.mQaRoh2J0yAyvdsM_ehEINWVLGMgQBt_0 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10861498271801377788', time=2024-09-12T02:54:23.461086+0000, chain.objs.size()=1 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5qs-m8ne6P8qmH5P6zedI39s-u3YyQ4_0 2024-09-12T01:07:27.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15318606256269713653', time=2024-09-12T02:54:23.510496+0000, chain.objs.size()=1 2024-09-12T01:07:27.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.CS15wb2WDXgx9937Dittxzph1-ITbTQ_0 2024-09-12T01:07:27.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6333320357576974395', time=2024-09-12T02:54:23.525592+0000, chain.objs.size()=1 2024-09-12T01:07:27.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.N7nSQgPtpX3lJpC6JlQyfL7kraIHAW1_0 2024-09-12T01:07:27.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1128899571517520132', time=2024-09-12T02:54:23.537563+0000, chain.objs.size()=1 2024-09-12T01:07:27.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.EO8aZ-N3BVo_KvOzcfbxlYIYow3ZiGm_0 2024-09-12T01:07:27.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14250512855137571933', time=2024-09-12T02:54:23.751858+0000, chain.objs.size()=1 2024-09-12T01:07:27.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.580+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GbDvJk7ocmt1rncVGav83s6oRhtqOiZ_0 2024-09-12T01:07:27.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5201717411556545318', time=2024-09-12T02:54:24.094189+0000, chain.objs.size()=1 2024-09-12T01:07:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ip-8UwNbapYuYXN08j3WcYfFGP42tcB_0 2024-09-12T01:07:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17142337867274680627', time=2024-09-12T02:54:24.103945+0000, chain.objs.size()=1 2024-09-12T01:07:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2aHidrzC8XGXoc_B2Vg-15ZsAknndUi_0 2024-09-12T01:07:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8855361442668130065', time=2024-09-12T02:54:24.109111+0000, chain.objs.size()=1 2024-09-12T01:07:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uKjqT-O1c6yZTZ3Rx7sWVUhTKt8SQW9_0 2024-09-12T01:07:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2961151487207789171', time=2024-09-12T02:54:24.116718+0000, chain.objs.size()=1 2024-09-12T01:07:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.e8_oJu0gwCcgTXAPJH0WJOIg4zXuNsN_0 2024-09-12T01:07:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6478297024385148292', time=2024-09-12T02:54:24.467521+0000, chain.objs.size()=1 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.e40qGEqw4Nof9gVCXST0I1ju5GayG_U_0 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14026357792934919777', time=2024-09-12T02:54:24.477155+0000, chain.objs.size()=1 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.32nyKl2YA1FcK05rDEo4mOh-bmyKWkp_0 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1228750029613883953', time=2024-09-12T02:54:24.527733+0000, chain.objs.size()=1 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.zxGqxv63NjRLPcPG8g2NchymB4hWVqJ_0 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1085115355166361057', time=2024-09-12T02:54:24.823968+0000, chain.objs.size()=1 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.hMmASEx9Ts0y2J2TugKIzbp0TdsgCxM_0 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8640584691039354265', time=2024-09-12T02:54:24.830988+0000, chain.objs.size()=1 2024-09-12T01:07:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GqrOiujq2PJ1QN9PXgazLqAdj1R13N2_0 2024-09-12T01:07:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17634475061402666823', time=2024-09-12T02:54:25.119839+0000, chain.objs.size()=1 2024-09-12T01:07:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.PVIsyW48Kkavu8hddIx4Z3oiUYhqsCA_0 2024-09-12T01:07:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7573726624510348042', time=2024-09-12T02:54:25.187460+0000, chain.objs.size()=1 2024-09-12T01:07:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.584+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.c4lpSSvJvk2PYmyOTyHp6WO50Ca7_Yn_0 2024-09-12T01:07:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5679570525748032179', time=2024-09-12T02:54:25.191224+0000, chain.objs.size()=1 2024-09-12T01:07:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.2c8fy83tMBehxUJ_qtQB28e5bBd7KL__0 2024-09-12T01:07:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7109567420623334803', time=2024-09-12T02:54:25.250799+0000, chain.objs.size()=1 2024-09-12T01:07:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ynvrgJiQm0T6DhqjZAQoF6h-Ak5EHl__0 2024-09-12T01:07:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10607505015810238279', time=2024-09-12T02:54:25.353132+0000, chain.objs.size()=1 2024-09-12T01:07:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.1FWrXcJrhgTZJZ4evklXQsO3FqKmJjd_0 2024-09-12T01:07:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2706101360343659824', time=2024-09-12T02:54:25.513726+0000, chain.objs.size()=1 2024-09-12T01:07:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.uaUGVzn2RASbK5htZ3aoQ9H6Rg_HM7M_0 2024-09-12T01:07:27.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13672219261395193182', time=2024-09-12T02:54:25.520366+0000, chain.objs.size()=1 2024-09-12T01:07:27.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6DnJt0JIEmCMYIp-gPhCUZ21fni1YXf_0 2024-09-12T01:07:27.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10467377203160181502', time=2024-09-12T02:54:25.582208+0000, chain.objs.size()=1 2024-09-12T01:07:27.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.7e5ytd_rhUbHd4ei401DLGISizsR1rM_0 2024-09-12T01:07:27.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1867977067503438195', time=2024-09-12T02:54:25.863413+0000, chain.objs.size()=1 2024-09-12T01:07:27.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.pakU1N0QF_q0gKLkYoVfXsBwnLHA9wt_0 2024-09-12T01:07:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12245213901223618467', time=2024-09-12T02:54:25.893081+0000, chain.objs.size()=1 2024-09-12T01:07:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.VYI_ch1fc_kMeDQ9Zcqp4ByoUKpVfjk_0 2024-09-12T01:07:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17630390302938263886', time=2024-09-12T02:54:25.909566+0000, chain.objs.size()=1 2024-09-12T01:07:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.8y_DclZ-hLwf5V2RbHA59feAdxVC_6o_0 2024-09-12T01:07:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10121879642208761008', time=2024-09-12T02:54:25.944483+0000, chain.objs.size()=1 2024-09-12T01:07:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.KCKfFKL2Sz5CuT2wGSLqygrksRo3zfe_0 2024-09-12T01:07:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5645626319683175354', time=2024-09-12T02:54:25.985676+0000, chain.objs.size()=1 2024-09-12T01:07:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.588+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_._JlhjNKFO9K3benHzkveUKUplYljszO_0 2024-09-12T01:07:27.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1374867794410331607', time=2024-09-12T02:54:34.803932+0000, chain.objs.size()=1 2024-09-12T01:07:27.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.275__shadow_.mPvVXU1GnIF_4duMvLZQkbb3ZM-U19Y_0 2024-09-12T01:07:27.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12086183506115053086', time=2024-09-12T02:54:39.018246+0000, chain.objs.size()=1 2024-09-12T01:07:27.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.281__shadow_.Gh5UyJoiDf5VxyD6OAqWcUtcc_zf73y_0 2024-09-12T01:07:27.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18380802188203296886', time=2024-09-12T02:54:39.773747+0000, chain.objs.size()=1 2024-09-12T01:07:27.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.282__shadow_.JlRruB3Cc633SBAlr_MXogmQ2s6F9--_0 2024-09-12T01:07:27.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2655272921596135005', time=2024-09-12T02:54:45.463922+0000, chain.objs.size()=1 2024-09-12T01:07:27.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.290__shadow_.xdBG5jwjqXyqq2fFv3qGl_PY5fEFicX_0 2024-09-12T01:07:27.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15444381256083772377', time=2024-09-12T02:54:55.799045+0000, chain.objs.size()=1 2024-09-12T01:07:27.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.302__shadow_.aN-rP5PJHrb7B_xIBEmoFczxVdtP2cX_0 2024-09-12T01:07:27.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3532147459942815924', time=2024-09-12T02:55:30.940308+0000, chain.objs.size()=1 2024-09-12T01:07:27.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ZFfVlN0QzT6FXiPWOhOS46L6JrPUOjn_0 2024-09-12T01:07:27.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4251607854971952352', time=2024-09-12T02:55:30.999394+0000, chain.objs.size()=1 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.QbPf81pUtkIbA4Qi2orK2P36uIJj6AP_0 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1147040963850427462', time=2024-09-12T02:55:31.014336+0000, chain.objs.size()=1 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Kz-IlO88bJYbLvhaLcEEPDqibkODLhd_0 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8511195441520176704', time=2024-09-12T02:55:31.234157+0000, chain.objs.size()=1 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.wePTNnI9Hk_rB4WCAlaRauEIHyiPNDE_0 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5434053653762963591', time=2024-09-12T02:55:31.296158+0000, chain.objs.size()=1 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.7TA-ZtkW82HQfmZHWNz7E5vGyMJfhQ4_0 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13944941938293330900', time=2024-09-12T02:55:31.345392+0000, chain.objs.size()=1 2024-09-12T01:07:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.592+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.PnaXScNQGDBSFnTaMucY6fLGOmFkojG_0 2024-09-12T01:07:27.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.142194036653546534', time=2024-09-12T02:55:31.356411+0000, chain.objs.size()=1 2024-09-12T01:07:27.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bc1YHeix9__zj5fEkkQOsZw69-B0Gx9_0 2024-09-12T01:07:27.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3225523486186389581', time=2024-09-12T02:55:31.388694+0000, chain.objs.size()=1 2024-09-12T01:07:27.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.pVUufEAjvkGMP7dCvMYOtoAU6gKkiLO_0 2024-09-12T01:07:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11409821572559870184', time=2024-09-12T02:55:31.434640+0000, chain.objs.size()=1 2024-09-12T01:07:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.NVMRijmvYUkikCbxeQofnwv-gLHNMxV_0 2024-09-12T01:07:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17465164515052437771', time=2024-09-12T02:55:31.600167+0000, chain.objs.size()=1 2024-09-12T01:07:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.LyLcBayCx_iWw_HPTfD58Y_UZ4VDvYe_0 2024-09-12T01:07:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5612798766608918981', time=2024-09-12T02:55:31.631379+0000, chain.objs.size()=1 2024-09-12T01:07:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.8JhcZq4SFiEjFyhTQMdK8gVypJ_wa7m_0 2024-09-12T01:07:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.831242619048161167', time=2024-09-12T02:55:31.651617+0000, chain.objs.size()=1 2024-09-12T01:07:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Rtk9pgnNh_YReXyEdopBY0VQmkG-1Ie_0 2024-09-12T01:07:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11189070481112963205', time=2024-09-12T02:55:31.660598+0000, chain.objs.size()=1 2024-09-12T01:07:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.wtaEy_P-aewegyNvDwyCfBnifdGBcP1_0 2024-09-12T01:07:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1020832488922413429', time=2024-09-12T02:55:31.679113+0000, chain.objs.size()=1 2024-09-12T01:07:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.596+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.4z2IY84o175xpfcADGFCHCXWPTpYxv-_0 2024-09-12T01:07:27.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2257565303858179935', time=2024-09-12T02:55:31.895789+0000, chain.objs.size()=1 2024-09-12T01:07:27.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ReNAPI7tavMKr2apUrgipZKj7LOJWL__0 2024-09-12T01:07:27.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16988115309065580066', time=2024-09-12T02:55:31.926859+0000, chain.objs.size()=1 2024-09-12T01:07:27.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.c1UySfUyiEgn2IwpGRxa7EIp6bHlVDG_0 2024-09-12T01:07:27.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.600+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3237521188962942605', time=2024-09-12T02:55:31.934028+0000, chain.objs.size()=1 2024-09-12T01:07:27.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.600+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Jitr-Pgj25XutonM2dO3crLFigIgbYP_0 2024-09-12T01:07:27.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12602528970336098014', time=2024-09-12T02:55:31.986367+0000, chain.objs.size()=1 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.siQNpsI8A5rcW_NHz4mUhUVxKW8WoFC_0 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15881790165673870447', time=2024-09-12T02:55:32.046434+0000, chain.objs.size()=1 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.a92tCAPK1qu6An7KV_MmZok3kSEf2lm_0 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18174912759824776728', time=2024-09-12T02:55:32.068955+0000, chain.objs.size()=1 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.x-06HRS-Q5FQkmJ8a70jGSfvRcxTMTY_0 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12779069757719432123', time=2024-09-12T02:55:32.252050+0000, chain.objs.size()=1 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.aG4kit0UbK1lpyNaYUNAAY8B6JL5SX4_0 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12745256783259757675', time=2024-09-12T02:55:32.282018+0000, chain.objs.size()=1 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.ALYWml7N3n7LS9n50ge5UDGdr1ZurZ3_0 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5861459179822296983', time=2024-09-12T02:55:32.319922+0000, chain.objs.size()=1 2024-09-12T01:07:27.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.25WiSlSuEIv7HufMRPn8LIHotGhowG6_0 2024-09-12T01:07:27.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15725372662284127309', time=2024-09-12T02:55:32.333162+0000, chain.objs.size()=1 2024-09-12T01:07:27.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jWQKwjdWnKTuQO1iv7DLDFZILlvOEfc_0 2024-09-12T01:07:27.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18111475254986702515', time=2024-09-12T02:55:32.363428+0000, chain.objs.size()=1 2024-09-12T01:07:27.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.Z7oCRQ27wbCTPJ1Y5KVxS5oqVCxUWIz_0 2024-09-12T01:07:27.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14731112347528555870', time=2024-09-12T02:55:32.432505+0000, chain.objs.size()=1 2024-09-12T01:07:27.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.uOFHBwlQrZvGEYa1w8QhRMnucbfrDpR_0 2024-09-12T01:07:27.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9100753974376986759', time=2024-09-12T02:55:32.542510+0000, chain.objs.size()=1 2024-09-12T01:07:27.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.rH7lvX9LQyk3YN45dwQfvachPm9mFNO_0 2024-09-12T01:07:27.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16752025064267046269', time=2024-09-12T02:55:32.574588+0000, chain.objs.size()=1 2024-09-12T01:07:27.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.604+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.bR7Q1dOaOoIwmTUHtdPexhwh2G91UYi_0 2024-09-12T01:07:27.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6655428526865639982', time=2024-09-12T02:55:32.626907+0000, chain.objs.size()=1 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.WGiNHUTVqkw6T5fJPiUHQ6oATrTUE5-_0 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9154989278710850593', time=2024-09-12T02:55:32.644659+0000, chain.objs.size()=1 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TqjcJ8_A1m8b7yFAvlpnym1p1bA8DmT_0 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2078890955447151801', time=2024-09-12T02:55:32.686251+0000, chain.objs.size()=1 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.FI1IkFeVp5GJYlhImnm5-Eyhc9gSujm_0 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14634089297118798527', time=2024-09-12T02:55:33.166788+0000, chain.objs.size()=1 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.GQzJDpSiqzaZ73NZQ4AEEtOGaVss0O7_0 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.569171041882469688', time=2024-09-12T02:55:33.202253+0000, chain.objs.size()=1 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.3aSOCZoyeS70_ASYifES_Kv84b7LRyO_0 2024-09-12T01:07:27.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12866391141969603541', time=2024-09-12T02:55:54.676055+0000, chain.objs.size()=1 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.nNKIC0h7bOCI7CCsm-wL4Ljy9c6g6bl_0 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14317006218760442764', time=2024-09-12T02:55:54.791342+0000, chain.objs.size()=1 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.zL0QANcY_yUapdGTQt_qSlQniTxic3A_0 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16122699753679296238', time=2024-09-12T02:55:54.899133+0000, chain.objs.size()=1 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ESsjTIPas5uFTdktEGWclmCGQwoDG4I_0 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1307617436877727858', time=2024-09-12T02:55:55.119667+0000, chain.objs.size()=1 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LOxdRdfVcL-e4WEZ9ye2oR0HH7pqdWV_0 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4930385367904352664', time=2024-09-12T02:55:55.120672+0000, chain.objs.size()=1 2024-09-12T01:07:27.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.E79FJpNBVUoeRxyD97iy7XRBgBm2wav_0 2024-09-12T01:07:27.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13059053391349637350', time=2024-09-12T02:55:55.122138+0000, chain.objs.size()=1 2024-09-12T01:07:27.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.608+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1351P5d8_Ki6uqTlVp1arJNqDH80AiU_0 2024-09-12T01:07:27.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8487254086405955407', time=2024-09-12T02:55:55.171069+0000, chain.objs.size()=1 2024-09-12T01:07:27.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.8ed91CCeUeaP3p1_nl1_EuyYnA7G1PL_0 2024-09-12T01:07:27.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3429578736575385250', time=2024-09-12T02:55:55.291927+0000, chain.objs.size()=1 2024-09-12T01:07:27.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.P6YduPn7ZmmsK2K8f3nMgrMRYN12qKj_0 2024-09-12T01:07:27.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9137157923165860132', time=2024-09-12T02:55:55.810423+0000, chain.objs.size()=1 2024-09-12T01:07:27.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.seQDN9XpqCEhboMpZfaCsFjUIUiB5p2_0 2024-09-12T01:07:27.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2262317168305837763', time=2024-09-12T02:55:55.833032+0000, chain.objs.size()=1 2024-09-12T01:07:27.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HNFWcZHb4X7_3WusfLdkM-D_NaJttX1_0 2024-09-12T01:07:27.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7068273585385155227', time=2024-09-12T02:55:55.864179+0000, chain.objs.size()=1 2024-09-12T01:07:27.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PWRMeg0AGsETIHhxHvVCb9YtSSQkGDl_0 2024-09-12T01:07:27.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13336631687032319137', time=2024-09-12T02:55:55.906869+0000, chain.objs.size()=1 2024-09-12T01:07:27.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1sCj7pONnYXVsTgwM9ERbuJ9xnEj2sp_0 2024-09-12T01:07:27.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15840412075402917869', time=2024-09-12T02:55:55.933371+0000, chain.objs.size()=1 2024-09-12T01:07:27.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.-RWBtaUbTQFADy-UtuqXTvAR2yGFyKE_0 2024-09-12T01:07:27.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17412645417918196518', time=2024-09-12T02:55:55.968498+0000, chain.objs.size()=1 2024-09-12T01:07:27.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Api-7OSMFRqCHV9EIz6fmhIgNJp4yGE_0 2024-09-12T01:07:27.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17559147617508271579', time=2024-09-12T02:55:56.149422+0000, chain.objs.size()=1 2024-09-12T01:07:27.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ObTxpOkb6QVPfiLJjFWeo6-KMI5T0la_0 2024-09-12T01:07:27.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4624663827525838664', time=2024-09-12T02:55:56.214537+0000, chain.objs.size()=1 2024-09-12T01:07:27.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.0mxnrQhv3d-U3kxbcw6aZ0puUd7F8Ns_0 2024-09-12T01:07:27.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8284521185190967148', time=2024-09-12T02:55:56.221756+0000, chain.objs.size()=1 2024-09-12T01:07:27.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.612+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.gHi3qZgsP0fSoWuFRcovtXsgzzidFPC_0 2024-09-12T01:07:27.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7761254793017081371', time=2024-09-12T02:55:56.335899+0000, chain.objs.size()=1 2024-09-12T01:07:27.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.DUgvWvaYqAVgHA2wvtq-MRV6Jg4sKf8_0 2024-09-12T01:07:27.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6685449704872726559', time=2024-09-12T02:55:56.476656+0000, chain.objs.size()=1 2024-09-12T01:07:27.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.z0spm1YJaBOe-IkDGg8dCm9vIxZfN9M_0 2024-09-12T01:07:27.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12809324633168332325', time=2024-09-12T02:55:56.480270+0000, chain.objs.size()=1 2024-09-12T01:07:27.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WlUORBxIE5MB1Us1vV29smn3r-x-XzY_0 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4814075235817428914', time=2024-09-12T02:55:56.505034+0000, chain.objs.size()=1 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OxKAJPNj78GQZmSlDkI-ngLa45yxXIB_0 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8558424111158120459', time=2024-09-12T02:55:56.525479+0000, chain.objs.size()=1 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.bjSyDxi1atnHlOAvAy-VUZzKZRSqy_W_0 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4011436103024718266', time=2024-09-12T02:55:56.576861+0000, chain.objs.size()=1 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pXEWsFrXvQyaSFwFCueB6EGfoYaLF5F_0 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1981448319956352347', time=2024-09-12T02:55:56.665534+0000, chain.objs.size()=1 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.9g99TbKkKrW5CjC2eSYh6v-0jyrln86_0 2024-09-12T01:07:27.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4078644427530955446', time=2024-09-12T02:55:56.771264+0000, chain.objs.size()=1 2024-09-12T01:07:27.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.30SuNxuLRHQ88gfMr8Z78si7fdiBHNx_0 2024-09-12T01:07:27.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16594593648603358299', time=2024-09-12T02:55:56.805435+0000, chain.objs.size()=1 2024-09-12T01:07:27.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Pao4ts73pLuyOtNPb92YRYkc2-UHyBc_0 2024-09-12T01:07:27.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.713471681990506932', time=2024-09-12T02:55:56.816728+0000, chain.objs.size()=1 2024-09-12T01:07:27.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.V1FqR0IW9gGlig8bwGE7oto1GAiGPHu_0 2024-09-12T01:07:27.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15960900740856525707', time=2024-09-12T02:55:56.887020+0000, chain.objs.size()=1 2024-09-12T01:07:27.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.616+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pX3hqPwlmSo1kbWFrbpwu0jEKqAn2nZ_0 2024-09-12T01:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.620+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/42024 2024-09-12T01:07:27.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:07:27.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15209178476584993513', time=2024-09-12T02:56:04.460952+0000, chain.objs.size()=1 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.336__shadow_.GKVuNAgv0YmmiXM17faAgAZFW53ZDfp_0 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6009840133068799454', time=2024-09-12T02:57:10.776168+0000, chain.objs.size()=1 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.435__shadow_.6gkU3KqsL7P9AJNGIph74KovUmCpOBL_0 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12526189143188063668', time=2024-09-12T02:57:45.070487+0000, chain.objs.size()=1 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.483__shadow_.p9kBcERXjIRgOfv87cBNL85RPLo2UDg_0 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2317611963463277707', time=2024-09-12T02:57:48.832444+0000, chain.objs.size()=1 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.488__shadow_.HrSRJCQk5uh3ncY9koKTsJUS8zvDNuO_0 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14317327961573328936', time=2024-09-12T02:58:01.740168+0000, chain.objs.size()=6 2024-09-12T01:07:27.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.1 2024-09-12T01:07:27.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.2 2024-09-12T01:07:27.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.3 2024-09-12T01:07:27.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.4 2024-09-12T01:07:27.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.5 2024-09-12T01:07:27.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.6 2024-09-12T01:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2391643882611823964', time=2024-09-12T02:59:32.612195+0000, chain.objs.size()=1 2024-09-12T01:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.552__shadow_.AE2M5W0AvStXNMxRKzxbSZQZXvvfNd8_0 2024-09-12T01:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.426282494992387530', time=2024-09-12T03:00:06.787750+0000, chain.objs.size()=1 2024-09-12T01:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.624+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.574__shadow:BAAxlInqANaqaqA.4euyeZ8AU9NFAxQ_.LA5k0m8MuDjKmZ4jZlhUrp76WkQ8ixJ_0 2024-09-12T01:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5587704051278837297', time=2024-09-12T03:00:24.975350+0000, chain.objs.size()=1 2024-09-12T01:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:UC7rExGymO6WlnDbIIs8Vfw27T1wOJ5_.4a3WRK4AOct6-6L8Z_00CySS_6hKcDg_0 2024-09-12T01:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15028717691267028339', time=2024-09-12T03:00:42.318401+0000, chain.objs.size()=1 2024-09-12T01:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.587__shadow:X6kS25d-ZZXLU56b9MGzrk8Uy7PHQ20_.XpyBAwgKk2Tzf-bwNJKZnNmli8MUqEw_0 2024-09-12T01:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9245367739378609093', time=2024-09-12T03:01:08.020794+0000, chain.objs.size()=12 2024-09-12T01:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__multipart_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.1 2024-09-12T01:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__shadow_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.1_1 2024-09-12T01:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__multipart_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.2 2024-09-12T01:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__shadow_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.2_1 2024-09-12T01:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__multipart_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.3 2024-09-12T01:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__shadow_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.3_1 2024-09-12T01:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__multipart_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.4 2024-09-12T01:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__shadow_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.4_1 2024-09-12T01:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.628+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__multipart_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.5 2024-09-12T01:07:27.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__shadow_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.5_1 2024-09-12T01:07:27.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__multipart_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.6 2024-09-12T01:07:27.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.614__shadow_multipart_enc.2~feaTC2SolGqfLJrLDN2v4w-U0cZvBWV.6_1 2024-09-12T01:07:27.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh', time=2024-09-12T03:03:20.635333+0000, chain.objs.size()=12 2024-09-12T01:07:27.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__multipart_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.1 2024-09-12T01:07:27.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__shadow_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.1_1 2024-09-12T01:07:27.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__multipart_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.2 2024-09-12T01:07:27.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__shadow_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.2_1 2024-09-12T01:07:27.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__multipart_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.3 2024-09-12T01:07:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__shadow_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.3_1 2024-09-12T01:07:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__multipart_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.4 2024-09-12T01:07:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.632+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__shadow_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.4_1 2024-09-12T01:07:27.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__multipart_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.5 2024-09-12T01:07:27.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__shadow_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.5_1 2024-09-12T01:07:27.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__multipart_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.6 2024-09-12T01:07:27.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.624__shadow_multipart_enc.2~l3IF6IjQjcGorV3NwrhiOqMFhJHbWdh.6_1 2024-09-12T01:07:27.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15970738884964917494', time=2024-09-12T03:04:10.440103+0000, chain.objs.size()=1 2024-09-12T01:07:27.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.694__shadow:u9pxRlFJ4l5nRDB4hQG2h6jnXbEVVrF_.voS_PiOcaUVsnQ5FAF89yCpSum0yuAt_0 2024-09-12T01:07:27.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.640+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5924985829551692485', time=2024-09-12T03:04:34.273781+0000, chain.objs.size()=1 2024-09-12T01:07:27.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.640+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.715__shadow:cfzX63i-QQ-P0Qhg9uAmWirRPBLPsiK_.73C6VCxXhdwyMPosi7mNZvUlFAUsd2C_0 2024-09-12T01:07:27.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.644+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.644+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:07:27.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:07:27.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:07:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54260' 2024-09-12T01:07:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15160233417209888672', time=2024-09-12T02:51:48.423191+0000, chain.objs.size()=1 2024-09-12T01:07:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.179__shadow_.P9frGCwVV8XtuiGTLC0e6eGyGT7vGXk_0 2024-09-12T01:07:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10903662948538288818', time=2024-09-12T02:53:39.206786+0000, chain.objs.size()=1 2024-09-12T01:07:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.231__shadow_.-968McfPgEwm0Fv6KDdf7hP2EUuR9GZ_0 2024-09-12T01:07:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15393172123488426083', time=2024-09-12T02:53:47.728180+0000, chain.objs.size()=1 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.242__shadow_.NpYRD9kSvirH5rwETjoWvh5vRn2vDxf_0 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4744554686835809921', time=2024-09-12T02:53:57.084813+0000, chain.objs.size()=1 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.254__shadow_.7Gcp0-QtORO20UhN6Tk1biB-OwqgBgG_0 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2574942372881067751', time=2024-09-12T02:54:23.031078+0000, chain.objs.size()=1 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.5utrp8Li16alKNHnt1L0xwc5qcTUSpy_0 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6488497797567550918', time=2024-09-12T02:54:23.569532+0000, chain.objs.size()=1 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.evAiruglVVXejfVutwxt_Zrai02gnKM_0 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10734328689488057740', time=2024-09-12T02:54:24.023741+0000, chain.objs.size()=1 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.qjBp5pnacACJ7v_dJAyV0yrVR4KjAZV_0 2024-09-12T01:07:27.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13640180893262460197', time=2024-09-12T02:54:24.340688+0000, chain.objs.size()=1 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.gPMUIYvtEug1WWFHpAwWlInBZrbhya8_0 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11894351839042775146', time=2024-09-12T02:54:24.420911+0000, chain.objs.size()=1 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.L3FnSVV78SfkydpGoZixRpGpLMsKGQ-_0 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2794395068373986470', time=2024-09-12T02:54:24.437593+0000, chain.objs.size()=1 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.XGN0OjlsnwOmkEbo7zJiYZbQyC7hSn3_0 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10187197403953579731', time=2024-09-12T02:54:24.517438+0000, chain.objs.size()=1 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.SnMUVFOpwrmyP8J1kLbERkZxpESgxBr_0 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.1136511049716061273', time=2024-09-12T02:54:24.912940+0000, chain.objs.size()=1 2024-09-12T01:07:27.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.648+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.TDB5VWp-b80RaqL2bDYK0LBtpQ5f7B__0 2024-09-12T01:07:27.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.18245085326451484640', time=2024-09-12T02:54:25.246684+0000, chain.objs.size()=1 2024-09-12T01:07:27.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.r7No1z8B6R9OuxVVdT-CCwnw2BzhJ_P_0 2024-09-12T01:07:27.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12875704239397206840', time=2024-09-12T02:54:25.583182+0000, chain.objs.size()=1 2024-09-12T01:07:27.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.P1d_79uU5lKYcD0LblQawCq4JIgsFGz_0 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12878032881513568644', time=2024-09-12T02:54:25.584865+0000, chain.objs.size()=1 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.ezfUWCvmZjddlG-JWY0hsdOy9pnYGwV_0 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8071433584403589776', time=2024-09-12T02:54:25.642232+0000, chain.objs.size()=1 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.GZiE9vAi1iHzfXt1md0EpUHtt04qxTb_0 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17192343529878579426', time=2024-09-12T02:54:25.714524+0000, chain.objs.size()=1 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.6TeSalY01Km54lXNv0tkj2j6ZPpSh0O_0 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16354865252419680581', time=2024-09-12T02:54:25.841880+0000, chain.objs.size()=1 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.nl0LdBOvD13T0-BlAYcet3t2qIyXbZk_0 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3213397947002853567', time=2024-09-12T02:54:25.939478+0000, chain.objs.size()=1 2024-09-12T01:07:27.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.fdN9hS4P2nODsCB5lz1HSkS-5Au7iP9_0 2024-09-12T01:07:27.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6864052827136230042', time=2024-09-12T02:54:26.013037+0000, chain.objs.size()=1 2024-09-12T01:07:27.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.oSxP5fXbQN97IJQ0PK-hzc4zp3jkCSb_0 2024-09-12T01:07:27.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9076620791637283978', time=2024-09-12T02:54:26.021159+0000, chain.objs.size()=1 2024-09-12T01:07:27.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.262__shadow_.3aWNY-ubsyuXFiSLJSBLmUSOTSRUTKa_0 2024-09-12T01:07:27.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12564120061436658068', time=2024-09-12T02:54:31.400965+0000, chain.objs.size()=1 2024-09-12T01:07:27.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.270__shadow_._tz-LKX8epeNCIVokI_CCQFfg2wDe4H_0 2024-09-12T01:07:27.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.2898497862985119436', time=2024-09-12T02:54:31.403120+0000, chain.objs.size()=1 2024-09-12T01:07:27.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.652+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.270__shadow_.2RpsX3h7Oz3AFObUN2S3UG4ZeI8x-Pz_0 2024-09-12T01:07:27.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17106059143532205784', time=2024-09-12T02:54:38.331777+0000, chain.objs.size()=1 2024-09-12T01:07:27.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.280__shadow_.NIk0oR23ZM0luYrYn0rpPCWYoO5U5HY_0 2024-09-12T01:07:27.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6341644838138468749', time=2024-09-12T02:54:40.465679+0000, chain.objs.size()=1 2024-09-12T01:07:27.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.283__shadow_.7_N0MqGA6trfelMW64rwCpuDDpeZjXX_0 2024-09-12T01:07:27.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3449094662343341502', time=2024-09-12T02:55:30.903393+0000, chain.objs.size()=1 2024-09-12T01:07:27.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.zW0qfTewJD6FhYu6yaZ_kdzbs8pp72M_0 2024-09-12T01:07:27.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8268968398494259084', time=2024-09-12T02:55:30.908924+0000, chain.objs.size()=1 2024-09-12T01:07:27.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.z1qTviRyFP6WjWHUBtioXxEyqK1Hn20_0 2024-09-12T01:07:27.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13638592026397199157', time=2024-09-12T02:55:30.959688+0000, chain.objs.size()=1 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.2a6V3KAad_DUQk23JyK50jw-e0qyH-H_0 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17062576644552225462', time=2024-09-12T02:55:30.966234+0000, chain.objs.size()=1 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.SLfnRKgMshPCajmAGbugk6zW19J3lvL_0 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.276071830557319616', time=2024-09-12T02:55:31.014705+0000, chain.objs.size()=1 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.6YEFnZVvzaTduVvVaR7VT7gUlm2DK0z_0 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6111583634289604947', time=2024-09-12T02:55:31.017278+0000, chain.objs.size()=1 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.VPZ7O5wTatukCQO9p6K0KwyRKt2Ho4-_0 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15958006844408393896', time=2024-09-12T02:55:31.275758+0000, chain.objs.size()=1 2024-09-12T01:07:27.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.656+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.io1d2T8ZQqRBcQ5DIezO4NxhVmmJs5o_0 2024-09-12T01:07:27.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.257818862690859412', time=2024-09-12T02:55:31.311756+0000, chain.objs.size()=1 2024-09-12T01:07:27.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1t11ypknsyptbMhSkmb1JZ9JnvpdI1a_0 2024-09-12T01:07:27.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5593650973958651413', time=2024-09-12T02:55:31.979200+0000, chain.objs.size()=1 2024-09-12T01:07:27.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.1d2qknfXOnK_CYZAQ5zOtqO-kljnslR_0 2024-09-12T01:07:27.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17528860651960085392', time=2024-09-12T02:55:31.983544+0000, chain.objs.size()=1 2024-09-12T01:07:27.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.TSF6sJcfozqUrJCneCZ4ZkJTj3OZ-9T_0 2024-09-12T01:07:27.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9887622411454506174', time=2024-09-12T02:55:32.053389+0000, chain.objs.size()=1 2024-09-12T01:07:27.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.KohfjStslrP8Px4n9IL1dTd3Efozk84_0 2024-09-12T01:07:27.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9405868173709869665', time=2024-09-12T02:55:32.059322+0000, chain.objs.size()=1 2024-09-12T01:07:27.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.OF2m1epk4UihZqJ3ns3W7-LJkF16_ai_0 2024-09-12T01:07:27.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13082935307946320513', time=2024-09-12T02:55:32.230354+0000, chain.objs.size()=1 2024-09-12T01:07:27.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.5YZCrRrUV2rM9N3KV5_NS-kCQjqE2V6_0 2024-09-12T01:07:27.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3350994734946340561', time=2024-09-12T02:55:32.257502+0000, chain.objs.size()=1 2024-09-12T01:07:27.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.660+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.A7imSyFuJMyA7ZSy00DkSDCH_RK3KX2_0 2024-09-12T01:07:27.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8032124069649122990', time=2024-09-12T02:55:32.906379+0000, chain.objs.size()=1 2024-09-12T01:07:27.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.b-XM2vYMV37FCgBSAqureXCu8wd5V2e_0 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16770693990086266661', time=2024-09-12T02:55:32.921966+0000, chain.objs.size()=1 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.eLsRupkyj_DO97-I2hmHq0Aj5I-tPmZ_0 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3022383929990586724', time=2024-09-12T02:55:32.988243+0000, chain.objs.size()=1 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.AmMlwlbLSaNf5_qX8rgvFz_5dT_Q4BS_0 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11328394641110944733', time=2024-09-12T02:55:33.018394+0000, chain.objs.size()=1 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.jRCxJKLwWjlDx8R8NQ-XOAkb39AfGMn_0 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13406660364686157884', time=2024-09-12T02:55:33.029375+0000, chain.objs.size()=1 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.j1l2ezkBV3Z9M8vEveahjOufR4Mg1vE_0 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15732136178453746452', time=2024-09-12T02:55:33.052852+0000, chain.objs.size()=1 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.G6Kk7v_2AouJSaxSb7ogAIQELbKm1ap_0 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8677046594422952749', time=2024-09-12T02:55:33.054917+0000, chain.objs.size()=1 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.MIsroh5pTGdYk7mHfqM5QKPTHgIL3Fe_0 2024-09-12T01:07:27.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13264100142697867149', time=2024-09-12T02:55:33.253100+0000, chain.objs.size()=1 2024-09-12T01:07:27.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.tCa62OV0Qi-BHW-WGJzOTGR2ffOdHum_0 2024-09-12T01:07:27.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5819065704092105621', time=2024-09-12T02:55:33.272674+0000, chain.objs.size()=1 2024-09-12T01:07:27.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.XZIUsFbB-v3yEhUB30FgeY8bcDHhgnD_0 2024-09-12T01:07:27.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14347388490378733091', time=2024-09-12T02:55:33.298118+0000, chain.objs.size()=1 2024-09-12T01:07:27.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.W4Be8vjloTFb1kjHRoQ4TSx2nhtS_5e_0 2024-09-12T01:07:27.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9216801596008518983', time=2024-09-12T02:55:33.328512+0000, chain.objs.size()=1 2024-09-12T01:07:27.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.664+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.323__shadow_.vTIw8wiI0ofrNrHSR8hZvoYWAvbz8xE_0 2024-09-12T01:07:27.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.4766961221228670829', time=2024-09-12T02:55:54.477503+0000, chain.objs.size()=1 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.eXc2vdNYbCB3TpGZQhgOYVqRbLFTOQr_0 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17489629220322089686', time=2024-09-12T02:55:54.533212+0000, chain.objs.size()=1 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.GuAHMowvn46JS_M_hBPXROhUiLHRrBL_0 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5183416644625002240', time=2024-09-12T02:55:54.546370+0000, chain.objs.size()=1 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.PcbwL8_Xw8SB2x_7QWZc14046zd77Zr_0 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16035036274754428761', time=2024-09-12T02:55:54.883904+0000, chain.objs.size()=1 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Wo1Ibnzt85kPHwlZEopzG1Sn7xsI5eV_0 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13548828977081824545', time=2024-09-12T02:55:54.964392+0000, chain.objs.size()=1 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.FmPxZkM3FKHK128-B5fBD82m9Oar7U1_0 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9027646517665999719', time=2024-09-12T02:55:55.008627+0000, chain.objs.size()=1 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.pCWxtRUbvOXwlWHt_Z7nfiXkmE9dpmq_0 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11203806654992362165', time=2024-09-12T02:55:55.134467+0000, chain.objs.size()=1 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.jVdQtDLcHl8bOV-WcLGG_lZ1gS1ZQaa_0 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11583558892591664665', time=2024-09-12T02:55:55.191708+0000, chain.objs.size()=1 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1DnvrEDgMuriRawXMqvLUk8NxNp8H5Q_0 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5128044657563779211', time=2024-09-12T02:55:55.263794+0000, chain.objs.size()=1 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.OmXPdVr-qy_zZSsPnsyV_wlcfEa8XQS_0 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9225551663914821584', time=2024-09-12T02:55:55.275616+0000, chain.objs.size()=1 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.Ms_T9lu7Ua_YvoW70UzlsTDl9KwDqOW_0 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13397384388951385143', time=2024-09-12T02:55:55.316372+0000, chain.objs.size()=1 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.668+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JjDXEQwoL7VvuV7W1--ZsXOxq2D2CeM_0 2024-09-12T01:07:27.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3826741932883481672', time=2024-09-12T02:55:55.668778+0000, chain.objs.size()=1 2024-09-12T01:07:27.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.LU5cdgN2EfNEKmDRHpZinqVwLNbJ1cv_0 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10537074182189033969', time=2024-09-12T02:55:55.688723+0000, chain.objs.size()=1 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.JIRav24sgvoHHOl2_Mzhwxb1qfU8NpA_0 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3125622224671809139', time=2024-09-12T02:55:55.834937+0000, chain.objs.size()=1 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.q6sJwSkrC0aFWVWBedLN5hQsvseW8ma_0 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14446093102363304766', time=2024-09-12T02:55:55.845362+0000, chain.objs.size()=1 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.BXSNDhhn6WNPXO0FwoywQMyxJBXGQs3_0 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.11081778800801472536', time=2024-09-12T02:55:55.920147+0000, chain.objs.size()=1 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.1gB2zc_GVLw-m2cVH2Xw6drVivD-sIR_0 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6895747846454019222', time=2024-09-12T02:55:55.941193+0000, chain.objs.size()=1 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.P1NwVKxO_cD1HPXAlumfTsghn2YWQ9o_0 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3762300432928554581', time=2024-09-12T02:55:55.982437+0000, chain.objs.size()=1 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.5HGXBP-a98IaUMCc_tb2h-wsEIJGJWB_0 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9162871268951487944', time=2024-09-12T02:55:56.174065+0000, chain.objs.size()=1 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.7wnlS08gh4iiyVzjNhps8JgY99bMU57_0 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12792978658589273287', time=2024-09-12T02:55:56.180891+0000, chain.objs.size()=1 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.ogdgrYjHrsMS-deamydf31wt4yLSkl0_0 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6226647346376021202', time=2024-09-12T02:55:56.260798+0000, chain.objs.size()=1 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.IOlHjZkcSKOm3yNLEeA5A8uG3weuasr_0 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5201927497230878208', time=2024-09-12T02:55:56.277438+0000, chain.objs.size()=1 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.WcZqof8HUrEie4uj6zXj-nmJcHt5A_U_0 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13910335722263777347', time=2024-09-12T02:55:56.354597+0000, chain.objs.size()=1 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.672+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.b0AXpiSN1jSJdi-WgM3VvprmUpGY03T_0 2024-09-12T01:07:27.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7507659440942410485', time=2024-09-12T02:55:56.502267+0000, chain.objs.size()=1 2024-09-12T01:07:27.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.sb3oTMBDsVNRsrQOlXv6CkXYbFhzuHS_0 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.5303394806270889306', time=2024-09-12T02:55:56.511573+0000, chain.objs.size()=1 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.wbMdWjnTRvhEoSdZKBMtK4RMimwUJTw_0 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8857471857935941656', time=2024-09-12T02:55:56.579746+0000, chain.objs.size()=1 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_._tyls2Z41ySuy6LtskF-hnVk1iDzAIj_0 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13873483607310332886', time=2024-09-12T02:55:56.634890+0000, chain.objs.size()=1 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.G96_hL0HPOYQfUZ6C693dEloD22uyLS_0 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.6233843208074374182', time=2024-09-12T02:55:56.820631+0000, chain.objs.size()=1 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.dYmLbBNs_rh-_WO-1RRY-2sAJHatFk3_0 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12849126934851782633', time=2024-09-12T02:55:56.857668+0000, chain.objs.size()=1 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.oib19sC9twMYa1ovImDpixnVds6ZZRn_0 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7825323927130926915', time=2024-09-12T02:55:56.913094+0000, chain.objs.size()=1 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.324__shadow_.HI8UUcQSD_S52aws2aSBEdU026AbkD0_0 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10740922611104402114', time=2024-09-12T02:56:29.705137+0000, chain.objs.size()=1 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.676+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.377__shadow_.CeG7rggV121D4Rt27nzu0eSJwOqILIL_0 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14174392818218417584', time=2024-09-12T02:57:07.602305+0000, chain.objs.size()=1 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.430__shadow_.HId91sAFAWPruaLldwtRPrj_SB1VECh_0 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14020532996458350512', time=2024-09-12T02:57:12.289283+0000, chain.objs.size()=1 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.437__shadow_.OcjfsWbdzdthotj6zzwsEfWxtYVo-hV_0 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7299413392811626839', time=2024-09-12T02:57:34.459736+0000, chain.objs.size()=1 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.463__shadow_.FXf2dgspvSUc8Cs9S0Wzrr7Q73x8eCo_0 2024-09-12T01:07:27.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.15312651918270818522', time=2024-09-12T02:58:01.739274+0000, chain.objs.size()=6 2024-09-12T01:07:27.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.1 2024-09-12T01:07:27.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.2 2024-09-12T01:07:27.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.3 2024-09-12T01:07:27.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.4 2024-09-12T01:07:27.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.5 2024-09-12T01:07:27.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.6 2024-09-12T01:07:27.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3664678051649822221', time=2024-09-12T02:58:01.869785+0000, chain.objs.size()=6 2024-09-12T01:07:27.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.1 2024-09-12T01:07:27.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.2 2024-09-12T01:07:27.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.680+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.3 2024-09-12T01:07:27.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.4 2024-09-12T01:07:27.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.5 2024-09-12T01:07:27.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.507__multipart_srcmultipart.2~fcirJMZ_Lmm44hzDEzASnxf3Z7WkHAh.6 2024-09-12T01:07:27.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13991648168316036109', time=2024-09-12T02:58:04.652452+0000, chain.objs.size()=1 2024-09-12T01:07:27.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.513__multipart_mymultipart.2~f9TSgoaG6hSZB2kjs0SD-mk9jYu_xFD.1 2024-09-12T01:07:27.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.3352011316563348472', time=2024-09-12T02:58:09.498768+0000, chain.objs.size()=1 2024-09-12T01:07:27.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.517__shadow_.WqaKidCdNPPk06zf2RWxmefpczoElgk_0 2024-09-12T01:07:27.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17893424862257156849', time=2024-09-12T02:58:17.913662+0000, chain.objs.size()=1 2024-09-12T01:07:27.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.684+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.520__shadow:g1Ryu5zzDTbFIiEeFTY1LuGcKGtB68U_.-F_OxjhK4nc-ZG_VyiQoK0isa6FDir8_0 2024-09-12T01:07:27.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tSFvLDhgtZeZ48IhN7SK0MEhQbpvmtp', time=2024-09-12T02:58:48.879732+0000, chain.objs.size()=1 2024-09-12T01:07:27.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.531__multipart_mymultipart2.2~tSFvLDhgtZeZ48IhN7SK0MEhQbpvmtp.1 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.17747488791031536166', time=2024-09-12T03:00:02.478914+0000, chain.objs.size()=1 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.572__shadow_.N8-rsDKeOipc0nDBYthnLQ4udy-NB1d_0 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7158636901879702364', time=2024-09-12T03:00:09.579339+0000, chain.objs.size()=1 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.576__shadow:D2.O0am.Y29mwyK9WCYR438cA946cIq_.HbN42-dqJ8Ye0sh3H3uj9Gjw11MofmK_0 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.12543540732099333952', time=2024-09-12T03:00:16.818838+0000, chain.objs.size()=1 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.577__shadow:ZZsUK7.p6mkNrLoFUKa2QqsSQyI3WKB_.8e74t3xSixAMc6EZef-4tZ79eCuLxpb_0 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.14516465886899764033', time=2024-09-12T03:00:35.231028+0000, chain.objs.size()=1 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:3VbObyn7MNZ4T9JQ5VnFyBSsAyBUV3f_.Iz_W11iMAGAHhbphhBwMhiqRo-IyT2F_0 2024-09-12T01:07:27.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.13144829468633753186', time=2024-09-12T03:00:35.245565+0000, chain.objs.size()=1 2024-09-12T01:07:27.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.579__shadow:P8VCZMMObDDzBym1xRgHaEuYf0wAhn2_.ZwCw2yrsBTPIxeHk6M485M4RfTkV5eg_0 2024-09-12T01:07:27.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9040210462624547936', time=2024-09-12T03:00:52.648512+0000, chain.objs.size()=1 2024-09-12T01:07:27.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.604__shadow_.WV6upqvEl4Jpy_QAbfOFj8chmXovrTO_0 2024-09-12T01:07:27.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.7946350075440446564', time=2024-09-12T03:03:28.208845+0000, chain.objs.size()=1 2024-09-12T01:07:27.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.634__shadow_.ITofgwOYV_XdQ8tholEu2PwdDEBeVbV_0 2024-09-12T01:07:27.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10581196612681553726', time=2024-09-12T03:03:33.118102+0000, chain.objs.size()=1 2024-09-12T01:07:27.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.642__shadow_.aKNgvXXCW1MV4Q-WL7K7pkf_f-1K2Z0_0 2024-09-12T01:07:27.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9084286949492376211', time=2024-09-12T03:03:38.328444+0000, chain.objs.size()=1 2024-09-12T01:07:27.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.648__shadow_.g_PU7Yyz8VerBMnxv0oHWomqHKMy76J_0 2024-09-12T01:07:27.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.10602613175135536652', time=2024-09-12T03:03:41.517537+0000, chain.objs.size()=1 2024-09-12T01:07:27.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.688+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.652__shadow_.jt4jvsU9wEnzPFCshO2bBkuupAR8r7i_0 2024-09-12T01:07:27.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.692+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54260 2024-09-12T01:07:27.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:07:27.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.9108062508981607290', time=2024-09-12T03:03:42.232449+0000, chain.objs.size()=1 2024-09-12T01:07:27.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.653__shadow_.h0l1TP-4Du4n7__OakLViv9TAzLxu3M_0 2024-09-12T01:07:27.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.16865533719735350322', time=2024-09-12T03:04:11.720290+0000, chain.objs.size()=1 2024-09-12T01:07:27.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.696__shadow:R-g5ZwSzCE1RhOnQ4xTvuw25IVRuQ9a_.CTuhf0xuzfulgLG9dPOjZO_TgAho1Tp_0 2024-09-12T01:07:27.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.696+0000 7fbe17aed9c0 20 garbage collection: RGWGC::process iterating over entry tag='68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.8754027645878782430', time=2024-09-12T03:04:46.453601+0000, chain.objs.size()=1 2024-09-12T01:07:27.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:68f093c2-d97a-4f4c-96cb-d3cbe2b155a4.4571.719__shadow_.do8cj_PQtqjYNwB-t-I5CwoB5LQjfiR_0 2024-09-12T01:07:27.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.696+0000 7fbe17aed9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:07:27.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.700+0000 7fbccbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:07:27.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.700+0000 7fbe17aed9c0 20 remove_watcher() i=0 2024-09-12T01:07:27.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.700+0000 7fbe17aed9c0 2 removed watcher, disabling cache 2024-09-12T01:07:27.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.704+0000 7fbe17aed9c0 20 remove_watcher() i=1 2024-09-12T01:07:27.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.704+0000 7fbe17aed9c0 20 remove_watcher() i=2 2024-09-12T01:07:27.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.704+0000 7fbe17aed9c0 20 remove_watcher() i=3 2024-09-12T01:07:27.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.704+0000 7fbe17aed9c0 20 remove_watcher() i=4 2024-09-12T01:07:27.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.708+0000 7fbe17aed9c0 20 remove_watcher() i=5 2024-09-12T01:07:27.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.708+0000 7fbe17aed9c0 20 remove_watcher() i=6 2024-09-12T01:07:27.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T01:07:27.708+0000 7fbe17aed9c0 20 remove_watcher() i=7 2024-09-12T01:07:27.722 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:07:27.757 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T01:07:27.770 DEBUG:teuthology.orchestra.run.smithi137:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:07:27.815 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T01:07:27.863 DEBUG:teuthology.orchestra.run.smithi137:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:07:27.911 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-12T01:07:27.967 DEBUG:teuthology.orchestra.run.smithi137:> sudo update-ca-certificates 2024-09-12T01:07:28.024 INFO:teuthology.orchestra.run.smithi137.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T01:07:28.360 INFO:teuthology.orchestra.run.smithi137.stdout:0 added, 0 removed; done. 2024-09-12T01:07:28.360 INFO:teuthology.orchestra.run.smithi137.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T01:07:28.361 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:07:28.682 INFO:teuthology.orchestra.run.smithi137.stdout:done. 2024-09-12T01:07:28.682 INFO:teuthology.orchestra.run.smithi137.stdout:done. 2024-09-12T01:07:28.685 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:07:28.716 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:07:28.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:07:29.035 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:07:29.050 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T01:07:29.053 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1644,"stamp":"2024-09-12T01:07:27.128391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658093208,"num_objects":4873,"num_object_clones":0,"num_object_copies":14205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4873,"num_whiteouts":0,"num_read":174683,"num_read_kb":2337341,"num_write":138352,"num_write_kb":2353676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13601,"ondisk_log_size":13601,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2530880,"kb_used_data":1128064,"kb_used_omap":12,"kb_used_meta":1402675,"kb_avail":752443840,"statfs":{"total":773094113280,"available":770502492160,"internally_reserved":0,"allocated":1155137536,"data_stored":1138795522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1436339761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009899"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587141+0000","last_change":"2024-09-12T00:49:10.624205+0000","last_active":"2024-09-12T01:04:14.587141+0000","last_peered":"2024-09-12T01:04:14.587141+0000","last_clean":"2024-09-12T01:04:14.587141+0000","last_became_active":"2024-09-12T00:49:10.623491+0000","last_became_peered":"2024-09-12T00:49:10.623491+0000","last_unstale":"2024-09-12T01:04:14.587141+0000","last_undegraded":"2024-09-12T01:04:14.587141+0000","last_fullsized":"2024-09-12T01:04:14.587141+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.660122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"267'6","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.755161+0000","last_change":"2024-09-12T00:38:10.688649+0000","last_active":"2024-09-12T01:03:14.755161+0000","last_peered":"2024-09-12T01:03:14.755161+0000","last_clean":"2024-09-12T01:03:14.755161+0000","last_became_active":"2024-09-12T00:38:10.687911+0000","last_became_peered":"2024-09-12T00:38:10.687911+0000","last_unstale":"2024-09-12T01:03:14.755161+0000","last_undegraded":"2024-09-12T01:03:14.755161+0000","last_fullsized":"2024-09-12T01:03:14.755161+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:09.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.571671+0000","last_change":"2024-09-12T00:38:07.665498+0000","last_active":"2024-09-12T01:03:08.571671+0000","last_peered":"2024-09-12T01:03:08.571671+0000","last_clean":"2024-09-12T01:03:08.571671+0000","last_became_active":"2024-09-12T00:38:07.664779+0000","last_became_peered":"2024-09-12T00:38:07.664779+0000","last_unstale":"2024-09-12T01:03:08.571671+0000","last_undegraded":"2024-09-12T01:03:08.571671+0000","last_fullsized":"2024-09-12T01:03:08.571671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.524540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'50","reported_seq":182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.429135+0000","last_change":"2024-09-12T00:36:37.236134+0000","last_active":"2024-09-12T01:03:50.429135+0000","last_peered":"2024-09-12T01:03:50.429135+0000","last_clean":"2024-09-12T01:03:50.429135+0000","last_became_active":"2024-09-12T00:36:37.223686+0000","last_became_peered":"2024-09-12T00:36:37.223686+0000","last_unstale":"2024-09-12T01:03:50.429135+0000","last_undegraded":"2024-09-12T01:03:50.429135+0000","last_fullsized":"2024-09-12T01:03:50.429135+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:53.656045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":201,"num_write":87,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.582523+0000","last_change":"2024-09-12T00:49:10.625393+0000","last_active":"2024-09-12T01:04:14.582523+0000","last_peered":"2024-09-12T01:04:14.582523+0000","last_clean":"2024-09-12T01:04:14.582523+0000","last_became_active":"2024-09-12T00:49:10.624700+0000","last_became_peered":"2024-09-12T00:49:10.624700+0000","last_unstale":"2024-09-12T01:04:14.582523+0000","last_undegraded":"2024-09-12T01:04:14.582523+0000","last_fullsized":"2024-09-12T01:04:14.582523+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"267'7","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.734454+0000","last_change":"2024-09-12T00:38:10.696907+0000","last_active":"2024-09-12T01:03:14.734454+0000","last_peered":"2024-09-12T01:03:14.734454+0000","last_clean":"2024-09-12T01:03:14.734454+0000","last_became_active":"2024-09-12T00:38:10.691195+0000","last_became_peered":"2024-09-12T00:38:10.691195+0000","last_unstale":"2024-09-12T01:03:14.734454+0000","last_undegraded":"2024-09-12T01:03:14.734454+0000","last_fullsized":"2024-09-12T01:03:14.734454+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.105627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"267'7","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.590149+0000","last_change":"2024-09-12T00:38:07.665354+0000","last_active":"2024-09-12T01:03:09.590149+0000","last_peered":"2024-09-12T01:03:09.590149+0000","last_clean":"2024-09-12T01:03:09.590149+0000","last_became_active":"2024-09-12T00:38:07.664663+0000","last_became_peered":"2024-09-12T00:38:07.664663+0000","last_unstale":"2024-09-12T01:03:09.590149+0000","last_undegraded":"2024-09-12T01:03:09.590149+0000","last_fullsized":"2024-09-12T01:03:09.590149+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.495162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587630+0000","last_change":"2024-09-12T00:36:37.240047+0000","last_active":"2024-09-12T01:04:49.587630+0000","last_peered":"2024-09-12T01:04:49.587630+0000","last_clean":"2024-09-12T01:04:49.587630+0000","last_became_active":"2024-09-12T00:36:37.239199+0000","last_became_peered":"2024-09-12T00:36:37.239199+0000","last_unstale":"2024-09-12T01:04:49.587630+0000","last_undegraded":"2024-09-12T01:04:49.587630+0000","last_fullsized":"2024-09-12T01:04:49.587630+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:11.845055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.762541+0000","last_change":"2024-09-12T00:49:10.612385+0000","last_active":"2024-09-12T01:03:44.762541+0000","last_peered":"2024-09-12T01:03:44.762541+0000","last_clean":"2024-09-12T01:03:44.762541+0000","last_became_active":"2024-09-12T00:49:10.611715+0000","last_became_peered":"2024-09-12T00:49:10.611715+0000","last_unstale":"2024-09-12T01:03:44.762541+0000","last_undegraded":"2024-09-12T01:03:44.762541+0000","last_fullsized":"2024-09-12T01:03:44.762541+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:44.906371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"267'10","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622484+0000","last_change":"2024-09-12T00:38:10.708434+0000","last_active":"2024-09-12T01:05:19.622484+0000","last_peered":"2024-09-12T01:05:19.622484+0000","last_clean":"2024-09-12T01:05:19.622484+0000","last_became_active":"2024-09-12T00:38:10.702832+0000","last_became_peered":"2024-09-12T00:38:10.702832+0000","last_unstale":"2024-09-12T01:05:19.622484+0000","last_undegraded":"2024-09-12T01:05:19.622484+0000","last_fullsized":"2024-09-12T01:05:19.622484+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:02.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":26653,"num_write":15,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.586519+0000","last_change":"2024-09-12T00:38:07.656103+0000","last_active":"2024-09-12T01:04:13.586519+0000","last_peered":"2024-09-12T01:04:13.586519+0000","last_clean":"2024-09-12T01:04:13.586519+0000","last_became_active":"2024-09-12T00:38:07.654162+0000","last_became_peered":"2024-09-12T00:38:07.654162+0000","last_unstale":"2024-09-12T01:04:13.586519+0000","last_undegraded":"2024-09-12T01:04:13.586519+0000","last_fullsized":"2024-09-12T01:04:13.586519+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:51.681421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'61","reported_seq":215,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.745657+0000","last_change":"2024-09-12T00:36:37.244669+0000","last_active":"2024-09-12T01:05:03.745657+0000","last_peered":"2024-09-12T01:05:03.745657+0000","last_clean":"2024-09-12T01:05:03.745657+0000","last_became_active":"2024-09-12T00:36:37.243951+0000","last_became_peered":"2024-09-12T00:36:37.243951+0000","last_unstale":"2024-09-12T01:05:03.745657+0000","last_undegraded":"2024-09-12T01:05:03.745657+0000","last_fullsized":"2024-09-12T01:05:03.745657+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:02.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":228,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600226+0000","last_change":"2024-09-12T00:49:10.614295+0000","last_active":"2024-09-12T01:03:49.600226+0000","last_peered":"2024-09-12T01:03:49.600226+0000","last_clean":"2024-09-12T01:03:49.600226+0000","last_became_active":"2024-09-12T00:49:10.613525+0000","last_became_peered":"2024-09-12T00:49:10.613525+0000","last_unstale":"2024-09-12T01:03:49.600226+0000","last_undegraded":"2024-09-12T01:03:49.600226+0000","last_fullsized":"2024-09-12T01:03:49.600226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:34.120845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'8","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.607603+0000","last_change":"2024-09-12T00:38:10.702125+0000","last_active":"2024-09-12T01:04:19.607603+0000","last_peered":"2024-09-12T01:04:19.607603+0000","last_clean":"2024-09-12T01:04:19.607603+0000","last_became_active":"2024-09-12T00:38:10.701406+0000","last_became_peered":"2024-09-12T00:38:10.701406+0000","last_unstale":"2024-09-12T01:04:19.607603+0000","last_undegraded":"2024-09-12T01:04:19.607603+0000","last_fullsized":"2024-09-12T01:04:19.607603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.321347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":23552,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'4","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.783176+0000","last_change":"2024-09-12T00:38:07.642044+0000","last_active":"2024-09-12T01:05:14.783176+0000","last_peered":"2024-09-12T01:05:14.783176+0000","last_clean":"2024-09-12T01:05:14.783176+0000","last_became_active":"2024-09-12T00:38:07.639897+0000","last_became_peered":"2024-09-12T00:38:07.639897+0000","last_unstale":"2024-09-12T01:05:14.783176+0000","last_undegraded":"2024-09-12T01:05:14.783176+0000","last_fullsized":"2024-09-12T01:05:14.783176+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:48.556221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4625,"num_write":4,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'49","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.581394+0000","last_change":"2024-09-12T00:36:37.236688+0000","last_active":"2024-09-12T01:04:09.581394+0000","last_peered":"2024-09-12T01:04:09.581394+0000","last_clean":"2024-09-12T01:04:09.581394+0000","last_became_active":"2024-09-12T00:36:37.235921+0000","last_became_peered":"2024-09-12T00:36:37.235921+0000","last_unstale":"2024-09-12T01:04:09.581394+0000","last_undegraded":"2024-09-12T01:04:09.581394+0000","last_fullsized":"2024-09-12T01:04:09.581394+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:57.656212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":160,"num_write":94,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.601979+0000","last_change":"2024-09-12T00:49:10.640862+0000","last_active":"2024-09-12T01:05:18.601979+0000","last_peered":"2024-09-12T01:05:18.601979+0000","last_clean":"2024-09-12T01:05:18.601979+0000","last_became_active":"2024-09-12T00:49:10.640187+0000","last_became_peered":"2024-09-12T00:49:10.640187+0000","last_unstale":"2024-09-12T01:05:18.601979+0000","last_undegraded":"2024-09-12T01:05:18.601979+0000","last_fullsized":"2024-09-12T01:05:18.601979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.913407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.596205+0000","last_change":"2024-09-12T00:38:10.702920+0000","last_active":"2024-09-12T01:04:54.596205+0000","last_peered":"2024-09-12T01:04:54.596205+0000","last_clean":"2024-09-12T01:04:54.596205+0000","last_became_active":"2024-09-12T00:38:10.702113+0000","last_became_peered":"2024-09-12T00:38:10.702113+0000","last_unstale":"2024-09-12T01:04:54.596205+0000","last_undegraded":"2024-09-12T01:04:54.596205+0000","last_fullsized":"2024-09-12T01:04:54.596205+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:03.161296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.613854+0000","last_change":"2024-09-12T00:38:07.661344+0000","last_active":"2024-09-12T01:04:44.613854+0000","last_peered":"2024-09-12T01:04:44.613854+0000","last_clean":"2024-09-12T01:04:44.613854+0000","last_became_active":"2024-09-12T00:38:07.660159+0000","last_became_peered":"2024-09-12T00:38:07.660159+0000","last_unstale":"2024-09-12T01:04:44.613854+0000","last_undegraded":"2024-09-12T01:04:44.613854+0000","last_fullsized":"2024-09-12T01:04:44.613854+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:05.309641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'28","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.675076+0000","last_change":"2024-09-12T00:36:37.251730+0000","last_active":"2024-09-12T01:04:15.675076+0000","last_peered":"2024-09-12T01:04:15.675076+0000","last_clean":"2024-09-12T01:04:15.675076+0000","last_became_active":"2024-09-12T00:36:37.248920+0000","last_became_peered":"2024-09-12T00:36:37.248920+0000","last_unstale":"2024-09-12T01:04:15.675076+0000","last_undegraded":"2024-09-12T01:04:15.675076+0000","last_fullsized":"2024-09-12T01:04:15.675076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.363028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574475+0000","last_change":"2024-09-12T00:49:10.640254+0000","last_active":"2024-09-12T01:03:49.574475+0000","last_peered":"2024-09-12T01:03:49.574475+0000","last_clean":"2024-09-12T01:03:49.574475+0000","last_became_active":"2024-09-12T00:49:10.638196+0000","last_became_peered":"2024-09-12T00:49:10.638196+0000","last_unstale":"2024-09-12T01:03:49.574475+0000","last_undegraded":"2024-09-12T01:03:49.574475+0000","last_fullsized":"2024-09-12T01:03:49.574475+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:50.165315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634261+0000","last_change":"2024-09-12T00:38:10.715254+0000","last_active":"2024-09-12T01:04:49.634261+0000","last_peered":"2024-09-12T01:04:49.634261+0000","last_clean":"2024-09-12T01:04:49.634261+0000","last_became_active":"2024-09-12T00:38:10.714503+0000","last_became_peered":"2024-09-12T00:38:10.714503+0000","last_unstale":"2024-09-12T01:04:49.634261+0000","last_undegraded":"2024-09-12T01:04:49.634261+0000","last_fullsized":"2024-09-12T01:04:49.634261+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.076577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"267'4","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634359+0000","last_change":"2024-09-12T00:38:07.659781+0000","last_active":"2024-09-12T01:04:49.634359+0000","last_peered":"2024-09-12T01:04:49.634359+0000","last_clean":"2024-09-12T01:04:49.634359+0000","last_became_active":"2024-09-12T00:38:07.656570+0000","last_became_peered":"2024-09-12T00:38:07.656570+0000","last_unstale":"2024-09-12T01:04:49.634359+0000","last_undegraded":"2024-09-12T01:04:49.634359+0000","last_fullsized":"2024-09-12T01:04:49.634359+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.888062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'40","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.829646+0000","last_change":"2024-09-12T00:36:37.239747+0000","last_active":"2024-09-12T01:05:02.829646+0000","last_peered":"2024-09-12T01:05:02.829646+0000","last_clean":"2024-09-12T01:05:02.829646+0000","last_became_active":"2024-09-12T00:36:37.239055+0000","last_became_peered":"2024-09-12T00:36:37.239055+0000","last_unstale":"2024-09-12T01:05:02.829646+0000","last_undegraded":"2024-09-12T01:05:02.829646+0000","last_fullsized":"2024-09-12T01:05:02.829646+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:58.947633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":128,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748036+0000","last_change":"2024-09-12T00:49:10.625186+0000","last_active":"2024-09-12T01:04:09.748036+0000","last_peered":"2024-09-12T01:04:09.748036+0000","last_clean":"2024-09-12T01:04:09.748036+0000","last_became_active":"2024-09-12T00:49:10.624542+0000","last_became_peered":"2024-09-12T00:49:10.624542+0000","last_unstale":"2024-09-12T01:04:09.748036+0000","last_undegraded":"2024-09-12T01:04:09.748036+0000","last_fullsized":"2024-09-12T01:04:09.748036+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:44.317158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.734406+0000","last_change":"2024-09-12T00:38:10.698782+0000","last_active":"2024-09-12T01:03:14.734406+0000","last_peered":"2024-09-12T01:03:14.734406+0000","last_clean":"2024-09-12T01:03:14.734406+0000","last_became_active":"2024-09-12T00:38:10.698076+0000","last_became_peered":"2024-09-12T00:38:10.698076+0000","last_unstale":"2024-09-12T01:03:14.734406+0000","last_undegraded":"2024-09-12T01:03:14.734406+0000","last_fullsized":"2024-09-12T01:03:14.734406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.783233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.573024+0000","last_change":"2024-09-12T00:38:07.627893+0000","last_active":"2024-09-12T01:03:09.573024+0000","last_peered":"2024-09-12T01:03:09.573024+0000","last_clean":"2024-09-12T01:03:09.573024+0000","last_became_active":"2024-09-12T00:38:07.626956+0000","last_became_peered":"2024-09-12T00:38:07.626956+0000","last_unstale":"2024-09-12T01:03:09.573024+0000","last_undegraded":"2024-09-12T01:03:09.573024+0000","last_fullsized":"2024-09-12T01:03:09.573024+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.872892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'29","reported_seq":124,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.573884+0000","last_change":"2024-09-12T00:36:37.240924+0000","last_active":"2024-09-12T01:03:18.573884+0000","last_peered":"2024-09-12T01:03:18.573884+0000","last_clean":"2024-09-12T01:03:18.573884+0000","last_became_active":"2024-09-12T00:36:37.239412+0000","last_became_peered":"2024-09-12T00:36:37.239412+0000","last_unstale":"2024-09-12T01:03:18.573884+0000","last_undegraded":"2024-09-12T01:03:18.573884+0000","last_fullsized":"2024-09-12T01:03:18.573884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:01.137832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":107,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587293+0000","last_change":"2024-09-12T00:49:10.628369+0000","last_active":"2024-09-12T01:04:14.587293+0000","last_peered":"2024-09-12T01:04:14.587293+0000","last_clean":"2024-09-12T01:04:14.587293+0000","last_became_active":"2024-09-12T00:49:10.623930+0000","last_became_peered":"2024-09-12T00:49:10.623930+0000","last_unstale":"2024-09-12T01:04:14.587293+0000","last_undegraded":"2024-09-12T01:04:14.587293+0000","last_fullsized":"2024-09-12T01:04:14.587293+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.045569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.572802+0000","last_change":"2024-09-12T00:38:10.710382+0000","last_active":"2024-09-12T01:03:13.572802+0000","last_peered":"2024-09-12T01:03:13.572802+0000","last_clean":"2024-09-12T01:03:13.572802+0000","last_became_active":"2024-09-12T00:38:10.709065+0000","last_became_peered":"2024-09-12T00:38:10.709065+0000","last_unstale":"2024-09-12T01:03:13.572802+0000","last_undegraded":"2024-09-12T01:03:13.572802+0000","last_fullsized":"2024-09-12T01:03:13.572802+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:25.778926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.566642+0000","last_change":"2024-09-12T00:38:07.659182+0000","last_active":"2024-09-12T01:03:09.566642+0000","last_peered":"2024-09-12T01:03:09.566642+0000","last_clean":"2024-09-12T01:03:09.566642+0000","last_became_active":"2024-09-12T00:38:07.658039+0000","last_became_peered":"2024-09-12T00:38:07.658039+0000","last_unstale":"2024-09-12T01:03:09.566642+0000","last_undegraded":"2024-09-12T01:03:09.566642+0000","last_fullsized":"2024-09-12T01:03:09.566642+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:05.041242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":3,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'24","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567579+0000","last_change":"2024-09-12T00:36:37.243485+0000","last_active":"2024-09-12T01:03:14.567579+0000","last_peered":"2024-09-12T01:03:14.567579+0000","last_clean":"2024-09-12T01:03:14.567579+0000","last_became_active":"2024-09-12T00:36:37.238156+0000","last_became_peered":"2024-09-12T00:36:37.238156+0000","last_unstale":"2024-09-12T01:03:14.567579+0000","last_undegraded":"2024-09-12T01:03:14.567579+0000","last_fullsized":"2024-09-12T01:03:14.567579+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:40.335893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":66,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.591380+0000","last_change":"2024-09-12T00:49:10.614687+0000","last_active":"2024-09-12T01:03:14.591380+0000","last_peered":"2024-09-12T01:03:14.591380+0000","last_clean":"2024-09-12T01:03:14.591380+0000","last_became_active":"2024-09-12T00:49:10.614006+0000","last_became_peered":"2024-09-12T00:49:10.614006+0000","last_unstale":"2024-09-12T01:03:14.591380+0000","last_undegraded":"2024-09-12T01:03:14.591380+0000","last_fullsized":"2024-09-12T01:03:14.591380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.570199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.594424+0000","last_change":"2024-09-12T00:38:10.692661+0000","last_active":"2024-09-12T01:04:48.594424+0000","last_peered":"2024-09-12T01:04:48.594424+0000","last_clean":"2024-09-12T01:04:48.594424+0000","last_became_active":"2024-09-12T00:38:10.691887+0000","last_became_peered":"2024-09-12T00:38:10.691887+0000","last_unstale":"2024-09-12T01:04:48.594424+0000","last_undegraded":"2024-09-12T01:04:48.594424+0000","last_fullsized":"2024-09-12T01:04:48.594424+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.050768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619962+0000","last_change":"2024-09-12T00:38:07.654631+0000","last_active":"2024-09-12T01:03:54.619962+0000","last_peered":"2024-09-12T01:03:54.619962+0000","last_clean":"2024-09-12T01:03:54.619962+0000","last_became_active":"2024-09-12T00:38:07.653685+0000","last_became_peered":"2024-09-12T00:38:07.653685+0000","last_unstale":"2024-09-12T01:03:54.619962+0000","last_undegraded":"2024-09-12T01:03:54.619962+0000","last_fullsized":"2024-09-12T01:03:54.619962+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:49.445932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'8","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567005+0000","last_change":"2024-09-12T00:36:37.229918+0000","last_active":"2024-09-12T01:03:14.567005+0000","last_peered":"2024-09-12T01:03:14.567005+0000","last_clean":"2024-09-12T01:03:14.567005+0000","last_became_active":"2024-09-12T00:36:37.223860+0000","last_became_peered":"2024-09-12T00:36:37.223860+0000","last_unstale":"2024-09-12T01:03:14.567005+0000","last_undegraded":"2024-09-12T01:03:14.567005+0000","last_fullsized":"2024-09-12T01:03:14.567005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:21.022755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567701+0000","last_change":"2024-09-12T00:49:10.623954+0000","last_active":"2024-09-12T01:03:14.567701+0000","last_peered":"2024-09-12T01:03:14.567701+0000","last_clean":"2024-09-12T01:03:14.567701+0000","last_became_active":"2024-09-12T00:49:10.622347+0000","last_became_peered":"2024-09-12T00:49:10.622347+0000","last_unstale":"2024-09-12T01:03:14.567701+0000","last_undegraded":"2024-09-12T01:03:14.567701+0000","last_fullsized":"2024-09-12T01:03:14.567701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:20.923775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.602778+0000","last_change":"2024-09-12T00:38:10.718025+0000","last_active":"2024-09-12T01:03:59.602778+0000","last_peered":"2024-09-12T01:03:59.602778+0000","last_clean":"2024-09-12T01:03:59.602778+0000","last_became_active":"2024-09-12T00:38:10.717358+0000","last_became_peered":"2024-09-12T00:38:10.717358+0000","last_unstale":"2024-09-12T01:03:59.602778+0000","last_undegraded":"2024-09-12T01:03:59.602778+0000","last_fullsized":"2024-09-12T01:03:59.602778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:56.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.593987+0000","last_change":"2024-09-12T00:38:07.639460+0000","last_active":"2024-09-12T01:04:44.593987+0000","last_peered":"2024-09-12T01:04:44.593987+0000","last_clean":"2024-09-12T01:04:44.593987+0000","last_became_active":"2024-09-12T00:38:07.638712+0000","last_became_peered":"2024-09-12T00:38:07.638712+0000","last_unstale":"2024-09-12T01:04:44.593987+0000","last_undegraded":"2024-09-12T01:04:44.593987+0000","last_fullsized":"2024-09-12T01:04:44.593987+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:01.987566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'20","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.646910+0000","last_change":"2024-09-12T00:36:37.224823+0000","last_active":"2024-09-12T01:03:20.646910+0000","last_peered":"2024-09-12T01:03:20.646910+0000","last_clean":"2024-09-12T01:03:20.646910+0000","last_became_active":"2024-09-12T00:36:37.223487+0000","last_became_peered":"2024-09-12T00:36:37.223487+0000","last_unstale":"2024-09-12T01:03:20.646910+0000","last_undegraded":"2024-09-12T01:03:20.646910+0000","last_fullsized":"2024-09-12T01:03:20.646910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.907220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":70,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.733136+0000","last_change":"2024-09-12T00:49:10.612000+0000","last_active":"2024-09-12T01:03:09.733136+0000","last_peered":"2024-09-12T01:03:09.733136+0000","last_clean":"2024-09-12T01:03:09.733136+0000","last_became_active":"2024-09-12T00:49:10.611251+0000","last_became_peered":"2024-09-12T00:49:10.611251+0000","last_unstale":"2024-09-12T01:03:09.733136+0000","last_undegraded":"2024-09-12T01:03:09.733136+0000","last_fullsized":"2024-09-12T01:03:09.733136+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:41.354887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"267'3","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.594549+0000","last_change":"2024-09-12T00:38:10.707668+0000","last_active":"2024-09-12T01:04:48.594549+0000","last_peered":"2024-09-12T01:04:48.594549+0000","last_clean":"2024-09-12T01:04:48.594549+0000","last_became_active":"2024-09-12T00:38:10.706726+0000","last_became_peered":"2024-09-12T00:38:10.706726+0000","last_unstale":"2024-09-12T01:04:48.594549+0000","last_undegraded":"2024-09-12T01:04:48.594549+0000","last_fullsized":"2024-09-12T01:04:48.594549+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:45.954816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242728,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8240,"num_write":8,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:43.593390+0000","last_change":"2024-09-12T00:38:07.668470+0000","last_active":"2024-09-12T01:04:43.593390+0000","last_peered":"2024-09-12T01:04:43.593390+0000","last_clean":"2024-09-12T01:04:43.593390+0000","last_became_active":"2024-09-12T00:38:07.667724+0000","last_became_peered":"2024-09-12T00:38:07.667724+0000","last_unstale":"2024-09-12T01:04:43.593390+0000","last_undegraded":"2024-09-12T01:04:43.593390+0000","last_fullsized":"2024-09-12T01:04:43.593390+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:20.409038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'49","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.780052+0000","last_change":"2024-09-12T00:36:37.244938+0000","last_active":"2024-09-12T01:04:57.780052+0000","last_peered":"2024-09-12T01:04:57.780052+0000","last_clean":"2024-09-12T01:04:57.780052+0000","last_became_active":"2024-09-12T00:36:37.244259+0000","last_became_peered":"2024-09-12T00:36:37.244259+0000","last_unstale":"2024-09-12T01:04:57.780052+0000","last_undegraded":"2024-09-12T01:04:57.780052+0000","last_fullsized":"2024-09-12T01:04:57.780052+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.194885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":182,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.574047+0000","last_change":"2024-09-12T00:49:10.630411+0000","last_active":"2024-09-12T01:03:14.574047+0000","last_peered":"2024-09-12T01:03:14.574047+0000","last_clean":"2024-09-12T01:03:14.574047+0000","last_became_active":"2024-09-12T00:49:10.629746+0000","last_became_peered":"2024-09-12T00:49:10.629746+0000","last_unstale":"2024-09-12T01:03:14.574047+0000","last_undegraded":"2024-09-12T01:03:14.574047+0000","last_fullsized":"2024-09-12T01:03:14.574047+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:10.415361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.595049+0000","last_change":"2024-09-12T00:38:10.696938+0000","last_active":"2024-09-12T01:04:49.595049+0000","last_peered":"2024-09-12T01:04:49.595049+0000","last_clean":"2024-09-12T01:04:49.595049+0000","last_became_active":"2024-09-12T00:38:10.695688+0000","last_became_peered":"2024-09-12T00:38:10.695688+0000","last_unstale":"2024-09-12T01:04:49.595049+0000","last_undegraded":"2024-09-12T01:04:49.595049+0000","last_fullsized":"2024-09-12T01:04:49.595049+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:07.485587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.614081+0000","last_change":"2024-09-12T00:38:07.647799+0000","last_active":"2024-09-12T01:04:44.614081+0000","last_peered":"2024-09-12T01:04:44.614081+0000","last_clean":"2024-09-12T01:04:44.614081+0000","last_became_active":"2024-09-12T00:38:07.645284+0000","last_became_peered":"2024-09-12T00:38:07.645284+0000","last_unstale":"2024-09-12T01:04:44.614081+0000","last_undegraded":"2024-09-12T01:04:44.614081+0000","last_fullsized":"2024-09-12T01:04:44.614081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:30.146339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.633189+0000","last_change":"2024-09-12T00:36:37.221009+0000","last_active":"2024-09-12T01:04:44.633189+0000","last_peered":"2024-09-12T01:04:44.633189+0000","last_clean":"2024-09-12T01:04:44.633189+0000","last_became_active":"2024-09-12T00:36:37.220195+0000","last_became_peered":"2024-09-12T00:36:37.220195+0000","last_unstale":"2024-09-12T01:04:44.633189+0000","last_undegraded":"2024-09-12T01:04:44.633189+0000","last_fullsized":"2024-09-12T01:04:44.633189+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:56.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":108,"num_write":45,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.599208+0000","last_change":"2024-09-12T00:49:10.615352+0000","last_active":"2024-09-12T01:03:44.599208+0000","last_peered":"2024-09-12T01:03:44.599208+0000","last_clean":"2024-09-12T01:03:44.599208+0000","last_became_active":"2024-09-12T00:49:10.614661+0000","last_became_peered":"2024-09-12T00:49:10.614661+0000","last_unstale":"2024-09-12T01:03:44.599208+0000","last_undegraded":"2024-09-12T01:03:44.599208+0000","last_fullsized":"2024-09-12T01:03:44.599208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:28.781007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.601595+0000","last_change":"2024-09-12T00:38:10.704123+0000","last_active":"2024-09-12T01:03:54.601595+0000","last_peered":"2024-09-12T01:03:54.601595+0000","last_clean":"2024-09-12T01:03:54.601595+0000","last_became_active":"2024-09-12T00:38:10.702260+0000","last_became_peered":"2024-09-12T00:38:10.702260+0000","last_unstale":"2024-09-12T01:03:54.601595+0000","last_undegraded":"2024-09-12T01:03:54.601595+0000","last_fullsized":"2024-09-12T01:03:54.601595+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:52.661395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763803+0000","last_change":"2024-09-12T00:38:07.640472+0000","last_active":"2024-09-12T01:03:49.763803+0000","last_peered":"2024-09-12T01:03:49.763803+0000","last_clean":"2024-09-12T01:03:49.763803+0000","last_became_active":"2024-09-12T00:38:07.639687+0000","last_became_peered":"2024-09-12T00:38:07.639687+0000","last_unstale":"2024-09-12T01:03:49.763803+0000","last_undegraded":"2024-09-12T01:03:49.763803+0000","last_fullsized":"2024-09-12T01:03:49.763803+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:58.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'52","reported_seq":183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.631949+0000","last_change":"2024-09-12T00:36:37.241171+0000","last_active":"2024-09-12T01:04:39.631949+0000","last_peered":"2024-09-12T01:04:39.631949+0000","last_clean":"2024-09-12T01:04:39.631949+0000","last_became_active":"2024-09-12T00:36:37.239844+0000","last_became_peered":"2024-09-12T00:36:37.239844+0000","last_unstale":"2024-09-12T01:04:39.631949+0000","last_undegraded":"2024-09-12T01:04:39.631949+0000","last_fullsized":"2024-09-12T01:04:39.631949+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:34.727635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":188,"num_write":97,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574686+0000","last_change":"2024-09-12T00:49:10.632954+0000","last_active":"2024-09-12T01:03:44.574686+0000","last_peered":"2024-09-12T01:03:44.574686+0000","last_clean":"2024-09-12T01:03:44.574686+0000","last_became_active":"2024-09-12T00:49:10.632241+0000","last_became_peered":"2024-09-12T00:49:10.632241+0000","last_unstale":"2024-09-12T01:03:44.574686+0000","last_undegraded":"2024-09-12T01:03:44.574686+0000","last_fullsized":"2024-09-12T01:03:44.574686+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:12.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"267'4","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.601460+0000","last_change":"2024-09-12T00:38:10.714497+0000","last_active":"2024-09-12T01:03:54.601460+0000","last_peered":"2024-09-12T01:03:54.601460+0000","last_clean":"2024-09-12T01:03:54.601460+0000","last_became_active":"2024-09-12T00:38:10.713890+0000","last_became_peered":"2024-09-12T00:38:10.713890+0000","last_unstale":"2024-09-12T01:03:54.601460+0000","last_undegraded":"2024-09-12T01:03:54.601460+0000","last_fullsized":"2024-09-12T01:03:54.601460+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.839866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600291+0000","last_change":"2024-09-12T00:38:07.667759+0000","last_active":"2024-09-12T01:03:49.600291+0000","last_peered":"2024-09-12T01:03:49.600291+0000","last_clean":"2024-09-12T01:03:49.600291+0000","last_became_active":"2024-09-12T00:38:07.667180+0000","last_became_peered":"2024-09-12T00:38:07.667180+0000","last_unstale":"2024-09-12T01:03:49.600291+0000","last_undegraded":"2024-09-12T01:03:49.600291+0000","last_fullsized":"2024-09-12T01:03:49.600291+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.515772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'23","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.592102+0000","last_change":"2024-09-12T00:36:37.253314+0000","last_active":"2024-09-12T01:04:38.592102+0000","last_peered":"2024-09-12T01:04:38.592102+0000","last_clean":"2024-09-12T01:04:38.592102+0000","last_became_active":"2024-09-12T00:36:37.248733+0000","last_became_peered":"2024-09-12T00:36:37.248733+0000","last_unstale":"2024-09-12T01:04:38.592102+0000","last_undegraded":"2024-09-12T01:04:38.592102+0000","last_fullsized":"2024-09-12T01:04:38.592102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.498855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.568017+0000","last_change":"2024-09-12T00:49:10.639305+0000","last_active":"2024-09-12T01:03:19.568017+0000","last_peered":"2024-09-12T01:03:19.568017+0000","last_clean":"2024-09-12T01:03:19.568017+0000","last_became_active":"2024-09-12T00:49:10.638628+0000","last_became_peered":"2024-09-12T00:49:10.638628+0000","last_unstale":"2024-09-12T01:03:19.568017+0000","last_undegraded":"2024-09-12T01:03:19.568017+0000","last_fullsized":"2024-09-12T01:03:19.568017+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:12.353339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.582007+0000","last_change":"2024-09-12T00:38:10.691801+0000","last_active":"2024-09-12T01:03:53.582007+0000","last_peered":"2024-09-12T01:03:53.582007+0000","last_clean":"2024-09-12T01:03:53.582007+0000","last_became_active":"2024-09-12T00:38:10.691129+0000","last_became_peered":"2024-09-12T00:38:10.691129+0000","last_unstale":"2024-09-12T01:03:53.582007+0000","last_undegraded":"2024-09-12T01:03:53.582007+0000","last_fullsized":"2024-09-12T01:03:53.582007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:27.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763900+0000","last_change":"2024-09-12T00:38:07.642523+0000","last_active":"2024-09-12T01:03:49.763900+0000","last_peered":"2024-09-12T01:03:49.763900+0000","last_clean":"2024-09-12T01:03:49.763900+0000","last_became_active":"2024-09-12T00:38:07.641719+0000","last_became_peered":"2024-09-12T00:38:07.641719+0000","last_unstale":"2024-09-12T01:03:49.763900+0000","last_undegraded":"2024-09-12T01:03:49.763900+0000","last_fullsized":"2024-09-12T01:03:49.763900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.330959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'60","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.754899+0000","last_change":"2024-09-12T00:36:37.224160+0000","last_active":"2024-09-12T01:04:39.754899+0000","last_peered":"2024-09-12T01:04:39.754899+0000","last_clean":"2024-09-12T01:04:39.754899+0000","last_became_active":"2024-09-12T00:36:37.223432+0000","last_became_peered":"2024-09-12T00:36:37.223432+0000","last_unstale":"2024-09-12T01:04:39.754899+0000","last_undegraded":"2024-09-12T01:04:39.754899+0000","last_fullsized":"2024-09-12T01:04:39.754899+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:13.061629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":212,"num_write":101,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574626+0000","last_change":"2024-09-12T00:49:10.635230+0000","last_active":"2024-09-12T01:03:44.574626+0000","last_peered":"2024-09-12T01:03:44.574626+0000","last_clean":"2024-09-12T01:03:44.574626+0000","last_became_active":"2024-09-12T00:49:10.634783+0000","last_became_peered":"2024-09-12T00:49:10.634783+0000","last_unstale":"2024-09-12T01:03:44.574626+0000","last_undegraded":"2024-09-12T01:03:44.574626+0000","last_fullsized":"2024-09-12T01:03:44.574626+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:22.424861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619873+0000","last_change":"2024-09-12T00:38:10.709528+0000","last_active":"2024-09-12T01:03:54.619873+0000","last_peered":"2024-09-12T01:03:54.619873+0000","last_clean":"2024-09-12T01:03:54.619873+0000","last_became_active":"2024-09-12T00:38:10.708687+0000","last_became_peered":"2024-09-12T00:38:10.708687+0000","last_unstale":"2024-09-12T01:03:54.619873+0000","last_undegraded":"2024-09-12T01:03:54.619873+0000","last_fullsized":"2024-09-12T01:03:54.619873+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.079976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763955+0000","last_change":"2024-09-12T00:38:07.637056+0000","last_active":"2024-09-12T01:03:49.763955+0000","last_peered":"2024-09-12T01:03:49.763955+0000","last_clean":"2024-09-12T01:03:49.763955+0000","last_became_active":"2024-09-12T00:38:07.636298+0000","last_became_peered":"2024-09-12T00:38:07.636298+0000","last_unstale":"2024-09-12T01:03:49.763955+0000","last_undegraded":"2024-09-12T01:03:49.763955+0000","last_fullsized":"2024-09-12T01:03:49.763955+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.591991+0000","last_change":"2024-09-12T00:36:37.253687+0000","last_active":"2024-09-12T01:04:38.591991+0000","last_peered":"2024-09-12T01:04:38.591991+0000","last_clean":"2024-09-12T01:04:38.591991+0000","last_became_active":"2024-09-12T00:36:37.248770+0000","last_became_peered":"2024-09-12T00:36:37.248770+0000","last_unstale":"2024-09-12T01:04:38.591991+0000","last_undegraded":"2024-09-12T01:04:38.591991+0000","last_fullsized":"2024-09-12T01:04:38.591991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.878928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":141,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609918+0000","last_change":"2024-09-12T00:49:10.597538+0000","last_active":"2024-09-12T01:04:29.609918+0000","last_peered":"2024-09-12T01:04:29.609918+0000","last_clean":"2024-09-12T01:04:29.609918+0000","last_became_active":"2024-09-12T00:49:10.596695+0000","last_became_peered":"2024-09-12T00:49:10.596695+0000","last_unstale":"2024-09-12T01:04:29.609918+0000","last_undegraded":"2024-09-12T01:04:29.609918+0000","last_fullsized":"2024-09-12T01:04:29.609918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:51.074598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.569127+0000","last_change":"2024-09-12T00:38:10.683836+0000","last_active":"2024-09-12T01:02:58.569127+0000","last_peered":"2024-09-12T01:02:58.569127+0000","last_clean":"2024-09-12T01:02:58.569127+0000","last_became_active":"2024-09-12T00:38:10.683024+0000","last_became_peered":"2024-09-12T00:38:10.683024+0000","last_unstale":"2024-09-12T01:02:58.569127+0000","last_undegraded":"2024-09-12T01:02:58.569127+0000","last_fullsized":"2024-09-12T01:02:58.569127+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:08.556147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.761594+0000","last_change":"2024-09-12T00:38:07.664050+0000","last_active":"2024-09-12T01:05:09.761594+0000","last_peered":"2024-09-12T01:05:09.761594+0000","last_clean":"2024-09-12T01:05:09.761594+0000","last_became_active":"2024-09-12T00:38:07.663265+0000","last_became_peered":"2024-09-12T00:38:07.663265+0000","last_unstale":"2024-09-12T01:05:09.761594+0000","last_undegraded":"2024-09-12T01:05:09.761594+0000","last_fullsized":"2024-09-12T01:05:09.761594+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:28.984997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'15","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.579861+0000","last_change":"2024-09-12T00:36:37.248079+0000","last_active":"2024-09-12T01:03:43.579861+0000","last_peered":"2024-09-12T01:03:43.579861+0000","last_clean":"2024-09-12T01:03:43.579861+0000","last_became_active":"2024-09-12T00:36:37.247409+0000","last_became_peered":"2024-09-12T00:36:37.247409+0000","last_unstale":"2024-09-12T01:03:43.579861+0000","last_undegraded":"2024-09-12T01:03:43.579861+0000","last_fullsized":"2024-09-12T01:03:43.579861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:04.933898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":52,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.779758+0000","last_change":"2024-09-12T00:49:10.594239+0000","last_active":"2024-09-12T01:04:59.779758+0000","last_peered":"2024-09-12T01:04:59.779758+0000","last_clean":"2024-09-12T01:04:59.779758+0000","last_became_active":"2024-09-12T00:49:10.593471+0000","last_became_peered":"2024-09-12T00:49:10.593471+0000","last_unstale":"2024-09-12T01:04:59.779758+0000","last_undegraded":"2024-09-12T01:04:59.779758+0000","last_fullsized":"2024-09-12T01:04:59.779758+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:54.840220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"267'2","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.569063+0000","last_change":"2024-09-12T00:38:10.709654+0000","last_active":"2024-09-12T01:02:58.569063+0000","last_peered":"2024-09-12T01:02:58.569063+0000","last_clean":"2024-09-12T01:02:58.569063+0000","last_became_active":"2024-09-12T00:38:10.708936+0000","last_became_peered":"2024-09-12T00:38:10.708936+0000","last_unstale":"2024-09-12T01:02:58.569063+0000","last_undegraded":"2024-09-12T01:02:58.569063+0000","last_fullsized":"2024-09-12T01:02:58.569063+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:34.439374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'6","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.594403+0000","last_change":"2024-09-12T00:38:07.651137+0000","last_active":"2024-09-12T01:05:09.594403+0000","last_peered":"2024-09-12T01:05:09.594403+0000","last_clean":"2024-09-12T01:05:09.594403+0000","last_became_active":"2024-09-12T00:38:07.650419+0000","last_became_peered":"2024-09-12T00:38:07.650419+0000","last_unstale":"2024-09-12T01:05:09.594403+0000","last_undegraded":"2024-09-12T01:05:09.594403+0000","last_fullsized":"2024-09-12T01:05:09.594403+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.557871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'98","reported_seq":352,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.615890+0000","last_change":"2024-09-12T00:36:37.227751+0000","last_active":"2024-09-12T01:03:39.615890+0000","last_peered":"2024-09-12T01:03:39.615890+0000","last_clean":"2024-09-12T01:03:39.615890+0000","last_became_active":"2024-09-12T00:36:37.225615+0000","last_became_peered":"2024-09-12T00:36:37.225615+0000","last_unstale":"2024-09-12T01:03:39.615890+0000","last_undegraded":"2024-09-12T01:03:39.615890+0000","last_fullsized":"2024-09-12T01:03:39.615890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:24.078167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":608,"num_read_kb":444,"num_write":119,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626251+0000","last_change":"2024-09-12T00:49:10.620839+0000","last_active":"2024-09-12T01:04:19.626251+0000","last_peered":"2024-09-12T01:04:19.626251+0000","last_clean":"2024-09-12T01:04:19.626251+0000","last_became_active":"2024-09-12T00:49:10.620169+0000","last_became_peered":"2024-09-12T00:49:10.620169+0000","last_unstale":"2024-09-12T01:04:19.626251+0000","last_undegraded":"2024-09-12T01:04:19.626251+0000","last_fullsized":"2024-09-12T01:04:19.626251+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.688639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.570450+0000","last_change":"2024-09-12T00:38:10.686990+0000","last_active":"2024-09-12T01:03:03.570450+0000","last_peered":"2024-09-12T01:03:03.570450+0000","last_clean":"2024-09-12T01:03:03.570450+0000","last_became_active":"2024-09-12T00:38:10.686216+0000","last_became_peered":"2024-09-12T00:38:10.686216+0000","last_unstale":"2024-09-12T01:03:03.570450+0000","last_undegraded":"2024-09-12T01:03:03.570450+0000","last_fullsized":"2024-09-12T01:03:03.570450+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:24.592600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.599265+0000","last_change":"2024-09-12T00:38:07.666660+0000","last_active":"2024-09-12T01:05:08.599265+0000","last_peered":"2024-09-12T01:05:08.599265+0000","last_clean":"2024-09-12T01:05:08.599265+0000","last_became_active":"2024-09-12T00:38:07.661932+0000","last_became_peered":"2024-09-12T00:38:07.661932+0000","last_unstale":"2024-09-12T01:05:08.599265+0000","last_undegraded":"2024-09-12T01:05:08.599265+0000","last_fullsized":"2024-09-12T01:05:08.599265+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:30.080552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'12","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.761390+0000","last_change":"2024-09-12T00:36:37.227779+0000","last_active":"2024-09-12T01:03:39.761390+0000","last_peered":"2024-09-12T01:03:39.761390+0000","last_clean":"2024-09-12T01:03:39.761390+0000","last_became_active":"2024-09-12T00:36:37.226992+0000","last_became_peered":"2024-09-12T00:36:37.226992+0000","last_unstale":"2024-09-12T01:03:39.761390+0000","last_undegraded":"2024-09-12T01:03:39.761390+0000","last_fullsized":"2024-09-12T01:03:39.761390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.657729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.771859+0000","last_change":"2024-09-12T00:49:10.598218+0000","last_active":"2024-09-12T01:04:24.771859+0000","last_peered":"2024-09-12T01:04:24.771859+0000","last_clean":"2024-09-12T01:04:24.771859+0000","last_became_active":"2024-09-12T00:49:10.597349+0000","last_became_peered":"2024-09-12T00:49:10.597349+0000","last_unstale":"2024-09-12T01:04:24.771859+0000","last_undegraded":"2024-09-12T01:04:24.771859+0000","last_fullsized":"2024-09-12T01:04:24.771859+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:32.342356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"267'10","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.587835+0000","last_change":"2024-09-12T00:38:10.701647+0000","last_active":"2024-09-12T01:02:59.587835+0000","last_peered":"2024-09-12T01:02:59.587835+0000","last_clean":"2024-09-12T01:02:59.587835+0000","last_became_active":"2024-09-12T00:38:10.700892+0000","last_became_peered":"2024-09-12T00:38:10.700892+0000","last_unstale":"2024-09-12T01:02:59.587835+0000","last_undegraded":"2024-09-12T01:02:59.587835+0000","last_fullsized":"2024-09-12T01:02:59.587835+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:36.388849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":15,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.569267+0000","last_change":"2024-09-12T00:38:07.643675+0000","last_active":"2024-09-12T01:02:58.569267+0000","last_peered":"2024-09-12T01:02:58.569267+0000","last_clean":"2024-09-12T01:02:58.569267+0000","last_became_active":"2024-09-12T00:38:07.642924+0000","last_became_peered":"2024-09-12T00:38:07.642924+0000","last_unstale":"2024-09-12T01:02:58.569267+0000","last_undegraded":"2024-09-12T01:02:58.569267+0000","last_fullsized":"2024-09-12T01:02:58.569267+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:03.027647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'31","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573415+0000","last_change":"2024-09-12T00:36:37.243786+0000","last_active":"2024-09-12T01:03:39.573415+0000","last_peered":"2024-09-12T01:03:39.573415+0000","last_clean":"2024-09-12T01:03:39.573415+0000","last_became_active":"2024-09-12T00:36:37.238481+0000","last_became_peered":"2024-09-12T00:36:37.238481+0000","last_unstale":"2024-09-12T01:03:39.573415+0000","last_undegraded":"2024-09-12T01:03:39.573415+0000","last_fullsized":"2024-09-12T01:03:39.573415+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:15.555438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":121,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.617607+0000","last_change":"2024-09-12T00:49:10.614315+0000","last_active":"2024-09-12T01:04:59.617607+0000","last_peered":"2024-09-12T01:04:59.617607+0000","last_clean":"2024-09-12T01:04:59.617607+0000","last_became_active":"2024-09-12T00:49:10.613613+0000","last_became_peered":"2024-09-12T00:49:10.613613+0000","last_unstale":"2024-09-12T01:04:59.617607+0000","last_undegraded":"2024-09-12T01:04:59.617607+0000","last_fullsized":"2024-09-12T01:04:59.617607+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:45.422915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.624836+0000","last_change":"2024-09-12T00:38:10.695438+0000","last_active":"2024-09-12T01:04:14.624836+0000","last_peered":"2024-09-12T01:04:14.624836+0000","last_clean":"2024-09-12T01:04:14.624836+0000","last_became_active":"2024-09-12T00:38:10.694714+0000","last_became_peered":"2024-09-12T00:38:10.694714+0000","last_unstale":"2024-09-12T01:04:14.624836+0000","last_undegraded":"2024-09-12T01:04:14.624836+0000","last_fullsized":"2024-09-12T01:04:14.624836+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:46.770976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'4","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:08.585154+0000","last_change":"2024-09-12T00:38:07.653886+0000","last_active":"2024-09-12T01:04:08.585154+0000","last_peered":"2024-09-12T01:04:08.585154+0000","last_clean":"2024-09-12T01:04:08.585154+0000","last_became_active":"2024-09-12T00:38:07.647225+0000","last_became_peered":"2024-09-12T00:38:07.647225+0000","last_unstale":"2024-09-12T01:04:08.585154+0000","last_undegraded":"2024-09-12T01:04:08.585154+0000","last_fullsized":"2024-09-12T01:04:08.585154+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:14.958030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'12","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573328+0000","last_change":"2024-09-12T00:36:37.249508+0000","last_active":"2024-09-12T01:03:39.573328+0000","last_peered":"2024-09-12T01:03:39.573328+0000","last_clean":"2024-09-12T01:03:39.573328+0000","last_became_active":"2024-09-12T00:36:37.246075+0000","last_became_peered":"2024-09-12T00:36:37.246075+0000","last_unstale":"2024-09-12T01:03:39.573328+0000","last_undegraded":"2024-09-12T01:03:39.573328+0000","last_fullsized":"2024-09-12T01:03:39.573328+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:45.712512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.759397+0000","last_change":"2024-09-12T00:49:10.598511+0000","last_active":"2024-09-12T01:04:59.759397+0000","last_peered":"2024-09-12T01:04:59.759397+0000","last_clean":"2024-09-12T01:04:59.759397+0000","last_became_active":"2024-09-12T00:49:10.597773+0000","last_became_peered":"2024-09-12T00:49:10.597773+0000","last_unstale":"2024-09-12T01:04:59.759397+0000","last_undegraded":"2024-09-12T01:04:59.759397+0000","last_fullsized":"2024-09-12T01:04:59.759397+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:51.989977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749157+0000","last_change":"2024-09-12T00:38:10.698369+0000","last_active":"2024-09-12T01:04:14.749157+0000","last_peered":"2024-09-12T01:04:14.749157+0000","last_clean":"2024-09-12T01:04:14.749157+0000","last_became_active":"2024-09-12T00:38:10.697403+0000","last_became_peered":"2024-09-12T00:38:10.697403+0000","last_unstale":"2024-09-12T01:04:14.749157+0000","last_undegraded":"2024-09-12T01:04:14.749157+0000","last_fullsized":"2024-09-12T01:04:14.749157+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:19.999588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.605162+0000","last_change":"2024-09-12T00:38:07.668475+0000","last_active":"2024-09-12T01:04:09.605162+0000","last_peered":"2024-09-12T01:04:09.605162+0000","last_clean":"2024-09-12T01:04:09.605162+0000","last_became_active":"2024-09-12T00:38:07.667447+0000","last_became_peered":"2024-09-12T00:38:07.667447+0000","last_unstale":"2024-09-12T01:04:09.605162+0000","last_undegraded":"2024-09-12T01:04:09.605162+0000","last_fullsized":"2024-09-12T01:04:09.605162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:23.306315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.758150+0000","last_change":"2024-09-12T00:36:37.240933+0000","last_active":"2024-09-12T01:04:54.758150+0000","last_peered":"2024-09-12T01:04:54.758150+0000","last_clean":"2024-09-12T01:04:54.758150+0000","last_became_active":"2024-09-12T00:36:37.239946+0000","last_became_peered":"2024-09-12T00:36:37.239946+0000","last_unstale":"2024-09-12T01:04:54.758150+0000","last_undegraded":"2024-09-12T01:04:54.758150+0000","last_fullsized":"2024-09-12T01:04:54.758150+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:57.116646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.597511+0000","last_change":"2024-09-12T00:49:10.630825+0000","last_active":"2024-09-12T01:04:59.597511+0000","last_peered":"2024-09-12T01:04:59.597511+0000","last_clean":"2024-09-12T01:04:59.597511+0000","last_became_active":"2024-09-12T00:49:10.629903+0000","last_became_peered":"2024-09-12T00:49:10.629903+0000","last_unstale":"2024-09-12T01:04:59.597511+0000","last_undegraded":"2024-09-12T01:04:59.597511+0000","last_fullsized":"2024-09-12T01:04:59.597511+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:07.324326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.564338+0000","last_change":"2024-09-12T00:38:10.714505+0000","last_active":"2024-09-12T01:02:59.564338+0000","last_peered":"2024-09-12T01:02:59.564338+0000","last_clean":"2024-09-12T01:02:59.564338+0000","last_became_active":"2024-09-12T00:38:10.708820+0000","last_became_peered":"2024-09-12T00:38:10.708820+0000","last_unstale":"2024-09-12T01:02:59.564338+0000","last_undegraded":"2024-09-12T01:02:59.564338+0000","last_fullsized":"2024-09-12T01:02:59.564338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:21.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.586371+0000","last_change":"2024-09-12T00:38:07.645572+0000","last_active":"2024-09-12T01:04:13.586371+0000","last_peered":"2024-09-12T01:04:13.586371+0000","last_clean":"2024-09-12T01:04:13.586371+0000","last_became_active":"2024-09-12T00:38:07.644752+0000","last_became_peered":"2024-09-12T00:38:07.644752+0000","last_unstale":"2024-09-12T01:04:13.586371+0000","last_undegraded":"2024-09-12T01:04:13.586371+0000","last_fullsized":"2024-09-12T01:04:13.586371+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:27.156732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"267'56","reported_seq":202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.615105+0000","last_change":"2024-09-12T00:36:37.247146+0000","last_active":"2024-09-12T01:04:49.615105+0000","last_peered":"2024-09-12T01:04:49.615105+0000","last_clean":"2024-09-12T01:04:49.615105+0000","last_became_active":"2024-09-12T00:36:37.246402+0000","last_became_peered":"2024-09-12T00:36:37.246402+0000","last_unstale":"2024-09-12T01:04:49.615105+0000","last_undegraded":"2024-09-12T01:04:49.615105+0000","last_fullsized":"2024-09-12T01:04:49.615105+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:50.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":211,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.597068+0000","last_change":"2024-09-12T00:49:10.627636+0000","last_active":"2024-09-12T01:04:58.597068+0000","last_peered":"2024-09-12T01:04:58.597068+0000","last_clean":"2024-09-12T01:04:58.597068+0000","last_became_active":"2024-09-12T00:49:10.626918+0000","last_became_peered":"2024-09-12T00:49:10.626918+0000","last_unstale":"2024-09-12T01:04:58.597068+0000","last_undegraded":"2024-09-12T01:04:58.597068+0000","last_fullsized":"2024-09-12T01:04:58.597068+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.462430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"267'6","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.588407+0000","last_change":"2024-09-12T00:38:10.706342+0000","last_active":"2024-09-12T01:04:19.588407+0000","last_peered":"2024-09-12T01:04:19.588407+0000","last_clean":"2024-09-12T01:04:19.588407+0000","last_became_active":"2024-09-12T00:38:10.705817+0000","last_became_peered":"2024-09-12T00:38:10.705817+0000","last_unstale":"2024-09-12T01:04:19.588407+0000","last_undegraded":"2024-09-12T01:04:19.588407+0000","last_fullsized":"2024-09-12T01:04:19.588407+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:39.296427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.639322+0000","last_change":"2024-09-12T00:38:07.655064+0000","last_active":"2024-09-12T01:05:09.639322+0000","last_peered":"2024-09-12T01:05:09.639322+0000","last_clean":"2024-09-12T01:05:09.639322+0000","last_became_active":"2024-09-12T00:38:07.654306+0000","last_became_peered":"2024-09-12T00:38:07.654306+0000","last_unstale":"2024-09-12T01:05:09.639322+0000","last_undegraded":"2024-09-12T01:05:09.639322+0000","last_fullsized":"2024-09-12T01:05:09.639322+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:13.318498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'60","reported_seq":249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.594897+0000","last_change":"2024-09-12T00:36:37.227571+0000","last_active":"2024-09-12T01:04:49.594897+0000","last_peered":"2024-09-12T01:04:49.594897+0000","last_clean":"2024-09-12T01:04:49.594897+0000","last_became_active":"2024-09-12T00:36:37.226845+0000","last_became_peered":"2024-09-12T00:36:37.226845+0000","last_unstale":"2024-09-12T01:04:49.594897+0000","last_undegraded":"2024-09-12T01:04:49.594897+0000","last_fullsized":"2024-09-12T01:04:49.594897+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.611933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":408,"num_read_kb":294,"num_write":66,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582015+0000","last_change":"2024-09-12T00:49:10.623449+0000","last_active":"2024-09-12T01:03:49.582015+0000","last_peered":"2024-09-12T01:03:49.582015+0000","last_clean":"2024-09-12T01:03:49.582015+0000","last_became_active":"2024-09-12T00:49:10.615566+0000","last_became_peered":"2024-09-12T00:49:10.615566+0000","last_unstale":"2024-09-12T01:03:49.582015+0000","last_undegraded":"2024-09-12T01:03:49.582015+0000","last_fullsized":"2024-09-12T01:03:49.582015+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:25.428504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'6","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.592823+0000","last_change":"2024-09-12T00:38:10.705943+0000","last_active":"2024-09-12T01:03:19.592823+0000","last_peered":"2024-09-12T01:03:19.592823+0000","last_clean":"2024-09-12T01:03:19.592823+0000","last_became_active":"2024-09-12T00:38:10.705207+0000","last_became_peered":"2024-09-12T00:38:10.705207+0000","last_unstale":"2024-09-12T01:03:19.592823+0000","last_undegraded":"2024-09-12T01:03:19.592823+0000","last_fullsized":"2024-09-12T01:03:19.592823+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:44.933546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'9","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640614+0000","last_change":"2024-09-12T00:38:07.663618+0000","last_active":"2024-09-12T01:05:14.640614+0000","last_peered":"2024-09-12T01:05:14.640614+0000","last_clean":"2024-09-12T01:05:14.640614+0000","last_became_active":"2024-09-12T00:38:07.663031+0000","last_became_peered":"2024-09-12T00:38:07.663031+0000","last_unstale":"2024-09-12T01:05:14.640614+0000","last_undegraded":"2024-09-12T01:05:14.640614+0000","last_fullsized":"2024-09-12T01:05:14.640614+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.928917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'40","reported_seq":152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587717+0000","last_change":"2024-09-12T00:36:37.251472+0000","last_active":"2024-09-12T01:04:49.587717+0000","last_peered":"2024-09-12T01:04:49.587717+0000","last_clean":"2024-09-12T01:04:49.587717+0000","last_became_active":"2024-09-12T00:36:37.250649+0000","last_became_peered":"2024-09-12T00:36:37.250649+0000","last_unstale":"2024-09-12T01:04:49.587717+0000","last_undegraded":"2024-09-12T01:04:49.587717+0000","last_fullsized":"2024-09-12T01:04:49.587717+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:22.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":70,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582037+0000","last_change":"2024-09-12T00:49:10.634985+0000","last_active":"2024-09-12T01:03:49.582037+0000","last_peered":"2024-09-12T01:03:49.582037+0000","last_clean":"2024-09-12T01:03:49.582037+0000","last_became_active":"2024-09-12T00:49:10.634433+0000","last_became_peered":"2024-09-12T00:49:10.634433+0000","last_unstale":"2024-09-12T01:03:49.582037+0000","last_undegraded":"2024-09-12T01:03:49.582037+0000","last_fullsized":"2024-09-12T01:03:49.582037+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:02.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622352+0000","last_change":"2024-09-12T00:38:10.718774+0000","last_active":"2024-09-12T01:05:19.622352+0000","last_peered":"2024-09-12T01:05:19.622352+0000","last_clean":"2024-09-12T01:05:19.622352+0000","last_became_active":"2024-09-12T00:38:10.717307+0000","last_became_peered":"2024-09-12T00:38:10.717307+0000","last_unstale":"2024-09-12T01:05:19.622352+0000","last_undegraded":"2024-09-12T01:05:19.622352+0000","last_fullsized":"2024-09-12T01:05:19.622352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:10.837950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.568074+0000","last_change":"2024-09-12T00:38:07.660476+0000","last_active":"2024-09-12T01:03:19.568074+0000","last_peered":"2024-09-12T01:03:19.568074+0000","last_clean":"2024-09-12T01:03:19.568074+0000","last_became_active":"2024-09-12T00:38:07.659692+0000","last_became_peered":"2024-09-12T00:38:07.659692+0000","last_unstale":"2024-09-12T01:03:19.568074+0000","last_undegraded":"2024-09-12T01:03:19.568074+0000","last_fullsized":"2024-09-12T01:03:19.568074+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:05.518531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'22","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.817272+0000","last_change":"2024-09-12T00:36:37.228455+0000","last_active":"2024-09-12T01:05:02.817272+0000","last_peered":"2024-09-12T01:05:02.817272+0000","last_clean":"2024-09-12T01:05:02.817272+0000","last_became_active":"2024-09-12T00:36:37.226892+0000","last_became_peered":"2024-09-12T00:36:37.226892+0000","last_unstale":"2024-09-12T01:05:02.817272+0000","last_undegraded":"2024-09-12T01:05:02.817272+0000","last_fullsized":"2024-09-12T01:05:02.817272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:09.675401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622226+0000","last_change":"2024-09-12T00:49:10.632589+0000","last_active":"2024-09-12T01:05:19.622226+0000","last_peered":"2024-09-12T01:05:19.622226+0000","last_clean":"2024-09-12T01:05:19.622226+0000","last_became_active":"2024-09-12T00:49:10.631961+0000","last_became_peered":"2024-09-12T00:49:10.631961+0000","last_unstale":"2024-09-12T01:05:19.622226+0000","last_undegraded":"2024-09-12T01:05:19.622226+0000","last_fullsized":"2024-09-12T01:05:19.622226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:28.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587368+0000","last_change":"2024-09-12T00:38:10.719998+0000","last_active":"2024-09-12T01:04:14.587368+0000","last_peered":"2024-09-12T01:04:14.587368+0000","last_clean":"2024-09-12T01:04:14.587368+0000","last_became_active":"2024-09-12T00:38:10.719337+0000","last_became_peered":"2024-09-12T00:38:10.719337+0000","last_unstale":"2024-09-12T01:04:14.587368+0000","last_undegraded":"2024-09-12T01:04:14.587368+0000","last_fullsized":"2024-09-12T01:04:14.587368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:16.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748163+0000","last_change":"2024-09-12T00:38:07.640549+0000","last_active":"2024-09-12T01:04:09.748163+0000","last_peered":"2024-09-12T01:04:09.748163+0000","last_clean":"2024-09-12T01:04:09.748163+0000","last_became_active":"2024-09-12T00:38:07.639751+0000","last_became_peered":"2024-09-12T00:38:07.639751+0000","last_unstale":"2024-09-12T01:04:09.748163+0000","last_undegraded":"2024-09-12T01:04:09.748163+0000","last_fullsized":"2024-09-12T01:04:09.748163+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:17.815510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'40","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743281+0000","last_change":"2024-09-12T00:36:37.248750+0000","last_active":"2024-09-12T01:03:49.743281+0000","last_peered":"2024-09-12T01:03:49.743281+0000","last_clean":"2024-09-12T01:03:49.743281+0000","last_became_active":"2024-09-12T00:36:37.248176+0000","last_became_peered":"2024-09-12T00:36:37.248176+0000","last_unstale":"2024-09-12T01:03:49.743281+0000","last_undegraded":"2024-09-12T01:03:49.743281+0000","last_fullsized":"2024-09-12T01:03:49.743281+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.812968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.616997+0000","last_change":"2024-09-12T00:49:10.635581+0000","last_active":"2024-09-12T01:03:44.616997+0000","last_peered":"2024-09-12T01:03:44.616997+0000","last_clean":"2024-09-12T01:03:44.616997+0000","last_became_active":"2024-09-12T00:49:10.634965+0000","last_became_peered":"2024-09-12T00:49:10.634965+0000","last_unstale":"2024-09-12T01:03:44.616997+0000","last_undegraded":"2024-09-12T01:03:44.616997+0000","last_fullsized":"2024-09-12T01:03:44.616997+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:00.298075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.625230+0000","last_change":"2024-09-12T00:38:10.695802+0000","last_active":"2024-09-12T01:04:14.625230+0000","last_peered":"2024-09-12T01:04:14.625230+0000","last_clean":"2024-09-12T01:04:14.625230+0000","last_became_active":"2024-09-12T00:38:10.694812+0000","last_became_peered":"2024-09-12T00:38:10.694812+0000","last_unstale":"2024-09-12T01:04:14.625230+0000","last_undegraded":"2024-09-12T01:04:14.625230+0000","last_fullsized":"2024-09-12T01:04:14.625230+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:47.266227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'3","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.623622+0000","last_change":"2024-09-12T00:38:07.648782+0000","last_active":"2024-09-12T01:04:09.623622+0000","last_peered":"2024-09-12T01:04:09.623622+0000","last_clean":"2024-09-12T01:04:09.623622+0000","last_became_active":"2024-09-12T00:38:07.648061+0000","last_became_peered":"2024-09-12T00:38:07.648061+0000","last_unstale":"2024-09-12T01:04:09.623622+0000","last_undegraded":"2024-09-12T01:04:09.623622+0000","last_fullsized":"2024-09-12T01:04:09.623622+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:11.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'35","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.768877+0000","last_change":"2024-09-12T00:36:37.244821+0000","last_active":"2024-09-12T01:04:21.768877+0000","last_peered":"2024-09-12T01:04:21.768877+0000","last_clean":"2024-09-12T01:04:21.768877+0000","last_became_active":"2024-09-12T00:36:37.244096+0000","last_became_peered":"2024-09-12T00:36:37.244096+0000","last_unstale":"2024-09-12T01:04:21.768877+0000","last_undegraded":"2024-09-12T01:04:21.768877+0000","last_fullsized":"2024-09-12T01:04:21.768877+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:50.671276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":53,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:23.588773+0000","last_change":"2024-09-12T00:49:10.626675+0000","last_active":"2024-09-12T01:04:23.588773+0000","last_peered":"2024-09-12T01:04:23.588773+0000","last_clean":"2024-09-12T01:04:23.588773+0000","last_became_active":"2024-09-12T00:49:10.621968+0000","last_became_peered":"2024-09-12T00:49:10.621968+0000","last_unstale":"2024-09-12T01:04:23.588773+0000","last_undegraded":"2024-09-12T01:04:23.588773+0000","last_fullsized":"2024-09-12T01:04:23.588773+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.338078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594658+0000","last_change":"2024-09-12T00:38:10.718573+0000","last_active":"2024-09-12T01:05:19.594658+0000","last_peered":"2024-09-12T01:05:19.594658+0000","last_clean":"2024-09-12T01:05:19.594658+0000","last_became_active":"2024-09-12T00:38:10.717877+0000","last_became_peered":"2024-09-12T00:38:10.717877+0000","last_unstale":"2024-09-12T01:05:19.594658+0000","last_undegraded":"2024-09-12T01:05:19.594658+0000","last_fullsized":"2024-09-12T01:05:19.594658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:53.348539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"267'3","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749225+0000","last_change":"2024-09-12T00:38:07.649510+0000","last_active":"2024-09-12T01:04:14.749225+0000","last_peered":"2024-09-12T01:04:14.749225+0000","last_clean":"2024-09-12T01:04:14.749225+0000","last_became_active":"2024-09-12T00:38:07.648786+0000","last_became_peered":"2024-09-12T00:38:07.648786+0000","last_unstale":"2024-09-12T01:04:14.749225+0000","last_undegraded":"2024-09-12T01:04:14.749225+0000","last_fullsized":"2024-09-12T01:04:14.749225+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:57.221376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.741862+0000","last_change":"2024-09-12T00:36:37.238021+0000","last_active":"2024-09-12T01:03:44.741862+0000","last_peered":"2024-09-12T01:03:44.741862+0000","last_clean":"2024-09-12T01:03:44.741862+0000","last_became_active":"2024-09-12T00:36:37.237365+0000","last_became_peered":"2024-09-12T00:36:37.237365+0000","last_unstale":"2024-09-12T01:03:44.741862+0000","last_undegraded":"2024-09-12T01:03:44.741862+0000","last_fullsized":"2024-09-12T01:03:44.741862+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:44.575480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":152,"num_write":73,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.582095+0000","last_change":"2024-09-12T00:49:10.628791+0000","last_active":"2024-09-12T01:04:24.582095+0000","last_peered":"2024-09-12T01:04:24.582095+0000","last_clean":"2024-09-12T01:04:24.582095+0000","last_became_active":"2024-09-12T00:49:10.628111+0000","last_became_peered":"2024-09-12T00:49:10.628111+0000","last_unstale":"2024-09-12T01:04:24.582095+0000","last_undegraded":"2024-09-12T01:04:24.582095+0000","last_fullsized":"2024-09-12T01:04:24.582095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.022373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'3","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626298+0000","last_change":"2024-09-12T00:38:10.702362+0000","last_active":"2024-09-12T01:04:19.626298+0000","last_peered":"2024-09-12T01:04:19.626298+0000","last_clean":"2024-09-12T01:04:19.626298+0000","last_became_active":"2024-09-12T00:38:10.696553+0000","last_became_peered":"2024-09-12T00:38:10.696553+0000","last_unstale":"2024-09-12T01:04:19.626298+0000","last_undegraded":"2024-09-12T01:04:19.626298+0000","last_fullsized":"2024-09-12T01:04:19.626298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:21.987094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145574,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3168,"num_write":3,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'3","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640450+0000","last_change":"2024-09-12T00:38:07.670741+0000","last_active":"2024-09-12T01:05:14.640450+0000","last_peered":"2024-09-12T01:05:14.640450+0000","last_clean":"2024-09-12T01:05:14.640450+0000","last_became_active":"2024-09-12T00:38:07.669959+0000","last_became_peered":"2024-09-12T00:38:07.669959+0000","last_unstale":"2024-09-12T01:05:14.640450+0000","last_undegraded":"2024-09-12T01:05:14.640450+0000","last_fullsized":"2024-09-12T01:05:14.640450+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:21.025381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":96,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617129+0000","last_change":"2024-09-12T00:36:37.229680+0000","last_active":"2024-09-12T01:03:44.617129+0000","last_peered":"2024-09-12T01:03:44.617129+0000","last_clean":"2024-09-12T01:03:44.617129+0000","last_became_active":"2024-09-12T00:36:37.228954+0000","last_became_peered":"2024-09-12T00:36:37.228954+0000","last_unstale":"2024-09-12T01:03:44.617129+0000","last_undegraded":"2024-09-12T01:03:44.617129+0000","last_fullsized":"2024-09-12T01:03:44.617129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:42.010486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600391+0000","last_change":"2024-09-12T00:49:10.593501+0000","last_active":"2024-09-12T01:03:49.600391+0000","last_peered":"2024-09-12T01:03:49.600391+0000","last_clean":"2024-09-12T01:03:49.600391+0000","last_became_active":"2024-09-12T00:49:10.592753+0000","last_became_peered":"2024-09-12T00:49:10.592753+0000","last_unstale":"2024-09-12T01:03:49.600391+0000","last_undegraded":"2024-09-12T01:03:49.600391+0000","last_fullsized":"2024-09-12T01:03:49.600391+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:14.659960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763857+0000","last_change":"2024-09-12T00:38:10.703751+0000","last_active":"2024-09-12T01:05:19.763857+0000","last_peered":"2024-09-12T01:05:19.763857+0000","last_clean":"2024-09-12T01:05:19.763857+0000","last_became_active":"2024-09-12T00:38:10.702958+0000","last_became_peered":"2024-09-12T00:38:10.702958+0000","last_unstale":"2024-09-12T01:05:19.763857+0000","last_undegraded":"2024-09-12T01:05:19.763857+0000","last_fullsized":"2024-09-12T01:05:19.763857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:12.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.595391+0000","last_change":"2024-09-12T00:38:07.650713+0000","last_active":"2024-09-12T01:05:14.595391+0000","last_peered":"2024-09-12T01:05:14.595391+0000","last_clean":"2024-09-12T01:05:14.595391+0000","last_became_active":"2024-09-12T00:38:07.650035+0000","last_became_peered":"2024-09-12T00:38:07.650035+0000","last_unstale":"2024-09-12T01:05:14.595391+0000","last_undegraded":"2024-09-12T01:05:14.595391+0000","last_fullsized":"2024-09-12T01:05:14.595391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.848243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"258'11","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617043+0000","last_change":"2024-09-12T00:36:37.223313+0000","last_active":"2024-09-12T01:03:44.617043+0000","last_peered":"2024-09-12T01:03:44.617043+0000","last_clean":"2024-09-12T01:03:44.617043+0000","last_became_active":"2024-09-12T00:36:37.222545+0000","last_became_peered":"2024-09-12T00:36:37.222545+0000","last_unstale":"2024-09-12T01:03:44.617043+0000","last_undegraded":"2024-09-12T01:03:44.617043+0000","last_fullsized":"2024-09-12T01:03:44.617043+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:28.704973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618658+0000","last_change":"2024-09-12T00:49:10.613325+0000","last_active":"2024-09-12T01:03:49.618658+0000","last_peered":"2024-09-12T01:03:49.618658+0000","last_clean":"2024-09-12T01:03:49.618658+0000","last_became_active":"2024-09-12T00:49:10.612680+0000","last_became_peered":"2024-09-12T00:49:10.612680+0000","last_unstale":"2024-09-12T01:03:49.618658+0000","last_undegraded":"2024-09-12T01:03:49.618658+0000","last_fullsized":"2024-09-12T01:03:49.618658+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.686773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763779+0000","last_change":"2024-09-12T00:38:10.698273+0000","last_active":"2024-09-12T01:05:19.763779+0000","last_peered":"2024-09-12T01:05:19.763779+0000","last_clean":"2024-09-12T01:05:19.763779+0000","last_became_active":"2024-09-12T00:38:10.691107+0000","last_became_peered":"2024-09-12T00:38:10.691107+0000","last_unstale":"2024-09-12T01:05:19.763779+0000","last_undegraded":"2024-09-12T01:05:19.763779+0000","last_fullsized":"2024-09-12T01:05:19.763779+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.535876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"267'3","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.783064+0000","last_change":"2024-09-12T00:38:07.657937+0000","last_active":"2024-09-12T01:05:14.783064+0000","last_peered":"2024-09-12T01:05:14.783064+0000","last_clean":"2024-09-12T01:05:14.783064+0000","last_became_active":"2024-09-12T00:38:07.657155+0000","last_became_peered":"2024-09-12T00:38:07.657155+0000","last_unstale":"2024-09-12T01:05:14.783064+0000","last_undegraded":"2024-09-12T01:05:14.783064+0000","last_fullsized":"2024-09-12T01:05:14.783064+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:32.225678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"267'20","reported_seq":101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.541498+0000","last_change":"2024-09-12T00:36:37.222927+0000","last_active":"2024-09-12T01:05:02.541498+0000","last_peered":"2024-09-12T01:05:02.541498+0000","last_clean":"2024-09-12T01:05:02.541498+0000","last_became_active":"2024-09-12T00:36:37.221980+0000","last_became_peered":"2024-09-12T00:36:37.221980+0000","last_unstale":"2024-09-12T01:05:02.541498+0000","last_undegraded":"2024-09-12T01:05:02.541498+0000","last_fullsized":"2024-09-12T01:05:02.541498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:08.085009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'305","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.155017+0000","last_change":"2024-09-12T00:21:42.528797+0000","last_active":"2024-09-12T01:05:53.155017+0000","last_peered":"2024-09-12T01:05:53.155017+0000","last_clean":"2024-09-12T01:05:53.155017+0000","last_became_active":"2024-09-12T00:21:42.528236+0000","last_became_peered":"2024-09-12T00:21:42.528236+0000","last_unstale":"2024-09-12T01:05:53.155017+0000","last_undegraded":"2024-09-12T01:05:53.155017+0000","last_fullsized":"2024-09-12T01:05:53.155017+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:42.182294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1861783,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":458,"num_read_kb":8804,"num_write":1137,"num_write_kb":22191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'52","reported_seq":604,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.310893+0000","last_change":"2024-09-12T00:21:44.504479+0000","last_active":"2024-09-12T01:05:23.310893+0000","last_peered":"2024-09-12T01:05:23.310893+0000","last_clean":"2024-09-12T01:05:23.310893+0000","last_became_active":"2024-09-12T00:21:44.499494+0000","last_became_peered":"2024-09-12T00:21:44.499494+0000","last_unstale":"2024-09-12T01:05:23.310893+0000","last_undegraded":"2024-09-12T01:05:23.310893+0000","last_fullsized":"2024-09-12T01:05:23.310893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.715105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":187,"num_write":87,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'399","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.410078+0000","last_change":"2024-09-12T00:21:42.512960+0000","last_active":"2024-09-12T01:05:39.410078+0000","last_peered":"2024-09-12T01:05:39.410078+0000","last_clean":"2024-09-12T01:05:39.410078+0000","last_became_active":"2024-09-12T00:21:42.511901+0000","last_became_peered":"2024-09-12T00:21:42.511901+0000","last_unstale":"2024-09-12T01:05:39.410078+0000","last_undegraded":"2024-09-12T01:05:39.410078+0000","last_fullsized":"2024-09-12T01:05:39.410078+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:23.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9055852,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":763,"num_read_kb":14451,"num_write":1319,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'102","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.581466+0000","last_change":"2024-09-12T00:21:44.498811+0000","last_active":"2024-09-12T01:05:38.581466+0000","last_peered":"2024-09-12T01:05:38.581466+0000","last_clean":"2024-09-12T01:05:38.581466+0000","last_became_active":"2024-09-12T00:21:44.498503+0000","last_became_peered":"2024-09-12T00:21:44.498503+0000","last_unstale":"2024-09-12T01:05:38.581466+0000","last_undegraded":"2024-09-12T01:05:38.581466+0000","last_fullsized":"2024-09-12T01:05:38.581466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:31.431088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":343,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'256","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.506720+0000","last_change":"2024-09-12T00:21:42.535770+0000","last_active":"2024-09-12T01:05:31.506720+0000","last_peered":"2024-09-12T01:05:31.506720+0000","last_clean":"2024-09-12T01:05:31.506720+0000","last_became_active":"2024-09-12T00:21:42.535071+0000","last_became_peered":"2024-09-12T00:21:42.535071+0000","last_unstale":"2024-09-12T01:05:31.506720+0000","last_undegraded":"2024-09-12T01:05:31.506720+0000","last_fullsized":"2024-09-12T01:05:31.506720+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.704366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7669220,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":697,"num_read_kb":29454,"num_write":912,"num_write_kb":25069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'217","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.419030+0000","last_change":"2024-09-12T00:21:44.498204+0000","last_active":"2024-09-12T01:06:44.419030+0000","last_peered":"2024-09-12T01:06:44.419030+0000","last_clean":"2024-09-12T01:06:44.419030+0000","last_became_active":"2024-09-12T00:21:44.497569+0000","last_became_peered":"2024-09-12T00:21:44.497569+0000","last_unstale":"2024-09-12T01:06:44.419030+0000","last_undegraded":"2024-09-12T01:06:44.419030+0000","last_fullsized":"2024-09-12T01:06:44.419030+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.653439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":917,"num_read_kb":735,"num_write":338,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'298","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.281579+0000","last_change":"2024-09-12T00:21:42.528466+0000","last_active":"2024-09-12T01:05:49.281579+0000","last_peered":"2024-09-12T01:05:49.281579+0000","last_clean":"2024-09-12T01:05:49.281579+0000","last_became_active":"2024-09-12T00:21:42.528057+0000","last_became_peered":"2024-09-12T00:21:42.528057+0000","last_unstale":"2024-09-12T01:05:49.281579+0000","last_undegraded":"2024-09-12T01:05:49.281579+0000","last_fullsized":"2024-09-12T01:05:49.281579+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:39.430016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7615455,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":536,"num_read_kb":8621,"num_write":1159,"num_write_kb":31712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'137","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.579683+0000","last_change":"2024-09-12T00:21:44.480273+0000","last_active":"2024-09-12T01:04:14.579683+0000","last_peered":"2024-09-12T01:04:14.579683+0000","last_clean":"2024-09-12T01:04:14.579683+0000","last_became_active":"2024-09-12T00:21:44.479037+0000","last_became_peered":"2024-09-12T00:21:44.479037+0000","last_unstale":"2024-09-12T01:04:14.579683+0000","last_undegraded":"2024-09-12T01:04:14.579683+0000","last_fullsized":"2024-09-12T01:04:14.579683+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:47.501743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":200,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'303","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.619867+0000","last_change":"2024-09-12T00:21:42.515893+0000","last_active":"2024-09-12T01:05:20.619867+0000","last_peered":"2024-09-12T01:05:20.619867+0000","last_clean":"2024-09-12T01:05:20.619867+0000","last_became_active":"2024-09-12T00:21:42.515464+0000","last_became_peered":"2024-09-12T00:21:42.515464+0000","last_unstale":"2024-09-12T01:05:20.619867+0000","last_undegraded":"2024-09-12T01:05:20.619867+0000","last_fullsized":"2024-09-12T01:05:20.619867+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:46.082315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11750416,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":467,"num_read_kb":28078,"num_write":1204,"num_write_kb":29332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'4286","reported_seq":4956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.151752+0000","last_change":"2024-09-12T00:21:44.496471+0000","last_active":"2024-09-12T01:05:25.151752+0000","last_peered":"2024-09-12T01:05:25.151752+0000","last_clean":"2024-09-12T01:05:25.151752+0000","last_became_active":"2024-09-12T00:21:44.495734+0000","last_became_peered":"2024-09-12T00:21:44.495734+0000","last_unstale":"2024-09-12T01:05:25.151752+0000","last_undegraded":"2024-09-12T01:05:25.151752+0000","last_fullsized":"2024-09-12T01:05:25.151752+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":3000,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:24.946491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17226,"num_read_kb":14426,"num_write":6464,"num_write_kb":3218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'291","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.339538+0000","last_change":"2024-09-12T00:21:42.534954+0000","last_active":"2024-09-12T01:04:20.339538+0000","last_peered":"2024-09-12T01:04:20.339538+0000","last_clean":"2024-09-12T01:04:20.339538+0000","last_became_active":"2024-09-12T00:21:42.534582+0000","last_became_peered":"2024-09-12T00:21:42.534582+0000","last_unstale":"2024-09-12T01:04:20.339538+0000","last_undegraded":"2024-09-12T01:04:20.339538+0000","last_fullsized":"2024-09-12T01:04:20.339538+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:20.859536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8784333,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":407,"num_read_kb":25297,"num_write":1044,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'161","reported_seq":807,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.318189+0000","last_change":"2024-09-12T00:21:44.511727+0000","last_active":"2024-09-12T01:06:07.318189+0000","last_peered":"2024-09-12T01:06:07.318189+0000","last_clean":"2024-09-12T01:06:07.318189+0000","last_became_active":"2024-09-12T00:21:44.510410+0000","last_became_peered":"2024-09-12T00:21:44.510410+0000","last_unstale":"2024-09-12T01:06:07.318189+0000","last_undegraded":"2024-09-12T01:06:07.318189+0000","last_fullsized":"2024-09-12T01:06:07.318189+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:16.032761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":577,"num_write":213,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'304","reported_seq":1169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.622469+0000","last_change":"2024-09-12T00:21:42.531705+0000","last_active":"2024-09-12T01:05:20.622469+0000","last_peered":"2024-09-12T01:05:20.622469+0000","last_clean":"2024-09-12T01:05:20.622469+0000","last_became_active":"2024-09-12T00:21:42.530155+0000","last_became_peered":"2024-09-12T00:21:42.530155+0000","last_unstale":"2024-09-12T01:05:20.622469+0000","last_undegraded":"2024-09-12T01:05:20.622469+0000","last_fullsized":"2024-09-12T01:05:20.622469+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:16.745757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243942,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":968,"num_read_kb":26574,"num_write":1075,"num_write_kb":18888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'160","reported_seq":770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.994148+0000","last_change":"2024-09-12T00:21:44.484205+0000","last_active":"2024-09-12T01:05:26.994148+0000","last_peered":"2024-09-12T01:05:26.994148+0000","last_clean":"2024-09-12T01:05:26.994148+0000","last_became_active":"2024-09-12T00:21:44.483825+0000","last_became_peered":"2024-09-12T00:21:44.483825+0000","last_unstale":"2024-09-12T01:05:26.994148+0000","last_undegraded":"2024-09-12T01:05:26.994148+0000","last_fullsized":"2024-09-12T01:05:26.994148+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:08.179658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":577,"num_write":242,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'326","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.447863+0000","last_change":"2024-09-12T00:22:12.621823+0000","last_active":"2024-09-12T01:04:57.447863+0000","last_peered":"2024-09-12T01:04:57.447863+0000","last_clean":"2024-09-12T01:04:57.447863+0000","last_became_active":"2024-09-12T00:22:12.620753+0000","last_became_peered":"2024-09-12T00:22:12.620753+0000","last_unstale":"2024-09-12T01:04:57.447863+0000","last_undegraded":"2024-09-12T01:04:57.447863+0000","last_fullsized":"2024-09-12T01:04:57.447863+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:42.887841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6432694,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":507,"num_read_kb":16569,"num_write":1263,"num_write_kb":33151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'179","reported_seq":763,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.857805+0000","last_change":"2024-09-12T00:21:44.528812+0000","last_active":"2024-09-12T01:05:49.857805+0000","last_peered":"2024-09-12T01:05:49.857805+0000","last_clean":"2024-09-12T01:05:49.857805+0000","last_became_active":"2024-09-12T00:21:44.528311+0000","last_became_peered":"2024-09-12T00:21:44.528311+0000","last_unstale":"2024-09-12T01:05:49.857805+0000","last_undegraded":"2024-09-12T01:05:49.857805+0000","last_fullsized":"2024-09-12T01:05:49.857805+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:11.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":638,"num_write":310,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'108","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.649963+0000","last_change":"2024-09-12T00:21:44.494924+0000","last_active":"2024-09-12T01:04:18.649963+0000","last_peered":"2024-09-12T01:04:18.649963+0000","last_clean":"2024-09-12T01:04:18.649963+0000","last_became_active":"2024-09-12T00:21:44.493767+0000","last_became_peered":"2024-09-12T00:21:44.493767+0000","last_unstale":"2024-09-12T01:04:18.649963+0000","last_undegraded":"2024-09-12T01:04:18.649963+0000","last_fullsized":"2024-09-12T01:04:18.649963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:36.428208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":357,"num_write":148,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'262","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.706142+0000","last_change":"2024-09-12T00:21:42.515019+0000","last_active":"2024-09-12T01:05:38.706142+0000","last_peered":"2024-09-12T01:05:38.706142+0000","last_clean":"2024-09-12T01:05:38.706142+0000","last_became_active":"2024-09-12T00:21:42.514489+0000","last_became_peered":"2024-09-12T00:21:42.514489+0000","last_unstale":"2024-09-12T01:05:38.706142+0000","last_undegraded":"2024-09-12T01:05:38.706142+0000","last_fullsized":"2024-09-12T01:05:38.706142+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:26.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585686,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":441,"num_read_kb":6549,"num_write":1034,"num_write_kb":16882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'52","reported_seq":605,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.796075+0000","last_change":"2024-09-12T00:21:44.510300+0000","last_active":"2024-09-12T01:05:30.796075+0000","last_peered":"2024-09-12T01:05:30.796075+0000","last_clean":"2024-09-12T01:05:30.796075+0000","last_became_active":"2024-09-12T00:21:44.509895+0000","last_became_peered":"2024-09-12T00:21:44.509895+0000","last_unstale":"2024-09-12T01:05:30.796075+0000","last_undegraded":"2024-09-12T01:05:30.796075+0000","last_fullsized":"2024-09-12T01:05:30.796075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.091723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":198,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'217","reported_seq":805,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.536689+0000","last_change":"2024-09-12T00:21:42.491403+0000","last_active":"2024-09-12T01:05:04.536689+0000","last_peered":"2024-09-12T01:05:04.536689+0000","last_clean":"2024-09-12T01:05:04.536689+0000","last_became_active":"2024-09-12T00:21:42.490660+0000","last_became_peered":"2024-09-12T00:21:42.490660+0000","last_unstale":"2024-09-12T01:05:04.536689+0000","last_undegraded":"2024-09-12T01:05:04.536689+0000","last_fullsized":"2024-09-12T01:05:04.536689+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:10.128469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3351,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":307,"num_read_kb":4406,"num_write":745,"num_write_kb":22345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'258","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.249226+0000","last_change":"2024-09-12T00:21:44.515348+0000","last_active":"2024-09-12T01:05:47.249226+0000","last_peered":"2024-09-12T01:05:47.249226+0000","last_clean":"2024-09-12T01:05:47.249226+0000","last_became_active":"2024-09-12T00:21:44.514893+0000","last_became_peered":"2024-09-12T00:21:44.514893+0000","last_unstale":"2024-09-12T01:05:47.249226+0000","last_undegraded":"2024-09-12T01:05:47.249226+0000","last_fullsized":"2024-09-12T01:05:47.249226+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.665865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1166,"num_read_kb":956,"num_write":431,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'289","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.539772+0000","last_change":"2024-09-12T00:22:13.552941+0000","last_active":"2024-09-12T01:03:27.539772+0000","last_peered":"2024-09-12T01:03:27.539772+0000","last_clean":"2024-09-12T01:03:27.539772+0000","last_became_active":"2024-09-12T00:22:13.552126+0000","last_became_peered":"2024-09-12T00:22:13.552126+0000","last_unstale":"2024-09-12T01:03:27.539772+0000","last_undegraded":"2024-09-12T01:03:27.539772+0000","last_fullsized":"2024-09-12T01:03:27.539772+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.367793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5314894,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":477,"num_read_kb":9786,"num_write":1091,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'125","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.824816+0000","last_change":"2024-09-12T00:21:44.521066+0000","last_active":"2024-09-12T01:03:50.824816+0000","last_peered":"2024-09-12T01:03:50.824816+0000","last_clean":"2024-09-12T01:03:50.824816+0000","last_became_active":"2024-09-12T00:21:44.520441+0000","last_became_peered":"2024-09-12T00:21:44.520441+0000","last_unstale":"2024-09-12T01:03:50.824816+0000","last_undegraded":"2024-09-12T01:03:50.824816+0000","last_fullsized":"2024-09-12T01:03:50.824816+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:58.395313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":459,"num_write":198,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'283","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.542372+0000","last_change":"2024-09-12T00:21:42.506242+0000","last_active":"2024-09-12T01:05:29.542372+0000","last_peered":"2024-09-12T01:05:29.542372+0000","last_clean":"2024-09-12T01:05:29.542372+0000","last_became_active":"2024-09-12T00:21:42.505754+0000","last_became_peered":"2024-09-12T00:21:42.505754+0000","last_unstale":"2024-09-12T01:05:29.542372+0000","last_undegraded":"2024-09-12T01:05:29.542372+0000","last_fullsized":"2024-09-12T01:05:29.542372+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:17.644717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14158857,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":426,"num_read_kb":23994,"num_write":1075,"num_write_kb":44987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'533","reported_seq":1294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.156332+0000","last_change":"2024-09-12T00:21:44.510694+0000","last_active":"2024-09-12T01:04:59.156332+0000","last_peered":"2024-09-12T01:04:59.156332+0000","last_clean":"2024-09-12T01:04:59.156332+0000","last_became_active":"2024-09-12T00:21:44.509840+0000","last_became_peered":"2024-09-12T00:21:44.509840+0000","last_unstale":"2024-09-12T01:04:59.156332+0000","last_undegraded":"2024-09-12T01:04:59.156332+0000","last_fullsized":"2024-09-12T01:04:59.156332+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:05.378563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2527,"num_read_kb":2144,"num_write":948,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'292","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.199763+0000","last_change":"2024-09-12T00:21:42.531184+0000","last_active":"2024-09-12T01:05:30.199763+0000","last_peered":"2024-09-12T01:05:30.199763+0000","last_clean":"2024-09-12T01:05:30.199763+0000","last_became_active":"2024-09-12T00:21:42.529312+0000","last_became_peered":"2024-09-12T00:21:42.529312+0000","last_unstale":"2024-09-12T01:05:30.199763+0000","last_undegraded":"2024-09-12T01:05:30.199763+0000","last_fullsized":"2024-09-12T01:05:30.199763+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:28.828303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":436,"num_read_kb":653,"num_write":1031,"num_write_kb":45878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'102","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.071243+0000","last_change":"2024-09-12T00:21:44.499519+0000","last_active":"2024-09-12T01:05:04.071243+0000","last_peered":"2024-09-12T01:05:04.071243+0000","last_clean":"2024-09-12T01:05:04.071243+0000","last_became_active":"2024-09-12T00:21:44.499173+0000","last_became_peered":"2024-09-12T00:21:44.499173+0000","last_unstale":"2024-09-12T01:05:04.071243+0000","last_undegraded":"2024-09-12T01:05:04.071243+0000","last_fullsized":"2024-09-12T01:05:04.071243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:51.311165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":398,"num_write":158,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'302","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.064153+0000","last_change":"2024-09-12T00:21:42.530559+0000","last_active":"2024-09-12T01:05:37.064153+0000","last_peered":"2024-09-12T01:05:37.064153+0000","last_clean":"2024-09-12T01:05:37.064153+0000","last_became_active":"2024-09-12T00:21:42.529873+0000","last_became_peered":"2024-09-12T00:21:42.529873+0000","last_unstale":"2024-09-12T01:05:37.064153+0000","last_undegraded":"2024-09-12T01:05:37.064153+0000","last_fullsized":"2024-09-12T01:05:37.064153+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:42.813481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998659,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":481,"num_read_kb":35147,"num_write":1161,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'136","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.400586+0000","last_change":"2024-09-12T00:21:52.546288+0000","last_active":"2024-09-12T01:06:07.400586+0000","last_peered":"2024-09-12T01:06:07.400586+0000","last_clean":"2024-09-12T01:06:07.400586+0000","last_became_active":"2024-09-12T00:21:52.545571+0000","last_became_peered":"2024-09-12T00:21:52.545571+0000","last_unstale":"2024-09-12T01:06:07.400586+0000","last_undegraded":"2024-09-12T01:06:07.400586+0000","last_fullsized":"2024-09-12T01:06:07.400586+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:55.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'88","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.478850+0000","last_change":"2024-09-12T00:21:44.485322+0000","last_active":"2024-09-12T01:05:20.478850+0000","last_peered":"2024-09-12T01:05:20.478850+0000","last_clean":"2024-09-12T01:05:20.478850+0000","last_became_active":"2024-09-12T00:21:44.484514+0000","last_became_peered":"2024-09-12T00:21:44.484514+0000","last_unstale":"2024-09-12T01:05:20.478850+0000","last_undegraded":"2024-09-12T01:05:20.478850+0000","last_fullsized":"2024-09-12T01:05:20.478850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:59.343439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":321,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'274","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.548948+0000","last_change":"2024-09-12T00:21:42.496374+0000","last_active":"2024-09-12T01:05:28.548948+0000","last_peered":"2024-09-12T01:05:28.548948+0000","last_clean":"2024-09-12T01:05:28.548948+0000","last_became_active":"2024-09-12T00:21:42.495808+0000","last_became_peered":"2024-09-12T00:21:42.495808+0000","last_unstale":"2024-09-12T01:05:28.548948+0000","last_undegraded":"2024-09-12T01:05:28.548948+0000","last_fullsized":"2024-09-12T01:05:28.548948+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:30.009676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4734268,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":478,"num_read_kb":20340,"num_write":997,"num_write_kb":31693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.604524+0000","last_change":"2024-09-12T00:21:46.515667+0000","last_active":"2024-09-12T01:02:54.604524+0000","last_peered":"2024-09-12T01:02:54.604524+0000","last_clean":"2024-09-12T01:02:54.604524+0000","last_became_active":"2024-09-12T00:21:46.515363+0000","last_became_peered":"2024-09-12T00:21:46.515363+0000","last_unstale":"2024-09-12T01:02:54.604524+0000","last_undegraded":"2024-09-12T01:02:54.604524+0000","last_fullsized":"2024-09-12T01:02:54.604524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:03.935806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'325","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594824+0000","last_change":"2024-09-12T00:21:48.528210+0000","last_active":"2024-09-12T01:05:19.594824+0000","last_peered":"2024-09-12T01:05:19.594824+0000","last_clean":"2024-09-12T01:05:19.594824+0000","last_became_active":"2024-09-12T00:21:48.524091+0000","last_became_peered":"2024-09-12T00:21:48.524091+0000","last_unstale":"2024-09-12T01:05:19.594824+0000","last_undegraded":"2024-09-12T01:05:19.594824+0000","last_fullsized":"2024-09-12T01:05:19.594824+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:14.328463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":973,"num_write":412,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.751663+0000","last_change":"2024-09-12T00:21:50.552444+0000","last_active":"2024-09-12T01:02:59.751663+0000","last_peered":"2024-09-12T01:02:59.751663+0000","last_clean":"2024-09-12T01:02:59.751663+0000","last_became_active":"2024-09-12T00:21:50.551742+0000","last_became_peered":"2024-09-12T00:21:50.551742+0000","last_unstale":"2024-09-12T01:02:59.751663+0000","last_undegraded":"2024-09-12T01:02:59.751663+0000","last_fullsized":"2024-09-12T01:02:59.751663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:41.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'173","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.384837+0000","last_change":"2024-09-12T00:21:52.546442+0000","last_active":"2024-09-12T01:06:06.384837+0000","last_peered":"2024-09-12T01:06:06.384837+0000","last_clean":"2024-09-12T01:06:06.384837+0000","last_became_active":"2024-09-12T00:21:52.544469+0000","last_became_peered":"2024-09-12T00:21:52.544469+0000","last_unstale":"2024-09-12T01:06:06.384837+0000","last_undegraded":"2024-09-12T01:06:06.384837+0000","last_fullsized":"2024-09-12T01:06:06.384837+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:08.007114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":251,"num_write":350,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'4223","reported_seq":4854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.512839+0000","last_change":"2024-09-12T00:21:44.500660+0000","last_active":"2024-09-12T01:04:03.512839+0000","last_peered":"2024-09-12T01:04:03.512839+0000","last_clean":"2024-09-12T01:04:03.512839+0000","last_became_active":"2024-09-12T00:21:44.500367+0000","last_became_peered":"2024-09-12T00:21:44.500367+0000","last_unstale":"2024-09-12T01:04:03.512839+0000","last_undegraded":"2024-09-12T01:04:03.512839+0000","last_fullsized":"2024-09-12T01:04:03.512839+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:22.788119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17010,"num_read_kb":14247,"num_write":6340,"num_write_kb":3163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'308","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.387570+0000","last_change":"2024-09-12T00:21:42.500670+0000","last_active":"2024-09-12T01:05:26.387570+0000","last_peered":"2024-09-12T01:05:26.387570+0000","last_clean":"2024-09-12T01:05:26.387570+0000","last_became_active":"2024-09-12T00:21:42.492572+0000","last_became_peered":"2024-09-12T00:21:42.492572+0000","last_unstale":"2024-09-12T01:05:26.387570+0000","last_undegraded":"2024-09-12T01:05:26.387570+0000","last_fullsized":"2024-09-12T01:05:26.387570+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:45.219943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14345206,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":515,"num_read_kb":145927,"num_write":1098,"num_write_kb":64533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.576546+0000","last_change":"2024-09-12T00:21:46.491690+0000","last_active":"2024-09-12T01:03:59.576546+0000","last_peered":"2024-09-12T01:03:59.576546+0000","last_clean":"2024-09-12T01:03:59.576546+0000","last_became_active":"2024-09-12T00:21:46.490985+0000","last_became_peered":"2024-09-12T00:21:46.490985+0000","last_unstale":"2024-09-12T01:03:59.576546+0000","last_undegraded":"2024-09-12T01:03:59.576546+0000","last_fullsized":"2024-09-12T01:03:59.576546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:41.609896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'84","reported_seq":618,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.296129+0000","last_change":"2024-09-12T00:21:48.535909+0000","last_active":"2024-09-12T01:04:55.296129+0000","last_peered":"2024-09-12T01:04:55.296129+0000","last_clean":"2024-09-12T01:04:55.296129+0000","last_became_active":"2024-09-12T00:21:48.535190+0000","last_became_peered":"2024-09-12T00:21:48.535190+0000","last_unstale":"2024-09-12T01:04:55.296129+0000","last_undegraded":"2024-09-12T01:04:55.296129+0000","last_fullsized":"2024-09-12T01:04:55.296129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.533022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.751597+0000","last_change":"2024-09-12T00:21:50.551431+0000","last_active":"2024-09-12T01:02:59.751597+0000","last_peered":"2024-09-12T01:02:59.751597+0000","last_clean":"2024-09-12T01:02:59.751597+0000","last_became_active":"2024-09-12T00:21:50.550214+0000","last_became_peered":"2024-09-12T00:21:50.550214+0000","last_unstale":"2024-09-12T01:02:59.751597+0000","last_undegraded":"2024-09-12T01:02:59.751597+0000","last_fullsized":"2024-09-12T01:02:59.751597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:11.439485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'124","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.000458+0000","last_change":"2024-09-12T00:21:52.545902+0000","last_active":"2024-09-12T01:05:53.000458+0000","last_peered":"2024-09-12T01:05:53.000458+0000","last_clean":"2024-09-12T01:05:53.000458+0000","last_became_active":"2024-09-12T00:21:52.545166+0000","last_became_peered":"2024-09-12T00:21:52.545166+0000","last_unstale":"2024-09-12T01:05:53.000458+0000","last_undegraded":"2024-09-12T01:05:53.000458+0000","last_fullsized":"2024-09-12T01:05:53.000458+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:01.544361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":292,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'288","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.243846+0000","last_change":"2024-09-12T00:21:44.520746+0000","last_active":"2024-09-12T01:04:15.243846+0000","last_peered":"2024-09-12T01:04:15.243846+0000","last_clean":"2024-09-12T01:04:15.243846+0000","last_became_active":"2024-09-12T00:21:44.520057+0000","last_became_peered":"2024-09-12T00:21:44.520057+0000","last_unstale":"2024-09-12T01:04:15.243846+0000","last_undegraded":"2024-09-12T01:04:15.243846+0000","last_fullsized":"2024-09-12T01:04:15.243846+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:54.675479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1259,"num_read_kb":1089,"num_write":465,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'259","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.992074+0000","last_change":"2024-09-12T00:21:42.497428+0000","last_active":"2024-09-12T01:04:19.992074+0000","last_peered":"2024-09-12T01:04:19.992074+0000","last_clean":"2024-09-12T01:04:19.992074+0000","last_became_active":"2024-09-12T00:21:42.496059+0000","last_became_peered":"2024-09-12T00:21:42.496059+0000","last_unstale":"2024-09-12T01:04:19.992074+0000","last_undegraded":"2024-09-12T01:04:19.992074+0000","last_fullsized":"2024-09-12T01:04:19.992074+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:13.046572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2126129,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":433,"num_read_kb":8626,"num_write":932,"num_write_kb":21953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.562551+0000","last_change":"2024-09-12T00:21:46.501997+0000","last_active":"2024-09-12T01:02:54.562551+0000","last_peered":"2024-09-12T01:02:54.562551+0000","last_clean":"2024-09-12T01:02:54.562551+0000","last_became_active":"2024-09-12T00:21:46.501407+0000","last_became_peered":"2024-09-12T00:21:46.501407+0000","last_unstale":"2024-09-12T01:02:54.562551+0000","last_undegraded":"2024-09-12T01:02:54.562551+0000","last_fullsized":"2024-09-12T01:02:54.562551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.795256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'122","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.317364+0000","last_change":"2024-09-12T00:21:48.542081+0000","last_active":"2024-09-12T01:04:21.317364+0000","last_peered":"2024-09-12T01:04:21.317364+0000","last_clean":"2024-09-12T01:04:21.317364+0000","last_became_active":"2024-09-12T00:21:48.541231+0000","last_became_peered":"2024-09-12T00:21:48.541231+0000","last_unstale":"2024-09-12T01:04:21.317364+0000","last_undegraded":"2024-09-12T01:04:21.317364+0000","last_fullsized":"2024-09-12T01:04:21.317364+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.064538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'784","reported_seq":2510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947341+0000","last_change":"2024-09-12T00:21:50.569545+0000","last_active":"2024-09-12T01:07:12.947341+0000","last_peered":"2024-09-12T01:07:12.947341+0000","last_clean":"2024-09-12T01:07:12.947341+0000","last_became_active":"2024-09-12T00:21:50.568825+0000","last_became_peered":"2024-09-12T00:21:50.568825+0000","last_unstale":"2024-09-12T01:07:12.947341+0000","last_undegraded":"2024-09-12T01:07:12.947341+0000","last_fullsized":"2024-09-12T01:07:12.947341+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'222","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.469146+0000","last_change":"2024-09-12T00:21:52.555837+0000","last_active":"2024-09-12T01:06:07.469146+0000","last_peered":"2024-09-12T01:06:07.469146+0000","last_clean":"2024-09-12T01:06:07.469146+0000","last_became_active":"2024-09-12T00:21:52.554865+0000","last_became_peered":"2024-09-12T00:21:52.554865+0000","last_unstale":"2024-09-12T01:06:07.469146+0000","last_undegraded":"2024-09-12T01:06:07.469146+0000","last_fullsized":"2024-09-12T01:06:07.469146+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:47.453983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":708,"num_read_kb":679,"num_write":497,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'135","reported_seq":691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.308334+0000","last_change":"2024-09-12T00:21:44.523637+0000","last_active":"2024-09-12T01:04:13.308334+0000","last_peered":"2024-09-12T01:04:13.308334+0000","last_clean":"2024-09-12T01:04:13.308334+0000","last_became_active":"2024-09-12T00:21:44.522830+0000","last_became_peered":"2024-09-12T00:21:44.522830+0000","last_unstale":"2024-09-12T01:04:13.308334+0000","last_undegraded":"2024-09-12T01:04:13.308334+0000","last_fullsized":"2024-09-12T01:04:13.308334+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:29.081489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":469,"num_write":207,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'264","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.377944+0000","last_change":"2024-09-12T00:21:42.516948+0000","last_active":"2024-09-12T01:05:02.377944+0000","last_peered":"2024-09-12T01:05:02.377944+0000","last_clean":"2024-09-12T01:05:02.377944+0000","last_became_active":"2024-09-12T00:21:42.516625+0000","last_became_peered":"2024-09-12T00:21:42.516625+0000","last_unstale":"2024-09-12T01:05:02.377944+0000","last_undegraded":"2024-09-12T01:05:02.377944+0000","last_fullsized":"2024-09-12T01:05:02.377944+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:25.672684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4203223,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":486,"num_read_kb":2648,"num_write":1058,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.604571+0000","last_change":"2024-09-12T00:21:46.504025+0000","last_active":"2024-09-12T01:02:54.604571+0000","last_peered":"2024-09-12T01:02:54.604571+0000","last_clean":"2024-09-12T01:02:54.604571+0000","last_became_active":"2024-09-12T00:21:46.503686+0000","last_became_peered":"2024-09-12T00:21:46.503686+0000","last_unstale":"2024-09-12T01:02:54.604571+0000","last_undegraded":"2024-09-12T01:02:54.604571+0000","last_fullsized":"2024-09-12T01:02:54.604571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:46.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'279","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.530837+0000","last_change":"2024-09-12T00:21:48.540014+0000","last_active":"2024-09-12T01:05:20.530837+0000","last_peered":"2024-09-12T01:05:20.530837+0000","last_clean":"2024-09-12T01:05:20.530837+0000","last_became_active":"2024-09-12T00:21:48.539522+0000","last_became_peered":"2024-09-12T00:21:48.539522+0000","last_unstale":"2024-09-12T01:05:20.530837+0000","last_undegraded":"2024-09-12T01:05:20.530837+0000","last_fullsized":"2024-09-12T01:05:20.530837+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:51.751137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":960,"num_write":382,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'774","reported_seq":2460,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.948159+0000","last_change":"2024-09-12T00:21:50.565919+0000","last_active":"2024-09-12T01:07:12.948159+0000","last_peered":"2024-09-12T01:07:12.948159+0000","last_clean":"2024-09-12T01:07:12.948159+0000","last_became_active":"2024-09-12T00:21:50.564483+0000","last_became_peered":"2024-09-12T00:21:50.564483+0000","last_unstale":"2024-09-12T01:07:12.948159+0000","last_undegraded":"2024-09-12T01:07:12.948159+0000","last_fullsized":"2024-09-12T01:07:12.948159+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'576","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.637851+0000","last_change":"2024-09-12T00:21:44.501308+0000","last_active":"2024-09-12T01:05:04.637851+0000","last_peered":"2024-09-12T01:05:04.637851+0000","last_clean":"2024-09-12T01:05:04.637851+0000","last_became_active":"2024-09-12T00:21:44.497754+0000","last_became_peered":"2024-09-12T00:21:44.497754+0000","last_unstale":"2024-09-12T01:05:04.637851+0000","last_undegraded":"2024-09-12T01:05:04.637851+0000","last_fullsized":"2024-09-12T01:05:04.637851+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:01.259088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2710,"num_read_kb":2241,"num_write":1007,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'310","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:50.637061+0000","last_change":"2024-09-12T00:21:42.528462+0000","last_active":"2024-09-12T01:05:50.637061+0000","last_peered":"2024-09-12T01:05:50.637061+0000","last_clean":"2024-09-12T01:05:50.637061+0000","last_became_active":"2024-09-12T00:21:42.528138+0000","last_became_peered":"2024-09-12T00:21:42.528138+0000","last_unstale":"2024-09-12T01:05:50.637061+0000","last_undegraded":"2024-09-12T01:05:50.637061+0000","last_fullsized":"2024-09-12T01:05:50.637061+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:59.797609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12248109,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":691,"num_read_kb":24537,"num_write":1019,"num_write_kb":22675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.781947+0000","last_change":"2024-09-12T00:21:46.503402+0000","last_active":"2024-09-12T01:05:09.781947+0000","last_peered":"2024-09-12T01:05:09.781947+0000","last_clean":"2024-09-12T01:05:09.781947+0000","last_became_active":"2024-09-12T00:21:46.503041+0000","last_became_peered":"2024-09-12T00:21:46.503041+0000","last_unstale":"2024-09-12T01:05:09.781947+0000","last_undegraded":"2024-09-12T01:05:09.781947+0000","last_fullsized":"2024-09-12T01:05:09.781947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.602442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'361","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.602132+0000","last_change":"2024-09-12T00:21:48.539441+0000","last_active":"2024-09-12T01:05:19.602132+0000","last_peered":"2024-09-12T01:05:19.602132+0000","last_clean":"2024-09-12T01:05:19.602132+0000","last_became_active":"2024-09-12T00:21:48.538727+0000","last_became_peered":"2024-09-12T00:21:48.538727+0000","last_unstale":"2024-09-12T01:05:19.602132+0000","last_undegraded":"2024-09-12T01:05:19.602132+0000","last_fullsized":"2024-09-12T01:05:19.602132+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:41.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60701,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":576,"num_read_kb":1074,"num_write":458,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.587751+0000","last_change":"2024-09-12T00:21:50.545196+0000","last_active":"2024-09-12T01:04:39.587751+0000","last_peered":"2024-09-12T01:04:39.587751+0000","last_clean":"2024-09-12T01:04:39.587751+0000","last_became_active":"2024-09-12T00:21:50.544432+0000","last_became_peered":"2024-09-12T00:21:50.544432+0000","last_unstale":"2024-09-12T01:04:39.587751+0000","last_undegraded":"2024-09-12T01:04:39.587751+0000","last_fullsized":"2024-09-12T01:04:39.587751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.923643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'549","reported_seq":1360,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.865258+0000","last_change":"2024-09-12T00:21:52.563743+0000","last_active":"2024-09-12T01:07:12.865258+0000","last_peered":"2024-09-12T01:07:12.865258+0000","last_clean":"2024-09-12T01:07:12.865258+0000","last_became_active":"2024-09-12T00:21:52.563086+0000","last_became_peered":"2024-09-12T00:21:52.563086+0000","last_unstale":"2024-09-12T01:07:12.865258+0000","last_undegraded":"2024-09-12T01:07:12.865258+0000","last_fullsized":"2024-09-12T01:07:12.865258+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:09.343801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1274,"num_read_kb":1271,"num_write":1130,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'524","reported_seq":1304,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.780894+0000","last_change":"2024-09-12T00:21:44.511296+0000","last_active":"2024-09-12T01:05:04.780894+0000","last_peered":"2024-09-12T01:05:04.780894+0000","last_clean":"2024-09-12T01:05:04.780894+0000","last_became_active":"2024-09-12T00:21:44.510918+0000","last_became_peered":"2024-09-12T00:21:44.510918+0000","last_unstale":"2024-09-12T01:05:04.780894+0000","last_undegraded":"2024-09-12T01:05:04.780894+0000","last_fullsized":"2024-09-12T01:05:04.780894+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:54.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2468,"num_read_kb":2089,"num_write":789,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'271","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.752863+0000","last_change":"2024-09-12T00:21:42.513398+0000","last_active":"2024-09-12T01:04:29.752863+0000","last_peered":"2024-09-12T01:04:29.752863+0000","last_clean":"2024-09-12T01:04:29.752863+0000","last_became_active":"2024-09-12T00:21:42.513031+0000","last_became_peered":"2024-09-12T00:21:42.513031+0000","last_unstale":"2024-09-12T01:04:29.752863+0000","last_undegraded":"2024-09-12T01:04:29.752863+0000","last_fullsized":"2024-09-12T01:04:29.752863+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10423793,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":421,"num_read_kb":44893,"num_write":956,"num_write_kb":33699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.594203+0000","last_change":"2024-09-12T00:21:46.519542+0000","last_active":"2024-09-12T01:05:09.594203+0000","last_peered":"2024-09-12T01:05:09.594203+0000","last_clean":"2024-09-12T01:05:09.594203+0000","last_became_active":"2024-09-12T00:21:46.517981+0000","last_became_peered":"2024-09-12T00:21:46.517981+0000","last_unstale":"2024-09-12T01:05:09.594203+0000","last_undegraded":"2024-09-12T01:05:09.594203+0000","last_fullsized":"2024-09-12T01:05:09.594203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:03.803070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'269","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.615952+0000","last_change":"2024-09-12T00:21:48.523626+0000","last_active":"2024-09-12T01:06:49.615952+0000","last_peered":"2024-09-12T01:06:49.615952+0000","last_clean":"2024-09-12T01:06:49.615952+0000","last_became_active":"2024-09-12T00:21:48.522920+0000","last_became_peered":"2024-09-12T00:21:48.522920+0000","last_unstale":"2024-09-12T01:06:49.615952+0000","last_undegraded":"2024-09-12T01:06:49.615952+0000","last_fullsized":"2024-09-12T01:06:49.615952+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:28.182271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55088,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":905,"num_write":360,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.566845+0000","last_change":"2024-09-12T00:21:50.545714+0000","last_active":"2024-09-12T01:03:14.566845+0000","last_peered":"2024-09-12T01:03:14.566845+0000","last_clean":"2024-09-12T01:03:14.566845+0000","last_became_active":"2024-09-12T00:21:50.543639+0000","last_became_peered":"2024-09-12T00:21:50.543639+0000","last_unstale":"2024-09-12T01:03:14.566845+0000","last_undegraded":"2024-09-12T01:03:14.566845+0000","last_fullsized":"2024-09-12T01:03:14.566845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:41.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2371","reported_seq":4212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.690521+0000","last_change":"2024-09-12T00:21:52.538444+0000","last_active":"2024-09-12T01:06:56.690521+0000","last_peered":"2024-09-12T01:06:56.690521+0000","last_clean":"2024-09-12T01:06:56.690521+0000","last_became_active":"2024-09-12T00:21:52.537701+0000","last_became_peered":"2024-09-12T00:21:52.537701+0000","last_unstale":"2024-09-12T01:06:56.690521+0000","last_undegraded":"2024-09-12T01:06:56.690521+0000","last_fullsized":"2024-09-12T01:06:56.690521+0000","mapping_epoch":36,"log_start":"267'2300","ondisk_log_start":"267'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:39.923689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5977,"num_write":4771,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'112","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.997112+0000","last_change":"2024-09-12T00:21:44.494633+0000","last_active":"2024-09-12T01:05:52.997112+0000","last_peered":"2024-09-12T01:05:52.997112+0000","last_clean":"2024-09-12T01:05:52.997112+0000","last_became_active":"2024-09-12T00:21:44.494313+0000","last_became_peered":"2024-09-12T00:21:44.494313+0000","last_unstale":"2024-09-12T01:05:52.997112+0000","last_undegraded":"2024-09-12T01:05:52.997112+0000","last_fullsized":"2024-09-12T01:05:52.997112+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:22.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":397,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'283","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.429761+0000","last_change":"2024-09-12T00:21:42.529770+0000","last_active":"2024-09-12T01:05:40.429761+0000","last_peered":"2024-09-12T01:05:40.429761+0000","last_clean":"2024-09-12T01:05:40.429761+0000","last_became_active":"2024-09-12T00:21:42.529372+0000","last_became_peered":"2024-09-12T00:21:42.529372+0000","last_unstale":"2024-09-12T01:05:40.429761+0000","last_undegraded":"2024-09-12T01:05:40.429761+0000","last_fullsized":"2024-09-12T01:05:40.429761+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.798589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6348479,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":507,"num_read_kb":12047,"num_write":1179,"num_write_kb":31958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611469+0000","last_change":"2024-09-12T00:21:46.512407+0000","last_active":"2024-09-12T01:04:34.611469+0000","last_peered":"2024-09-12T01:04:34.611469+0000","last_clean":"2024-09-12T01:04:34.611469+0000","last_became_active":"2024-09-12T00:21:46.511704+0000","last_became_peered":"2024-09-12T00:21:46.511704+0000","last_unstale":"2024-09-12T01:04:34.611469+0000","last_undegraded":"2024-09-12T01:04:34.611469+0000","last_fullsized":"2024-09-12T01:04:34.611469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:04.950564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'279","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.840274+0000","last_change":"2024-09-12T00:21:48.552567+0000","last_active":"2024-09-12T01:07:12.840274+0000","last_peered":"2024-09-12T01:07:12.840274+0000","last_clean":"2024-09-12T01:07:12.840274+0000","last_became_active":"2024-09-12T00:21:48.551752+0000","last_became_peered":"2024-09-12T00:21:48.551752+0000","last_unstale":"2024-09-12T01:07:12.840274+0000","last_undegraded":"2024-09-12T01:07:12.840274+0000","last_fullsized":"2024-09-12T01:07:12.840274+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.243890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53943,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":454,"num_read_kb":871,"num_write":360,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'775","reported_seq":4653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.220504+0000","last_change":"2024-09-12T00:21:50.562293+0000","last_active":"2024-09-12T01:07:13.220504+0000","last_peered":"2024-09-12T01:07:13.220504+0000","last_clean":"2024-09-12T01:07:13.220504+0000","last_became_active":"2024-09-12T00:21:50.561680+0000","last_became_peered":"2024-09-12T00:21:50.561680+0000","last_unstale":"2024-09-12T01:07:13.220504+0000","last_undegraded":"2024-09-12T01:07:13.220504+0000","last_fullsized":"2024-09-12T01:07:13.220504+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":701,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:35.170696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'119","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.966637+0000","last_change":"2024-09-12T00:21:52.547626+0000","last_active":"2024-09-12T01:07:11.966637+0000","last_peered":"2024-09-12T01:07:11.966637+0000","last_clean":"2024-09-12T01:07:11.966637+0000","last_became_active":"2024-09-12T00:21:52.546889+0000","last_became_peered":"2024-09-12T00:21:52.546889+0000","last_unstale":"2024-09-12T01:07:11.966637+0000","last_undegraded":"2024-09-12T01:07:11.966637+0000","last_fullsized":"2024-09-12T01:07:11.966637+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:06.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":121,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'188","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.081285+0000","last_change":"2024-09-12T00:21:44.519531+0000","last_active":"2024-09-12T01:05:30.081285+0000","last_peered":"2024-09-12T01:05:30.081285+0000","last_clean":"2024-09-12T01:05:30.081285+0000","last_became_active":"2024-09-12T00:21:44.518595+0000","last_became_peered":"2024-09-12T00:21:44.518595+0000","last_unstale":"2024-09-12T01:05:30.081285+0000","last_undegraded":"2024-09-12T01:05:30.081285+0000","last_fullsized":"2024-09-12T01:05:30.081285+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.767338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":656,"num_write":281,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'214","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.699785+0000","last_change":"2024-09-12T00:21:42.498445+0000","last_active":"2024-09-12T01:05:44.699785+0000","last_peered":"2024-09-12T01:05:44.699785+0000","last_clean":"2024-09-12T01:05:44.699785+0000","last_became_active":"2024-09-12T00:21:42.497992+0000","last_became_peered":"2024-09-12T00:21:42.497992+0000","last_unstale":"2024-09-12T01:05:44.699785+0000","last_undegraded":"2024-09-12T01:05:44.699785+0000","last_fullsized":"2024-09-12T01:05:44.699785+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:31.325313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4482985,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":346,"num_read_kb":82463,"num_write":801,"num_write_kb":27861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.566546+0000","last_change":"2024-09-12T00:21:46.512131+0000","last_active":"2024-09-12T01:03:09.566546+0000","last_peered":"2024-09-12T01:03:09.566546+0000","last_clean":"2024-09-12T01:03:09.566546+0000","last_became_active":"2024-09-12T00:21:46.511365+0000","last_became_peered":"2024-09-12T00:21:46.511365+0000","last_unstale":"2024-09-12T01:03:09.566546+0000","last_undegraded":"2024-09-12T01:03:09.566546+0000","last_fullsized":"2024-09-12T01:03:09.566546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:52.291093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'463","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.846736+0000","last_change":"2024-09-12T00:21:48.526015+0000","last_active":"2024-09-12T01:07:12.846736+0000","last_peered":"2024-09-12T01:07:12.846736+0000","last_clean":"2024-09-12T01:07:12.846736+0000","last_became_active":"2024-09-12T00:21:48.524173+0000","last_became_peered":"2024-09-12T00:21:48.524173+0000","last_unstale":"2024-09-12T01:07:12.846736+0000","last_undegraded":"2024-09-12T01:07:12.846736+0000","last_fullsized":"2024-09-12T01:07:12.846736+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:01.094285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108366,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":795,"num_read_kb":1720,"num_write":656,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.620896+0000","last_change":"2024-09-12T00:21:50.562375+0000","last_active":"2024-09-12T01:05:14.620896+0000","last_peered":"2024-09-12T01:05:14.620896+0000","last_clean":"2024-09-12T01:05:14.620896+0000","last_became_active":"2024-09-12T00:21:50.561720+0000","last_became_peered":"2024-09-12T00:21:50.561720+0000","last_unstale":"2024-09-12T01:05:14.620896+0000","last_undegraded":"2024-09-12T01:05:14.620896+0000","last_fullsized":"2024-09-12T01:05:14.620896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:55.724402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'124","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.185203+0000","last_change":"2024-09-12T00:21:52.565860+0000","last_active":"2024-09-12T01:05:29.185203+0000","last_peered":"2024-09-12T01:05:29.185203+0000","last_clean":"2024-09-12T01:05:29.185203+0000","last_became_active":"2024-09-12T00:21:52.565276+0000","last_became_peered":"2024-09-12T00:21:52.565276+0000","last_unstale":"2024-09-12T01:05:29.185203+0000","last_undegraded":"2024-09-12T01:05:29.185203+0000","last_fullsized":"2024-09-12T01:05:29.185203+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:19.050097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'92","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.590887+0000","last_change":"2024-09-12T00:21:44.505865+0000","last_active":"2024-09-12T01:04:29.590887+0000","last_peered":"2024-09-12T01:04:29.590887+0000","last_clean":"2024-09-12T01:04:29.590887+0000","last_became_active":"2024-09-12T00:21:44.504866+0000","last_became_peered":"2024-09-12T00:21:44.504866+0000","last_unstale":"2024-09-12T01:04:29.590887+0000","last_undegraded":"2024-09-12T01:04:29.590887+0000","last_fullsized":"2024-09-12T01:04:29.590887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:00.702193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":364,"num_write":125,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'285","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:04.635972+0000","last_change":"2024-09-12T00:21:42.513602+0000","last_active":"2024-09-12T01:07:04.635972+0000","last_peered":"2024-09-12T01:07:04.635972+0000","last_clean":"2024-09-12T01:07:04.635972+0000","last_became_active":"2024-09-12T00:21:42.511762+0000","last_became_peered":"2024-09-12T00:21:42.511762+0000","last_unstale":"2024-09-12T01:07:04.635972+0000","last_undegraded":"2024-09-12T01:07:04.635972+0000","last_fullsized":"2024-09-12T01:07:04.635972+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:56.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16020838,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":473,"num_read_kb":36346,"num_write":1026,"num_write_kb":41720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:33.591024+0000","last_change":"2024-09-12T00:21:46.515246+0000","last_active":"2024-09-12T01:04:33.591024+0000","last_peered":"2024-09-12T01:04:33.591024+0000","last_clean":"2024-09-12T01:04:33.591024+0000","last_became_active":"2024-09-12T00:21:46.514486+0000","last_became_peered":"2024-09-12T00:21:46.514486+0000","last_unstale":"2024-09-12T01:04:33.591024+0000","last_undegraded":"2024-09-12T01:04:33.591024+0000","last_fullsized":"2024-09-12T01:04:33.591024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:53.736171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'313","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.419509+0000","last_change":"2024-09-12T00:21:48.548232+0000","last_active":"2024-09-12T01:06:49.419509+0000","last_peered":"2024-09-12T01:06:49.419509+0000","last_clean":"2024-09-12T01:06:49.419509+0000","last_became_active":"2024-09-12T00:21:48.547356+0000","last_became_peered":"2024-09-12T00:21:48.547356+0000","last_unstale":"2024-09-12T01:06:49.419509+0000","last_undegraded":"2024-09-12T01:06:49.419509+0000","last_fullsized":"2024-09-12T01:06:49.419509+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:38.710415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":980,"num_write":452,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.594618+0000","last_change":"2024-09-12T00:21:50.556901+0000","last_active":"2024-09-12T01:04:48.594618+0000","last_peered":"2024-09-12T01:04:48.594618+0000","last_clean":"2024-09-12T01:04:48.594618+0000","last_became_active":"2024-09-12T00:21:50.556220+0000","last_became_peered":"2024-09-12T00:21:50.556220+0000","last_unstale":"2024-09-12T01:04:48.594618+0000","last_undegraded":"2024-09-12T01:04:48.594618+0000","last_fullsized":"2024-09-12T01:04:48.594618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.780602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.632683+0000","last_change":"2024-09-12T00:21:52.567877+0000","last_active":"2024-09-12T01:06:04.632683+0000","last_peered":"2024-09-12T01:06:04.632683+0000","last_clean":"2024-09-12T01:06:04.632683+0000","last_became_active":"2024-09-12T00:21:52.567273+0000","last_became_peered":"2024-09-12T00:21:52.567273+0000","last_unstale":"2024-09-12T01:06:04.632683+0000","last_undegraded":"2024-09-12T01:06:04.632683+0000","last_fullsized":"2024-09-12T01:06:04.632683+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:22.583804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'124","reported_seq":703,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.523823+0000","last_change":"2024-09-12T00:21:44.503225+0000","last_active":"2024-09-12T01:06:06.523823+0000","last_peered":"2024-09-12T01:06:06.523823+0000","last_clean":"2024-09-12T01:06:06.523823+0000","last_became_active":"2024-09-12T00:21:44.502965+0000","last_became_peered":"2024-09-12T00:21:44.502965+0000","last_unstale":"2024-09-12T01:06:06.523823+0000","last_undegraded":"2024-09-12T01:06:06.523823+0000","last_fullsized":"2024-09-12T01:06:06.523823+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:31.381032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":435,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'294","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:02.556096+0000","last_change":"2024-09-12T00:22:13.521128+0000","last_active":"2024-09-12T01:07:02.556096+0000","last_peered":"2024-09-12T01:07:02.556096+0000","last_clean":"2024-09-12T01:07:02.556096+0000","last_became_active":"2024-09-12T00:22:13.520026+0000","last_became_peered":"2024-09-12T00:22:13.520026+0000","last_unstale":"2024-09-12T01:07:02.556096+0000","last_undegraded":"2024-09-12T01:07:02.556096+0000","last_fullsized":"2024-09-12T01:07:02.556096+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:58.425398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9661557,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":556,"num_read_kb":38314,"num_write":1075,"num_write_kb":31045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611545+0000","last_change":"2024-09-12T00:21:46.508177+0000","last_active":"2024-09-12T01:04:34.611545+0000","last_peered":"2024-09-12T01:04:34.611545+0000","last_clean":"2024-09-12T01:04:34.611545+0000","last_became_active":"2024-09-12T00:21:46.507456+0000","last_became_peered":"2024-09-12T00:21:46.507456+0000","last_unstale":"2024-09-12T01:04:34.611545+0000","last_undegraded":"2024-09-12T01:04:34.611545+0000","last_fullsized":"2024-09-12T01:04:34.611545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.624519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'305","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:59.646490+0000","last_change":"2024-09-12T00:21:48.541207+0000","last_active":"2024-09-12T01:06:59.646490+0000","last_peered":"2024-09-12T01:06:59.646490+0000","last_clean":"2024-09-12T01:06:59.646490+0000","last_became_active":"2024-09-12T00:21:48.535782+0000","last_became_peered":"2024-09-12T00:21:48.535782+0000","last_unstale":"2024-09-12T01:06:59.646490+0000","last_undegraded":"2024-09-12T01:06:59.646490+0000","last_fullsized":"2024-09-12T01:06:59.646490+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:36.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60857,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1011,"num_write":406,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'748","reported_seq":2243,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.948125+0000","last_change":"2024-09-12T00:21:50.558383+0000","last_active":"2024-09-12T01:07:12.948125+0000","last_peered":"2024-09-12T01:07:12.948125+0000","last_clean":"2024-09-12T01:07:12.948125+0000","last_became_active":"2024-09-12T00:21:50.557158+0000","last_became_peered":"2024-09-12T00:21:50.557158+0000","last_unstale":"2024-09-12T01:07:12.948125+0000","last_undegraded":"2024-09-12T01:07:12.948125+0000","last_fullsized":"2024-09-12T01:07:12.948125+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:51.183200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'134","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.252744+0000","last_change":"2024-09-12T00:21:52.546563+0000","last_active":"2024-09-12T01:05:47.252744+0000","last_peered":"2024-09-12T01:05:47.252744+0000","last_clean":"2024-09-12T01:05:47.252744+0000","last_became_active":"2024-09-12T00:21:52.545876+0000","last_became_peered":"2024-09-12T00:21:52.545876+0000","last_unstale":"2024-09-12T01:05:47.252744+0000","last_undegraded":"2024-09-12T01:05:47.252744+0000","last_fullsized":"2024-09-12T01:05:47.252744+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.003099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":172,"num_write":354,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'141","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.454853+0000","last_change":"2024-09-12T00:21:44.494799+0000","last_active":"2024-09-12T01:05:00.454853+0000","last_peered":"2024-09-12T01:05:00.454853+0000","last_clean":"2024-09-12T01:05:00.454853+0000","last_became_active":"2024-09-12T00:21:44.494386+0000","last_became_peered":"2024-09-12T00:21:44.494386+0000","last_unstale":"2024-09-12T01:05:00.454853+0000","last_undegraded":"2024-09-12T01:05:00.454853+0000","last_fullsized":"2024-09-12T01:05:00.454853+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:48.947337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":627,"num_read_kb":527,"num_write":195,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'345","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.432353+0000","last_change":"2024-09-12T00:21:42.529220+0000","last_active":"2024-09-12T01:05:52.432353+0000","last_peered":"2024-09-12T01:05:52.432353+0000","last_clean":"2024-09-12T01:05:52.432353+0000","last_became_active":"2024-09-12T00:21:42.528782+0000","last_became_peered":"2024-09-12T00:21:42.528782+0000","last_unstale":"2024-09-12T01:05:52.432353+0000","last_undegraded":"2024-09-12T01:05:52.432353+0000","last_fullsized":"2024-09-12T01:05:52.432353+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:42.093500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8938182,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":585,"num_read_kb":31515,"num_write":1169,"num_write_kb":36332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'7","reported_seq":1938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.736641+0000","last_change":"2024-09-12T00:21:46.504153+0000","last_active":"2024-09-12T01:07:12.736641+0000","last_peered":"2024-09-12T01:07:12.736641+0000","last_clean":"2024-09-12T01:07:12.736641+0000","last_became_active":"2024-09-12T00:21:46.503412+0000","last_became_peered":"2024-09-12T00:21:46.503412+0000","last_unstale":"2024-09-12T01:07:12.736641+0000","last_undegraded":"2024-09-12T01:07:12.736641+0000","last_fullsized":"2024-09-12T01:07:12.736641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:47.686112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1679,"num_read_kb":2143,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'73","reported_seq":588,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.311430+0000","last_change":"2024-09-12T00:21:48.546361+0000","last_active":"2024-09-12T01:04:48.311430+0000","last_peered":"2024-09-12T01:04:48.311430+0000","last_clean":"2024-09-12T01:04:48.311430+0000","last_became_active":"2024-09-12T00:21:48.545388+0000","last_became_peered":"2024-09-12T00:21:48.545388+0000","last_unstale":"2024-09-12T01:04:48.311430+0000","last_undegraded":"2024-09-12T01:04:48.311430+0000","last_fullsized":"2024-09-12T01:04:48.311430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.386351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'766","reported_seq":4008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947470+0000","last_change":"2024-09-12T00:21:50.537415+0000","last_active":"2024-09-12T01:07:12.947470+0000","last_peered":"2024-09-12T01:07:12.947470+0000","last_clean":"2024-09-12T01:07:12.947470+0000","last_became_active":"2024-09-12T00:21:50.536672+0000","last_became_peered":"2024-09-12T00:21:50.536672+0000","last_unstale":"2024-09-12T01:07:12.947470+0000","last_undegraded":"2024-09-12T01:07:12.947470+0000","last_fullsized":"2024-09-12T01:07:12.947470+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.799043+0000","last_change":"2024-09-12T00:21:52.557213+0000","last_active":"2024-09-12T01:05:30.799043+0000","last_peered":"2024-09-12T01:05:30.799043+0000","last_clean":"2024-09-12T01:05:30.799043+0000","last_became_active":"2024-09-12T00:21:52.556523+0000","last_became_peered":"2024-09-12T00:21:52.556523+0000","last_unstale":"2024-09-12T01:05:30.799043+0000","last_undegraded":"2024-09-12T01:05:30.799043+0000","last_fullsized":"2024-09-12T01:05:30.799043+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:13.223517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":161,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'217","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.545950+0000","last_change":"2024-09-12T00:21:44.515428+0000","last_active":"2024-09-12T01:04:58.545950+0000","last_peered":"2024-09-12T01:04:58.545950+0000","last_clean":"2024-09-12T01:04:58.545950+0000","last_became_active":"2024-09-12T00:21:44.514085+0000","last_became_peered":"2024-09-12T00:21:44.514085+0000","last_unstale":"2024-09-12T01:04:58.545950+0000","last_undegraded":"2024-09-12T01:04:58.545950+0000","last_fullsized":"2024-09-12T01:04:58.545950+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:56.006782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":987,"num_read_kb":820,"num_write":332,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'290","reported_seq":906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.703704+0000","last_change":"2024-09-12T00:21:42.485706+0000","last_active":"2024-09-12T01:05:44.703704+0000","last_peered":"2024-09-12T01:05:44.703704+0000","last_clean":"2024-09-12T01:05:44.703704+0000","last_became_active":"2024-09-12T00:21:42.484728+0000","last_became_peered":"2024-09-12T00:21:42.484728+0000","last_unstale":"2024-09-12T01:05:44.703704+0000","last_undegraded":"2024-09-12T01:05:44.703704+0000","last_fullsized":"2024-09-12T01:05:44.703704+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:46.673395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486240,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":459,"num_read_kb":1781,"num_write":963,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.630684+0000","last_change":"2024-09-12T00:21:46.515775+0000","last_active":"2024-09-12T01:04:34.630684+0000","last_peered":"2024-09-12T01:04:34.630684+0000","last_clean":"2024-09-12T01:04:34.630684+0000","last_became_active":"2024-09-12T00:21:46.515469+0000","last_became_peered":"2024-09-12T00:21:46.515469+0000","last_unstale":"2024-09-12T01:04:34.630684+0000","last_undegraded":"2024-09-12T01:04:34.630684+0000","last_fullsized":"2024-09-12T01:04:34.630684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:12.258449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'337","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.419459+0000","last_change":"2024-09-12T00:21:48.524169+0000","last_active":"2024-09-12T01:06:49.419459+0000","last_peered":"2024-09-12T01:06:49.419459+0000","last_clean":"2024-09-12T01:06:49.419459+0000","last_became_active":"2024-09-12T00:21:48.523392+0000","last_became_peered":"2024-09-12T00:21:48.523392+0000","last_unstale":"2024-09-12T01:06:49.419459+0000","last_undegraded":"2024-09-12T01:06:49.419459+0000","last_fullsized":"2024-09-12T01:06:49.419459+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:05.832531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59967,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":1046,"num_write":434,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.755012+0000","last_change":"2024-09-12T00:21:50.567348+0000","last_active":"2024-09-12T01:04:39.755012+0000","last_peered":"2024-09-12T01:04:39.755012+0000","last_clean":"2024-09-12T01:04:39.755012+0000","last_became_active":"2024-09-12T00:21:50.566831+0000","last_became_peered":"2024-09-12T00:21:50.566831+0000","last_unstale":"2024-09-12T01:04:39.755012+0000","last_undegraded":"2024-09-12T01:04:39.755012+0000","last_fullsized":"2024-09-12T01:04:39.755012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:07.974869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'158","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.073492+0000","last_change":"2024-09-12T00:21:52.563487+0000","last_active":"2024-09-12T01:05:34.073492+0000","last_peered":"2024-09-12T01:05:34.073492+0000","last_clean":"2024-09-12T01:05:34.073492+0000","last_became_active":"2024-09-12T00:21:52.562716+0000","last_became_peered":"2024-09-12T00:21:52.562716+0000","last_unstale":"2024-09-12T01:05:34.073492+0000","last_undegraded":"2024-09-12T01:05:34.073492+0000","last_fullsized":"2024-09-12T01:05:34.073492+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:57.280882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":186,"num_write":388,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'137","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.221538+0000","last_change":"2024-09-12T00:21:44.503230+0000","last_active":"2024-09-12T01:05:43.221538+0000","last_peered":"2024-09-12T01:05:43.221538+0000","last_clean":"2024-09-12T01:05:43.221538+0000","last_became_active":"2024-09-12T00:21:44.502832+0000","last_became_peered":"2024-09-12T00:21:44.502832+0000","last_unstale":"2024-09-12T01:05:43.221538+0000","last_undegraded":"2024-09-12T01:05:43.221538+0000","last_fullsized":"2024-09-12T01:05:43.221538+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:03.323487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":521,"num_write":201,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.759168+0000","last_change":"2024-09-12T00:21:22.027534+0000","last_active":"2024-09-12T01:03:29.759168+0000","last_peered":"2024-09-12T01:03:29.759168+0000","last_clean":"2024-09-12T01:03:29.759168+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T01:03:29.759168+0000","last_undegraded":"2024-09-12T01:03:29.759168+0000","last_fullsized":"2024-09-12T01:03:29.759168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_clean_scrub_stamp":"2024-09-12T00:21:20.173671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:18.049959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640578+0000","last_change":"2024-09-12T00:21:28.254766+0000","last_active":"2024-09-12T01:05:14.640578+0000","last_peered":"2024-09-12T01:05:14.640578+0000","last_clean":"2024-09-12T01:05:14.640578+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T01:05:14.640578+0000","last_undegraded":"2024-09-12T01:05:14.640578+0000","last_fullsized":"2024-09-12T01:05:14.640578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:37.352626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'276","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.550233+0000","last_change":"2024-09-12T00:21:42.514559+0000","last_active":"2024-09-12T01:05:22.550233+0000","last_peered":"2024-09-12T01:05:22.550233+0000","last_clean":"2024-09-12T01:05:22.550233+0000","last_became_active":"2024-09-12T00:21:42.513672+0000","last_became_peered":"2024-09-12T00:21:42.513672+0000","last_unstale":"2024-09-12T01:05:22.550233+0000","last_undegraded":"2024-09-12T01:05:22.550233+0000","last_fullsized":"2024-09-12T01:05:22.550233+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:10.803601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285509,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":432,"num_read_kb":4546,"num_write":1020,"num_write_kb":26678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.577808+0000","last_change":"2024-09-12T00:21:46.506706+0000","last_active":"2024-09-12T01:03:29.577808+0000","last_peered":"2024-09-12T01:03:29.577808+0000","last_clean":"2024-09-12T01:03:29.577808+0000","last_became_active":"2024-09-12T00:21:46.506196+0000","last_became_peered":"2024-09-12T00:21:46.506196+0000","last_unstale":"2024-09-12T01:03:29.577808+0000","last_undegraded":"2024-09-12T01:03:29.577808+0000","last_fullsized":"2024-09-12T01:03:29.577808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:37.852267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'717","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.856519+0000","last_change":"2024-09-12T00:21:48.545130+0000","last_active":"2024-09-12T01:07:12.856519+0000","last_peered":"2024-09-12T01:07:12.856519+0000","last_clean":"2024-09-12T01:07:12.856519+0000","last_became_active":"2024-09-12T00:21:48.544327+0000","last_became_peered":"2024-09-12T00:21:48.544327+0000","last_unstale":"2024-09-12T01:07:12.856519+0000","last_undegraded":"2024-09-12T01:07:12.856519+0000","last_fullsized":"2024-09-12T01:07:12.856519+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:21.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168878,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1377,"num_read_kb":2876,"num_write":1288,"num_write_kb":1144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621223+0000","last_change":"2024-09-12T00:21:50.565245+0000","last_active":"2024-09-12T01:05:14.621223+0000","last_peered":"2024-09-12T01:05:14.621223+0000","last_clean":"2024-09-12T01:05:14.621223+0000","last_became_active":"2024-09-12T00:21:50.564442+0000","last_became_peered":"2024-09-12T00:21:50.564442+0000","last_unstale":"2024-09-12T01:05:14.621223+0000","last_undegraded":"2024-09-12T01:05:14.621223+0000","last_fullsized":"2024-09-12T01:05:14.621223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'206","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.344626+0000","last_change":"2024-09-12T00:21:52.557348+0000","last_active":"2024-09-12T01:06:07.344626+0000","last_peered":"2024-09-12T01:06:07.344626+0000","last_clean":"2024-09-12T01:06:07.344626+0000","last_became_active":"2024-09-12T00:21:52.550903+0000","last_became_peered":"2024-09-12T00:21:52.550903+0000","last_unstale":"2024-09-12T01:06:07.344626+0000","last_undegraded":"2024-09-12T01:06:07.344626+0000","last_fullsized":"2024-09-12T01:06:07.344626+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:10.990623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":429,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'100","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.182137+0000","last_change":"2024-09-12T00:21:44.519572+0000","last_active":"2024-09-12T01:05:29.182137+0000","last_peered":"2024-09-12T01:05:29.182137+0000","last_clean":"2024-09-12T01:05:29.182137+0000","last_became_active":"2024-09-12T00:21:44.518873+0000","last_became_peered":"2024-09-12T00:21:44.518873+0000","last_unstale":"2024-09-12T01:05:29.182137+0000","last_undegraded":"2024-09-12T01:05:29.182137+0000","last_fullsized":"2024-09-12T01:05:29.182137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:37.792281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":399,"num_write":140,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.615695+0000","last_change":"2024-09-12T00:21:28.254653+0000","last_active":"2024-09-12T01:03:39.615695+0000","last_peered":"2024-09-12T01:03:39.615695+0000","last_clean":"2024-09-12T01:03:39.615695+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T01:03:39.615695+0000","last_undegraded":"2024-09-12T01:03:39.615695+0000","last_fullsized":"2024-09-12T01:03:39.615695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:52.457807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'288","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.981722+0000","last_change":"2024-09-12T00:21:42.530775+0000","last_active":"2024-09-12T01:05:37.981722+0000","last_peered":"2024-09-12T01:05:37.981722+0000","last_clean":"2024-09-12T01:05:37.981722+0000","last_became_active":"2024-09-12T00:21:42.530049+0000","last_became_peered":"2024-09-12T00:21:42.530049+0000","last_unstale":"2024-09-12T01:05:37.981722+0000","last_undegraded":"2024-09-12T01:05:37.981722+0000","last_fullsized":"2024-09-12T01:05:37.981722+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.562005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4536165,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":739,"num_read_kb":7839,"num_write":1061,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.639489+0000","last_change":"2024-09-12T00:21:46.506977+0000","last_active":"2024-09-12T01:05:09.639489+0000","last_peered":"2024-09-12T01:05:09.639489+0000","last_clean":"2024-09-12T01:05:09.639489+0000","last_became_active":"2024-09-12T00:21:46.506303+0000","last_became_peered":"2024-09-12T00:21:46.506303+0000","last_unstale":"2024-09-12T01:05:09.639489+0000","last_undegraded":"2024-09-12T01:05:09.639489+0000","last_fullsized":"2024-09-12T01:05:09.639489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:15.859039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1248","reported_seq":2716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.948159+0000","last_change":"2024-09-12T00:21:48.539139+0000","last_active":"2024-09-12T01:07:12.948159+0000","last_peered":"2024-09-12T01:07:12.948159+0000","last_clean":"2024-09-12T01:07:12.948159+0000","last_became_active":"2024-09-12T00:21:48.538447+0000","last_became_peered":"2024-09-12T00:21:48.538447+0000","last_unstale":"2024-09-12T01:07:12.948159+0000","last_undegraded":"2024-09-12T01:07:12.948159+0000","last_fullsized":"2024-09-12T01:07:12.948159+0000","mapping_epoch":32,"log_start":"267'1200","ondisk_log_start":"267'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:58.399951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184921,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1994,"num_read_kb":3472,"num_write":1120,"num_write_kb":971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617264+0000","last_change":"2024-09-12T00:21:50.569042+0000","last_active":"2024-09-12T01:03:44.617264+0000","last_peered":"2024-09-12T01:03:44.617264+0000","last_clean":"2024-09-12T01:03:44.617264+0000","last_became_active":"2024-09-12T00:21:50.568353+0000","last_became_peered":"2024-09-12T00:21:50.568353+0000","last_unstale":"2024-09-12T01:03:44.617264+0000","last_undegraded":"2024-09-12T01:03:44.617264+0000","last_fullsized":"2024-09-12T01:03:44.617264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'220","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.646102+0000","last_change":"2024-09-12T00:21:52.560037+0000","last_active":"2024-09-12T01:04:18.646102+0000","last_peered":"2024-09-12T01:04:18.646102+0000","last_clean":"2024-09-12T01:04:18.646102+0000","last_became_active":"2024-09-12T00:21:52.559325+0000","last_became_peered":"2024-09-12T00:21:52.559325+0000","last_unstale":"2024-09-12T01:04:18.646102+0000","last_undegraded":"2024-09-12T01:04:18.646102+0000","last_fullsized":"2024-09-12T01:04:18.646102+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:26.252511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":373,"num_write":495,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'235","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.199872+0000","last_change":"2024-09-12T00:21:44.499926+0000","last_active":"2024-09-12T01:05:36.199872+0000","last_peered":"2024-09-12T01:05:36.199872+0000","last_clean":"2024-09-12T01:05:36.199872+0000","last_became_active":"2024-09-12T00:21:44.499405+0000","last_became_peered":"2024-09-12T00:21:44.499405+0000","last_unstale":"2024-09-12T01:05:36.199872+0000","last_undegraded":"2024-09-12T01:05:36.199872+0000","last_fullsized":"2024-09-12T01:05:36.199872+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:43.127372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":847,"num_write":402,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600239+0000","last_change":"2024-09-12T00:21:28.255269+0000","last_active":"2024-09-12T01:05:13.600239+0000","last_peered":"2024-09-12T01:05:13.600239+0000","last_clean":"2024-09-12T01:05:13.600239+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T01:05:13.600239+0000","last_undegraded":"2024-09-12T01:05:13.600239+0000","last_fullsized":"2024-09-12T01:05:13.600239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:37.489457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'260","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.018485+0000","last_change":"2024-09-12T00:21:42.537155+0000","last_active":"2024-09-12T01:06:03.018485+0000","last_peered":"2024-09-12T01:06:03.018485+0000","last_clean":"2024-09-12T01:06:03.018485+0000","last_became_active":"2024-09-12T00:21:42.533356+0000","last_became_peered":"2024-09-12T00:21:42.533356+0000","last_unstale":"2024-09-12T01:06:03.018485+0000","last_undegraded":"2024-09-12T01:06:03.018485+0000","last_fullsized":"2024-09-12T01:06:03.018485+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10454589,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":341,"num_read_kb":11281,"num_write":913,"num_write_kb":25420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.599241+0000","last_change":"2024-09-12T00:21:46.511151+0000","last_active":"2024-09-12T01:05:08.599241+0000","last_peered":"2024-09-12T01:05:08.599241+0000","last_clean":"2024-09-12T01:05:08.599241+0000","last_became_active":"2024-09-12T00:21:46.510230+0000","last_became_peered":"2024-09-12T00:21:46.510230+0000","last_unstale":"2024-09-12T01:05:08.599241+0000","last_undegraded":"2024-09-12T01:05:08.599241+0000","last_fullsized":"2024-09-12T01:05:08.599241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:33.182597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'236","reported_seq":1333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947368+0000","last_change":"2024-09-12T00:21:48.543106+0000","last_active":"2024-09-12T01:07:12.947368+0000","last_peered":"2024-09-12T01:07:12.947368+0000","last_clean":"2024-09-12T01:07:12.947368+0000","last_became_active":"2024-09-12T00:21:48.541987+0000","last_became_peered":"2024-09-12T00:21:48.541987+0000","last_unstale":"2024-09-12T01:07:12.947368+0000","last_undegraded":"2024-09-12T01:07:12.947368+0000","last_fullsized":"2024-09-12T01:07:12.947368+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:35.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.571245+0000","last_change":"2024-09-12T00:21:50.550098+0000","last_active":"2024-09-12T01:03:34.571245+0000","last_peered":"2024-09-12T01:03:34.571245+0000","last_clean":"2024-09-12T01:03:34.571245+0000","last_became_active":"2024-09-12T00:21:50.549468+0000","last_became_peered":"2024-09-12T00:21:50.549468+0000","last_unstale":"2024-09-12T01:03:34.571245+0000","last_undegraded":"2024-09-12T01:03:34.571245+0000","last_fullsized":"2024-09-12T01:03:34.571245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:51.226795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'266","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.525444+0000","last_change":"2024-09-12T00:21:52.553306+0000","last_active":"2024-09-12T01:06:07.525444+0000","last_peered":"2024-09-12T01:06:07.525444+0000","last_clean":"2024-09-12T01:06:07.525444+0000","last_became_active":"2024-09-12T00:21:52.552571+0000","last_became_peered":"2024-09-12T00:21:52.552571+0000","last_unstale":"2024-09-12T01:06:07.525444+0000","last_undegraded":"2024-09-12T01:06:07.525444+0000","last_fullsized":"2024-09-12T01:06:07.525444+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.410934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":539,"num_write":598,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'152","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.291657+0000","last_change":"2024-09-12T00:21:44.494446+0000","last_active":"2024-09-12T01:05:46.291657+0000","last_peered":"2024-09-12T01:05:46.291657+0000","last_clean":"2024-09-12T01:05:46.291657+0000","last_became_active":"2024-09-12T00:21:44.493744+0000","last_became_peered":"2024-09-12T00:21:44.493744+0000","last_unstale":"2024-09-12T01:05:46.291657+0000","last_undegraded":"2024-09-12T01:05:46.291657+0000","last_fullsized":"2024-09-12T01:05:46.291657+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.811924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":592,"num_write":229,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640540+0000","last_change":"2024-09-12T00:21:28.255515+0000","last_active":"2024-09-12T01:05:14.640540+0000","last_peered":"2024-09-12T01:05:14.640540+0000","last_clean":"2024-09-12T01:05:14.640540+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T01:05:14.640540+0000","last_undegraded":"2024-09-12T01:05:14.640540+0000","last_fullsized":"2024-09-12T01:05:14.640540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:43.203836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'266","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.181183+0000","last_change":"2024-09-12T00:21:42.530327+0000","last_active":"2024-09-12T01:07:07.181183+0000","last_peered":"2024-09-12T01:07:07.181183+0000","last_clean":"2024-09-12T01:07:07.181183+0000","last_became_active":"2024-09-12T00:21:42.528949+0000","last_became_peered":"2024-09-12T00:21:42.528949+0000","last_unstale":"2024-09-12T01:07:07.181183+0000","last_undegraded":"2024-09-12T01:07:07.181183+0000","last_fullsized":"2024-09-12T01:07:07.181183+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.542668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16418323,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":416,"num_read_kb":67654,"num_write":972,"num_write_kb":55160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:38.578580+0000","last_change":"2024-09-12T00:21:46.518181+0000","last_active":"2024-09-12T01:03:38.578580+0000","last_peered":"2024-09-12T01:03:38.578580+0000","last_clean":"2024-09-12T01:03:38.578580+0000","last_became_active":"2024-09-12T00:21:46.517381+0000","last_became_peered":"2024-09-12T00:21:46.517381+0000","last_unstale":"2024-09-12T01:03:38.578580+0000","last_undegraded":"2024-09-12T01:03:38.578580+0000","last_fullsized":"2024-09-12T01:03:38.578580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:55.356740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'120","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.029686+0000","last_change":"2024-09-12T00:21:48.553881+0000","last_active":"2024-09-12T01:07:13.029686+0000","last_peered":"2024-09-12T01:07:13.029686+0000","last_clean":"2024-09-12T01:07:13.029686+0000","last_became_active":"2024-09-12T00:21:48.553129+0000","last_became_peered":"2024-09-12T00:21:48.553129+0000","last_unstale":"2024-09-12T01:07:13.029686+0000","last_undegraded":"2024-09-12T01:07:13.029686+0000","last_fullsized":"2024-09-12T01:07:13.029686+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:52.650170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640743+0000","last_change":"2024-09-12T00:21:50.545732+0000","last_active":"2024-09-12T01:05:14.640743+0000","last_peered":"2024-09-12T01:05:14.640743+0000","last_clean":"2024-09-12T01:05:14.640743+0000","last_became_active":"2024-09-12T00:21:50.545037+0000","last_became_peered":"2024-09-12T00:21:50.545037+0000","last_unstale":"2024-09-12T01:05:14.640743+0000","last_undegraded":"2024-09-12T01:05:14.640743+0000","last_fullsized":"2024-09-12T01:05:14.640743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'98","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.414533+0000","last_change":"2024-09-12T00:21:52.541609+0000","last_active":"2024-09-12T01:06:07.414533+0000","last_peered":"2024-09-12T01:06:07.414533+0000","last_clean":"2024-09-12T01:06:07.414533+0000","last_became_active":"2024-09-12T00:21:52.540900+0000","last_became_peered":"2024-09-12T00:21:52.540900+0000","last_unstale":"2024-09-12T01:06:07.414533+0000","last_undegraded":"2024-09-12T01:06:07.414533+0000","last_fullsized":"2024-09-12T01:06:07.414533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:38.138742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":212,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'221","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:00.984004+0000","last_change":"2024-09-12T00:21:44.498171+0000","last_active":"2024-09-12T01:04:00.984004+0000","last_peered":"2024-09-12T01:04:00.984004+0000","last_clean":"2024-09-12T01:04:00.984004+0000","last_became_active":"2024-09-12T00:21:44.497354+0000","last_became_peered":"2024-09-12T00:21:44.497354+0000","last_unstale":"2024-09-12T01:04:00.984004+0000","last_undegraded":"2024-09-12T01:04:00.984004+0000","last_fullsized":"2024-09-12T01:04:00.984004+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:14.091559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":990,"num_read_kb":806,"num_write":357,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'241","reported_seq":872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.977380+0000","last_change":"2024-09-12T00:21:42.522295+0000","last_active":"2024-09-12T01:05:37.977380+0000","last_peered":"2024-09-12T01:05:37.977380+0000","last_clean":"2024-09-12T01:05:37.977380+0000","last_became_active":"2024-09-12T00:21:42.521990+0000","last_became_peered":"2024-09-12T00:21:42.521990+0000","last_unstale":"2024-09-12T01:05:37.977380+0000","last_undegraded":"2024-09-12T01:05:37.977380+0000","last_fullsized":"2024-09-12T01:05:37.977380+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:21.962527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14471811,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":384,"num_read_kb":61831,"num_write":942,"num_write_kb":29041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621065+0000","last_change":"2024-09-12T00:21:28.750763+0000","last_active":"2024-09-12T01:05:14.621065+0000","last_peered":"2024-09-12T01:05:14.621065+0000","last_clean":"2024-09-12T01:05:14.621065+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T01:05:14.621065+0000","last_undegraded":"2024-09-12T01:05:14.621065+0000","last_fullsized":"2024-09-12T01:05:14.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:40.130897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.570148+0000","last_change":"2024-09-12T00:21:46.499113+0000","last_active":"2024-09-12T01:03:29.570148+0000","last_peered":"2024-09-12T01:03:29.570148+0000","last_clean":"2024-09-12T01:03:29.570148+0000","last_became_active":"2024-09-12T00:21:46.498378+0000","last_became_peered":"2024-09-12T00:21:46.498378+0000","last_unstale":"2024-09-12T01:03:29.570148+0000","last_undegraded":"2024-09-12T01:03:29.570148+0000","last_fullsized":"2024-09-12T01:03:29.570148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:56.000475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'568","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.817903+0000","last_change":"2024-09-12T00:21:48.535483+0000","last_active":"2024-09-12T01:07:12.817903+0000","last_peered":"2024-09-12T01:07:12.817903+0000","last_clean":"2024-09-12T01:07:12.817903+0000","last_became_active":"2024-09-12T00:21:48.534749+0000","last_became_peered":"2024-09-12T00:21:48.534749+0000","last_unstale":"2024-09-12T01:07:12.817903+0000","last_undegraded":"2024-09-12T01:07:12.817903+0000","last_fullsized":"2024-09-12T01:07:12.817903+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:39.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110150,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1576,"num_read_kb":2532,"num_write":2066,"num_write_kb":1904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.739282+0000","last_change":"2024-09-12T00:21:50.556186+0000","last_active":"2024-09-12T01:03:34.739282+0000","last_peered":"2024-09-12T01:03:34.739282+0000","last_clean":"2024-09-12T01:03:34.739282+0000","last_became_active":"2024-09-12T00:21:50.554728+0000","last_became_peered":"2024-09-12T00:21:50.554728+0000","last_unstale":"2024-09-12T01:03:34.739282+0000","last_undegraded":"2024-09-12T01:03:34.739282+0000","last_fullsized":"2024-09-12T01:03:34.739282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:49.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'174","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.400639+0000","last_change":"2024-09-12T00:21:52.558976+0000","last_active":"2024-09-12T01:05:25.400639+0000","last_peered":"2024-09-12T01:05:25.400639+0000","last_clean":"2024-09-12T01:05:25.400639+0000","last_became_active":"2024-09-12T00:21:52.558203+0000","last_became_peered":"2024-09-12T00:21:52.558203+0000","last_unstale":"2024-09-12T01:05:25.400639+0000","last_undegraded":"2024-09-12T01:05:25.400639+0000","last_fullsized":"2024-09-12T01:05:25.400639+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:46.691847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1145,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":410,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'196","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.150715+0000","last_change":"2024-09-12T00:21:44.498346+0000","last_active":"2024-09-12T01:05:52.150715+0000","last_peered":"2024-09-12T01:05:52.150715+0000","last_clean":"2024-09-12T01:05:52.150715+0000","last_became_active":"2024-09-12T00:21:44.497510+0000","last_became_peered":"2024-09-12T00:21:44.497510+0000","last_unstale":"2024-09-12T01:05:52.150715+0000","last_undegraded":"2024-09-12T01:05:52.150715+0000","last_fullsized":"2024-09-12T01:05:52.150715+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:28.893058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":719,"num_write":306,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'268","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.560350+0000","last_change":"2024-09-12T00:21:42.529749+0000","last_active":"2024-09-12T01:05:51.560350+0000","last_peered":"2024-09-12T01:05:51.560350+0000","last_clean":"2024-09-12T01:05:51.560350+0000","last_became_active":"2024-09-12T00:21:42.529084+0000","last_became_peered":"2024-09-12T00:21:42.529084+0000","last_unstale":"2024-09-12T01:05:51.560350+0000","last_undegraded":"2024-09-12T01:05:51.560350+0000","last_fullsized":"2024-09-12T01:05:51.560350+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:23.266713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052743,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":435,"num_read_kb":3172,"num_write":1024,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.610735+0000","last_change":"2024-09-12T00:21:28.256092+0000","last_active":"2024-09-12T01:03:19.610735+0000","last_peered":"2024-09-12T01:03:19.610735+0000","last_clean":"2024-09-12T01:03:19.610735+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T01:03:19.610735+0000","last_undegraded":"2024-09-12T01:03:19.610735+0000","last_fullsized":"2024-09-12T01:03:19.610735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:41.836946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.577690+0000","last_change":"2024-09-12T00:21:46.507947+0000","last_active":"2024-09-12T01:03:29.577690+0000","last_peered":"2024-09-12T01:03:29.577690+0000","last_clean":"2024-09-12T01:03:29.577690+0000","last_became_active":"2024-09-12T00:21:46.507150+0000","last_became_peered":"2024-09-12T00:21:46.507150+0000","last_unstale":"2024-09-12T01:03:29.577690+0000","last_undegraded":"2024-09-12T01:03:29.577690+0000","last_fullsized":"2024-09-12T01:03:29.577690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:27.994405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'166","reported_seq":730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.042400+0000","last_change":"2024-09-12T00:21:48.546326+0000","last_active":"2024-09-12T01:04:58.042400+0000","last_peered":"2024-09-12T01:04:58.042400+0000","last_clean":"2024-09-12T01:04:58.042400+0000","last_became_active":"2024-09-12T00:21:48.545244+0000","last_became_peered":"2024-09-12T00:21:48.545244+0000","last_unstale":"2024-09-12T01:04:58.042400+0000","last_undegraded":"2024-09-12T01:04:58.042400+0000","last_fullsized":"2024-09-12T01:04:58.042400+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.959520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'768","reported_seq":2798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947416+0000","last_change":"2024-09-12T00:21:50.566794+0000","last_active":"2024-09-12T01:07:12.947416+0000","last_peered":"2024-09-12T01:07:12.947416+0000","last_clean":"2024-09-12T01:07:12.947416+0000","last_became_active":"2024-09-12T00:21:50.565930+0000","last_became_peered":"2024-09-12T00:21:50.565930+0000","last_unstale":"2024-09-12T01:07:12.947416+0000","last_undegraded":"2024-09-12T01:07:12.947416+0000","last_fullsized":"2024-09-12T01:07:12.947416+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:10.827538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.868125+0000","last_change":"2024-09-12T00:21:52.563826+0000","last_active":"2024-09-12T01:07:12.868125+0000","last_peered":"2024-09-12T01:07:12.868125+0000","last_clean":"2024-09-12T01:07:12.868125+0000","last_became_active":"2024-09-12T00:21:52.562765+0000","last_became_peered":"2024-09-12T00:21:52.562765+0000","last_unstale":"2024-09-12T01:07:12.868125+0000","last_undegraded":"2024-09-12T01:07:12.868125+0000","last_fullsized":"2024-09-12T01:07:12.868125+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.216884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":136,"num_write":336,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'106","reported_seq":691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.575375+0000","last_change":"2024-09-12T00:21:44.493205+0000","last_active":"2024-09-12T01:03:54.575375+0000","last_peered":"2024-09-12T01:03:54.575375+0000","last_clean":"2024-09-12T01:03:54.575375+0000","last_became_active":"2024-09-12T00:21:44.492443+0000","last_became_peered":"2024-09-12T00:21:44.492443+0000","last_unstale":"2024-09-12T01:03:54.575375+0000","last_undegraded":"2024-09-12T01:03:54.575375+0000","last_fullsized":"2024-09-12T01:03:54.575375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:20.383680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":379,"num_write":156,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'261","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.383871+0000","last_change":"2024-09-12T00:21:42.506233+0000","last_active":"2024-09-12T01:05:26.383871+0000","last_peered":"2024-09-12T01:05:26.383871+0000","last_clean":"2024-09-12T01:05:26.383871+0000","last_became_active":"2024-09-12T00:21:42.505355+0000","last_became_peered":"2024-09-12T00:21:42.505355+0000","last_unstale":"2024-09-12T01:05:26.383871+0000","last_undegraded":"2024-09-12T01:05:26.383871+0000","last_fullsized":"2024-09-12T01:05:26.383871+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:51.142709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5315687,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":8879,"num_write":1053,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587669+0000","last_change":"2024-09-12T00:21:28.670456+0000","last_active":"2024-09-12T01:04:49.587669+0000","last_peered":"2024-09-12T01:04:49.587669+0000","last_clean":"2024-09-12T01:04:49.587669+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T01:04:49.587669+0000","last_undegraded":"2024-09-12T01:04:49.587669+0000","last_fullsized":"2024-09-12T01:04:49.587669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:30.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.613152+0000","last_change":"2024-09-12T00:21:46.507186+0000","last_active":"2024-09-12T01:03:29.613152+0000","last_peered":"2024-09-12T01:03:29.613152+0000","last_clean":"2024-09-12T01:03:29.613152+0000","last_became_active":"2024-09-12T00:21:46.506416+0000","last_became_peered":"2024-09-12T00:21:46.506416+0000","last_unstale":"2024-09-12T01:03:29.613152+0000","last_undegraded":"2024-09-12T01:03:29.613152+0000","last_fullsized":"2024-09-12T01:03:29.613152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:06.407604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'112","reported_seq":655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.074689+0000","last_change":"2024-09-12T00:21:48.541779+0000","last_active":"2024-09-12T01:05:04.074689+0000","last_peered":"2024-09-12T01:05:04.074689+0000","last_clean":"2024-09-12T01:05:04.074689+0000","last_became_active":"2024-09-12T00:21:48.541051+0000","last_became_peered":"2024-09-12T00:21:48.541051+0000","last_unstale":"2024-09-12T01:05:04.074689+0000","last_undegraded":"2024-09-12T01:05:04.074689+0000","last_fullsized":"2024-09-12T01:05:04.074689+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:48.095228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'775","reported_seq":2249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.948032+0000","last_change":"2024-09-12T00:21:50.565496+0000","last_active":"2024-09-12T01:07:12.948032+0000","last_peered":"2024-09-12T01:07:12.948032+0000","last_clean":"2024-09-12T01:07:12.948032+0000","last_became_active":"2024-09-12T00:21:50.564982+0000","last_became_peered":"2024-09-12T00:21:50.564982+0000","last_unstale":"2024-09-12T01:07:12.948032+0000","last_undegraded":"2024-09-12T01:07:12.948032+0000","last_fullsized":"2024-09-12T01:07:12.948032+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:45.360699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'150","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.238137+0000","last_change":"2024-09-12T00:21:52.556569+0000","last_active":"2024-09-12T01:05:51.238137+0000","last_peered":"2024-09-12T01:05:51.238137+0000","last_clean":"2024-09-12T01:05:51.238137+0000","last_became_active":"2024-09-12T00:21:52.555909+0000","last_became_peered":"2024-09-12T00:21:52.555909+0000","last_unstale":"2024-09-12T01:05:51.238137+0000","last_undegraded":"2024-09-12T01:05:51.238137+0000","last_fullsized":"2024-09-12T01:05:51.238137+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:36.848678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":331,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'167","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:02.021470+0000","last_change":"2024-09-12T00:21:44.494606+0000","last_active":"2024-09-12T01:06:02.021470+0000","last_peered":"2024-09-12T01:06:02.021470+0000","last_clean":"2024-09-12T01:06:02.021470+0000","last_became_active":"2024-09-12T00:21:44.494215+0000","last_became_peered":"2024-09-12T00:21:44.494215+0000","last_unstale":"2024-09-12T01:06:02.021470+0000","last_undegraded":"2024-09-12T01:06:02.021470+0000","last_fullsized":"2024-09-12T01:06:02.021470+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:08.392897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":568,"num_write":276,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'310","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.588319+0000","last_change":"2024-09-12T00:21:42.495485+0000","last_active":"2024-09-12T01:05:47.588319+0000","last_peered":"2024-09-12T01:05:47.588319+0000","last_clean":"2024-09-12T01:05:47.588319+0000","last_became_active":"2024-09-12T00:21:42.494486+0000","last_became_peered":"2024-09-12T00:21:42.494486+0000","last_unstale":"2024-09-12T01:05:47.588319+0000","last_undegraded":"2024-09-12T01:05:47.588319+0000","last_fullsized":"2024-09-12T01:05:47.588319+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.868593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4223711,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":471,"num_read_kb":23252,"num_write":1167,"num_write_kb":41943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634565+0000","last_change":"2024-09-12T00:21:28.255394+0000","last_active":"2024-09-12T01:04:49.634565+0000","last_peered":"2024-09-12T01:04:49.634565+0000","last_clean":"2024-09-12T01:04:49.634565+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T01:04:49.634565+0000","last_undegraded":"2024-09-12T01:04:49.634565+0000","last_fullsized":"2024-09-12T01:04:49.634565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:59.294638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.576422+0000","last_change":"2024-09-12T00:21:46.491161+0000","last_active":"2024-09-12T01:03:59.576422+0000","last_peered":"2024-09-12T01:03:59.576422+0000","last_clean":"2024-09-12T01:03:59.576422+0000","last_became_active":"2024-09-12T00:21:46.490398+0000","last_became_peered":"2024-09-12T00:21:46.490398+0000","last_unstale":"2024-09-12T01:03:59.576422+0000","last_undegraded":"2024-09-12T01:03:59.576422+0000","last_fullsized":"2024-09-12T01:03:59.576422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:39.280351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'701","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.809996+0000","last_change":"2024-09-12T00:21:48.545913+0000","last_active":"2024-09-12T01:07:12.809996+0000","last_peered":"2024-09-12T01:07:12.809996+0000","last_clean":"2024-09-12T01:07:12.809996+0000","last_became_active":"2024-09-12T00:21:48.543101+0000","last_became_peered":"2024-09-12T00:21:48.543101+0000","last_unstale":"2024-09-12T01:07:12.809996+0000","last_undegraded":"2024-09-12T01:07:12.809996+0000","last_fullsized":"2024-09-12T01:07:12.809996+0000","mapping_epoch":32,"log_start":"267'600","ondisk_log_start":"267'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190375,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1252,"num_read_kb":2706,"num_write":1030,"num_write_kb":879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.571169+0000","last_change":"2024-09-12T00:21:50.551312+0000","last_active":"2024-09-12T01:03:34.571169+0000","last_peered":"2024-09-12T01:03:34.571169+0000","last_clean":"2024-09-12T01:03:34.571169+0000","last_became_active":"2024-09-12T00:21:50.549692+0000","last_became_peered":"2024-09-12T00:21:50.549692+0000","last_unstale":"2024-09-12T01:03:34.571169+0000","last_undegraded":"2024-09-12T01:03:34.571169+0000","last_fullsized":"2024-09-12T01:03:34.571169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:16.254094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'107","reported_seq":601,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.235026+0000","last_change":"2024-09-12T00:21:52.556774+0000","last_active":"2024-09-12T01:05:43.235026+0000","last_peered":"2024-09-12T01:05:43.235026+0000","last_clean":"2024-09-12T01:05:43.235026+0000","last_became_active":"2024-09-12T00:21:52.556038+0000","last_became_peered":"2024-09-12T00:21:52.556038+0000","last_unstale":"2024-09-12T01:05:43.235026+0000","last_undegraded":"2024-09-12T01:05:43.235026+0000","last_fullsized":"2024-09-12T01:05:43.235026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:26.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":258,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'117","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.624149+0000","last_change":"2024-09-12T00:21:52.538201+0000","last_active":"2024-09-12T01:06:06.624149+0000","last_peered":"2024-09-12T01:06:06.624149+0000","last_clean":"2024-09-12T01:06:06.624149+0000","last_became_active":"2024-09-12T00:21:52.537464+0000","last_became_peered":"2024-09-12T00:21:52.537464+0000","last_unstale":"2024-09-12T01:06:06.624149+0000","last_undegraded":"2024-09-12T01:06:06.624149+0000","last_fullsized":"2024-09-12T01:06:06.624149+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:06.332481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":226,"num_write":297,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'147","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.222011+0000","last_change":"2024-09-12T00:21:44.507294+0000","last_active":"2024-09-12T01:04:11.222011+0000","last_peered":"2024-09-12T01:04:11.222011+0000","last_clean":"2024-09-12T01:04:11.222011+0000","last_became_active":"2024-09-12T00:21:44.494375+0000","last_became_peered":"2024-09-12T00:21:44.494375+0000","last_unstale":"2024-09-12T01:04:11.222011+0000","last_undegraded":"2024-09-12T01:04:11.222011+0000","last_fullsized":"2024-09-12T01:04:11.222011+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:57.052664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":613,"num_write":235,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.567138+0000","last_change":"2024-09-12T00:21:42.495876+0000","last_active":"2024-09-12T01:05:31.567138+0000","last_peered":"2024-09-12T01:05:31.567138+0000","last_clean":"2024-09-12T01:05:31.567138+0000","last_became_active":"2024-09-12T00:21:42.495160+0000","last_became_peered":"2024-09-12T00:21:42.495160+0000","last_unstale":"2024-09-12T01:05:31.567138+0000","last_undegraded":"2024-09-12T01:05:31.567138+0000","last_fullsized":"2024-09-12T01:05:31.567138+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.406950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10079349,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":597,"num_read_kb":36666,"num_write":1217,"num_write_kb":30706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.576962+0000","last_change":"2024-09-12T00:21:46.504482+0000","last_active":"2024-09-12T01:03:49.576962+0000","last_peered":"2024-09-12T01:03:49.576962+0000","last_clean":"2024-09-12T01:03:49.576962+0000","last_became_active":"2024-09-12T00:21:46.503594+0000","last_became_peered":"2024-09-12T00:21:46.503594+0000","last_unstale":"2024-09-12T01:03:49.576962+0000","last_undegraded":"2024-09-12T01:03:49.576962+0000","last_fullsized":"2024-09-12T01:03:49.576962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:50.259430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'268","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.976069+0000","last_change":"2024-09-12T00:21:48.546884+0000","last_active":"2024-09-12T01:07:11.976069+0000","last_peered":"2024-09-12T01:07:11.976069+0000","last_clean":"2024-09-12T01:07:11.976069+0000","last_became_active":"2024-09-12T00:21:48.546213+0000","last_became_peered":"2024-09-12T00:21:48.546213+0000","last_unstale":"2024-09-12T01:07:11.976069+0000","last_undegraded":"2024-09-12T01:07:11.976069+0000","last_fullsized":"2024-09-12T01:07:11.976069+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:17.869108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53909,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":423,"num_read_kb":860,"num_write":342,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581894+0000","last_change":"2024-09-12T00:21:50.549810+0000","last_active":"2024-09-12T01:03:53.581894+0000","last_peered":"2024-09-12T01:03:53.581894+0000","last_clean":"2024-09-12T01:03:53.581894+0000","last_became_active":"2024-09-12T00:21:50.549135+0000","last_became_peered":"2024-09-12T00:21:50.549135+0000","last_unstale":"2024-09-12T01:03:53.581894+0000","last_undegraded":"2024-09-12T01:03:53.581894+0000","last_fullsized":"2024-09-12T01:03:53.581894+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:36.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'126","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.920723+0000","last_change":"2024-09-12T00:21:52.563982+0000","last_active":"2024-09-12T01:07:11.920723+0000","last_peered":"2024-09-12T01:07:11.920723+0000","last_clean":"2024-09-12T01:07:11.920723+0000","last_became_active":"2024-09-12T00:21:52.563303+0000","last_became_peered":"2024-09-12T00:21:52.563303+0000","last_unstale":"2024-09-12T01:07:11.920723+0000","last_undegraded":"2024-09-12T01:07:11.920723+0000","last_fullsized":"2024-09-12T01:07:11.920723+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:33.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":144,"num_write":323,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'152","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.618706+0000","last_change":"2024-09-12T00:21:44.498404+0000","last_active":"2024-09-12T01:04:20.618706+0000","last_peered":"2024-09-12T01:04:20.618706+0000","last_clean":"2024-09-12T01:04:20.618706+0000","last_became_active":"2024-09-12T00:21:44.495299+0000","last_became_peered":"2024-09-12T00:21:44.495299+0000","last_unstale":"2024-09-12T01:04:20.618706+0000","last_undegraded":"2024-09-12T01:04:20.618706+0000","last_fullsized":"2024-09-12T01:04:20.618706+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":653,"num_read_kb":535,"num_write":221,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'226","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.596992+0000","last_change":"2024-09-12T00:21:42.511183+0000","last_active":"2024-09-12T01:05:46.596992+0000","last_peered":"2024-09-12T01:05:46.596992+0000","last_clean":"2024-09-12T01:05:46.596992+0000","last_became_active":"2024-09-12T00:21:42.510774+0000","last_became_peered":"2024-09-12T00:21:42.510774+0000","last_unstale":"2024-09-12T01:05:46.596992+0000","last_undegraded":"2024-09-12T01:05:46.596992+0000","last_fullsized":"2024-09-12T01:05:46.596992+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:35.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6805157,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":384,"num_read_kb":10210,"num_write":868,"num_write_kb":22659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574388+0000","last_change":"2024-09-12T00:21:46.499247+0000","last_active":"2024-09-12T01:03:49.574388+0000","last_peered":"2024-09-12T01:03:49.574388+0000","last_clean":"2024-09-12T01:03:49.574388+0000","last_became_active":"2024-09-12T00:21:46.498536+0000","last_became_peered":"2024-09-12T00:21:46.498536+0000","last_unstale":"2024-09-12T01:03:49.574388+0000","last_undegraded":"2024-09-12T01:03:49.574388+0000","last_fullsized":"2024-09-12T01:03:49.574388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:23.854256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'42","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.160500+0000","last_change":"2024-09-12T00:21:48.530906+0000","last_active":"2024-09-12T01:04:59.160500+0000","last_peered":"2024-09-12T01:04:59.160500+0000","last_clean":"2024-09-12T01:04:59.160500+0000","last_became_active":"2024-09-12T00:21:48.528299+0000","last_became_peered":"2024-09-12T00:21:48.528299+0000","last_unstale":"2024-09-12T01:04:59.160500+0000","last_undegraded":"2024-09-12T01:04:59.160500+0000","last_fullsized":"2024-09-12T01:04:59.160500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:04.289536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.744259+0000","last_change":"2024-09-12T00:21:50.555449+0000","last_active":"2024-09-12T01:03:54.744259+0000","last_peered":"2024-09-12T01:03:54.744259+0000","last_clean":"2024-09-12T01:03:54.744259+0000","last_became_active":"2024-09-12T00:21:50.553714+0000","last_became_peered":"2024-09-12T00:21:50.553714+0000","last_unstale":"2024-09-12T01:03:54.744259+0000","last_undegraded":"2024-09-12T01:03:54.744259+0000","last_fullsized":"2024-09-12T01:03:54.744259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:49.756435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'214","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.327000+0000","last_change":"2024-09-12T00:21:52.557187+0000","last_active":"2024-09-12T01:06:07.327000+0000","last_peered":"2024-09-12T01:06:07.327000+0000","last_clean":"2024-09-12T01:06:07.327000+0000","last_became_active":"2024-09-12T00:21:52.556407+0000","last_became_peered":"2024-09-12T00:21:52.556407+0000","last_unstale":"2024-09-12T01:06:07.327000+0000","last_undegraded":"2024-09-12T01:06:07.327000+0000","last_fullsized":"2024-09-12T01:06:07.327000+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.366159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":286,"num_write":472,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'340","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.973379+0000","last_change":"2024-09-12T00:21:44.501770+0000","last_active":"2024-09-12T01:04:13.973379+0000","last_peered":"2024-09-12T01:04:13.973379+0000","last_clean":"2024-09-12T01:04:13.973379+0000","last_became_active":"2024-09-12T00:21:44.499891+0000","last_became_peered":"2024-09-12T00:21:44.499891+0000","last_unstale":"2024-09-12T01:04:13.973379+0000","last_undegraded":"2024-09-12T01:04:13.973379+0000","last_fullsized":"2024-09-12T01:04:13.973379+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.959531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1519,"num_read_kb":1239,"num_write":521,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'249","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.016790+0000","last_change":"2024-09-12T00:21:42.534894+0000","last_active":"2024-09-12T01:06:03.016790+0000","last_peered":"2024-09-12T01:06:03.016790+0000","last_clean":"2024-09-12T01:06:03.016790+0000","last_became_active":"2024-09-12T00:21:42.534537+0000","last_became_peered":"2024-09-12T00:21:42.534537+0000","last_unstale":"2024-09-12T01:06:03.016790+0000","last_undegraded":"2024-09-12T01:06:03.016790+0000","last_fullsized":"2024-09-12T01:06:03.016790+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.812543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224401,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":327,"num_read_kb":22569,"num_write":906,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743057+0000","last_change":"2024-09-12T00:21:46.489769+0000","last_active":"2024-09-12T01:03:49.743057+0000","last_peered":"2024-09-12T01:03:49.743057+0000","last_clean":"2024-09-12T01:03:49.743057+0000","last_became_active":"2024-09-12T00:21:46.489054+0000","last_became_peered":"2024-09-12T00:21:46.489054+0000","last_unstale":"2024-09-12T01:03:49.743057+0000","last_undegraded":"2024-09-12T01:03:49.743057+0000","last_fullsized":"2024-09-12T01:03:49.743057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:29.459282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'286","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:08.613727+0000","last_change":"2024-09-12T00:21:48.550280+0000","last_active":"2024-09-12T01:06:08.613727+0000","last_peered":"2024-09-12T01:06:08.613727+0000","last_clean":"2024-09-12T01:06:08.613727+0000","last_became_active":"2024-09-12T00:21:48.549368+0000","last_became_peered":"2024-09-12T00:21:48.549368+0000","last_unstale":"2024-09-12T01:06:08.613727+0000","last_undegraded":"2024-09-12T01:06:08.613727+0000","last_fullsized":"2024-09-12T01:06:08.613727+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:05.929053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58591,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":951,"num_write":382,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.765195+0000","last_change":"2024-09-12T00:21:50.566488+0000","last_active":"2024-09-12T01:03:54.765195+0000","last_peered":"2024-09-12T01:03:54.765195+0000","last_clean":"2024-09-12T01:03:54.765195+0000","last_became_active":"2024-09-12T00:21:50.565753+0000","last_became_peered":"2024-09-12T00:21:50.565753+0000","last_unstale":"2024-09-12T01:03:54.765195+0000","last_undegraded":"2024-09-12T01:03:54.765195+0000","last_fullsized":"2024-09-12T01:03:54.765195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:49.492114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.980755+0000","last_change":"2024-09-12T00:21:52.565618+0000","last_active":"2024-09-12T01:05:39.980755+0000","last_peered":"2024-09-12T01:05:39.980755+0000","last_clean":"2024-09-12T01:05:39.980755+0000","last_became_active":"2024-09-12T00:21:52.559213+0000","last_became_peered":"2024-09-12T00:21:52.559213+0000","last_unstale":"2024-09-12T01:05:39.980755+0000","last_undegraded":"2024-09-12T01:05:39.980755+0000","last_fullsized":"2024-09-12T01:05:39.980755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.549214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":329,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'146","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.117283+0000","last_change":"2024-09-12T00:21:44.508192+0000","last_active":"2024-09-12T01:05:42.117283+0000","last_peered":"2024-09-12T01:05:42.117283+0000","last_clean":"2024-09-12T01:05:42.117283+0000","last_became_active":"2024-09-12T00:21:44.507460+0000","last_became_peered":"2024-09-12T00:21:44.507460+0000","last_unstale":"2024-09-12T01:05:42.117283+0000","last_undegraded":"2024-09-12T01:05:42.117283+0000","last_fullsized":"2024-09-12T01:05:42.117283+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:54.113624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":507,"num_write":216,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'276","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.370911+0000","last_change":"2024-09-12T00:21:42.520089+0000","last_active":"2024-09-12T01:04:18.370911+0000","last_peered":"2024-09-12T01:04:18.370911+0000","last_clean":"2024-09-12T01:04:18.370911+0000","last_became_active":"2024-09-12T00:21:42.517333+0000","last_became_peered":"2024-09-12T00:21:42.517333+0000","last_unstale":"2024-09-12T01:04:18.370911+0000","last_undegraded":"2024-09-12T01:04:18.370911+0000","last_fullsized":"2024-09-12T01:04:18.370911+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.752943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14478325,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":375,"num_read_kb":50264,"num_write":980,"num_write_kb":41560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618453+0000","last_change":"2024-09-12T00:21:46.502471+0000","last_active":"2024-09-12T01:03:49.618453+0000","last_peered":"2024-09-12T01:03:49.618453+0000","last_clean":"2024-09-12T01:03:49.618453+0000","last_became_active":"2024-09-12T00:21:46.501673+0000","last_became_peered":"2024-09-12T00:21:46.501673+0000","last_unstale":"2024-09-12T01:03:49.618453+0000","last_undegraded":"2024-09-12T01:03:49.618453+0000","last_fullsized":"2024-09-12T01:03:49.618453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'268","reported_seq":833,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:09.614123+0000","last_change":"2024-09-12T00:21:48.538585+0000","last_active":"2024-09-12T01:06:09.614123+0000","last_peered":"2024-09-12T01:06:09.614123+0000","last_clean":"2024-09-12T01:06:09.614123+0000","last_became_active":"2024-09-12T00:21:48.537864+0000","last_became_peered":"2024-09-12T00:21:48.537864+0000","last_unstale":"2024-09-12T01:06:09.614123+0000","last_undegraded":"2024-09-12T01:06:09.614123+0000","last_fullsized":"2024-09-12T01:06:09.614123+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:33.610420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58259,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":936,"num_write":366,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581973+0000","last_change":"2024-09-12T00:21:50.561361+0000","last_active":"2024-09-12T01:03:53.581973+0000","last_peered":"2024-09-12T01:03:53.581973+0000","last_clean":"2024-09-12T01:03:53.581973+0000","last_became_active":"2024-09-12T00:21:50.560805+0000","last_became_peered":"2024-09-12T00:21:50.560805+0000","last_unstale":"2024-09-12T01:03:53.581973+0000","last_undegraded":"2024-09-12T01:03:53.581973+0000","last_fullsized":"2024-09-12T01:03:53.581973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:00.373479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'385","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.779861+0000","last_change":"2024-09-12T00:21:44.516768+0000","last_active":"2024-09-12T01:04:59.779861+0000","last_peered":"2024-09-12T01:04:59.779861+0000","last_clean":"2024-09-12T01:04:59.779861+0000","last_became_active":"2024-09-12T00:21:44.516321+0000","last_became_peered":"2024-09-12T00:21:44.516321+0000","last_unstale":"2024-09-12T01:04:59.779861+0000","last_undegraded":"2024-09-12T01:04:59.779861+0000","last_fullsized":"2024-09-12T01:04:59.779861+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:16.398087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1787,"num_read_kb":1547,"num_write":658,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'271","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.971040+0000","last_change":"2024-09-12T00:22:13.520852+0000","last_active":"2024-09-12T01:03:13.971040+0000","last_peered":"2024-09-12T01:03:13.971040+0000","last_clean":"2024-09-12T01:03:13.971040+0000","last_became_active":"2024-09-12T00:22:13.519954+0000","last_became_peered":"2024-09-12T00:22:13.519954+0000","last_unstale":"2024-09-12T01:03:13.971040+0000","last_undegraded":"2024-09-12T01:03:13.971040+0000","last_fullsized":"2024-09-12T01:03:13.971040+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:59.772753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6272573,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":412,"num_read_kb":32939,"num_write":1035,"num_write_kb":17030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.579239+0000","last_change":"2024-09-12T00:21:46.504485+0000","last_active":"2024-09-12T01:03:59.579239+0000","last_peered":"2024-09-12T01:03:59.579239+0000","last_clean":"2024-09-12T01:03:59.579239+0000","last_became_active":"2024-09-12T00:21:46.503646+0000","last_became_peered":"2024-09-12T00:21:46.503646+0000","last_unstale":"2024-09-12T01:03:59.579239+0000","last_undegraded":"2024-09-12T01:03:59.579239+0000","last_fullsized":"2024-09-12T01:03:59.579239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:24.062861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'512","reported_seq":1133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.804264+0000","last_change":"2024-09-12T00:21:48.548531+0000","last_active":"2024-09-12T01:07:12.804264+0000","last_peered":"2024-09-12T01:07:12.804264+0000","last_clean":"2024-09-12T01:07:12.804264+0000","last_became_active":"2024-09-12T00:21:48.547827+0000","last_became_peered":"2024-09-12T00:21:48.547827+0000","last_unstale":"2024-09-12T01:07:12.804264+0000","last_undegraded":"2024-09-12T01:07:12.804264+0000","last_fullsized":"2024-09-12T01:07:12.804264+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136620,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":930,"num_read_kb":2049,"num_write":822,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.751771+0000","last_change":"2024-09-12T00:21:50.554994+0000","last_active":"2024-09-12T01:04:24.751771+0000","last_peered":"2024-09-12T01:04:24.751771+0000","last_clean":"2024-09-12T01:04:24.751771+0000","last_became_active":"2024-09-12T00:21:50.554194+0000","last_became_peered":"2024-09-12T00:21:50.554194+0000","last_unstale":"2024-09-12T01:04:24.751771+0000","last_undegraded":"2024-09-12T01:04:24.751771+0000","last_fullsized":"2024-09-12T01:04:24.751771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.351737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'158","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.556466+0000","last_change":"2024-09-12T00:21:52.558812+0000","last_active":"2024-09-12T01:06:06.556466+0000","last_peered":"2024-09-12T01:06:06.556466+0000","last_clean":"2024-09-12T01:06:06.556466+0000","last_became_active":"2024-09-12T00:21:52.558070+0000","last_became_peered":"2024-09-12T00:21:52.558070+0000","last_unstale":"2024-09-12T01:06:06.556466+0000","last_undegraded":"2024-09-12T01:06:06.556466+0000","last_fullsized":"2024-09-12T01:06:06.556466+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:23.383768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":234,"num_write":361,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'83","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.789441+0000","last_change":"2024-09-12T00:21:44.502471+0000","last_active":"2024-09-12T01:03:54.789441+0000","last_peered":"2024-09-12T01:03:54.789441+0000","last_clean":"2024-09-12T01:03:54.789441+0000","last_became_active":"2024-09-12T00:21:44.501836+0000","last_became_peered":"2024-09-12T00:21:44.501836+0000","last_unstale":"2024-09-12T01:03:54.789441+0000","last_undegraded":"2024-09-12T01:03:54.789441+0000","last_fullsized":"2024-09-12T01:03:54.789441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:34.189402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":399,"num_read_kb":345,"num_write":130,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'247","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.025681+0000","last_change":"2024-09-12T00:21:42.497979+0000","last_active":"2024-09-12T01:06:03.025681+0000","last_peered":"2024-09-12T01:06:03.025681+0000","last_clean":"2024-09-12T01:06:03.025681+0000","last_became_active":"2024-09-12T00:21:42.496837+0000","last_became_peered":"2024-09-12T00:21:42.496837+0000","last_unstale":"2024-09-12T01:06:03.025681+0000","last_undegraded":"2024-09-12T01:06:03.025681+0000","last_fullsized":"2024-09-12T01:06:03.025681+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4841815,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":295,"num_read_kb":1485,"num_write":833,"num_write_kb":29678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.738284+0000","last_change":"2024-09-12T00:21:46.499289+0000","last_active":"2024-09-12T01:03:29.738284+0000","last_peered":"2024-09-12T01:03:29.738284+0000","last_clean":"2024-09-12T01:03:29.738284+0000","last_became_active":"2024-09-12T00:21:46.498517+0000","last_became_peered":"2024-09-12T00:21:46.498517+0000","last_unstale":"2024-09-12T01:03:29.738284+0000","last_undegraded":"2024-09-12T01:03:29.738284+0000","last_fullsized":"2024-09-12T01:03:29.738284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:50.960412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'295","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.420278+0000","last_change":"2024-09-12T00:21:48.539854+0000","last_active":"2024-09-12T01:06:49.420278+0000","last_peered":"2024-09-12T01:06:49.420278+0000","last_clean":"2024-09-12T01:06:49.420278+0000","last_became_active":"2024-09-12T00:21:48.539419+0000","last_became_peered":"2024-09-12T00:21:48.539419+0000","last_unstale":"2024-09-12T01:06:49.420278+0000","last_undegraded":"2024-09-12T01:06:49.420278+0000","last_fullsized":"2024-09-12T01:06:49.420278+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:42.243175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1025,"num_write":422,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.608749+0000","last_change":"2024-09-12T00:21:50.565460+0000","last_active":"2024-09-12T01:04:24.608749+0000","last_peered":"2024-09-12T01:04:24.608749+0000","last_clean":"2024-09-12T01:04:24.608749+0000","last_became_active":"2024-09-12T00:21:50.564610+0000","last_became_peered":"2024-09-12T00:21:50.564610+0000","last_unstale":"2024-09-12T01:04:24.608749+0000","last_undegraded":"2024-09-12T01:04:24.608749+0000","last_fullsized":"2024-09-12T01:04:24.608749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'152","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.192650+0000","last_change":"2024-09-12T00:21:52.560731+0000","last_active":"2024-09-12T01:05:01.192650+0000","last_peered":"2024-09-12T01:05:01.192650+0000","last_clean":"2024-09-12T01:05:01.192650+0000","last_became_active":"2024-09-12T00:21:52.559989+0000","last_became_peered":"2024-09-12T00:21:52.559989+0000","last_unstale":"2024-09-12T01:05:01.192650+0000","last_undegraded":"2024-09-12T01:05:01.192650+0000","last_fullsized":"2024-09-12T01:05:01.192650+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.302197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":167,"num_write":448,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'180","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.587709+0000","last_change":"2024-09-12T00:21:44.515569+0000","last_active":"2024-09-12T01:04:18.587709+0000","last_peered":"2024-09-12T01:04:18.587709+0000","last_clean":"2024-09-12T01:04:18.587709+0000","last_became_active":"2024-09-12T00:21:44.515059+0000","last_became_peered":"2024-09-12T00:21:44.515059+0000","last_unstale":"2024-09-12T01:04:18.587709+0000","last_undegraded":"2024-09-12T01:04:18.587709+0000","last_fullsized":"2024-09-12T01:04:18.587709+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.436679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":674,"num_write":306,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'261","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.713210+0000","last_change":"2024-09-12T00:21:42.528216+0000","last_active":"2024-09-12T01:05:45.713210+0000","last_peered":"2024-09-12T01:05:45.713210+0000","last_clean":"2024-09-12T01:05:45.713210+0000","last_became_active":"2024-09-12T00:21:42.527838+0000","last_became_peered":"2024-09-12T00:21:42.527838+0000","last_unstale":"2024-09-12T01:05:45.713210+0000","last_undegraded":"2024-09-12T01:05:45.713210+0000","last_fullsized":"2024-09-12T01:05:45.713210+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:49.488680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3596652,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":446,"num_read_kb":57947,"num_write":959,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.750536+0000","last_change":"2024-09-12T00:21:46.487430+0000","last_active":"2024-09-12T01:04:19.750536+0000","last_peered":"2024-09-12T01:04:19.750536+0000","last_clean":"2024-09-12T01:04:19.750536+0000","last_became_active":"2024-09-12T00:21:46.486768+0000","last_became_peered":"2024-09-12T00:21:46.486768+0000","last_unstale":"2024-09-12T01:04:19.750536+0000","last_undegraded":"2024-09-12T01:04:19.750536+0000","last_fullsized":"2024-09-12T01:04:19.750536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:46.811644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'286","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.599971+0000","last_change":"2024-09-12T00:21:48.546553+0000","last_active":"2024-09-12T01:05:34.599971+0000","last_peered":"2024-09-12T01:05:34.599971+0000","last_clean":"2024-09-12T01:05:34.599971+0000","last_became_active":"2024-09-12T00:21:48.545589+0000","last_became_peered":"2024-09-12T00:21:48.545589+0000","last_unstale":"2024-09-12T01:05:34.599971+0000","last_undegraded":"2024-09-12T01:05:34.599971+0000","last_fullsized":"2024-09-12T01:05:34.599971+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:05.509631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":970,"num_write":392,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.584221+0000","last_change":"2024-09-12T00:21:50.557751+0000","last_active":"2024-09-12T01:04:03.584221+0000","last_peered":"2024-09-12T01:04:03.584221+0000","last_clean":"2024-09-12T01:04:03.584221+0000","last_became_active":"2024-09-12T00:21:50.556333+0000","last_became_peered":"2024-09-12T00:21:50.556333+0000","last_unstale":"2024-09-12T01:04:03.584221+0000","last_undegraded":"2024-09-12T01:04:03.584221+0000","last_fullsized":"2024-09-12T01:04:03.584221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.592627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'204","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.864522+0000","last_change":"2024-09-12T00:21:52.566691+0000","last_active":"2024-09-12T01:07:12.864522+0000","last_peered":"2024-09-12T01:07:12.864522+0000","last_clean":"2024-09-12T01:07:12.864522+0000","last_became_active":"2024-09-12T00:21:52.565109+0000","last_became_peered":"2024-09-12T00:21:52.565109+0000","last_unstale":"2024-09-12T01:07:12.864522+0000","last_undegraded":"2024-09-12T01:07:12.864522+0000","last_fullsized":"2024-09-12T01:07:12.864522+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:52.766859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'131","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.241463+0000","last_change":"2024-09-12T00:21:44.489287+0000","last_active":"2024-09-12T01:05:45.241463+0000","last_peered":"2024-09-12T01:05:45.241463+0000","last_clean":"2024-09-12T01:05:45.241463+0000","last_became_active":"2024-09-12T00:21:44.488546+0000","last_became_peered":"2024-09-12T00:21:44.488546+0000","last_unstale":"2024-09-12T01:05:45.241463+0000","last_undegraded":"2024-09-12T01:05:45.241463+0000","last_fullsized":"2024-09-12T01:05:45.241463+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:32.061615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":436,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'281","reported_seq":904,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.103263+0000","last_change":"2024-09-12T00:21:42.514641+0000","last_active":"2024-09-12T01:04:57.103263+0000","last_peered":"2024-09-12T01:04:57.103263+0000","last_clean":"2024-09-12T01:04:57.103263+0000","last_became_active":"2024-09-12T00:21:42.513837+0000","last_became_peered":"2024-09-12T00:21:42.513837+0000","last_unstale":"2024-09-12T01:04:57.103263+0000","last_undegraded":"2024-09-12T01:04:57.103263+0000","last_fullsized":"2024-09-12T01:04:57.103263+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:59.737503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6712997,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":371,"num_read_kb":19207,"num_write":962,"num_write_kb":45165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.580850+0000","last_change":"2024-09-12T00:21:46.493177+0000","last_active":"2024-09-12T01:04:19.580850+0000","last_peered":"2024-09-12T01:04:19.580850+0000","last_clean":"2024-09-12T01:04:19.580850+0000","last_became_active":"2024-09-12T00:21:46.492502+0000","last_became_peered":"2024-09-12T00:21:46.492502+0000","last_unstale":"2024-09-12T01:04:19.580850+0000","last_undegraded":"2024-09-12T01:04:19.580850+0000","last_fullsized":"2024-09-12T01:04:19.580850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:29.059786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'96","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:59.651411+0000","last_change":"2024-09-12T00:21:48.548949+0000","last_active":"2024-09-12T01:05:59.651411+0000","last_peered":"2024-09-12T01:05:59.651411+0000","last_clean":"2024-09-12T01:05:59.651411+0000","last_became_active":"2024-09-12T00:21:48.544915+0000","last_became_peered":"2024-09-12T00:21:48.544915+0000","last_unstale":"2024-09-12T01:05:59.651411+0000","last_undegraded":"2024-09-12T01:05:59.651411+0000","last_fullsized":"2024-09-12T01:05:59.651411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:44.234342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":128,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'777","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947295+0000","last_change":"2024-09-12T00:21:50.550332+0000","last_active":"2024-09-12T01:07:12.947295+0000","last_peered":"2024-09-12T01:07:12.947295+0000","last_clean":"2024-09-12T01:07:12.947295+0000","last_became_active":"2024-09-12T00:21:50.549552+0000","last_became_peered":"2024-09-12T00:21:50.549552+0000","last_unstale":"2024-09-12T01:07:12.947295+0000","last_undegraded":"2024-09-12T01:07:12.947295+0000","last_fullsized":"2024-09-12T01:07:12.947295+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:44.130994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'170","reported_seq":686,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.303926+0000","last_change":"2024-09-12T00:21:52.566510+0000","last_active":"2024-09-12T01:05:46.303926+0000","last_peered":"2024-09-12T01:05:46.303926+0000","last_clean":"2024-09-12T01:05:46.303926+0000","last_became_active":"2024-09-12T00:21:52.565872+0000","last_became_peered":"2024-09-12T00:21:52.565872+0000","last_unstale":"2024-09-12T01:05:46.303926+0000","last_undegraded":"2024-09-12T01:05:46.303926+0000","last_fullsized":"2024-09-12T01:05:46.303926+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:54.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":199,"num_write":407,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'4284","reported_seq":4939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749378+0000","last_change":"2024-09-12T00:21:44.521635+0000","last_active":"2024-09-12T01:04:14.749378+0000","last_peered":"2024-09-12T01:04:14.749378+0000","last_clean":"2024-09-12T01:04:14.749378+0000","last_became_active":"2024-09-12T00:21:44.521310+0000","last_became_peered":"2024-09-12T00:21:44.521310+0000","last_unstale":"2024-09-12T01:04:14.749378+0000","last_undegraded":"2024-09-12T01:04:14.749378+0000","last_fullsized":"2024-09-12T01:04:14.749378+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":3000,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:18.886376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17290,"num_read_kb":14479,"num_write":6455,"num_write_kb":3215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'335","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.350057+0000","last_change":"2024-09-12T00:21:42.508020+0000","last_active":"2024-09-12T01:07:11.350057+0000","last_peered":"2024-09-12T01:07:11.350057+0000","last_clean":"2024-09-12T01:07:11.350057+0000","last_became_active":"2024-09-12T00:21:42.507712+0000","last_became_peered":"2024-09-12T00:21:42.507712+0000","last_unstale":"2024-09-12T01:07:11.350057+0000","last_undegraded":"2024-09-12T01:07:11.350057+0000","last_fullsized":"2024-09-12T01:07:11.350057+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:04.367696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11806959,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":540,"num_read_kb":35216,"num_write":1267,"num_write_kb":36033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.770689+0000","last_change":"2024-09-12T00:21:46.514629+0000","last_active":"2024-09-12T01:04:19.770689+0000","last_peered":"2024-09-12T01:04:19.770689+0000","last_clean":"2024-09-12T01:04:19.770689+0000","last_became_active":"2024-09-12T00:21:46.514146+0000","last_became_peered":"2024-09-12T00:21:46.514146+0000","last_unstale":"2024-09-12T01:04:19.770689+0000","last_undegraded":"2024-09-12T01:04:19.770689+0000","last_fullsized":"2024-09-12T01:04:19.770689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:04.796502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'326","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.604419+0000","last_change":"2024-09-12T00:21:48.545059+0000","last_active":"2024-09-12T01:05:29.604419+0000","last_peered":"2024-09-12T01:05:29.604419+0000","last_clean":"2024-09-12T01:05:29.604419+0000","last_became_active":"2024-09-12T00:21:48.543993+0000","last_became_peered":"2024-09-12T00:21:48.543993+0000","last_unstale":"2024-09-12T01:05:29.604419+0000","last_undegraded":"2024-09-12T01:05:29.604419+0000","last_fullsized":"2024-09-12T01:05:29.604419+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:00.172691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65257,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1041,"num_write":434,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.563509+0000","last_change":"2024-09-12T00:21:50.526640+0000","last_active":"2024-09-12T01:02:59.563509+0000","last_peered":"2024-09-12T01:02:59.563509+0000","last_clean":"2024-09-12T01:02:59.563509+0000","last_became_active":"2024-09-12T00:21:50.525885+0000","last_became_peered":"2024-09-12T00:21:50.525885+0000","last_unstale":"2024-09-12T01:02:59.563509+0000","last_undegraded":"2024-09-12T01:02:59.563509+0000","last_fullsized":"2024-09-12T01:02:59.563509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.636381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'113","reported_seq":614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.083293+0000","last_change":"2024-09-12T00:21:52.560445+0000","last_active":"2024-09-12T01:05:30.083293+0000","last_peered":"2024-09-12T01:05:30.083293+0000","last_clean":"2024-09-12T01:05:30.083293+0000","last_became_active":"2024-09-12T00:21:52.559361+0000","last_became_peered":"2024-09-12T00:21:52.559361+0000","last_unstale":"2024-09-12T01:05:30.083293+0000","last_undegraded":"2024-09-12T01:05:30.083293+0000","last_fullsized":"2024-09-12T01:05:30.083293+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:30.798988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":266,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'251","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.931531+0000","last_change":"2024-09-12T00:21:44.486385+0000","last_active":"2024-09-12T01:04:34.931531+0000","last_peered":"2024-09-12T01:04:34.931531+0000","last_clean":"2024-09-12T01:04:34.931531+0000","last_became_active":"2024-09-12T00:21:44.486014+0000","last_became_peered":"2024-09-12T00:21:44.486014+0000","last_unstale":"2024-09-12T01:04:34.931531+0000","last_undegraded":"2024-09-12T01:04:34.931531+0000","last_fullsized":"2024-09-12T01:04:34.931531+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:04.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1098,"num_read_kb":899,"num_write":369,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'260","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:50.634477+0000","last_change":"2024-09-12T00:21:42.492181+0000","last_active":"2024-09-12T01:05:50.634477+0000","last_peered":"2024-09-12T01:05:50.634477+0000","last_clean":"2024-09-12T01:05:50.634477+0000","last_became_active":"2024-09-12T00:21:42.491757+0000","last_became_peered":"2024-09-12T00:21:42.491757+0000","last_unstale":"2024-09-12T01:05:50.634477+0000","last_undegraded":"2024-09-12T01:05:50.634477+0000","last_fullsized":"2024-09-12T01:05:50.634477+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:19.920075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389249,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":402,"num_read_kb":76220,"num_write":982,"num_write_kb":46746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.750467+0000","last_change":"2024-09-12T00:21:46.503909+0000","last_active":"2024-09-12T01:04:19.750467+0000","last_peered":"2024-09-12T01:04:19.750467+0000","last_clean":"2024-09-12T01:04:19.750467+0000","last_became_active":"2024-09-12T00:21:46.503203+0000","last_became_peered":"2024-09-12T00:21:46.503203+0000","last_unstale":"2024-09-12T01:04:19.750467+0000","last_undegraded":"2024-09-12T01:04:19.750467+0000","last_fullsized":"2024-09-12T01:04:19.750467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:04.494436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'279","reported_seq":846,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594577+0000","last_change":"2024-09-12T00:21:48.537800+0000","last_active":"2024-09-12T01:05:19.594577+0000","last_peered":"2024-09-12T01:05:19.594577+0000","last_clean":"2024-09-12T01:05:19.594577+0000","last_became_active":"2024-09-12T00:21:48.536841+0000","last_became_peered":"2024-09-12T00:21:48.536841+0000","last_unstale":"2024-09-12T01:05:19.594577+0000","last_undegraded":"2024-09-12T01:05:19.594577+0000","last_fullsized":"2024-09-12T01:05:19.594577+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:36.935321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":984,"num_write":384,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.608163+0000","last_change":"2024-09-12T00:21:50.541922+0000","last_active":"2024-09-12T01:03:09.608163+0000","last_peered":"2024-09-12T01:03:09.608163+0000","last_clean":"2024-09-12T01:03:09.608163+0000","last_became_active":"2024-09-12T00:21:50.538041+0000","last_became_peered":"2024-09-12T00:21:50.538041+0000","last_unstale":"2024-09-12T01:03:09.608163+0000","last_undegraded":"2024-09-12T01:03:09.608163+0000","last_fullsized":"2024-09-12T01:03:09.608163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:16.216296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'125","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.684858+0000","last_change":"2024-09-12T00:21:52.564384+0000","last_active":"2024-09-12T01:05:19.684858+0000","last_peered":"2024-09-12T01:05:19.684858+0000","last_clean":"2024-09-12T01:05:19.684858+0000","last_became_active":"2024-09-12T00:21:52.560366+0000","last_became_peered":"2024-09-12T00:21:52.560366+0000","last_unstale":"2024-09-12T01:05:19.684858+0000","last_undegraded":"2024-09-12T01:05:19.684858+0000","last_fullsized":"2024-09-12T01:05:19.684858+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:27.682015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":163,"num_read_kb":157,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'212","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.678629+0000","last_change":"2024-09-12T00:21:44.513724+0000","last_active":"2024-09-12T01:04:47.678629+0000","last_peered":"2024-09-12T01:04:47.678629+0000","last_clean":"2024-09-12T01:04:47.678629+0000","last_became_active":"2024-09-12T00:21:44.512917+0000","last_became_peered":"2024-09-12T00:21:44.512917+0000","last_unstale":"2024-09-12T01:04:47.678629+0000","last_undegraded":"2024-09-12T01:04:47.678629+0000","last_fullsized":"2024-09-12T01:04:47.678629+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:10.484566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":716,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'308","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.625978+0000","last_change":"2024-09-12T00:21:42.517480+0000","last_active":"2024-09-12T01:05:51.625978+0000","last_peered":"2024-09-12T01:05:51.625978+0000","last_clean":"2024-09-12T01:05:51.625978+0000","last_became_active":"2024-09-12T00:21:42.516419+0000","last_became_peered":"2024-09-12T00:21:42.516419+0000","last_unstale":"2024-09-12T01:05:51.625978+0000","last_undegraded":"2024-09-12T01:05:51.625978+0000","last_fullsized":"2024-09-12T01:05:51.625978+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:55.919056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419298,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":551,"num_read_kb":12934,"num_write":1185,"num_write_kb":32784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.750311+0000","last_change":"2024-09-12T00:21:46.504336+0000","last_active":"2024-09-12T01:02:54.750311+0000","last_peered":"2024-09-12T01:02:54.750311+0000","last_clean":"2024-09-12T01:02:54.750311+0000","last_became_active":"2024-09-12T00:21:46.503747+0000","last_became_peered":"2024-09-12T00:21:46.503747+0000","last_unstale":"2024-09-12T01:02:54.750311+0000","last_undegraded":"2024-09-12T01:02:54.750311+0000","last_fullsized":"2024-09-12T01:02:54.750311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:49.256627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'239","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.423033+0000","last_change":"2024-09-12T00:21:48.547112+0000","last_active":"2024-09-12T01:06:49.423033+0000","last_peered":"2024-09-12T01:06:49.423033+0000","last_clean":"2024-09-12T01:06:49.423033+0000","last_became_active":"2024-09-12T00:21:48.546392+0000","last_became_peered":"2024-09-12T00:21:48.546392+0000","last_unstale":"2024-09-12T01:06:49.423033+0000","last_undegraded":"2024-09-12T01:06:49.423033+0000","last_fullsized":"2024-09-12T01:06:49.423033+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:06.500945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":822,"num_write":306,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.627760+0000","last_change":"2024-09-12T00:21:50.549326+0000","last_active":"2024-09-12T01:04:24.627760+0000","last_peered":"2024-09-12T01:04:24.627760+0000","last_clean":"2024-09-12T01:04:24.627760+0000","last_became_active":"2024-09-12T00:21:50.548527+0000","last_became_peered":"2024-09-12T00:21:50.548527+0000","last_unstale":"2024-09-12T01:04:24.627760+0000","last_undegraded":"2024-09-12T01:04:24.627760+0000","last_fullsized":"2024-09-12T01:04:24.627760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:37.290906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'193","reported_seq":1701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.596270+0000","last_change":"2024-09-12T00:21:52.569731+0000","last_active":"2024-09-12T01:06:04.596270+0000","last_peered":"2024-09-12T01:06:04.596270+0000","last_clean":"2024-09-12T01:06:04.596270+0000","last_became_active":"2024-09-12T00:21:52.559360+0000","last_became_peered":"2024-09-12T00:21:52.559360+0000","last_unstale":"2024-09-12T01:06:04.596270+0000","last_undegraded":"2024-09-12T01:06:04.596270+0000","last_fullsized":"2024-09-12T01:06:04.596270+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:25.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1316,"num_write":423,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'81","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.145312+0000","last_change":"2024-09-12T00:21:44.485574+0000","last_active":"2024-09-12T01:04:56.145312+0000","last_peered":"2024-09-12T01:04:56.145312+0000","last_clean":"2024-09-12T01:04:56.145312+0000","last_became_active":"2024-09-12T00:21:44.485278+0000","last_became_peered":"2024-09-12T00:21:44.485278+0000","last_unstale":"2024-09-12T01:04:56.145312+0000","last_undegraded":"2024-09-12T01:04:56.145312+0000","last_fullsized":"2024-09-12T01:04:56.145312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:13.977255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":295,"num_write":139,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'261","reported_seq":895,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:22.470850+0000","last_change":"2024-09-12T00:21:42.524712+0000","last_active":"2024-09-12T01:04:22.470850+0000","last_peered":"2024-09-12T01:04:22.470850+0000","last_clean":"2024-09-12T01:04:22.470850+0000","last_became_active":"2024-09-12T00:21:42.520276+0000","last_became_peered":"2024-09-12T00:21:42.520276+0000","last_unstale":"2024-09-12T01:04:22.470850+0000","last_undegraded":"2024-09-12T01:04:22.470850+0000","last_fullsized":"2024-09-12T01:04:22.470850+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:35.769781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488903,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":405,"num_read_kb":35265,"num_write":964,"num_write_kb":28370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":975,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.723471+0000","last_change":"2024-09-12T00:21:46.495855+0000","last_active":"2024-09-12T01:07:12.723471+0000","last_peered":"2024-09-12T01:07:12.723471+0000","last_clean":"2024-09-12T01:07:12.723471+0000","last_became_active":"2024-09-12T00:21:46.495088+0000","last_became_peered":"2024-09-12T00:21:46.495088+0000","last_unstale":"2024-09-12T01:07:12.723471+0000","last_undegraded":"2024-09-12T01:07:12.723471+0000","last_fullsized":"2024-09-12T01:07:12.723471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:27.176611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'322","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.420157+0000","last_change":"2024-09-12T00:21:48.551157+0000","last_active":"2024-09-12T01:06:49.420157+0000","last_peered":"2024-09-12T01:06:49.420157+0000","last_clean":"2024-09-12T01:06:49.420157+0000","last_became_active":"2024-09-12T00:21:48.550441+0000","last_became_peered":"2024-09-12T00:21:48.550441+0000","last_unstale":"2024-09-12T01:06:49.420157+0000","last_undegraded":"2024-09-12T01:06:49.420157+0000","last_fullsized":"2024-09-12T01:06:49.420157+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:58.154347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1076,"num_write":438,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.581974+0000","last_change":"2024-09-12T00:21:50.566647+0000","last_active":"2024-09-12T01:04:24.581974+0000","last_peered":"2024-09-12T01:04:24.581974+0000","last_clean":"2024-09-12T01:04:24.581974+0000","last_became_active":"2024-09-12T00:21:50.565955+0000","last_became_peered":"2024-09-12T00:21:50.565955+0000","last_unstale":"2024-09-12T01:04:24.581974+0000","last_undegraded":"2024-09-12T01:04:24.581974+0000","last_fullsized":"2024-09-12T01:04:24.581974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:37.311871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'131","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.963224+0000","last_change":"2024-09-12T00:21:52.549770+0000","last_active":"2024-09-12T01:07:11.963224+0000","last_peered":"2024-09-12T01:07:11.963224+0000","last_clean":"2024-09-12T01:07:11.963224+0000","last_became_active":"2024-09-12T00:21:52.549080+0000","last_became_peered":"2024-09-12T00:21:52.549080+0000","last_unstale":"2024-09-12T01:07:11.963224+0000","last_undegraded":"2024-09-12T01:07:11.963224+0000","last_fullsized":"2024-09-12T01:07:11.963224+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.186294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'77","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.591355+0000","last_change":"2024-09-12T00:21:44.495955+0000","last_active":"2024-09-12T01:05:04.591355+0000","last_peered":"2024-09-12T01:05:04.591355+0000","last_clean":"2024-09-12T01:05:04.591355+0000","last_became_active":"2024-09-12T00:21:44.495122+0000","last_became_peered":"2024-09-12T00:21:44.495122+0000","last_unstale":"2024-09-12T01:05:04.591355+0000","last_undegraded":"2024-09-12T01:05:04.591355+0000","last_fullsized":"2024-09-12T01:05:04.591355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:03.274312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":290,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'290","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.545818+0000","last_change":"2024-09-12T00:21:42.492687+0000","last_active":"2024-09-12T01:05:28.545818+0000","last_peered":"2024-09-12T01:05:28.545818+0000","last_clean":"2024-09-12T01:05:28.545818+0000","last_became_active":"2024-09-12T00:21:42.492358+0000","last_became_peered":"2024-09-12T00:21:42.492358+0000","last_unstale":"2024-09-12T01:05:28.545818+0000","last_undegraded":"2024-09-12T01:05:28.545818+0000","last_fullsized":"2024-09-12T01:05:28.545818+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:04.601338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4782119,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":506,"num_read_kb":28331,"num_write":1111,"num_write_kb":34411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'258","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.198362+0000","last_change":"2024-09-12T00:21:44.518405+0000","last_active":"2024-09-12T01:05:20.198362+0000","last_peered":"2024-09-12T01:05:20.198362+0000","last_clean":"2024-09-12T01:05:20.198362+0000","last_became_active":"2024-09-12T00:21:44.515839+0000","last_became_peered":"2024-09-12T00:21:44.515839+0000","last_unstale":"2024-09-12T01:05:20.198362+0000","last_undegraded":"2024-09-12T01:05:20.198362+0000","last_fullsized":"2024-09-12T01:05:20.198362+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:06.067490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":1036,"num_write":423,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'369","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.614722+0000","last_change":"2024-09-12T00:21:42.503380+0000","last_active":"2024-09-12T01:05:45.614722+0000","last_peered":"2024-09-12T01:05:45.614722+0000","last_clean":"2024-09-12T01:05:45.614722+0000","last_became_active":"2024-09-12T00:21:42.502396+0000","last_became_peered":"2024-09-12T00:21:42.502396+0000","last_unstale":"2024-09-12T01:05:45.614722+0000","last_undegraded":"2024-09-12T01:05:45.614722+0000","last_fullsized":"2024-09-12T01:05:45.614722+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:34.541877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5959057,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":662,"num_read_kb":17888,"num_write":1440,"num_write_kb":31183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'183","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.638098+0000","last_change":"2024-09-12T00:21:44.500052+0000","last_active":"2024-09-12T01:05:04.638098+0000","last_peered":"2024-09-12T01:05:04.638098+0000","last_clean":"2024-09-12T01:05:04.638098+0000","last_became_active":"2024-09-12T00:21:44.499805+0000","last_became_peered":"2024-09-12T00:21:44.499805+0000","last_unstale":"2024-09-12T01:05:04.638098+0000","last_undegraded":"2024-09-12T01:05:04.638098+0000","last_fullsized":"2024-09-12T01:05:04.638098+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:04.496825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":613,"num_write":283,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'399","reported_seq":1142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.017382+0000","last_change":"2024-09-12T00:21:42.519251+0000","last_active":"2024-09-12T01:06:03.017382+0000","last_peered":"2024-09-12T01:06:03.017382+0000","last_clean":"2024-09-12T01:06:03.017382+0000","last_became_active":"2024-09-12T00:21:42.518823+0000","last_became_peered":"2024-09-12T00:21:42.518823+0000","last_unstale":"2024-09-12T01:06:03.017382+0000","last_undegraded":"2024-09-12T01:06:03.017382+0000","last_fullsized":"2024-09-12T01:06:03.017382+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:20.503872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972276,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":898,"num_read_kb":24368,"num_write":1426,"num_write_kb":48727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'183","reported_seq":794,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.618714+0000","last_change":"2024-09-12T00:21:44.511626+0000","last_active":"2024-09-12T01:05:04.618714+0000","last_peered":"2024-09-12T01:05:04.618714+0000","last_clean":"2024-09-12T01:05:04.618714+0000","last_became_active":"2024-09-12T00:21:44.510818+0000","last_became_peered":"2024-09-12T00:21:44.510818+0000","last_unstale":"2024-09-12T01:05:04.618714+0000","last_undegraded":"2024-09-12T01:05:04.618714+0000","last_fullsized":"2024-09-12T01:05:04.618714+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:52.353228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":671,"num_write":265,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'280","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.208287+0000","last_change":"2024-09-12T00:21:42.526241+0000","last_active":"2024-09-12T01:05:19.208287+0000","last_peered":"2024-09-12T01:05:19.208287+0000","last_clean":"2024-09-12T01:05:19.208287+0000","last_became_active":"2024-09-12T00:21:42.525233+0000","last_became_peered":"2024-09-12T00:21:42.525233+0000","last_unstale":"2024-09-12T01:05:19.208287+0000","last_undegraded":"2024-09-12T01:05:19.208287+0000","last_fullsized":"2024-09-12T01:05:19.208287+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:21.684315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12271764,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":774,"num_read_kb":20384,"num_write":993,"num_write_kb":42665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'183","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.832023+0000","last_change":"2024-09-12T00:21:44.524491+0000","last_active":"2024-09-12T01:04:45.832023+0000","last_peered":"2024-09-12T01:04:45.832023+0000","last_clean":"2024-09-12T01:04:45.832023+0000","last_became_active":"2024-09-12T00:21:44.523632+0000","last_became_peered":"2024-09-12T00:21:44.523632+0000","last_unstale":"2024-09-12T01:04:45.832023+0000","last_undegraded":"2024-09-12T01:04:45.832023+0000","last_fullsized":"2024-09-12T01:04:45.832023+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:53.560876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":821,"num_read_kb":680,"num_write":294,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'325","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.844190+0000","last_change":"2024-09-12T00:21:42.504025+0000","last_active":"2024-09-12T01:07:07.844190+0000","last_peered":"2024-09-12T01:07:07.844190+0000","last_clean":"2024-09-12T01:07:07.844190+0000","last_became_active":"2024-09-12T00:21:42.501690+0000","last_became_peered":"2024-09-12T00:21:42.501690+0000","last_unstale":"2024-09-12T01:07:07.844190+0000","last_undegraded":"2024-09-12T01:07:07.844190+0000","last_fullsized":"2024-09-12T01:07:07.844190+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.312316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491986,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":530,"num_read_kb":15191,"num_write":1265,"num_write_kb":28087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'132","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.849170+0000","last_change":"2024-09-12T00:21:44.506973+0000","last_active":"2024-09-12T01:04:50.849170+0000","last_peered":"2024-09-12T01:04:50.849170+0000","last_clean":"2024-09-12T01:04:50.849170+0000","last_became_active":"2024-09-12T00:21:44.505235+0000","last_became_peered":"2024-09-12T00:21:44.505235+0000","last_unstale":"2024-09-12T01:04:50.849170+0000","last_undegraded":"2024-09-12T01:04:50.849170+0000","last_fullsized":"2024-09-12T01:04:50.849170+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:20.444195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":497,"num_write":201,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'281","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.768427+0000","last_change":"2024-09-12T00:21:42.509646+0000","last_active":"2024-09-12T01:05:38.768427+0000","last_peered":"2024-09-12T01:05:38.768427+0000","last_clean":"2024-09-12T01:05:38.768427+0000","last_became_active":"2024-09-12T00:21:42.508673+0000","last_became_peered":"2024-09-12T00:21:42.508673+0000","last_unstale":"2024-09-12T01:05:38.768427+0000","last_undegraded":"2024-09-12T01:05:38.768427+0000","last_fullsized":"2024-09-12T01:05:38.768427+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:10.125063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4844272,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":550,"num_read_kb":49155,"num_write":1136,"num_write_kb":40891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'142","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.964429+0000","last_change":"2024-09-12T00:21:44.515765+0000","last_active":"2024-09-12T01:07:11.964429+0000","last_peered":"2024-09-12T01:07:11.964429+0000","last_clean":"2024-09-12T01:07:11.964429+0000","last_became_active":"2024-09-12T00:21:44.515206+0000","last_became_peered":"2024-09-12T00:21:44.515206+0000","last_unstale":"2024-09-12T01:07:11.964429+0000","last_undegraded":"2024-09-12T01:07:11.964429+0000","last_fullsized":"2024-09-12T01:07:11.964429+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:47.686425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":613,"num_write":237,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'281","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.215870+0000","last_change":"2024-09-12T00:21:42.489401+0000","last_active":"2024-09-12T01:05:53.215870+0000","last_peered":"2024-09-12T01:05:53.215870+0000","last_clean":"2024-09-12T01:05:53.215870+0000","last_became_active":"2024-09-12T00:21:42.486829+0000","last_became_peered":"2024-09-12T00:21:42.486829+0000","last_unstale":"2024-09-12T01:05:53.215870+0000","last_undegraded":"2024-09-12T01:05:53.215870+0000","last_fullsized":"2024-09-12T01:05:53.215870+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.611453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4540397,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":478,"num_read_kb":26644,"num_write":985,"num_write_kb":13447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'172","reported_seq":773,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.043569+0000","last_change":"2024-09-12T00:21:44.503743+0000","last_active":"2024-09-12T01:05:28.043569+0000","last_peered":"2024-09-12T01:05:28.043569+0000","last_clean":"2024-09-12T01:05:28.043569+0000","last_became_active":"2024-09-12T00:21:44.501384+0000","last_became_peered":"2024-09-12T00:21:44.501384+0000","last_unstale":"2024-09-12T01:05:28.043569+0000","last_undegraded":"2024-09-12T01:05:28.043569+0000","last_fullsized":"2024-09-12T01:05:28.043569+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:44.078748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":594,"num_write":251,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'283","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.647940+0000","last_change":"2024-09-12T00:21:42.534665+0000","last_active":"2024-09-12T01:05:42.647940+0000","last_peered":"2024-09-12T01:05:42.647940+0000","last_clean":"2024-09-12T01:05:42.647940+0000","last_became_active":"2024-09-12T00:21:42.533216+0000","last_became_peered":"2024-09-12T00:21:42.533216+0000","last_unstale":"2024-09-12T01:05:42.647940+0000","last_undegraded":"2024-09-12T01:05:42.647940+0000","last_fullsized":"2024-09-12T01:05:42.647940+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.651370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10089675,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":504,"num_read_kb":42167,"num_write":1121,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'107","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:48.581000+0000","last_change":"2024-09-12T00:21:44.515637+0000","last_active":"2024-09-12T01:03:48.581000+0000","last_peered":"2024-09-12T01:03:48.581000+0000","last_clean":"2024-09-12T01:03:48.581000+0000","last_became_active":"2024-09-12T00:21:44.514909+0000","last_became_peered":"2024-09-12T00:21:44.514909+0000","last_unstale":"2024-09-12T01:03:48.581000+0000","last_undegraded":"2024-09-12T01:03:48.581000+0000","last_fullsized":"2024-09-12T01:03:48.581000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:15.377389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":354,"num_write":152,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'309","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.526906+0000","last_change":"2024-09-12T00:21:42.529321+0000","last_active":"2024-09-12T01:05:47.526906+0000","last_peered":"2024-09-12T01:05:47.526906+0000","last_clean":"2024-09-12T01:05:47.526906+0000","last_became_active":"2024-09-12T00:21:42.528929+0000","last_became_peered":"2024-09-12T00:21:42.528929+0000","last_unstale":"2024-09-12T01:05:47.526906+0000","last_undegraded":"2024-09-12T01:05:47.526906+0000","last_fullsized":"2024-09-12T01:05:47.526906+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.595630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826969,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":551,"num_read_kb":14743,"num_write":1015,"num_write_kb":22917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'148","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.196493+0000","last_change":"2024-09-12T00:21:44.507845+0000","last_active":"2024-09-12T01:05:01.196493+0000","last_peered":"2024-09-12T01:05:01.196493+0000","last_clean":"2024-09-12T01:05:01.196493+0000","last_became_active":"2024-09-12T00:21:44.507579+0000","last_became_peered":"2024-09-12T00:21:44.507579+0000","last_unstale":"2024-09-12T01:05:01.196493+0000","last_undegraded":"2024-09-12T01:05:01.196493+0000","last_fullsized":"2024-09-12T01:05:01.196493+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:20.931149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":566,"num_write":233,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'312","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609831+0000","last_change":"2024-09-12T00:21:42.512593+0000","last_active":"2024-09-12T01:04:29.609831+0000","last_peered":"2024-09-12T01:04:29.609831+0000","last_clean":"2024-09-12T01:04:29.609831+0000","last_became_active":"2024-09-12T00:21:42.511703+0000","last_became_peered":"2024-09-12T00:21:42.511703+0000","last_unstale":"2024-09-12T01:04:29.609831+0000","last_undegraded":"2024-09-12T01:04:29.609831+0000","last_fullsized":"2024-09-12T01:04:29.609831+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:16.112281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561783,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":516,"num_read_kb":16282,"num_write":1149,"num_write_kb":34029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'32","reported_seq":574,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.235223+0000","last_change":"2024-09-12T00:21:44.512963+0000","last_active":"2024-09-12T01:05:51.235223+0000","last_peered":"2024-09-12T01:05:51.235223+0000","last_clean":"2024-09-12T01:05:51.235223+0000","last_became_active":"2024-09-12T00:21:44.509834+0000","last_became_peered":"2024-09-12T00:21:44.509834+0000","last_unstale":"2024-09-12T01:05:51.235223+0000","last_undegraded":"2024-09-12T01:05:51.235223+0000","last_fullsized":"2024-09-12T01:05:51.235223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:08.437585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'289","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.413211+0000","last_change":"2024-09-12T00:21:42.484617+0000","last_active":"2024-09-12T01:05:22.413211+0000","last_peered":"2024-09-12T01:05:22.413211+0000","last_clean":"2024-09-12T01:05:22.413211+0000","last_became_active":"2024-09-12T00:21:42.484073+0000","last_became_peered":"2024-09-12T00:21:42.484073+0000","last_unstale":"2024-09-12T01:05:22.413211+0000","last_undegraded":"2024-09-12T01:05:22.413211+0000","last_fullsized":"2024-09-12T01:05:22.413211+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:02.073875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19842851,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":466,"num_read_kb":37310,"num_write":1112,"num_write_kb":47723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'219","reported_seq":806,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.336782+0000","last_change":"2024-09-12T00:21:44.499442+0000","last_active":"2024-09-12T01:05:39.336782+0000","last_peered":"2024-09-12T01:05:39.336782+0000","last_clean":"2024-09-12T01:05:39.336782+0000","last_became_active":"2024-09-12T00:21:44.499043+0000","last_became_peered":"2024-09-12T00:21:44.499043+0000","last_unstale":"2024-09-12T01:05:39.336782+0000","last_undegraded":"2024-09-12T01:05:39.336782+0000","last_fullsized":"2024-09-12T01:05:39.336782+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:15.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":734,"num_write":347,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'316","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.234563+0000","last_change":"2024-09-12T00:21:42.483974+0000","last_active":"2024-09-12T01:06:03.234563+0000","last_peered":"2024-09-12T01:06:03.234563+0000","last_clean":"2024-09-12T01:06:03.234563+0000","last_became_active":"2024-09-12T00:21:42.482971+0000","last_became_peered":"2024-09-12T00:21:42.482971+0000","last_unstale":"2024-09-12T01:06:03.234563+0000","last_undegraded":"2024-09-12T01:06:03.234563+0000","last_fullsized":"2024-09-12T01:06:03.234563+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:02.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10637338,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":557,"num_read_kb":31089,"num_write":1085,"num_write_kb":20487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'217","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.418327+0000","last_change":"2024-09-12T00:21:44.526412+0000","last_active":"2024-09-12T01:06:44.418327+0000","last_peered":"2024-09-12T01:06:44.418327+0000","last_clean":"2024-09-12T01:06:44.418327+0000","last_became_active":"2024-09-12T00:21:44.526086+0000","last_became_peered":"2024-09-12T00:21:44.526086+0000","last_unstale":"2024-09-12T01:06:44.418327+0000","last_undegraded":"2024-09-12T01:06:44.418327+0000","last_fullsized":"2024-09-12T01:06:44.418327+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:23.397670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1006,"num_read_kb":865,"num_write":343,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'294","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.285557+0000","last_change":"2024-09-12T00:22:12.610824+0000","last_active":"2024-09-12T01:05:49.285557+0000","last_peered":"2024-09-12T01:05:49.285557+0000","last_clean":"2024-09-12T01:05:49.285557+0000","last_became_active":"2024-09-12T00:22:12.609837+0000","last_became_peered":"2024-09-12T00:22:12.609837+0000","last_unstale":"2024-09-12T01:05:49.285557+0000","last_undegraded":"2024-09-12T01:05:49.285557+0000","last_fullsized":"2024-09-12T01:05:49.285557+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:23.567602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8530495,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":772,"num_read_kb":34651,"num_write":1094,"num_write_kb":39913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2a","version":"267'441","reported_seq":1107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.368037+0000","last_change":"2024-09-12T00:21:44.512868+0000","last_active":"2024-09-12T01:05:25.368037+0000","last_peered":"2024-09-12T01:05:25.368037+0000","last_clean":"2024-09-12T01:05:25.368037+0000","last_became_active":"2024-09-12T00:21:44.511294+0000","last_became_peered":"2024-09-12T00:21:44.511294+0000","last_unstale":"2024-09-12T01:05:25.368037+0000","last_undegraded":"2024-09-12T01:05:25.368037+0000","last_fullsized":"2024-09-12T01:05:25.368037+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:11.069322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2157,"num_read_kb":1820,"num_write":750,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'284","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.225948+0000","last_change":"2024-09-12T00:21:42.530226+0000","last_active":"2024-09-12T01:06:03.225948+0000","last_peered":"2024-09-12T01:06:03.225948+0000","last_clean":"2024-09-12T01:06:03.225948+0000","last_became_active":"2024-09-12T00:21:42.528942+0000","last_became_peered":"2024-09-12T00:21:42.528942+0000","last_unstale":"2024-09-12T01:06:03.225948+0000","last_undegraded":"2024-09-12T01:06:03.225948+0000","last_fullsized":"2024-09-12T01:06:03.225948+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:58.270470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513679,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":444,"num_read_kb":48912,"num_write":1124,"num_write_kb":34098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'117","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.852107+0000","last_change":"2024-09-12T00:21:44.526377+0000","last_active":"2024-09-12T01:05:02.852107+0000","last_peered":"2024-09-12T01:05:02.852107+0000","last_clean":"2024-09-12T01:05:02.852107+0000","last_became_active":"2024-09-12T00:21:44.525685+0000","last_became_peered":"2024-09-12T00:21:44.525685+0000","last_unstale":"2024-09-12T01:05:02.852107+0000","last_undegraded":"2024-09-12T01:05:02.852107+0000","last_fullsized":"2024-09-12T01:05:02.852107+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.603436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":457,"num_write":189,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'265","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.612676+0000","last_change":"2024-09-12T00:21:42.503168+0000","last_active":"2024-09-12T01:06:03.612676+0000","last_peered":"2024-09-12T01:06:03.612676+0000","last_clean":"2024-09-12T01:06:03.612676+0000","last_became_active":"2024-09-12T00:21:42.499294+0000","last_became_peered":"2024-09-12T00:21:42.499294+0000","last_unstale":"2024-09-12T01:06:03.612676+0000","last_undegraded":"2024-09-12T01:06:03.612676+0000","last_fullsized":"2024-09-12T01:06:03.612676+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:30.172185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4897244,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":401,"num_read_kb":11483,"num_write":1015,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'192","reported_seq":807,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:48.540662+0000","last_change":"2024-09-12T00:21:44.511953+0000","last_active":"2024-09-12T01:05:48.540662+0000","last_peered":"2024-09-12T01:05:48.540662+0000","last_clean":"2024-09-12T01:05:48.540662+0000","last_became_active":"2024-09-12T00:21:44.511085+0000","last_became_peered":"2024-09-12T00:21:44.511085+0000","last_unstale":"2024-09-12T01:05:48.540662+0000","last_undegraded":"2024-09-12T01:05:48.540662+0000","last_fullsized":"2024-09-12T01:05:48.540662+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:53.583649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":698,"num_write":312,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'311","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.708915+0000","last_change":"2024-09-12T00:21:42.519200+0000","last_active":"2024-09-12T01:07:05.708915+0000","last_peered":"2024-09-12T01:07:05.708915+0000","last_clean":"2024-09-12T01:07:05.708915+0000","last_became_active":"2024-09-12T00:21:42.518768+0000","last_became_peered":"2024-09-12T00:21:42.518768+0000","last_unstale":"2024-09-12T01:07:05.708915+0000","last_undegraded":"2024-09-12T01:07:05.708915+0000","last_fullsized":"2024-09-12T01:07:05.708915+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:58.092377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7638034,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":523,"num_read_kb":53651,"num_write":1035,"num_write_kb":23347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'248","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:16.319309+0000","last_change":"2024-09-12T00:21:42.495841+0000","last_active":"2024-09-12T01:04:16.319309+0000","last_peered":"2024-09-12T01:04:16.319309+0000","last_clean":"2024-09-12T01:04:16.319309+0000","last_became_active":"2024-09-12T00:21:42.495480+0000","last_became_peered":"2024-09-12T00:21:42.495480+0000","last_unstale":"2024-09-12T01:04:16.319309+0000","last_undegraded":"2024-09-12T01:04:16.319309+0000","last_fullsized":"2024-09-12T01:04:16.319309+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:30.083635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813200,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":356,"num_read_kb":25580,"num_write":877,"num_write_kb":28169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'195","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.324242+0000","last_change":"2024-09-12T00:21:44.527476+0000","last_active":"2024-09-12T01:04:19.324242+0000","last_peered":"2024-09-12T01:04:19.324242+0000","last_clean":"2024-09-12T01:04:19.324242+0000","last_became_active":"2024-09-12T00:21:44.526907+0000","last_became_peered":"2024-09-12T00:21:44.526907+0000","last_unstale":"2024-09-12T01:04:19.324242+0000","last_undegraded":"2024-09-12T01:04:19.324242+0000","last_fullsized":"2024-09-12T01:04:19.324242+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.457978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":917,"num_read_kb":786,"num_write":315,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'253","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.449829+0000","last_change":"2024-09-12T00:21:42.518641+0000","last_active":"2024-09-12T01:05:43.449829+0000","last_peered":"2024-09-12T01:05:43.449829+0000","last_clean":"2024-09-12T01:05:43.449829+0000","last_became_active":"2024-09-12T00:21:42.516614+0000","last_became_peered":"2024-09-12T00:21:42.516614+0000","last_unstale":"2024-09-12T01:05:43.449829+0000","last_undegraded":"2024-09-12T01:05:43.449829+0000","last_fullsized":"2024-09-12T01:05:43.449829+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:05.951966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10018583,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":355,"num_read_kb":30838,"num_write":863,"num_write_kb":38454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'102","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.972355+0000","last_change":"2024-09-12T00:21:44.497391+0000","last_active":"2024-09-12T01:05:40.972355+0000","last_peered":"2024-09-12T01:05:40.972355+0000","last_clean":"2024-09-12T01:05:40.972355+0000","last_became_active":"2024-09-12T00:21:44.496138+0000","last_became_peered":"2024-09-12T00:21:44.496138+0000","last_unstale":"2024-09-12T01:05:40.972355+0000","last_undegraded":"2024-09-12T01:05:40.972355+0000","last_fullsized":"2024-09-12T01:05:40.972355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:58.246589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5839,"num_read_kb":4146,"num_write":1942,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1113,"ondisk_log_size":1113,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14973,"num_read_kb":14645,"num_write":16791,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1915236,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17268,"num_read_kb":32926,"num_write":14583,"num_write_kb":11539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2785784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1797,"ondisk_log_size":1797,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":101832,"num_read_kb":85065,"num_write":36894,"num_write_kb":18565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3786,"ondisk_log_size":3786,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":487604295,"num_objects":4459,"num_object_clones":0,"num_object_copies":13377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4459,"num_whiteouts":0,"num_read":32004,"num_read_kb":1795863,"num_write":67679,"num_write_kb":2042491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":780877824,"data_stored":780877824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4490,"ondisk_log_size":4490,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":83982926,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":145,"num_read_kb":206538,"num_write":160,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":83982926,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":141,"num_read_kb":195226,"num_write":160,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509996,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209920,"kb_used_data":128816,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94161920,"statfs":{"total":96636764160,"available":96421806080,"internally_reserved":0,"allocated":131907584,"data_stored":129847978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509997,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":428644,"kb_used_data":172628,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93943196,"statfs":{"total":96636764160,"available":96197832704,"internally_reserved":0,"allocated":176771072,"data_stored":174719875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509999,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303956,"kb_used_data":120132,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94067884,"statfs":{"total":96636764160,"available":96325513216,"internally_reserved":0,"allocated":123015168,"data_stored":120972731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509997,"num_pgs":123,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358648,"kb_used_data":169192,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94013192,"statfs":{"total":96636764160,"available":96269508608,"internally_reserved":0,"allocated":173252608,"data_stored":171214777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":193984968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510000,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249116,"kb_used_data":137420,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94122724,"statfs":{"total":96636764160,"available":96381669376,"internally_reserved":0,"allocated":140718080,"data_stored":138714461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509997,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375112,"kb_used_data":113464,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93996728,"statfs":{"total":96636764160,"available":96252649472,"internally_reserved":0,"allocated":116187136,"data_stored":114123792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509996,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260596,"kb_used_data":139236,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94111244,"statfs":{"total":96636764160,"available":96369913856,"internally_reserved":0,"allocated":142577664,"data_stored":140512320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542702,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":344888,"kb_used_data":147176,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94026952,"statfs":{"total":96636764160,"available":96283598848,"internally_reserved":0,"allocated":150708224,"data_stored":148689588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118882304,"data_stored":118882304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":89845760,"data_stored":89845760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":99635200,"data_stored":99635200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107778048,"data_stored":107778048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":82595840,"data_stored":82595840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":104267776,"data_stored":104267776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":76865536,"data_stored":76865536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":101007360,"data_stored":101007360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":501806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":465157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":127090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":270653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":374988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":403118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":349499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":293473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44089344,"data_stored":44088614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27312128,"data_stored":27311400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27312128,"data_stored":27311400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29409280,"data_stored":29408550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39895040,"data_stored":39894312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:07:29.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:07:29.406 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:07:29.423 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T01:07:29.432 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1645,"stamp":"2024-09-12T01:07:29.128917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":610655116,"num_objects":4649,"num_object_clones":0,"num_object_copies":13544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4649,"num_whiteouts":0,"num_read":174993,"num_read_kb":2338056,"num_write":138617,"num_write_kb":2353688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13565,"ondisk_log_size":13565,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429140,"kb_used_data":999684,"kb_used_omap":12,"kb_used_meta":1429043,"kb_avail":752545580,"statfs":{"total":773094113280,"available":770606673920,"internally_reserved":0,"allocated":1023676416,"data_stored":1007366039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1463340593},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-47438092,"num_objects":-224,"num_object_clones":0,"num_object_copies":-661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-224,"num_whiteouts":0,"num_read":310,"num_read_kb":715,"num_write":265,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008054"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587141+0000","last_change":"2024-09-12T00:49:10.624205+0000","last_active":"2024-09-12T01:04:14.587141+0000","last_peered":"2024-09-12T01:04:14.587141+0000","last_clean":"2024-09-12T01:04:14.587141+0000","last_became_active":"2024-09-12T00:49:10.623491+0000","last_became_peered":"2024-09-12T00:49:10.623491+0000","last_unstale":"2024-09-12T01:04:14.587141+0000","last_undegraded":"2024-09-12T01:04:14.587141+0000","last_fullsized":"2024-09-12T01:04:14.587141+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.660122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"267'6","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.755161+0000","last_change":"2024-09-12T00:38:10.688649+0000","last_active":"2024-09-12T01:03:14.755161+0000","last_peered":"2024-09-12T01:03:14.755161+0000","last_clean":"2024-09-12T01:03:14.755161+0000","last_became_active":"2024-09-12T00:38:10.687911+0000","last_became_peered":"2024-09-12T00:38:10.687911+0000","last_unstale":"2024-09-12T01:03:14.755161+0000","last_undegraded":"2024-09-12T01:03:14.755161+0000","last_fullsized":"2024-09-12T01:03:14.755161+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:09.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.571671+0000","last_change":"2024-09-12T00:38:07.665498+0000","last_active":"2024-09-12T01:03:08.571671+0000","last_peered":"2024-09-12T01:03:08.571671+0000","last_clean":"2024-09-12T01:03:08.571671+0000","last_became_active":"2024-09-12T00:38:07.664779+0000","last_became_peered":"2024-09-12T00:38:07.664779+0000","last_unstale":"2024-09-12T01:03:08.571671+0000","last_undegraded":"2024-09-12T01:03:08.571671+0000","last_fullsized":"2024-09-12T01:03:08.571671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.524540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'50","reported_seq":182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.429135+0000","last_change":"2024-09-12T00:36:37.236134+0000","last_active":"2024-09-12T01:03:50.429135+0000","last_peered":"2024-09-12T01:03:50.429135+0000","last_clean":"2024-09-12T01:03:50.429135+0000","last_became_active":"2024-09-12T00:36:37.223686+0000","last_became_peered":"2024-09-12T00:36:37.223686+0000","last_unstale":"2024-09-12T01:03:50.429135+0000","last_undegraded":"2024-09-12T01:03:50.429135+0000","last_fullsized":"2024-09-12T01:03:50.429135+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:53.656045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":201,"num_write":87,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.582523+0000","last_change":"2024-09-12T00:49:10.625393+0000","last_active":"2024-09-12T01:04:14.582523+0000","last_peered":"2024-09-12T01:04:14.582523+0000","last_clean":"2024-09-12T01:04:14.582523+0000","last_became_active":"2024-09-12T00:49:10.624700+0000","last_became_peered":"2024-09-12T00:49:10.624700+0000","last_unstale":"2024-09-12T01:04:14.582523+0000","last_undegraded":"2024-09-12T01:04:14.582523+0000","last_fullsized":"2024-09-12T01:04:14.582523+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"267'7","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.734454+0000","last_change":"2024-09-12T00:38:10.696907+0000","last_active":"2024-09-12T01:03:14.734454+0000","last_peered":"2024-09-12T01:03:14.734454+0000","last_clean":"2024-09-12T01:03:14.734454+0000","last_became_active":"2024-09-12T00:38:10.691195+0000","last_became_peered":"2024-09-12T00:38:10.691195+0000","last_unstale":"2024-09-12T01:03:14.734454+0000","last_undegraded":"2024-09-12T01:03:14.734454+0000","last_fullsized":"2024-09-12T01:03:14.734454+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.105627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"267'7","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.590149+0000","last_change":"2024-09-12T00:38:07.665354+0000","last_active":"2024-09-12T01:03:09.590149+0000","last_peered":"2024-09-12T01:03:09.590149+0000","last_clean":"2024-09-12T01:03:09.590149+0000","last_became_active":"2024-09-12T00:38:07.664663+0000","last_became_peered":"2024-09-12T00:38:07.664663+0000","last_unstale":"2024-09-12T01:03:09.590149+0000","last_undegraded":"2024-09-12T01:03:09.590149+0000","last_fullsized":"2024-09-12T01:03:09.590149+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.495162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587630+0000","last_change":"2024-09-12T00:36:37.240047+0000","last_active":"2024-09-12T01:04:49.587630+0000","last_peered":"2024-09-12T01:04:49.587630+0000","last_clean":"2024-09-12T01:04:49.587630+0000","last_became_active":"2024-09-12T00:36:37.239199+0000","last_became_peered":"2024-09-12T00:36:37.239199+0000","last_unstale":"2024-09-12T01:04:49.587630+0000","last_undegraded":"2024-09-12T01:04:49.587630+0000","last_fullsized":"2024-09-12T01:04:49.587630+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:11.845055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.762541+0000","last_change":"2024-09-12T00:49:10.612385+0000","last_active":"2024-09-12T01:03:44.762541+0000","last_peered":"2024-09-12T01:03:44.762541+0000","last_clean":"2024-09-12T01:03:44.762541+0000","last_became_active":"2024-09-12T00:49:10.611715+0000","last_became_peered":"2024-09-12T00:49:10.611715+0000","last_unstale":"2024-09-12T01:03:44.762541+0000","last_undegraded":"2024-09-12T01:03:44.762541+0000","last_fullsized":"2024-09-12T01:03:44.762541+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:44.906371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"267'10","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622484+0000","last_change":"2024-09-12T00:38:10.708434+0000","last_active":"2024-09-12T01:05:19.622484+0000","last_peered":"2024-09-12T01:05:19.622484+0000","last_clean":"2024-09-12T01:05:19.622484+0000","last_became_active":"2024-09-12T00:38:10.702832+0000","last_became_peered":"2024-09-12T00:38:10.702832+0000","last_unstale":"2024-09-12T01:05:19.622484+0000","last_undegraded":"2024-09-12T01:05:19.622484+0000","last_fullsized":"2024-09-12T01:05:19.622484+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:02.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":26653,"num_write":15,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.586519+0000","last_change":"2024-09-12T00:38:07.656103+0000","last_active":"2024-09-12T01:04:13.586519+0000","last_peered":"2024-09-12T01:04:13.586519+0000","last_clean":"2024-09-12T01:04:13.586519+0000","last_became_active":"2024-09-12T00:38:07.654162+0000","last_became_peered":"2024-09-12T00:38:07.654162+0000","last_unstale":"2024-09-12T01:04:13.586519+0000","last_undegraded":"2024-09-12T01:04:13.586519+0000","last_fullsized":"2024-09-12T01:04:13.586519+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:51.681421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'61","reported_seq":215,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.745657+0000","last_change":"2024-09-12T00:36:37.244669+0000","last_active":"2024-09-12T01:05:03.745657+0000","last_peered":"2024-09-12T01:05:03.745657+0000","last_clean":"2024-09-12T01:05:03.745657+0000","last_became_active":"2024-09-12T00:36:37.243951+0000","last_became_peered":"2024-09-12T00:36:37.243951+0000","last_unstale":"2024-09-12T01:05:03.745657+0000","last_undegraded":"2024-09-12T01:05:03.745657+0000","last_fullsized":"2024-09-12T01:05:03.745657+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:02.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":228,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600226+0000","last_change":"2024-09-12T00:49:10.614295+0000","last_active":"2024-09-12T01:03:49.600226+0000","last_peered":"2024-09-12T01:03:49.600226+0000","last_clean":"2024-09-12T01:03:49.600226+0000","last_became_active":"2024-09-12T00:49:10.613525+0000","last_became_peered":"2024-09-12T00:49:10.613525+0000","last_unstale":"2024-09-12T01:03:49.600226+0000","last_undegraded":"2024-09-12T01:03:49.600226+0000","last_fullsized":"2024-09-12T01:03:49.600226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:34.120845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'8","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.607603+0000","last_change":"2024-09-12T00:38:10.702125+0000","last_active":"2024-09-12T01:04:19.607603+0000","last_peered":"2024-09-12T01:04:19.607603+0000","last_clean":"2024-09-12T01:04:19.607603+0000","last_became_active":"2024-09-12T00:38:10.701406+0000","last_became_peered":"2024-09-12T00:38:10.701406+0000","last_unstale":"2024-09-12T01:04:19.607603+0000","last_undegraded":"2024-09-12T01:04:19.607603+0000","last_fullsized":"2024-09-12T01:04:19.607603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.321347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":23552,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'4","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.783176+0000","last_change":"2024-09-12T00:38:07.642044+0000","last_active":"2024-09-12T01:05:14.783176+0000","last_peered":"2024-09-12T01:05:14.783176+0000","last_clean":"2024-09-12T01:05:14.783176+0000","last_became_active":"2024-09-12T00:38:07.639897+0000","last_became_peered":"2024-09-12T00:38:07.639897+0000","last_unstale":"2024-09-12T01:05:14.783176+0000","last_undegraded":"2024-09-12T01:05:14.783176+0000","last_fullsized":"2024-09-12T01:05:14.783176+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:48.556221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4625,"num_write":4,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'49","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.581394+0000","last_change":"2024-09-12T00:36:37.236688+0000","last_active":"2024-09-12T01:04:09.581394+0000","last_peered":"2024-09-12T01:04:09.581394+0000","last_clean":"2024-09-12T01:04:09.581394+0000","last_became_active":"2024-09-12T00:36:37.235921+0000","last_became_peered":"2024-09-12T00:36:37.235921+0000","last_unstale":"2024-09-12T01:04:09.581394+0000","last_undegraded":"2024-09-12T01:04:09.581394+0000","last_fullsized":"2024-09-12T01:04:09.581394+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:57.656212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":160,"num_write":94,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.601979+0000","last_change":"2024-09-12T00:49:10.640862+0000","last_active":"2024-09-12T01:05:18.601979+0000","last_peered":"2024-09-12T01:05:18.601979+0000","last_clean":"2024-09-12T01:05:18.601979+0000","last_became_active":"2024-09-12T00:49:10.640187+0000","last_became_peered":"2024-09-12T00:49:10.640187+0000","last_unstale":"2024-09-12T01:05:18.601979+0000","last_undegraded":"2024-09-12T01:05:18.601979+0000","last_fullsized":"2024-09-12T01:05:18.601979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.913407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.596205+0000","last_change":"2024-09-12T00:38:10.702920+0000","last_active":"2024-09-12T01:04:54.596205+0000","last_peered":"2024-09-12T01:04:54.596205+0000","last_clean":"2024-09-12T01:04:54.596205+0000","last_became_active":"2024-09-12T00:38:10.702113+0000","last_became_peered":"2024-09-12T00:38:10.702113+0000","last_unstale":"2024-09-12T01:04:54.596205+0000","last_undegraded":"2024-09-12T01:04:54.596205+0000","last_fullsized":"2024-09-12T01:04:54.596205+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:03.161296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.613854+0000","last_change":"2024-09-12T00:38:07.661344+0000","last_active":"2024-09-12T01:04:44.613854+0000","last_peered":"2024-09-12T01:04:44.613854+0000","last_clean":"2024-09-12T01:04:44.613854+0000","last_became_active":"2024-09-12T00:38:07.660159+0000","last_became_peered":"2024-09-12T00:38:07.660159+0000","last_unstale":"2024-09-12T01:04:44.613854+0000","last_undegraded":"2024-09-12T01:04:44.613854+0000","last_fullsized":"2024-09-12T01:04:44.613854+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:05.309641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'28","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.675076+0000","last_change":"2024-09-12T00:36:37.251730+0000","last_active":"2024-09-12T01:04:15.675076+0000","last_peered":"2024-09-12T01:04:15.675076+0000","last_clean":"2024-09-12T01:04:15.675076+0000","last_became_active":"2024-09-12T00:36:37.248920+0000","last_became_peered":"2024-09-12T00:36:37.248920+0000","last_unstale":"2024-09-12T01:04:15.675076+0000","last_undegraded":"2024-09-12T01:04:15.675076+0000","last_fullsized":"2024-09-12T01:04:15.675076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.363028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574475+0000","last_change":"2024-09-12T00:49:10.640254+0000","last_active":"2024-09-12T01:03:49.574475+0000","last_peered":"2024-09-12T01:03:49.574475+0000","last_clean":"2024-09-12T01:03:49.574475+0000","last_became_active":"2024-09-12T00:49:10.638196+0000","last_became_peered":"2024-09-12T00:49:10.638196+0000","last_unstale":"2024-09-12T01:03:49.574475+0000","last_undegraded":"2024-09-12T01:03:49.574475+0000","last_fullsized":"2024-09-12T01:03:49.574475+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:50.165315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634261+0000","last_change":"2024-09-12T00:38:10.715254+0000","last_active":"2024-09-12T01:04:49.634261+0000","last_peered":"2024-09-12T01:04:49.634261+0000","last_clean":"2024-09-12T01:04:49.634261+0000","last_became_active":"2024-09-12T00:38:10.714503+0000","last_became_peered":"2024-09-12T00:38:10.714503+0000","last_unstale":"2024-09-12T01:04:49.634261+0000","last_undegraded":"2024-09-12T01:04:49.634261+0000","last_fullsized":"2024-09-12T01:04:49.634261+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.076577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"267'4","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634359+0000","last_change":"2024-09-12T00:38:07.659781+0000","last_active":"2024-09-12T01:04:49.634359+0000","last_peered":"2024-09-12T01:04:49.634359+0000","last_clean":"2024-09-12T01:04:49.634359+0000","last_became_active":"2024-09-12T00:38:07.656570+0000","last_became_peered":"2024-09-12T00:38:07.656570+0000","last_unstale":"2024-09-12T01:04:49.634359+0000","last_undegraded":"2024-09-12T01:04:49.634359+0000","last_fullsized":"2024-09-12T01:04:49.634359+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.888062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'40","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.829646+0000","last_change":"2024-09-12T00:36:37.239747+0000","last_active":"2024-09-12T01:05:02.829646+0000","last_peered":"2024-09-12T01:05:02.829646+0000","last_clean":"2024-09-12T01:05:02.829646+0000","last_became_active":"2024-09-12T00:36:37.239055+0000","last_became_peered":"2024-09-12T00:36:37.239055+0000","last_unstale":"2024-09-12T01:05:02.829646+0000","last_undegraded":"2024-09-12T01:05:02.829646+0000","last_fullsized":"2024-09-12T01:05:02.829646+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:58.947633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":128,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748036+0000","last_change":"2024-09-12T00:49:10.625186+0000","last_active":"2024-09-12T01:04:09.748036+0000","last_peered":"2024-09-12T01:04:09.748036+0000","last_clean":"2024-09-12T01:04:09.748036+0000","last_became_active":"2024-09-12T00:49:10.624542+0000","last_became_peered":"2024-09-12T00:49:10.624542+0000","last_unstale":"2024-09-12T01:04:09.748036+0000","last_undegraded":"2024-09-12T01:04:09.748036+0000","last_fullsized":"2024-09-12T01:04:09.748036+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:44.317158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.734406+0000","last_change":"2024-09-12T00:38:10.698782+0000","last_active":"2024-09-12T01:03:14.734406+0000","last_peered":"2024-09-12T01:03:14.734406+0000","last_clean":"2024-09-12T01:03:14.734406+0000","last_became_active":"2024-09-12T00:38:10.698076+0000","last_became_peered":"2024-09-12T00:38:10.698076+0000","last_unstale":"2024-09-12T01:03:14.734406+0000","last_undegraded":"2024-09-12T01:03:14.734406+0000","last_fullsized":"2024-09-12T01:03:14.734406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.783233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.573024+0000","last_change":"2024-09-12T00:38:07.627893+0000","last_active":"2024-09-12T01:03:09.573024+0000","last_peered":"2024-09-12T01:03:09.573024+0000","last_clean":"2024-09-12T01:03:09.573024+0000","last_became_active":"2024-09-12T00:38:07.626956+0000","last_became_peered":"2024-09-12T00:38:07.626956+0000","last_unstale":"2024-09-12T01:03:09.573024+0000","last_undegraded":"2024-09-12T01:03:09.573024+0000","last_fullsized":"2024-09-12T01:03:09.573024+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.872892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'29","reported_seq":124,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.573884+0000","last_change":"2024-09-12T00:36:37.240924+0000","last_active":"2024-09-12T01:03:18.573884+0000","last_peered":"2024-09-12T01:03:18.573884+0000","last_clean":"2024-09-12T01:03:18.573884+0000","last_became_active":"2024-09-12T00:36:37.239412+0000","last_became_peered":"2024-09-12T00:36:37.239412+0000","last_unstale":"2024-09-12T01:03:18.573884+0000","last_undegraded":"2024-09-12T01:03:18.573884+0000","last_fullsized":"2024-09-12T01:03:18.573884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:01.137832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":107,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587293+0000","last_change":"2024-09-12T00:49:10.628369+0000","last_active":"2024-09-12T01:04:14.587293+0000","last_peered":"2024-09-12T01:04:14.587293+0000","last_clean":"2024-09-12T01:04:14.587293+0000","last_became_active":"2024-09-12T00:49:10.623930+0000","last_became_peered":"2024-09-12T00:49:10.623930+0000","last_unstale":"2024-09-12T01:04:14.587293+0000","last_undegraded":"2024-09-12T01:04:14.587293+0000","last_fullsized":"2024-09-12T01:04:14.587293+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.045569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.572802+0000","last_change":"2024-09-12T00:38:10.710382+0000","last_active":"2024-09-12T01:03:13.572802+0000","last_peered":"2024-09-12T01:03:13.572802+0000","last_clean":"2024-09-12T01:03:13.572802+0000","last_became_active":"2024-09-12T00:38:10.709065+0000","last_became_peered":"2024-09-12T00:38:10.709065+0000","last_unstale":"2024-09-12T01:03:13.572802+0000","last_undegraded":"2024-09-12T01:03:13.572802+0000","last_fullsized":"2024-09-12T01:03:13.572802+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:25.778926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.566642+0000","last_change":"2024-09-12T00:38:07.659182+0000","last_active":"2024-09-12T01:03:09.566642+0000","last_peered":"2024-09-12T01:03:09.566642+0000","last_clean":"2024-09-12T01:03:09.566642+0000","last_became_active":"2024-09-12T00:38:07.658039+0000","last_became_peered":"2024-09-12T00:38:07.658039+0000","last_unstale":"2024-09-12T01:03:09.566642+0000","last_undegraded":"2024-09-12T01:03:09.566642+0000","last_fullsized":"2024-09-12T01:03:09.566642+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:05.041242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":3,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'24","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567579+0000","last_change":"2024-09-12T00:36:37.243485+0000","last_active":"2024-09-12T01:03:14.567579+0000","last_peered":"2024-09-12T01:03:14.567579+0000","last_clean":"2024-09-12T01:03:14.567579+0000","last_became_active":"2024-09-12T00:36:37.238156+0000","last_became_peered":"2024-09-12T00:36:37.238156+0000","last_unstale":"2024-09-12T01:03:14.567579+0000","last_undegraded":"2024-09-12T01:03:14.567579+0000","last_fullsized":"2024-09-12T01:03:14.567579+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:40.335893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":66,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.591380+0000","last_change":"2024-09-12T00:49:10.614687+0000","last_active":"2024-09-12T01:03:14.591380+0000","last_peered":"2024-09-12T01:03:14.591380+0000","last_clean":"2024-09-12T01:03:14.591380+0000","last_became_active":"2024-09-12T00:49:10.614006+0000","last_became_peered":"2024-09-12T00:49:10.614006+0000","last_unstale":"2024-09-12T01:03:14.591380+0000","last_undegraded":"2024-09-12T01:03:14.591380+0000","last_fullsized":"2024-09-12T01:03:14.591380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.570199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.428804+0000","last_change":"2024-09-12T00:38:10.692661+0000","last_active":"2024-09-12T01:07:13.428804+0000","last_peered":"2024-09-12T01:07:13.428804+0000","last_clean":"2024-09-12T01:07:13.428804+0000","last_became_active":"2024-09-12T00:38:10.691887+0000","last_became_peered":"2024-09-12T00:38:10.691887+0000","last_unstale":"2024-09-12T01:07:13.428804+0000","last_undegraded":"2024-09-12T01:07:13.428804+0000","last_fullsized":"2024-09-12T01:07:13.428804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.050768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619962+0000","last_change":"2024-09-12T00:38:07.654631+0000","last_active":"2024-09-12T01:03:54.619962+0000","last_peered":"2024-09-12T01:03:54.619962+0000","last_clean":"2024-09-12T01:03:54.619962+0000","last_became_active":"2024-09-12T00:38:07.653685+0000","last_became_peered":"2024-09-12T00:38:07.653685+0000","last_unstale":"2024-09-12T01:03:54.619962+0000","last_undegraded":"2024-09-12T01:03:54.619962+0000","last_fullsized":"2024-09-12T01:03:54.619962+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:49.445932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'8","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567005+0000","last_change":"2024-09-12T00:36:37.229918+0000","last_active":"2024-09-12T01:03:14.567005+0000","last_peered":"2024-09-12T01:03:14.567005+0000","last_clean":"2024-09-12T01:03:14.567005+0000","last_became_active":"2024-09-12T00:36:37.223860+0000","last_became_peered":"2024-09-12T00:36:37.223860+0000","last_unstale":"2024-09-12T01:03:14.567005+0000","last_undegraded":"2024-09-12T01:03:14.567005+0000","last_fullsized":"2024-09-12T01:03:14.567005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:21.022755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567701+0000","last_change":"2024-09-12T00:49:10.623954+0000","last_active":"2024-09-12T01:03:14.567701+0000","last_peered":"2024-09-12T01:03:14.567701+0000","last_clean":"2024-09-12T01:03:14.567701+0000","last_became_active":"2024-09-12T00:49:10.622347+0000","last_became_peered":"2024-09-12T00:49:10.622347+0000","last_unstale":"2024-09-12T01:03:14.567701+0000","last_undegraded":"2024-09-12T01:03:14.567701+0000","last_fullsized":"2024-09-12T01:03:14.567701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:20.923775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.602778+0000","last_change":"2024-09-12T00:38:10.718025+0000","last_active":"2024-09-12T01:03:59.602778+0000","last_peered":"2024-09-12T01:03:59.602778+0000","last_clean":"2024-09-12T01:03:59.602778+0000","last_became_active":"2024-09-12T00:38:10.717358+0000","last_became_peered":"2024-09-12T00:38:10.717358+0000","last_unstale":"2024-09-12T01:03:59.602778+0000","last_undegraded":"2024-09-12T01:03:59.602778+0000","last_fullsized":"2024-09-12T01:03:59.602778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:56.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.593987+0000","last_change":"2024-09-12T00:38:07.639460+0000","last_active":"2024-09-12T01:04:44.593987+0000","last_peered":"2024-09-12T01:04:44.593987+0000","last_clean":"2024-09-12T01:04:44.593987+0000","last_became_active":"2024-09-12T00:38:07.638712+0000","last_became_peered":"2024-09-12T00:38:07.638712+0000","last_unstale":"2024-09-12T01:04:44.593987+0000","last_undegraded":"2024-09-12T01:04:44.593987+0000","last_fullsized":"2024-09-12T01:04:44.593987+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:01.987566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'20","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.646910+0000","last_change":"2024-09-12T00:36:37.224823+0000","last_active":"2024-09-12T01:03:20.646910+0000","last_peered":"2024-09-12T01:03:20.646910+0000","last_clean":"2024-09-12T01:03:20.646910+0000","last_became_active":"2024-09-12T00:36:37.223487+0000","last_became_peered":"2024-09-12T00:36:37.223487+0000","last_unstale":"2024-09-12T01:03:20.646910+0000","last_undegraded":"2024-09-12T01:03:20.646910+0000","last_fullsized":"2024-09-12T01:03:20.646910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.907220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":70,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.733136+0000","last_change":"2024-09-12T00:49:10.612000+0000","last_active":"2024-09-12T01:03:09.733136+0000","last_peered":"2024-09-12T01:03:09.733136+0000","last_clean":"2024-09-12T01:03:09.733136+0000","last_became_active":"2024-09-12T00:49:10.611251+0000","last_became_peered":"2024-09-12T00:49:10.611251+0000","last_unstale":"2024-09-12T01:03:09.733136+0000","last_undegraded":"2024-09-12T01:03:09.733136+0000","last_fullsized":"2024-09-12T01:03:09.733136+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:41.354887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.558277+0000","last_change":"2024-09-12T00:38:10.707668+0000","last_active":"2024-09-12T01:07:26.558277+0000","last_peered":"2024-09-12T01:07:26.558277+0000","last_clean":"2024-09-12T01:07:26.558277+0000","last_became_active":"2024-09-12T00:38:10.706726+0000","last_became_peered":"2024-09-12T00:38:10.706726+0000","last_unstale":"2024-09-12T01:07:26.558277+0000","last_undegraded":"2024-09-12T01:07:26.558277+0000","last_fullsized":"2024-09-12T01:07:26.558277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:45.954816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321211+0000","last_change":"2024-09-12T00:38:07.668470+0000","last_active":"2024-09-12T01:07:26.321211+0000","last_peered":"2024-09-12T01:07:26.321211+0000","last_clean":"2024-09-12T01:07:26.321211+0000","last_became_active":"2024-09-12T00:38:07.667724+0000","last_became_peered":"2024-09-12T00:38:07.667724+0000","last_unstale":"2024-09-12T01:07:26.321211+0000","last_undegraded":"2024-09-12T01:07:26.321211+0000","last_fullsized":"2024-09-12T01:07:26.321211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:20.409038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'49","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.780052+0000","last_change":"2024-09-12T00:36:37.244938+0000","last_active":"2024-09-12T01:04:57.780052+0000","last_peered":"2024-09-12T01:04:57.780052+0000","last_clean":"2024-09-12T01:04:57.780052+0000","last_became_active":"2024-09-12T00:36:37.244259+0000","last_became_peered":"2024-09-12T00:36:37.244259+0000","last_unstale":"2024-09-12T01:04:57.780052+0000","last_undegraded":"2024-09-12T01:04:57.780052+0000","last_fullsized":"2024-09-12T01:04:57.780052+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.194885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":182,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.574047+0000","last_change":"2024-09-12T00:49:10.630411+0000","last_active":"2024-09-12T01:03:14.574047+0000","last_peered":"2024-09-12T01:03:14.574047+0000","last_clean":"2024-09-12T01:03:14.574047+0000","last_became_active":"2024-09-12T00:49:10.629746+0000","last_became_peered":"2024-09-12T00:49:10.629746+0000","last_unstale":"2024-09-12T01:03:14.574047+0000","last_undegraded":"2024-09-12T01:03:14.574047+0000","last_fullsized":"2024-09-12T01:03:14.574047+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:10.415361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.595049+0000","last_change":"2024-09-12T00:38:10.696938+0000","last_active":"2024-09-12T01:04:49.595049+0000","last_peered":"2024-09-12T01:04:49.595049+0000","last_clean":"2024-09-12T01:04:49.595049+0000","last_became_active":"2024-09-12T00:38:10.695688+0000","last_became_peered":"2024-09-12T00:38:10.695688+0000","last_unstale":"2024-09-12T01:04:49.595049+0000","last_undegraded":"2024-09-12T01:04:49.595049+0000","last_fullsized":"2024-09-12T01:04:49.595049+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:07.485587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.614081+0000","last_change":"2024-09-12T00:38:07.647799+0000","last_active":"2024-09-12T01:04:44.614081+0000","last_peered":"2024-09-12T01:04:44.614081+0000","last_clean":"2024-09-12T01:04:44.614081+0000","last_became_active":"2024-09-12T00:38:07.645284+0000","last_became_peered":"2024-09-12T00:38:07.645284+0000","last_unstale":"2024-09-12T01:04:44.614081+0000","last_undegraded":"2024-09-12T01:04:44.614081+0000","last_fullsized":"2024-09-12T01:04:44.614081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:30.146339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.633189+0000","last_change":"2024-09-12T00:36:37.221009+0000","last_active":"2024-09-12T01:04:44.633189+0000","last_peered":"2024-09-12T01:04:44.633189+0000","last_clean":"2024-09-12T01:04:44.633189+0000","last_became_active":"2024-09-12T00:36:37.220195+0000","last_became_peered":"2024-09-12T00:36:37.220195+0000","last_unstale":"2024-09-12T01:04:44.633189+0000","last_undegraded":"2024-09-12T01:04:44.633189+0000","last_fullsized":"2024-09-12T01:04:44.633189+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:56.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":108,"num_write":45,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.599208+0000","last_change":"2024-09-12T00:49:10.615352+0000","last_active":"2024-09-12T01:03:44.599208+0000","last_peered":"2024-09-12T01:03:44.599208+0000","last_clean":"2024-09-12T01:03:44.599208+0000","last_became_active":"2024-09-12T00:49:10.614661+0000","last_became_peered":"2024-09-12T00:49:10.614661+0000","last_unstale":"2024-09-12T01:03:44.599208+0000","last_undegraded":"2024-09-12T01:03:44.599208+0000","last_fullsized":"2024-09-12T01:03:44.599208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:28.781007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.601595+0000","last_change":"2024-09-12T00:38:10.704123+0000","last_active":"2024-09-12T01:03:54.601595+0000","last_peered":"2024-09-12T01:03:54.601595+0000","last_clean":"2024-09-12T01:03:54.601595+0000","last_became_active":"2024-09-12T00:38:10.702260+0000","last_became_peered":"2024-09-12T00:38:10.702260+0000","last_unstale":"2024-09-12T01:03:54.601595+0000","last_undegraded":"2024-09-12T01:03:54.601595+0000","last_fullsized":"2024-09-12T01:03:54.601595+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:52.661395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763803+0000","last_change":"2024-09-12T00:38:07.640472+0000","last_active":"2024-09-12T01:03:49.763803+0000","last_peered":"2024-09-12T01:03:49.763803+0000","last_clean":"2024-09-12T01:03:49.763803+0000","last_became_active":"2024-09-12T00:38:07.639687+0000","last_became_peered":"2024-09-12T00:38:07.639687+0000","last_unstale":"2024-09-12T01:03:49.763803+0000","last_undegraded":"2024-09-12T01:03:49.763803+0000","last_fullsized":"2024-09-12T01:03:49.763803+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:58.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'52","reported_seq":183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.631949+0000","last_change":"2024-09-12T00:36:37.241171+0000","last_active":"2024-09-12T01:04:39.631949+0000","last_peered":"2024-09-12T01:04:39.631949+0000","last_clean":"2024-09-12T01:04:39.631949+0000","last_became_active":"2024-09-12T00:36:37.239844+0000","last_became_peered":"2024-09-12T00:36:37.239844+0000","last_unstale":"2024-09-12T01:04:39.631949+0000","last_undegraded":"2024-09-12T01:04:39.631949+0000","last_fullsized":"2024-09-12T01:04:39.631949+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:34.727635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":188,"num_write":97,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574686+0000","last_change":"2024-09-12T00:49:10.632954+0000","last_active":"2024-09-12T01:03:44.574686+0000","last_peered":"2024-09-12T01:03:44.574686+0000","last_clean":"2024-09-12T01:03:44.574686+0000","last_became_active":"2024-09-12T00:49:10.632241+0000","last_became_peered":"2024-09-12T00:49:10.632241+0000","last_unstale":"2024-09-12T01:03:44.574686+0000","last_undegraded":"2024-09-12T01:03:44.574686+0000","last_fullsized":"2024-09-12T01:03:44.574686+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:12.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"267'4","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.601460+0000","last_change":"2024-09-12T00:38:10.714497+0000","last_active":"2024-09-12T01:03:54.601460+0000","last_peered":"2024-09-12T01:03:54.601460+0000","last_clean":"2024-09-12T01:03:54.601460+0000","last_became_active":"2024-09-12T00:38:10.713890+0000","last_became_peered":"2024-09-12T00:38:10.713890+0000","last_unstale":"2024-09-12T01:03:54.601460+0000","last_undegraded":"2024-09-12T01:03:54.601460+0000","last_fullsized":"2024-09-12T01:03:54.601460+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.839866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600291+0000","last_change":"2024-09-12T00:38:07.667759+0000","last_active":"2024-09-12T01:03:49.600291+0000","last_peered":"2024-09-12T01:03:49.600291+0000","last_clean":"2024-09-12T01:03:49.600291+0000","last_became_active":"2024-09-12T00:38:07.667180+0000","last_became_peered":"2024-09-12T00:38:07.667180+0000","last_unstale":"2024-09-12T01:03:49.600291+0000","last_undegraded":"2024-09-12T01:03:49.600291+0000","last_fullsized":"2024-09-12T01:03:49.600291+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.515772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'23","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.592102+0000","last_change":"2024-09-12T00:36:37.253314+0000","last_active":"2024-09-12T01:04:38.592102+0000","last_peered":"2024-09-12T01:04:38.592102+0000","last_clean":"2024-09-12T01:04:38.592102+0000","last_became_active":"2024-09-12T00:36:37.248733+0000","last_became_peered":"2024-09-12T00:36:37.248733+0000","last_unstale":"2024-09-12T01:04:38.592102+0000","last_undegraded":"2024-09-12T01:04:38.592102+0000","last_fullsized":"2024-09-12T01:04:38.592102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.498855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.568017+0000","last_change":"2024-09-12T00:49:10.639305+0000","last_active":"2024-09-12T01:03:19.568017+0000","last_peered":"2024-09-12T01:03:19.568017+0000","last_clean":"2024-09-12T01:03:19.568017+0000","last_became_active":"2024-09-12T00:49:10.638628+0000","last_became_peered":"2024-09-12T00:49:10.638628+0000","last_unstale":"2024-09-12T01:03:19.568017+0000","last_undegraded":"2024-09-12T01:03:19.568017+0000","last_fullsized":"2024-09-12T01:03:19.568017+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:12.353339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.582007+0000","last_change":"2024-09-12T00:38:10.691801+0000","last_active":"2024-09-12T01:03:53.582007+0000","last_peered":"2024-09-12T01:03:53.582007+0000","last_clean":"2024-09-12T01:03:53.582007+0000","last_became_active":"2024-09-12T00:38:10.691129+0000","last_became_peered":"2024-09-12T00:38:10.691129+0000","last_unstale":"2024-09-12T01:03:53.582007+0000","last_undegraded":"2024-09-12T01:03:53.582007+0000","last_fullsized":"2024-09-12T01:03:53.582007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:27.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763900+0000","last_change":"2024-09-12T00:38:07.642523+0000","last_active":"2024-09-12T01:03:49.763900+0000","last_peered":"2024-09-12T01:03:49.763900+0000","last_clean":"2024-09-12T01:03:49.763900+0000","last_became_active":"2024-09-12T00:38:07.641719+0000","last_became_peered":"2024-09-12T00:38:07.641719+0000","last_unstale":"2024-09-12T01:03:49.763900+0000","last_undegraded":"2024-09-12T01:03:49.763900+0000","last_fullsized":"2024-09-12T01:03:49.763900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.330959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'60","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.754899+0000","last_change":"2024-09-12T00:36:37.224160+0000","last_active":"2024-09-12T01:04:39.754899+0000","last_peered":"2024-09-12T01:04:39.754899+0000","last_clean":"2024-09-12T01:04:39.754899+0000","last_became_active":"2024-09-12T00:36:37.223432+0000","last_became_peered":"2024-09-12T00:36:37.223432+0000","last_unstale":"2024-09-12T01:04:39.754899+0000","last_undegraded":"2024-09-12T01:04:39.754899+0000","last_fullsized":"2024-09-12T01:04:39.754899+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:13.061629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":212,"num_write":101,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574626+0000","last_change":"2024-09-12T00:49:10.635230+0000","last_active":"2024-09-12T01:03:44.574626+0000","last_peered":"2024-09-12T01:03:44.574626+0000","last_clean":"2024-09-12T01:03:44.574626+0000","last_became_active":"2024-09-12T00:49:10.634783+0000","last_became_peered":"2024-09-12T00:49:10.634783+0000","last_unstale":"2024-09-12T01:03:44.574626+0000","last_undegraded":"2024-09-12T01:03:44.574626+0000","last_fullsized":"2024-09-12T01:03:44.574626+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:22.424861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619873+0000","last_change":"2024-09-12T00:38:10.709528+0000","last_active":"2024-09-12T01:03:54.619873+0000","last_peered":"2024-09-12T01:03:54.619873+0000","last_clean":"2024-09-12T01:03:54.619873+0000","last_became_active":"2024-09-12T00:38:10.708687+0000","last_became_peered":"2024-09-12T00:38:10.708687+0000","last_unstale":"2024-09-12T01:03:54.619873+0000","last_undegraded":"2024-09-12T01:03:54.619873+0000","last_fullsized":"2024-09-12T01:03:54.619873+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.079976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763955+0000","last_change":"2024-09-12T00:38:07.637056+0000","last_active":"2024-09-12T01:03:49.763955+0000","last_peered":"2024-09-12T01:03:49.763955+0000","last_clean":"2024-09-12T01:03:49.763955+0000","last_became_active":"2024-09-12T00:38:07.636298+0000","last_became_peered":"2024-09-12T00:38:07.636298+0000","last_unstale":"2024-09-12T01:03:49.763955+0000","last_undegraded":"2024-09-12T01:03:49.763955+0000","last_fullsized":"2024-09-12T01:03:49.763955+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.591991+0000","last_change":"2024-09-12T00:36:37.253687+0000","last_active":"2024-09-12T01:04:38.591991+0000","last_peered":"2024-09-12T01:04:38.591991+0000","last_clean":"2024-09-12T01:04:38.591991+0000","last_became_active":"2024-09-12T00:36:37.248770+0000","last_became_peered":"2024-09-12T00:36:37.248770+0000","last_unstale":"2024-09-12T01:04:38.591991+0000","last_undegraded":"2024-09-12T01:04:38.591991+0000","last_fullsized":"2024-09-12T01:04:38.591991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.878928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":141,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609918+0000","last_change":"2024-09-12T00:49:10.597538+0000","last_active":"2024-09-12T01:04:29.609918+0000","last_peered":"2024-09-12T01:04:29.609918+0000","last_clean":"2024-09-12T01:04:29.609918+0000","last_became_active":"2024-09-12T00:49:10.596695+0000","last_became_peered":"2024-09-12T00:49:10.596695+0000","last_unstale":"2024-09-12T01:04:29.609918+0000","last_undegraded":"2024-09-12T01:04:29.609918+0000","last_fullsized":"2024-09-12T01:04:29.609918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:51.074598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600399+0000","last_change":"2024-09-12T00:38:10.683836+0000","last_active":"2024-09-12T01:05:13.600399+0000","last_peered":"2024-09-12T01:05:13.600399+0000","last_clean":"2024-09-12T01:05:13.600399+0000","last_became_active":"2024-09-12T00:38:10.683024+0000","last_became_peered":"2024-09-12T00:38:10.683024+0000","last_unstale":"2024-09-12T01:05:13.600399+0000","last_undegraded":"2024-09-12T01:05:13.600399+0000","last_fullsized":"2024-09-12T01:05:13.600399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:08.556147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.761594+0000","last_change":"2024-09-12T00:38:07.664050+0000","last_active":"2024-09-12T01:05:09.761594+0000","last_peered":"2024-09-12T01:05:09.761594+0000","last_clean":"2024-09-12T01:05:09.761594+0000","last_became_active":"2024-09-12T00:38:07.663265+0000","last_became_peered":"2024-09-12T00:38:07.663265+0000","last_unstale":"2024-09-12T01:05:09.761594+0000","last_undegraded":"2024-09-12T01:05:09.761594+0000","last_fullsized":"2024-09-12T01:05:09.761594+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:28.984997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'15","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.579861+0000","last_change":"2024-09-12T00:36:37.248079+0000","last_active":"2024-09-12T01:03:43.579861+0000","last_peered":"2024-09-12T01:03:43.579861+0000","last_clean":"2024-09-12T01:03:43.579861+0000","last_became_active":"2024-09-12T00:36:37.247409+0000","last_became_peered":"2024-09-12T00:36:37.247409+0000","last_unstale":"2024-09-12T01:03:43.579861+0000","last_undegraded":"2024-09-12T01:03:43.579861+0000","last_fullsized":"2024-09-12T01:03:43.579861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:04.933898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":52,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.779758+0000","last_change":"2024-09-12T00:49:10.594239+0000","last_active":"2024-09-12T01:04:59.779758+0000","last_peered":"2024-09-12T01:04:59.779758+0000","last_clean":"2024-09-12T01:04:59.779758+0000","last_became_active":"2024-09-12T00:49:10.593471+0000","last_became_peered":"2024-09-12T00:49:10.593471+0000","last_unstale":"2024-09-12T01:04:59.779758+0000","last_undegraded":"2024-09-12T01:04:59.779758+0000","last_fullsized":"2024-09-12T01:04:59.779758+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:54.840220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"267'4","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321277+0000","last_change":"2024-09-12T00:38:10.709654+0000","last_active":"2024-09-12T01:07:26.321277+0000","last_peered":"2024-09-12T01:07:26.321277+0000","last_clean":"2024-09-12T01:07:26.321277+0000","last_became_active":"2024-09-12T00:38:10.708936+0000","last_became_peered":"2024-09-12T00:38:10.708936+0000","last_unstale":"2024-09-12T01:07:26.321277+0000","last_undegraded":"2024-09-12T01:07:26.321277+0000","last_fullsized":"2024-09-12T01:07:26.321277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:34.439374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'6","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.594403+0000","last_change":"2024-09-12T00:38:07.651137+0000","last_active":"2024-09-12T01:05:09.594403+0000","last_peered":"2024-09-12T01:05:09.594403+0000","last_clean":"2024-09-12T01:05:09.594403+0000","last_became_active":"2024-09-12T00:38:07.650419+0000","last_became_peered":"2024-09-12T00:38:07.650419+0000","last_unstale":"2024-09-12T01:05:09.594403+0000","last_undegraded":"2024-09-12T01:05:09.594403+0000","last_fullsized":"2024-09-12T01:05:09.594403+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.557871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'98","reported_seq":352,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.615890+0000","last_change":"2024-09-12T00:36:37.227751+0000","last_active":"2024-09-12T01:03:39.615890+0000","last_peered":"2024-09-12T01:03:39.615890+0000","last_clean":"2024-09-12T01:03:39.615890+0000","last_became_active":"2024-09-12T00:36:37.225615+0000","last_became_peered":"2024-09-12T00:36:37.225615+0000","last_unstale":"2024-09-12T01:03:39.615890+0000","last_undegraded":"2024-09-12T01:03:39.615890+0000","last_fullsized":"2024-09-12T01:03:39.615890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:24.078167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":608,"num_read_kb":444,"num_write":119,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626251+0000","last_change":"2024-09-12T00:49:10.620839+0000","last_active":"2024-09-12T01:04:19.626251+0000","last_peered":"2024-09-12T01:04:19.626251+0000","last_clean":"2024-09-12T01:04:19.626251+0000","last_became_active":"2024-09-12T00:49:10.620169+0000","last_became_peered":"2024-09-12T00:49:10.620169+0000","last_unstale":"2024-09-12T01:04:19.626251+0000","last_undegraded":"2024-09-12T01:04:19.626251+0000","last_fullsized":"2024-09-12T01:04:19.626251+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.688639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.570450+0000","last_change":"2024-09-12T00:38:10.686990+0000","last_active":"2024-09-12T01:03:03.570450+0000","last_peered":"2024-09-12T01:03:03.570450+0000","last_clean":"2024-09-12T01:03:03.570450+0000","last_became_active":"2024-09-12T00:38:10.686216+0000","last_became_peered":"2024-09-12T00:38:10.686216+0000","last_unstale":"2024-09-12T01:03:03.570450+0000","last_undegraded":"2024-09-12T01:03:03.570450+0000","last_fullsized":"2024-09-12T01:03:03.570450+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:24.592600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"267'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.431292+0000","last_change":"2024-09-12T00:38:07.666660+0000","last_active":"2024-09-12T01:07:23.431292+0000","last_peered":"2024-09-12T01:07:23.431292+0000","last_clean":"2024-09-12T01:07:23.431292+0000","last_became_active":"2024-09-12T00:38:07.661932+0000","last_became_peered":"2024-09-12T00:38:07.661932+0000","last_unstale":"2024-09-12T01:07:23.431292+0000","last_undegraded":"2024-09-12T01:07:23.431292+0000","last_fullsized":"2024-09-12T01:07:23.431292+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:30.080552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'12","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.761390+0000","last_change":"2024-09-12T00:36:37.227779+0000","last_active":"2024-09-12T01:03:39.761390+0000","last_peered":"2024-09-12T01:03:39.761390+0000","last_clean":"2024-09-12T01:03:39.761390+0000","last_became_active":"2024-09-12T00:36:37.226992+0000","last_became_peered":"2024-09-12T00:36:37.226992+0000","last_unstale":"2024-09-12T01:03:39.761390+0000","last_undegraded":"2024-09-12T01:03:39.761390+0000","last_fullsized":"2024-09-12T01:03:39.761390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.657729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.771859+0000","last_change":"2024-09-12T00:49:10.598218+0000","last_active":"2024-09-12T01:04:24.771859+0000","last_peered":"2024-09-12T01:04:24.771859+0000","last_clean":"2024-09-12T01:04:24.771859+0000","last_became_active":"2024-09-12T00:49:10.597349+0000","last_became_peered":"2024-09-12T00:49:10.597349+0000","last_unstale":"2024-09-12T01:04:24.771859+0000","last_undegraded":"2024-09-12T01:04:24.771859+0000","last_fullsized":"2024-09-12T01:04:24.771859+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:32.342356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"267'10","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.587835+0000","last_change":"2024-09-12T00:38:10.701647+0000","last_active":"2024-09-12T01:02:59.587835+0000","last_peered":"2024-09-12T01:02:59.587835+0000","last_clean":"2024-09-12T01:02:59.587835+0000","last_became_active":"2024-09-12T00:38:10.700892+0000","last_became_peered":"2024-09-12T00:38:10.700892+0000","last_unstale":"2024-09-12T01:02:59.587835+0000","last_undegraded":"2024-09-12T01:02:59.587835+0000","last_fullsized":"2024-09-12T01:02:59.587835+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:36.388849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":15,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.569267+0000","last_change":"2024-09-12T00:38:07.643675+0000","last_active":"2024-09-12T01:02:58.569267+0000","last_peered":"2024-09-12T01:02:58.569267+0000","last_clean":"2024-09-12T01:02:58.569267+0000","last_became_active":"2024-09-12T00:38:07.642924+0000","last_became_peered":"2024-09-12T00:38:07.642924+0000","last_unstale":"2024-09-12T01:02:58.569267+0000","last_undegraded":"2024-09-12T01:02:58.569267+0000","last_fullsized":"2024-09-12T01:02:58.569267+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:03.027647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'31","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573415+0000","last_change":"2024-09-12T00:36:37.243786+0000","last_active":"2024-09-12T01:03:39.573415+0000","last_peered":"2024-09-12T01:03:39.573415+0000","last_clean":"2024-09-12T01:03:39.573415+0000","last_became_active":"2024-09-12T00:36:37.238481+0000","last_became_peered":"2024-09-12T00:36:37.238481+0000","last_unstale":"2024-09-12T01:03:39.573415+0000","last_undegraded":"2024-09-12T01:03:39.573415+0000","last_fullsized":"2024-09-12T01:03:39.573415+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:15.555438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":121,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.617607+0000","last_change":"2024-09-12T00:49:10.614315+0000","last_active":"2024-09-12T01:04:59.617607+0000","last_peered":"2024-09-12T01:04:59.617607+0000","last_clean":"2024-09-12T01:04:59.617607+0000","last_became_active":"2024-09-12T00:49:10.613613+0000","last_became_peered":"2024-09-12T00:49:10.613613+0000","last_unstale":"2024-09-12T01:04:59.617607+0000","last_undegraded":"2024-09-12T01:04:59.617607+0000","last_fullsized":"2024-09-12T01:04:59.617607+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:45.422915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.624836+0000","last_change":"2024-09-12T00:38:10.695438+0000","last_active":"2024-09-12T01:04:14.624836+0000","last_peered":"2024-09-12T01:04:14.624836+0000","last_clean":"2024-09-12T01:04:14.624836+0000","last_became_active":"2024-09-12T00:38:10.694714+0000","last_became_peered":"2024-09-12T00:38:10.694714+0000","last_unstale":"2024-09-12T01:04:14.624836+0000","last_undegraded":"2024-09-12T01:04:14.624836+0000","last_fullsized":"2024-09-12T01:04:14.624836+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:46.770976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852962+0000","last_change":"2024-09-12T00:38:07.653886+0000","last_active":"2024-09-12T01:07:25.852962+0000","last_peered":"2024-09-12T01:07:25.852962+0000","last_clean":"2024-09-12T01:07:25.852962+0000","last_became_active":"2024-09-12T00:38:07.647225+0000","last_became_peered":"2024-09-12T00:38:07.647225+0000","last_unstale":"2024-09-12T01:07:25.852962+0000","last_undegraded":"2024-09-12T01:07:25.852962+0000","last_fullsized":"2024-09-12T01:07:25.852962+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:14.958030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'12","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573328+0000","last_change":"2024-09-12T00:36:37.249508+0000","last_active":"2024-09-12T01:03:39.573328+0000","last_peered":"2024-09-12T01:03:39.573328+0000","last_clean":"2024-09-12T01:03:39.573328+0000","last_became_active":"2024-09-12T00:36:37.246075+0000","last_became_peered":"2024-09-12T00:36:37.246075+0000","last_unstale":"2024-09-12T01:03:39.573328+0000","last_undegraded":"2024-09-12T01:03:39.573328+0000","last_fullsized":"2024-09-12T01:03:39.573328+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:45.712512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.759397+0000","last_change":"2024-09-12T00:49:10.598511+0000","last_active":"2024-09-12T01:04:59.759397+0000","last_peered":"2024-09-12T01:04:59.759397+0000","last_clean":"2024-09-12T01:04:59.759397+0000","last_became_active":"2024-09-12T00:49:10.597773+0000","last_became_peered":"2024-09-12T00:49:10.597773+0000","last_unstale":"2024-09-12T01:04:59.759397+0000","last_undegraded":"2024-09-12T01:04:59.759397+0000","last_fullsized":"2024-09-12T01:04:59.759397+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:51.989977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749157+0000","last_change":"2024-09-12T00:38:10.698369+0000","last_active":"2024-09-12T01:04:14.749157+0000","last_peered":"2024-09-12T01:04:14.749157+0000","last_clean":"2024-09-12T01:04:14.749157+0000","last_became_active":"2024-09-12T00:38:10.697403+0000","last_became_peered":"2024-09-12T00:38:10.697403+0000","last_unstale":"2024-09-12T01:04:14.749157+0000","last_undegraded":"2024-09-12T01:04:14.749157+0000","last_fullsized":"2024-09-12T01:04:14.749157+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:19.999588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.605162+0000","last_change":"2024-09-12T00:38:07.668475+0000","last_active":"2024-09-12T01:04:09.605162+0000","last_peered":"2024-09-12T01:04:09.605162+0000","last_clean":"2024-09-12T01:04:09.605162+0000","last_became_active":"2024-09-12T00:38:07.667447+0000","last_became_peered":"2024-09-12T00:38:07.667447+0000","last_unstale":"2024-09-12T01:04:09.605162+0000","last_undegraded":"2024-09-12T01:04:09.605162+0000","last_fullsized":"2024-09-12T01:04:09.605162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:23.306315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.758150+0000","last_change":"2024-09-12T00:36:37.240933+0000","last_active":"2024-09-12T01:04:54.758150+0000","last_peered":"2024-09-12T01:04:54.758150+0000","last_clean":"2024-09-12T01:04:54.758150+0000","last_became_active":"2024-09-12T00:36:37.239946+0000","last_became_peered":"2024-09-12T00:36:37.239946+0000","last_unstale":"2024-09-12T01:04:54.758150+0000","last_undegraded":"2024-09-12T01:04:54.758150+0000","last_fullsized":"2024-09-12T01:04:54.758150+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:57.116646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.597511+0000","last_change":"2024-09-12T00:49:10.630825+0000","last_active":"2024-09-12T01:04:59.597511+0000","last_peered":"2024-09-12T01:04:59.597511+0000","last_clean":"2024-09-12T01:04:59.597511+0000","last_became_active":"2024-09-12T00:49:10.629903+0000","last_became_peered":"2024-09-12T00:49:10.629903+0000","last_unstale":"2024-09-12T01:04:59.597511+0000","last_undegraded":"2024-09-12T01:04:59.597511+0000","last_fullsized":"2024-09-12T01:04:59.597511+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:07.324326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.564338+0000","last_change":"2024-09-12T00:38:10.714505+0000","last_active":"2024-09-12T01:02:59.564338+0000","last_peered":"2024-09-12T01:02:59.564338+0000","last_clean":"2024-09-12T01:02:59.564338+0000","last_became_active":"2024-09-12T00:38:10.708820+0000","last_became_peered":"2024-09-12T00:38:10.708820+0000","last_unstale":"2024-09-12T01:02:59.564338+0000","last_undegraded":"2024-09-12T01:02:59.564338+0000","last_fullsized":"2024-09-12T01:02:59.564338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:21.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'2","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:28.418371+0000","last_change":"2024-09-12T00:38:07.645572+0000","last_active":"2024-09-12T01:06:28.418371+0000","last_peered":"2024-09-12T01:06:28.418371+0000","last_clean":"2024-09-12T01:06:28.418371+0000","last_became_active":"2024-09-12T00:38:07.644752+0000","last_became_peered":"2024-09-12T00:38:07.644752+0000","last_unstale":"2024-09-12T01:06:28.418371+0000","last_undegraded":"2024-09-12T01:06:28.418371+0000","last_fullsized":"2024-09-12T01:06:28.418371+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:27.156732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"267'56","reported_seq":202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.615105+0000","last_change":"2024-09-12T00:36:37.247146+0000","last_active":"2024-09-12T01:04:49.615105+0000","last_peered":"2024-09-12T01:04:49.615105+0000","last_clean":"2024-09-12T01:04:49.615105+0000","last_became_active":"2024-09-12T00:36:37.246402+0000","last_became_peered":"2024-09-12T00:36:37.246402+0000","last_unstale":"2024-09-12T01:04:49.615105+0000","last_undegraded":"2024-09-12T01:04:49.615105+0000","last_fullsized":"2024-09-12T01:04:49.615105+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:50.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":211,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.597068+0000","last_change":"2024-09-12T00:49:10.627636+0000","last_active":"2024-09-12T01:04:58.597068+0000","last_peered":"2024-09-12T01:04:58.597068+0000","last_clean":"2024-09-12T01:04:58.597068+0000","last_became_active":"2024-09-12T00:49:10.626918+0000","last_became_peered":"2024-09-12T00:49:10.626918+0000","last_unstale":"2024-09-12T01:04:58.597068+0000","last_undegraded":"2024-09-12T01:04:58.597068+0000","last_fullsized":"2024-09-12T01:04:58.597068+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.462430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"267'6","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.588407+0000","last_change":"2024-09-12T00:38:10.706342+0000","last_active":"2024-09-12T01:04:19.588407+0000","last_peered":"2024-09-12T01:04:19.588407+0000","last_clean":"2024-09-12T01:04:19.588407+0000","last_became_active":"2024-09-12T00:38:10.705817+0000","last_became_peered":"2024-09-12T00:38:10.705817+0000","last_unstale":"2024-09-12T01:04:19.588407+0000","last_undegraded":"2024-09-12T01:04:19.588407+0000","last_fullsized":"2024-09-12T01:04:19.588407+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:39.296427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.639322+0000","last_change":"2024-09-12T00:38:07.655064+0000","last_active":"2024-09-12T01:05:09.639322+0000","last_peered":"2024-09-12T01:05:09.639322+0000","last_clean":"2024-09-12T01:05:09.639322+0000","last_became_active":"2024-09-12T00:38:07.654306+0000","last_became_peered":"2024-09-12T00:38:07.654306+0000","last_unstale":"2024-09-12T01:05:09.639322+0000","last_undegraded":"2024-09-12T01:05:09.639322+0000","last_fullsized":"2024-09-12T01:05:09.639322+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:13.318498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'60","reported_seq":249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.594897+0000","last_change":"2024-09-12T00:36:37.227571+0000","last_active":"2024-09-12T01:04:49.594897+0000","last_peered":"2024-09-12T01:04:49.594897+0000","last_clean":"2024-09-12T01:04:49.594897+0000","last_became_active":"2024-09-12T00:36:37.226845+0000","last_became_peered":"2024-09-12T00:36:37.226845+0000","last_unstale":"2024-09-12T01:04:49.594897+0000","last_undegraded":"2024-09-12T01:04:49.594897+0000","last_fullsized":"2024-09-12T01:04:49.594897+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.611933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":408,"num_read_kb":294,"num_write":66,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582015+0000","last_change":"2024-09-12T00:49:10.623449+0000","last_active":"2024-09-12T01:03:49.582015+0000","last_peered":"2024-09-12T01:03:49.582015+0000","last_clean":"2024-09-12T01:03:49.582015+0000","last_became_active":"2024-09-12T00:49:10.615566+0000","last_became_peered":"2024-09-12T00:49:10.615566+0000","last_unstale":"2024-09-12T01:03:49.582015+0000","last_undegraded":"2024-09-12T01:03:49.582015+0000","last_fullsized":"2024-09-12T01:03:49.582015+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:25.428504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'6","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.592823+0000","last_change":"2024-09-12T00:38:10.705943+0000","last_active":"2024-09-12T01:03:19.592823+0000","last_peered":"2024-09-12T01:03:19.592823+0000","last_clean":"2024-09-12T01:03:19.592823+0000","last_became_active":"2024-09-12T00:38:10.705207+0000","last_became_peered":"2024-09-12T00:38:10.705207+0000","last_unstale":"2024-09-12T01:03:19.592823+0000","last_undegraded":"2024-09-12T01:03:19.592823+0000","last_fullsized":"2024-09-12T01:03:19.592823+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:44.933546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'9","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640614+0000","last_change":"2024-09-12T00:38:07.663618+0000","last_active":"2024-09-12T01:05:14.640614+0000","last_peered":"2024-09-12T01:05:14.640614+0000","last_clean":"2024-09-12T01:05:14.640614+0000","last_became_active":"2024-09-12T00:38:07.663031+0000","last_became_peered":"2024-09-12T00:38:07.663031+0000","last_unstale":"2024-09-12T01:05:14.640614+0000","last_undegraded":"2024-09-12T01:05:14.640614+0000","last_fullsized":"2024-09-12T01:05:14.640614+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.928917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'40","reported_seq":152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587717+0000","last_change":"2024-09-12T00:36:37.251472+0000","last_active":"2024-09-12T01:04:49.587717+0000","last_peered":"2024-09-12T01:04:49.587717+0000","last_clean":"2024-09-12T01:04:49.587717+0000","last_became_active":"2024-09-12T00:36:37.250649+0000","last_became_peered":"2024-09-12T00:36:37.250649+0000","last_unstale":"2024-09-12T01:04:49.587717+0000","last_undegraded":"2024-09-12T01:04:49.587717+0000","last_fullsized":"2024-09-12T01:04:49.587717+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:22.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":70,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582037+0000","last_change":"2024-09-12T00:49:10.634985+0000","last_active":"2024-09-12T01:03:49.582037+0000","last_peered":"2024-09-12T01:03:49.582037+0000","last_clean":"2024-09-12T01:03:49.582037+0000","last_became_active":"2024-09-12T00:49:10.634433+0000","last_became_peered":"2024-09-12T00:49:10.634433+0000","last_unstale":"2024-09-12T01:03:49.582037+0000","last_undegraded":"2024-09-12T01:03:49.582037+0000","last_fullsized":"2024-09-12T01:03:49.582037+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:02.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622352+0000","last_change":"2024-09-12T00:38:10.718774+0000","last_active":"2024-09-12T01:05:19.622352+0000","last_peered":"2024-09-12T01:05:19.622352+0000","last_clean":"2024-09-12T01:05:19.622352+0000","last_became_active":"2024-09-12T00:38:10.717307+0000","last_became_peered":"2024-09-12T00:38:10.717307+0000","last_unstale":"2024-09-12T01:05:19.622352+0000","last_undegraded":"2024-09-12T01:05:19.622352+0000","last_fullsized":"2024-09-12T01:05:19.622352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:10.837950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.568074+0000","last_change":"2024-09-12T00:38:07.660476+0000","last_active":"2024-09-12T01:03:19.568074+0000","last_peered":"2024-09-12T01:03:19.568074+0000","last_clean":"2024-09-12T01:03:19.568074+0000","last_became_active":"2024-09-12T00:38:07.659692+0000","last_became_peered":"2024-09-12T00:38:07.659692+0000","last_unstale":"2024-09-12T01:03:19.568074+0000","last_undegraded":"2024-09-12T01:03:19.568074+0000","last_fullsized":"2024-09-12T01:03:19.568074+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:05.518531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'22","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.817272+0000","last_change":"2024-09-12T00:36:37.228455+0000","last_active":"2024-09-12T01:05:02.817272+0000","last_peered":"2024-09-12T01:05:02.817272+0000","last_clean":"2024-09-12T01:05:02.817272+0000","last_became_active":"2024-09-12T00:36:37.226892+0000","last_became_peered":"2024-09-12T00:36:37.226892+0000","last_unstale":"2024-09-12T01:05:02.817272+0000","last_undegraded":"2024-09-12T01:05:02.817272+0000","last_fullsized":"2024-09-12T01:05:02.817272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:09.675401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622226+0000","last_change":"2024-09-12T00:49:10.632589+0000","last_active":"2024-09-12T01:05:19.622226+0000","last_peered":"2024-09-12T01:05:19.622226+0000","last_clean":"2024-09-12T01:05:19.622226+0000","last_became_active":"2024-09-12T00:49:10.631961+0000","last_became_peered":"2024-09-12T00:49:10.631961+0000","last_unstale":"2024-09-12T01:05:19.622226+0000","last_undegraded":"2024-09-12T01:05:19.622226+0000","last_fullsized":"2024-09-12T01:05:19.622226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:28.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587368+0000","last_change":"2024-09-12T00:38:10.719998+0000","last_active":"2024-09-12T01:04:14.587368+0000","last_peered":"2024-09-12T01:04:14.587368+0000","last_clean":"2024-09-12T01:04:14.587368+0000","last_became_active":"2024-09-12T00:38:10.719337+0000","last_became_peered":"2024-09-12T00:38:10.719337+0000","last_unstale":"2024-09-12T01:04:14.587368+0000","last_undegraded":"2024-09-12T01:04:14.587368+0000","last_fullsized":"2024-09-12T01:04:14.587368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:16.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748163+0000","last_change":"2024-09-12T00:38:07.640549+0000","last_active":"2024-09-12T01:04:09.748163+0000","last_peered":"2024-09-12T01:04:09.748163+0000","last_clean":"2024-09-12T01:04:09.748163+0000","last_became_active":"2024-09-12T00:38:07.639751+0000","last_became_peered":"2024-09-12T00:38:07.639751+0000","last_unstale":"2024-09-12T01:04:09.748163+0000","last_undegraded":"2024-09-12T01:04:09.748163+0000","last_fullsized":"2024-09-12T01:04:09.748163+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:17.815510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'40","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743281+0000","last_change":"2024-09-12T00:36:37.248750+0000","last_active":"2024-09-12T01:03:49.743281+0000","last_peered":"2024-09-12T01:03:49.743281+0000","last_clean":"2024-09-12T01:03:49.743281+0000","last_became_active":"2024-09-12T00:36:37.248176+0000","last_became_peered":"2024-09-12T00:36:37.248176+0000","last_unstale":"2024-09-12T01:03:49.743281+0000","last_undegraded":"2024-09-12T01:03:49.743281+0000","last_fullsized":"2024-09-12T01:03:49.743281+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.812968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.616997+0000","last_change":"2024-09-12T00:49:10.635581+0000","last_active":"2024-09-12T01:03:44.616997+0000","last_peered":"2024-09-12T01:03:44.616997+0000","last_clean":"2024-09-12T01:03:44.616997+0000","last_became_active":"2024-09-12T00:49:10.634965+0000","last_became_peered":"2024-09-12T00:49:10.634965+0000","last_unstale":"2024-09-12T01:03:44.616997+0000","last_undegraded":"2024-09-12T01:03:44.616997+0000","last_fullsized":"2024-09-12T01:03:44.616997+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:00.298075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.625230+0000","last_change":"2024-09-12T00:38:10.695802+0000","last_active":"2024-09-12T01:04:14.625230+0000","last_peered":"2024-09-12T01:04:14.625230+0000","last_clean":"2024-09-12T01:04:14.625230+0000","last_became_active":"2024-09-12T00:38:10.694812+0000","last_became_peered":"2024-09-12T00:38:10.694812+0000","last_unstale":"2024-09-12T01:04:14.625230+0000","last_undegraded":"2024-09-12T01:04:14.625230+0000","last_fullsized":"2024-09-12T01:04:14.625230+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:47.266227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'3","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.623622+0000","last_change":"2024-09-12T00:38:07.648782+0000","last_active":"2024-09-12T01:04:09.623622+0000","last_peered":"2024-09-12T01:04:09.623622+0000","last_clean":"2024-09-12T01:04:09.623622+0000","last_became_active":"2024-09-12T00:38:07.648061+0000","last_became_peered":"2024-09-12T00:38:07.648061+0000","last_unstale":"2024-09-12T01:04:09.623622+0000","last_undegraded":"2024-09-12T01:04:09.623622+0000","last_fullsized":"2024-09-12T01:04:09.623622+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:11.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'35","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.768877+0000","last_change":"2024-09-12T00:36:37.244821+0000","last_active":"2024-09-12T01:04:21.768877+0000","last_peered":"2024-09-12T01:04:21.768877+0000","last_clean":"2024-09-12T01:04:21.768877+0000","last_became_active":"2024-09-12T00:36:37.244096+0000","last_became_peered":"2024-09-12T00:36:37.244096+0000","last_unstale":"2024-09-12T01:04:21.768877+0000","last_undegraded":"2024-09-12T01:04:21.768877+0000","last_fullsized":"2024-09-12T01:04:21.768877+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:50.671276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":53,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:23.588773+0000","last_change":"2024-09-12T00:49:10.626675+0000","last_active":"2024-09-12T01:04:23.588773+0000","last_peered":"2024-09-12T01:04:23.588773+0000","last_clean":"2024-09-12T01:04:23.588773+0000","last_became_active":"2024-09-12T00:49:10.621968+0000","last_became_peered":"2024-09-12T00:49:10.621968+0000","last_unstale":"2024-09-12T01:04:23.588773+0000","last_undegraded":"2024-09-12T01:04:23.588773+0000","last_fullsized":"2024-09-12T01:04:23.588773+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.338078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594658+0000","last_change":"2024-09-12T00:38:10.718573+0000","last_active":"2024-09-12T01:05:19.594658+0000","last_peered":"2024-09-12T01:05:19.594658+0000","last_clean":"2024-09-12T01:05:19.594658+0000","last_became_active":"2024-09-12T00:38:10.717877+0000","last_became_peered":"2024-09-12T00:38:10.717877+0000","last_unstale":"2024-09-12T01:05:19.594658+0000","last_undegraded":"2024-09-12T01:05:19.594658+0000","last_fullsized":"2024-09-12T01:05:19.594658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:53.348539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"267'3","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749225+0000","last_change":"2024-09-12T00:38:07.649510+0000","last_active":"2024-09-12T01:04:14.749225+0000","last_peered":"2024-09-12T01:04:14.749225+0000","last_clean":"2024-09-12T01:04:14.749225+0000","last_became_active":"2024-09-12T00:38:07.648786+0000","last_became_peered":"2024-09-12T00:38:07.648786+0000","last_unstale":"2024-09-12T01:04:14.749225+0000","last_undegraded":"2024-09-12T01:04:14.749225+0000","last_fullsized":"2024-09-12T01:04:14.749225+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:57.221376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.741862+0000","last_change":"2024-09-12T00:36:37.238021+0000","last_active":"2024-09-12T01:03:44.741862+0000","last_peered":"2024-09-12T01:03:44.741862+0000","last_clean":"2024-09-12T01:03:44.741862+0000","last_became_active":"2024-09-12T00:36:37.237365+0000","last_became_peered":"2024-09-12T00:36:37.237365+0000","last_unstale":"2024-09-12T01:03:44.741862+0000","last_undegraded":"2024-09-12T01:03:44.741862+0000","last_fullsized":"2024-09-12T01:03:44.741862+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:44.575480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":152,"num_write":73,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.582095+0000","last_change":"2024-09-12T00:49:10.628791+0000","last_active":"2024-09-12T01:04:24.582095+0000","last_peered":"2024-09-12T01:04:24.582095+0000","last_clean":"2024-09-12T01:04:24.582095+0000","last_became_active":"2024-09-12T00:49:10.628111+0000","last_became_peered":"2024-09-12T00:49:10.628111+0000","last_unstale":"2024-09-12T01:04:24.582095+0000","last_undegraded":"2024-09-12T01:04:24.582095+0000","last_fullsized":"2024-09-12T01:04:24.582095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.022373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'3","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626298+0000","last_change":"2024-09-12T00:38:10.702362+0000","last_active":"2024-09-12T01:04:19.626298+0000","last_peered":"2024-09-12T01:04:19.626298+0000","last_clean":"2024-09-12T01:04:19.626298+0000","last_became_active":"2024-09-12T00:38:10.696553+0000","last_became_peered":"2024-09-12T00:38:10.696553+0000","last_unstale":"2024-09-12T01:04:19.626298+0000","last_undegraded":"2024-09-12T01:04:19.626298+0000","last_fullsized":"2024-09-12T01:04:19.626298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:21.987094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145574,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3168,"num_write":3,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'3","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640450+0000","last_change":"2024-09-12T00:38:07.670741+0000","last_active":"2024-09-12T01:05:14.640450+0000","last_peered":"2024-09-12T01:05:14.640450+0000","last_clean":"2024-09-12T01:05:14.640450+0000","last_became_active":"2024-09-12T00:38:07.669959+0000","last_became_peered":"2024-09-12T00:38:07.669959+0000","last_unstale":"2024-09-12T01:05:14.640450+0000","last_undegraded":"2024-09-12T01:05:14.640450+0000","last_fullsized":"2024-09-12T01:05:14.640450+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:21.025381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":96,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617129+0000","last_change":"2024-09-12T00:36:37.229680+0000","last_active":"2024-09-12T01:03:44.617129+0000","last_peered":"2024-09-12T01:03:44.617129+0000","last_clean":"2024-09-12T01:03:44.617129+0000","last_became_active":"2024-09-12T00:36:37.228954+0000","last_became_peered":"2024-09-12T00:36:37.228954+0000","last_unstale":"2024-09-12T01:03:44.617129+0000","last_undegraded":"2024-09-12T01:03:44.617129+0000","last_fullsized":"2024-09-12T01:03:44.617129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:42.010486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600391+0000","last_change":"2024-09-12T00:49:10.593501+0000","last_active":"2024-09-12T01:03:49.600391+0000","last_peered":"2024-09-12T01:03:49.600391+0000","last_clean":"2024-09-12T01:03:49.600391+0000","last_became_active":"2024-09-12T00:49:10.592753+0000","last_became_peered":"2024-09-12T00:49:10.592753+0000","last_unstale":"2024-09-12T01:03:49.600391+0000","last_undegraded":"2024-09-12T01:03:49.600391+0000","last_fullsized":"2024-09-12T01:03:49.600391+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:14.659960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763857+0000","last_change":"2024-09-12T00:38:10.703751+0000","last_active":"2024-09-12T01:05:19.763857+0000","last_peered":"2024-09-12T01:05:19.763857+0000","last_clean":"2024-09-12T01:05:19.763857+0000","last_became_active":"2024-09-12T00:38:10.702958+0000","last_became_peered":"2024-09-12T00:38:10.702958+0000","last_unstale":"2024-09-12T01:05:19.763857+0000","last_undegraded":"2024-09-12T01:05:19.763857+0000","last_fullsized":"2024-09-12T01:05:19.763857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:12.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.595391+0000","last_change":"2024-09-12T00:38:07.650713+0000","last_active":"2024-09-12T01:05:14.595391+0000","last_peered":"2024-09-12T01:05:14.595391+0000","last_clean":"2024-09-12T01:05:14.595391+0000","last_became_active":"2024-09-12T00:38:07.650035+0000","last_became_peered":"2024-09-12T00:38:07.650035+0000","last_unstale":"2024-09-12T01:05:14.595391+0000","last_undegraded":"2024-09-12T01:05:14.595391+0000","last_fullsized":"2024-09-12T01:05:14.595391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.848243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"258'11","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617043+0000","last_change":"2024-09-12T00:36:37.223313+0000","last_active":"2024-09-12T01:03:44.617043+0000","last_peered":"2024-09-12T01:03:44.617043+0000","last_clean":"2024-09-12T01:03:44.617043+0000","last_became_active":"2024-09-12T00:36:37.222545+0000","last_became_peered":"2024-09-12T00:36:37.222545+0000","last_unstale":"2024-09-12T01:03:44.617043+0000","last_undegraded":"2024-09-12T01:03:44.617043+0000","last_fullsized":"2024-09-12T01:03:44.617043+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:28.704973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618658+0000","last_change":"2024-09-12T00:49:10.613325+0000","last_active":"2024-09-12T01:03:49.618658+0000","last_peered":"2024-09-12T01:03:49.618658+0000","last_clean":"2024-09-12T01:03:49.618658+0000","last_became_active":"2024-09-12T00:49:10.612680+0000","last_became_peered":"2024-09-12T00:49:10.612680+0000","last_unstale":"2024-09-12T01:03:49.618658+0000","last_undegraded":"2024-09-12T01:03:49.618658+0000","last_fullsized":"2024-09-12T01:03:49.618658+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.686773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763779+0000","last_change":"2024-09-12T00:38:10.698273+0000","last_active":"2024-09-12T01:05:19.763779+0000","last_peered":"2024-09-12T01:05:19.763779+0000","last_clean":"2024-09-12T01:05:19.763779+0000","last_became_active":"2024-09-12T00:38:10.691107+0000","last_became_peered":"2024-09-12T00:38:10.691107+0000","last_unstale":"2024-09-12T01:05:19.763779+0000","last_undegraded":"2024-09-12T01:05:19.763779+0000","last_fullsized":"2024-09-12T01:05:19.763779+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.535876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"267'3","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.783064+0000","last_change":"2024-09-12T00:38:07.657937+0000","last_active":"2024-09-12T01:05:14.783064+0000","last_peered":"2024-09-12T01:05:14.783064+0000","last_clean":"2024-09-12T01:05:14.783064+0000","last_became_active":"2024-09-12T00:38:07.657155+0000","last_became_peered":"2024-09-12T00:38:07.657155+0000","last_unstale":"2024-09-12T01:05:14.783064+0000","last_undegraded":"2024-09-12T01:05:14.783064+0000","last_fullsized":"2024-09-12T01:05:14.783064+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:32.225678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"267'20","reported_seq":101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.541498+0000","last_change":"2024-09-12T00:36:37.222927+0000","last_active":"2024-09-12T01:05:02.541498+0000","last_peered":"2024-09-12T01:05:02.541498+0000","last_clean":"2024-09-12T01:05:02.541498+0000","last_became_active":"2024-09-12T00:36:37.221980+0000","last_became_peered":"2024-09-12T00:36:37.221980+0000","last_unstale":"2024-09-12T01:05:02.541498+0000","last_undegraded":"2024-09-12T01:05:02.541498+0000","last_fullsized":"2024-09-12T01:05:02.541498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:08.085009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'305","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.155017+0000","last_change":"2024-09-12T00:21:42.528797+0000","last_active":"2024-09-12T01:05:53.155017+0000","last_peered":"2024-09-12T01:05:53.155017+0000","last_clean":"2024-09-12T01:05:53.155017+0000","last_became_active":"2024-09-12T00:21:42.528236+0000","last_became_peered":"2024-09-12T00:21:42.528236+0000","last_unstale":"2024-09-12T01:05:53.155017+0000","last_undegraded":"2024-09-12T01:05:53.155017+0000","last_fullsized":"2024-09-12T01:05:53.155017+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:42.182294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1861783,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":458,"num_read_kb":8804,"num_write":1137,"num_write_kb":22191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'52","reported_seq":604,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.310893+0000","last_change":"2024-09-12T00:21:44.504479+0000","last_active":"2024-09-12T01:05:23.310893+0000","last_peered":"2024-09-12T01:05:23.310893+0000","last_clean":"2024-09-12T01:05:23.310893+0000","last_became_active":"2024-09-12T00:21:44.499494+0000","last_became_peered":"2024-09-12T00:21:44.499494+0000","last_unstale":"2024-09-12T01:05:23.310893+0000","last_undegraded":"2024-09-12T01:05:23.310893+0000","last_fullsized":"2024-09-12T01:05:23.310893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.715105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":187,"num_write":87,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'399","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.410078+0000","last_change":"2024-09-12T00:21:42.512960+0000","last_active":"2024-09-12T01:05:39.410078+0000","last_peered":"2024-09-12T01:05:39.410078+0000","last_clean":"2024-09-12T01:05:39.410078+0000","last_became_active":"2024-09-12T00:21:42.511901+0000","last_became_peered":"2024-09-12T00:21:42.511901+0000","last_unstale":"2024-09-12T01:05:39.410078+0000","last_undegraded":"2024-09-12T01:05:39.410078+0000","last_fullsized":"2024-09-12T01:05:39.410078+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:23.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9055852,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":763,"num_read_kb":14451,"num_write":1319,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'102","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.581466+0000","last_change":"2024-09-12T00:21:44.498811+0000","last_active":"2024-09-12T01:05:38.581466+0000","last_peered":"2024-09-12T01:05:38.581466+0000","last_clean":"2024-09-12T01:05:38.581466+0000","last_became_active":"2024-09-12T00:21:44.498503+0000","last_became_peered":"2024-09-12T00:21:44.498503+0000","last_unstale":"2024-09-12T01:05:38.581466+0000","last_undegraded":"2024-09-12T01:05:38.581466+0000","last_fullsized":"2024-09-12T01:05:38.581466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:31.431088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":343,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'256","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.506720+0000","last_change":"2024-09-12T00:21:42.535770+0000","last_active":"2024-09-12T01:05:31.506720+0000","last_peered":"2024-09-12T01:05:31.506720+0000","last_clean":"2024-09-12T01:05:31.506720+0000","last_became_active":"2024-09-12T00:21:42.535071+0000","last_became_peered":"2024-09-12T00:21:42.535071+0000","last_unstale":"2024-09-12T01:05:31.506720+0000","last_undegraded":"2024-09-12T01:05:31.506720+0000","last_fullsized":"2024-09-12T01:05:31.506720+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.704366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7669220,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":697,"num_read_kb":29454,"num_write":912,"num_write_kb":25069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'217","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.419030+0000","last_change":"2024-09-12T00:21:44.498204+0000","last_active":"2024-09-12T01:06:44.419030+0000","last_peered":"2024-09-12T01:06:44.419030+0000","last_clean":"2024-09-12T01:06:44.419030+0000","last_became_active":"2024-09-12T00:21:44.497569+0000","last_became_peered":"2024-09-12T00:21:44.497569+0000","last_unstale":"2024-09-12T01:06:44.419030+0000","last_undegraded":"2024-09-12T01:06:44.419030+0000","last_fullsized":"2024-09-12T01:06:44.419030+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.653439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":917,"num_read_kb":735,"num_write":338,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'298","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.281579+0000","last_change":"2024-09-12T00:21:42.528466+0000","last_active":"2024-09-12T01:05:49.281579+0000","last_peered":"2024-09-12T01:05:49.281579+0000","last_clean":"2024-09-12T01:05:49.281579+0000","last_became_active":"2024-09-12T00:21:42.528057+0000","last_became_peered":"2024-09-12T00:21:42.528057+0000","last_unstale":"2024-09-12T01:05:49.281579+0000","last_undegraded":"2024-09-12T01:05:49.281579+0000","last_fullsized":"2024-09-12T01:05:49.281579+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:39.430016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7615455,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":536,"num_read_kb":8621,"num_write":1159,"num_write_kb":31712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'137","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.579683+0000","last_change":"2024-09-12T00:21:44.480273+0000","last_active":"2024-09-12T01:04:14.579683+0000","last_peered":"2024-09-12T01:04:14.579683+0000","last_clean":"2024-09-12T01:04:14.579683+0000","last_became_active":"2024-09-12T00:21:44.479037+0000","last_became_peered":"2024-09-12T00:21:44.479037+0000","last_unstale":"2024-09-12T01:04:14.579683+0000","last_undegraded":"2024-09-12T01:04:14.579683+0000","last_fullsized":"2024-09-12T01:04:14.579683+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:47.501743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":200,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'303","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.619867+0000","last_change":"2024-09-12T00:21:42.515893+0000","last_active":"2024-09-12T01:05:20.619867+0000","last_peered":"2024-09-12T01:05:20.619867+0000","last_clean":"2024-09-12T01:05:20.619867+0000","last_became_active":"2024-09-12T00:21:42.515464+0000","last_became_peered":"2024-09-12T00:21:42.515464+0000","last_unstale":"2024-09-12T01:05:20.619867+0000","last_undegraded":"2024-09-12T01:05:20.619867+0000","last_fullsized":"2024-09-12T01:05:20.619867+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:46.082315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11750416,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":467,"num_read_kb":28078,"num_write":1204,"num_write_kb":29332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'4286","reported_seq":4956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.151752+0000","last_change":"2024-09-12T00:21:44.496471+0000","last_active":"2024-09-12T01:05:25.151752+0000","last_peered":"2024-09-12T01:05:25.151752+0000","last_clean":"2024-09-12T01:05:25.151752+0000","last_became_active":"2024-09-12T00:21:44.495734+0000","last_became_peered":"2024-09-12T00:21:44.495734+0000","last_unstale":"2024-09-12T01:05:25.151752+0000","last_undegraded":"2024-09-12T01:05:25.151752+0000","last_fullsized":"2024-09-12T01:05:25.151752+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":3000,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:24.946491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17226,"num_read_kb":14426,"num_write":6464,"num_write_kb":3218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'291","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.339538+0000","last_change":"2024-09-12T00:21:42.534954+0000","last_active":"2024-09-12T01:04:20.339538+0000","last_peered":"2024-09-12T01:04:20.339538+0000","last_clean":"2024-09-12T01:04:20.339538+0000","last_became_active":"2024-09-12T00:21:42.534582+0000","last_became_peered":"2024-09-12T00:21:42.534582+0000","last_unstale":"2024-09-12T01:04:20.339538+0000","last_undegraded":"2024-09-12T01:04:20.339538+0000","last_fullsized":"2024-09-12T01:04:20.339538+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:20.859536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8784333,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":407,"num_read_kb":25297,"num_write":1044,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'161","reported_seq":807,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.318189+0000","last_change":"2024-09-12T00:21:44.511727+0000","last_active":"2024-09-12T01:06:07.318189+0000","last_peered":"2024-09-12T01:06:07.318189+0000","last_clean":"2024-09-12T01:06:07.318189+0000","last_became_active":"2024-09-12T00:21:44.510410+0000","last_became_peered":"2024-09-12T00:21:44.510410+0000","last_unstale":"2024-09-12T01:06:07.318189+0000","last_undegraded":"2024-09-12T01:06:07.318189+0000","last_fullsized":"2024-09-12T01:06:07.318189+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:16.032761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":577,"num_write":213,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'304","reported_seq":1169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.622469+0000","last_change":"2024-09-12T00:21:42.531705+0000","last_active":"2024-09-12T01:05:20.622469+0000","last_peered":"2024-09-12T01:05:20.622469+0000","last_clean":"2024-09-12T01:05:20.622469+0000","last_became_active":"2024-09-12T00:21:42.530155+0000","last_became_peered":"2024-09-12T00:21:42.530155+0000","last_unstale":"2024-09-12T01:05:20.622469+0000","last_undegraded":"2024-09-12T01:05:20.622469+0000","last_fullsized":"2024-09-12T01:05:20.622469+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:16.745757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243942,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":968,"num_read_kb":26574,"num_write":1075,"num_write_kb":18888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'160","reported_seq":770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.994148+0000","last_change":"2024-09-12T00:21:44.484205+0000","last_active":"2024-09-12T01:05:26.994148+0000","last_peered":"2024-09-12T01:05:26.994148+0000","last_clean":"2024-09-12T01:05:26.994148+0000","last_became_active":"2024-09-12T00:21:44.483825+0000","last_became_peered":"2024-09-12T00:21:44.483825+0000","last_unstale":"2024-09-12T01:05:26.994148+0000","last_undegraded":"2024-09-12T01:05:26.994148+0000","last_fullsized":"2024-09-12T01:05:26.994148+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:08.179658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":577,"num_write":242,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'326","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.447863+0000","last_change":"2024-09-12T00:22:12.621823+0000","last_active":"2024-09-12T01:04:57.447863+0000","last_peered":"2024-09-12T01:04:57.447863+0000","last_clean":"2024-09-12T01:04:57.447863+0000","last_became_active":"2024-09-12T00:22:12.620753+0000","last_became_peered":"2024-09-12T00:22:12.620753+0000","last_unstale":"2024-09-12T01:04:57.447863+0000","last_undegraded":"2024-09-12T01:04:57.447863+0000","last_fullsized":"2024-09-12T01:04:57.447863+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:42.887841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6432694,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":507,"num_read_kb":16569,"num_write":1263,"num_write_kb":33151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'179","reported_seq":763,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.857805+0000","last_change":"2024-09-12T00:21:44.528812+0000","last_active":"2024-09-12T01:05:49.857805+0000","last_peered":"2024-09-12T01:05:49.857805+0000","last_clean":"2024-09-12T01:05:49.857805+0000","last_became_active":"2024-09-12T00:21:44.528311+0000","last_became_peered":"2024-09-12T00:21:44.528311+0000","last_unstale":"2024-09-12T01:05:49.857805+0000","last_undegraded":"2024-09-12T01:05:49.857805+0000","last_fullsized":"2024-09-12T01:05:49.857805+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:11.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":638,"num_write":310,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'108","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.649963+0000","last_change":"2024-09-12T00:21:44.494924+0000","last_active":"2024-09-12T01:04:18.649963+0000","last_peered":"2024-09-12T01:04:18.649963+0000","last_clean":"2024-09-12T01:04:18.649963+0000","last_became_active":"2024-09-12T00:21:44.493767+0000","last_became_peered":"2024-09-12T00:21:44.493767+0000","last_unstale":"2024-09-12T01:04:18.649963+0000","last_undegraded":"2024-09-12T01:04:18.649963+0000","last_fullsized":"2024-09-12T01:04:18.649963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:36.428208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":357,"num_write":148,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'262","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.706142+0000","last_change":"2024-09-12T00:21:42.515019+0000","last_active":"2024-09-12T01:05:38.706142+0000","last_peered":"2024-09-12T01:05:38.706142+0000","last_clean":"2024-09-12T01:05:38.706142+0000","last_became_active":"2024-09-12T00:21:42.514489+0000","last_became_peered":"2024-09-12T00:21:42.514489+0000","last_unstale":"2024-09-12T01:05:38.706142+0000","last_undegraded":"2024-09-12T01:05:38.706142+0000","last_fullsized":"2024-09-12T01:05:38.706142+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:26.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585686,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":441,"num_read_kb":6549,"num_write":1034,"num_write_kb":16882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'52","reported_seq":605,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.796075+0000","last_change":"2024-09-12T00:21:44.510300+0000","last_active":"2024-09-12T01:05:30.796075+0000","last_peered":"2024-09-12T01:05:30.796075+0000","last_clean":"2024-09-12T01:05:30.796075+0000","last_became_active":"2024-09-12T00:21:44.509895+0000","last_became_peered":"2024-09-12T00:21:44.509895+0000","last_unstale":"2024-09-12T01:05:30.796075+0000","last_undegraded":"2024-09-12T01:05:30.796075+0000","last_fullsized":"2024-09-12T01:05:30.796075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.091723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":198,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'217","reported_seq":805,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.536689+0000","last_change":"2024-09-12T00:21:42.491403+0000","last_active":"2024-09-12T01:05:04.536689+0000","last_peered":"2024-09-12T01:05:04.536689+0000","last_clean":"2024-09-12T01:05:04.536689+0000","last_became_active":"2024-09-12T00:21:42.490660+0000","last_became_peered":"2024-09-12T00:21:42.490660+0000","last_unstale":"2024-09-12T01:05:04.536689+0000","last_undegraded":"2024-09-12T01:05:04.536689+0000","last_fullsized":"2024-09-12T01:05:04.536689+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:10.128469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3351,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":307,"num_read_kb":4406,"num_write":745,"num_write_kb":22345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'258","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.249226+0000","last_change":"2024-09-12T00:21:44.515348+0000","last_active":"2024-09-12T01:05:47.249226+0000","last_peered":"2024-09-12T01:05:47.249226+0000","last_clean":"2024-09-12T01:05:47.249226+0000","last_became_active":"2024-09-12T00:21:44.514893+0000","last_became_peered":"2024-09-12T00:21:44.514893+0000","last_unstale":"2024-09-12T01:05:47.249226+0000","last_undegraded":"2024-09-12T01:05:47.249226+0000","last_fullsized":"2024-09-12T01:05:47.249226+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.665865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1166,"num_read_kb":956,"num_write":431,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'289","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.539772+0000","last_change":"2024-09-12T00:22:13.552941+0000","last_active":"2024-09-12T01:03:27.539772+0000","last_peered":"2024-09-12T01:03:27.539772+0000","last_clean":"2024-09-12T01:03:27.539772+0000","last_became_active":"2024-09-12T00:22:13.552126+0000","last_became_peered":"2024-09-12T00:22:13.552126+0000","last_unstale":"2024-09-12T01:03:27.539772+0000","last_undegraded":"2024-09-12T01:03:27.539772+0000","last_fullsized":"2024-09-12T01:03:27.539772+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.367793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5314894,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":477,"num_read_kb":9786,"num_write":1091,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'125","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.824816+0000","last_change":"2024-09-12T00:21:44.521066+0000","last_active":"2024-09-12T01:03:50.824816+0000","last_peered":"2024-09-12T01:03:50.824816+0000","last_clean":"2024-09-12T01:03:50.824816+0000","last_became_active":"2024-09-12T00:21:44.520441+0000","last_became_peered":"2024-09-12T00:21:44.520441+0000","last_unstale":"2024-09-12T01:03:50.824816+0000","last_undegraded":"2024-09-12T01:03:50.824816+0000","last_fullsized":"2024-09-12T01:03:50.824816+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:58.395313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":459,"num_write":198,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'283","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.542372+0000","last_change":"2024-09-12T00:21:42.506242+0000","last_active":"2024-09-12T01:05:29.542372+0000","last_peered":"2024-09-12T01:05:29.542372+0000","last_clean":"2024-09-12T01:05:29.542372+0000","last_became_active":"2024-09-12T00:21:42.505754+0000","last_became_peered":"2024-09-12T00:21:42.505754+0000","last_unstale":"2024-09-12T01:05:29.542372+0000","last_undegraded":"2024-09-12T01:05:29.542372+0000","last_fullsized":"2024-09-12T01:05:29.542372+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:17.644717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14158857,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":426,"num_read_kb":23994,"num_write":1075,"num_write_kb":44987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'533","reported_seq":1294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.156332+0000","last_change":"2024-09-12T00:21:44.510694+0000","last_active":"2024-09-12T01:04:59.156332+0000","last_peered":"2024-09-12T01:04:59.156332+0000","last_clean":"2024-09-12T01:04:59.156332+0000","last_became_active":"2024-09-12T00:21:44.509840+0000","last_became_peered":"2024-09-12T00:21:44.509840+0000","last_unstale":"2024-09-12T01:04:59.156332+0000","last_undegraded":"2024-09-12T01:04:59.156332+0000","last_fullsized":"2024-09-12T01:04:59.156332+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:05.378563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2527,"num_read_kb":2144,"num_write":948,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'292","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.199763+0000","last_change":"2024-09-12T00:21:42.531184+0000","last_active":"2024-09-12T01:05:30.199763+0000","last_peered":"2024-09-12T01:05:30.199763+0000","last_clean":"2024-09-12T01:05:30.199763+0000","last_became_active":"2024-09-12T00:21:42.529312+0000","last_became_peered":"2024-09-12T00:21:42.529312+0000","last_unstale":"2024-09-12T01:05:30.199763+0000","last_undegraded":"2024-09-12T01:05:30.199763+0000","last_fullsized":"2024-09-12T01:05:30.199763+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:28.828303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":436,"num_read_kb":653,"num_write":1031,"num_write_kb":45878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'102","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.071243+0000","last_change":"2024-09-12T00:21:44.499519+0000","last_active":"2024-09-12T01:05:04.071243+0000","last_peered":"2024-09-12T01:05:04.071243+0000","last_clean":"2024-09-12T01:05:04.071243+0000","last_became_active":"2024-09-12T00:21:44.499173+0000","last_became_peered":"2024-09-12T00:21:44.499173+0000","last_unstale":"2024-09-12T01:05:04.071243+0000","last_undegraded":"2024-09-12T01:05:04.071243+0000","last_fullsized":"2024-09-12T01:05:04.071243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:51.311165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":398,"num_write":158,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'302","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.064153+0000","last_change":"2024-09-12T00:21:42.530559+0000","last_active":"2024-09-12T01:05:37.064153+0000","last_peered":"2024-09-12T01:05:37.064153+0000","last_clean":"2024-09-12T01:05:37.064153+0000","last_became_active":"2024-09-12T00:21:42.529873+0000","last_became_peered":"2024-09-12T00:21:42.529873+0000","last_unstale":"2024-09-12T01:05:37.064153+0000","last_undegraded":"2024-09-12T01:05:37.064153+0000","last_fullsized":"2024-09-12T01:05:37.064153+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:42.813481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998659,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":481,"num_read_kb":35147,"num_write":1161,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'136","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.400586+0000","last_change":"2024-09-12T00:21:52.546288+0000","last_active":"2024-09-12T01:06:07.400586+0000","last_peered":"2024-09-12T01:06:07.400586+0000","last_clean":"2024-09-12T01:06:07.400586+0000","last_became_active":"2024-09-12T00:21:52.545571+0000","last_became_peered":"2024-09-12T00:21:52.545571+0000","last_unstale":"2024-09-12T01:06:07.400586+0000","last_undegraded":"2024-09-12T01:06:07.400586+0000","last_fullsized":"2024-09-12T01:06:07.400586+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:55.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'88","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.478850+0000","last_change":"2024-09-12T00:21:44.485322+0000","last_active":"2024-09-12T01:05:20.478850+0000","last_peered":"2024-09-12T01:05:20.478850+0000","last_clean":"2024-09-12T01:05:20.478850+0000","last_became_active":"2024-09-12T00:21:44.484514+0000","last_became_peered":"2024-09-12T00:21:44.484514+0000","last_unstale":"2024-09-12T01:05:20.478850+0000","last_undegraded":"2024-09-12T01:05:20.478850+0000","last_fullsized":"2024-09-12T01:05:20.478850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:59.343439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":321,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'274","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.548948+0000","last_change":"2024-09-12T00:21:42.496374+0000","last_active":"2024-09-12T01:05:28.548948+0000","last_peered":"2024-09-12T01:05:28.548948+0000","last_clean":"2024-09-12T01:05:28.548948+0000","last_became_active":"2024-09-12T00:21:42.495808+0000","last_became_peered":"2024-09-12T00:21:42.495808+0000","last_unstale":"2024-09-12T01:05:28.548948+0000","last_undegraded":"2024-09-12T01:05:28.548948+0000","last_fullsized":"2024-09-12T01:05:28.548948+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:30.009676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4734268,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":478,"num_read_kb":20340,"num_write":997,"num_write_kb":31693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.604524+0000","last_change":"2024-09-12T00:21:46.515667+0000","last_active":"2024-09-12T01:02:54.604524+0000","last_peered":"2024-09-12T01:02:54.604524+0000","last_clean":"2024-09-12T01:02:54.604524+0000","last_became_active":"2024-09-12T00:21:46.515363+0000","last_became_peered":"2024-09-12T00:21:46.515363+0000","last_unstale":"2024-09-12T01:02:54.604524+0000","last_undegraded":"2024-09-12T01:02:54.604524+0000","last_fullsized":"2024-09-12T01:02:54.604524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:03.935806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'325","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594824+0000","last_change":"2024-09-12T00:21:48.528210+0000","last_active":"2024-09-12T01:05:19.594824+0000","last_peered":"2024-09-12T01:05:19.594824+0000","last_clean":"2024-09-12T01:05:19.594824+0000","last_became_active":"2024-09-12T00:21:48.524091+0000","last_became_peered":"2024-09-12T00:21:48.524091+0000","last_unstale":"2024-09-12T01:05:19.594824+0000","last_undegraded":"2024-09-12T01:05:19.594824+0000","last_fullsized":"2024-09-12T01:05:19.594824+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:14.328463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":973,"num_write":412,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.751663+0000","last_change":"2024-09-12T00:21:50.552444+0000","last_active":"2024-09-12T01:02:59.751663+0000","last_peered":"2024-09-12T01:02:59.751663+0000","last_clean":"2024-09-12T01:02:59.751663+0000","last_became_active":"2024-09-12T00:21:50.551742+0000","last_became_peered":"2024-09-12T00:21:50.551742+0000","last_unstale":"2024-09-12T01:02:59.751663+0000","last_undegraded":"2024-09-12T01:02:59.751663+0000","last_fullsized":"2024-09-12T01:02:59.751663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:41.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'173","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.384837+0000","last_change":"2024-09-12T00:21:52.546442+0000","last_active":"2024-09-12T01:06:06.384837+0000","last_peered":"2024-09-12T01:06:06.384837+0000","last_clean":"2024-09-12T01:06:06.384837+0000","last_became_active":"2024-09-12T00:21:52.544469+0000","last_became_peered":"2024-09-12T00:21:52.544469+0000","last_unstale":"2024-09-12T01:06:06.384837+0000","last_undegraded":"2024-09-12T01:06:06.384837+0000","last_fullsized":"2024-09-12T01:06:06.384837+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:08.007114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":251,"num_write":350,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'4223","reported_seq":4854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.512839+0000","last_change":"2024-09-12T00:21:44.500660+0000","last_active":"2024-09-12T01:04:03.512839+0000","last_peered":"2024-09-12T01:04:03.512839+0000","last_clean":"2024-09-12T01:04:03.512839+0000","last_became_active":"2024-09-12T00:21:44.500367+0000","last_became_peered":"2024-09-12T00:21:44.500367+0000","last_unstale":"2024-09-12T01:04:03.512839+0000","last_undegraded":"2024-09-12T01:04:03.512839+0000","last_fullsized":"2024-09-12T01:04:03.512839+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:22.788119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17010,"num_read_kb":14247,"num_write":6340,"num_write_kb":3163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'308","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.387570+0000","last_change":"2024-09-12T00:21:42.500670+0000","last_active":"2024-09-12T01:05:26.387570+0000","last_peered":"2024-09-12T01:05:26.387570+0000","last_clean":"2024-09-12T01:05:26.387570+0000","last_became_active":"2024-09-12T00:21:42.492572+0000","last_became_peered":"2024-09-12T00:21:42.492572+0000","last_unstale":"2024-09-12T01:05:26.387570+0000","last_undegraded":"2024-09-12T01:05:26.387570+0000","last_fullsized":"2024-09-12T01:05:26.387570+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:45.219943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14345206,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":515,"num_read_kb":145927,"num_write":1098,"num_write_kb":64533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.576546+0000","last_change":"2024-09-12T00:21:46.491690+0000","last_active":"2024-09-12T01:03:59.576546+0000","last_peered":"2024-09-12T01:03:59.576546+0000","last_clean":"2024-09-12T01:03:59.576546+0000","last_became_active":"2024-09-12T00:21:46.490985+0000","last_became_peered":"2024-09-12T00:21:46.490985+0000","last_unstale":"2024-09-12T01:03:59.576546+0000","last_undegraded":"2024-09-12T01:03:59.576546+0000","last_fullsized":"2024-09-12T01:03:59.576546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:41.609896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'84","reported_seq":618,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.296129+0000","last_change":"2024-09-12T00:21:48.535909+0000","last_active":"2024-09-12T01:04:55.296129+0000","last_peered":"2024-09-12T01:04:55.296129+0000","last_clean":"2024-09-12T01:04:55.296129+0000","last_became_active":"2024-09-12T00:21:48.535190+0000","last_became_peered":"2024-09-12T00:21:48.535190+0000","last_unstale":"2024-09-12T01:04:55.296129+0000","last_undegraded":"2024-09-12T01:04:55.296129+0000","last_fullsized":"2024-09-12T01:04:55.296129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.533022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.751597+0000","last_change":"2024-09-12T00:21:50.551431+0000","last_active":"2024-09-12T01:02:59.751597+0000","last_peered":"2024-09-12T01:02:59.751597+0000","last_clean":"2024-09-12T01:02:59.751597+0000","last_became_active":"2024-09-12T00:21:50.550214+0000","last_became_peered":"2024-09-12T00:21:50.550214+0000","last_unstale":"2024-09-12T01:02:59.751597+0000","last_undegraded":"2024-09-12T01:02:59.751597+0000","last_fullsized":"2024-09-12T01:02:59.751597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:11.439485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'124","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.000458+0000","last_change":"2024-09-12T00:21:52.545902+0000","last_active":"2024-09-12T01:05:53.000458+0000","last_peered":"2024-09-12T01:05:53.000458+0000","last_clean":"2024-09-12T01:05:53.000458+0000","last_became_active":"2024-09-12T00:21:52.545166+0000","last_became_peered":"2024-09-12T00:21:52.545166+0000","last_unstale":"2024-09-12T01:05:53.000458+0000","last_undegraded":"2024-09-12T01:05:53.000458+0000","last_fullsized":"2024-09-12T01:05:53.000458+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:01.544361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":292,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'288","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.243846+0000","last_change":"2024-09-12T00:21:44.520746+0000","last_active":"2024-09-12T01:04:15.243846+0000","last_peered":"2024-09-12T01:04:15.243846+0000","last_clean":"2024-09-12T01:04:15.243846+0000","last_became_active":"2024-09-12T00:21:44.520057+0000","last_became_peered":"2024-09-12T00:21:44.520057+0000","last_unstale":"2024-09-12T01:04:15.243846+0000","last_undegraded":"2024-09-12T01:04:15.243846+0000","last_fullsized":"2024-09-12T01:04:15.243846+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:54.675479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1259,"num_read_kb":1089,"num_write":465,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'259","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.992074+0000","last_change":"2024-09-12T00:21:42.497428+0000","last_active":"2024-09-12T01:04:19.992074+0000","last_peered":"2024-09-12T01:04:19.992074+0000","last_clean":"2024-09-12T01:04:19.992074+0000","last_became_active":"2024-09-12T00:21:42.496059+0000","last_became_peered":"2024-09-12T00:21:42.496059+0000","last_unstale":"2024-09-12T01:04:19.992074+0000","last_undegraded":"2024-09-12T01:04:19.992074+0000","last_fullsized":"2024-09-12T01:04:19.992074+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:13.046572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2126129,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":433,"num_read_kb":8626,"num_write":932,"num_write_kb":21953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.562551+0000","last_change":"2024-09-12T00:21:46.501997+0000","last_active":"2024-09-12T01:02:54.562551+0000","last_peered":"2024-09-12T01:02:54.562551+0000","last_clean":"2024-09-12T01:02:54.562551+0000","last_became_active":"2024-09-12T00:21:46.501407+0000","last_became_peered":"2024-09-12T00:21:46.501407+0000","last_unstale":"2024-09-12T01:02:54.562551+0000","last_undegraded":"2024-09-12T01:02:54.562551+0000","last_fullsized":"2024-09-12T01:02:54.562551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.795256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'122","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.317364+0000","last_change":"2024-09-12T00:21:48.542081+0000","last_active":"2024-09-12T01:04:21.317364+0000","last_peered":"2024-09-12T01:04:21.317364+0000","last_clean":"2024-09-12T01:04:21.317364+0000","last_became_active":"2024-09-12T00:21:48.541231+0000","last_became_peered":"2024-09-12T00:21:48.541231+0000","last_unstale":"2024-09-12T01:04:21.317364+0000","last_undegraded":"2024-09-12T01:04:21.317364+0000","last_fullsized":"2024-09-12T01:04:21.317364+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.064538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'784","reported_seq":2510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947341+0000","last_change":"2024-09-12T00:21:50.569545+0000","last_active":"2024-09-12T01:07:12.947341+0000","last_peered":"2024-09-12T01:07:12.947341+0000","last_clean":"2024-09-12T01:07:12.947341+0000","last_became_active":"2024-09-12T00:21:50.568825+0000","last_became_peered":"2024-09-12T00:21:50.568825+0000","last_unstale":"2024-09-12T01:07:12.947341+0000","last_undegraded":"2024-09-12T01:07:12.947341+0000","last_fullsized":"2024-09-12T01:07:12.947341+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'222","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.469146+0000","last_change":"2024-09-12T00:21:52.555837+0000","last_active":"2024-09-12T01:06:07.469146+0000","last_peered":"2024-09-12T01:06:07.469146+0000","last_clean":"2024-09-12T01:06:07.469146+0000","last_became_active":"2024-09-12T00:21:52.554865+0000","last_became_peered":"2024-09-12T00:21:52.554865+0000","last_unstale":"2024-09-12T01:06:07.469146+0000","last_undegraded":"2024-09-12T01:06:07.469146+0000","last_fullsized":"2024-09-12T01:06:07.469146+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:47.453983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":708,"num_read_kb":679,"num_write":497,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'135","reported_seq":691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.308334+0000","last_change":"2024-09-12T00:21:44.523637+0000","last_active":"2024-09-12T01:04:13.308334+0000","last_peered":"2024-09-12T01:04:13.308334+0000","last_clean":"2024-09-12T01:04:13.308334+0000","last_became_active":"2024-09-12T00:21:44.522830+0000","last_became_peered":"2024-09-12T00:21:44.522830+0000","last_unstale":"2024-09-12T01:04:13.308334+0000","last_undegraded":"2024-09-12T01:04:13.308334+0000","last_fullsized":"2024-09-12T01:04:13.308334+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:29.081489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":469,"num_write":207,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'264","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.377944+0000","last_change":"2024-09-12T00:21:42.516948+0000","last_active":"2024-09-12T01:05:02.377944+0000","last_peered":"2024-09-12T01:05:02.377944+0000","last_clean":"2024-09-12T01:05:02.377944+0000","last_became_active":"2024-09-12T00:21:42.516625+0000","last_became_peered":"2024-09-12T00:21:42.516625+0000","last_unstale":"2024-09-12T01:05:02.377944+0000","last_undegraded":"2024-09-12T01:05:02.377944+0000","last_fullsized":"2024-09-12T01:05:02.377944+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:25.672684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4203223,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":486,"num_read_kb":2648,"num_write":1058,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.604571+0000","last_change":"2024-09-12T00:21:46.504025+0000","last_active":"2024-09-12T01:02:54.604571+0000","last_peered":"2024-09-12T01:02:54.604571+0000","last_clean":"2024-09-12T01:02:54.604571+0000","last_became_active":"2024-09-12T00:21:46.503686+0000","last_became_peered":"2024-09-12T00:21:46.503686+0000","last_unstale":"2024-09-12T01:02:54.604571+0000","last_undegraded":"2024-09-12T01:02:54.604571+0000","last_fullsized":"2024-09-12T01:02:54.604571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:46.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'279","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.530837+0000","last_change":"2024-09-12T00:21:48.540014+0000","last_active":"2024-09-12T01:05:20.530837+0000","last_peered":"2024-09-12T01:05:20.530837+0000","last_clean":"2024-09-12T01:05:20.530837+0000","last_became_active":"2024-09-12T00:21:48.539522+0000","last_became_peered":"2024-09-12T00:21:48.539522+0000","last_unstale":"2024-09-12T01:05:20.530837+0000","last_undegraded":"2024-09-12T01:05:20.530837+0000","last_fullsized":"2024-09-12T01:05:20.530837+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:51.751137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":960,"num_write":382,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'774","reported_seq":2460,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.948159+0000","last_change":"2024-09-12T00:21:50.565919+0000","last_active":"2024-09-12T01:07:12.948159+0000","last_peered":"2024-09-12T01:07:12.948159+0000","last_clean":"2024-09-12T01:07:12.948159+0000","last_became_active":"2024-09-12T00:21:50.564483+0000","last_became_peered":"2024-09-12T00:21:50.564483+0000","last_unstale":"2024-09-12T01:07:12.948159+0000","last_undegraded":"2024-09-12T01:07:12.948159+0000","last_fullsized":"2024-09-12T01:07:12.948159+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'576","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.637851+0000","last_change":"2024-09-12T00:21:44.501308+0000","last_active":"2024-09-12T01:05:04.637851+0000","last_peered":"2024-09-12T01:05:04.637851+0000","last_clean":"2024-09-12T01:05:04.637851+0000","last_became_active":"2024-09-12T00:21:44.497754+0000","last_became_peered":"2024-09-12T00:21:44.497754+0000","last_unstale":"2024-09-12T01:05:04.637851+0000","last_undegraded":"2024-09-12T01:05:04.637851+0000","last_fullsized":"2024-09-12T01:05:04.637851+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:01.259088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2710,"num_read_kb":2241,"num_write":1007,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'310","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:50.637061+0000","last_change":"2024-09-12T00:21:42.528462+0000","last_active":"2024-09-12T01:05:50.637061+0000","last_peered":"2024-09-12T01:05:50.637061+0000","last_clean":"2024-09-12T01:05:50.637061+0000","last_became_active":"2024-09-12T00:21:42.528138+0000","last_became_peered":"2024-09-12T00:21:42.528138+0000","last_unstale":"2024-09-12T01:05:50.637061+0000","last_undegraded":"2024-09-12T01:05:50.637061+0000","last_fullsized":"2024-09-12T01:05:50.637061+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:59.797609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12248109,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":691,"num_read_kb":24537,"num_write":1019,"num_write_kb":22675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.781947+0000","last_change":"2024-09-12T00:21:46.503402+0000","last_active":"2024-09-12T01:05:09.781947+0000","last_peered":"2024-09-12T01:05:09.781947+0000","last_clean":"2024-09-12T01:05:09.781947+0000","last_became_active":"2024-09-12T00:21:46.503041+0000","last_became_peered":"2024-09-12T00:21:46.503041+0000","last_unstale":"2024-09-12T01:05:09.781947+0000","last_undegraded":"2024-09-12T01:05:09.781947+0000","last_fullsized":"2024-09-12T01:05:09.781947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.602442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'361","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.602132+0000","last_change":"2024-09-12T00:21:48.539441+0000","last_active":"2024-09-12T01:05:19.602132+0000","last_peered":"2024-09-12T01:05:19.602132+0000","last_clean":"2024-09-12T01:05:19.602132+0000","last_became_active":"2024-09-12T00:21:48.538727+0000","last_became_peered":"2024-09-12T00:21:48.538727+0000","last_unstale":"2024-09-12T01:05:19.602132+0000","last_undegraded":"2024-09-12T01:05:19.602132+0000","last_fullsized":"2024-09-12T01:05:19.602132+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:41.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60701,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":576,"num_read_kb":1074,"num_write":458,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.587751+0000","last_change":"2024-09-12T00:21:50.545196+0000","last_active":"2024-09-12T01:04:39.587751+0000","last_peered":"2024-09-12T01:04:39.587751+0000","last_clean":"2024-09-12T01:04:39.587751+0000","last_became_active":"2024-09-12T00:21:50.544432+0000","last_became_peered":"2024-09-12T00:21:50.544432+0000","last_unstale":"2024-09-12T01:04:39.587751+0000","last_undegraded":"2024-09-12T01:04:39.587751+0000","last_fullsized":"2024-09-12T01:04:39.587751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.923643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'549","reported_seq":1360,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.865258+0000","last_change":"2024-09-12T00:21:52.563743+0000","last_active":"2024-09-12T01:07:12.865258+0000","last_peered":"2024-09-12T01:07:12.865258+0000","last_clean":"2024-09-12T01:07:12.865258+0000","last_became_active":"2024-09-12T00:21:52.563086+0000","last_became_peered":"2024-09-12T00:21:52.563086+0000","last_unstale":"2024-09-12T01:07:12.865258+0000","last_undegraded":"2024-09-12T01:07:12.865258+0000","last_fullsized":"2024-09-12T01:07:12.865258+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:09.343801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1274,"num_read_kb":1271,"num_write":1130,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'524","reported_seq":1304,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.780894+0000","last_change":"2024-09-12T00:21:44.511296+0000","last_active":"2024-09-12T01:05:04.780894+0000","last_peered":"2024-09-12T01:05:04.780894+0000","last_clean":"2024-09-12T01:05:04.780894+0000","last_became_active":"2024-09-12T00:21:44.510918+0000","last_became_peered":"2024-09-12T00:21:44.510918+0000","last_unstale":"2024-09-12T01:05:04.780894+0000","last_undegraded":"2024-09-12T01:05:04.780894+0000","last_fullsized":"2024-09-12T01:05:04.780894+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:54.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2468,"num_read_kb":2089,"num_write":789,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'271","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.752863+0000","last_change":"2024-09-12T00:21:42.513398+0000","last_active":"2024-09-12T01:04:29.752863+0000","last_peered":"2024-09-12T01:04:29.752863+0000","last_clean":"2024-09-12T01:04:29.752863+0000","last_became_active":"2024-09-12T00:21:42.513031+0000","last_became_peered":"2024-09-12T00:21:42.513031+0000","last_unstale":"2024-09-12T01:04:29.752863+0000","last_undegraded":"2024-09-12T01:04:29.752863+0000","last_fullsized":"2024-09-12T01:04:29.752863+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10423793,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":421,"num_read_kb":44893,"num_write":956,"num_write_kb":33699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.594203+0000","last_change":"2024-09-12T00:21:46.519542+0000","last_active":"2024-09-12T01:05:09.594203+0000","last_peered":"2024-09-12T01:05:09.594203+0000","last_clean":"2024-09-12T01:05:09.594203+0000","last_became_active":"2024-09-12T00:21:46.517981+0000","last_became_peered":"2024-09-12T00:21:46.517981+0000","last_unstale":"2024-09-12T01:05:09.594203+0000","last_undegraded":"2024-09-12T01:05:09.594203+0000","last_fullsized":"2024-09-12T01:05:09.594203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:03.803070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'269","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.615952+0000","last_change":"2024-09-12T00:21:48.523626+0000","last_active":"2024-09-12T01:06:49.615952+0000","last_peered":"2024-09-12T01:06:49.615952+0000","last_clean":"2024-09-12T01:06:49.615952+0000","last_became_active":"2024-09-12T00:21:48.522920+0000","last_became_peered":"2024-09-12T00:21:48.522920+0000","last_unstale":"2024-09-12T01:06:49.615952+0000","last_undegraded":"2024-09-12T01:06:49.615952+0000","last_fullsized":"2024-09-12T01:06:49.615952+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:28.182271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55088,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":905,"num_write":360,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.566845+0000","last_change":"2024-09-12T00:21:50.545714+0000","last_active":"2024-09-12T01:03:14.566845+0000","last_peered":"2024-09-12T01:03:14.566845+0000","last_clean":"2024-09-12T01:03:14.566845+0000","last_became_active":"2024-09-12T00:21:50.543639+0000","last_became_peered":"2024-09-12T00:21:50.543639+0000","last_unstale":"2024-09-12T01:03:14.566845+0000","last_undegraded":"2024-09-12T01:03:14.566845+0000","last_fullsized":"2024-09-12T01:03:14.566845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:41.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2371","reported_seq":4212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.690521+0000","last_change":"2024-09-12T00:21:52.538444+0000","last_active":"2024-09-12T01:06:56.690521+0000","last_peered":"2024-09-12T01:06:56.690521+0000","last_clean":"2024-09-12T01:06:56.690521+0000","last_became_active":"2024-09-12T00:21:52.537701+0000","last_became_peered":"2024-09-12T00:21:52.537701+0000","last_unstale":"2024-09-12T01:06:56.690521+0000","last_undegraded":"2024-09-12T01:06:56.690521+0000","last_fullsized":"2024-09-12T01:06:56.690521+0000","mapping_epoch":36,"log_start":"267'2300","ondisk_log_start":"267'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:39.923689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5977,"num_write":4771,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'112","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.997112+0000","last_change":"2024-09-12T00:21:44.494633+0000","last_active":"2024-09-12T01:05:52.997112+0000","last_peered":"2024-09-12T01:05:52.997112+0000","last_clean":"2024-09-12T01:05:52.997112+0000","last_became_active":"2024-09-12T00:21:44.494313+0000","last_became_peered":"2024-09-12T00:21:44.494313+0000","last_unstale":"2024-09-12T01:05:52.997112+0000","last_undegraded":"2024-09-12T01:05:52.997112+0000","last_fullsized":"2024-09-12T01:05:52.997112+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:22.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":397,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'283","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.429761+0000","last_change":"2024-09-12T00:21:42.529770+0000","last_active":"2024-09-12T01:05:40.429761+0000","last_peered":"2024-09-12T01:05:40.429761+0000","last_clean":"2024-09-12T01:05:40.429761+0000","last_became_active":"2024-09-12T00:21:42.529372+0000","last_became_peered":"2024-09-12T00:21:42.529372+0000","last_unstale":"2024-09-12T01:05:40.429761+0000","last_undegraded":"2024-09-12T01:05:40.429761+0000","last_fullsized":"2024-09-12T01:05:40.429761+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.798589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6348479,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":507,"num_read_kb":12047,"num_write":1179,"num_write_kb":31958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611469+0000","last_change":"2024-09-12T00:21:46.512407+0000","last_active":"2024-09-12T01:04:34.611469+0000","last_peered":"2024-09-12T01:04:34.611469+0000","last_clean":"2024-09-12T01:04:34.611469+0000","last_became_active":"2024-09-12T00:21:46.511704+0000","last_became_peered":"2024-09-12T00:21:46.511704+0000","last_unstale":"2024-09-12T01:04:34.611469+0000","last_undegraded":"2024-09-12T01:04:34.611469+0000","last_fullsized":"2024-09-12T01:04:34.611469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:04.950564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'279","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.840274+0000","last_change":"2024-09-12T00:21:48.552567+0000","last_active":"2024-09-12T01:07:12.840274+0000","last_peered":"2024-09-12T01:07:12.840274+0000","last_clean":"2024-09-12T01:07:12.840274+0000","last_became_active":"2024-09-12T00:21:48.551752+0000","last_became_peered":"2024-09-12T00:21:48.551752+0000","last_unstale":"2024-09-12T01:07:12.840274+0000","last_undegraded":"2024-09-12T01:07:12.840274+0000","last_fullsized":"2024-09-12T01:07:12.840274+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.243890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53943,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":454,"num_read_kb":871,"num_write":360,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'775","reported_seq":4653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.220504+0000","last_change":"2024-09-12T00:21:50.562293+0000","last_active":"2024-09-12T01:07:13.220504+0000","last_peered":"2024-09-12T01:07:13.220504+0000","last_clean":"2024-09-12T01:07:13.220504+0000","last_became_active":"2024-09-12T00:21:50.561680+0000","last_became_peered":"2024-09-12T00:21:50.561680+0000","last_unstale":"2024-09-12T01:07:13.220504+0000","last_undegraded":"2024-09-12T01:07:13.220504+0000","last_fullsized":"2024-09-12T01:07:13.220504+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":701,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:35.170696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'119","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.966637+0000","last_change":"2024-09-12T00:21:52.547626+0000","last_active":"2024-09-12T01:07:11.966637+0000","last_peered":"2024-09-12T01:07:11.966637+0000","last_clean":"2024-09-12T01:07:11.966637+0000","last_became_active":"2024-09-12T00:21:52.546889+0000","last_became_peered":"2024-09-12T00:21:52.546889+0000","last_unstale":"2024-09-12T01:07:11.966637+0000","last_undegraded":"2024-09-12T01:07:11.966637+0000","last_fullsized":"2024-09-12T01:07:11.966637+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:06.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":121,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'188","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.081285+0000","last_change":"2024-09-12T00:21:44.519531+0000","last_active":"2024-09-12T01:05:30.081285+0000","last_peered":"2024-09-12T01:05:30.081285+0000","last_clean":"2024-09-12T01:05:30.081285+0000","last_became_active":"2024-09-12T00:21:44.518595+0000","last_became_peered":"2024-09-12T00:21:44.518595+0000","last_unstale":"2024-09-12T01:05:30.081285+0000","last_undegraded":"2024-09-12T01:05:30.081285+0000","last_fullsized":"2024-09-12T01:05:30.081285+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.767338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":656,"num_write":281,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'214","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.699785+0000","last_change":"2024-09-12T00:21:42.498445+0000","last_active":"2024-09-12T01:05:44.699785+0000","last_peered":"2024-09-12T01:05:44.699785+0000","last_clean":"2024-09-12T01:05:44.699785+0000","last_became_active":"2024-09-12T00:21:42.497992+0000","last_became_peered":"2024-09-12T00:21:42.497992+0000","last_unstale":"2024-09-12T01:05:44.699785+0000","last_undegraded":"2024-09-12T01:05:44.699785+0000","last_fullsized":"2024-09-12T01:05:44.699785+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:31.325313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4482985,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":346,"num_read_kb":82463,"num_write":801,"num_write_kb":27861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.566546+0000","last_change":"2024-09-12T00:21:46.512131+0000","last_active":"2024-09-12T01:03:09.566546+0000","last_peered":"2024-09-12T01:03:09.566546+0000","last_clean":"2024-09-12T01:03:09.566546+0000","last_became_active":"2024-09-12T00:21:46.511365+0000","last_became_peered":"2024-09-12T00:21:46.511365+0000","last_unstale":"2024-09-12T01:03:09.566546+0000","last_undegraded":"2024-09-12T01:03:09.566546+0000","last_fullsized":"2024-09-12T01:03:09.566546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:52.291093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'463","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.846736+0000","last_change":"2024-09-12T00:21:48.526015+0000","last_active":"2024-09-12T01:07:12.846736+0000","last_peered":"2024-09-12T01:07:12.846736+0000","last_clean":"2024-09-12T01:07:12.846736+0000","last_became_active":"2024-09-12T00:21:48.524173+0000","last_became_peered":"2024-09-12T00:21:48.524173+0000","last_unstale":"2024-09-12T01:07:12.846736+0000","last_undegraded":"2024-09-12T01:07:12.846736+0000","last_fullsized":"2024-09-12T01:07:12.846736+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:01.094285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108366,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":795,"num_read_kb":1720,"num_write":656,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.620896+0000","last_change":"2024-09-12T00:21:50.562375+0000","last_active":"2024-09-12T01:05:14.620896+0000","last_peered":"2024-09-12T01:05:14.620896+0000","last_clean":"2024-09-12T01:05:14.620896+0000","last_became_active":"2024-09-12T00:21:50.561720+0000","last_became_peered":"2024-09-12T00:21:50.561720+0000","last_unstale":"2024-09-12T01:05:14.620896+0000","last_undegraded":"2024-09-12T01:05:14.620896+0000","last_fullsized":"2024-09-12T01:05:14.620896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:55.724402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'124","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.185203+0000","last_change":"2024-09-12T00:21:52.565860+0000","last_active":"2024-09-12T01:05:29.185203+0000","last_peered":"2024-09-12T01:05:29.185203+0000","last_clean":"2024-09-12T01:05:29.185203+0000","last_became_active":"2024-09-12T00:21:52.565276+0000","last_became_peered":"2024-09-12T00:21:52.565276+0000","last_unstale":"2024-09-12T01:05:29.185203+0000","last_undegraded":"2024-09-12T01:05:29.185203+0000","last_fullsized":"2024-09-12T01:05:29.185203+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:19.050097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'92","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.590887+0000","last_change":"2024-09-12T00:21:44.505865+0000","last_active":"2024-09-12T01:04:29.590887+0000","last_peered":"2024-09-12T01:04:29.590887+0000","last_clean":"2024-09-12T01:04:29.590887+0000","last_became_active":"2024-09-12T00:21:44.504866+0000","last_became_peered":"2024-09-12T00:21:44.504866+0000","last_unstale":"2024-09-12T01:04:29.590887+0000","last_undegraded":"2024-09-12T01:04:29.590887+0000","last_fullsized":"2024-09-12T01:04:29.590887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:00.702193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":364,"num_write":125,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'360","reported_seq":1010,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.690221+0000","last_change":"2024-09-12T00:21:42.513602+0000","last_active":"2024-09-12T01:07:27.690221+0000","last_peered":"2024-09-12T01:07:27.690221+0000","last_clean":"2024-09-12T01:07:27.690221+0000","last_became_active":"2024-09-12T00:21:42.511762+0000","last_became_peered":"2024-09-12T00:21:42.511762+0000","last_unstale":"2024-09-12T01:07:27.690221+0000","last_undegraded":"2024-09-12T01:07:27.690221+0000","last_fullsized":"2024-09-12T01:07:27.690221+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:56.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":36352,"num_write":1101,"num_write_kb":41720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:33.591024+0000","last_change":"2024-09-12T00:21:46.515246+0000","last_active":"2024-09-12T01:04:33.591024+0000","last_peered":"2024-09-12T01:04:33.591024+0000","last_clean":"2024-09-12T01:04:33.591024+0000","last_became_active":"2024-09-12T00:21:46.514486+0000","last_became_peered":"2024-09-12T00:21:46.514486+0000","last_unstale":"2024-09-12T01:04:33.591024+0000","last_undegraded":"2024-09-12T01:04:33.591024+0000","last_fullsized":"2024-09-12T01:04:33.591024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:53.736171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'313","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.419509+0000","last_change":"2024-09-12T00:21:48.548232+0000","last_active":"2024-09-12T01:06:49.419509+0000","last_peered":"2024-09-12T01:06:49.419509+0000","last_clean":"2024-09-12T01:06:49.419509+0000","last_became_active":"2024-09-12T00:21:48.547356+0000","last_became_peered":"2024-09-12T00:21:48.547356+0000","last_unstale":"2024-09-12T01:06:49.419509+0000","last_undegraded":"2024-09-12T01:06:49.419509+0000","last_fullsized":"2024-09-12T01:06:49.419509+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:38.710415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":980,"num_write":452,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.594618+0000","last_change":"2024-09-12T00:21:50.556901+0000","last_active":"2024-09-12T01:04:48.594618+0000","last_peered":"2024-09-12T01:04:48.594618+0000","last_clean":"2024-09-12T01:04:48.594618+0000","last_became_active":"2024-09-12T00:21:50.556220+0000","last_became_peered":"2024-09-12T00:21:50.556220+0000","last_unstale":"2024-09-12T01:04:48.594618+0000","last_undegraded":"2024-09-12T01:04:48.594618+0000","last_fullsized":"2024-09-12T01:04:48.594618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.780602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.632683+0000","last_change":"2024-09-12T00:21:52.567877+0000","last_active":"2024-09-12T01:06:04.632683+0000","last_peered":"2024-09-12T01:06:04.632683+0000","last_clean":"2024-09-12T01:06:04.632683+0000","last_became_active":"2024-09-12T00:21:52.567273+0000","last_became_peered":"2024-09-12T00:21:52.567273+0000","last_unstale":"2024-09-12T01:06:04.632683+0000","last_undegraded":"2024-09-12T01:06:04.632683+0000","last_fullsized":"2024-09-12T01:06:04.632683+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:22.583804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'124","reported_seq":703,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.523823+0000","last_change":"2024-09-12T00:21:44.503225+0000","last_active":"2024-09-12T01:06:06.523823+0000","last_peered":"2024-09-12T01:06:06.523823+0000","last_clean":"2024-09-12T01:06:06.523823+0000","last_became_active":"2024-09-12T00:21:44.502965+0000","last_became_peered":"2024-09-12T00:21:44.502965+0000","last_unstale":"2024-09-12T01:06:06.523823+0000","last_undegraded":"2024-09-12T01:06:06.523823+0000","last_fullsized":"2024-09-12T01:06:06.523823+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:31.381032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":435,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'294","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:02.556096+0000","last_change":"2024-09-12T00:22:13.521128+0000","last_active":"2024-09-12T01:07:02.556096+0000","last_peered":"2024-09-12T01:07:02.556096+0000","last_clean":"2024-09-12T01:07:02.556096+0000","last_became_active":"2024-09-12T00:22:13.520026+0000","last_became_peered":"2024-09-12T00:22:13.520026+0000","last_unstale":"2024-09-12T01:07:02.556096+0000","last_undegraded":"2024-09-12T01:07:02.556096+0000","last_fullsized":"2024-09-12T01:07:02.556096+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:58.425398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9661557,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":556,"num_read_kb":38314,"num_write":1075,"num_write_kb":31045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611545+0000","last_change":"2024-09-12T00:21:46.508177+0000","last_active":"2024-09-12T01:04:34.611545+0000","last_peered":"2024-09-12T01:04:34.611545+0000","last_clean":"2024-09-12T01:04:34.611545+0000","last_became_active":"2024-09-12T00:21:46.507456+0000","last_became_peered":"2024-09-12T00:21:46.507456+0000","last_unstale":"2024-09-12T01:04:34.611545+0000","last_undegraded":"2024-09-12T01:04:34.611545+0000","last_fullsized":"2024-09-12T01:04:34.611545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.624519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'305","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:59.646490+0000","last_change":"2024-09-12T00:21:48.541207+0000","last_active":"2024-09-12T01:06:59.646490+0000","last_peered":"2024-09-12T01:06:59.646490+0000","last_clean":"2024-09-12T01:06:59.646490+0000","last_became_active":"2024-09-12T00:21:48.535782+0000","last_became_peered":"2024-09-12T00:21:48.535782+0000","last_unstale":"2024-09-12T01:06:59.646490+0000","last_undegraded":"2024-09-12T01:06:59.646490+0000","last_fullsized":"2024-09-12T01:06:59.646490+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:36.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60857,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1011,"num_write":406,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'751","reported_seq":2246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.508497+0000","last_change":"2024-09-12T00:21:50.558383+0000","last_active":"2024-09-12T01:07:25.508497+0000","last_peered":"2024-09-12T01:07:25.508497+0000","last_clean":"2024-09-12T01:07:25.508497+0000","last_became_active":"2024-09-12T00:21:50.557158+0000","last_became_peered":"2024-09-12T00:21:50.557158+0000","last_unstale":"2024-09-12T01:07:25.508497+0000","last_undegraded":"2024-09-12T01:07:25.508497+0000","last_fullsized":"2024-09-12T01:07:25.508497+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:51.183200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'134","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.252744+0000","last_change":"2024-09-12T00:21:52.546563+0000","last_active":"2024-09-12T01:05:47.252744+0000","last_peered":"2024-09-12T01:05:47.252744+0000","last_clean":"2024-09-12T01:05:47.252744+0000","last_became_active":"2024-09-12T00:21:52.545876+0000","last_became_peered":"2024-09-12T00:21:52.545876+0000","last_unstale":"2024-09-12T01:05:47.252744+0000","last_undegraded":"2024-09-12T01:05:47.252744+0000","last_fullsized":"2024-09-12T01:05:47.252744+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.003099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":172,"num_write":354,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'141","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.454853+0000","last_change":"2024-09-12T00:21:44.494799+0000","last_active":"2024-09-12T01:05:00.454853+0000","last_peered":"2024-09-12T01:05:00.454853+0000","last_clean":"2024-09-12T01:05:00.454853+0000","last_became_active":"2024-09-12T00:21:44.494386+0000","last_became_peered":"2024-09-12T00:21:44.494386+0000","last_unstale":"2024-09-12T01:05:00.454853+0000","last_undegraded":"2024-09-12T01:05:00.454853+0000","last_fullsized":"2024-09-12T01:05:00.454853+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:48.947337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":627,"num_read_kb":527,"num_write":195,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'345","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.432353+0000","last_change":"2024-09-12T00:21:42.529220+0000","last_active":"2024-09-12T01:05:52.432353+0000","last_peered":"2024-09-12T01:05:52.432353+0000","last_clean":"2024-09-12T01:05:52.432353+0000","last_became_active":"2024-09-12T00:21:42.528782+0000","last_became_peered":"2024-09-12T00:21:42.528782+0000","last_unstale":"2024-09-12T01:05:52.432353+0000","last_undegraded":"2024-09-12T01:05:52.432353+0000","last_fullsized":"2024-09-12T01:05:52.432353+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:42.093500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8938182,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":585,"num_read_kb":31515,"num_write":1169,"num_write_kb":36332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'7","reported_seq":1938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.736641+0000","last_change":"2024-09-12T00:21:46.504153+0000","last_active":"2024-09-12T01:07:12.736641+0000","last_peered":"2024-09-12T01:07:12.736641+0000","last_clean":"2024-09-12T01:07:12.736641+0000","last_became_active":"2024-09-12T00:21:46.503412+0000","last_became_peered":"2024-09-12T00:21:46.503412+0000","last_unstale":"2024-09-12T01:07:12.736641+0000","last_undegraded":"2024-09-12T01:07:12.736641+0000","last_fullsized":"2024-09-12T01:07:12.736641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:47.686112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1679,"num_read_kb":2143,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'73","reported_seq":588,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.311430+0000","last_change":"2024-09-12T00:21:48.546361+0000","last_active":"2024-09-12T01:04:48.311430+0000","last_peered":"2024-09-12T01:04:48.311430+0000","last_clean":"2024-09-12T01:04:48.311430+0000","last_became_active":"2024-09-12T00:21:48.545388+0000","last_became_peered":"2024-09-12T00:21:48.545388+0000","last_unstale":"2024-09-12T01:04:48.311430+0000","last_undegraded":"2024-09-12T01:04:48.311430+0000","last_fullsized":"2024-09-12T01:04:48.311430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.386351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'766","reported_seq":4008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947470+0000","last_change":"2024-09-12T00:21:50.537415+0000","last_active":"2024-09-12T01:07:12.947470+0000","last_peered":"2024-09-12T01:07:12.947470+0000","last_clean":"2024-09-12T01:07:12.947470+0000","last_became_active":"2024-09-12T00:21:50.536672+0000","last_became_peered":"2024-09-12T00:21:50.536672+0000","last_unstale":"2024-09-12T01:07:12.947470+0000","last_undegraded":"2024-09-12T01:07:12.947470+0000","last_fullsized":"2024-09-12T01:07:12.947470+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.799043+0000","last_change":"2024-09-12T00:21:52.557213+0000","last_active":"2024-09-12T01:05:30.799043+0000","last_peered":"2024-09-12T01:05:30.799043+0000","last_clean":"2024-09-12T01:05:30.799043+0000","last_became_active":"2024-09-12T00:21:52.556523+0000","last_became_peered":"2024-09-12T00:21:52.556523+0000","last_unstale":"2024-09-12T01:05:30.799043+0000","last_undegraded":"2024-09-12T01:05:30.799043+0000","last_fullsized":"2024-09-12T01:05:30.799043+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:13.223517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":161,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'217","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.545950+0000","last_change":"2024-09-12T00:21:44.515428+0000","last_active":"2024-09-12T01:04:58.545950+0000","last_peered":"2024-09-12T01:04:58.545950+0000","last_clean":"2024-09-12T01:04:58.545950+0000","last_became_active":"2024-09-12T00:21:44.514085+0000","last_became_peered":"2024-09-12T00:21:44.514085+0000","last_unstale":"2024-09-12T01:04:58.545950+0000","last_undegraded":"2024-09-12T01:04:58.545950+0000","last_fullsized":"2024-09-12T01:04:58.545950+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:56.006782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":987,"num_read_kb":820,"num_write":332,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'290","reported_seq":906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.703704+0000","last_change":"2024-09-12T00:21:42.485706+0000","last_active":"2024-09-12T01:05:44.703704+0000","last_peered":"2024-09-12T01:05:44.703704+0000","last_clean":"2024-09-12T01:05:44.703704+0000","last_became_active":"2024-09-12T00:21:42.484728+0000","last_became_peered":"2024-09-12T00:21:42.484728+0000","last_unstale":"2024-09-12T01:05:44.703704+0000","last_undegraded":"2024-09-12T01:05:44.703704+0000","last_fullsized":"2024-09-12T01:05:44.703704+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:46.673395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486240,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":459,"num_read_kb":1781,"num_write":963,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.630684+0000","last_change":"2024-09-12T00:21:46.515775+0000","last_active":"2024-09-12T01:04:34.630684+0000","last_peered":"2024-09-12T01:04:34.630684+0000","last_clean":"2024-09-12T01:04:34.630684+0000","last_became_active":"2024-09-12T00:21:46.515469+0000","last_became_peered":"2024-09-12T00:21:46.515469+0000","last_unstale":"2024-09-12T01:04:34.630684+0000","last_undegraded":"2024-09-12T01:04:34.630684+0000","last_fullsized":"2024-09-12T01:04:34.630684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:12.258449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'337","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.419459+0000","last_change":"2024-09-12T00:21:48.524169+0000","last_active":"2024-09-12T01:06:49.419459+0000","last_peered":"2024-09-12T01:06:49.419459+0000","last_clean":"2024-09-12T01:06:49.419459+0000","last_became_active":"2024-09-12T00:21:48.523392+0000","last_became_peered":"2024-09-12T00:21:48.523392+0000","last_unstale":"2024-09-12T01:06:49.419459+0000","last_undegraded":"2024-09-12T01:06:49.419459+0000","last_fullsized":"2024-09-12T01:06:49.419459+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:05.832531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59967,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":1046,"num_write":434,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.755012+0000","last_change":"2024-09-12T00:21:50.567348+0000","last_active":"2024-09-12T01:04:39.755012+0000","last_peered":"2024-09-12T01:04:39.755012+0000","last_clean":"2024-09-12T01:04:39.755012+0000","last_became_active":"2024-09-12T00:21:50.566831+0000","last_became_peered":"2024-09-12T00:21:50.566831+0000","last_unstale":"2024-09-12T01:04:39.755012+0000","last_undegraded":"2024-09-12T01:04:39.755012+0000","last_fullsized":"2024-09-12T01:04:39.755012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:07.974869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'158","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.073492+0000","last_change":"2024-09-12T00:21:52.563487+0000","last_active":"2024-09-12T01:05:34.073492+0000","last_peered":"2024-09-12T01:05:34.073492+0000","last_clean":"2024-09-12T01:05:34.073492+0000","last_became_active":"2024-09-12T00:21:52.562716+0000","last_became_peered":"2024-09-12T00:21:52.562716+0000","last_unstale":"2024-09-12T01:05:34.073492+0000","last_undegraded":"2024-09-12T01:05:34.073492+0000","last_fullsized":"2024-09-12T01:05:34.073492+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:57.280882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":186,"num_write":388,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'137","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.221538+0000","last_change":"2024-09-12T00:21:44.503230+0000","last_active":"2024-09-12T01:05:43.221538+0000","last_peered":"2024-09-12T01:05:43.221538+0000","last_clean":"2024-09-12T01:05:43.221538+0000","last_became_active":"2024-09-12T00:21:44.502832+0000","last_became_peered":"2024-09-12T00:21:44.502832+0000","last_unstale":"2024-09-12T01:05:43.221538+0000","last_undegraded":"2024-09-12T01:05:43.221538+0000","last_fullsized":"2024-09-12T01:05:43.221538+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:03.323487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":521,"num_write":201,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.759168+0000","last_change":"2024-09-12T00:21:22.027534+0000","last_active":"2024-09-12T01:03:29.759168+0000","last_peered":"2024-09-12T01:03:29.759168+0000","last_clean":"2024-09-12T01:03:29.759168+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T01:03:29.759168+0000","last_undegraded":"2024-09-12T01:03:29.759168+0000","last_fullsized":"2024-09-12T01:03:29.759168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_clean_scrub_stamp":"2024-09-12T00:21:20.173671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:18.049959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640578+0000","last_change":"2024-09-12T00:21:28.254766+0000","last_active":"2024-09-12T01:05:14.640578+0000","last_peered":"2024-09-12T01:05:14.640578+0000","last_clean":"2024-09-12T01:05:14.640578+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T01:05:14.640578+0000","last_undegraded":"2024-09-12T01:05:14.640578+0000","last_fullsized":"2024-09-12T01:05:14.640578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:37.352626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'276","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.550233+0000","last_change":"2024-09-12T00:21:42.514559+0000","last_active":"2024-09-12T01:05:22.550233+0000","last_peered":"2024-09-12T01:05:22.550233+0000","last_clean":"2024-09-12T01:05:22.550233+0000","last_became_active":"2024-09-12T00:21:42.513672+0000","last_became_peered":"2024-09-12T00:21:42.513672+0000","last_unstale":"2024-09-12T01:05:22.550233+0000","last_undegraded":"2024-09-12T01:05:22.550233+0000","last_fullsized":"2024-09-12T01:05:22.550233+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:10.803601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285509,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":432,"num_read_kb":4546,"num_write":1020,"num_write_kb":26678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.577808+0000","last_change":"2024-09-12T00:21:46.506706+0000","last_active":"2024-09-12T01:03:29.577808+0000","last_peered":"2024-09-12T01:03:29.577808+0000","last_clean":"2024-09-12T01:03:29.577808+0000","last_became_active":"2024-09-12T00:21:46.506196+0000","last_became_peered":"2024-09-12T00:21:46.506196+0000","last_unstale":"2024-09-12T01:03:29.577808+0000","last_undegraded":"2024-09-12T01:03:29.577808+0000","last_fullsized":"2024-09-12T01:03:29.577808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:37.852267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'717","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.856519+0000","last_change":"2024-09-12T00:21:48.545130+0000","last_active":"2024-09-12T01:07:12.856519+0000","last_peered":"2024-09-12T01:07:12.856519+0000","last_clean":"2024-09-12T01:07:12.856519+0000","last_became_active":"2024-09-12T00:21:48.544327+0000","last_became_peered":"2024-09-12T00:21:48.544327+0000","last_unstale":"2024-09-12T01:07:12.856519+0000","last_undegraded":"2024-09-12T01:07:12.856519+0000","last_fullsized":"2024-09-12T01:07:12.856519+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:21.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168878,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1377,"num_read_kb":2876,"num_write":1288,"num_write_kb":1144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621223+0000","last_change":"2024-09-12T00:21:50.565245+0000","last_active":"2024-09-12T01:05:14.621223+0000","last_peered":"2024-09-12T01:05:14.621223+0000","last_clean":"2024-09-12T01:05:14.621223+0000","last_became_active":"2024-09-12T00:21:50.564442+0000","last_became_peered":"2024-09-12T00:21:50.564442+0000","last_unstale":"2024-09-12T01:05:14.621223+0000","last_undegraded":"2024-09-12T01:05:14.621223+0000","last_fullsized":"2024-09-12T01:05:14.621223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'206","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.344626+0000","last_change":"2024-09-12T00:21:52.557348+0000","last_active":"2024-09-12T01:06:07.344626+0000","last_peered":"2024-09-12T01:06:07.344626+0000","last_clean":"2024-09-12T01:06:07.344626+0000","last_became_active":"2024-09-12T00:21:52.550903+0000","last_became_peered":"2024-09-12T00:21:52.550903+0000","last_unstale":"2024-09-12T01:06:07.344626+0000","last_undegraded":"2024-09-12T01:06:07.344626+0000","last_fullsized":"2024-09-12T01:06:07.344626+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:10.990623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":429,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'100","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.182137+0000","last_change":"2024-09-12T00:21:44.519572+0000","last_active":"2024-09-12T01:05:29.182137+0000","last_peered":"2024-09-12T01:05:29.182137+0000","last_clean":"2024-09-12T01:05:29.182137+0000","last_became_active":"2024-09-12T00:21:44.518873+0000","last_became_peered":"2024-09-12T00:21:44.518873+0000","last_unstale":"2024-09-12T01:05:29.182137+0000","last_undegraded":"2024-09-12T01:05:29.182137+0000","last_fullsized":"2024-09-12T01:05:29.182137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:37.792281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":399,"num_write":140,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.615695+0000","last_change":"2024-09-12T00:21:28.254653+0000","last_active":"2024-09-12T01:03:39.615695+0000","last_peered":"2024-09-12T01:03:39.615695+0000","last_clean":"2024-09-12T01:03:39.615695+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T01:03:39.615695+0000","last_undegraded":"2024-09-12T01:03:39.615695+0000","last_fullsized":"2024-09-12T01:03:39.615695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:52.457807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'288","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.981722+0000","last_change":"2024-09-12T00:21:42.530775+0000","last_active":"2024-09-12T01:05:37.981722+0000","last_peered":"2024-09-12T01:05:37.981722+0000","last_clean":"2024-09-12T01:05:37.981722+0000","last_became_active":"2024-09-12T00:21:42.530049+0000","last_became_peered":"2024-09-12T00:21:42.530049+0000","last_unstale":"2024-09-12T01:05:37.981722+0000","last_undegraded":"2024-09-12T01:05:37.981722+0000","last_fullsized":"2024-09-12T01:05:37.981722+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.562005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4536165,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":739,"num_read_kb":7839,"num_write":1061,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.639489+0000","last_change":"2024-09-12T00:21:46.506977+0000","last_active":"2024-09-12T01:05:09.639489+0000","last_peered":"2024-09-12T01:05:09.639489+0000","last_clean":"2024-09-12T01:05:09.639489+0000","last_became_active":"2024-09-12T00:21:46.506303+0000","last_became_peered":"2024-09-12T00:21:46.506303+0000","last_unstale":"2024-09-12T01:05:09.639489+0000","last_undegraded":"2024-09-12T01:05:09.639489+0000","last_fullsized":"2024-09-12T01:05:09.639489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:15.859039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1265","reported_seq":2749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.380915+0000","last_change":"2024-09-12T00:21:48.539139+0000","last_active":"2024-09-12T01:07:27.380915+0000","last_peered":"2024-09-12T01:07:27.380915+0000","last_clean":"2024-09-12T01:07:27.380915+0000","last_became_active":"2024-09-12T00:21:48.538447+0000","last_became_peered":"2024-09-12T00:21:48.538447+0000","last_unstale":"2024-09-12T01:07:27.380915+0000","last_undegraded":"2024-09-12T01:07:27.380915+0000","last_fullsized":"2024-09-12T01:07:27.380915+0000","mapping_epoch":32,"log_start":"267'1200","ondisk_log_start":"267'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:58.399951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157796,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2036,"num_read_kb":3848,"num_write":1138,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617264+0000","last_change":"2024-09-12T00:21:50.569042+0000","last_active":"2024-09-12T01:03:44.617264+0000","last_peered":"2024-09-12T01:03:44.617264+0000","last_clean":"2024-09-12T01:03:44.617264+0000","last_became_active":"2024-09-12T00:21:50.568353+0000","last_became_peered":"2024-09-12T00:21:50.568353+0000","last_unstale":"2024-09-12T01:03:44.617264+0000","last_undegraded":"2024-09-12T01:03:44.617264+0000","last_fullsized":"2024-09-12T01:03:44.617264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'220","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.646102+0000","last_change":"2024-09-12T00:21:52.560037+0000","last_active":"2024-09-12T01:04:18.646102+0000","last_peered":"2024-09-12T01:04:18.646102+0000","last_clean":"2024-09-12T01:04:18.646102+0000","last_became_active":"2024-09-12T00:21:52.559325+0000","last_became_peered":"2024-09-12T00:21:52.559325+0000","last_unstale":"2024-09-12T01:04:18.646102+0000","last_undegraded":"2024-09-12T01:04:18.646102+0000","last_fullsized":"2024-09-12T01:04:18.646102+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:26.252511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":373,"num_write":495,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'235","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.199872+0000","last_change":"2024-09-12T00:21:44.499926+0000","last_active":"2024-09-12T01:05:36.199872+0000","last_peered":"2024-09-12T01:05:36.199872+0000","last_clean":"2024-09-12T01:05:36.199872+0000","last_became_active":"2024-09-12T00:21:44.499405+0000","last_became_peered":"2024-09-12T00:21:44.499405+0000","last_unstale":"2024-09-12T01:05:36.199872+0000","last_undegraded":"2024-09-12T01:05:36.199872+0000","last_fullsized":"2024-09-12T01:05:36.199872+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:43.127372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":847,"num_write":402,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600239+0000","last_change":"2024-09-12T00:21:28.255269+0000","last_active":"2024-09-12T01:05:13.600239+0000","last_peered":"2024-09-12T01:05:13.600239+0000","last_clean":"2024-09-12T01:05:13.600239+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T01:05:13.600239+0000","last_undegraded":"2024-09-12T01:05:13.600239+0000","last_fullsized":"2024-09-12T01:05:13.600239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:37.489457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'260","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.018485+0000","last_change":"2024-09-12T00:21:42.537155+0000","last_active":"2024-09-12T01:06:03.018485+0000","last_peered":"2024-09-12T01:06:03.018485+0000","last_clean":"2024-09-12T01:06:03.018485+0000","last_became_active":"2024-09-12T00:21:42.533356+0000","last_became_peered":"2024-09-12T00:21:42.533356+0000","last_unstale":"2024-09-12T01:06:03.018485+0000","last_undegraded":"2024-09-12T01:06:03.018485+0000","last_fullsized":"2024-09-12T01:06:03.018485+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10454589,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":341,"num_read_kb":11281,"num_write":913,"num_write_kb":25420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.599241+0000","last_change":"2024-09-12T00:21:46.511151+0000","last_active":"2024-09-12T01:05:08.599241+0000","last_peered":"2024-09-12T01:05:08.599241+0000","last_clean":"2024-09-12T01:05:08.599241+0000","last_became_active":"2024-09-12T00:21:46.510230+0000","last_became_peered":"2024-09-12T00:21:46.510230+0000","last_unstale":"2024-09-12T01:05:08.599241+0000","last_undegraded":"2024-09-12T01:05:08.599241+0000","last_fullsized":"2024-09-12T01:05:08.599241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:33.182597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'236","reported_seq":1333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947368+0000","last_change":"2024-09-12T00:21:48.543106+0000","last_active":"2024-09-12T01:07:12.947368+0000","last_peered":"2024-09-12T01:07:12.947368+0000","last_clean":"2024-09-12T01:07:12.947368+0000","last_became_active":"2024-09-12T00:21:48.541987+0000","last_became_peered":"2024-09-12T00:21:48.541987+0000","last_unstale":"2024-09-12T01:07:12.947368+0000","last_undegraded":"2024-09-12T01:07:12.947368+0000","last_fullsized":"2024-09-12T01:07:12.947368+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:35.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.571245+0000","last_change":"2024-09-12T00:21:50.550098+0000","last_active":"2024-09-12T01:03:34.571245+0000","last_peered":"2024-09-12T01:03:34.571245+0000","last_clean":"2024-09-12T01:03:34.571245+0000","last_became_active":"2024-09-12T00:21:50.549468+0000","last_became_peered":"2024-09-12T00:21:50.549468+0000","last_unstale":"2024-09-12T01:03:34.571245+0000","last_undegraded":"2024-09-12T01:03:34.571245+0000","last_fullsized":"2024-09-12T01:03:34.571245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:51.226795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'266","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.525444+0000","last_change":"2024-09-12T00:21:52.553306+0000","last_active":"2024-09-12T01:06:07.525444+0000","last_peered":"2024-09-12T01:06:07.525444+0000","last_clean":"2024-09-12T01:06:07.525444+0000","last_became_active":"2024-09-12T00:21:52.552571+0000","last_became_peered":"2024-09-12T00:21:52.552571+0000","last_unstale":"2024-09-12T01:06:07.525444+0000","last_undegraded":"2024-09-12T01:06:07.525444+0000","last_fullsized":"2024-09-12T01:06:07.525444+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.410934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":539,"num_write":598,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'152","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.291657+0000","last_change":"2024-09-12T00:21:44.494446+0000","last_active":"2024-09-12T01:05:46.291657+0000","last_peered":"2024-09-12T01:05:46.291657+0000","last_clean":"2024-09-12T01:05:46.291657+0000","last_became_active":"2024-09-12T00:21:44.493744+0000","last_became_peered":"2024-09-12T00:21:44.493744+0000","last_unstale":"2024-09-12T01:05:46.291657+0000","last_undegraded":"2024-09-12T01:05:46.291657+0000","last_fullsized":"2024-09-12T01:05:46.291657+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.811924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":592,"num_write":229,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640540+0000","last_change":"2024-09-12T00:21:28.255515+0000","last_active":"2024-09-12T01:05:14.640540+0000","last_peered":"2024-09-12T01:05:14.640540+0000","last_clean":"2024-09-12T01:05:14.640540+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T01:05:14.640540+0000","last_undegraded":"2024-09-12T01:05:14.640540+0000","last_fullsized":"2024-09-12T01:05:14.640540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:43.203836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'266","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.181183+0000","last_change":"2024-09-12T00:21:42.530327+0000","last_active":"2024-09-12T01:07:07.181183+0000","last_peered":"2024-09-12T01:07:07.181183+0000","last_clean":"2024-09-12T01:07:07.181183+0000","last_became_active":"2024-09-12T00:21:42.528949+0000","last_became_peered":"2024-09-12T00:21:42.528949+0000","last_unstale":"2024-09-12T01:07:07.181183+0000","last_undegraded":"2024-09-12T01:07:07.181183+0000","last_fullsized":"2024-09-12T01:07:07.181183+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.542668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16418323,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":416,"num_read_kb":67654,"num_write":972,"num_write_kb":55160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:38.578580+0000","last_change":"2024-09-12T00:21:46.518181+0000","last_active":"2024-09-12T01:03:38.578580+0000","last_peered":"2024-09-12T01:03:38.578580+0000","last_clean":"2024-09-12T01:03:38.578580+0000","last_became_active":"2024-09-12T00:21:46.517381+0000","last_became_peered":"2024-09-12T00:21:46.517381+0000","last_unstale":"2024-09-12T01:03:38.578580+0000","last_undegraded":"2024-09-12T01:03:38.578580+0000","last_fullsized":"2024-09-12T01:03:38.578580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:55.356740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'120","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.029686+0000","last_change":"2024-09-12T00:21:48.553881+0000","last_active":"2024-09-12T01:07:13.029686+0000","last_peered":"2024-09-12T01:07:13.029686+0000","last_clean":"2024-09-12T01:07:13.029686+0000","last_became_active":"2024-09-12T00:21:48.553129+0000","last_became_peered":"2024-09-12T00:21:48.553129+0000","last_unstale":"2024-09-12T01:07:13.029686+0000","last_undegraded":"2024-09-12T01:07:13.029686+0000","last_fullsized":"2024-09-12T01:07:13.029686+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:52.650170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640743+0000","last_change":"2024-09-12T00:21:50.545732+0000","last_active":"2024-09-12T01:05:14.640743+0000","last_peered":"2024-09-12T01:05:14.640743+0000","last_clean":"2024-09-12T01:05:14.640743+0000","last_became_active":"2024-09-12T00:21:50.545037+0000","last_became_peered":"2024-09-12T00:21:50.545037+0000","last_unstale":"2024-09-12T01:05:14.640743+0000","last_undegraded":"2024-09-12T01:05:14.640743+0000","last_fullsized":"2024-09-12T01:05:14.640743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'98","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.414533+0000","last_change":"2024-09-12T00:21:52.541609+0000","last_active":"2024-09-12T01:06:07.414533+0000","last_peered":"2024-09-12T01:06:07.414533+0000","last_clean":"2024-09-12T01:06:07.414533+0000","last_became_active":"2024-09-12T00:21:52.540900+0000","last_became_peered":"2024-09-12T00:21:52.540900+0000","last_unstale":"2024-09-12T01:06:07.414533+0000","last_undegraded":"2024-09-12T01:06:07.414533+0000","last_fullsized":"2024-09-12T01:06:07.414533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:38.138742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":212,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'221","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:00.984004+0000","last_change":"2024-09-12T00:21:44.498171+0000","last_active":"2024-09-12T01:04:00.984004+0000","last_peered":"2024-09-12T01:04:00.984004+0000","last_clean":"2024-09-12T01:04:00.984004+0000","last_became_active":"2024-09-12T00:21:44.497354+0000","last_became_peered":"2024-09-12T00:21:44.497354+0000","last_unstale":"2024-09-12T01:04:00.984004+0000","last_undegraded":"2024-09-12T01:04:00.984004+0000","last_fullsized":"2024-09-12T01:04:00.984004+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:14.091559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":990,"num_read_kb":806,"num_write":357,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'241","reported_seq":872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.977380+0000","last_change":"2024-09-12T00:21:42.522295+0000","last_active":"2024-09-12T01:05:37.977380+0000","last_peered":"2024-09-12T01:05:37.977380+0000","last_clean":"2024-09-12T01:05:37.977380+0000","last_became_active":"2024-09-12T00:21:42.521990+0000","last_became_peered":"2024-09-12T00:21:42.521990+0000","last_unstale":"2024-09-12T01:05:37.977380+0000","last_undegraded":"2024-09-12T01:05:37.977380+0000","last_fullsized":"2024-09-12T01:05:37.977380+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:21.962527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14471811,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":384,"num_read_kb":61831,"num_write":942,"num_write_kb":29041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621065+0000","last_change":"2024-09-12T00:21:28.750763+0000","last_active":"2024-09-12T01:05:14.621065+0000","last_peered":"2024-09-12T01:05:14.621065+0000","last_clean":"2024-09-12T01:05:14.621065+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T01:05:14.621065+0000","last_undegraded":"2024-09-12T01:05:14.621065+0000","last_fullsized":"2024-09-12T01:05:14.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:40.130897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.570148+0000","last_change":"2024-09-12T00:21:46.499113+0000","last_active":"2024-09-12T01:03:29.570148+0000","last_peered":"2024-09-12T01:03:29.570148+0000","last_clean":"2024-09-12T01:03:29.570148+0000","last_became_active":"2024-09-12T00:21:46.498378+0000","last_became_peered":"2024-09-12T00:21:46.498378+0000","last_unstale":"2024-09-12T01:03:29.570148+0000","last_undegraded":"2024-09-12T01:03:29.570148+0000","last_fullsized":"2024-09-12T01:03:29.570148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:56.000475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'578","reported_seq":1246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.989988+0000","last_change":"2024-09-12T00:21:48.535483+0000","last_active":"2024-09-12T01:07:26.989988+0000","last_peered":"2024-09-12T01:07:26.989988+0000","last_clean":"2024-09-12T01:07:26.989988+0000","last_became_active":"2024-09-12T00:21:48.534749+0000","last_became_peered":"2024-09-12T00:21:48.534749+0000","last_unstale":"2024-09-12T01:07:26.989988+0000","last_undegraded":"2024-09-12T01:07:26.989988+0000","last_fullsized":"2024-09-12T01:07:26.989988+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:39.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96095,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1602,"num_read_kb":2762,"num_write":2078,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.739282+0000","last_change":"2024-09-12T00:21:50.556186+0000","last_active":"2024-09-12T01:03:34.739282+0000","last_peered":"2024-09-12T01:03:34.739282+0000","last_clean":"2024-09-12T01:03:34.739282+0000","last_became_active":"2024-09-12T00:21:50.554728+0000","last_became_peered":"2024-09-12T00:21:50.554728+0000","last_unstale":"2024-09-12T01:03:34.739282+0000","last_undegraded":"2024-09-12T01:03:34.739282+0000","last_fullsized":"2024-09-12T01:03:34.739282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:49.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'174","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.400639+0000","last_change":"2024-09-12T00:21:52.558976+0000","last_active":"2024-09-12T01:05:25.400639+0000","last_peered":"2024-09-12T01:05:25.400639+0000","last_clean":"2024-09-12T01:05:25.400639+0000","last_became_active":"2024-09-12T00:21:52.558203+0000","last_became_peered":"2024-09-12T00:21:52.558203+0000","last_unstale":"2024-09-12T01:05:25.400639+0000","last_undegraded":"2024-09-12T01:05:25.400639+0000","last_fullsized":"2024-09-12T01:05:25.400639+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:46.691847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1145,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":410,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'196","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.150715+0000","last_change":"2024-09-12T00:21:44.498346+0000","last_active":"2024-09-12T01:05:52.150715+0000","last_peered":"2024-09-12T01:05:52.150715+0000","last_clean":"2024-09-12T01:05:52.150715+0000","last_became_active":"2024-09-12T00:21:44.497510+0000","last_became_peered":"2024-09-12T00:21:44.497510+0000","last_unstale":"2024-09-12T01:05:52.150715+0000","last_undegraded":"2024-09-12T01:05:52.150715+0000","last_fullsized":"2024-09-12T01:05:52.150715+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:28.893058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":719,"num_write":306,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'268","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.560350+0000","last_change":"2024-09-12T00:21:42.529749+0000","last_active":"2024-09-12T01:05:51.560350+0000","last_peered":"2024-09-12T01:05:51.560350+0000","last_clean":"2024-09-12T01:05:51.560350+0000","last_became_active":"2024-09-12T00:21:42.529084+0000","last_became_peered":"2024-09-12T00:21:42.529084+0000","last_unstale":"2024-09-12T01:05:51.560350+0000","last_undegraded":"2024-09-12T01:05:51.560350+0000","last_fullsized":"2024-09-12T01:05:51.560350+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:23.266713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052743,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":435,"num_read_kb":3172,"num_write":1024,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.610735+0000","last_change":"2024-09-12T00:21:28.256092+0000","last_active":"2024-09-12T01:03:19.610735+0000","last_peered":"2024-09-12T01:03:19.610735+0000","last_clean":"2024-09-12T01:03:19.610735+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T01:03:19.610735+0000","last_undegraded":"2024-09-12T01:03:19.610735+0000","last_fullsized":"2024-09-12T01:03:19.610735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:41.836946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.577690+0000","last_change":"2024-09-12T00:21:46.507947+0000","last_active":"2024-09-12T01:03:29.577690+0000","last_peered":"2024-09-12T01:03:29.577690+0000","last_clean":"2024-09-12T01:03:29.577690+0000","last_became_active":"2024-09-12T00:21:46.507150+0000","last_became_peered":"2024-09-12T00:21:46.507150+0000","last_unstale":"2024-09-12T01:03:29.577690+0000","last_undegraded":"2024-09-12T01:03:29.577690+0000","last_fullsized":"2024-09-12T01:03:29.577690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:27.994405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'166","reported_seq":730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.042400+0000","last_change":"2024-09-12T00:21:48.546326+0000","last_active":"2024-09-12T01:04:58.042400+0000","last_peered":"2024-09-12T01:04:58.042400+0000","last_clean":"2024-09-12T01:04:58.042400+0000","last_became_active":"2024-09-12T00:21:48.545244+0000","last_became_peered":"2024-09-12T00:21:48.545244+0000","last_unstale":"2024-09-12T01:04:58.042400+0000","last_undegraded":"2024-09-12T01:04:58.042400+0000","last_fullsized":"2024-09-12T01:04:58.042400+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.959520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'768","reported_seq":2798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947416+0000","last_change":"2024-09-12T00:21:50.566794+0000","last_active":"2024-09-12T01:07:12.947416+0000","last_peered":"2024-09-12T01:07:12.947416+0000","last_clean":"2024-09-12T01:07:12.947416+0000","last_became_active":"2024-09-12T00:21:50.565930+0000","last_became_peered":"2024-09-12T00:21:50.565930+0000","last_unstale":"2024-09-12T01:07:12.947416+0000","last_undegraded":"2024-09-12T01:07:12.947416+0000","last_fullsized":"2024-09-12T01:07:12.947416+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:10.827538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.868125+0000","last_change":"2024-09-12T00:21:52.563826+0000","last_active":"2024-09-12T01:07:12.868125+0000","last_peered":"2024-09-12T01:07:12.868125+0000","last_clean":"2024-09-12T01:07:12.868125+0000","last_became_active":"2024-09-12T00:21:52.562765+0000","last_became_peered":"2024-09-12T00:21:52.562765+0000","last_unstale":"2024-09-12T01:07:12.868125+0000","last_undegraded":"2024-09-12T01:07:12.868125+0000","last_fullsized":"2024-09-12T01:07:12.868125+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.216884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":136,"num_write":336,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'106","reported_seq":691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.575375+0000","last_change":"2024-09-12T00:21:44.493205+0000","last_active":"2024-09-12T01:03:54.575375+0000","last_peered":"2024-09-12T01:03:54.575375+0000","last_clean":"2024-09-12T01:03:54.575375+0000","last_became_active":"2024-09-12T00:21:44.492443+0000","last_became_peered":"2024-09-12T00:21:44.492443+0000","last_unstale":"2024-09-12T01:03:54.575375+0000","last_undegraded":"2024-09-12T01:03:54.575375+0000","last_fullsized":"2024-09-12T01:03:54.575375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:20.383680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":379,"num_write":156,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'261","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.383871+0000","last_change":"2024-09-12T00:21:42.506233+0000","last_active":"2024-09-12T01:05:26.383871+0000","last_peered":"2024-09-12T01:05:26.383871+0000","last_clean":"2024-09-12T01:05:26.383871+0000","last_became_active":"2024-09-12T00:21:42.505355+0000","last_became_peered":"2024-09-12T00:21:42.505355+0000","last_unstale":"2024-09-12T01:05:26.383871+0000","last_undegraded":"2024-09-12T01:05:26.383871+0000","last_fullsized":"2024-09-12T01:05:26.383871+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:51.142709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5315687,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":8879,"num_write":1053,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587669+0000","last_change":"2024-09-12T00:21:28.670456+0000","last_active":"2024-09-12T01:04:49.587669+0000","last_peered":"2024-09-12T01:04:49.587669+0000","last_clean":"2024-09-12T01:04:49.587669+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T01:04:49.587669+0000","last_undegraded":"2024-09-12T01:04:49.587669+0000","last_fullsized":"2024-09-12T01:04:49.587669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:30.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.613152+0000","last_change":"2024-09-12T00:21:46.507186+0000","last_active":"2024-09-12T01:03:29.613152+0000","last_peered":"2024-09-12T01:03:29.613152+0000","last_clean":"2024-09-12T01:03:29.613152+0000","last_became_active":"2024-09-12T00:21:46.506416+0000","last_became_peered":"2024-09-12T00:21:46.506416+0000","last_unstale":"2024-09-12T01:03:29.613152+0000","last_undegraded":"2024-09-12T01:03:29.613152+0000","last_fullsized":"2024-09-12T01:03:29.613152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:06.407604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'112","reported_seq":655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.074689+0000","last_change":"2024-09-12T00:21:48.541779+0000","last_active":"2024-09-12T01:05:04.074689+0000","last_peered":"2024-09-12T01:05:04.074689+0000","last_clean":"2024-09-12T01:05:04.074689+0000","last_became_active":"2024-09-12T00:21:48.541051+0000","last_became_peered":"2024-09-12T00:21:48.541051+0000","last_unstale":"2024-09-12T01:05:04.074689+0000","last_undegraded":"2024-09-12T01:05:04.074689+0000","last_fullsized":"2024-09-12T01:05:04.074689+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:48.095228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'775","reported_seq":2249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.948032+0000","last_change":"2024-09-12T00:21:50.565496+0000","last_active":"2024-09-12T01:07:12.948032+0000","last_peered":"2024-09-12T01:07:12.948032+0000","last_clean":"2024-09-12T01:07:12.948032+0000","last_became_active":"2024-09-12T00:21:50.564982+0000","last_became_peered":"2024-09-12T00:21:50.564982+0000","last_unstale":"2024-09-12T01:07:12.948032+0000","last_undegraded":"2024-09-12T01:07:12.948032+0000","last_fullsized":"2024-09-12T01:07:12.948032+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:45.360699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'150","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.238137+0000","last_change":"2024-09-12T00:21:52.556569+0000","last_active":"2024-09-12T01:05:51.238137+0000","last_peered":"2024-09-12T01:05:51.238137+0000","last_clean":"2024-09-12T01:05:51.238137+0000","last_became_active":"2024-09-12T00:21:52.555909+0000","last_became_peered":"2024-09-12T00:21:52.555909+0000","last_unstale":"2024-09-12T01:05:51.238137+0000","last_undegraded":"2024-09-12T01:05:51.238137+0000","last_fullsized":"2024-09-12T01:05:51.238137+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:36.848678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":331,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'167","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:02.021470+0000","last_change":"2024-09-12T00:21:44.494606+0000","last_active":"2024-09-12T01:06:02.021470+0000","last_peered":"2024-09-12T01:06:02.021470+0000","last_clean":"2024-09-12T01:06:02.021470+0000","last_became_active":"2024-09-12T00:21:44.494215+0000","last_became_peered":"2024-09-12T00:21:44.494215+0000","last_unstale":"2024-09-12T01:06:02.021470+0000","last_undegraded":"2024-09-12T01:06:02.021470+0000","last_fullsized":"2024-09-12T01:06:02.021470+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:08.392897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":568,"num_write":276,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'310","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.588319+0000","last_change":"2024-09-12T00:21:42.495485+0000","last_active":"2024-09-12T01:05:47.588319+0000","last_peered":"2024-09-12T01:05:47.588319+0000","last_clean":"2024-09-12T01:05:47.588319+0000","last_became_active":"2024-09-12T00:21:42.494486+0000","last_became_peered":"2024-09-12T00:21:42.494486+0000","last_unstale":"2024-09-12T01:05:47.588319+0000","last_undegraded":"2024-09-12T01:05:47.588319+0000","last_fullsized":"2024-09-12T01:05:47.588319+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.868593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4223711,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":471,"num_read_kb":23252,"num_write":1167,"num_write_kb":41943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634565+0000","last_change":"2024-09-12T00:21:28.255394+0000","last_active":"2024-09-12T01:04:49.634565+0000","last_peered":"2024-09-12T01:04:49.634565+0000","last_clean":"2024-09-12T01:04:49.634565+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T01:04:49.634565+0000","last_undegraded":"2024-09-12T01:04:49.634565+0000","last_fullsized":"2024-09-12T01:04:49.634565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:59.294638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.576422+0000","last_change":"2024-09-12T00:21:46.491161+0000","last_active":"2024-09-12T01:03:59.576422+0000","last_peered":"2024-09-12T01:03:59.576422+0000","last_clean":"2024-09-12T01:03:59.576422+0000","last_became_active":"2024-09-12T00:21:46.490398+0000","last_became_peered":"2024-09-12T00:21:46.490398+0000","last_unstale":"2024-09-12T01:03:59.576422+0000","last_undegraded":"2024-09-12T01:03:59.576422+0000","last_fullsized":"2024-09-12T01:03:59.576422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:39.280351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'701","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.809996+0000","last_change":"2024-09-12T00:21:48.545913+0000","last_active":"2024-09-12T01:07:12.809996+0000","last_peered":"2024-09-12T01:07:12.809996+0000","last_clean":"2024-09-12T01:07:12.809996+0000","last_became_active":"2024-09-12T00:21:48.543101+0000","last_became_peered":"2024-09-12T00:21:48.543101+0000","last_unstale":"2024-09-12T01:07:12.809996+0000","last_undegraded":"2024-09-12T01:07:12.809996+0000","last_fullsized":"2024-09-12T01:07:12.809996+0000","mapping_epoch":32,"log_start":"267'600","ondisk_log_start":"267'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190375,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1252,"num_read_kb":2706,"num_write":1030,"num_write_kb":879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.571169+0000","last_change":"2024-09-12T00:21:50.551312+0000","last_active":"2024-09-12T01:03:34.571169+0000","last_peered":"2024-09-12T01:03:34.571169+0000","last_clean":"2024-09-12T01:03:34.571169+0000","last_became_active":"2024-09-12T00:21:50.549692+0000","last_became_peered":"2024-09-12T00:21:50.549692+0000","last_unstale":"2024-09-12T01:03:34.571169+0000","last_undegraded":"2024-09-12T01:03:34.571169+0000","last_fullsized":"2024-09-12T01:03:34.571169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:16.254094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'107","reported_seq":601,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.235026+0000","last_change":"2024-09-12T00:21:52.556774+0000","last_active":"2024-09-12T01:05:43.235026+0000","last_peered":"2024-09-12T01:05:43.235026+0000","last_clean":"2024-09-12T01:05:43.235026+0000","last_became_active":"2024-09-12T00:21:52.556038+0000","last_became_peered":"2024-09-12T00:21:52.556038+0000","last_unstale":"2024-09-12T01:05:43.235026+0000","last_undegraded":"2024-09-12T01:05:43.235026+0000","last_fullsized":"2024-09-12T01:05:43.235026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:26.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":258,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'117","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.624149+0000","last_change":"2024-09-12T00:21:52.538201+0000","last_active":"2024-09-12T01:06:06.624149+0000","last_peered":"2024-09-12T01:06:06.624149+0000","last_clean":"2024-09-12T01:06:06.624149+0000","last_became_active":"2024-09-12T00:21:52.537464+0000","last_became_peered":"2024-09-12T00:21:52.537464+0000","last_unstale":"2024-09-12T01:06:06.624149+0000","last_undegraded":"2024-09-12T01:06:06.624149+0000","last_fullsized":"2024-09-12T01:06:06.624149+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:06.332481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":226,"num_write":297,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'147","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.222011+0000","last_change":"2024-09-12T00:21:44.507294+0000","last_active":"2024-09-12T01:04:11.222011+0000","last_peered":"2024-09-12T01:04:11.222011+0000","last_clean":"2024-09-12T01:04:11.222011+0000","last_became_active":"2024-09-12T00:21:44.494375+0000","last_became_peered":"2024-09-12T00:21:44.494375+0000","last_unstale":"2024-09-12T01:04:11.222011+0000","last_undegraded":"2024-09-12T01:04:11.222011+0000","last_fullsized":"2024-09-12T01:04:11.222011+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:57.052664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":613,"num_write":235,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.567138+0000","last_change":"2024-09-12T00:21:42.495876+0000","last_active":"2024-09-12T01:05:31.567138+0000","last_peered":"2024-09-12T01:05:31.567138+0000","last_clean":"2024-09-12T01:05:31.567138+0000","last_became_active":"2024-09-12T00:21:42.495160+0000","last_became_peered":"2024-09-12T00:21:42.495160+0000","last_unstale":"2024-09-12T01:05:31.567138+0000","last_undegraded":"2024-09-12T01:05:31.567138+0000","last_fullsized":"2024-09-12T01:05:31.567138+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.406950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10079349,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":597,"num_read_kb":36666,"num_write":1217,"num_write_kb":30706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.576962+0000","last_change":"2024-09-12T00:21:46.504482+0000","last_active":"2024-09-12T01:03:49.576962+0000","last_peered":"2024-09-12T01:03:49.576962+0000","last_clean":"2024-09-12T01:03:49.576962+0000","last_became_active":"2024-09-12T00:21:46.503594+0000","last_became_peered":"2024-09-12T00:21:46.503594+0000","last_unstale":"2024-09-12T01:03:49.576962+0000","last_undegraded":"2024-09-12T01:03:49.576962+0000","last_fullsized":"2024-09-12T01:03:49.576962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:50.259430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'268","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.976069+0000","last_change":"2024-09-12T00:21:48.546884+0000","last_active":"2024-09-12T01:07:11.976069+0000","last_peered":"2024-09-12T01:07:11.976069+0000","last_clean":"2024-09-12T01:07:11.976069+0000","last_became_active":"2024-09-12T00:21:48.546213+0000","last_became_peered":"2024-09-12T00:21:48.546213+0000","last_unstale":"2024-09-12T01:07:11.976069+0000","last_undegraded":"2024-09-12T01:07:11.976069+0000","last_fullsized":"2024-09-12T01:07:11.976069+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:17.869108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53909,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":423,"num_read_kb":860,"num_write":342,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581894+0000","last_change":"2024-09-12T00:21:50.549810+0000","last_active":"2024-09-12T01:03:53.581894+0000","last_peered":"2024-09-12T01:03:53.581894+0000","last_clean":"2024-09-12T01:03:53.581894+0000","last_became_active":"2024-09-12T00:21:50.549135+0000","last_became_peered":"2024-09-12T00:21:50.549135+0000","last_unstale":"2024-09-12T01:03:53.581894+0000","last_undegraded":"2024-09-12T01:03:53.581894+0000","last_fullsized":"2024-09-12T01:03:53.581894+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:36.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'126","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.920723+0000","last_change":"2024-09-12T00:21:52.563982+0000","last_active":"2024-09-12T01:07:11.920723+0000","last_peered":"2024-09-12T01:07:11.920723+0000","last_clean":"2024-09-12T01:07:11.920723+0000","last_became_active":"2024-09-12T00:21:52.563303+0000","last_became_peered":"2024-09-12T00:21:52.563303+0000","last_unstale":"2024-09-12T01:07:11.920723+0000","last_undegraded":"2024-09-12T01:07:11.920723+0000","last_fullsized":"2024-09-12T01:07:11.920723+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:33.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":144,"num_write":323,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'152","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.618706+0000","last_change":"2024-09-12T00:21:44.498404+0000","last_active":"2024-09-12T01:04:20.618706+0000","last_peered":"2024-09-12T01:04:20.618706+0000","last_clean":"2024-09-12T01:04:20.618706+0000","last_became_active":"2024-09-12T00:21:44.495299+0000","last_became_peered":"2024-09-12T00:21:44.495299+0000","last_unstale":"2024-09-12T01:04:20.618706+0000","last_undegraded":"2024-09-12T01:04:20.618706+0000","last_fullsized":"2024-09-12T01:04:20.618706+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":653,"num_read_kb":535,"num_write":221,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'226","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.596992+0000","last_change":"2024-09-12T00:21:42.511183+0000","last_active":"2024-09-12T01:05:46.596992+0000","last_peered":"2024-09-12T01:05:46.596992+0000","last_clean":"2024-09-12T01:05:46.596992+0000","last_became_active":"2024-09-12T00:21:42.510774+0000","last_became_peered":"2024-09-12T00:21:42.510774+0000","last_unstale":"2024-09-12T01:05:46.596992+0000","last_undegraded":"2024-09-12T01:05:46.596992+0000","last_fullsized":"2024-09-12T01:05:46.596992+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:35.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6805157,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":384,"num_read_kb":10210,"num_write":868,"num_write_kb":22659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574388+0000","last_change":"2024-09-12T00:21:46.499247+0000","last_active":"2024-09-12T01:03:49.574388+0000","last_peered":"2024-09-12T01:03:49.574388+0000","last_clean":"2024-09-12T01:03:49.574388+0000","last_became_active":"2024-09-12T00:21:46.498536+0000","last_became_peered":"2024-09-12T00:21:46.498536+0000","last_unstale":"2024-09-12T01:03:49.574388+0000","last_undegraded":"2024-09-12T01:03:49.574388+0000","last_fullsized":"2024-09-12T01:03:49.574388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:23.854256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'42","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.160500+0000","last_change":"2024-09-12T00:21:48.530906+0000","last_active":"2024-09-12T01:04:59.160500+0000","last_peered":"2024-09-12T01:04:59.160500+0000","last_clean":"2024-09-12T01:04:59.160500+0000","last_became_active":"2024-09-12T00:21:48.528299+0000","last_became_peered":"2024-09-12T00:21:48.528299+0000","last_unstale":"2024-09-12T01:04:59.160500+0000","last_undegraded":"2024-09-12T01:04:59.160500+0000","last_fullsized":"2024-09-12T01:04:59.160500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:04.289536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.744259+0000","last_change":"2024-09-12T00:21:50.555449+0000","last_active":"2024-09-12T01:03:54.744259+0000","last_peered":"2024-09-12T01:03:54.744259+0000","last_clean":"2024-09-12T01:03:54.744259+0000","last_became_active":"2024-09-12T00:21:50.553714+0000","last_became_peered":"2024-09-12T00:21:50.553714+0000","last_unstale":"2024-09-12T01:03:54.744259+0000","last_undegraded":"2024-09-12T01:03:54.744259+0000","last_fullsized":"2024-09-12T01:03:54.744259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:49.756435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'214","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.327000+0000","last_change":"2024-09-12T00:21:52.557187+0000","last_active":"2024-09-12T01:06:07.327000+0000","last_peered":"2024-09-12T01:06:07.327000+0000","last_clean":"2024-09-12T01:06:07.327000+0000","last_became_active":"2024-09-12T00:21:52.556407+0000","last_became_peered":"2024-09-12T00:21:52.556407+0000","last_unstale":"2024-09-12T01:06:07.327000+0000","last_undegraded":"2024-09-12T01:06:07.327000+0000","last_fullsized":"2024-09-12T01:06:07.327000+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.366159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":286,"num_write":472,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'340","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.973379+0000","last_change":"2024-09-12T00:21:44.501770+0000","last_active":"2024-09-12T01:04:13.973379+0000","last_peered":"2024-09-12T01:04:13.973379+0000","last_clean":"2024-09-12T01:04:13.973379+0000","last_became_active":"2024-09-12T00:21:44.499891+0000","last_became_peered":"2024-09-12T00:21:44.499891+0000","last_unstale":"2024-09-12T01:04:13.973379+0000","last_undegraded":"2024-09-12T01:04:13.973379+0000","last_fullsized":"2024-09-12T01:04:13.973379+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.959531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1519,"num_read_kb":1239,"num_write":521,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'249","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.016790+0000","last_change":"2024-09-12T00:21:42.534894+0000","last_active":"2024-09-12T01:06:03.016790+0000","last_peered":"2024-09-12T01:06:03.016790+0000","last_clean":"2024-09-12T01:06:03.016790+0000","last_became_active":"2024-09-12T00:21:42.534537+0000","last_became_peered":"2024-09-12T00:21:42.534537+0000","last_unstale":"2024-09-12T01:06:03.016790+0000","last_undegraded":"2024-09-12T01:06:03.016790+0000","last_fullsized":"2024-09-12T01:06:03.016790+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.812543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224401,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":327,"num_read_kb":22569,"num_write":906,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743057+0000","last_change":"2024-09-12T00:21:46.489769+0000","last_active":"2024-09-12T01:03:49.743057+0000","last_peered":"2024-09-12T01:03:49.743057+0000","last_clean":"2024-09-12T01:03:49.743057+0000","last_became_active":"2024-09-12T00:21:46.489054+0000","last_became_peered":"2024-09-12T00:21:46.489054+0000","last_unstale":"2024-09-12T01:03:49.743057+0000","last_undegraded":"2024-09-12T01:03:49.743057+0000","last_fullsized":"2024-09-12T01:03:49.743057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:29.459282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'291","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.866262+0000","last_change":"2024-09-12T00:21:48.550280+0000","last_active":"2024-09-12T01:07:26.866262+0000","last_peered":"2024-09-12T01:07:26.866262+0000","last_clean":"2024-09-12T01:07:26.866262+0000","last_became_active":"2024-09-12T00:21:48.549368+0000","last_became_peered":"2024-09-12T00:21:48.549368+0000","last_unstale":"2024-09-12T01:07:26.866262+0000","last_undegraded":"2024-09-12T01:07:26.866262+0000","last_fullsized":"2024-09-12T01:07:26.866262+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:05.929053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56273,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1054,"num_write":388,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.765195+0000","last_change":"2024-09-12T00:21:50.566488+0000","last_active":"2024-09-12T01:03:54.765195+0000","last_peered":"2024-09-12T01:03:54.765195+0000","last_clean":"2024-09-12T01:03:54.765195+0000","last_became_active":"2024-09-12T00:21:50.565753+0000","last_became_peered":"2024-09-12T00:21:50.565753+0000","last_unstale":"2024-09-12T01:03:54.765195+0000","last_undegraded":"2024-09-12T01:03:54.765195+0000","last_fullsized":"2024-09-12T01:03:54.765195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:49.492114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.980755+0000","last_change":"2024-09-12T00:21:52.565618+0000","last_active":"2024-09-12T01:05:39.980755+0000","last_peered":"2024-09-12T01:05:39.980755+0000","last_clean":"2024-09-12T01:05:39.980755+0000","last_became_active":"2024-09-12T00:21:52.559213+0000","last_became_peered":"2024-09-12T00:21:52.559213+0000","last_unstale":"2024-09-12T01:05:39.980755+0000","last_undegraded":"2024-09-12T01:05:39.980755+0000","last_fullsized":"2024-09-12T01:05:39.980755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.549214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":329,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'146","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.117283+0000","last_change":"2024-09-12T00:21:44.508192+0000","last_active":"2024-09-12T01:05:42.117283+0000","last_peered":"2024-09-12T01:05:42.117283+0000","last_clean":"2024-09-12T01:05:42.117283+0000","last_became_active":"2024-09-12T00:21:44.507460+0000","last_became_peered":"2024-09-12T00:21:44.507460+0000","last_unstale":"2024-09-12T01:05:42.117283+0000","last_undegraded":"2024-09-12T01:05:42.117283+0000","last_fullsized":"2024-09-12T01:05:42.117283+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:54.113624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":507,"num_write":216,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'276","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.370911+0000","last_change":"2024-09-12T00:21:42.520089+0000","last_active":"2024-09-12T01:04:18.370911+0000","last_peered":"2024-09-12T01:04:18.370911+0000","last_clean":"2024-09-12T01:04:18.370911+0000","last_became_active":"2024-09-12T00:21:42.517333+0000","last_became_peered":"2024-09-12T00:21:42.517333+0000","last_unstale":"2024-09-12T01:04:18.370911+0000","last_undegraded":"2024-09-12T01:04:18.370911+0000","last_fullsized":"2024-09-12T01:04:18.370911+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.752943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14478325,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":375,"num_read_kb":50264,"num_write":980,"num_write_kb":41560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618453+0000","last_change":"2024-09-12T00:21:46.502471+0000","last_active":"2024-09-12T01:03:49.618453+0000","last_peered":"2024-09-12T01:03:49.618453+0000","last_clean":"2024-09-12T01:03:49.618453+0000","last_became_active":"2024-09-12T00:21:46.501673+0000","last_became_peered":"2024-09-12T00:21:46.501673+0000","last_unstale":"2024-09-12T01:03:49.618453+0000","last_undegraded":"2024-09-12T01:03:49.618453+0000","last_fullsized":"2024-09-12T01:03:49.618453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'268","reported_seq":833,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:09.614123+0000","last_change":"2024-09-12T00:21:48.538585+0000","last_active":"2024-09-12T01:06:09.614123+0000","last_peered":"2024-09-12T01:06:09.614123+0000","last_clean":"2024-09-12T01:06:09.614123+0000","last_became_active":"2024-09-12T00:21:48.537864+0000","last_became_peered":"2024-09-12T00:21:48.537864+0000","last_unstale":"2024-09-12T01:06:09.614123+0000","last_undegraded":"2024-09-12T01:06:09.614123+0000","last_fullsized":"2024-09-12T01:06:09.614123+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:33.610420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58259,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":936,"num_write":366,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581973+0000","last_change":"2024-09-12T00:21:50.561361+0000","last_active":"2024-09-12T01:03:53.581973+0000","last_peered":"2024-09-12T01:03:53.581973+0000","last_clean":"2024-09-12T01:03:53.581973+0000","last_became_active":"2024-09-12T00:21:50.560805+0000","last_became_peered":"2024-09-12T00:21:50.560805+0000","last_unstale":"2024-09-12T01:03:53.581973+0000","last_undegraded":"2024-09-12T01:03:53.581973+0000","last_fullsized":"2024-09-12T01:03:53.581973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:00.373479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'385","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.779861+0000","last_change":"2024-09-12T00:21:44.516768+0000","last_active":"2024-09-12T01:04:59.779861+0000","last_peered":"2024-09-12T01:04:59.779861+0000","last_clean":"2024-09-12T01:04:59.779861+0000","last_became_active":"2024-09-12T00:21:44.516321+0000","last_became_peered":"2024-09-12T00:21:44.516321+0000","last_unstale":"2024-09-12T01:04:59.779861+0000","last_undegraded":"2024-09-12T01:04:59.779861+0000","last_fullsized":"2024-09-12T01:04:59.779861+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:16.398087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1787,"num_read_kb":1547,"num_write":658,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'271","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.971040+0000","last_change":"2024-09-12T00:22:13.520852+0000","last_active":"2024-09-12T01:03:13.971040+0000","last_peered":"2024-09-12T01:03:13.971040+0000","last_clean":"2024-09-12T01:03:13.971040+0000","last_became_active":"2024-09-12T00:22:13.519954+0000","last_became_peered":"2024-09-12T00:22:13.519954+0000","last_unstale":"2024-09-12T01:03:13.971040+0000","last_undegraded":"2024-09-12T01:03:13.971040+0000","last_fullsized":"2024-09-12T01:03:13.971040+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:59.772753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6272573,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":412,"num_read_kb":32939,"num_write":1035,"num_write_kb":17030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.579239+0000","last_change":"2024-09-12T00:21:46.504485+0000","last_active":"2024-09-12T01:03:59.579239+0000","last_peered":"2024-09-12T01:03:59.579239+0000","last_clean":"2024-09-12T01:03:59.579239+0000","last_became_active":"2024-09-12T00:21:46.503646+0000","last_became_peered":"2024-09-12T00:21:46.503646+0000","last_unstale":"2024-09-12T01:03:59.579239+0000","last_undegraded":"2024-09-12T01:03:59.579239+0000","last_fullsized":"2024-09-12T01:03:59.579239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:24.062861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'512","reported_seq":1133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.804264+0000","last_change":"2024-09-12T00:21:48.548531+0000","last_active":"2024-09-12T01:07:12.804264+0000","last_peered":"2024-09-12T01:07:12.804264+0000","last_clean":"2024-09-12T01:07:12.804264+0000","last_became_active":"2024-09-12T00:21:48.547827+0000","last_became_peered":"2024-09-12T00:21:48.547827+0000","last_unstale":"2024-09-12T01:07:12.804264+0000","last_undegraded":"2024-09-12T01:07:12.804264+0000","last_fullsized":"2024-09-12T01:07:12.804264+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136620,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":930,"num_read_kb":2049,"num_write":822,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.751771+0000","last_change":"2024-09-12T00:21:50.554994+0000","last_active":"2024-09-12T01:04:24.751771+0000","last_peered":"2024-09-12T01:04:24.751771+0000","last_clean":"2024-09-12T01:04:24.751771+0000","last_became_active":"2024-09-12T00:21:50.554194+0000","last_became_peered":"2024-09-12T00:21:50.554194+0000","last_unstale":"2024-09-12T01:04:24.751771+0000","last_undegraded":"2024-09-12T01:04:24.751771+0000","last_fullsized":"2024-09-12T01:04:24.751771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.351737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'158","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.556466+0000","last_change":"2024-09-12T00:21:52.558812+0000","last_active":"2024-09-12T01:06:06.556466+0000","last_peered":"2024-09-12T01:06:06.556466+0000","last_clean":"2024-09-12T01:06:06.556466+0000","last_became_active":"2024-09-12T00:21:52.558070+0000","last_became_peered":"2024-09-12T00:21:52.558070+0000","last_unstale":"2024-09-12T01:06:06.556466+0000","last_undegraded":"2024-09-12T01:06:06.556466+0000","last_fullsized":"2024-09-12T01:06:06.556466+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:23.383768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":234,"num_write":361,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'83","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.789441+0000","last_change":"2024-09-12T00:21:44.502471+0000","last_active":"2024-09-12T01:03:54.789441+0000","last_peered":"2024-09-12T01:03:54.789441+0000","last_clean":"2024-09-12T01:03:54.789441+0000","last_became_active":"2024-09-12T00:21:44.501836+0000","last_became_peered":"2024-09-12T00:21:44.501836+0000","last_unstale":"2024-09-12T01:03:54.789441+0000","last_undegraded":"2024-09-12T01:03:54.789441+0000","last_fullsized":"2024-09-12T01:03:54.789441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:34.189402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":399,"num_read_kb":345,"num_write":130,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'247","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.025681+0000","last_change":"2024-09-12T00:21:42.497979+0000","last_active":"2024-09-12T01:06:03.025681+0000","last_peered":"2024-09-12T01:06:03.025681+0000","last_clean":"2024-09-12T01:06:03.025681+0000","last_became_active":"2024-09-12T00:21:42.496837+0000","last_became_peered":"2024-09-12T00:21:42.496837+0000","last_unstale":"2024-09-12T01:06:03.025681+0000","last_undegraded":"2024-09-12T01:06:03.025681+0000","last_fullsized":"2024-09-12T01:06:03.025681+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4841815,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":295,"num_read_kb":1485,"num_write":833,"num_write_kb":29678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.738284+0000","last_change":"2024-09-12T00:21:46.499289+0000","last_active":"2024-09-12T01:03:29.738284+0000","last_peered":"2024-09-12T01:03:29.738284+0000","last_clean":"2024-09-12T01:03:29.738284+0000","last_became_active":"2024-09-12T00:21:46.498517+0000","last_became_peered":"2024-09-12T00:21:46.498517+0000","last_unstale":"2024-09-12T01:03:29.738284+0000","last_undegraded":"2024-09-12T01:03:29.738284+0000","last_fullsized":"2024-09-12T01:03:29.738284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:50.960412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'295","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.420278+0000","last_change":"2024-09-12T00:21:48.539854+0000","last_active":"2024-09-12T01:06:49.420278+0000","last_peered":"2024-09-12T01:06:49.420278+0000","last_clean":"2024-09-12T01:06:49.420278+0000","last_became_active":"2024-09-12T00:21:48.539419+0000","last_became_peered":"2024-09-12T00:21:48.539419+0000","last_unstale":"2024-09-12T01:06:49.420278+0000","last_undegraded":"2024-09-12T01:06:49.420278+0000","last_fullsized":"2024-09-12T01:06:49.420278+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:42.243175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1025,"num_write":422,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.608749+0000","last_change":"2024-09-12T00:21:50.565460+0000","last_active":"2024-09-12T01:04:24.608749+0000","last_peered":"2024-09-12T01:04:24.608749+0000","last_clean":"2024-09-12T01:04:24.608749+0000","last_became_active":"2024-09-12T00:21:50.564610+0000","last_became_peered":"2024-09-12T00:21:50.564610+0000","last_unstale":"2024-09-12T01:04:24.608749+0000","last_undegraded":"2024-09-12T01:04:24.608749+0000","last_fullsized":"2024-09-12T01:04:24.608749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'152","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.192650+0000","last_change":"2024-09-12T00:21:52.560731+0000","last_active":"2024-09-12T01:05:01.192650+0000","last_peered":"2024-09-12T01:05:01.192650+0000","last_clean":"2024-09-12T01:05:01.192650+0000","last_became_active":"2024-09-12T00:21:52.559989+0000","last_became_peered":"2024-09-12T00:21:52.559989+0000","last_unstale":"2024-09-12T01:05:01.192650+0000","last_undegraded":"2024-09-12T01:05:01.192650+0000","last_fullsized":"2024-09-12T01:05:01.192650+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.302197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":167,"num_write":448,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'180","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.587709+0000","last_change":"2024-09-12T00:21:44.515569+0000","last_active":"2024-09-12T01:04:18.587709+0000","last_peered":"2024-09-12T01:04:18.587709+0000","last_clean":"2024-09-12T01:04:18.587709+0000","last_became_active":"2024-09-12T00:21:44.515059+0000","last_became_peered":"2024-09-12T00:21:44.515059+0000","last_unstale":"2024-09-12T01:04:18.587709+0000","last_undegraded":"2024-09-12T01:04:18.587709+0000","last_fullsized":"2024-09-12T01:04:18.587709+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.436679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":674,"num_write":306,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'261","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.713210+0000","last_change":"2024-09-12T00:21:42.528216+0000","last_active":"2024-09-12T01:05:45.713210+0000","last_peered":"2024-09-12T01:05:45.713210+0000","last_clean":"2024-09-12T01:05:45.713210+0000","last_became_active":"2024-09-12T00:21:42.527838+0000","last_became_peered":"2024-09-12T00:21:42.527838+0000","last_unstale":"2024-09-12T01:05:45.713210+0000","last_undegraded":"2024-09-12T01:05:45.713210+0000","last_fullsized":"2024-09-12T01:05:45.713210+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:49.488680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3596652,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":446,"num_read_kb":57947,"num_write":959,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.750536+0000","last_change":"2024-09-12T00:21:46.487430+0000","last_active":"2024-09-12T01:04:19.750536+0000","last_peered":"2024-09-12T01:04:19.750536+0000","last_clean":"2024-09-12T01:04:19.750536+0000","last_became_active":"2024-09-12T00:21:46.486768+0000","last_became_peered":"2024-09-12T00:21:46.486768+0000","last_unstale":"2024-09-12T01:04:19.750536+0000","last_undegraded":"2024-09-12T01:04:19.750536+0000","last_fullsized":"2024-09-12T01:04:19.750536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:46.811644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'286","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.599971+0000","last_change":"2024-09-12T00:21:48.546553+0000","last_active":"2024-09-12T01:05:34.599971+0000","last_peered":"2024-09-12T01:05:34.599971+0000","last_clean":"2024-09-12T01:05:34.599971+0000","last_became_active":"2024-09-12T00:21:48.545589+0000","last_became_peered":"2024-09-12T00:21:48.545589+0000","last_unstale":"2024-09-12T01:05:34.599971+0000","last_undegraded":"2024-09-12T01:05:34.599971+0000","last_fullsized":"2024-09-12T01:05:34.599971+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:05.509631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":970,"num_write":392,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.584221+0000","last_change":"2024-09-12T00:21:50.557751+0000","last_active":"2024-09-12T01:04:03.584221+0000","last_peered":"2024-09-12T01:04:03.584221+0000","last_clean":"2024-09-12T01:04:03.584221+0000","last_became_active":"2024-09-12T00:21:50.556333+0000","last_became_peered":"2024-09-12T00:21:50.556333+0000","last_unstale":"2024-09-12T01:04:03.584221+0000","last_undegraded":"2024-09-12T01:04:03.584221+0000","last_fullsized":"2024-09-12T01:04:03.584221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.592627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'204","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.864522+0000","last_change":"2024-09-12T00:21:52.566691+0000","last_active":"2024-09-12T01:07:12.864522+0000","last_peered":"2024-09-12T01:07:12.864522+0000","last_clean":"2024-09-12T01:07:12.864522+0000","last_became_active":"2024-09-12T00:21:52.565109+0000","last_became_peered":"2024-09-12T00:21:52.565109+0000","last_unstale":"2024-09-12T01:07:12.864522+0000","last_undegraded":"2024-09-12T01:07:12.864522+0000","last_fullsized":"2024-09-12T01:07:12.864522+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:52.766859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'131","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.241463+0000","last_change":"2024-09-12T00:21:44.489287+0000","last_active":"2024-09-12T01:05:45.241463+0000","last_peered":"2024-09-12T01:05:45.241463+0000","last_clean":"2024-09-12T01:05:45.241463+0000","last_became_active":"2024-09-12T00:21:44.488546+0000","last_became_peered":"2024-09-12T00:21:44.488546+0000","last_unstale":"2024-09-12T01:05:45.241463+0000","last_undegraded":"2024-09-12T01:05:45.241463+0000","last_fullsized":"2024-09-12T01:05:45.241463+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:32.061615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":436,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'281","reported_seq":904,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.103263+0000","last_change":"2024-09-12T00:21:42.514641+0000","last_active":"2024-09-12T01:04:57.103263+0000","last_peered":"2024-09-12T01:04:57.103263+0000","last_clean":"2024-09-12T01:04:57.103263+0000","last_became_active":"2024-09-12T00:21:42.513837+0000","last_became_peered":"2024-09-12T00:21:42.513837+0000","last_unstale":"2024-09-12T01:04:57.103263+0000","last_undegraded":"2024-09-12T01:04:57.103263+0000","last_fullsized":"2024-09-12T01:04:57.103263+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:59.737503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6712997,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":371,"num_read_kb":19207,"num_write":962,"num_write_kb":45165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.580850+0000","last_change":"2024-09-12T00:21:46.493177+0000","last_active":"2024-09-12T01:04:19.580850+0000","last_peered":"2024-09-12T01:04:19.580850+0000","last_clean":"2024-09-12T01:04:19.580850+0000","last_became_active":"2024-09-12T00:21:46.492502+0000","last_became_peered":"2024-09-12T00:21:46.492502+0000","last_unstale":"2024-09-12T01:04:19.580850+0000","last_undegraded":"2024-09-12T01:04:19.580850+0000","last_fullsized":"2024-09-12T01:04:19.580850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:29.059786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'96","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:59.651411+0000","last_change":"2024-09-12T00:21:48.548949+0000","last_active":"2024-09-12T01:05:59.651411+0000","last_peered":"2024-09-12T01:05:59.651411+0000","last_clean":"2024-09-12T01:05:59.651411+0000","last_became_active":"2024-09-12T00:21:48.544915+0000","last_became_peered":"2024-09-12T00:21:48.544915+0000","last_unstale":"2024-09-12T01:05:59.651411+0000","last_undegraded":"2024-09-12T01:05:59.651411+0000","last_fullsized":"2024-09-12T01:05:59.651411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:44.234342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":128,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'777","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947295+0000","last_change":"2024-09-12T00:21:50.550332+0000","last_active":"2024-09-12T01:07:12.947295+0000","last_peered":"2024-09-12T01:07:12.947295+0000","last_clean":"2024-09-12T01:07:12.947295+0000","last_became_active":"2024-09-12T00:21:50.549552+0000","last_became_peered":"2024-09-12T00:21:50.549552+0000","last_unstale":"2024-09-12T01:07:12.947295+0000","last_undegraded":"2024-09-12T01:07:12.947295+0000","last_fullsized":"2024-09-12T01:07:12.947295+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:44.130994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'170","reported_seq":686,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.303926+0000","last_change":"2024-09-12T00:21:52.566510+0000","last_active":"2024-09-12T01:05:46.303926+0000","last_peered":"2024-09-12T01:05:46.303926+0000","last_clean":"2024-09-12T01:05:46.303926+0000","last_became_active":"2024-09-12T00:21:52.565872+0000","last_became_peered":"2024-09-12T00:21:52.565872+0000","last_unstale":"2024-09-12T01:05:46.303926+0000","last_undegraded":"2024-09-12T01:05:46.303926+0000","last_fullsized":"2024-09-12T01:05:46.303926+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:54.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":199,"num_write":407,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'4284","reported_seq":4939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749378+0000","last_change":"2024-09-12T00:21:44.521635+0000","last_active":"2024-09-12T01:04:14.749378+0000","last_peered":"2024-09-12T01:04:14.749378+0000","last_clean":"2024-09-12T01:04:14.749378+0000","last_became_active":"2024-09-12T00:21:44.521310+0000","last_became_peered":"2024-09-12T00:21:44.521310+0000","last_unstale":"2024-09-12T01:04:14.749378+0000","last_undegraded":"2024-09-12T01:04:14.749378+0000","last_fullsized":"2024-09-12T01:04:14.749378+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":3000,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:18.886376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17290,"num_read_kb":14479,"num_write":6455,"num_write_kb":3215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'335","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.350057+0000","last_change":"2024-09-12T00:21:42.508020+0000","last_active":"2024-09-12T01:07:11.350057+0000","last_peered":"2024-09-12T01:07:11.350057+0000","last_clean":"2024-09-12T01:07:11.350057+0000","last_became_active":"2024-09-12T00:21:42.507712+0000","last_became_peered":"2024-09-12T00:21:42.507712+0000","last_unstale":"2024-09-12T01:07:11.350057+0000","last_undegraded":"2024-09-12T01:07:11.350057+0000","last_fullsized":"2024-09-12T01:07:11.350057+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:04.367696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11806959,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":540,"num_read_kb":35216,"num_write":1267,"num_write_kb":36033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.770689+0000","last_change":"2024-09-12T00:21:46.514629+0000","last_active":"2024-09-12T01:04:19.770689+0000","last_peered":"2024-09-12T01:04:19.770689+0000","last_clean":"2024-09-12T01:04:19.770689+0000","last_became_active":"2024-09-12T00:21:46.514146+0000","last_became_peered":"2024-09-12T00:21:46.514146+0000","last_unstale":"2024-09-12T01:04:19.770689+0000","last_undegraded":"2024-09-12T01:04:19.770689+0000","last_fullsized":"2024-09-12T01:04:19.770689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:04.796502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'326","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.604419+0000","last_change":"2024-09-12T00:21:48.545059+0000","last_active":"2024-09-12T01:05:29.604419+0000","last_peered":"2024-09-12T01:05:29.604419+0000","last_clean":"2024-09-12T01:05:29.604419+0000","last_became_active":"2024-09-12T00:21:48.543993+0000","last_became_peered":"2024-09-12T00:21:48.543993+0000","last_unstale":"2024-09-12T01:05:29.604419+0000","last_undegraded":"2024-09-12T01:05:29.604419+0000","last_fullsized":"2024-09-12T01:05:29.604419+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:00.172691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65257,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1041,"num_write":434,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.563509+0000","last_change":"2024-09-12T00:21:50.526640+0000","last_active":"2024-09-12T01:02:59.563509+0000","last_peered":"2024-09-12T01:02:59.563509+0000","last_clean":"2024-09-12T01:02:59.563509+0000","last_became_active":"2024-09-12T00:21:50.525885+0000","last_became_peered":"2024-09-12T00:21:50.525885+0000","last_unstale":"2024-09-12T01:02:59.563509+0000","last_undegraded":"2024-09-12T01:02:59.563509+0000","last_fullsized":"2024-09-12T01:02:59.563509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.636381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'113","reported_seq":614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.083293+0000","last_change":"2024-09-12T00:21:52.560445+0000","last_active":"2024-09-12T01:05:30.083293+0000","last_peered":"2024-09-12T01:05:30.083293+0000","last_clean":"2024-09-12T01:05:30.083293+0000","last_became_active":"2024-09-12T00:21:52.559361+0000","last_became_peered":"2024-09-12T00:21:52.559361+0000","last_unstale":"2024-09-12T01:05:30.083293+0000","last_undegraded":"2024-09-12T01:05:30.083293+0000","last_fullsized":"2024-09-12T01:05:30.083293+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:30.798988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":266,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'251","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.931531+0000","last_change":"2024-09-12T00:21:44.486385+0000","last_active":"2024-09-12T01:04:34.931531+0000","last_peered":"2024-09-12T01:04:34.931531+0000","last_clean":"2024-09-12T01:04:34.931531+0000","last_became_active":"2024-09-12T00:21:44.486014+0000","last_became_peered":"2024-09-12T00:21:44.486014+0000","last_unstale":"2024-09-12T01:04:34.931531+0000","last_undegraded":"2024-09-12T01:04:34.931531+0000","last_fullsized":"2024-09-12T01:04:34.931531+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:04.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1098,"num_read_kb":899,"num_write":369,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'260","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:50.634477+0000","last_change":"2024-09-12T00:21:42.492181+0000","last_active":"2024-09-12T01:05:50.634477+0000","last_peered":"2024-09-12T01:05:50.634477+0000","last_clean":"2024-09-12T01:05:50.634477+0000","last_became_active":"2024-09-12T00:21:42.491757+0000","last_became_peered":"2024-09-12T00:21:42.491757+0000","last_unstale":"2024-09-12T01:05:50.634477+0000","last_undegraded":"2024-09-12T01:05:50.634477+0000","last_fullsized":"2024-09-12T01:05:50.634477+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:19.920075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389249,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":402,"num_read_kb":76220,"num_write":982,"num_write_kb":46746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.750467+0000","last_change":"2024-09-12T00:21:46.503909+0000","last_active":"2024-09-12T01:04:19.750467+0000","last_peered":"2024-09-12T01:04:19.750467+0000","last_clean":"2024-09-12T01:04:19.750467+0000","last_became_active":"2024-09-12T00:21:46.503203+0000","last_became_peered":"2024-09-12T00:21:46.503203+0000","last_unstale":"2024-09-12T01:04:19.750467+0000","last_undegraded":"2024-09-12T01:04:19.750467+0000","last_fullsized":"2024-09-12T01:04:19.750467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:04.494436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'279","reported_seq":846,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594577+0000","last_change":"2024-09-12T00:21:48.537800+0000","last_active":"2024-09-12T01:05:19.594577+0000","last_peered":"2024-09-12T01:05:19.594577+0000","last_clean":"2024-09-12T01:05:19.594577+0000","last_became_active":"2024-09-12T00:21:48.536841+0000","last_became_peered":"2024-09-12T00:21:48.536841+0000","last_unstale":"2024-09-12T01:05:19.594577+0000","last_undegraded":"2024-09-12T01:05:19.594577+0000","last_fullsized":"2024-09-12T01:05:19.594577+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:36.935321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":984,"num_write":384,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.608163+0000","last_change":"2024-09-12T00:21:50.541922+0000","last_active":"2024-09-12T01:03:09.608163+0000","last_peered":"2024-09-12T01:03:09.608163+0000","last_clean":"2024-09-12T01:03:09.608163+0000","last_became_active":"2024-09-12T00:21:50.538041+0000","last_became_peered":"2024-09-12T00:21:50.538041+0000","last_unstale":"2024-09-12T01:03:09.608163+0000","last_undegraded":"2024-09-12T01:03:09.608163+0000","last_fullsized":"2024-09-12T01:03:09.608163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:16.216296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'125","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.684858+0000","last_change":"2024-09-12T00:21:52.564384+0000","last_active":"2024-09-12T01:05:19.684858+0000","last_peered":"2024-09-12T01:05:19.684858+0000","last_clean":"2024-09-12T01:05:19.684858+0000","last_became_active":"2024-09-12T00:21:52.560366+0000","last_became_peered":"2024-09-12T00:21:52.560366+0000","last_unstale":"2024-09-12T01:05:19.684858+0000","last_undegraded":"2024-09-12T01:05:19.684858+0000","last_fullsized":"2024-09-12T01:05:19.684858+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:27.682015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":163,"num_read_kb":157,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'212","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.678629+0000","last_change":"2024-09-12T00:21:44.513724+0000","last_active":"2024-09-12T01:04:47.678629+0000","last_peered":"2024-09-12T01:04:47.678629+0000","last_clean":"2024-09-12T01:04:47.678629+0000","last_became_active":"2024-09-12T00:21:44.512917+0000","last_became_peered":"2024-09-12T00:21:44.512917+0000","last_unstale":"2024-09-12T01:04:47.678629+0000","last_undegraded":"2024-09-12T01:04:47.678629+0000","last_fullsized":"2024-09-12T01:04:47.678629+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:10.484566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":716,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'308","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.625978+0000","last_change":"2024-09-12T00:21:42.517480+0000","last_active":"2024-09-12T01:05:51.625978+0000","last_peered":"2024-09-12T01:05:51.625978+0000","last_clean":"2024-09-12T01:05:51.625978+0000","last_became_active":"2024-09-12T00:21:42.516419+0000","last_became_peered":"2024-09-12T00:21:42.516419+0000","last_unstale":"2024-09-12T01:05:51.625978+0000","last_undegraded":"2024-09-12T01:05:51.625978+0000","last_fullsized":"2024-09-12T01:05:51.625978+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:55.919056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419298,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":551,"num_read_kb":12934,"num_write":1185,"num_write_kb":32784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.750311+0000","last_change":"2024-09-12T00:21:46.504336+0000","last_active":"2024-09-12T01:02:54.750311+0000","last_peered":"2024-09-12T01:02:54.750311+0000","last_clean":"2024-09-12T01:02:54.750311+0000","last_became_active":"2024-09-12T00:21:46.503747+0000","last_became_peered":"2024-09-12T00:21:46.503747+0000","last_unstale":"2024-09-12T01:02:54.750311+0000","last_undegraded":"2024-09-12T01:02:54.750311+0000","last_fullsized":"2024-09-12T01:02:54.750311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:49.256627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'239","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.423033+0000","last_change":"2024-09-12T00:21:48.547112+0000","last_active":"2024-09-12T01:06:49.423033+0000","last_peered":"2024-09-12T01:06:49.423033+0000","last_clean":"2024-09-12T01:06:49.423033+0000","last_became_active":"2024-09-12T00:21:48.546392+0000","last_became_peered":"2024-09-12T00:21:48.546392+0000","last_unstale":"2024-09-12T01:06:49.423033+0000","last_undegraded":"2024-09-12T01:06:49.423033+0000","last_fullsized":"2024-09-12T01:06:49.423033+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:06.500945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":822,"num_write":306,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.627760+0000","last_change":"2024-09-12T00:21:50.549326+0000","last_active":"2024-09-12T01:04:24.627760+0000","last_peered":"2024-09-12T01:04:24.627760+0000","last_clean":"2024-09-12T01:04:24.627760+0000","last_became_active":"2024-09-12T00:21:50.548527+0000","last_became_peered":"2024-09-12T00:21:50.548527+0000","last_unstale":"2024-09-12T01:04:24.627760+0000","last_undegraded":"2024-09-12T01:04:24.627760+0000","last_fullsized":"2024-09-12T01:04:24.627760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:37.290906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'193","reported_seq":1701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.596270+0000","last_change":"2024-09-12T00:21:52.569731+0000","last_active":"2024-09-12T01:06:04.596270+0000","last_peered":"2024-09-12T01:06:04.596270+0000","last_clean":"2024-09-12T01:06:04.596270+0000","last_became_active":"2024-09-12T00:21:52.559360+0000","last_became_peered":"2024-09-12T00:21:52.559360+0000","last_unstale":"2024-09-12T01:06:04.596270+0000","last_undegraded":"2024-09-12T01:06:04.596270+0000","last_fullsized":"2024-09-12T01:06:04.596270+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:25.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1316,"num_write":423,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'81","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.145312+0000","last_change":"2024-09-12T00:21:44.485574+0000","last_active":"2024-09-12T01:04:56.145312+0000","last_peered":"2024-09-12T01:04:56.145312+0000","last_clean":"2024-09-12T01:04:56.145312+0000","last_became_active":"2024-09-12T00:21:44.485278+0000","last_became_peered":"2024-09-12T00:21:44.485278+0000","last_unstale":"2024-09-12T01:04:56.145312+0000","last_undegraded":"2024-09-12T01:04:56.145312+0000","last_fullsized":"2024-09-12T01:04:56.145312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:13.977255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":295,"num_write":139,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'261","reported_seq":895,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:22.470850+0000","last_change":"2024-09-12T00:21:42.524712+0000","last_active":"2024-09-12T01:04:22.470850+0000","last_peered":"2024-09-12T01:04:22.470850+0000","last_clean":"2024-09-12T01:04:22.470850+0000","last_became_active":"2024-09-12T00:21:42.520276+0000","last_became_peered":"2024-09-12T00:21:42.520276+0000","last_unstale":"2024-09-12T01:04:22.470850+0000","last_undegraded":"2024-09-12T01:04:22.470850+0000","last_fullsized":"2024-09-12T01:04:22.470850+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:35.769781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488903,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":405,"num_read_kb":35265,"num_write":964,"num_write_kb":28370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":975,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.723471+0000","last_change":"2024-09-12T00:21:46.495855+0000","last_active":"2024-09-12T01:07:12.723471+0000","last_peered":"2024-09-12T01:07:12.723471+0000","last_clean":"2024-09-12T01:07:12.723471+0000","last_became_active":"2024-09-12T00:21:46.495088+0000","last_became_peered":"2024-09-12T00:21:46.495088+0000","last_unstale":"2024-09-12T01:07:12.723471+0000","last_undegraded":"2024-09-12T01:07:12.723471+0000","last_fullsized":"2024-09-12T01:07:12.723471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:27.176611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'322","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.420157+0000","last_change":"2024-09-12T00:21:48.551157+0000","last_active":"2024-09-12T01:06:49.420157+0000","last_peered":"2024-09-12T01:06:49.420157+0000","last_clean":"2024-09-12T01:06:49.420157+0000","last_became_active":"2024-09-12T00:21:48.550441+0000","last_became_peered":"2024-09-12T00:21:48.550441+0000","last_unstale":"2024-09-12T01:06:49.420157+0000","last_undegraded":"2024-09-12T01:06:49.420157+0000","last_fullsized":"2024-09-12T01:06:49.420157+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:58.154347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1076,"num_write":438,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.581974+0000","last_change":"2024-09-12T00:21:50.566647+0000","last_active":"2024-09-12T01:04:24.581974+0000","last_peered":"2024-09-12T01:04:24.581974+0000","last_clean":"2024-09-12T01:04:24.581974+0000","last_became_active":"2024-09-12T00:21:50.565955+0000","last_became_peered":"2024-09-12T00:21:50.565955+0000","last_unstale":"2024-09-12T01:04:24.581974+0000","last_undegraded":"2024-09-12T01:04:24.581974+0000","last_fullsized":"2024-09-12T01:04:24.581974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:37.311871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'131","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.963224+0000","last_change":"2024-09-12T00:21:52.549770+0000","last_active":"2024-09-12T01:07:11.963224+0000","last_peered":"2024-09-12T01:07:11.963224+0000","last_clean":"2024-09-12T01:07:11.963224+0000","last_became_active":"2024-09-12T00:21:52.549080+0000","last_became_peered":"2024-09-12T00:21:52.549080+0000","last_unstale":"2024-09-12T01:07:11.963224+0000","last_undegraded":"2024-09-12T01:07:11.963224+0000","last_fullsized":"2024-09-12T01:07:11.963224+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.186294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'77","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.591355+0000","last_change":"2024-09-12T00:21:44.495955+0000","last_active":"2024-09-12T01:05:04.591355+0000","last_peered":"2024-09-12T01:05:04.591355+0000","last_clean":"2024-09-12T01:05:04.591355+0000","last_became_active":"2024-09-12T00:21:44.495122+0000","last_became_peered":"2024-09-12T00:21:44.495122+0000","last_unstale":"2024-09-12T01:05:04.591355+0000","last_undegraded":"2024-09-12T01:05:04.591355+0000","last_fullsized":"2024-09-12T01:05:04.591355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:03.274312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":290,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'290","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.545818+0000","last_change":"2024-09-12T00:21:42.492687+0000","last_active":"2024-09-12T01:05:28.545818+0000","last_peered":"2024-09-12T01:05:28.545818+0000","last_clean":"2024-09-12T01:05:28.545818+0000","last_became_active":"2024-09-12T00:21:42.492358+0000","last_became_peered":"2024-09-12T00:21:42.492358+0000","last_unstale":"2024-09-12T01:05:28.545818+0000","last_undegraded":"2024-09-12T01:05:28.545818+0000","last_fullsized":"2024-09-12T01:05:28.545818+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:04.601338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4782119,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":506,"num_read_kb":28331,"num_write":1111,"num_write_kb":34411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'258","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.198362+0000","last_change":"2024-09-12T00:21:44.518405+0000","last_active":"2024-09-12T01:05:20.198362+0000","last_peered":"2024-09-12T01:05:20.198362+0000","last_clean":"2024-09-12T01:05:20.198362+0000","last_became_active":"2024-09-12T00:21:44.515839+0000","last_became_peered":"2024-09-12T00:21:44.515839+0000","last_unstale":"2024-09-12T01:05:20.198362+0000","last_undegraded":"2024-09-12T01:05:20.198362+0000","last_fullsized":"2024-09-12T01:05:20.198362+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:06.067490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":1036,"num_write":423,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'449","reported_seq":1152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.665453+0000","last_change":"2024-09-12T00:21:42.503380+0000","last_active":"2024-09-12T01:07:27.665453+0000","last_peered":"2024-09-12T01:07:27.665453+0000","last_clean":"2024-09-12T01:07:27.665453+0000","last_became_active":"2024-09-12T00:21:42.502396+0000","last_became_peered":"2024-09-12T00:21:42.502396+0000","last_unstale":"2024-09-12T01:07:27.665453+0000","last_undegraded":"2024-09-12T01:07:27.665453+0000","last_fullsized":"2024-09-12T01:07:27.665453+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:34.541877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607324,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":742,"num_read_kb":17888,"num_write":1520,"num_write_kb":31183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'183","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.638098+0000","last_change":"2024-09-12T00:21:44.500052+0000","last_active":"2024-09-12T01:05:04.638098+0000","last_peered":"2024-09-12T01:05:04.638098+0000","last_clean":"2024-09-12T01:05:04.638098+0000","last_became_active":"2024-09-12T00:21:44.499805+0000","last_became_peered":"2024-09-12T00:21:44.499805+0000","last_unstale":"2024-09-12T01:05:04.638098+0000","last_undegraded":"2024-09-12T01:05:04.638098+0000","last_fullsized":"2024-09-12T01:05:04.638098+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:04.496825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":613,"num_write":283,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'399","reported_seq":1142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.017382+0000","last_change":"2024-09-12T00:21:42.519251+0000","last_active":"2024-09-12T01:06:03.017382+0000","last_peered":"2024-09-12T01:06:03.017382+0000","last_clean":"2024-09-12T01:06:03.017382+0000","last_became_active":"2024-09-12T00:21:42.518823+0000","last_became_peered":"2024-09-12T00:21:42.518823+0000","last_unstale":"2024-09-12T01:06:03.017382+0000","last_undegraded":"2024-09-12T01:06:03.017382+0000","last_fullsized":"2024-09-12T01:06:03.017382+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:20.503872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972276,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":898,"num_read_kb":24368,"num_write":1426,"num_write_kb":48727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'183","reported_seq":794,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.618714+0000","last_change":"2024-09-12T00:21:44.511626+0000","last_active":"2024-09-12T01:05:04.618714+0000","last_peered":"2024-09-12T01:05:04.618714+0000","last_clean":"2024-09-12T01:05:04.618714+0000","last_became_active":"2024-09-12T00:21:44.510818+0000","last_became_peered":"2024-09-12T00:21:44.510818+0000","last_unstale":"2024-09-12T01:05:04.618714+0000","last_undegraded":"2024-09-12T01:05:04.618714+0000","last_fullsized":"2024-09-12T01:05:04.618714+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:52.353228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":671,"num_write":265,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'280","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.208287+0000","last_change":"2024-09-12T00:21:42.526241+0000","last_active":"2024-09-12T01:05:19.208287+0000","last_peered":"2024-09-12T01:05:19.208287+0000","last_clean":"2024-09-12T01:05:19.208287+0000","last_became_active":"2024-09-12T00:21:42.525233+0000","last_became_peered":"2024-09-12T00:21:42.525233+0000","last_unstale":"2024-09-12T01:05:19.208287+0000","last_undegraded":"2024-09-12T01:05:19.208287+0000","last_fullsized":"2024-09-12T01:05:19.208287+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:21.684315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12271764,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":774,"num_read_kb":20384,"num_write":993,"num_write_kb":42665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'183","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.832023+0000","last_change":"2024-09-12T00:21:44.524491+0000","last_active":"2024-09-12T01:04:45.832023+0000","last_peered":"2024-09-12T01:04:45.832023+0000","last_clean":"2024-09-12T01:04:45.832023+0000","last_became_active":"2024-09-12T00:21:44.523632+0000","last_became_peered":"2024-09-12T00:21:44.523632+0000","last_unstale":"2024-09-12T01:04:45.832023+0000","last_undegraded":"2024-09-12T01:04:45.832023+0000","last_fullsized":"2024-09-12T01:04:45.832023+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:53.560876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":821,"num_read_kb":680,"num_write":294,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'325","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.844190+0000","last_change":"2024-09-12T00:21:42.504025+0000","last_active":"2024-09-12T01:07:07.844190+0000","last_peered":"2024-09-12T01:07:07.844190+0000","last_clean":"2024-09-12T01:07:07.844190+0000","last_became_active":"2024-09-12T00:21:42.501690+0000","last_became_peered":"2024-09-12T00:21:42.501690+0000","last_unstale":"2024-09-12T01:07:07.844190+0000","last_undegraded":"2024-09-12T01:07:07.844190+0000","last_fullsized":"2024-09-12T01:07:07.844190+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.312316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491986,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":530,"num_read_kb":15191,"num_write":1265,"num_write_kb":28087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'132","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.849170+0000","last_change":"2024-09-12T00:21:44.506973+0000","last_active":"2024-09-12T01:04:50.849170+0000","last_peered":"2024-09-12T01:04:50.849170+0000","last_clean":"2024-09-12T01:04:50.849170+0000","last_became_active":"2024-09-12T00:21:44.505235+0000","last_became_peered":"2024-09-12T00:21:44.505235+0000","last_unstale":"2024-09-12T01:04:50.849170+0000","last_undegraded":"2024-09-12T01:04:50.849170+0000","last_fullsized":"2024-09-12T01:04:50.849170+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:20.444195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":497,"num_write":201,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'281","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.768427+0000","last_change":"2024-09-12T00:21:42.509646+0000","last_active":"2024-09-12T01:05:38.768427+0000","last_peered":"2024-09-12T01:05:38.768427+0000","last_clean":"2024-09-12T01:05:38.768427+0000","last_became_active":"2024-09-12T00:21:42.508673+0000","last_became_peered":"2024-09-12T00:21:42.508673+0000","last_unstale":"2024-09-12T01:05:38.768427+0000","last_undegraded":"2024-09-12T01:05:38.768427+0000","last_fullsized":"2024-09-12T01:05:38.768427+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:10.125063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4844272,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":550,"num_read_kb":49155,"num_write":1136,"num_write_kb":40891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'142","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.964429+0000","last_change":"2024-09-12T00:21:44.515765+0000","last_active":"2024-09-12T01:07:11.964429+0000","last_peered":"2024-09-12T01:07:11.964429+0000","last_clean":"2024-09-12T01:07:11.964429+0000","last_became_active":"2024-09-12T00:21:44.515206+0000","last_became_peered":"2024-09-12T00:21:44.515206+0000","last_unstale":"2024-09-12T01:07:11.964429+0000","last_undegraded":"2024-09-12T01:07:11.964429+0000","last_fullsized":"2024-09-12T01:07:11.964429+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:47.686425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":613,"num_write":237,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'281","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.215870+0000","last_change":"2024-09-12T00:21:42.489401+0000","last_active":"2024-09-12T01:05:53.215870+0000","last_peered":"2024-09-12T01:05:53.215870+0000","last_clean":"2024-09-12T01:05:53.215870+0000","last_became_active":"2024-09-12T00:21:42.486829+0000","last_became_peered":"2024-09-12T00:21:42.486829+0000","last_unstale":"2024-09-12T01:05:53.215870+0000","last_undegraded":"2024-09-12T01:05:53.215870+0000","last_fullsized":"2024-09-12T01:05:53.215870+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.611453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4540397,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":478,"num_read_kb":26644,"num_write":985,"num_write_kb":13447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'172","reported_seq":773,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.043569+0000","last_change":"2024-09-12T00:21:44.503743+0000","last_active":"2024-09-12T01:05:28.043569+0000","last_peered":"2024-09-12T01:05:28.043569+0000","last_clean":"2024-09-12T01:05:28.043569+0000","last_became_active":"2024-09-12T00:21:44.501384+0000","last_became_peered":"2024-09-12T00:21:44.501384+0000","last_unstale":"2024-09-12T01:05:28.043569+0000","last_undegraded":"2024-09-12T01:05:28.043569+0000","last_fullsized":"2024-09-12T01:05:28.043569+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:44.078748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":594,"num_write":251,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'283","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.647940+0000","last_change":"2024-09-12T00:21:42.534665+0000","last_active":"2024-09-12T01:05:42.647940+0000","last_peered":"2024-09-12T01:05:42.647940+0000","last_clean":"2024-09-12T01:05:42.647940+0000","last_became_active":"2024-09-12T00:21:42.533216+0000","last_became_peered":"2024-09-12T00:21:42.533216+0000","last_unstale":"2024-09-12T01:05:42.647940+0000","last_undegraded":"2024-09-12T01:05:42.647940+0000","last_fullsized":"2024-09-12T01:05:42.647940+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.651370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10089675,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":504,"num_read_kb":42167,"num_write":1121,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'107","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:48.581000+0000","last_change":"2024-09-12T00:21:44.515637+0000","last_active":"2024-09-12T01:03:48.581000+0000","last_peered":"2024-09-12T01:03:48.581000+0000","last_clean":"2024-09-12T01:03:48.581000+0000","last_became_active":"2024-09-12T00:21:44.514909+0000","last_became_peered":"2024-09-12T00:21:44.514909+0000","last_unstale":"2024-09-12T01:03:48.581000+0000","last_undegraded":"2024-09-12T01:03:48.581000+0000","last_fullsized":"2024-09-12T01:03:48.581000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:15.377389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":354,"num_write":152,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'309","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.526906+0000","last_change":"2024-09-12T00:21:42.529321+0000","last_active":"2024-09-12T01:05:47.526906+0000","last_peered":"2024-09-12T01:05:47.526906+0000","last_clean":"2024-09-12T01:05:47.526906+0000","last_became_active":"2024-09-12T00:21:42.528929+0000","last_became_peered":"2024-09-12T00:21:42.528929+0000","last_unstale":"2024-09-12T01:05:47.526906+0000","last_undegraded":"2024-09-12T01:05:47.526906+0000","last_fullsized":"2024-09-12T01:05:47.526906+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.595630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826969,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":551,"num_read_kb":14743,"num_write":1015,"num_write_kb":22917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'148","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.196493+0000","last_change":"2024-09-12T00:21:44.507845+0000","last_active":"2024-09-12T01:05:01.196493+0000","last_peered":"2024-09-12T01:05:01.196493+0000","last_clean":"2024-09-12T01:05:01.196493+0000","last_became_active":"2024-09-12T00:21:44.507579+0000","last_became_peered":"2024-09-12T00:21:44.507579+0000","last_unstale":"2024-09-12T01:05:01.196493+0000","last_undegraded":"2024-09-12T01:05:01.196493+0000","last_fullsized":"2024-09-12T01:05:01.196493+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:20.931149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":566,"num_write":233,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'312","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609831+0000","last_change":"2024-09-12T00:21:42.512593+0000","last_active":"2024-09-12T01:04:29.609831+0000","last_peered":"2024-09-12T01:04:29.609831+0000","last_clean":"2024-09-12T01:04:29.609831+0000","last_became_active":"2024-09-12T00:21:42.511703+0000","last_became_peered":"2024-09-12T00:21:42.511703+0000","last_unstale":"2024-09-12T01:04:29.609831+0000","last_undegraded":"2024-09-12T01:04:29.609831+0000","last_fullsized":"2024-09-12T01:04:29.609831+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:16.112281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561783,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":516,"num_read_kb":16282,"num_write":1149,"num_write_kb":34029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'32","reported_seq":574,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.235223+0000","last_change":"2024-09-12T00:21:44.512963+0000","last_active":"2024-09-12T01:05:51.235223+0000","last_peered":"2024-09-12T01:05:51.235223+0000","last_clean":"2024-09-12T01:05:51.235223+0000","last_became_active":"2024-09-12T00:21:44.509834+0000","last_became_peered":"2024-09-12T00:21:44.509834+0000","last_unstale":"2024-09-12T01:05:51.235223+0000","last_undegraded":"2024-09-12T01:05:51.235223+0000","last_fullsized":"2024-09-12T01:05:51.235223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:08.437585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'289","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.413211+0000","last_change":"2024-09-12T00:21:42.484617+0000","last_active":"2024-09-12T01:05:22.413211+0000","last_peered":"2024-09-12T01:05:22.413211+0000","last_clean":"2024-09-12T01:05:22.413211+0000","last_became_active":"2024-09-12T00:21:42.484073+0000","last_became_peered":"2024-09-12T00:21:42.484073+0000","last_unstale":"2024-09-12T01:05:22.413211+0000","last_undegraded":"2024-09-12T01:05:22.413211+0000","last_fullsized":"2024-09-12T01:05:22.413211+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:02.073875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19842851,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":466,"num_read_kb":37310,"num_write":1112,"num_write_kb":47723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'219","reported_seq":806,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.336782+0000","last_change":"2024-09-12T00:21:44.499442+0000","last_active":"2024-09-12T01:05:39.336782+0000","last_peered":"2024-09-12T01:05:39.336782+0000","last_clean":"2024-09-12T01:05:39.336782+0000","last_became_active":"2024-09-12T00:21:44.499043+0000","last_became_peered":"2024-09-12T00:21:44.499043+0000","last_unstale":"2024-09-12T01:05:39.336782+0000","last_undegraded":"2024-09-12T01:05:39.336782+0000","last_fullsized":"2024-09-12T01:05:39.336782+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:15.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":734,"num_write":347,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'316","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.234563+0000","last_change":"2024-09-12T00:21:42.483974+0000","last_active":"2024-09-12T01:06:03.234563+0000","last_peered":"2024-09-12T01:06:03.234563+0000","last_clean":"2024-09-12T01:06:03.234563+0000","last_became_active":"2024-09-12T00:21:42.482971+0000","last_became_peered":"2024-09-12T00:21:42.482971+0000","last_unstale":"2024-09-12T01:06:03.234563+0000","last_undegraded":"2024-09-12T01:06:03.234563+0000","last_fullsized":"2024-09-12T01:06:03.234563+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:02.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10637338,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":557,"num_read_kb":31089,"num_write":1085,"num_write_kb":20487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'217","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.418327+0000","last_change":"2024-09-12T00:21:44.526412+0000","last_active":"2024-09-12T01:06:44.418327+0000","last_peered":"2024-09-12T01:06:44.418327+0000","last_clean":"2024-09-12T01:06:44.418327+0000","last_became_active":"2024-09-12T00:21:44.526086+0000","last_became_peered":"2024-09-12T00:21:44.526086+0000","last_unstale":"2024-09-12T01:06:44.418327+0000","last_undegraded":"2024-09-12T01:06:44.418327+0000","last_fullsized":"2024-09-12T01:06:44.418327+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:23.397670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1006,"num_read_kb":865,"num_write":343,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'294","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.285557+0000","last_change":"2024-09-12T00:22:12.610824+0000","last_active":"2024-09-12T01:05:49.285557+0000","last_peered":"2024-09-12T01:05:49.285557+0000","last_clean":"2024-09-12T01:05:49.285557+0000","last_became_active":"2024-09-12T00:22:12.609837+0000","last_became_peered":"2024-09-12T00:22:12.609837+0000","last_unstale":"2024-09-12T01:05:49.285557+0000","last_undegraded":"2024-09-12T01:05:49.285557+0000","last_fullsized":"2024-09-12T01:05:49.285557+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:23.567602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8530495,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":772,"num_read_kb":34651,"num_write":1094,"num_write_kb":39913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2a","version":"267'441","reported_seq":1107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.368037+0000","last_change":"2024-09-12T00:21:44.512868+0000","last_active":"2024-09-12T01:05:25.368037+0000","last_peered":"2024-09-12T01:05:25.368037+0000","last_clean":"2024-09-12T01:05:25.368037+0000","last_became_active":"2024-09-12T00:21:44.511294+0000","last_became_peered":"2024-09-12T00:21:44.511294+0000","last_unstale":"2024-09-12T01:05:25.368037+0000","last_undegraded":"2024-09-12T01:05:25.368037+0000","last_fullsized":"2024-09-12T01:05:25.368037+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:11.069322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2157,"num_read_kb":1820,"num_write":750,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'284","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.225948+0000","last_change":"2024-09-12T00:21:42.530226+0000","last_active":"2024-09-12T01:06:03.225948+0000","last_peered":"2024-09-12T01:06:03.225948+0000","last_clean":"2024-09-12T01:06:03.225948+0000","last_became_active":"2024-09-12T00:21:42.528942+0000","last_became_peered":"2024-09-12T00:21:42.528942+0000","last_unstale":"2024-09-12T01:06:03.225948+0000","last_undegraded":"2024-09-12T01:06:03.225948+0000","last_fullsized":"2024-09-12T01:06:03.225948+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:58.270470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513679,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":444,"num_read_kb":48912,"num_write":1124,"num_write_kb":34098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'117","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.852107+0000","last_change":"2024-09-12T00:21:44.526377+0000","last_active":"2024-09-12T01:05:02.852107+0000","last_peered":"2024-09-12T01:05:02.852107+0000","last_clean":"2024-09-12T01:05:02.852107+0000","last_became_active":"2024-09-12T00:21:44.525685+0000","last_became_peered":"2024-09-12T00:21:44.525685+0000","last_unstale":"2024-09-12T01:05:02.852107+0000","last_undegraded":"2024-09-12T01:05:02.852107+0000","last_fullsized":"2024-09-12T01:05:02.852107+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.603436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":457,"num_write":189,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'328","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.607175+0000","last_change":"2024-09-12T00:21:42.503168+0000","last_active":"2024-09-12T01:07:27.607175+0000","last_peered":"2024-09-12T01:07:27.607175+0000","last_clean":"2024-09-12T01:07:27.607175+0000","last_became_active":"2024-09-12T00:21:42.499294+0000","last_became_peered":"2024-09-12T00:21:42.499294+0000","last_unstale":"2024-09-12T01:07:27.607175+0000","last_undegraded":"2024-09-12T01:07:27.607175+0000","last_fullsized":"2024-09-12T01:07:27.607175+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:30.172185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":11483,"num_write":1078,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'192","reported_seq":807,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:48.540662+0000","last_change":"2024-09-12T00:21:44.511953+0000","last_active":"2024-09-12T01:05:48.540662+0000","last_peered":"2024-09-12T01:05:48.540662+0000","last_clean":"2024-09-12T01:05:48.540662+0000","last_became_active":"2024-09-12T00:21:44.511085+0000","last_became_peered":"2024-09-12T00:21:44.511085+0000","last_unstale":"2024-09-12T01:05:48.540662+0000","last_undegraded":"2024-09-12T01:05:48.540662+0000","last_fullsized":"2024-09-12T01:05:48.540662+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:53.583649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":698,"num_write":312,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'311","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.708915+0000","last_change":"2024-09-12T00:21:42.519200+0000","last_active":"2024-09-12T01:07:05.708915+0000","last_peered":"2024-09-12T01:07:05.708915+0000","last_clean":"2024-09-12T01:07:05.708915+0000","last_became_active":"2024-09-12T00:21:42.518768+0000","last_became_peered":"2024-09-12T00:21:42.518768+0000","last_unstale":"2024-09-12T01:07:05.708915+0000","last_undegraded":"2024-09-12T01:07:05.708915+0000","last_fullsized":"2024-09-12T01:07:05.708915+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:58.092377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7638034,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":523,"num_read_kb":53651,"num_write":1035,"num_write_kb":23347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'248","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:16.319309+0000","last_change":"2024-09-12T00:21:42.495841+0000","last_active":"2024-09-12T01:04:16.319309+0000","last_peered":"2024-09-12T01:04:16.319309+0000","last_clean":"2024-09-12T01:04:16.319309+0000","last_became_active":"2024-09-12T00:21:42.495480+0000","last_became_peered":"2024-09-12T00:21:42.495480+0000","last_unstale":"2024-09-12T01:04:16.319309+0000","last_undegraded":"2024-09-12T01:04:16.319309+0000","last_fullsized":"2024-09-12T01:04:16.319309+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:30.083635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813200,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":356,"num_read_kb":25580,"num_write":877,"num_write_kb":28169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'195","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.324242+0000","last_change":"2024-09-12T00:21:44.527476+0000","last_active":"2024-09-12T01:04:19.324242+0000","last_peered":"2024-09-12T01:04:19.324242+0000","last_clean":"2024-09-12T01:04:19.324242+0000","last_became_active":"2024-09-12T00:21:44.526907+0000","last_became_peered":"2024-09-12T00:21:44.526907+0000","last_unstale":"2024-09-12T01:04:19.324242+0000","last_undegraded":"2024-09-12T01:04:19.324242+0000","last_fullsized":"2024-09-12T01:04:19.324242+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.457978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":917,"num_read_kb":786,"num_write":315,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'253","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.449829+0000","last_change":"2024-09-12T00:21:42.518641+0000","last_active":"2024-09-12T01:05:43.449829+0000","last_peered":"2024-09-12T01:05:43.449829+0000","last_clean":"2024-09-12T01:05:43.449829+0000","last_became_active":"2024-09-12T00:21:42.516614+0000","last_became_peered":"2024-09-12T00:21:42.516614+0000","last_unstale":"2024-09-12T01:05:43.449829+0000","last_undegraded":"2024-09-12T01:05:43.449829+0000","last_fullsized":"2024-09-12T01:05:43.449829+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:05.951966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10018583,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":355,"num_read_kb":30838,"num_write":863,"num_write_kb":38454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'102","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.972355+0000","last_change":"2024-09-12T00:21:44.497391+0000","last_active":"2024-09-12T01:05:40.972355+0000","last_peered":"2024-09-12T01:05:40.972355+0000","last_clean":"2024-09-12T01:05:40.972355+0000","last_became_active":"2024-09-12T00:21:44.496138+0000","last_became_peered":"2024-09-12T00:21:44.496138+0000","last_unstale":"2024-09-12T01:05:40.972355+0000","last_undegraded":"2024-09-12T01:05:40.972355+0000","last_fullsized":"2024-09-12T01:05:40.972355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:58.246589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5839,"num_read_kb":4146,"num_write":1942,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1113,"ondisk_log_size":1113,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14973,"num_read_kb":14645,"num_write":16791,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":568,"ondisk_log_size":568,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1871738,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17349,"num_read_kb":33635,"num_write":14619,"num_write_kb":11551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2994176,"data_stored":2493109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1829,"ondisk_log_size":1829,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":101832,"num_read_kb":85065,"num_write":36894,"num_write_kb":18565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3786,"ondisk_log_size":3786,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":463326797,"num_objects":4246,"num_object_clones":0,"num_object_copies":12738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4246,"num_whiteouts":0,"num_read":32222,"num_read_kb":1795869,"num_write":67897,"num_write_kb":2042491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":694878208,"data_stored":694878208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4408,"ondisk_log_size":4408,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73448742,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":150,"num_read_kb":206538,"num_write":165,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147996672,"data_stored":147994484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":71400014,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":147,"num_read_kb":195226,"num_write":166,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142802944,"data_stored":142800028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509996,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209920,"kb_used_data":128816,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94161920,"statfs":{"total":96636764160,"available":96421806080,"internally_reserved":0,"allocated":131907584,"data_stored":129847978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509997,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":428644,"kb_used_data":172628,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93943196,"statfs":{"total":96636764160,"available":96197832704,"internally_reserved":0,"allocated":176771072,"data_stored":174719875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509999,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303956,"kb_used_data":120132,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94067884,"statfs":{"total":96636764160,"available":96325513216,"internally_reserved":0,"allocated":123015168,"data_stored":120972731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509997,"num_pgs":123,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358648,"kb_used_data":169192,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94013192,"statfs":{"total":96636764160,"available":96269508608,"internally_reserved":0,"allocated":173252608,"data_stored":171214777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":193984968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510000,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249116,"kb_used_data":137420,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94122724,"statfs":{"total":96636764160,"available":96381669376,"internally_reserved":0,"allocated":140718080,"data_stored":138714461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509997,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375112,"kb_used_data":113464,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93996728,"statfs":{"total":96636764160,"available":96252649472,"internally_reserved":0,"allocated":116187136,"data_stored":114123792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509996,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260596,"kb_used_data":139236,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94111244,"statfs":{"total":96636764160,"available":96369913856,"internally_reserved":0,"allocated":142577664,"data_stored":140512320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542703,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243148,"kb_used_data":18796,"kb_used_omap":1,"kb_used_meta":224062,"kb_avail":94128692,"statfs":{"total":96636764160,"available":96387780608,"internally_reserved":0,"allocated":19247104,"data_stored":17260105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":229439946},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118882304,"data_stored":118882304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":89845760,"data_stored":89845760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":99635200,"data_stored":99635200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107778048,"data_stored":107778048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":82595840,"data_stored":82595840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":104267776,"data_stored":104267776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":76865536,"data_stored":76865536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15007744,"data_stored":15007744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":501806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":465157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":127090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":270653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":374988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":403118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":349499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44089344,"data_stored":44088614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27312128,"data_stored":27311400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27312128,"data_stored":27311400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29409280,"data_stored":29408550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39895040,"data_stored":39894312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:07:29.447 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:07:29.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:07:29.816 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:07:29.828 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T01:07:29.835 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1645,"stamp":"2024-09-12T01:07:29.128917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":610655116,"num_objects":4649,"num_object_clones":0,"num_object_copies":13544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4649,"num_whiteouts":0,"num_read":174993,"num_read_kb":2338056,"num_write":138617,"num_write_kb":2353688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13565,"ondisk_log_size":13565,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429140,"kb_used_data":999684,"kb_used_omap":12,"kb_used_meta":1429043,"kb_avail":752545580,"statfs":{"total":773094113280,"available":770606673920,"internally_reserved":0,"allocated":1023676416,"data_stored":1007366039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1463340593},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-47438092,"num_objects":-224,"num_object_clones":0,"num_object_copies":-661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-224,"num_whiteouts":0,"num_read":310,"num_read_kb":715,"num_write":265,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008054"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587141+0000","last_change":"2024-09-12T00:49:10.624205+0000","last_active":"2024-09-12T01:04:14.587141+0000","last_peered":"2024-09-12T01:04:14.587141+0000","last_clean":"2024-09-12T01:04:14.587141+0000","last_became_active":"2024-09-12T00:49:10.623491+0000","last_became_peered":"2024-09-12T00:49:10.623491+0000","last_unstale":"2024-09-12T01:04:14.587141+0000","last_undegraded":"2024-09-12T01:04:14.587141+0000","last_fullsized":"2024-09-12T01:04:14.587141+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.660122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"267'6","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.755161+0000","last_change":"2024-09-12T00:38:10.688649+0000","last_active":"2024-09-12T01:03:14.755161+0000","last_peered":"2024-09-12T01:03:14.755161+0000","last_clean":"2024-09-12T01:03:14.755161+0000","last_became_active":"2024-09-12T00:38:10.687911+0000","last_became_peered":"2024-09-12T00:38:10.687911+0000","last_unstale":"2024-09-12T01:03:14.755161+0000","last_undegraded":"2024-09-12T01:03:14.755161+0000","last_fullsized":"2024-09-12T01:03:14.755161+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:09.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.571671+0000","last_change":"2024-09-12T00:38:07.665498+0000","last_active":"2024-09-12T01:03:08.571671+0000","last_peered":"2024-09-12T01:03:08.571671+0000","last_clean":"2024-09-12T01:03:08.571671+0000","last_became_active":"2024-09-12T00:38:07.664779+0000","last_became_peered":"2024-09-12T00:38:07.664779+0000","last_unstale":"2024-09-12T01:03:08.571671+0000","last_undegraded":"2024-09-12T01:03:08.571671+0000","last_fullsized":"2024-09-12T01:03:08.571671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.524540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'50","reported_seq":182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.429135+0000","last_change":"2024-09-12T00:36:37.236134+0000","last_active":"2024-09-12T01:03:50.429135+0000","last_peered":"2024-09-12T01:03:50.429135+0000","last_clean":"2024-09-12T01:03:50.429135+0000","last_became_active":"2024-09-12T00:36:37.223686+0000","last_became_peered":"2024-09-12T00:36:37.223686+0000","last_unstale":"2024-09-12T01:03:50.429135+0000","last_undegraded":"2024-09-12T01:03:50.429135+0000","last_fullsized":"2024-09-12T01:03:50.429135+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:53.656045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":201,"num_write":87,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.582523+0000","last_change":"2024-09-12T00:49:10.625393+0000","last_active":"2024-09-12T01:04:14.582523+0000","last_peered":"2024-09-12T01:04:14.582523+0000","last_clean":"2024-09-12T01:04:14.582523+0000","last_became_active":"2024-09-12T00:49:10.624700+0000","last_became_peered":"2024-09-12T00:49:10.624700+0000","last_unstale":"2024-09-12T01:04:14.582523+0000","last_undegraded":"2024-09-12T01:04:14.582523+0000","last_fullsized":"2024-09-12T01:04:14.582523+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"267'7","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.734454+0000","last_change":"2024-09-12T00:38:10.696907+0000","last_active":"2024-09-12T01:03:14.734454+0000","last_peered":"2024-09-12T01:03:14.734454+0000","last_clean":"2024-09-12T01:03:14.734454+0000","last_became_active":"2024-09-12T00:38:10.691195+0000","last_became_peered":"2024-09-12T00:38:10.691195+0000","last_unstale":"2024-09-12T01:03:14.734454+0000","last_undegraded":"2024-09-12T01:03:14.734454+0000","last_fullsized":"2024-09-12T01:03:14.734454+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.105627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"267'7","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.590149+0000","last_change":"2024-09-12T00:38:07.665354+0000","last_active":"2024-09-12T01:03:09.590149+0000","last_peered":"2024-09-12T01:03:09.590149+0000","last_clean":"2024-09-12T01:03:09.590149+0000","last_became_active":"2024-09-12T00:38:07.664663+0000","last_became_peered":"2024-09-12T00:38:07.664663+0000","last_unstale":"2024-09-12T01:03:09.590149+0000","last_undegraded":"2024-09-12T01:03:09.590149+0000","last_fullsized":"2024-09-12T01:03:09.590149+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.495162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587630+0000","last_change":"2024-09-12T00:36:37.240047+0000","last_active":"2024-09-12T01:04:49.587630+0000","last_peered":"2024-09-12T01:04:49.587630+0000","last_clean":"2024-09-12T01:04:49.587630+0000","last_became_active":"2024-09-12T00:36:37.239199+0000","last_became_peered":"2024-09-12T00:36:37.239199+0000","last_unstale":"2024-09-12T01:04:49.587630+0000","last_undegraded":"2024-09-12T01:04:49.587630+0000","last_fullsized":"2024-09-12T01:04:49.587630+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:11.845055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.762541+0000","last_change":"2024-09-12T00:49:10.612385+0000","last_active":"2024-09-12T01:03:44.762541+0000","last_peered":"2024-09-12T01:03:44.762541+0000","last_clean":"2024-09-12T01:03:44.762541+0000","last_became_active":"2024-09-12T00:49:10.611715+0000","last_became_peered":"2024-09-12T00:49:10.611715+0000","last_unstale":"2024-09-12T01:03:44.762541+0000","last_undegraded":"2024-09-12T01:03:44.762541+0000","last_fullsized":"2024-09-12T01:03:44.762541+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:44.906371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"267'10","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622484+0000","last_change":"2024-09-12T00:38:10.708434+0000","last_active":"2024-09-12T01:05:19.622484+0000","last_peered":"2024-09-12T01:05:19.622484+0000","last_clean":"2024-09-12T01:05:19.622484+0000","last_became_active":"2024-09-12T00:38:10.702832+0000","last_became_peered":"2024-09-12T00:38:10.702832+0000","last_unstale":"2024-09-12T01:05:19.622484+0000","last_undegraded":"2024-09-12T01:05:19.622484+0000","last_fullsized":"2024-09-12T01:05:19.622484+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:02.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":26653,"num_write":15,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.586519+0000","last_change":"2024-09-12T00:38:07.656103+0000","last_active":"2024-09-12T01:04:13.586519+0000","last_peered":"2024-09-12T01:04:13.586519+0000","last_clean":"2024-09-12T01:04:13.586519+0000","last_became_active":"2024-09-12T00:38:07.654162+0000","last_became_peered":"2024-09-12T00:38:07.654162+0000","last_unstale":"2024-09-12T01:04:13.586519+0000","last_undegraded":"2024-09-12T01:04:13.586519+0000","last_fullsized":"2024-09-12T01:04:13.586519+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:51.681421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'61","reported_seq":215,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.745657+0000","last_change":"2024-09-12T00:36:37.244669+0000","last_active":"2024-09-12T01:05:03.745657+0000","last_peered":"2024-09-12T01:05:03.745657+0000","last_clean":"2024-09-12T01:05:03.745657+0000","last_became_active":"2024-09-12T00:36:37.243951+0000","last_became_peered":"2024-09-12T00:36:37.243951+0000","last_unstale":"2024-09-12T01:05:03.745657+0000","last_undegraded":"2024-09-12T01:05:03.745657+0000","last_fullsized":"2024-09-12T01:05:03.745657+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:02.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":228,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600226+0000","last_change":"2024-09-12T00:49:10.614295+0000","last_active":"2024-09-12T01:03:49.600226+0000","last_peered":"2024-09-12T01:03:49.600226+0000","last_clean":"2024-09-12T01:03:49.600226+0000","last_became_active":"2024-09-12T00:49:10.613525+0000","last_became_peered":"2024-09-12T00:49:10.613525+0000","last_unstale":"2024-09-12T01:03:49.600226+0000","last_undegraded":"2024-09-12T01:03:49.600226+0000","last_fullsized":"2024-09-12T01:03:49.600226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:34.120845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'8","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.607603+0000","last_change":"2024-09-12T00:38:10.702125+0000","last_active":"2024-09-12T01:04:19.607603+0000","last_peered":"2024-09-12T01:04:19.607603+0000","last_clean":"2024-09-12T01:04:19.607603+0000","last_became_active":"2024-09-12T00:38:10.701406+0000","last_became_peered":"2024-09-12T00:38:10.701406+0000","last_unstale":"2024-09-12T01:04:19.607603+0000","last_undegraded":"2024-09-12T01:04:19.607603+0000","last_fullsized":"2024-09-12T01:04:19.607603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.321347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":23552,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'4","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.783176+0000","last_change":"2024-09-12T00:38:07.642044+0000","last_active":"2024-09-12T01:05:14.783176+0000","last_peered":"2024-09-12T01:05:14.783176+0000","last_clean":"2024-09-12T01:05:14.783176+0000","last_became_active":"2024-09-12T00:38:07.639897+0000","last_became_peered":"2024-09-12T00:38:07.639897+0000","last_unstale":"2024-09-12T01:05:14.783176+0000","last_undegraded":"2024-09-12T01:05:14.783176+0000","last_fullsized":"2024-09-12T01:05:14.783176+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:48.556221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4625,"num_write":4,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'49","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.581394+0000","last_change":"2024-09-12T00:36:37.236688+0000","last_active":"2024-09-12T01:04:09.581394+0000","last_peered":"2024-09-12T01:04:09.581394+0000","last_clean":"2024-09-12T01:04:09.581394+0000","last_became_active":"2024-09-12T00:36:37.235921+0000","last_became_peered":"2024-09-12T00:36:37.235921+0000","last_unstale":"2024-09-12T01:04:09.581394+0000","last_undegraded":"2024-09-12T01:04:09.581394+0000","last_fullsized":"2024-09-12T01:04:09.581394+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:57.656212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":160,"num_write":94,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.601979+0000","last_change":"2024-09-12T00:49:10.640862+0000","last_active":"2024-09-12T01:05:18.601979+0000","last_peered":"2024-09-12T01:05:18.601979+0000","last_clean":"2024-09-12T01:05:18.601979+0000","last_became_active":"2024-09-12T00:49:10.640187+0000","last_became_peered":"2024-09-12T00:49:10.640187+0000","last_unstale":"2024-09-12T01:05:18.601979+0000","last_undegraded":"2024-09-12T01:05:18.601979+0000","last_fullsized":"2024-09-12T01:05:18.601979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.913407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.596205+0000","last_change":"2024-09-12T00:38:10.702920+0000","last_active":"2024-09-12T01:04:54.596205+0000","last_peered":"2024-09-12T01:04:54.596205+0000","last_clean":"2024-09-12T01:04:54.596205+0000","last_became_active":"2024-09-12T00:38:10.702113+0000","last_became_peered":"2024-09-12T00:38:10.702113+0000","last_unstale":"2024-09-12T01:04:54.596205+0000","last_undegraded":"2024-09-12T01:04:54.596205+0000","last_fullsized":"2024-09-12T01:04:54.596205+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:03.161296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.613854+0000","last_change":"2024-09-12T00:38:07.661344+0000","last_active":"2024-09-12T01:04:44.613854+0000","last_peered":"2024-09-12T01:04:44.613854+0000","last_clean":"2024-09-12T01:04:44.613854+0000","last_became_active":"2024-09-12T00:38:07.660159+0000","last_became_peered":"2024-09-12T00:38:07.660159+0000","last_unstale":"2024-09-12T01:04:44.613854+0000","last_undegraded":"2024-09-12T01:04:44.613854+0000","last_fullsized":"2024-09-12T01:04:44.613854+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:05.309641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'28","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.675076+0000","last_change":"2024-09-12T00:36:37.251730+0000","last_active":"2024-09-12T01:04:15.675076+0000","last_peered":"2024-09-12T01:04:15.675076+0000","last_clean":"2024-09-12T01:04:15.675076+0000","last_became_active":"2024-09-12T00:36:37.248920+0000","last_became_peered":"2024-09-12T00:36:37.248920+0000","last_unstale":"2024-09-12T01:04:15.675076+0000","last_undegraded":"2024-09-12T01:04:15.675076+0000","last_fullsized":"2024-09-12T01:04:15.675076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.363028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574475+0000","last_change":"2024-09-12T00:49:10.640254+0000","last_active":"2024-09-12T01:03:49.574475+0000","last_peered":"2024-09-12T01:03:49.574475+0000","last_clean":"2024-09-12T01:03:49.574475+0000","last_became_active":"2024-09-12T00:49:10.638196+0000","last_became_peered":"2024-09-12T00:49:10.638196+0000","last_unstale":"2024-09-12T01:03:49.574475+0000","last_undegraded":"2024-09-12T01:03:49.574475+0000","last_fullsized":"2024-09-12T01:03:49.574475+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:50.165315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634261+0000","last_change":"2024-09-12T00:38:10.715254+0000","last_active":"2024-09-12T01:04:49.634261+0000","last_peered":"2024-09-12T01:04:49.634261+0000","last_clean":"2024-09-12T01:04:49.634261+0000","last_became_active":"2024-09-12T00:38:10.714503+0000","last_became_peered":"2024-09-12T00:38:10.714503+0000","last_unstale":"2024-09-12T01:04:49.634261+0000","last_undegraded":"2024-09-12T01:04:49.634261+0000","last_fullsized":"2024-09-12T01:04:49.634261+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.076577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"267'4","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634359+0000","last_change":"2024-09-12T00:38:07.659781+0000","last_active":"2024-09-12T01:04:49.634359+0000","last_peered":"2024-09-12T01:04:49.634359+0000","last_clean":"2024-09-12T01:04:49.634359+0000","last_became_active":"2024-09-12T00:38:07.656570+0000","last_became_peered":"2024-09-12T00:38:07.656570+0000","last_unstale":"2024-09-12T01:04:49.634359+0000","last_undegraded":"2024-09-12T01:04:49.634359+0000","last_fullsized":"2024-09-12T01:04:49.634359+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.888062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'40","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.829646+0000","last_change":"2024-09-12T00:36:37.239747+0000","last_active":"2024-09-12T01:05:02.829646+0000","last_peered":"2024-09-12T01:05:02.829646+0000","last_clean":"2024-09-12T01:05:02.829646+0000","last_became_active":"2024-09-12T00:36:37.239055+0000","last_became_peered":"2024-09-12T00:36:37.239055+0000","last_unstale":"2024-09-12T01:05:02.829646+0000","last_undegraded":"2024-09-12T01:05:02.829646+0000","last_fullsized":"2024-09-12T01:05:02.829646+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:58.947633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":128,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748036+0000","last_change":"2024-09-12T00:49:10.625186+0000","last_active":"2024-09-12T01:04:09.748036+0000","last_peered":"2024-09-12T01:04:09.748036+0000","last_clean":"2024-09-12T01:04:09.748036+0000","last_became_active":"2024-09-12T00:49:10.624542+0000","last_became_peered":"2024-09-12T00:49:10.624542+0000","last_unstale":"2024-09-12T01:04:09.748036+0000","last_undegraded":"2024-09-12T01:04:09.748036+0000","last_fullsized":"2024-09-12T01:04:09.748036+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:44.317158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.734406+0000","last_change":"2024-09-12T00:38:10.698782+0000","last_active":"2024-09-12T01:03:14.734406+0000","last_peered":"2024-09-12T01:03:14.734406+0000","last_clean":"2024-09-12T01:03:14.734406+0000","last_became_active":"2024-09-12T00:38:10.698076+0000","last_became_peered":"2024-09-12T00:38:10.698076+0000","last_unstale":"2024-09-12T01:03:14.734406+0000","last_undegraded":"2024-09-12T01:03:14.734406+0000","last_fullsized":"2024-09-12T01:03:14.734406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.783233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.573024+0000","last_change":"2024-09-12T00:38:07.627893+0000","last_active":"2024-09-12T01:03:09.573024+0000","last_peered":"2024-09-12T01:03:09.573024+0000","last_clean":"2024-09-12T01:03:09.573024+0000","last_became_active":"2024-09-12T00:38:07.626956+0000","last_became_peered":"2024-09-12T00:38:07.626956+0000","last_unstale":"2024-09-12T01:03:09.573024+0000","last_undegraded":"2024-09-12T01:03:09.573024+0000","last_fullsized":"2024-09-12T01:03:09.573024+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.872892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'29","reported_seq":124,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.573884+0000","last_change":"2024-09-12T00:36:37.240924+0000","last_active":"2024-09-12T01:03:18.573884+0000","last_peered":"2024-09-12T01:03:18.573884+0000","last_clean":"2024-09-12T01:03:18.573884+0000","last_became_active":"2024-09-12T00:36:37.239412+0000","last_became_peered":"2024-09-12T00:36:37.239412+0000","last_unstale":"2024-09-12T01:03:18.573884+0000","last_undegraded":"2024-09-12T01:03:18.573884+0000","last_fullsized":"2024-09-12T01:03:18.573884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:01.137832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":107,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587293+0000","last_change":"2024-09-12T00:49:10.628369+0000","last_active":"2024-09-12T01:04:14.587293+0000","last_peered":"2024-09-12T01:04:14.587293+0000","last_clean":"2024-09-12T01:04:14.587293+0000","last_became_active":"2024-09-12T00:49:10.623930+0000","last_became_peered":"2024-09-12T00:49:10.623930+0000","last_unstale":"2024-09-12T01:04:14.587293+0000","last_undegraded":"2024-09-12T01:04:14.587293+0000","last_fullsized":"2024-09-12T01:04:14.587293+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.045569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.572802+0000","last_change":"2024-09-12T00:38:10.710382+0000","last_active":"2024-09-12T01:03:13.572802+0000","last_peered":"2024-09-12T01:03:13.572802+0000","last_clean":"2024-09-12T01:03:13.572802+0000","last_became_active":"2024-09-12T00:38:10.709065+0000","last_became_peered":"2024-09-12T00:38:10.709065+0000","last_unstale":"2024-09-12T01:03:13.572802+0000","last_undegraded":"2024-09-12T01:03:13.572802+0000","last_fullsized":"2024-09-12T01:03:13.572802+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:25.778926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.566642+0000","last_change":"2024-09-12T00:38:07.659182+0000","last_active":"2024-09-12T01:03:09.566642+0000","last_peered":"2024-09-12T01:03:09.566642+0000","last_clean":"2024-09-12T01:03:09.566642+0000","last_became_active":"2024-09-12T00:38:07.658039+0000","last_became_peered":"2024-09-12T00:38:07.658039+0000","last_unstale":"2024-09-12T01:03:09.566642+0000","last_undegraded":"2024-09-12T01:03:09.566642+0000","last_fullsized":"2024-09-12T01:03:09.566642+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:05.041242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":3,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'24","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567579+0000","last_change":"2024-09-12T00:36:37.243485+0000","last_active":"2024-09-12T01:03:14.567579+0000","last_peered":"2024-09-12T01:03:14.567579+0000","last_clean":"2024-09-12T01:03:14.567579+0000","last_became_active":"2024-09-12T00:36:37.238156+0000","last_became_peered":"2024-09-12T00:36:37.238156+0000","last_unstale":"2024-09-12T01:03:14.567579+0000","last_undegraded":"2024-09-12T01:03:14.567579+0000","last_fullsized":"2024-09-12T01:03:14.567579+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:40.335893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":66,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.591380+0000","last_change":"2024-09-12T00:49:10.614687+0000","last_active":"2024-09-12T01:03:14.591380+0000","last_peered":"2024-09-12T01:03:14.591380+0000","last_clean":"2024-09-12T01:03:14.591380+0000","last_became_active":"2024-09-12T00:49:10.614006+0000","last_became_peered":"2024-09-12T00:49:10.614006+0000","last_unstale":"2024-09-12T01:03:14.591380+0000","last_undegraded":"2024-09-12T01:03:14.591380+0000","last_fullsized":"2024-09-12T01:03:14.591380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.570199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.428804+0000","last_change":"2024-09-12T00:38:10.692661+0000","last_active":"2024-09-12T01:07:13.428804+0000","last_peered":"2024-09-12T01:07:13.428804+0000","last_clean":"2024-09-12T01:07:13.428804+0000","last_became_active":"2024-09-12T00:38:10.691887+0000","last_became_peered":"2024-09-12T00:38:10.691887+0000","last_unstale":"2024-09-12T01:07:13.428804+0000","last_undegraded":"2024-09-12T01:07:13.428804+0000","last_fullsized":"2024-09-12T01:07:13.428804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.050768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619962+0000","last_change":"2024-09-12T00:38:07.654631+0000","last_active":"2024-09-12T01:03:54.619962+0000","last_peered":"2024-09-12T01:03:54.619962+0000","last_clean":"2024-09-12T01:03:54.619962+0000","last_became_active":"2024-09-12T00:38:07.653685+0000","last_became_peered":"2024-09-12T00:38:07.653685+0000","last_unstale":"2024-09-12T01:03:54.619962+0000","last_undegraded":"2024-09-12T01:03:54.619962+0000","last_fullsized":"2024-09-12T01:03:54.619962+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:49.445932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'8","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567005+0000","last_change":"2024-09-12T00:36:37.229918+0000","last_active":"2024-09-12T01:03:14.567005+0000","last_peered":"2024-09-12T01:03:14.567005+0000","last_clean":"2024-09-12T01:03:14.567005+0000","last_became_active":"2024-09-12T00:36:37.223860+0000","last_became_peered":"2024-09-12T00:36:37.223860+0000","last_unstale":"2024-09-12T01:03:14.567005+0000","last_undegraded":"2024-09-12T01:03:14.567005+0000","last_fullsized":"2024-09-12T01:03:14.567005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:21.022755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567701+0000","last_change":"2024-09-12T00:49:10.623954+0000","last_active":"2024-09-12T01:03:14.567701+0000","last_peered":"2024-09-12T01:03:14.567701+0000","last_clean":"2024-09-12T01:03:14.567701+0000","last_became_active":"2024-09-12T00:49:10.622347+0000","last_became_peered":"2024-09-12T00:49:10.622347+0000","last_unstale":"2024-09-12T01:03:14.567701+0000","last_undegraded":"2024-09-12T01:03:14.567701+0000","last_fullsized":"2024-09-12T01:03:14.567701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:20.923775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.602778+0000","last_change":"2024-09-12T00:38:10.718025+0000","last_active":"2024-09-12T01:03:59.602778+0000","last_peered":"2024-09-12T01:03:59.602778+0000","last_clean":"2024-09-12T01:03:59.602778+0000","last_became_active":"2024-09-12T00:38:10.717358+0000","last_became_peered":"2024-09-12T00:38:10.717358+0000","last_unstale":"2024-09-12T01:03:59.602778+0000","last_undegraded":"2024-09-12T01:03:59.602778+0000","last_fullsized":"2024-09-12T01:03:59.602778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:56.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.593987+0000","last_change":"2024-09-12T00:38:07.639460+0000","last_active":"2024-09-12T01:04:44.593987+0000","last_peered":"2024-09-12T01:04:44.593987+0000","last_clean":"2024-09-12T01:04:44.593987+0000","last_became_active":"2024-09-12T00:38:07.638712+0000","last_became_peered":"2024-09-12T00:38:07.638712+0000","last_unstale":"2024-09-12T01:04:44.593987+0000","last_undegraded":"2024-09-12T01:04:44.593987+0000","last_fullsized":"2024-09-12T01:04:44.593987+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:01.987566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'20","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.646910+0000","last_change":"2024-09-12T00:36:37.224823+0000","last_active":"2024-09-12T01:03:20.646910+0000","last_peered":"2024-09-12T01:03:20.646910+0000","last_clean":"2024-09-12T01:03:20.646910+0000","last_became_active":"2024-09-12T00:36:37.223487+0000","last_became_peered":"2024-09-12T00:36:37.223487+0000","last_unstale":"2024-09-12T01:03:20.646910+0000","last_undegraded":"2024-09-12T01:03:20.646910+0000","last_fullsized":"2024-09-12T01:03:20.646910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.907220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":70,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.733136+0000","last_change":"2024-09-12T00:49:10.612000+0000","last_active":"2024-09-12T01:03:09.733136+0000","last_peered":"2024-09-12T01:03:09.733136+0000","last_clean":"2024-09-12T01:03:09.733136+0000","last_became_active":"2024-09-12T00:49:10.611251+0000","last_became_peered":"2024-09-12T00:49:10.611251+0000","last_unstale":"2024-09-12T01:03:09.733136+0000","last_undegraded":"2024-09-12T01:03:09.733136+0000","last_fullsized":"2024-09-12T01:03:09.733136+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:41.354887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.558277+0000","last_change":"2024-09-12T00:38:10.707668+0000","last_active":"2024-09-12T01:07:26.558277+0000","last_peered":"2024-09-12T01:07:26.558277+0000","last_clean":"2024-09-12T01:07:26.558277+0000","last_became_active":"2024-09-12T00:38:10.706726+0000","last_became_peered":"2024-09-12T00:38:10.706726+0000","last_unstale":"2024-09-12T01:07:26.558277+0000","last_undegraded":"2024-09-12T01:07:26.558277+0000","last_fullsized":"2024-09-12T01:07:26.558277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:45.954816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321211+0000","last_change":"2024-09-12T00:38:07.668470+0000","last_active":"2024-09-12T01:07:26.321211+0000","last_peered":"2024-09-12T01:07:26.321211+0000","last_clean":"2024-09-12T01:07:26.321211+0000","last_became_active":"2024-09-12T00:38:07.667724+0000","last_became_peered":"2024-09-12T00:38:07.667724+0000","last_unstale":"2024-09-12T01:07:26.321211+0000","last_undegraded":"2024-09-12T01:07:26.321211+0000","last_fullsized":"2024-09-12T01:07:26.321211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:20.409038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'49","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.780052+0000","last_change":"2024-09-12T00:36:37.244938+0000","last_active":"2024-09-12T01:04:57.780052+0000","last_peered":"2024-09-12T01:04:57.780052+0000","last_clean":"2024-09-12T01:04:57.780052+0000","last_became_active":"2024-09-12T00:36:37.244259+0000","last_became_peered":"2024-09-12T00:36:37.244259+0000","last_unstale":"2024-09-12T01:04:57.780052+0000","last_undegraded":"2024-09-12T01:04:57.780052+0000","last_fullsized":"2024-09-12T01:04:57.780052+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.194885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":182,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.574047+0000","last_change":"2024-09-12T00:49:10.630411+0000","last_active":"2024-09-12T01:03:14.574047+0000","last_peered":"2024-09-12T01:03:14.574047+0000","last_clean":"2024-09-12T01:03:14.574047+0000","last_became_active":"2024-09-12T00:49:10.629746+0000","last_became_peered":"2024-09-12T00:49:10.629746+0000","last_unstale":"2024-09-12T01:03:14.574047+0000","last_undegraded":"2024-09-12T01:03:14.574047+0000","last_fullsized":"2024-09-12T01:03:14.574047+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:10.415361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.595049+0000","last_change":"2024-09-12T00:38:10.696938+0000","last_active":"2024-09-12T01:04:49.595049+0000","last_peered":"2024-09-12T01:04:49.595049+0000","last_clean":"2024-09-12T01:04:49.595049+0000","last_became_active":"2024-09-12T00:38:10.695688+0000","last_became_peered":"2024-09-12T00:38:10.695688+0000","last_unstale":"2024-09-12T01:04:49.595049+0000","last_undegraded":"2024-09-12T01:04:49.595049+0000","last_fullsized":"2024-09-12T01:04:49.595049+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:07.485587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.614081+0000","last_change":"2024-09-12T00:38:07.647799+0000","last_active":"2024-09-12T01:04:44.614081+0000","last_peered":"2024-09-12T01:04:44.614081+0000","last_clean":"2024-09-12T01:04:44.614081+0000","last_became_active":"2024-09-12T00:38:07.645284+0000","last_became_peered":"2024-09-12T00:38:07.645284+0000","last_unstale":"2024-09-12T01:04:44.614081+0000","last_undegraded":"2024-09-12T01:04:44.614081+0000","last_fullsized":"2024-09-12T01:04:44.614081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:30.146339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.633189+0000","last_change":"2024-09-12T00:36:37.221009+0000","last_active":"2024-09-12T01:04:44.633189+0000","last_peered":"2024-09-12T01:04:44.633189+0000","last_clean":"2024-09-12T01:04:44.633189+0000","last_became_active":"2024-09-12T00:36:37.220195+0000","last_became_peered":"2024-09-12T00:36:37.220195+0000","last_unstale":"2024-09-12T01:04:44.633189+0000","last_undegraded":"2024-09-12T01:04:44.633189+0000","last_fullsized":"2024-09-12T01:04:44.633189+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:56.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":108,"num_write":45,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.599208+0000","last_change":"2024-09-12T00:49:10.615352+0000","last_active":"2024-09-12T01:03:44.599208+0000","last_peered":"2024-09-12T01:03:44.599208+0000","last_clean":"2024-09-12T01:03:44.599208+0000","last_became_active":"2024-09-12T00:49:10.614661+0000","last_became_peered":"2024-09-12T00:49:10.614661+0000","last_unstale":"2024-09-12T01:03:44.599208+0000","last_undegraded":"2024-09-12T01:03:44.599208+0000","last_fullsized":"2024-09-12T01:03:44.599208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:28.781007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.601595+0000","last_change":"2024-09-12T00:38:10.704123+0000","last_active":"2024-09-12T01:03:54.601595+0000","last_peered":"2024-09-12T01:03:54.601595+0000","last_clean":"2024-09-12T01:03:54.601595+0000","last_became_active":"2024-09-12T00:38:10.702260+0000","last_became_peered":"2024-09-12T00:38:10.702260+0000","last_unstale":"2024-09-12T01:03:54.601595+0000","last_undegraded":"2024-09-12T01:03:54.601595+0000","last_fullsized":"2024-09-12T01:03:54.601595+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:52.661395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763803+0000","last_change":"2024-09-12T00:38:07.640472+0000","last_active":"2024-09-12T01:03:49.763803+0000","last_peered":"2024-09-12T01:03:49.763803+0000","last_clean":"2024-09-12T01:03:49.763803+0000","last_became_active":"2024-09-12T00:38:07.639687+0000","last_became_peered":"2024-09-12T00:38:07.639687+0000","last_unstale":"2024-09-12T01:03:49.763803+0000","last_undegraded":"2024-09-12T01:03:49.763803+0000","last_fullsized":"2024-09-12T01:03:49.763803+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:58.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'52","reported_seq":183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.631949+0000","last_change":"2024-09-12T00:36:37.241171+0000","last_active":"2024-09-12T01:04:39.631949+0000","last_peered":"2024-09-12T01:04:39.631949+0000","last_clean":"2024-09-12T01:04:39.631949+0000","last_became_active":"2024-09-12T00:36:37.239844+0000","last_became_peered":"2024-09-12T00:36:37.239844+0000","last_unstale":"2024-09-12T01:04:39.631949+0000","last_undegraded":"2024-09-12T01:04:39.631949+0000","last_fullsized":"2024-09-12T01:04:39.631949+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:34.727635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":188,"num_write":97,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574686+0000","last_change":"2024-09-12T00:49:10.632954+0000","last_active":"2024-09-12T01:03:44.574686+0000","last_peered":"2024-09-12T01:03:44.574686+0000","last_clean":"2024-09-12T01:03:44.574686+0000","last_became_active":"2024-09-12T00:49:10.632241+0000","last_became_peered":"2024-09-12T00:49:10.632241+0000","last_unstale":"2024-09-12T01:03:44.574686+0000","last_undegraded":"2024-09-12T01:03:44.574686+0000","last_fullsized":"2024-09-12T01:03:44.574686+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:12.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"267'4","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.601460+0000","last_change":"2024-09-12T00:38:10.714497+0000","last_active":"2024-09-12T01:03:54.601460+0000","last_peered":"2024-09-12T01:03:54.601460+0000","last_clean":"2024-09-12T01:03:54.601460+0000","last_became_active":"2024-09-12T00:38:10.713890+0000","last_became_peered":"2024-09-12T00:38:10.713890+0000","last_unstale":"2024-09-12T01:03:54.601460+0000","last_undegraded":"2024-09-12T01:03:54.601460+0000","last_fullsized":"2024-09-12T01:03:54.601460+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.839866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600291+0000","last_change":"2024-09-12T00:38:07.667759+0000","last_active":"2024-09-12T01:03:49.600291+0000","last_peered":"2024-09-12T01:03:49.600291+0000","last_clean":"2024-09-12T01:03:49.600291+0000","last_became_active":"2024-09-12T00:38:07.667180+0000","last_became_peered":"2024-09-12T00:38:07.667180+0000","last_unstale":"2024-09-12T01:03:49.600291+0000","last_undegraded":"2024-09-12T01:03:49.600291+0000","last_fullsized":"2024-09-12T01:03:49.600291+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.515772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'23","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.592102+0000","last_change":"2024-09-12T00:36:37.253314+0000","last_active":"2024-09-12T01:04:38.592102+0000","last_peered":"2024-09-12T01:04:38.592102+0000","last_clean":"2024-09-12T01:04:38.592102+0000","last_became_active":"2024-09-12T00:36:37.248733+0000","last_became_peered":"2024-09-12T00:36:37.248733+0000","last_unstale":"2024-09-12T01:04:38.592102+0000","last_undegraded":"2024-09-12T01:04:38.592102+0000","last_fullsized":"2024-09-12T01:04:38.592102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.498855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.568017+0000","last_change":"2024-09-12T00:49:10.639305+0000","last_active":"2024-09-12T01:03:19.568017+0000","last_peered":"2024-09-12T01:03:19.568017+0000","last_clean":"2024-09-12T01:03:19.568017+0000","last_became_active":"2024-09-12T00:49:10.638628+0000","last_became_peered":"2024-09-12T00:49:10.638628+0000","last_unstale":"2024-09-12T01:03:19.568017+0000","last_undegraded":"2024-09-12T01:03:19.568017+0000","last_fullsized":"2024-09-12T01:03:19.568017+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:12.353339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.582007+0000","last_change":"2024-09-12T00:38:10.691801+0000","last_active":"2024-09-12T01:03:53.582007+0000","last_peered":"2024-09-12T01:03:53.582007+0000","last_clean":"2024-09-12T01:03:53.582007+0000","last_became_active":"2024-09-12T00:38:10.691129+0000","last_became_peered":"2024-09-12T00:38:10.691129+0000","last_unstale":"2024-09-12T01:03:53.582007+0000","last_undegraded":"2024-09-12T01:03:53.582007+0000","last_fullsized":"2024-09-12T01:03:53.582007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:27.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763900+0000","last_change":"2024-09-12T00:38:07.642523+0000","last_active":"2024-09-12T01:03:49.763900+0000","last_peered":"2024-09-12T01:03:49.763900+0000","last_clean":"2024-09-12T01:03:49.763900+0000","last_became_active":"2024-09-12T00:38:07.641719+0000","last_became_peered":"2024-09-12T00:38:07.641719+0000","last_unstale":"2024-09-12T01:03:49.763900+0000","last_undegraded":"2024-09-12T01:03:49.763900+0000","last_fullsized":"2024-09-12T01:03:49.763900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.330959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'60","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.754899+0000","last_change":"2024-09-12T00:36:37.224160+0000","last_active":"2024-09-12T01:04:39.754899+0000","last_peered":"2024-09-12T01:04:39.754899+0000","last_clean":"2024-09-12T01:04:39.754899+0000","last_became_active":"2024-09-12T00:36:37.223432+0000","last_became_peered":"2024-09-12T00:36:37.223432+0000","last_unstale":"2024-09-12T01:04:39.754899+0000","last_undegraded":"2024-09-12T01:04:39.754899+0000","last_fullsized":"2024-09-12T01:04:39.754899+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:13.061629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":212,"num_write":101,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574626+0000","last_change":"2024-09-12T00:49:10.635230+0000","last_active":"2024-09-12T01:03:44.574626+0000","last_peered":"2024-09-12T01:03:44.574626+0000","last_clean":"2024-09-12T01:03:44.574626+0000","last_became_active":"2024-09-12T00:49:10.634783+0000","last_became_peered":"2024-09-12T00:49:10.634783+0000","last_unstale":"2024-09-12T01:03:44.574626+0000","last_undegraded":"2024-09-12T01:03:44.574626+0000","last_fullsized":"2024-09-12T01:03:44.574626+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:22.424861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619873+0000","last_change":"2024-09-12T00:38:10.709528+0000","last_active":"2024-09-12T01:03:54.619873+0000","last_peered":"2024-09-12T01:03:54.619873+0000","last_clean":"2024-09-12T01:03:54.619873+0000","last_became_active":"2024-09-12T00:38:10.708687+0000","last_became_peered":"2024-09-12T00:38:10.708687+0000","last_unstale":"2024-09-12T01:03:54.619873+0000","last_undegraded":"2024-09-12T01:03:54.619873+0000","last_fullsized":"2024-09-12T01:03:54.619873+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.079976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763955+0000","last_change":"2024-09-12T00:38:07.637056+0000","last_active":"2024-09-12T01:03:49.763955+0000","last_peered":"2024-09-12T01:03:49.763955+0000","last_clean":"2024-09-12T01:03:49.763955+0000","last_became_active":"2024-09-12T00:38:07.636298+0000","last_became_peered":"2024-09-12T00:38:07.636298+0000","last_unstale":"2024-09-12T01:03:49.763955+0000","last_undegraded":"2024-09-12T01:03:49.763955+0000","last_fullsized":"2024-09-12T01:03:49.763955+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.591991+0000","last_change":"2024-09-12T00:36:37.253687+0000","last_active":"2024-09-12T01:04:38.591991+0000","last_peered":"2024-09-12T01:04:38.591991+0000","last_clean":"2024-09-12T01:04:38.591991+0000","last_became_active":"2024-09-12T00:36:37.248770+0000","last_became_peered":"2024-09-12T00:36:37.248770+0000","last_unstale":"2024-09-12T01:04:38.591991+0000","last_undegraded":"2024-09-12T01:04:38.591991+0000","last_fullsized":"2024-09-12T01:04:38.591991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.878928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":141,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609918+0000","last_change":"2024-09-12T00:49:10.597538+0000","last_active":"2024-09-12T01:04:29.609918+0000","last_peered":"2024-09-12T01:04:29.609918+0000","last_clean":"2024-09-12T01:04:29.609918+0000","last_became_active":"2024-09-12T00:49:10.596695+0000","last_became_peered":"2024-09-12T00:49:10.596695+0000","last_unstale":"2024-09-12T01:04:29.609918+0000","last_undegraded":"2024-09-12T01:04:29.609918+0000","last_fullsized":"2024-09-12T01:04:29.609918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:51.074598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600399+0000","last_change":"2024-09-12T00:38:10.683836+0000","last_active":"2024-09-12T01:05:13.600399+0000","last_peered":"2024-09-12T01:05:13.600399+0000","last_clean":"2024-09-12T01:05:13.600399+0000","last_became_active":"2024-09-12T00:38:10.683024+0000","last_became_peered":"2024-09-12T00:38:10.683024+0000","last_unstale":"2024-09-12T01:05:13.600399+0000","last_undegraded":"2024-09-12T01:05:13.600399+0000","last_fullsized":"2024-09-12T01:05:13.600399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:08.556147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.761594+0000","last_change":"2024-09-12T00:38:07.664050+0000","last_active":"2024-09-12T01:05:09.761594+0000","last_peered":"2024-09-12T01:05:09.761594+0000","last_clean":"2024-09-12T01:05:09.761594+0000","last_became_active":"2024-09-12T00:38:07.663265+0000","last_became_peered":"2024-09-12T00:38:07.663265+0000","last_unstale":"2024-09-12T01:05:09.761594+0000","last_undegraded":"2024-09-12T01:05:09.761594+0000","last_fullsized":"2024-09-12T01:05:09.761594+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:28.984997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'15","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.579861+0000","last_change":"2024-09-12T00:36:37.248079+0000","last_active":"2024-09-12T01:03:43.579861+0000","last_peered":"2024-09-12T01:03:43.579861+0000","last_clean":"2024-09-12T01:03:43.579861+0000","last_became_active":"2024-09-12T00:36:37.247409+0000","last_became_peered":"2024-09-12T00:36:37.247409+0000","last_unstale":"2024-09-12T01:03:43.579861+0000","last_undegraded":"2024-09-12T01:03:43.579861+0000","last_fullsized":"2024-09-12T01:03:43.579861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:04.933898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":52,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.779758+0000","last_change":"2024-09-12T00:49:10.594239+0000","last_active":"2024-09-12T01:04:59.779758+0000","last_peered":"2024-09-12T01:04:59.779758+0000","last_clean":"2024-09-12T01:04:59.779758+0000","last_became_active":"2024-09-12T00:49:10.593471+0000","last_became_peered":"2024-09-12T00:49:10.593471+0000","last_unstale":"2024-09-12T01:04:59.779758+0000","last_undegraded":"2024-09-12T01:04:59.779758+0000","last_fullsized":"2024-09-12T01:04:59.779758+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:54.840220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"267'4","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321277+0000","last_change":"2024-09-12T00:38:10.709654+0000","last_active":"2024-09-12T01:07:26.321277+0000","last_peered":"2024-09-12T01:07:26.321277+0000","last_clean":"2024-09-12T01:07:26.321277+0000","last_became_active":"2024-09-12T00:38:10.708936+0000","last_became_peered":"2024-09-12T00:38:10.708936+0000","last_unstale":"2024-09-12T01:07:26.321277+0000","last_undegraded":"2024-09-12T01:07:26.321277+0000","last_fullsized":"2024-09-12T01:07:26.321277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:34.439374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'6","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.594403+0000","last_change":"2024-09-12T00:38:07.651137+0000","last_active":"2024-09-12T01:05:09.594403+0000","last_peered":"2024-09-12T01:05:09.594403+0000","last_clean":"2024-09-12T01:05:09.594403+0000","last_became_active":"2024-09-12T00:38:07.650419+0000","last_became_peered":"2024-09-12T00:38:07.650419+0000","last_unstale":"2024-09-12T01:05:09.594403+0000","last_undegraded":"2024-09-12T01:05:09.594403+0000","last_fullsized":"2024-09-12T01:05:09.594403+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.557871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'98","reported_seq":352,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.615890+0000","last_change":"2024-09-12T00:36:37.227751+0000","last_active":"2024-09-12T01:03:39.615890+0000","last_peered":"2024-09-12T01:03:39.615890+0000","last_clean":"2024-09-12T01:03:39.615890+0000","last_became_active":"2024-09-12T00:36:37.225615+0000","last_became_peered":"2024-09-12T00:36:37.225615+0000","last_unstale":"2024-09-12T01:03:39.615890+0000","last_undegraded":"2024-09-12T01:03:39.615890+0000","last_fullsized":"2024-09-12T01:03:39.615890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:24.078167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":608,"num_read_kb":444,"num_write":119,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626251+0000","last_change":"2024-09-12T00:49:10.620839+0000","last_active":"2024-09-12T01:04:19.626251+0000","last_peered":"2024-09-12T01:04:19.626251+0000","last_clean":"2024-09-12T01:04:19.626251+0000","last_became_active":"2024-09-12T00:49:10.620169+0000","last_became_peered":"2024-09-12T00:49:10.620169+0000","last_unstale":"2024-09-12T01:04:19.626251+0000","last_undegraded":"2024-09-12T01:04:19.626251+0000","last_fullsized":"2024-09-12T01:04:19.626251+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.688639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.570450+0000","last_change":"2024-09-12T00:38:10.686990+0000","last_active":"2024-09-12T01:03:03.570450+0000","last_peered":"2024-09-12T01:03:03.570450+0000","last_clean":"2024-09-12T01:03:03.570450+0000","last_became_active":"2024-09-12T00:38:10.686216+0000","last_became_peered":"2024-09-12T00:38:10.686216+0000","last_unstale":"2024-09-12T01:03:03.570450+0000","last_undegraded":"2024-09-12T01:03:03.570450+0000","last_fullsized":"2024-09-12T01:03:03.570450+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:24.592600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"267'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.431292+0000","last_change":"2024-09-12T00:38:07.666660+0000","last_active":"2024-09-12T01:07:23.431292+0000","last_peered":"2024-09-12T01:07:23.431292+0000","last_clean":"2024-09-12T01:07:23.431292+0000","last_became_active":"2024-09-12T00:38:07.661932+0000","last_became_peered":"2024-09-12T00:38:07.661932+0000","last_unstale":"2024-09-12T01:07:23.431292+0000","last_undegraded":"2024-09-12T01:07:23.431292+0000","last_fullsized":"2024-09-12T01:07:23.431292+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:30.080552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'12","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.761390+0000","last_change":"2024-09-12T00:36:37.227779+0000","last_active":"2024-09-12T01:03:39.761390+0000","last_peered":"2024-09-12T01:03:39.761390+0000","last_clean":"2024-09-12T01:03:39.761390+0000","last_became_active":"2024-09-12T00:36:37.226992+0000","last_became_peered":"2024-09-12T00:36:37.226992+0000","last_unstale":"2024-09-12T01:03:39.761390+0000","last_undegraded":"2024-09-12T01:03:39.761390+0000","last_fullsized":"2024-09-12T01:03:39.761390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.657729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.771859+0000","last_change":"2024-09-12T00:49:10.598218+0000","last_active":"2024-09-12T01:04:24.771859+0000","last_peered":"2024-09-12T01:04:24.771859+0000","last_clean":"2024-09-12T01:04:24.771859+0000","last_became_active":"2024-09-12T00:49:10.597349+0000","last_became_peered":"2024-09-12T00:49:10.597349+0000","last_unstale":"2024-09-12T01:04:24.771859+0000","last_undegraded":"2024-09-12T01:04:24.771859+0000","last_fullsized":"2024-09-12T01:04:24.771859+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:32.342356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"267'10","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.587835+0000","last_change":"2024-09-12T00:38:10.701647+0000","last_active":"2024-09-12T01:02:59.587835+0000","last_peered":"2024-09-12T01:02:59.587835+0000","last_clean":"2024-09-12T01:02:59.587835+0000","last_became_active":"2024-09-12T00:38:10.700892+0000","last_became_peered":"2024-09-12T00:38:10.700892+0000","last_unstale":"2024-09-12T01:02:59.587835+0000","last_undegraded":"2024-09-12T01:02:59.587835+0000","last_fullsized":"2024-09-12T01:02:59.587835+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:36.388849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":15,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.569267+0000","last_change":"2024-09-12T00:38:07.643675+0000","last_active":"2024-09-12T01:02:58.569267+0000","last_peered":"2024-09-12T01:02:58.569267+0000","last_clean":"2024-09-12T01:02:58.569267+0000","last_became_active":"2024-09-12T00:38:07.642924+0000","last_became_peered":"2024-09-12T00:38:07.642924+0000","last_unstale":"2024-09-12T01:02:58.569267+0000","last_undegraded":"2024-09-12T01:02:58.569267+0000","last_fullsized":"2024-09-12T01:02:58.569267+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:03.027647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'31","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573415+0000","last_change":"2024-09-12T00:36:37.243786+0000","last_active":"2024-09-12T01:03:39.573415+0000","last_peered":"2024-09-12T01:03:39.573415+0000","last_clean":"2024-09-12T01:03:39.573415+0000","last_became_active":"2024-09-12T00:36:37.238481+0000","last_became_peered":"2024-09-12T00:36:37.238481+0000","last_unstale":"2024-09-12T01:03:39.573415+0000","last_undegraded":"2024-09-12T01:03:39.573415+0000","last_fullsized":"2024-09-12T01:03:39.573415+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:15.555438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":121,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.617607+0000","last_change":"2024-09-12T00:49:10.614315+0000","last_active":"2024-09-12T01:04:59.617607+0000","last_peered":"2024-09-12T01:04:59.617607+0000","last_clean":"2024-09-12T01:04:59.617607+0000","last_became_active":"2024-09-12T00:49:10.613613+0000","last_became_peered":"2024-09-12T00:49:10.613613+0000","last_unstale":"2024-09-12T01:04:59.617607+0000","last_undegraded":"2024-09-12T01:04:59.617607+0000","last_fullsized":"2024-09-12T01:04:59.617607+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:45.422915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.624836+0000","last_change":"2024-09-12T00:38:10.695438+0000","last_active":"2024-09-12T01:04:14.624836+0000","last_peered":"2024-09-12T01:04:14.624836+0000","last_clean":"2024-09-12T01:04:14.624836+0000","last_became_active":"2024-09-12T00:38:10.694714+0000","last_became_peered":"2024-09-12T00:38:10.694714+0000","last_unstale":"2024-09-12T01:04:14.624836+0000","last_undegraded":"2024-09-12T01:04:14.624836+0000","last_fullsized":"2024-09-12T01:04:14.624836+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:46.770976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852962+0000","last_change":"2024-09-12T00:38:07.653886+0000","last_active":"2024-09-12T01:07:25.852962+0000","last_peered":"2024-09-12T01:07:25.852962+0000","last_clean":"2024-09-12T01:07:25.852962+0000","last_became_active":"2024-09-12T00:38:07.647225+0000","last_became_peered":"2024-09-12T00:38:07.647225+0000","last_unstale":"2024-09-12T01:07:25.852962+0000","last_undegraded":"2024-09-12T01:07:25.852962+0000","last_fullsized":"2024-09-12T01:07:25.852962+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:14.958030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'12","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573328+0000","last_change":"2024-09-12T00:36:37.249508+0000","last_active":"2024-09-12T01:03:39.573328+0000","last_peered":"2024-09-12T01:03:39.573328+0000","last_clean":"2024-09-12T01:03:39.573328+0000","last_became_active":"2024-09-12T00:36:37.246075+0000","last_became_peered":"2024-09-12T00:36:37.246075+0000","last_unstale":"2024-09-12T01:03:39.573328+0000","last_undegraded":"2024-09-12T01:03:39.573328+0000","last_fullsized":"2024-09-12T01:03:39.573328+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:45.712512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.759397+0000","last_change":"2024-09-12T00:49:10.598511+0000","last_active":"2024-09-12T01:04:59.759397+0000","last_peered":"2024-09-12T01:04:59.759397+0000","last_clean":"2024-09-12T01:04:59.759397+0000","last_became_active":"2024-09-12T00:49:10.597773+0000","last_became_peered":"2024-09-12T00:49:10.597773+0000","last_unstale":"2024-09-12T01:04:59.759397+0000","last_undegraded":"2024-09-12T01:04:59.759397+0000","last_fullsized":"2024-09-12T01:04:59.759397+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:51.989977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749157+0000","last_change":"2024-09-12T00:38:10.698369+0000","last_active":"2024-09-12T01:04:14.749157+0000","last_peered":"2024-09-12T01:04:14.749157+0000","last_clean":"2024-09-12T01:04:14.749157+0000","last_became_active":"2024-09-12T00:38:10.697403+0000","last_became_peered":"2024-09-12T00:38:10.697403+0000","last_unstale":"2024-09-12T01:04:14.749157+0000","last_undegraded":"2024-09-12T01:04:14.749157+0000","last_fullsized":"2024-09-12T01:04:14.749157+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:19.999588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.605162+0000","last_change":"2024-09-12T00:38:07.668475+0000","last_active":"2024-09-12T01:04:09.605162+0000","last_peered":"2024-09-12T01:04:09.605162+0000","last_clean":"2024-09-12T01:04:09.605162+0000","last_became_active":"2024-09-12T00:38:07.667447+0000","last_became_peered":"2024-09-12T00:38:07.667447+0000","last_unstale":"2024-09-12T01:04:09.605162+0000","last_undegraded":"2024-09-12T01:04:09.605162+0000","last_fullsized":"2024-09-12T01:04:09.605162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:23.306315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.758150+0000","last_change":"2024-09-12T00:36:37.240933+0000","last_active":"2024-09-12T01:04:54.758150+0000","last_peered":"2024-09-12T01:04:54.758150+0000","last_clean":"2024-09-12T01:04:54.758150+0000","last_became_active":"2024-09-12T00:36:37.239946+0000","last_became_peered":"2024-09-12T00:36:37.239946+0000","last_unstale":"2024-09-12T01:04:54.758150+0000","last_undegraded":"2024-09-12T01:04:54.758150+0000","last_fullsized":"2024-09-12T01:04:54.758150+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:57.116646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.597511+0000","last_change":"2024-09-12T00:49:10.630825+0000","last_active":"2024-09-12T01:04:59.597511+0000","last_peered":"2024-09-12T01:04:59.597511+0000","last_clean":"2024-09-12T01:04:59.597511+0000","last_became_active":"2024-09-12T00:49:10.629903+0000","last_became_peered":"2024-09-12T00:49:10.629903+0000","last_unstale":"2024-09-12T01:04:59.597511+0000","last_undegraded":"2024-09-12T01:04:59.597511+0000","last_fullsized":"2024-09-12T01:04:59.597511+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:07.324326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.564338+0000","last_change":"2024-09-12T00:38:10.714505+0000","last_active":"2024-09-12T01:02:59.564338+0000","last_peered":"2024-09-12T01:02:59.564338+0000","last_clean":"2024-09-12T01:02:59.564338+0000","last_became_active":"2024-09-12T00:38:10.708820+0000","last_became_peered":"2024-09-12T00:38:10.708820+0000","last_unstale":"2024-09-12T01:02:59.564338+0000","last_undegraded":"2024-09-12T01:02:59.564338+0000","last_fullsized":"2024-09-12T01:02:59.564338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:21.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'2","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:28.418371+0000","last_change":"2024-09-12T00:38:07.645572+0000","last_active":"2024-09-12T01:06:28.418371+0000","last_peered":"2024-09-12T01:06:28.418371+0000","last_clean":"2024-09-12T01:06:28.418371+0000","last_became_active":"2024-09-12T00:38:07.644752+0000","last_became_peered":"2024-09-12T00:38:07.644752+0000","last_unstale":"2024-09-12T01:06:28.418371+0000","last_undegraded":"2024-09-12T01:06:28.418371+0000","last_fullsized":"2024-09-12T01:06:28.418371+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:27.156732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"267'56","reported_seq":202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.615105+0000","last_change":"2024-09-12T00:36:37.247146+0000","last_active":"2024-09-12T01:04:49.615105+0000","last_peered":"2024-09-12T01:04:49.615105+0000","last_clean":"2024-09-12T01:04:49.615105+0000","last_became_active":"2024-09-12T00:36:37.246402+0000","last_became_peered":"2024-09-12T00:36:37.246402+0000","last_unstale":"2024-09-12T01:04:49.615105+0000","last_undegraded":"2024-09-12T01:04:49.615105+0000","last_fullsized":"2024-09-12T01:04:49.615105+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:50.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":211,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.597068+0000","last_change":"2024-09-12T00:49:10.627636+0000","last_active":"2024-09-12T01:04:58.597068+0000","last_peered":"2024-09-12T01:04:58.597068+0000","last_clean":"2024-09-12T01:04:58.597068+0000","last_became_active":"2024-09-12T00:49:10.626918+0000","last_became_peered":"2024-09-12T00:49:10.626918+0000","last_unstale":"2024-09-12T01:04:58.597068+0000","last_undegraded":"2024-09-12T01:04:58.597068+0000","last_fullsized":"2024-09-12T01:04:58.597068+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.462430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"267'6","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.588407+0000","last_change":"2024-09-12T00:38:10.706342+0000","last_active":"2024-09-12T01:04:19.588407+0000","last_peered":"2024-09-12T01:04:19.588407+0000","last_clean":"2024-09-12T01:04:19.588407+0000","last_became_active":"2024-09-12T00:38:10.705817+0000","last_became_peered":"2024-09-12T00:38:10.705817+0000","last_unstale":"2024-09-12T01:04:19.588407+0000","last_undegraded":"2024-09-12T01:04:19.588407+0000","last_fullsized":"2024-09-12T01:04:19.588407+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:39.296427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.639322+0000","last_change":"2024-09-12T00:38:07.655064+0000","last_active":"2024-09-12T01:05:09.639322+0000","last_peered":"2024-09-12T01:05:09.639322+0000","last_clean":"2024-09-12T01:05:09.639322+0000","last_became_active":"2024-09-12T00:38:07.654306+0000","last_became_peered":"2024-09-12T00:38:07.654306+0000","last_unstale":"2024-09-12T01:05:09.639322+0000","last_undegraded":"2024-09-12T01:05:09.639322+0000","last_fullsized":"2024-09-12T01:05:09.639322+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:13.318498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'60","reported_seq":249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.594897+0000","last_change":"2024-09-12T00:36:37.227571+0000","last_active":"2024-09-12T01:04:49.594897+0000","last_peered":"2024-09-12T01:04:49.594897+0000","last_clean":"2024-09-12T01:04:49.594897+0000","last_became_active":"2024-09-12T00:36:37.226845+0000","last_became_peered":"2024-09-12T00:36:37.226845+0000","last_unstale":"2024-09-12T01:04:49.594897+0000","last_undegraded":"2024-09-12T01:04:49.594897+0000","last_fullsized":"2024-09-12T01:04:49.594897+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.611933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":408,"num_read_kb":294,"num_write":66,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582015+0000","last_change":"2024-09-12T00:49:10.623449+0000","last_active":"2024-09-12T01:03:49.582015+0000","last_peered":"2024-09-12T01:03:49.582015+0000","last_clean":"2024-09-12T01:03:49.582015+0000","last_became_active":"2024-09-12T00:49:10.615566+0000","last_became_peered":"2024-09-12T00:49:10.615566+0000","last_unstale":"2024-09-12T01:03:49.582015+0000","last_undegraded":"2024-09-12T01:03:49.582015+0000","last_fullsized":"2024-09-12T01:03:49.582015+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:25.428504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'6","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.592823+0000","last_change":"2024-09-12T00:38:10.705943+0000","last_active":"2024-09-12T01:03:19.592823+0000","last_peered":"2024-09-12T01:03:19.592823+0000","last_clean":"2024-09-12T01:03:19.592823+0000","last_became_active":"2024-09-12T00:38:10.705207+0000","last_became_peered":"2024-09-12T00:38:10.705207+0000","last_unstale":"2024-09-12T01:03:19.592823+0000","last_undegraded":"2024-09-12T01:03:19.592823+0000","last_fullsized":"2024-09-12T01:03:19.592823+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:44.933546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'9","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640614+0000","last_change":"2024-09-12T00:38:07.663618+0000","last_active":"2024-09-12T01:05:14.640614+0000","last_peered":"2024-09-12T01:05:14.640614+0000","last_clean":"2024-09-12T01:05:14.640614+0000","last_became_active":"2024-09-12T00:38:07.663031+0000","last_became_peered":"2024-09-12T00:38:07.663031+0000","last_unstale":"2024-09-12T01:05:14.640614+0000","last_undegraded":"2024-09-12T01:05:14.640614+0000","last_fullsized":"2024-09-12T01:05:14.640614+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.928917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'40","reported_seq":152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587717+0000","last_change":"2024-09-12T00:36:37.251472+0000","last_active":"2024-09-12T01:04:49.587717+0000","last_peered":"2024-09-12T01:04:49.587717+0000","last_clean":"2024-09-12T01:04:49.587717+0000","last_became_active":"2024-09-12T00:36:37.250649+0000","last_became_peered":"2024-09-12T00:36:37.250649+0000","last_unstale":"2024-09-12T01:04:49.587717+0000","last_undegraded":"2024-09-12T01:04:49.587717+0000","last_fullsized":"2024-09-12T01:04:49.587717+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:22.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":70,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582037+0000","last_change":"2024-09-12T00:49:10.634985+0000","last_active":"2024-09-12T01:03:49.582037+0000","last_peered":"2024-09-12T01:03:49.582037+0000","last_clean":"2024-09-12T01:03:49.582037+0000","last_became_active":"2024-09-12T00:49:10.634433+0000","last_became_peered":"2024-09-12T00:49:10.634433+0000","last_unstale":"2024-09-12T01:03:49.582037+0000","last_undegraded":"2024-09-12T01:03:49.582037+0000","last_fullsized":"2024-09-12T01:03:49.582037+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:02.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622352+0000","last_change":"2024-09-12T00:38:10.718774+0000","last_active":"2024-09-12T01:05:19.622352+0000","last_peered":"2024-09-12T01:05:19.622352+0000","last_clean":"2024-09-12T01:05:19.622352+0000","last_became_active":"2024-09-12T00:38:10.717307+0000","last_became_peered":"2024-09-12T00:38:10.717307+0000","last_unstale":"2024-09-12T01:05:19.622352+0000","last_undegraded":"2024-09-12T01:05:19.622352+0000","last_fullsized":"2024-09-12T01:05:19.622352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:10.837950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.568074+0000","last_change":"2024-09-12T00:38:07.660476+0000","last_active":"2024-09-12T01:03:19.568074+0000","last_peered":"2024-09-12T01:03:19.568074+0000","last_clean":"2024-09-12T01:03:19.568074+0000","last_became_active":"2024-09-12T00:38:07.659692+0000","last_became_peered":"2024-09-12T00:38:07.659692+0000","last_unstale":"2024-09-12T01:03:19.568074+0000","last_undegraded":"2024-09-12T01:03:19.568074+0000","last_fullsized":"2024-09-12T01:03:19.568074+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:05.518531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'22","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.817272+0000","last_change":"2024-09-12T00:36:37.228455+0000","last_active":"2024-09-12T01:05:02.817272+0000","last_peered":"2024-09-12T01:05:02.817272+0000","last_clean":"2024-09-12T01:05:02.817272+0000","last_became_active":"2024-09-12T00:36:37.226892+0000","last_became_peered":"2024-09-12T00:36:37.226892+0000","last_unstale":"2024-09-12T01:05:02.817272+0000","last_undegraded":"2024-09-12T01:05:02.817272+0000","last_fullsized":"2024-09-12T01:05:02.817272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:09.675401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622226+0000","last_change":"2024-09-12T00:49:10.632589+0000","last_active":"2024-09-12T01:05:19.622226+0000","last_peered":"2024-09-12T01:05:19.622226+0000","last_clean":"2024-09-12T01:05:19.622226+0000","last_became_active":"2024-09-12T00:49:10.631961+0000","last_became_peered":"2024-09-12T00:49:10.631961+0000","last_unstale":"2024-09-12T01:05:19.622226+0000","last_undegraded":"2024-09-12T01:05:19.622226+0000","last_fullsized":"2024-09-12T01:05:19.622226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:28.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587368+0000","last_change":"2024-09-12T00:38:10.719998+0000","last_active":"2024-09-12T01:04:14.587368+0000","last_peered":"2024-09-12T01:04:14.587368+0000","last_clean":"2024-09-12T01:04:14.587368+0000","last_became_active":"2024-09-12T00:38:10.719337+0000","last_became_peered":"2024-09-12T00:38:10.719337+0000","last_unstale":"2024-09-12T01:04:14.587368+0000","last_undegraded":"2024-09-12T01:04:14.587368+0000","last_fullsized":"2024-09-12T01:04:14.587368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:16.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748163+0000","last_change":"2024-09-12T00:38:07.640549+0000","last_active":"2024-09-12T01:04:09.748163+0000","last_peered":"2024-09-12T01:04:09.748163+0000","last_clean":"2024-09-12T01:04:09.748163+0000","last_became_active":"2024-09-12T00:38:07.639751+0000","last_became_peered":"2024-09-12T00:38:07.639751+0000","last_unstale":"2024-09-12T01:04:09.748163+0000","last_undegraded":"2024-09-12T01:04:09.748163+0000","last_fullsized":"2024-09-12T01:04:09.748163+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:17.815510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'40","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743281+0000","last_change":"2024-09-12T00:36:37.248750+0000","last_active":"2024-09-12T01:03:49.743281+0000","last_peered":"2024-09-12T01:03:49.743281+0000","last_clean":"2024-09-12T01:03:49.743281+0000","last_became_active":"2024-09-12T00:36:37.248176+0000","last_became_peered":"2024-09-12T00:36:37.248176+0000","last_unstale":"2024-09-12T01:03:49.743281+0000","last_undegraded":"2024-09-12T01:03:49.743281+0000","last_fullsized":"2024-09-12T01:03:49.743281+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.812968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.616997+0000","last_change":"2024-09-12T00:49:10.635581+0000","last_active":"2024-09-12T01:03:44.616997+0000","last_peered":"2024-09-12T01:03:44.616997+0000","last_clean":"2024-09-12T01:03:44.616997+0000","last_became_active":"2024-09-12T00:49:10.634965+0000","last_became_peered":"2024-09-12T00:49:10.634965+0000","last_unstale":"2024-09-12T01:03:44.616997+0000","last_undegraded":"2024-09-12T01:03:44.616997+0000","last_fullsized":"2024-09-12T01:03:44.616997+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:00.298075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.625230+0000","last_change":"2024-09-12T00:38:10.695802+0000","last_active":"2024-09-12T01:04:14.625230+0000","last_peered":"2024-09-12T01:04:14.625230+0000","last_clean":"2024-09-12T01:04:14.625230+0000","last_became_active":"2024-09-12T00:38:10.694812+0000","last_became_peered":"2024-09-12T00:38:10.694812+0000","last_unstale":"2024-09-12T01:04:14.625230+0000","last_undegraded":"2024-09-12T01:04:14.625230+0000","last_fullsized":"2024-09-12T01:04:14.625230+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:47.266227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'3","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.623622+0000","last_change":"2024-09-12T00:38:07.648782+0000","last_active":"2024-09-12T01:04:09.623622+0000","last_peered":"2024-09-12T01:04:09.623622+0000","last_clean":"2024-09-12T01:04:09.623622+0000","last_became_active":"2024-09-12T00:38:07.648061+0000","last_became_peered":"2024-09-12T00:38:07.648061+0000","last_unstale":"2024-09-12T01:04:09.623622+0000","last_undegraded":"2024-09-12T01:04:09.623622+0000","last_fullsized":"2024-09-12T01:04:09.623622+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:11.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'35","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.768877+0000","last_change":"2024-09-12T00:36:37.244821+0000","last_active":"2024-09-12T01:04:21.768877+0000","last_peered":"2024-09-12T01:04:21.768877+0000","last_clean":"2024-09-12T01:04:21.768877+0000","last_became_active":"2024-09-12T00:36:37.244096+0000","last_became_peered":"2024-09-12T00:36:37.244096+0000","last_unstale":"2024-09-12T01:04:21.768877+0000","last_undegraded":"2024-09-12T01:04:21.768877+0000","last_fullsized":"2024-09-12T01:04:21.768877+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:50.671276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":53,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:23.588773+0000","last_change":"2024-09-12T00:49:10.626675+0000","last_active":"2024-09-12T01:04:23.588773+0000","last_peered":"2024-09-12T01:04:23.588773+0000","last_clean":"2024-09-12T01:04:23.588773+0000","last_became_active":"2024-09-12T00:49:10.621968+0000","last_became_peered":"2024-09-12T00:49:10.621968+0000","last_unstale":"2024-09-12T01:04:23.588773+0000","last_undegraded":"2024-09-12T01:04:23.588773+0000","last_fullsized":"2024-09-12T01:04:23.588773+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.338078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594658+0000","last_change":"2024-09-12T00:38:10.718573+0000","last_active":"2024-09-12T01:05:19.594658+0000","last_peered":"2024-09-12T01:05:19.594658+0000","last_clean":"2024-09-12T01:05:19.594658+0000","last_became_active":"2024-09-12T00:38:10.717877+0000","last_became_peered":"2024-09-12T00:38:10.717877+0000","last_unstale":"2024-09-12T01:05:19.594658+0000","last_undegraded":"2024-09-12T01:05:19.594658+0000","last_fullsized":"2024-09-12T01:05:19.594658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:53.348539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"267'3","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749225+0000","last_change":"2024-09-12T00:38:07.649510+0000","last_active":"2024-09-12T01:04:14.749225+0000","last_peered":"2024-09-12T01:04:14.749225+0000","last_clean":"2024-09-12T01:04:14.749225+0000","last_became_active":"2024-09-12T00:38:07.648786+0000","last_became_peered":"2024-09-12T00:38:07.648786+0000","last_unstale":"2024-09-12T01:04:14.749225+0000","last_undegraded":"2024-09-12T01:04:14.749225+0000","last_fullsized":"2024-09-12T01:04:14.749225+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:57.221376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.741862+0000","last_change":"2024-09-12T00:36:37.238021+0000","last_active":"2024-09-12T01:03:44.741862+0000","last_peered":"2024-09-12T01:03:44.741862+0000","last_clean":"2024-09-12T01:03:44.741862+0000","last_became_active":"2024-09-12T00:36:37.237365+0000","last_became_peered":"2024-09-12T00:36:37.237365+0000","last_unstale":"2024-09-12T01:03:44.741862+0000","last_undegraded":"2024-09-12T01:03:44.741862+0000","last_fullsized":"2024-09-12T01:03:44.741862+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:44.575480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":152,"num_write":73,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.582095+0000","last_change":"2024-09-12T00:49:10.628791+0000","last_active":"2024-09-12T01:04:24.582095+0000","last_peered":"2024-09-12T01:04:24.582095+0000","last_clean":"2024-09-12T01:04:24.582095+0000","last_became_active":"2024-09-12T00:49:10.628111+0000","last_became_peered":"2024-09-12T00:49:10.628111+0000","last_unstale":"2024-09-12T01:04:24.582095+0000","last_undegraded":"2024-09-12T01:04:24.582095+0000","last_fullsized":"2024-09-12T01:04:24.582095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.022373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'3","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626298+0000","last_change":"2024-09-12T00:38:10.702362+0000","last_active":"2024-09-12T01:04:19.626298+0000","last_peered":"2024-09-12T01:04:19.626298+0000","last_clean":"2024-09-12T01:04:19.626298+0000","last_became_active":"2024-09-12T00:38:10.696553+0000","last_became_peered":"2024-09-12T00:38:10.696553+0000","last_unstale":"2024-09-12T01:04:19.626298+0000","last_undegraded":"2024-09-12T01:04:19.626298+0000","last_fullsized":"2024-09-12T01:04:19.626298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:21.987094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145574,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3168,"num_write":3,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'3","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640450+0000","last_change":"2024-09-12T00:38:07.670741+0000","last_active":"2024-09-12T01:05:14.640450+0000","last_peered":"2024-09-12T01:05:14.640450+0000","last_clean":"2024-09-12T01:05:14.640450+0000","last_became_active":"2024-09-12T00:38:07.669959+0000","last_became_peered":"2024-09-12T00:38:07.669959+0000","last_unstale":"2024-09-12T01:05:14.640450+0000","last_undegraded":"2024-09-12T01:05:14.640450+0000","last_fullsized":"2024-09-12T01:05:14.640450+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:21.025381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":96,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617129+0000","last_change":"2024-09-12T00:36:37.229680+0000","last_active":"2024-09-12T01:03:44.617129+0000","last_peered":"2024-09-12T01:03:44.617129+0000","last_clean":"2024-09-12T01:03:44.617129+0000","last_became_active":"2024-09-12T00:36:37.228954+0000","last_became_peered":"2024-09-12T00:36:37.228954+0000","last_unstale":"2024-09-12T01:03:44.617129+0000","last_undegraded":"2024-09-12T01:03:44.617129+0000","last_fullsized":"2024-09-12T01:03:44.617129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:42.010486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600391+0000","last_change":"2024-09-12T00:49:10.593501+0000","last_active":"2024-09-12T01:03:49.600391+0000","last_peered":"2024-09-12T01:03:49.600391+0000","last_clean":"2024-09-12T01:03:49.600391+0000","last_became_active":"2024-09-12T00:49:10.592753+0000","last_became_peered":"2024-09-12T00:49:10.592753+0000","last_unstale":"2024-09-12T01:03:49.600391+0000","last_undegraded":"2024-09-12T01:03:49.600391+0000","last_fullsized":"2024-09-12T01:03:49.600391+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:14.659960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763857+0000","last_change":"2024-09-12T00:38:10.703751+0000","last_active":"2024-09-12T01:05:19.763857+0000","last_peered":"2024-09-12T01:05:19.763857+0000","last_clean":"2024-09-12T01:05:19.763857+0000","last_became_active":"2024-09-12T00:38:10.702958+0000","last_became_peered":"2024-09-12T00:38:10.702958+0000","last_unstale":"2024-09-12T01:05:19.763857+0000","last_undegraded":"2024-09-12T01:05:19.763857+0000","last_fullsized":"2024-09-12T01:05:19.763857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:12.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.595391+0000","last_change":"2024-09-12T00:38:07.650713+0000","last_active":"2024-09-12T01:05:14.595391+0000","last_peered":"2024-09-12T01:05:14.595391+0000","last_clean":"2024-09-12T01:05:14.595391+0000","last_became_active":"2024-09-12T00:38:07.650035+0000","last_became_peered":"2024-09-12T00:38:07.650035+0000","last_unstale":"2024-09-12T01:05:14.595391+0000","last_undegraded":"2024-09-12T01:05:14.595391+0000","last_fullsized":"2024-09-12T01:05:14.595391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.848243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"258'11","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617043+0000","last_change":"2024-09-12T00:36:37.223313+0000","last_active":"2024-09-12T01:03:44.617043+0000","last_peered":"2024-09-12T01:03:44.617043+0000","last_clean":"2024-09-12T01:03:44.617043+0000","last_became_active":"2024-09-12T00:36:37.222545+0000","last_became_peered":"2024-09-12T00:36:37.222545+0000","last_unstale":"2024-09-12T01:03:44.617043+0000","last_undegraded":"2024-09-12T01:03:44.617043+0000","last_fullsized":"2024-09-12T01:03:44.617043+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:28.704973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618658+0000","last_change":"2024-09-12T00:49:10.613325+0000","last_active":"2024-09-12T01:03:49.618658+0000","last_peered":"2024-09-12T01:03:49.618658+0000","last_clean":"2024-09-12T01:03:49.618658+0000","last_became_active":"2024-09-12T00:49:10.612680+0000","last_became_peered":"2024-09-12T00:49:10.612680+0000","last_unstale":"2024-09-12T01:03:49.618658+0000","last_undegraded":"2024-09-12T01:03:49.618658+0000","last_fullsized":"2024-09-12T01:03:49.618658+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.686773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763779+0000","last_change":"2024-09-12T00:38:10.698273+0000","last_active":"2024-09-12T01:05:19.763779+0000","last_peered":"2024-09-12T01:05:19.763779+0000","last_clean":"2024-09-12T01:05:19.763779+0000","last_became_active":"2024-09-12T00:38:10.691107+0000","last_became_peered":"2024-09-12T00:38:10.691107+0000","last_unstale":"2024-09-12T01:05:19.763779+0000","last_undegraded":"2024-09-12T01:05:19.763779+0000","last_fullsized":"2024-09-12T01:05:19.763779+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.535876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"267'3","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.783064+0000","last_change":"2024-09-12T00:38:07.657937+0000","last_active":"2024-09-12T01:05:14.783064+0000","last_peered":"2024-09-12T01:05:14.783064+0000","last_clean":"2024-09-12T01:05:14.783064+0000","last_became_active":"2024-09-12T00:38:07.657155+0000","last_became_peered":"2024-09-12T00:38:07.657155+0000","last_unstale":"2024-09-12T01:05:14.783064+0000","last_undegraded":"2024-09-12T01:05:14.783064+0000","last_fullsized":"2024-09-12T01:05:14.783064+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:32.225678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"267'20","reported_seq":101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.541498+0000","last_change":"2024-09-12T00:36:37.222927+0000","last_active":"2024-09-12T01:05:02.541498+0000","last_peered":"2024-09-12T01:05:02.541498+0000","last_clean":"2024-09-12T01:05:02.541498+0000","last_became_active":"2024-09-12T00:36:37.221980+0000","last_became_peered":"2024-09-12T00:36:37.221980+0000","last_unstale":"2024-09-12T01:05:02.541498+0000","last_undegraded":"2024-09-12T01:05:02.541498+0000","last_fullsized":"2024-09-12T01:05:02.541498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:08.085009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'305","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.155017+0000","last_change":"2024-09-12T00:21:42.528797+0000","last_active":"2024-09-12T01:05:53.155017+0000","last_peered":"2024-09-12T01:05:53.155017+0000","last_clean":"2024-09-12T01:05:53.155017+0000","last_became_active":"2024-09-12T00:21:42.528236+0000","last_became_peered":"2024-09-12T00:21:42.528236+0000","last_unstale":"2024-09-12T01:05:53.155017+0000","last_undegraded":"2024-09-12T01:05:53.155017+0000","last_fullsized":"2024-09-12T01:05:53.155017+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:42.182294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1861783,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":458,"num_read_kb":8804,"num_write":1137,"num_write_kb":22191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'52","reported_seq":604,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.310893+0000","last_change":"2024-09-12T00:21:44.504479+0000","last_active":"2024-09-12T01:05:23.310893+0000","last_peered":"2024-09-12T01:05:23.310893+0000","last_clean":"2024-09-12T01:05:23.310893+0000","last_became_active":"2024-09-12T00:21:44.499494+0000","last_became_peered":"2024-09-12T00:21:44.499494+0000","last_unstale":"2024-09-12T01:05:23.310893+0000","last_undegraded":"2024-09-12T01:05:23.310893+0000","last_fullsized":"2024-09-12T01:05:23.310893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.715105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":187,"num_write":87,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'399","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.410078+0000","last_change":"2024-09-12T00:21:42.512960+0000","last_active":"2024-09-12T01:05:39.410078+0000","last_peered":"2024-09-12T01:05:39.410078+0000","last_clean":"2024-09-12T01:05:39.410078+0000","last_became_active":"2024-09-12T00:21:42.511901+0000","last_became_peered":"2024-09-12T00:21:42.511901+0000","last_unstale":"2024-09-12T01:05:39.410078+0000","last_undegraded":"2024-09-12T01:05:39.410078+0000","last_fullsized":"2024-09-12T01:05:39.410078+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:23.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9055852,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":763,"num_read_kb":14451,"num_write":1319,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'102","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.581466+0000","last_change":"2024-09-12T00:21:44.498811+0000","last_active":"2024-09-12T01:05:38.581466+0000","last_peered":"2024-09-12T01:05:38.581466+0000","last_clean":"2024-09-12T01:05:38.581466+0000","last_became_active":"2024-09-12T00:21:44.498503+0000","last_became_peered":"2024-09-12T00:21:44.498503+0000","last_unstale":"2024-09-12T01:05:38.581466+0000","last_undegraded":"2024-09-12T01:05:38.581466+0000","last_fullsized":"2024-09-12T01:05:38.581466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:31.431088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":343,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'256","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.506720+0000","last_change":"2024-09-12T00:21:42.535770+0000","last_active":"2024-09-12T01:05:31.506720+0000","last_peered":"2024-09-12T01:05:31.506720+0000","last_clean":"2024-09-12T01:05:31.506720+0000","last_became_active":"2024-09-12T00:21:42.535071+0000","last_became_peered":"2024-09-12T00:21:42.535071+0000","last_unstale":"2024-09-12T01:05:31.506720+0000","last_undegraded":"2024-09-12T01:05:31.506720+0000","last_fullsized":"2024-09-12T01:05:31.506720+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.704366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7669220,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":697,"num_read_kb":29454,"num_write":912,"num_write_kb":25069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'217","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.419030+0000","last_change":"2024-09-12T00:21:44.498204+0000","last_active":"2024-09-12T01:06:44.419030+0000","last_peered":"2024-09-12T01:06:44.419030+0000","last_clean":"2024-09-12T01:06:44.419030+0000","last_became_active":"2024-09-12T00:21:44.497569+0000","last_became_peered":"2024-09-12T00:21:44.497569+0000","last_unstale":"2024-09-12T01:06:44.419030+0000","last_undegraded":"2024-09-12T01:06:44.419030+0000","last_fullsized":"2024-09-12T01:06:44.419030+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.653439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":917,"num_read_kb":735,"num_write":338,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'298","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.281579+0000","last_change":"2024-09-12T00:21:42.528466+0000","last_active":"2024-09-12T01:05:49.281579+0000","last_peered":"2024-09-12T01:05:49.281579+0000","last_clean":"2024-09-12T01:05:49.281579+0000","last_became_active":"2024-09-12T00:21:42.528057+0000","last_became_peered":"2024-09-12T00:21:42.528057+0000","last_unstale":"2024-09-12T01:05:49.281579+0000","last_undegraded":"2024-09-12T01:05:49.281579+0000","last_fullsized":"2024-09-12T01:05:49.281579+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:39.430016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7615455,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":536,"num_read_kb":8621,"num_write":1159,"num_write_kb":31712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'137","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.579683+0000","last_change":"2024-09-12T00:21:44.480273+0000","last_active":"2024-09-12T01:04:14.579683+0000","last_peered":"2024-09-12T01:04:14.579683+0000","last_clean":"2024-09-12T01:04:14.579683+0000","last_became_active":"2024-09-12T00:21:44.479037+0000","last_became_peered":"2024-09-12T00:21:44.479037+0000","last_unstale":"2024-09-12T01:04:14.579683+0000","last_undegraded":"2024-09-12T01:04:14.579683+0000","last_fullsized":"2024-09-12T01:04:14.579683+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:47.501743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":200,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'303","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.619867+0000","last_change":"2024-09-12T00:21:42.515893+0000","last_active":"2024-09-12T01:05:20.619867+0000","last_peered":"2024-09-12T01:05:20.619867+0000","last_clean":"2024-09-12T01:05:20.619867+0000","last_became_active":"2024-09-12T00:21:42.515464+0000","last_became_peered":"2024-09-12T00:21:42.515464+0000","last_unstale":"2024-09-12T01:05:20.619867+0000","last_undegraded":"2024-09-12T01:05:20.619867+0000","last_fullsized":"2024-09-12T01:05:20.619867+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:46.082315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11750416,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":467,"num_read_kb":28078,"num_write":1204,"num_write_kb":29332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'4286","reported_seq":4956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.151752+0000","last_change":"2024-09-12T00:21:44.496471+0000","last_active":"2024-09-12T01:05:25.151752+0000","last_peered":"2024-09-12T01:05:25.151752+0000","last_clean":"2024-09-12T01:05:25.151752+0000","last_became_active":"2024-09-12T00:21:44.495734+0000","last_became_peered":"2024-09-12T00:21:44.495734+0000","last_unstale":"2024-09-12T01:05:25.151752+0000","last_undegraded":"2024-09-12T01:05:25.151752+0000","last_fullsized":"2024-09-12T01:05:25.151752+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":3000,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:24.946491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17226,"num_read_kb":14426,"num_write":6464,"num_write_kb":3218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'291","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.339538+0000","last_change":"2024-09-12T00:21:42.534954+0000","last_active":"2024-09-12T01:04:20.339538+0000","last_peered":"2024-09-12T01:04:20.339538+0000","last_clean":"2024-09-12T01:04:20.339538+0000","last_became_active":"2024-09-12T00:21:42.534582+0000","last_became_peered":"2024-09-12T00:21:42.534582+0000","last_unstale":"2024-09-12T01:04:20.339538+0000","last_undegraded":"2024-09-12T01:04:20.339538+0000","last_fullsized":"2024-09-12T01:04:20.339538+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:20.859536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8784333,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":407,"num_read_kb":25297,"num_write":1044,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'161","reported_seq":807,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.318189+0000","last_change":"2024-09-12T00:21:44.511727+0000","last_active":"2024-09-12T01:06:07.318189+0000","last_peered":"2024-09-12T01:06:07.318189+0000","last_clean":"2024-09-12T01:06:07.318189+0000","last_became_active":"2024-09-12T00:21:44.510410+0000","last_became_peered":"2024-09-12T00:21:44.510410+0000","last_unstale":"2024-09-12T01:06:07.318189+0000","last_undegraded":"2024-09-12T01:06:07.318189+0000","last_fullsized":"2024-09-12T01:06:07.318189+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:16.032761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":577,"num_write":213,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'304","reported_seq":1169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.622469+0000","last_change":"2024-09-12T00:21:42.531705+0000","last_active":"2024-09-12T01:05:20.622469+0000","last_peered":"2024-09-12T01:05:20.622469+0000","last_clean":"2024-09-12T01:05:20.622469+0000","last_became_active":"2024-09-12T00:21:42.530155+0000","last_became_peered":"2024-09-12T00:21:42.530155+0000","last_unstale":"2024-09-12T01:05:20.622469+0000","last_undegraded":"2024-09-12T01:05:20.622469+0000","last_fullsized":"2024-09-12T01:05:20.622469+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:16.745757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243942,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":968,"num_read_kb":26574,"num_write":1075,"num_write_kb":18888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'160","reported_seq":770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.994148+0000","last_change":"2024-09-12T00:21:44.484205+0000","last_active":"2024-09-12T01:05:26.994148+0000","last_peered":"2024-09-12T01:05:26.994148+0000","last_clean":"2024-09-12T01:05:26.994148+0000","last_became_active":"2024-09-12T00:21:44.483825+0000","last_became_peered":"2024-09-12T00:21:44.483825+0000","last_unstale":"2024-09-12T01:05:26.994148+0000","last_undegraded":"2024-09-12T01:05:26.994148+0000","last_fullsized":"2024-09-12T01:05:26.994148+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:08.179658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":577,"num_write":242,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'326","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.447863+0000","last_change":"2024-09-12T00:22:12.621823+0000","last_active":"2024-09-12T01:04:57.447863+0000","last_peered":"2024-09-12T01:04:57.447863+0000","last_clean":"2024-09-12T01:04:57.447863+0000","last_became_active":"2024-09-12T00:22:12.620753+0000","last_became_peered":"2024-09-12T00:22:12.620753+0000","last_unstale":"2024-09-12T01:04:57.447863+0000","last_undegraded":"2024-09-12T01:04:57.447863+0000","last_fullsized":"2024-09-12T01:04:57.447863+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:42.887841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6432694,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":507,"num_read_kb":16569,"num_write":1263,"num_write_kb":33151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'179","reported_seq":763,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.857805+0000","last_change":"2024-09-12T00:21:44.528812+0000","last_active":"2024-09-12T01:05:49.857805+0000","last_peered":"2024-09-12T01:05:49.857805+0000","last_clean":"2024-09-12T01:05:49.857805+0000","last_became_active":"2024-09-12T00:21:44.528311+0000","last_became_peered":"2024-09-12T00:21:44.528311+0000","last_unstale":"2024-09-12T01:05:49.857805+0000","last_undegraded":"2024-09-12T01:05:49.857805+0000","last_fullsized":"2024-09-12T01:05:49.857805+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:11.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":638,"num_write":310,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'108","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.649963+0000","last_change":"2024-09-12T00:21:44.494924+0000","last_active":"2024-09-12T01:04:18.649963+0000","last_peered":"2024-09-12T01:04:18.649963+0000","last_clean":"2024-09-12T01:04:18.649963+0000","last_became_active":"2024-09-12T00:21:44.493767+0000","last_became_peered":"2024-09-12T00:21:44.493767+0000","last_unstale":"2024-09-12T01:04:18.649963+0000","last_undegraded":"2024-09-12T01:04:18.649963+0000","last_fullsized":"2024-09-12T01:04:18.649963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:36.428208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":357,"num_write":148,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'262","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.706142+0000","last_change":"2024-09-12T00:21:42.515019+0000","last_active":"2024-09-12T01:05:38.706142+0000","last_peered":"2024-09-12T01:05:38.706142+0000","last_clean":"2024-09-12T01:05:38.706142+0000","last_became_active":"2024-09-12T00:21:42.514489+0000","last_became_peered":"2024-09-12T00:21:42.514489+0000","last_unstale":"2024-09-12T01:05:38.706142+0000","last_undegraded":"2024-09-12T01:05:38.706142+0000","last_fullsized":"2024-09-12T01:05:38.706142+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:26.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585686,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":441,"num_read_kb":6549,"num_write":1034,"num_write_kb":16882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'52","reported_seq":605,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.796075+0000","last_change":"2024-09-12T00:21:44.510300+0000","last_active":"2024-09-12T01:05:30.796075+0000","last_peered":"2024-09-12T01:05:30.796075+0000","last_clean":"2024-09-12T01:05:30.796075+0000","last_became_active":"2024-09-12T00:21:44.509895+0000","last_became_peered":"2024-09-12T00:21:44.509895+0000","last_unstale":"2024-09-12T01:05:30.796075+0000","last_undegraded":"2024-09-12T01:05:30.796075+0000","last_fullsized":"2024-09-12T01:05:30.796075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.091723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":198,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'217","reported_seq":805,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.536689+0000","last_change":"2024-09-12T00:21:42.491403+0000","last_active":"2024-09-12T01:05:04.536689+0000","last_peered":"2024-09-12T01:05:04.536689+0000","last_clean":"2024-09-12T01:05:04.536689+0000","last_became_active":"2024-09-12T00:21:42.490660+0000","last_became_peered":"2024-09-12T00:21:42.490660+0000","last_unstale":"2024-09-12T01:05:04.536689+0000","last_undegraded":"2024-09-12T01:05:04.536689+0000","last_fullsized":"2024-09-12T01:05:04.536689+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:10.128469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3351,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":307,"num_read_kb":4406,"num_write":745,"num_write_kb":22345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'258","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.249226+0000","last_change":"2024-09-12T00:21:44.515348+0000","last_active":"2024-09-12T01:05:47.249226+0000","last_peered":"2024-09-12T01:05:47.249226+0000","last_clean":"2024-09-12T01:05:47.249226+0000","last_became_active":"2024-09-12T00:21:44.514893+0000","last_became_peered":"2024-09-12T00:21:44.514893+0000","last_unstale":"2024-09-12T01:05:47.249226+0000","last_undegraded":"2024-09-12T01:05:47.249226+0000","last_fullsized":"2024-09-12T01:05:47.249226+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.665865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1166,"num_read_kb":956,"num_write":431,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'289","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.539772+0000","last_change":"2024-09-12T00:22:13.552941+0000","last_active":"2024-09-12T01:03:27.539772+0000","last_peered":"2024-09-12T01:03:27.539772+0000","last_clean":"2024-09-12T01:03:27.539772+0000","last_became_active":"2024-09-12T00:22:13.552126+0000","last_became_peered":"2024-09-12T00:22:13.552126+0000","last_unstale":"2024-09-12T01:03:27.539772+0000","last_undegraded":"2024-09-12T01:03:27.539772+0000","last_fullsized":"2024-09-12T01:03:27.539772+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.367793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5314894,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":477,"num_read_kb":9786,"num_write":1091,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'125","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.824816+0000","last_change":"2024-09-12T00:21:44.521066+0000","last_active":"2024-09-12T01:03:50.824816+0000","last_peered":"2024-09-12T01:03:50.824816+0000","last_clean":"2024-09-12T01:03:50.824816+0000","last_became_active":"2024-09-12T00:21:44.520441+0000","last_became_peered":"2024-09-12T00:21:44.520441+0000","last_unstale":"2024-09-12T01:03:50.824816+0000","last_undegraded":"2024-09-12T01:03:50.824816+0000","last_fullsized":"2024-09-12T01:03:50.824816+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:58.395313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":459,"num_write":198,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'283","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.542372+0000","last_change":"2024-09-12T00:21:42.506242+0000","last_active":"2024-09-12T01:05:29.542372+0000","last_peered":"2024-09-12T01:05:29.542372+0000","last_clean":"2024-09-12T01:05:29.542372+0000","last_became_active":"2024-09-12T00:21:42.505754+0000","last_became_peered":"2024-09-12T00:21:42.505754+0000","last_unstale":"2024-09-12T01:05:29.542372+0000","last_undegraded":"2024-09-12T01:05:29.542372+0000","last_fullsized":"2024-09-12T01:05:29.542372+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:17.644717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14158857,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":426,"num_read_kb":23994,"num_write":1075,"num_write_kb":44987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'533","reported_seq":1294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.156332+0000","last_change":"2024-09-12T00:21:44.510694+0000","last_active":"2024-09-12T01:04:59.156332+0000","last_peered":"2024-09-12T01:04:59.156332+0000","last_clean":"2024-09-12T01:04:59.156332+0000","last_became_active":"2024-09-12T00:21:44.509840+0000","last_became_peered":"2024-09-12T00:21:44.509840+0000","last_unstale":"2024-09-12T01:04:59.156332+0000","last_undegraded":"2024-09-12T01:04:59.156332+0000","last_fullsized":"2024-09-12T01:04:59.156332+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:05.378563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2527,"num_read_kb":2144,"num_write":948,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'292","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.199763+0000","last_change":"2024-09-12T00:21:42.531184+0000","last_active":"2024-09-12T01:05:30.199763+0000","last_peered":"2024-09-12T01:05:30.199763+0000","last_clean":"2024-09-12T01:05:30.199763+0000","last_became_active":"2024-09-12T00:21:42.529312+0000","last_became_peered":"2024-09-12T00:21:42.529312+0000","last_unstale":"2024-09-12T01:05:30.199763+0000","last_undegraded":"2024-09-12T01:05:30.199763+0000","last_fullsized":"2024-09-12T01:05:30.199763+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:28.828303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":436,"num_read_kb":653,"num_write":1031,"num_write_kb":45878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'102","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.071243+0000","last_change":"2024-09-12T00:21:44.499519+0000","last_active":"2024-09-12T01:05:04.071243+0000","last_peered":"2024-09-12T01:05:04.071243+0000","last_clean":"2024-09-12T01:05:04.071243+0000","last_became_active":"2024-09-12T00:21:44.499173+0000","last_became_peered":"2024-09-12T00:21:44.499173+0000","last_unstale":"2024-09-12T01:05:04.071243+0000","last_undegraded":"2024-09-12T01:05:04.071243+0000","last_fullsized":"2024-09-12T01:05:04.071243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:51.311165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":398,"num_write":158,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'302","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.064153+0000","last_change":"2024-09-12T00:21:42.530559+0000","last_active":"2024-09-12T01:05:37.064153+0000","last_peered":"2024-09-12T01:05:37.064153+0000","last_clean":"2024-09-12T01:05:37.064153+0000","last_became_active":"2024-09-12T00:21:42.529873+0000","last_became_peered":"2024-09-12T00:21:42.529873+0000","last_unstale":"2024-09-12T01:05:37.064153+0000","last_undegraded":"2024-09-12T01:05:37.064153+0000","last_fullsized":"2024-09-12T01:05:37.064153+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:42.813481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998659,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":481,"num_read_kb":35147,"num_write":1161,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'136","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.400586+0000","last_change":"2024-09-12T00:21:52.546288+0000","last_active":"2024-09-12T01:06:07.400586+0000","last_peered":"2024-09-12T01:06:07.400586+0000","last_clean":"2024-09-12T01:06:07.400586+0000","last_became_active":"2024-09-12T00:21:52.545571+0000","last_became_peered":"2024-09-12T00:21:52.545571+0000","last_unstale":"2024-09-12T01:06:07.400586+0000","last_undegraded":"2024-09-12T01:06:07.400586+0000","last_fullsized":"2024-09-12T01:06:07.400586+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:55.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'88","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.478850+0000","last_change":"2024-09-12T00:21:44.485322+0000","last_active":"2024-09-12T01:05:20.478850+0000","last_peered":"2024-09-12T01:05:20.478850+0000","last_clean":"2024-09-12T01:05:20.478850+0000","last_became_active":"2024-09-12T00:21:44.484514+0000","last_became_peered":"2024-09-12T00:21:44.484514+0000","last_unstale":"2024-09-12T01:05:20.478850+0000","last_undegraded":"2024-09-12T01:05:20.478850+0000","last_fullsized":"2024-09-12T01:05:20.478850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:59.343439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":321,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'274","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.548948+0000","last_change":"2024-09-12T00:21:42.496374+0000","last_active":"2024-09-12T01:05:28.548948+0000","last_peered":"2024-09-12T01:05:28.548948+0000","last_clean":"2024-09-12T01:05:28.548948+0000","last_became_active":"2024-09-12T00:21:42.495808+0000","last_became_peered":"2024-09-12T00:21:42.495808+0000","last_unstale":"2024-09-12T01:05:28.548948+0000","last_undegraded":"2024-09-12T01:05:28.548948+0000","last_fullsized":"2024-09-12T01:05:28.548948+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:30.009676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4734268,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":478,"num_read_kb":20340,"num_write":997,"num_write_kb":31693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.604524+0000","last_change":"2024-09-12T00:21:46.515667+0000","last_active":"2024-09-12T01:02:54.604524+0000","last_peered":"2024-09-12T01:02:54.604524+0000","last_clean":"2024-09-12T01:02:54.604524+0000","last_became_active":"2024-09-12T00:21:46.515363+0000","last_became_peered":"2024-09-12T00:21:46.515363+0000","last_unstale":"2024-09-12T01:02:54.604524+0000","last_undegraded":"2024-09-12T01:02:54.604524+0000","last_fullsized":"2024-09-12T01:02:54.604524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:03.935806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'325","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594824+0000","last_change":"2024-09-12T00:21:48.528210+0000","last_active":"2024-09-12T01:05:19.594824+0000","last_peered":"2024-09-12T01:05:19.594824+0000","last_clean":"2024-09-12T01:05:19.594824+0000","last_became_active":"2024-09-12T00:21:48.524091+0000","last_became_peered":"2024-09-12T00:21:48.524091+0000","last_unstale":"2024-09-12T01:05:19.594824+0000","last_undegraded":"2024-09-12T01:05:19.594824+0000","last_fullsized":"2024-09-12T01:05:19.594824+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:14.328463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":973,"num_write":412,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.751663+0000","last_change":"2024-09-12T00:21:50.552444+0000","last_active":"2024-09-12T01:02:59.751663+0000","last_peered":"2024-09-12T01:02:59.751663+0000","last_clean":"2024-09-12T01:02:59.751663+0000","last_became_active":"2024-09-12T00:21:50.551742+0000","last_became_peered":"2024-09-12T00:21:50.551742+0000","last_unstale":"2024-09-12T01:02:59.751663+0000","last_undegraded":"2024-09-12T01:02:59.751663+0000","last_fullsized":"2024-09-12T01:02:59.751663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:41.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'173","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.384837+0000","last_change":"2024-09-12T00:21:52.546442+0000","last_active":"2024-09-12T01:06:06.384837+0000","last_peered":"2024-09-12T01:06:06.384837+0000","last_clean":"2024-09-12T01:06:06.384837+0000","last_became_active":"2024-09-12T00:21:52.544469+0000","last_became_peered":"2024-09-12T00:21:52.544469+0000","last_unstale":"2024-09-12T01:06:06.384837+0000","last_undegraded":"2024-09-12T01:06:06.384837+0000","last_fullsized":"2024-09-12T01:06:06.384837+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:08.007114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":251,"num_write":350,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'4223","reported_seq":4854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.512839+0000","last_change":"2024-09-12T00:21:44.500660+0000","last_active":"2024-09-12T01:04:03.512839+0000","last_peered":"2024-09-12T01:04:03.512839+0000","last_clean":"2024-09-12T01:04:03.512839+0000","last_became_active":"2024-09-12T00:21:44.500367+0000","last_became_peered":"2024-09-12T00:21:44.500367+0000","last_unstale":"2024-09-12T01:04:03.512839+0000","last_undegraded":"2024-09-12T01:04:03.512839+0000","last_fullsized":"2024-09-12T01:04:03.512839+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:22.788119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17010,"num_read_kb":14247,"num_write":6340,"num_write_kb":3163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'308","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.387570+0000","last_change":"2024-09-12T00:21:42.500670+0000","last_active":"2024-09-12T01:05:26.387570+0000","last_peered":"2024-09-12T01:05:26.387570+0000","last_clean":"2024-09-12T01:05:26.387570+0000","last_became_active":"2024-09-12T00:21:42.492572+0000","last_became_peered":"2024-09-12T00:21:42.492572+0000","last_unstale":"2024-09-12T01:05:26.387570+0000","last_undegraded":"2024-09-12T01:05:26.387570+0000","last_fullsized":"2024-09-12T01:05:26.387570+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:45.219943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14345206,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":515,"num_read_kb":145927,"num_write":1098,"num_write_kb":64533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.576546+0000","last_change":"2024-09-12T00:21:46.491690+0000","last_active":"2024-09-12T01:03:59.576546+0000","last_peered":"2024-09-12T01:03:59.576546+0000","last_clean":"2024-09-12T01:03:59.576546+0000","last_became_active":"2024-09-12T00:21:46.490985+0000","last_became_peered":"2024-09-12T00:21:46.490985+0000","last_unstale":"2024-09-12T01:03:59.576546+0000","last_undegraded":"2024-09-12T01:03:59.576546+0000","last_fullsized":"2024-09-12T01:03:59.576546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:41.609896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'84","reported_seq":618,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.296129+0000","last_change":"2024-09-12T00:21:48.535909+0000","last_active":"2024-09-12T01:04:55.296129+0000","last_peered":"2024-09-12T01:04:55.296129+0000","last_clean":"2024-09-12T01:04:55.296129+0000","last_became_active":"2024-09-12T00:21:48.535190+0000","last_became_peered":"2024-09-12T00:21:48.535190+0000","last_unstale":"2024-09-12T01:04:55.296129+0000","last_undegraded":"2024-09-12T01:04:55.296129+0000","last_fullsized":"2024-09-12T01:04:55.296129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.533022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.751597+0000","last_change":"2024-09-12T00:21:50.551431+0000","last_active":"2024-09-12T01:02:59.751597+0000","last_peered":"2024-09-12T01:02:59.751597+0000","last_clean":"2024-09-12T01:02:59.751597+0000","last_became_active":"2024-09-12T00:21:50.550214+0000","last_became_peered":"2024-09-12T00:21:50.550214+0000","last_unstale":"2024-09-12T01:02:59.751597+0000","last_undegraded":"2024-09-12T01:02:59.751597+0000","last_fullsized":"2024-09-12T01:02:59.751597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:11.439485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'124","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.000458+0000","last_change":"2024-09-12T00:21:52.545902+0000","last_active":"2024-09-12T01:05:53.000458+0000","last_peered":"2024-09-12T01:05:53.000458+0000","last_clean":"2024-09-12T01:05:53.000458+0000","last_became_active":"2024-09-12T00:21:52.545166+0000","last_became_peered":"2024-09-12T00:21:52.545166+0000","last_unstale":"2024-09-12T01:05:53.000458+0000","last_undegraded":"2024-09-12T01:05:53.000458+0000","last_fullsized":"2024-09-12T01:05:53.000458+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:01.544361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":292,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'288","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.243846+0000","last_change":"2024-09-12T00:21:44.520746+0000","last_active":"2024-09-12T01:04:15.243846+0000","last_peered":"2024-09-12T01:04:15.243846+0000","last_clean":"2024-09-12T01:04:15.243846+0000","last_became_active":"2024-09-12T00:21:44.520057+0000","last_became_peered":"2024-09-12T00:21:44.520057+0000","last_unstale":"2024-09-12T01:04:15.243846+0000","last_undegraded":"2024-09-12T01:04:15.243846+0000","last_fullsized":"2024-09-12T01:04:15.243846+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:54.675479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1259,"num_read_kb":1089,"num_write":465,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'259","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.992074+0000","last_change":"2024-09-12T00:21:42.497428+0000","last_active":"2024-09-12T01:04:19.992074+0000","last_peered":"2024-09-12T01:04:19.992074+0000","last_clean":"2024-09-12T01:04:19.992074+0000","last_became_active":"2024-09-12T00:21:42.496059+0000","last_became_peered":"2024-09-12T00:21:42.496059+0000","last_unstale":"2024-09-12T01:04:19.992074+0000","last_undegraded":"2024-09-12T01:04:19.992074+0000","last_fullsized":"2024-09-12T01:04:19.992074+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:13.046572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2126129,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":433,"num_read_kb":8626,"num_write":932,"num_write_kb":21953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.562551+0000","last_change":"2024-09-12T00:21:46.501997+0000","last_active":"2024-09-12T01:02:54.562551+0000","last_peered":"2024-09-12T01:02:54.562551+0000","last_clean":"2024-09-12T01:02:54.562551+0000","last_became_active":"2024-09-12T00:21:46.501407+0000","last_became_peered":"2024-09-12T00:21:46.501407+0000","last_unstale":"2024-09-12T01:02:54.562551+0000","last_undegraded":"2024-09-12T01:02:54.562551+0000","last_fullsized":"2024-09-12T01:02:54.562551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.795256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'122","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.317364+0000","last_change":"2024-09-12T00:21:48.542081+0000","last_active":"2024-09-12T01:04:21.317364+0000","last_peered":"2024-09-12T01:04:21.317364+0000","last_clean":"2024-09-12T01:04:21.317364+0000","last_became_active":"2024-09-12T00:21:48.541231+0000","last_became_peered":"2024-09-12T00:21:48.541231+0000","last_unstale":"2024-09-12T01:04:21.317364+0000","last_undegraded":"2024-09-12T01:04:21.317364+0000","last_fullsized":"2024-09-12T01:04:21.317364+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.064538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'784","reported_seq":2510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947341+0000","last_change":"2024-09-12T00:21:50.569545+0000","last_active":"2024-09-12T01:07:12.947341+0000","last_peered":"2024-09-12T01:07:12.947341+0000","last_clean":"2024-09-12T01:07:12.947341+0000","last_became_active":"2024-09-12T00:21:50.568825+0000","last_became_peered":"2024-09-12T00:21:50.568825+0000","last_unstale":"2024-09-12T01:07:12.947341+0000","last_undegraded":"2024-09-12T01:07:12.947341+0000","last_fullsized":"2024-09-12T01:07:12.947341+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'222","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.469146+0000","last_change":"2024-09-12T00:21:52.555837+0000","last_active":"2024-09-12T01:06:07.469146+0000","last_peered":"2024-09-12T01:06:07.469146+0000","last_clean":"2024-09-12T01:06:07.469146+0000","last_became_active":"2024-09-12T00:21:52.554865+0000","last_became_peered":"2024-09-12T00:21:52.554865+0000","last_unstale":"2024-09-12T01:06:07.469146+0000","last_undegraded":"2024-09-12T01:06:07.469146+0000","last_fullsized":"2024-09-12T01:06:07.469146+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:47.453983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":708,"num_read_kb":679,"num_write":497,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'135","reported_seq":691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.308334+0000","last_change":"2024-09-12T00:21:44.523637+0000","last_active":"2024-09-12T01:04:13.308334+0000","last_peered":"2024-09-12T01:04:13.308334+0000","last_clean":"2024-09-12T01:04:13.308334+0000","last_became_active":"2024-09-12T00:21:44.522830+0000","last_became_peered":"2024-09-12T00:21:44.522830+0000","last_unstale":"2024-09-12T01:04:13.308334+0000","last_undegraded":"2024-09-12T01:04:13.308334+0000","last_fullsized":"2024-09-12T01:04:13.308334+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:29.081489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":469,"num_write":207,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'264","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.377944+0000","last_change":"2024-09-12T00:21:42.516948+0000","last_active":"2024-09-12T01:05:02.377944+0000","last_peered":"2024-09-12T01:05:02.377944+0000","last_clean":"2024-09-12T01:05:02.377944+0000","last_became_active":"2024-09-12T00:21:42.516625+0000","last_became_peered":"2024-09-12T00:21:42.516625+0000","last_unstale":"2024-09-12T01:05:02.377944+0000","last_undegraded":"2024-09-12T01:05:02.377944+0000","last_fullsized":"2024-09-12T01:05:02.377944+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:25.672684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4203223,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":486,"num_read_kb":2648,"num_write":1058,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.604571+0000","last_change":"2024-09-12T00:21:46.504025+0000","last_active":"2024-09-12T01:02:54.604571+0000","last_peered":"2024-09-12T01:02:54.604571+0000","last_clean":"2024-09-12T01:02:54.604571+0000","last_became_active":"2024-09-12T00:21:46.503686+0000","last_became_peered":"2024-09-12T00:21:46.503686+0000","last_unstale":"2024-09-12T01:02:54.604571+0000","last_undegraded":"2024-09-12T01:02:54.604571+0000","last_fullsized":"2024-09-12T01:02:54.604571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:46.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'279","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.530837+0000","last_change":"2024-09-12T00:21:48.540014+0000","last_active":"2024-09-12T01:05:20.530837+0000","last_peered":"2024-09-12T01:05:20.530837+0000","last_clean":"2024-09-12T01:05:20.530837+0000","last_became_active":"2024-09-12T00:21:48.539522+0000","last_became_peered":"2024-09-12T00:21:48.539522+0000","last_unstale":"2024-09-12T01:05:20.530837+0000","last_undegraded":"2024-09-12T01:05:20.530837+0000","last_fullsized":"2024-09-12T01:05:20.530837+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:51.751137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":960,"num_write":382,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'774","reported_seq":2460,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.948159+0000","last_change":"2024-09-12T00:21:50.565919+0000","last_active":"2024-09-12T01:07:12.948159+0000","last_peered":"2024-09-12T01:07:12.948159+0000","last_clean":"2024-09-12T01:07:12.948159+0000","last_became_active":"2024-09-12T00:21:50.564483+0000","last_became_peered":"2024-09-12T00:21:50.564483+0000","last_unstale":"2024-09-12T01:07:12.948159+0000","last_undegraded":"2024-09-12T01:07:12.948159+0000","last_fullsized":"2024-09-12T01:07:12.948159+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'576","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.637851+0000","last_change":"2024-09-12T00:21:44.501308+0000","last_active":"2024-09-12T01:05:04.637851+0000","last_peered":"2024-09-12T01:05:04.637851+0000","last_clean":"2024-09-12T01:05:04.637851+0000","last_became_active":"2024-09-12T00:21:44.497754+0000","last_became_peered":"2024-09-12T00:21:44.497754+0000","last_unstale":"2024-09-12T01:05:04.637851+0000","last_undegraded":"2024-09-12T01:05:04.637851+0000","last_fullsized":"2024-09-12T01:05:04.637851+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:01.259088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2710,"num_read_kb":2241,"num_write":1007,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'310","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:50.637061+0000","last_change":"2024-09-12T00:21:42.528462+0000","last_active":"2024-09-12T01:05:50.637061+0000","last_peered":"2024-09-12T01:05:50.637061+0000","last_clean":"2024-09-12T01:05:50.637061+0000","last_became_active":"2024-09-12T00:21:42.528138+0000","last_became_peered":"2024-09-12T00:21:42.528138+0000","last_unstale":"2024-09-12T01:05:50.637061+0000","last_undegraded":"2024-09-12T01:05:50.637061+0000","last_fullsized":"2024-09-12T01:05:50.637061+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:59.797609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12248109,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":691,"num_read_kb":24537,"num_write":1019,"num_write_kb":22675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.781947+0000","last_change":"2024-09-12T00:21:46.503402+0000","last_active":"2024-09-12T01:05:09.781947+0000","last_peered":"2024-09-12T01:05:09.781947+0000","last_clean":"2024-09-12T01:05:09.781947+0000","last_became_active":"2024-09-12T00:21:46.503041+0000","last_became_peered":"2024-09-12T00:21:46.503041+0000","last_unstale":"2024-09-12T01:05:09.781947+0000","last_undegraded":"2024-09-12T01:05:09.781947+0000","last_fullsized":"2024-09-12T01:05:09.781947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.602442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'361","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.602132+0000","last_change":"2024-09-12T00:21:48.539441+0000","last_active":"2024-09-12T01:05:19.602132+0000","last_peered":"2024-09-12T01:05:19.602132+0000","last_clean":"2024-09-12T01:05:19.602132+0000","last_became_active":"2024-09-12T00:21:48.538727+0000","last_became_peered":"2024-09-12T00:21:48.538727+0000","last_unstale":"2024-09-12T01:05:19.602132+0000","last_undegraded":"2024-09-12T01:05:19.602132+0000","last_fullsized":"2024-09-12T01:05:19.602132+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:41.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60701,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":576,"num_read_kb":1074,"num_write":458,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.587751+0000","last_change":"2024-09-12T00:21:50.545196+0000","last_active":"2024-09-12T01:04:39.587751+0000","last_peered":"2024-09-12T01:04:39.587751+0000","last_clean":"2024-09-12T01:04:39.587751+0000","last_became_active":"2024-09-12T00:21:50.544432+0000","last_became_peered":"2024-09-12T00:21:50.544432+0000","last_unstale":"2024-09-12T01:04:39.587751+0000","last_undegraded":"2024-09-12T01:04:39.587751+0000","last_fullsized":"2024-09-12T01:04:39.587751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.923643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'549","reported_seq":1360,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.865258+0000","last_change":"2024-09-12T00:21:52.563743+0000","last_active":"2024-09-12T01:07:12.865258+0000","last_peered":"2024-09-12T01:07:12.865258+0000","last_clean":"2024-09-12T01:07:12.865258+0000","last_became_active":"2024-09-12T00:21:52.563086+0000","last_became_peered":"2024-09-12T00:21:52.563086+0000","last_unstale":"2024-09-12T01:07:12.865258+0000","last_undegraded":"2024-09-12T01:07:12.865258+0000","last_fullsized":"2024-09-12T01:07:12.865258+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:09.343801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1274,"num_read_kb":1271,"num_write":1130,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'524","reported_seq":1304,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.780894+0000","last_change":"2024-09-12T00:21:44.511296+0000","last_active":"2024-09-12T01:05:04.780894+0000","last_peered":"2024-09-12T01:05:04.780894+0000","last_clean":"2024-09-12T01:05:04.780894+0000","last_became_active":"2024-09-12T00:21:44.510918+0000","last_became_peered":"2024-09-12T00:21:44.510918+0000","last_unstale":"2024-09-12T01:05:04.780894+0000","last_undegraded":"2024-09-12T01:05:04.780894+0000","last_fullsized":"2024-09-12T01:05:04.780894+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:54.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2468,"num_read_kb":2089,"num_write":789,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'271","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.752863+0000","last_change":"2024-09-12T00:21:42.513398+0000","last_active":"2024-09-12T01:04:29.752863+0000","last_peered":"2024-09-12T01:04:29.752863+0000","last_clean":"2024-09-12T01:04:29.752863+0000","last_became_active":"2024-09-12T00:21:42.513031+0000","last_became_peered":"2024-09-12T00:21:42.513031+0000","last_unstale":"2024-09-12T01:04:29.752863+0000","last_undegraded":"2024-09-12T01:04:29.752863+0000","last_fullsized":"2024-09-12T01:04:29.752863+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10423793,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":421,"num_read_kb":44893,"num_write":956,"num_write_kb":33699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.594203+0000","last_change":"2024-09-12T00:21:46.519542+0000","last_active":"2024-09-12T01:05:09.594203+0000","last_peered":"2024-09-12T01:05:09.594203+0000","last_clean":"2024-09-12T01:05:09.594203+0000","last_became_active":"2024-09-12T00:21:46.517981+0000","last_became_peered":"2024-09-12T00:21:46.517981+0000","last_unstale":"2024-09-12T01:05:09.594203+0000","last_undegraded":"2024-09-12T01:05:09.594203+0000","last_fullsized":"2024-09-12T01:05:09.594203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:03.803070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'269","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.615952+0000","last_change":"2024-09-12T00:21:48.523626+0000","last_active":"2024-09-12T01:06:49.615952+0000","last_peered":"2024-09-12T01:06:49.615952+0000","last_clean":"2024-09-12T01:06:49.615952+0000","last_became_active":"2024-09-12T00:21:48.522920+0000","last_became_peered":"2024-09-12T00:21:48.522920+0000","last_unstale":"2024-09-12T01:06:49.615952+0000","last_undegraded":"2024-09-12T01:06:49.615952+0000","last_fullsized":"2024-09-12T01:06:49.615952+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:28.182271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55088,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":905,"num_write":360,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.566845+0000","last_change":"2024-09-12T00:21:50.545714+0000","last_active":"2024-09-12T01:03:14.566845+0000","last_peered":"2024-09-12T01:03:14.566845+0000","last_clean":"2024-09-12T01:03:14.566845+0000","last_became_active":"2024-09-12T00:21:50.543639+0000","last_became_peered":"2024-09-12T00:21:50.543639+0000","last_unstale":"2024-09-12T01:03:14.566845+0000","last_undegraded":"2024-09-12T01:03:14.566845+0000","last_fullsized":"2024-09-12T01:03:14.566845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:41.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2371","reported_seq":4212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.690521+0000","last_change":"2024-09-12T00:21:52.538444+0000","last_active":"2024-09-12T01:06:56.690521+0000","last_peered":"2024-09-12T01:06:56.690521+0000","last_clean":"2024-09-12T01:06:56.690521+0000","last_became_active":"2024-09-12T00:21:52.537701+0000","last_became_peered":"2024-09-12T00:21:52.537701+0000","last_unstale":"2024-09-12T01:06:56.690521+0000","last_undegraded":"2024-09-12T01:06:56.690521+0000","last_fullsized":"2024-09-12T01:06:56.690521+0000","mapping_epoch":36,"log_start":"267'2300","ondisk_log_start":"267'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:39.923689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5977,"num_write":4771,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'112","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.997112+0000","last_change":"2024-09-12T00:21:44.494633+0000","last_active":"2024-09-12T01:05:52.997112+0000","last_peered":"2024-09-12T01:05:52.997112+0000","last_clean":"2024-09-12T01:05:52.997112+0000","last_became_active":"2024-09-12T00:21:44.494313+0000","last_became_peered":"2024-09-12T00:21:44.494313+0000","last_unstale":"2024-09-12T01:05:52.997112+0000","last_undegraded":"2024-09-12T01:05:52.997112+0000","last_fullsized":"2024-09-12T01:05:52.997112+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:22.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":397,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'283","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.429761+0000","last_change":"2024-09-12T00:21:42.529770+0000","last_active":"2024-09-12T01:05:40.429761+0000","last_peered":"2024-09-12T01:05:40.429761+0000","last_clean":"2024-09-12T01:05:40.429761+0000","last_became_active":"2024-09-12T00:21:42.529372+0000","last_became_peered":"2024-09-12T00:21:42.529372+0000","last_unstale":"2024-09-12T01:05:40.429761+0000","last_undegraded":"2024-09-12T01:05:40.429761+0000","last_fullsized":"2024-09-12T01:05:40.429761+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.798589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6348479,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":507,"num_read_kb":12047,"num_write":1179,"num_write_kb":31958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611469+0000","last_change":"2024-09-12T00:21:46.512407+0000","last_active":"2024-09-12T01:04:34.611469+0000","last_peered":"2024-09-12T01:04:34.611469+0000","last_clean":"2024-09-12T01:04:34.611469+0000","last_became_active":"2024-09-12T00:21:46.511704+0000","last_became_peered":"2024-09-12T00:21:46.511704+0000","last_unstale":"2024-09-12T01:04:34.611469+0000","last_undegraded":"2024-09-12T01:04:34.611469+0000","last_fullsized":"2024-09-12T01:04:34.611469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:04.950564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'279","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.840274+0000","last_change":"2024-09-12T00:21:48.552567+0000","last_active":"2024-09-12T01:07:12.840274+0000","last_peered":"2024-09-12T01:07:12.840274+0000","last_clean":"2024-09-12T01:07:12.840274+0000","last_became_active":"2024-09-12T00:21:48.551752+0000","last_became_peered":"2024-09-12T00:21:48.551752+0000","last_unstale":"2024-09-12T01:07:12.840274+0000","last_undegraded":"2024-09-12T01:07:12.840274+0000","last_fullsized":"2024-09-12T01:07:12.840274+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.243890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53943,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":454,"num_read_kb":871,"num_write":360,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'775","reported_seq":4653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.220504+0000","last_change":"2024-09-12T00:21:50.562293+0000","last_active":"2024-09-12T01:07:13.220504+0000","last_peered":"2024-09-12T01:07:13.220504+0000","last_clean":"2024-09-12T01:07:13.220504+0000","last_became_active":"2024-09-12T00:21:50.561680+0000","last_became_peered":"2024-09-12T00:21:50.561680+0000","last_unstale":"2024-09-12T01:07:13.220504+0000","last_undegraded":"2024-09-12T01:07:13.220504+0000","last_fullsized":"2024-09-12T01:07:13.220504+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":701,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:35.170696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'119","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.966637+0000","last_change":"2024-09-12T00:21:52.547626+0000","last_active":"2024-09-12T01:07:11.966637+0000","last_peered":"2024-09-12T01:07:11.966637+0000","last_clean":"2024-09-12T01:07:11.966637+0000","last_became_active":"2024-09-12T00:21:52.546889+0000","last_became_peered":"2024-09-12T00:21:52.546889+0000","last_unstale":"2024-09-12T01:07:11.966637+0000","last_undegraded":"2024-09-12T01:07:11.966637+0000","last_fullsized":"2024-09-12T01:07:11.966637+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:06.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":121,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'188","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.081285+0000","last_change":"2024-09-12T00:21:44.519531+0000","last_active":"2024-09-12T01:05:30.081285+0000","last_peered":"2024-09-12T01:05:30.081285+0000","last_clean":"2024-09-12T01:05:30.081285+0000","last_became_active":"2024-09-12T00:21:44.518595+0000","last_became_peered":"2024-09-12T00:21:44.518595+0000","last_unstale":"2024-09-12T01:05:30.081285+0000","last_undegraded":"2024-09-12T01:05:30.081285+0000","last_fullsized":"2024-09-12T01:05:30.081285+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.767338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":656,"num_write":281,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'214","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.699785+0000","last_change":"2024-09-12T00:21:42.498445+0000","last_active":"2024-09-12T01:05:44.699785+0000","last_peered":"2024-09-12T01:05:44.699785+0000","last_clean":"2024-09-12T01:05:44.699785+0000","last_became_active":"2024-09-12T00:21:42.497992+0000","last_became_peered":"2024-09-12T00:21:42.497992+0000","last_unstale":"2024-09-12T01:05:44.699785+0000","last_undegraded":"2024-09-12T01:05:44.699785+0000","last_fullsized":"2024-09-12T01:05:44.699785+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:31.325313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4482985,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":346,"num_read_kb":82463,"num_write":801,"num_write_kb":27861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.566546+0000","last_change":"2024-09-12T00:21:46.512131+0000","last_active":"2024-09-12T01:03:09.566546+0000","last_peered":"2024-09-12T01:03:09.566546+0000","last_clean":"2024-09-12T01:03:09.566546+0000","last_became_active":"2024-09-12T00:21:46.511365+0000","last_became_peered":"2024-09-12T00:21:46.511365+0000","last_unstale":"2024-09-12T01:03:09.566546+0000","last_undegraded":"2024-09-12T01:03:09.566546+0000","last_fullsized":"2024-09-12T01:03:09.566546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:52.291093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'463","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.846736+0000","last_change":"2024-09-12T00:21:48.526015+0000","last_active":"2024-09-12T01:07:12.846736+0000","last_peered":"2024-09-12T01:07:12.846736+0000","last_clean":"2024-09-12T01:07:12.846736+0000","last_became_active":"2024-09-12T00:21:48.524173+0000","last_became_peered":"2024-09-12T00:21:48.524173+0000","last_unstale":"2024-09-12T01:07:12.846736+0000","last_undegraded":"2024-09-12T01:07:12.846736+0000","last_fullsized":"2024-09-12T01:07:12.846736+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:01.094285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108366,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":795,"num_read_kb":1720,"num_write":656,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.620896+0000","last_change":"2024-09-12T00:21:50.562375+0000","last_active":"2024-09-12T01:05:14.620896+0000","last_peered":"2024-09-12T01:05:14.620896+0000","last_clean":"2024-09-12T01:05:14.620896+0000","last_became_active":"2024-09-12T00:21:50.561720+0000","last_became_peered":"2024-09-12T00:21:50.561720+0000","last_unstale":"2024-09-12T01:05:14.620896+0000","last_undegraded":"2024-09-12T01:05:14.620896+0000","last_fullsized":"2024-09-12T01:05:14.620896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:55.724402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'124","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.185203+0000","last_change":"2024-09-12T00:21:52.565860+0000","last_active":"2024-09-12T01:05:29.185203+0000","last_peered":"2024-09-12T01:05:29.185203+0000","last_clean":"2024-09-12T01:05:29.185203+0000","last_became_active":"2024-09-12T00:21:52.565276+0000","last_became_peered":"2024-09-12T00:21:52.565276+0000","last_unstale":"2024-09-12T01:05:29.185203+0000","last_undegraded":"2024-09-12T01:05:29.185203+0000","last_fullsized":"2024-09-12T01:05:29.185203+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:19.050097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'92","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.590887+0000","last_change":"2024-09-12T00:21:44.505865+0000","last_active":"2024-09-12T01:04:29.590887+0000","last_peered":"2024-09-12T01:04:29.590887+0000","last_clean":"2024-09-12T01:04:29.590887+0000","last_became_active":"2024-09-12T00:21:44.504866+0000","last_became_peered":"2024-09-12T00:21:44.504866+0000","last_unstale":"2024-09-12T01:04:29.590887+0000","last_undegraded":"2024-09-12T01:04:29.590887+0000","last_fullsized":"2024-09-12T01:04:29.590887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:00.702193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":364,"num_write":125,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'360","reported_seq":1010,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.690221+0000","last_change":"2024-09-12T00:21:42.513602+0000","last_active":"2024-09-12T01:07:27.690221+0000","last_peered":"2024-09-12T01:07:27.690221+0000","last_clean":"2024-09-12T01:07:27.690221+0000","last_became_active":"2024-09-12T00:21:42.511762+0000","last_became_peered":"2024-09-12T00:21:42.511762+0000","last_unstale":"2024-09-12T01:07:27.690221+0000","last_undegraded":"2024-09-12T01:07:27.690221+0000","last_fullsized":"2024-09-12T01:07:27.690221+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:56.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":36352,"num_write":1101,"num_write_kb":41720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:33.591024+0000","last_change":"2024-09-12T00:21:46.515246+0000","last_active":"2024-09-12T01:04:33.591024+0000","last_peered":"2024-09-12T01:04:33.591024+0000","last_clean":"2024-09-12T01:04:33.591024+0000","last_became_active":"2024-09-12T00:21:46.514486+0000","last_became_peered":"2024-09-12T00:21:46.514486+0000","last_unstale":"2024-09-12T01:04:33.591024+0000","last_undegraded":"2024-09-12T01:04:33.591024+0000","last_fullsized":"2024-09-12T01:04:33.591024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:53.736171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'313","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.419509+0000","last_change":"2024-09-12T00:21:48.548232+0000","last_active":"2024-09-12T01:06:49.419509+0000","last_peered":"2024-09-12T01:06:49.419509+0000","last_clean":"2024-09-12T01:06:49.419509+0000","last_became_active":"2024-09-12T00:21:48.547356+0000","last_became_peered":"2024-09-12T00:21:48.547356+0000","last_unstale":"2024-09-12T01:06:49.419509+0000","last_undegraded":"2024-09-12T01:06:49.419509+0000","last_fullsized":"2024-09-12T01:06:49.419509+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:38.710415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":980,"num_write":452,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.594618+0000","last_change":"2024-09-12T00:21:50.556901+0000","last_active":"2024-09-12T01:04:48.594618+0000","last_peered":"2024-09-12T01:04:48.594618+0000","last_clean":"2024-09-12T01:04:48.594618+0000","last_became_active":"2024-09-12T00:21:50.556220+0000","last_became_peered":"2024-09-12T00:21:50.556220+0000","last_unstale":"2024-09-12T01:04:48.594618+0000","last_undegraded":"2024-09-12T01:04:48.594618+0000","last_fullsized":"2024-09-12T01:04:48.594618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.780602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.632683+0000","last_change":"2024-09-12T00:21:52.567877+0000","last_active":"2024-09-12T01:06:04.632683+0000","last_peered":"2024-09-12T01:06:04.632683+0000","last_clean":"2024-09-12T01:06:04.632683+0000","last_became_active":"2024-09-12T00:21:52.567273+0000","last_became_peered":"2024-09-12T00:21:52.567273+0000","last_unstale":"2024-09-12T01:06:04.632683+0000","last_undegraded":"2024-09-12T01:06:04.632683+0000","last_fullsized":"2024-09-12T01:06:04.632683+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:22.583804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'124","reported_seq":703,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.523823+0000","last_change":"2024-09-12T00:21:44.503225+0000","last_active":"2024-09-12T01:06:06.523823+0000","last_peered":"2024-09-12T01:06:06.523823+0000","last_clean":"2024-09-12T01:06:06.523823+0000","last_became_active":"2024-09-12T00:21:44.502965+0000","last_became_peered":"2024-09-12T00:21:44.502965+0000","last_unstale":"2024-09-12T01:06:06.523823+0000","last_undegraded":"2024-09-12T01:06:06.523823+0000","last_fullsized":"2024-09-12T01:06:06.523823+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:31.381032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":435,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'294","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:02.556096+0000","last_change":"2024-09-12T00:22:13.521128+0000","last_active":"2024-09-12T01:07:02.556096+0000","last_peered":"2024-09-12T01:07:02.556096+0000","last_clean":"2024-09-12T01:07:02.556096+0000","last_became_active":"2024-09-12T00:22:13.520026+0000","last_became_peered":"2024-09-12T00:22:13.520026+0000","last_unstale":"2024-09-12T01:07:02.556096+0000","last_undegraded":"2024-09-12T01:07:02.556096+0000","last_fullsized":"2024-09-12T01:07:02.556096+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:58.425398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9661557,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":556,"num_read_kb":38314,"num_write":1075,"num_write_kb":31045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611545+0000","last_change":"2024-09-12T00:21:46.508177+0000","last_active":"2024-09-12T01:04:34.611545+0000","last_peered":"2024-09-12T01:04:34.611545+0000","last_clean":"2024-09-12T01:04:34.611545+0000","last_became_active":"2024-09-12T00:21:46.507456+0000","last_became_peered":"2024-09-12T00:21:46.507456+0000","last_unstale":"2024-09-12T01:04:34.611545+0000","last_undegraded":"2024-09-12T01:04:34.611545+0000","last_fullsized":"2024-09-12T01:04:34.611545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.624519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'305","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:59.646490+0000","last_change":"2024-09-12T00:21:48.541207+0000","last_active":"2024-09-12T01:06:59.646490+0000","last_peered":"2024-09-12T01:06:59.646490+0000","last_clean":"2024-09-12T01:06:59.646490+0000","last_became_active":"2024-09-12T00:21:48.535782+0000","last_became_peered":"2024-09-12T00:21:48.535782+0000","last_unstale":"2024-09-12T01:06:59.646490+0000","last_undegraded":"2024-09-12T01:06:59.646490+0000","last_fullsized":"2024-09-12T01:06:59.646490+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:36.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60857,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1011,"num_write":406,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'751","reported_seq":2246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.508497+0000","last_change":"2024-09-12T00:21:50.558383+0000","last_active":"2024-09-12T01:07:25.508497+0000","last_peered":"2024-09-12T01:07:25.508497+0000","last_clean":"2024-09-12T01:07:25.508497+0000","last_became_active":"2024-09-12T00:21:50.557158+0000","last_became_peered":"2024-09-12T00:21:50.557158+0000","last_unstale":"2024-09-12T01:07:25.508497+0000","last_undegraded":"2024-09-12T01:07:25.508497+0000","last_fullsized":"2024-09-12T01:07:25.508497+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:51.183200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'134","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.252744+0000","last_change":"2024-09-12T00:21:52.546563+0000","last_active":"2024-09-12T01:05:47.252744+0000","last_peered":"2024-09-12T01:05:47.252744+0000","last_clean":"2024-09-12T01:05:47.252744+0000","last_became_active":"2024-09-12T00:21:52.545876+0000","last_became_peered":"2024-09-12T00:21:52.545876+0000","last_unstale":"2024-09-12T01:05:47.252744+0000","last_undegraded":"2024-09-12T01:05:47.252744+0000","last_fullsized":"2024-09-12T01:05:47.252744+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.003099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":172,"num_write":354,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'141","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.454853+0000","last_change":"2024-09-12T00:21:44.494799+0000","last_active":"2024-09-12T01:05:00.454853+0000","last_peered":"2024-09-12T01:05:00.454853+0000","last_clean":"2024-09-12T01:05:00.454853+0000","last_became_active":"2024-09-12T00:21:44.494386+0000","last_became_peered":"2024-09-12T00:21:44.494386+0000","last_unstale":"2024-09-12T01:05:00.454853+0000","last_undegraded":"2024-09-12T01:05:00.454853+0000","last_fullsized":"2024-09-12T01:05:00.454853+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:48.947337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":627,"num_read_kb":527,"num_write":195,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'345","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.432353+0000","last_change":"2024-09-12T00:21:42.529220+0000","last_active":"2024-09-12T01:05:52.432353+0000","last_peered":"2024-09-12T01:05:52.432353+0000","last_clean":"2024-09-12T01:05:52.432353+0000","last_became_active":"2024-09-12T00:21:42.528782+0000","last_became_peered":"2024-09-12T00:21:42.528782+0000","last_unstale":"2024-09-12T01:05:52.432353+0000","last_undegraded":"2024-09-12T01:05:52.432353+0000","last_fullsized":"2024-09-12T01:05:52.432353+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:42.093500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8938182,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":585,"num_read_kb":31515,"num_write":1169,"num_write_kb":36332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'7","reported_seq":1938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.736641+0000","last_change":"2024-09-12T00:21:46.504153+0000","last_active":"2024-09-12T01:07:12.736641+0000","last_peered":"2024-09-12T01:07:12.736641+0000","last_clean":"2024-09-12T01:07:12.736641+0000","last_became_active":"2024-09-12T00:21:46.503412+0000","last_became_peered":"2024-09-12T00:21:46.503412+0000","last_unstale":"2024-09-12T01:07:12.736641+0000","last_undegraded":"2024-09-12T01:07:12.736641+0000","last_fullsized":"2024-09-12T01:07:12.736641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:47.686112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1679,"num_read_kb":2143,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'73","reported_seq":588,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.311430+0000","last_change":"2024-09-12T00:21:48.546361+0000","last_active":"2024-09-12T01:04:48.311430+0000","last_peered":"2024-09-12T01:04:48.311430+0000","last_clean":"2024-09-12T01:04:48.311430+0000","last_became_active":"2024-09-12T00:21:48.545388+0000","last_became_peered":"2024-09-12T00:21:48.545388+0000","last_unstale":"2024-09-12T01:04:48.311430+0000","last_undegraded":"2024-09-12T01:04:48.311430+0000","last_fullsized":"2024-09-12T01:04:48.311430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.386351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'766","reported_seq":4008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947470+0000","last_change":"2024-09-12T00:21:50.537415+0000","last_active":"2024-09-12T01:07:12.947470+0000","last_peered":"2024-09-12T01:07:12.947470+0000","last_clean":"2024-09-12T01:07:12.947470+0000","last_became_active":"2024-09-12T00:21:50.536672+0000","last_became_peered":"2024-09-12T00:21:50.536672+0000","last_unstale":"2024-09-12T01:07:12.947470+0000","last_undegraded":"2024-09-12T01:07:12.947470+0000","last_fullsized":"2024-09-12T01:07:12.947470+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.799043+0000","last_change":"2024-09-12T00:21:52.557213+0000","last_active":"2024-09-12T01:05:30.799043+0000","last_peered":"2024-09-12T01:05:30.799043+0000","last_clean":"2024-09-12T01:05:30.799043+0000","last_became_active":"2024-09-12T00:21:52.556523+0000","last_became_peered":"2024-09-12T00:21:52.556523+0000","last_unstale":"2024-09-12T01:05:30.799043+0000","last_undegraded":"2024-09-12T01:05:30.799043+0000","last_fullsized":"2024-09-12T01:05:30.799043+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:13.223517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":161,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'217","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.545950+0000","last_change":"2024-09-12T00:21:44.515428+0000","last_active":"2024-09-12T01:04:58.545950+0000","last_peered":"2024-09-12T01:04:58.545950+0000","last_clean":"2024-09-12T01:04:58.545950+0000","last_became_active":"2024-09-12T00:21:44.514085+0000","last_became_peered":"2024-09-12T00:21:44.514085+0000","last_unstale":"2024-09-12T01:04:58.545950+0000","last_undegraded":"2024-09-12T01:04:58.545950+0000","last_fullsized":"2024-09-12T01:04:58.545950+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:56.006782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":987,"num_read_kb":820,"num_write":332,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'290","reported_seq":906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.703704+0000","last_change":"2024-09-12T00:21:42.485706+0000","last_active":"2024-09-12T01:05:44.703704+0000","last_peered":"2024-09-12T01:05:44.703704+0000","last_clean":"2024-09-12T01:05:44.703704+0000","last_became_active":"2024-09-12T00:21:42.484728+0000","last_became_peered":"2024-09-12T00:21:42.484728+0000","last_unstale":"2024-09-12T01:05:44.703704+0000","last_undegraded":"2024-09-12T01:05:44.703704+0000","last_fullsized":"2024-09-12T01:05:44.703704+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:46.673395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486240,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":459,"num_read_kb":1781,"num_write":963,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.630684+0000","last_change":"2024-09-12T00:21:46.515775+0000","last_active":"2024-09-12T01:04:34.630684+0000","last_peered":"2024-09-12T01:04:34.630684+0000","last_clean":"2024-09-12T01:04:34.630684+0000","last_became_active":"2024-09-12T00:21:46.515469+0000","last_became_peered":"2024-09-12T00:21:46.515469+0000","last_unstale":"2024-09-12T01:04:34.630684+0000","last_undegraded":"2024-09-12T01:04:34.630684+0000","last_fullsized":"2024-09-12T01:04:34.630684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:12.258449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'337","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.419459+0000","last_change":"2024-09-12T00:21:48.524169+0000","last_active":"2024-09-12T01:06:49.419459+0000","last_peered":"2024-09-12T01:06:49.419459+0000","last_clean":"2024-09-12T01:06:49.419459+0000","last_became_active":"2024-09-12T00:21:48.523392+0000","last_became_peered":"2024-09-12T00:21:48.523392+0000","last_unstale":"2024-09-12T01:06:49.419459+0000","last_undegraded":"2024-09-12T01:06:49.419459+0000","last_fullsized":"2024-09-12T01:06:49.419459+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:05.832531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59967,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":1046,"num_write":434,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.755012+0000","last_change":"2024-09-12T00:21:50.567348+0000","last_active":"2024-09-12T01:04:39.755012+0000","last_peered":"2024-09-12T01:04:39.755012+0000","last_clean":"2024-09-12T01:04:39.755012+0000","last_became_active":"2024-09-12T00:21:50.566831+0000","last_became_peered":"2024-09-12T00:21:50.566831+0000","last_unstale":"2024-09-12T01:04:39.755012+0000","last_undegraded":"2024-09-12T01:04:39.755012+0000","last_fullsized":"2024-09-12T01:04:39.755012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:07.974869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'158","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.073492+0000","last_change":"2024-09-12T00:21:52.563487+0000","last_active":"2024-09-12T01:05:34.073492+0000","last_peered":"2024-09-12T01:05:34.073492+0000","last_clean":"2024-09-12T01:05:34.073492+0000","last_became_active":"2024-09-12T00:21:52.562716+0000","last_became_peered":"2024-09-12T00:21:52.562716+0000","last_unstale":"2024-09-12T01:05:34.073492+0000","last_undegraded":"2024-09-12T01:05:34.073492+0000","last_fullsized":"2024-09-12T01:05:34.073492+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:57.280882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":186,"num_write":388,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'137","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.221538+0000","last_change":"2024-09-12T00:21:44.503230+0000","last_active":"2024-09-12T01:05:43.221538+0000","last_peered":"2024-09-12T01:05:43.221538+0000","last_clean":"2024-09-12T01:05:43.221538+0000","last_became_active":"2024-09-12T00:21:44.502832+0000","last_became_peered":"2024-09-12T00:21:44.502832+0000","last_unstale":"2024-09-12T01:05:43.221538+0000","last_undegraded":"2024-09-12T01:05:43.221538+0000","last_fullsized":"2024-09-12T01:05:43.221538+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:03.323487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":521,"num_write":201,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.759168+0000","last_change":"2024-09-12T00:21:22.027534+0000","last_active":"2024-09-12T01:03:29.759168+0000","last_peered":"2024-09-12T01:03:29.759168+0000","last_clean":"2024-09-12T01:03:29.759168+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T01:03:29.759168+0000","last_undegraded":"2024-09-12T01:03:29.759168+0000","last_fullsized":"2024-09-12T01:03:29.759168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:20.173671+0000","last_clean_scrub_stamp":"2024-09-12T00:21:20.173671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:18.049959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640578+0000","last_change":"2024-09-12T00:21:28.254766+0000","last_active":"2024-09-12T01:05:14.640578+0000","last_peered":"2024-09-12T01:05:14.640578+0000","last_clean":"2024-09-12T01:05:14.640578+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T01:05:14.640578+0000","last_undegraded":"2024-09-12T01:05:14.640578+0000","last_fullsized":"2024-09-12T01:05:14.640578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:37.352626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'276","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.550233+0000","last_change":"2024-09-12T00:21:42.514559+0000","last_active":"2024-09-12T01:05:22.550233+0000","last_peered":"2024-09-12T01:05:22.550233+0000","last_clean":"2024-09-12T01:05:22.550233+0000","last_became_active":"2024-09-12T00:21:42.513672+0000","last_became_peered":"2024-09-12T00:21:42.513672+0000","last_unstale":"2024-09-12T01:05:22.550233+0000","last_undegraded":"2024-09-12T01:05:22.550233+0000","last_fullsized":"2024-09-12T01:05:22.550233+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:10.803601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285509,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":432,"num_read_kb":4546,"num_write":1020,"num_write_kb":26678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.577808+0000","last_change":"2024-09-12T00:21:46.506706+0000","last_active":"2024-09-12T01:03:29.577808+0000","last_peered":"2024-09-12T01:03:29.577808+0000","last_clean":"2024-09-12T01:03:29.577808+0000","last_became_active":"2024-09-12T00:21:46.506196+0000","last_became_peered":"2024-09-12T00:21:46.506196+0000","last_unstale":"2024-09-12T01:03:29.577808+0000","last_undegraded":"2024-09-12T01:03:29.577808+0000","last_fullsized":"2024-09-12T01:03:29.577808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:37.852267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'717","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.856519+0000","last_change":"2024-09-12T00:21:48.545130+0000","last_active":"2024-09-12T01:07:12.856519+0000","last_peered":"2024-09-12T01:07:12.856519+0000","last_clean":"2024-09-12T01:07:12.856519+0000","last_became_active":"2024-09-12T00:21:48.544327+0000","last_became_peered":"2024-09-12T00:21:48.544327+0000","last_unstale":"2024-09-12T01:07:12.856519+0000","last_undegraded":"2024-09-12T01:07:12.856519+0000","last_fullsized":"2024-09-12T01:07:12.856519+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:21.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168878,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1377,"num_read_kb":2876,"num_write":1288,"num_write_kb":1144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621223+0000","last_change":"2024-09-12T00:21:50.565245+0000","last_active":"2024-09-12T01:05:14.621223+0000","last_peered":"2024-09-12T01:05:14.621223+0000","last_clean":"2024-09-12T01:05:14.621223+0000","last_became_active":"2024-09-12T00:21:50.564442+0000","last_became_peered":"2024-09-12T00:21:50.564442+0000","last_unstale":"2024-09-12T01:05:14.621223+0000","last_undegraded":"2024-09-12T01:05:14.621223+0000","last_fullsized":"2024-09-12T01:05:14.621223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'206","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.344626+0000","last_change":"2024-09-12T00:21:52.557348+0000","last_active":"2024-09-12T01:06:07.344626+0000","last_peered":"2024-09-12T01:06:07.344626+0000","last_clean":"2024-09-12T01:06:07.344626+0000","last_became_active":"2024-09-12T00:21:52.550903+0000","last_became_peered":"2024-09-12T00:21:52.550903+0000","last_unstale":"2024-09-12T01:06:07.344626+0000","last_undegraded":"2024-09-12T01:06:07.344626+0000","last_fullsized":"2024-09-12T01:06:07.344626+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:10.990623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":429,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'100","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.182137+0000","last_change":"2024-09-12T00:21:44.519572+0000","last_active":"2024-09-12T01:05:29.182137+0000","last_peered":"2024-09-12T01:05:29.182137+0000","last_clean":"2024-09-12T01:05:29.182137+0000","last_became_active":"2024-09-12T00:21:44.518873+0000","last_became_peered":"2024-09-12T00:21:44.518873+0000","last_unstale":"2024-09-12T01:05:29.182137+0000","last_undegraded":"2024-09-12T01:05:29.182137+0000","last_fullsized":"2024-09-12T01:05:29.182137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:37.792281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":399,"num_write":140,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.615695+0000","last_change":"2024-09-12T00:21:28.254653+0000","last_active":"2024-09-12T01:03:39.615695+0000","last_peered":"2024-09-12T01:03:39.615695+0000","last_clean":"2024-09-12T01:03:39.615695+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T01:03:39.615695+0000","last_undegraded":"2024-09-12T01:03:39.615695+0000","last_fullsized":"2024-09-12T01:03:39.615695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:52.457807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'288","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.981722+0000","last_change":"2024-09-12T00:21:42.530775+0000","last_active":"2024-09-12T01:05:37.981722+0000","last_peered":"2024-09-12T01:05:37.981722+0000","last_clean":"2024-09-12T01:05:37.981722+0000","last_became_active":"2024-09-12T00:21:42.530049+0000","last_became_peered":"2024-09-12T00:21:42.530049+0000","last_unstale":"2024-09-12T01:05:37.981722+0000","last_undegraded":"2024-09-12T01:05:37.981722+0000","last_fullsized":"2024-09-12T01:05:37.981722+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.562005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4536165,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":739,"num_read_kb":7839,"num_write":1061,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.639489+0000","last_change":"2024-09-12T00:21:46.506977+0000","last_active":"2024-09-12T01:05:09.639489+0000","last_peered":"2024-09-12T01:05:09.639489+0000","last_clean":"2024-09-12T01:05:09.639489+0000","last_became_active":"2024-09-12T00:21:46.506303+0000","last_became_peered":"2024-09-12T00:21:46.506303+0000","last_unstale":"2024-09-12T01:05:09.639489+0000","last_undegraded":"2024-09-12T01:05:09.639489+0000","last_fullsized":"2024-09-12T01:05:09.639489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:15.859039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1265","reported_seq":2749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.380915+0000","last_change":"2024-09-12T00:21:48.539139+0000","last_active":"2024-09-12T01:07:27.380915+0000","last_peered":"2024-09-12T01:07:27.380915+0000","last_clean":"2024-09-12T01:07:27.380915+0000","last_became_active":"2024-09-12T00:21:48.538447+0000","last_became_peered":"2024-09-12T00:21:48.538447+0000","last_unstale":"2024-09-12T01:07:27.380915+0000","last_undegraded":"2024-09-12T01:07:27.380915+0000","last_fullsized":"2024-09-12T01:07:27.380915+0000","mapping_epoch":32,"log_start":"267'1200","ondisk_log_start":"267'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:58.399951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157796,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2036,"num_read_kb":3848,"num_write":1138,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617264+0000","last_change":"2024-09-12T00:21:50.569042+0000","last_active":"2024-09-12T01:03:44.617264+0000","last_peered":"2024-09-12T01:03:44.617264+0000","last_clean":"2024-09-12T01:03:44.617264+0000","last_became_active":"2024-09-12T00:21:50.568353+0000","last_became_peered":"2024-09-12T00:21:50.568353+0000","last_unstale":"2024-09-12T01:03:44.617264+0000","last_undegraded":"2024-09-12T01:03:44.617264+0000","last_fullsized":"2024-09-12T01:03:44.617264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'220","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.646102+0000","last_change":"2024-09-12T00:21:52.560037+0000","last_active":"2024-09-12T01:04:18.646102+0000","last_peered":"2024-09-12T01:04:18.646102+0000","last_clean":"2024-09-12T01:04:18.646102+0000","last_became_active":"2024-09-12T00:21:52.559325+0000","last_became_peered":"2024-09-12T00:21:52.559325+0000","last_unstale":"2024-09-12T01:04:18.646102+0000","last_undegraded":"2024-09-12T01:04:18.646102+0000","last_fullsized":"2024-09-12T01:04:18.646102+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:26.252511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":373,"num_write":495,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'235","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.199872+0000","last_change":"2024-09-12T00:21:44.499926+0000","last_active":"2024-09-12T01:05:36.199872+0000","last_peered":"2024-09-12T01:05:36.199872+0000","last_clean":"2024-09-12T01:05:36.199872+0000","last_became_active":"2024-09-12T00:21:44.499405+0000","last_became_peered":"2024-09-12T00:21:44.499405+0000","last_unstale":"2024-09-12T01:05:36.199872+0000","last_undegraded":"2024-09-12T01:05:36.199872+0000","last_fullsized":"2024-09-12T01:05:36.199872+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:43.127372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":847,"num_write":402,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600239+0000","last_change":"2024-09-12T00:21:28.255269+0000","last_active":"2024-09-12T01:05:13.600239+0000","last_peered":"2024-09-12T01:05:13.600239+0000","last_clean":"2024-09-12T01:05:13.600239+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T01:05:13.600239+0000","last_undegraded":"2024-09-12T01:05:13.600239+0000","last_fullsized":"2024-09-12T01:05:13.600239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:37.489457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'260","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.018485+0000","last_change":"2024-09-12T00:21:42.537155+0000","last_active":"2024-09-12T01:06:03.018485+0000","last_peered":"2024-09-12T01:06:03.018485+0000","last_clean":"2024-09-12T01:06:03.018485+0000","last_became_active":"2024-09-12T00:21:42.533356+0000","last_became_peered":"2024-09-12T00:21:42.533356+0000","last_unstale":"2024-09-12T01:06:03.018485+0000","last_undegraded":"2024-09-12T01:06:03.018485+0000","last_fullsized":"2024-09-12T01:06:03.018485+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10454589,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":341,"num_read_kb":11281,"num_write":913,"num_write_kb":25420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.599241+0000","last_change":"2024-09-12T00:21:46.511151+0000","last_active":"2024-09-12T01:05:08.599241+0000","last_peered":"2024-09-12T01:05:08.599241+0000","last_clean":"2024-09-12T01:05:08.599241+0000","last_became_active":"2024-09-12T00:21:46.510230+0000","last_became_peered":"2024-09-12T00:21:46.510230+0000","last_unstale":"2024-09-12T01:05:08.599241+0000","last_undegraded":"2024-09-12T01:05:08.599241+0000","last_fullsized":"2024-09-12T01:05:08.599241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:33.182597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'236","reported_seq":1333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947368+0000","last_change":"2024-09-12T00:21:48.543106+0000","last_active":"2024-09-12T01:07:12.947368+0000","last_peered":"2024-09-12T01:07:12.947368+0000","last_clean":"2024-09-12T01:07:12.947368+0000","last_became_active":"2024-09-12T00:21:48.541987+0000","last_became_peered":"2024-09-12T00:21:48.541987+0000","last_unstale":"2024-09-12T01:07:12.947368+0000","last_undegraded":"2024-09-12T01:07:12.947368+0000","last_fullsized":"2024-09-12T01:07:12.947368+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:35.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.571245+0000","last_change":"2024-09-12T00:21:50.550098+0000","last_active":"2024-09-12T01:03:34.571245+0000","last_peered":"2024-09-12T01:03:34.571245+0000","last_clean":"2024-09-12T01:03:34.571245+0000","last_became_active":"2024-09-12T00:21:50.549468+0000","last_became_peered":"2024-09-12T00:21:50.549468+0000","last_unstale":"2024-09-12T01:03:34.571245+0000","last_undegraded":"2024-09-12T01:03:34.571245+0000","last_fullsized":"2024-09-12T01:03:34.571245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:51.226795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'266","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.525444+0000","last_change":"2024-09-12T00:21:52.553306+0000","last_active":"2024-09-12T01:06:07.525444+0000","last_peered":"2024-09-12T01:06:07.525444+0000","last_clean":"2024-09-12T01:06:07.525444+0000","last_became_active":"2024-09-12T00:21:52.552571+0000","last_became_peered":"2024-09-12T00:21:52.552571+0000","last_unstale":"2024-09-12T01:06:07.525444+0000","last_undegraded":"2024-09-12T01:06:07.525444+0000","last_fullsized":"2024-09-12T01:06:07.525444+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.410934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":539,"num_write":598,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'152","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.291657+0000","last_change":"2024-09-12T00:21:44.494446+0000","last_active":"2024-09-12T01:05:46.291657+0000","last_peered":"2024-09-12T01:05:46.291657+0000","last_clean":"2024-09-12T01:05:46.291657+0000","last_became_active":"2024-09-12T00:21:44.493744+0000","last_became_peered":"2024-09-12T00:21:44.493744+0000","last_unstale":"2024-09-12T01:05:46.291657+0000","last_undegraded":"2024-09-12T01:05:46.291657+0000","last_fullsized":"2024-09-12T01:05:46.291657+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.811924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":592,"num_write":229,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640540+0000","last_change":"2024-09-12T00:21:28.255515+0000","last_active":"2024-09-12T01:05:14.640540+0000","last_peered":"2024-09-12T01:05:14.640540+0000","last_clean":"2024-09-12T01:05:14.640540+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T01:05:14.640540+0000","last_undegraded":"2024-09-12T01:05:14.640540+0000","last_fullsized":"2024-09-12T01:05:14.640540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:43.203836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'266","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.181183+0000","last_change":"2024-09-12T00:21:42.530327+0000","last_active":"2024-09-12T01:07:07.181183+0000","last_peered":"2024-09-12T01:07:07.181183+0000","last_clean":"2024-09-12T01:07:07.181183+0000","last_became_active":"2024-09-12T00:21:42.528949+0000","last_became_peered":"2024-09-12T00:21:42.528949+0000","last_unstale":"2024-09-12T01:07:07.181183+0000","last_undegraded":"2024-09-12T01:07:07.181183+0000","last_fullsized":"2024-09-12T01:07:07.181183+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.542668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16418323,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":416,"num_read_kb":67654,"num_write":972,"num_write_kb":55160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:38.578580+0000","last_change":"2024-09-12T00:21:46.518181+0000","last_active":"2024-09-12T01:03:38.578580+0000","last_peered":"2024-09-12T01:03:38.578580+0000","last_clean":"2024-09-12T01:03:38.578580+0000","last_became_active":"2024-09-12T00:21:46.517381+0000","last_became_peered":"2024-09-12T00:21:46.517381+0000","last_unstale":"2024-09-12T01:03:38.578580+0000","last_undegraded":"2024-09-12T01:03:38.578580+0000","last_fullsized":"2024-09-12T01:03:38.578580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:55.356740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'120","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.029686+0000","last_change":"2024-09-12T00:21:48.553881+0000","last_active":"2024-09-12T01:07:13.029686+0000","last_peered":"2024-09-12T01:07:13.029686+0000","last_clean":"2024-09-12T01:07:13.029686+0000","last_became_active":"2024-09-12T00:21:48.553129+0000","last_became_peered":"2024-09-12T00:21:48.553129+0000","last_unstale":"2024-09-12T01:07:13.029686+0000","last_undegraded":"2024-09-12T01:07:13.029686+0000","last_fullsized":"2024-09-12T01:07:13.029686+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:52.650170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640743+0000","last_change":"2024-09-12T00:21:50.545732+0000","last_active":"2024-09-12T01:05:14.640743+0000","last_peered":"2024-09-12T01:05:14.640743+0000","last_clean":"2024-09-12T01:05:14.640743+0000","last_became_active":"2024-09-12T00:21:50.545037+0000","last_became_peered":"2024-09-12T00:21:50.545037+0000","last_unstale":"2024-09-12T01:05:14.640743+0000","last_undegraded":"2024-09-12T01:05:14.640743+0000","last_fullsized":"2024-09-12T01:05:14.640743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'98","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.414533+0000","last_change":"2024-09-12T00:21:52.541609+0000","last_active":"2024-09-12T01:06:07.414533+0000","last_peered":"2024-09-12T01:06:07.414533+0000","last_clean":"2024-09-12T01:06:07.414533+0000","last_became_active":"2024-09-12T00:21:52.540900+0000","last_became_peered":"2024-09-12T00:21:52.540900+0000","last_unstale":"2024-09-12T01:06:07.414533+0000","last_undegraded":"2024-09-12T01:06:07.414533+0000","last_fullsized":"2024-09-12T01:06:07.414533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:38.138742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":212,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'221","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:00.984004+0000","last_change":"2024-09-12T00:21:44.498171+0000","last_active":"2024-09-12T01:04:00.984004+0000","last_peered":"2024-09-12T01:04:00.984004+0000","last_clean":"2024-09-12T01:04:00.984004+0000","last_became_active":"2024-09-12T00:21:44.497354+0000","last_became_peered":"2024-09-12T00:21:44.497354+0000","last_unstale":"2024-09-12T01:04:00.984004+0000","last_undegraded":"2024-09-12T01:04:00.984004+0000","last_fullsized":"2024-09-12T01:04:00.984004+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:14.091559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":990,"num_read_kb":806,"num_write":357,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'241","reported_seq":872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.977380+0000","last_change":"2024-09-12T00:21:42.522295+0000","last_active":"2024-09-12T01:05:37.977380+0000","last_peered":"2024-09-12T01:05:37.977380+0000","last_clean":"2024-09-12T01:05:37.977380+0000","last_became_active":"2024-09-12T00:21:42.521990+0000","last_became_peered":"2024-09-12T00:21:42.521990+0000","last_unstale":"2024-09-12T01:05:37.977380+0000","last_undegraded":"2024-09-12T01:05:37.977380+0000","last_fullsized":"2024-09-12T01:05:37.977380+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:21.962527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14471811,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":384,"num_read_kb":61831,"num_write":942,"num_write_kb":29041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621065+0000","last_change":"2024-09-12T00:21:28.750763+0000","last_active":"2024-09-12T01:05:14.621065+0000","last_peered":"2024-09-12T01:05:14.621065+0000","last_clean":"2024-09-12T01:05:14.621065+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T01:05:14.621065+0000","last_undegraded":"2024-09-12T01:05:14.621065+0000","last_fullsized":"2024-09-12T01:05:14.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:40.130897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.570148+0000","last_change":"2024-09-12T00:21:46.499113+0000","last_active":"2024-09-12T01:03:29.570148+0000","last_peered":"2024-09-12T01:03:29.570148+0000","last_clean":"2024-09-12T01:03:29.570148+0000","last_became_active":"2024-09-12T00:21:46.498378+0000","last_became_peered":"2024-09-12T00:21:46.498378+0000","last_unstale":"2024-09-12T01:03:29.570148+0000","last_undegraded":"2024-09-12T01:03:29.570148+0000","last_fullsized":"2024-09-12T01:03:29.570148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:56.000475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'578","reported_seq":1246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.989988+0000","last_change":"2024-09-12T00:21:48.535483+0000","last_active":"2024-09-12T01:07:26.989988+0000","last_peered":"2024-09-12T01:07:26.989988+0000","last_clean":"2024-09-12T01:07:26.989988+0000","last_became_active":"2024-09-12T00:21:48.534749+0000","last_became_peered":"2024-09-12T00:21:48.534749+0000","last_unstale":"2024-09-12T01:07:26.989988+0000","last_undegraded":"2024-09-12T01:07:26.989988+0000","last_fullsized":"2024-09-12T01:07:26.989988+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:39.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96095,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1602,"num_read_kb":2762,"num_write":2078,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.739282+0000","last_change":"2024-09-12T00:21:50.556186+0000","last_active":"2024-09-12T01:03:34.739282+0000","last_peered":"2024-09-12T01:03:34.739282+0000","last_clean":"2024-09-12T01:03:34.739282+0000","last_became_active":"2024-09-12T00:21:50.554728+0000","last_became_peered":"2024-09-12T00:21:50.554728+0000","last_unstale":"2024-09-12T01:03:34.739282+0000","last_undegraded":"2024-09-12T01:03:34.739282+0000","last_fullsized":"2024-09-12T01:03:34.739282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:49.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'174","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.400639+0000","last_change":"2024-09-12T00:21:52.558976+0000","last_active":"2024-09-12T01:05:25.400639+0000","last_peered":"2024-09-12T01:05:25.400639+0000","last_clean":"2024-09-12T01:05:25.400639+0000","last_became_active":"2024-09-12T00:21:52.558203+0000","last_became_peered":"2024-09-12T00:21:52.558203+0000","last_unstale":"2024-09-12T01:05:25.400639+0000","last_undegraded":"2024-09-12T01:05:25.400639+0000","last_fullsized":"2024-09-12T01:05:25.400639+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:46.691847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1145,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":410,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'196","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.150715+0000","last_change":"2024-09-12T00:21:44.498346+0000","last_active":"2024-09-12T01:05:52.150715+0000","last_peered":"2024-09-12T01:05:52.150715+0000","last_clean":"2024-09-12T01:05:52.150715+0000","last_became_active":"2024-09-12T00:21:44.497510+0000","last_became_peered":"2024-09-12T00:21:44.497510+0000","last_unstale":"2024-09-12T01:05:52.150715+0000","last_undegraded":"2024-09-12T01:05:52.150715+0000","last_fullsized":"2024-09-12T01:05:52.150715+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:28.893058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":719,"num_write":306,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'268","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.560350+0000","last_change":"2024-09-12T00:21:42.529749+0000","last_active":"2024-09-12T01:05:51.560350+0000","last_peered":"2024-09-12T01:05:51.560350+0000","last_clean":"2024-09-12T01:05:51.560350+0000","last_became_active":"2024-09-12T00:21:42.529084+0000","last_became_peered":"2024-09-12T00:21:42.529084+0000","last_unstale":"2024-09-12T01:05:51.560350+0000","last_undegraded":"2024-09-12T01:05:51.560350+0000","last_fullsized":"2024-09-12T01:05:51.560350+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:23.266713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052743,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":435,"num_read_kb":3172,"num_write":1024,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.610735+0000","last_change":"2024-09-12T00:21:28.256092+0000","last_active":"2024-09-12T01:03:19.610735+0000","last_peered":"2024-09-12T01:03:19.610735+0000","last_clean":"2024-09-12T01:03:19.610735+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T01:03:19.610735+0000","last_undegraded":"2024-09-12T01:03:19.610735+0000","last_fullsized":"2024-09-12T01:03:19.610735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:41.836946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.577690+0000","last_change":"2024-09-12T00:21:46.507947+0000","last_active":"2024-09-12T01:03:29.577690+0000","last_peered":"2024-09-12T01:03:29.577690+0000","last_clean":"2024-09-12T01:03:29.577690+0000","last_became_active":"2024-09-12T00:21:46.507150+0000","last_became_peered":"2024-09-12T00:21:46.507150+0000","last_unstale":"2024-09-12T01:03:29.577690+0000","last_undegraded":"2024-09-12T01:03:29.577690+0000","last_fullsized":"2024-09-12T01:03:29.577690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:27.994405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'166","reported_seq":730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.042400+0000","last_change":"2024-09-12T00:21:48.546326+0000","last_active":"2024-09-12T01:04:58.042400+0000","last_peered":"2024-09-12T01:04:58.042400+0000","last_clean":"2024-09-12T01:04:58.042400+0000","last_became_active":"2024-09-12T00:21:48.545244+0000","last_became_peered":"2024-09-12T00:21:48.545244+0000","last_unstale":"2024-09-12T01:04:58.042400+0000","last_undegraded":"2024-09-12T01:04:58.042400+0000","last_fullsized":"2024-09-12T01:04:58.042400+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.959520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'768","reported_seq":2798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947416+0000","last_change":"2024-09-12T00:21:50.566794+0000","last_active":"2024-09-12T01:07:12.947416+0000","last_peered":"2024-09-12T01:07:12.947416+0000","last_clean":"2024-09-12T01:07:12.947416+0000","last_became_active":"2024-09-12T00:21:50.565930+0000","last_became_peered":"2024-09-12T00:21:50.565930+0000","last_unstale":"2024-09-12T01:07:12.947416+0000","last_undegraded":"2024-09-12T01:07:12.947416+0000","last_fullsized":"2024-09-12T01:07:12.947416+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:10.827538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.868125+0000","last_change":"2024-09-12T00:21:52.563826+0000","last_active":"2024-09-12T01:07:12.868125+0000","last_peered":"2024-09-12T01:07:12.868125+0000","last_clean":"2024-09-12T01:07:12.868125+0000","last_became_active":"2024-09-12T00:21:52.562765+0000","last_became_peered":"2024-09-12T00:21:52.562765+0000","last_unstale":"2024-09-12T01:07:12.868125+0000","last_undegraded":"2024-09-12T01:07:12.868125+0000","last_fullsized":"2024-09-12T01:07:12.868125+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.216884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":136,"num_write":336,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'106","reported_seq":691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.575375+0000","last_change":"2024-09-12T00:21:44.493205+0000","last_active":"2024-09-12T01:03:54.575375+0000","last_peered":"2024-09-12T01:03:54.575375+0000","last_clean":"2024-09-12T01:03:54.575375+0000","last_became_active":"2024-09-12T00:21:44.492443+0000","last_became_peered":"2024-09-12T00:21:44.492443+0000","last_unstale":"2024-09-12T01:03:54.575375+0000","last_undegraded":"2024-09-12T01:03:54.575375+0000","last_fullsized":"2024-09-12T01:03:54.575375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:20.383680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":379,"num_write":156,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'261","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.383871+0000","last_change":"2024-09-12T00:21:42.506233+0000","last_active":"2024-09-12T01:05:26.383871+0000","last_peered":"2024-09-12T01:05:26.383871+0000","last_clean":"2024-09-12T01:05:26.383871+0000","last_became_active":"2024-09-12T00:21:42.505355+0000","last_became_peered":"2024-09-12T00:21:42.505355+0000","last_unstale":"2024-09-12T01:05:26.383871+0000","last_undegraded":"2024-09-12T01:05:26.383871+0000","last_fullsized":"2024-09-12T01:05:26.383871+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:51.142709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5315687,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":8879,"num_write":1053,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587669+0000","last_change":"2024-09-12T00:21:28.670456+0000","last_active":"2024-09-12T01:04:49.587669+0000","last_peered":"2024-09-12T01:04:49.587669+0000","last_clean":"2024-09-12T01:04:49.587669+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T01:04:49.587669+0000","last_undegraded":"2024-09-12T01:04:49.587669+0000","last_fullsized":"2024-09-12T01:04:49.587669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:30.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.613152+0000","last_change":"2024-09-12T00:21:46.507186+0000","last_active":"2024-09-12T01:03:29.613152+0000","last_peered":"2024-09-12T01:03:29.613152+0000","last_clean":"2024-09-12T01:03:29.613152+0000","last_became_active":"2024-09-12T00:21:46.506416+0000","last_became_peered":"2024-09-12T00:21:46.506416+0000","last_unstale":"2024-09-12T01:03:29.613152+0000","last_undegraded":"2024-09-12T01:03:29.613152+0000","last_fullsized":"2024-09-12T01:03:29.613152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:06.407604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'112","reported_seq":655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.074689+0000","last_change":"2024-09-12T00:21:48.541779+0000","last_active":"2024-09-12T01:05:04.074689+0000","last_peered":"2024-09-12T01:05:04.074689+0000","last_clean":"2024-09-12T01:05:04.074689+0000","last_became_active":"2024-09-12T00:21:48.541051+0000","last_became_peered":"2024-09-12T00:21:48.541051+0000","last_unstale":"2024-09-12T01:05:04.074689+0000","last_undegraded":"2024-09-12T01:05:04.074689+0000","last_fullsized":"2024-09-12T01:05:04.074689+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:48.095228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'775","reported_seq":2249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.948032+0000","last_change":"2024-09-12T00:21:50.565496+0000","last_active":"2024-09-12T01:07:12.948032+0000","last_peered":"2024-09-12T01:07:12.948032+0000","last_clean":"2024-09-12T01:07:12.948032+0000","last_became_active":"2024-09-12T00:21:50.564982+0000","last_became_peered":"2024-09-12T00:21:50.564982+0000","last_unstale":"2024-09-12T01:07:12.948032+0000","last_undegraded":"2024-09-12T01:07:12.948032+0000","last_fullsized":"2024-09-12T01:07:12.948032+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:45.360699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'150","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.238137+0000","last_change":"2024-09-12T00:21:52.556569+0000","last_active":"2024-09-12T01:05:51.238137+0000","last_peered":"2024-09-12T01:05:51.238137+0000","last_clean":"2024-09-12T01:05:51.238137+0000","last_became_active":"2024-09-12T00:21:52.555909+0000","last_became_peered":"2024-09-12T00:21:52.555909+0000","last_unstale":"2024-09-12T01:05:51.238137+0000","last_undegraded":"2024-09-12T01:05:51.238137+0000","last_fullsized":"2024-09-12T01:05:51.238137+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:36.848678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":331,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'167","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:02.021470+0000","last_change":"2024-09-12T00:21:44.494606+0000","last_active":"2024-09-12T01:06:02.021470+0000","last_peered":"2024-09-12T01:06:02.021470+0000","last_clean":"2024-09-12T01:06:02.021470+0000","last_became_active":"2024-09-12T00:21:44.494215+0000","last_became_peered":"2024-09-12T00:21:44.494215+0000","last_unstale":"2024-09-12T01:06:02.021470+0000","last_undegraded":"2024-09-12T01:06:02.021470+0000","last_fullsized":"2024-09-12T01:06:02.021470+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:08.392897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":568,"num_write":276,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'310","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.588319+0000","last_change":"2024-09-12T00:21:42.495485+0000","last_active":"2024-09-12T01:05:47.588319+0000","last_peered":"2024-09-12T01:05:47.588319+0000","last_clean":"2024-09-12T01:05:47.588319+0000","last_became_active":"2024-09-12T00:21:42.494486+0000","last_became_peered":"2024-09-12T00:21:42.494486+0000","last_unstale":"2024-09-12T01:05:47.588319+0000","last_undegraded":"2024-09-12T01:05:47.588319+0000","last_fullsized":"2024-09-12T01:05:47.588319+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.868593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4223711,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":471,"num_read_kb":23252,"num_write":1167,"num_write_kb":41943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634565+0000","last_change":"2024-09-12T00:21:28.255394+0000","last_active":"2024-09-12T01:04:49.634565+0000","last_peered":"2024-09-12T01:04:49.634565+0000","last_clean":"2024-09-12T01:04:49.634565+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T01:04:49.634565+0000","last_undegraded":"2024-09-12T01:04:49.634565+0000","last_fullsized":"2024-09-12T01:04:49.634565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:59.294638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.576422+0000","last_change":"2024-09-12T00:21:46.491161+0000","last_active":"2024-09-12T01:03:59.576422+0000","last_peered":"2024-09-12T01:03:59.576422+0000","last_clean":"2024-09-12T01:03:59.576422+0000","last_became_active":"2024-09-12T00:21:46.490398+0000","last_became_peered":"2024-09-12T00:21:46.490398+0000","last_unstale":"2024-09-12T01:03:59.576422+0000","last_undegraded":"2024-09-12T01:03:59.576422+0000","last_fullsized":"2024-09-12T01:03:59.576422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:39.280351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'701","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.809996+0000","last_change":"2024-09-12T00:21:48.545913+0000","last_active":"2024-09-12T01:07:12.809996+0000","last_peered":"2024-09-12T01:07:12.809996+0000","last_clean":"2024-09-12T01:07:12.809996+0000","last_became_active":"2024-09-12T00:21:48.543101+0000","last_became_peered":"2024-09-12T00:21:48.543101+0000","last_unstale":"2024-09-12T01:07:12.809996+0000","last_undegraded":"2024-09-12T01:07:12.809996+0000","last_fullsized":"2024-09-12T01:07:12.809996+0000","mapping_epoch":32,"log_start":"267'600","ondisk_log_start":"267'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190375,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1252,"num_read_kb":2706,"num_write":1030,"num_write_kb":879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.571169+0000","last_change":"2024-09-12T00:21:50.551312+0000","last_active":"2024-09-12T01:03:34.571169+0000","last_peered":"2024-09-12T01:03:34.571169+0000","last_clean":"2024-09-12T01:03:34.571169+0000","last_became_active":"2024-09-12T00:21:50.549692+0000","last_became_peered":"2024-09-12T00:21:50.549692+0000","last_unstale":"2024-09-12T01:03:34.571169+0000","last_undegraded":"2024-09-12T01:03:34.571169+0000","last_fullsized":"2024-09-12T01:03:34.571169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:16.254094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'107","reported_seq":601,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.235026+0000","last_change":"2024-09-12T00:21:52.556774+0000","last_active":"2024-09-12T01:05:43.235026+0000","last_peered":"2024-09-12T01:05:43.235026+0000","last_clean":"2024-09-12T01:05:43.235026+0000","last_became_active":"2024-09-12T00:21:52.556038+0000","last_became_peered":"2024-09-12T00:21:52.556038+0000","last_unstale":"2024-09-12T01:05:43.235026+0000","last_undegraded":"2024-09-12T01:05:43.235026+0000","last_fullsized":"2024-09-12T01:05:43.235026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:26.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":258,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'117","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.624149+0000","last_change":"2024-09-12T00:21:52.538201+0000","last_active":"2024-09-12T01:06:06.624149+0000","last_peered":"2024-09-12T01:06:06.624149+0000","last_clean":"2024-09-12T01:06:06.624149+0000","last_became_active":"2024-09-12T00:21:52.537464+0000","last_became_peered":"2024-09-12T00:21:52.537464+0000","last_unstale":"2024-09-12T01:06:06.624149+0000","last_undegraded":"2024-09-12T01:06:06.624149+0000","last_fullsized":"2024-09-12T01:06:06.624149+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:06.332481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":226,"num_write":297,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'147","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.222011+0000","last_change":"2024-09-12T00:21:44.507294+0000","last_active":"2024-09-12T01:04:11.222011+0000","last_peered":"2024-09-12T01:04:11.222011+0000","last_clean":"2024-09-12T01:04:11.222011+0000","last_became_active":"2024-09-12T00:21:44.494375+0000","last_became_peered":"2024-09-12T00:21:44.494375+0000","last_unstale":"2024-09-12T01:04:11.222011+0000","last_undegraded":"2024-09-12T01:04:11.222011+0000","last_fullsized":"2024-09-12T01:04:11.222011+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:57.052664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":613,"num_write":235,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.567138+0000","last_change":"2024-09-12T00:21:42.495876+0000","last_active":"2024-09-12T01:05:31.567138+0000","last_peered":"2024-09-12T01:05:31.567138+0000","last_clean":"2024-09-12T01:05:31.567138+0000","last_became_active":"2024-09-12T00:21:42.495160+0000","last_became_peered":"2024-09-12T00:21:42.495160+0000","last_unstale":"2024-09-12T01:05:31.567138+0000","last_undegraded":"2024-09-12T01:05:31.567138+0000","last_fullsized":"2024-09-12T01:05:31.567138+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.406950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10079349,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":597,"num_read_kb":36666,"num_write":1217,"num_write_kb":30706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.576962+0000","last_change":"2024-09-12T00:21:46.504482+0000","last_active":"2024-09-12T01:03:49.576962+0000","last_peered":"2024-09-12T01:03:49.576962+0000","last_clean":"2024-09-12T01:03:49.576962+0000","last_became_active":"2024-09-12T00:21:46.503594+0000","last_became_peered":"2024-09-12T00:21:46.503594+0000","last_unstale":"2024-09-12T01:03:49.576962+0000","last_undegraded":"2024-09-12T01:03:49.576962+0000","last_fullsized":"2024-09-12T01:03:49.576962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:50.259430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'268","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.976069+0000","last_change":"2024-09-12T00:21:48.546884+0000","last_active":"2024-09-12T01:07:11.976069+0000","last_peered":"2024-09-12T01:07:11.976069+0000","last_clean":"2024-09-12T01:07:11.976069+0000","last_became_active":"2024-09-12T00:21:48.546213+0000","last_became_peered":"2024-09-12T00:21:48.546213+0000","last_unstale":"2024-09-12T01:07:11.976069+0000","last_undegraded":"2024-09-12T01:07:11.976069+0000","last_fullsized":"2024-09-12T01:07:11.976069+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:17.869108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53909,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":423,"num_read_kb":860,"num_write":342,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581894+0000","last_change":"2024-09-12T00:21:50.549810+0000","last_active":"2024-09-12T01:03:53.581894+0000","last_peered":"2024-09-12T01:03:53.581894+0000","last_clean":"2024-09-12T01:03:53.581894+0000","last_became_active":"2024-09-12T00:21:50.549135+0000","last_became_peered":"2024-09-12T00:21:50.549135+0000","last_unstale":"2024-09-12T01:03:53.581894+0000","last_undegraded":"2024-09-12T01:03:53.581894+0000","last_fullsized":"2024-09-12T01:03:53.581894+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:36.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'126","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.920723+0000","last_change":"2024-09-12T00:21:52.563982+0000","last_active":"2024-09-12T01:07:11.920723+0000","last_peered":"2024-09-12T01:07:11.920723+0000","last_clean":"2024-09-12T01:07:11.920723+0000","last_became_active":"2024-09-12T00:21:52.563303+0000","last_became_peered":"2024-09-12T00:21:52.563303+0000","last_unstale":"2024-09-12T01:07:11.920723+0000","last_undegraded":"2024-09-12T01:07:11.920723+0000","last_fullsized":"2024-09-12T01:07:11.920723+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:33.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":144,"num_write":323,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'152","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.618706+0000","last_change":"2024-09-12T00:21:44.498404+0000","last_active":"2024-09-12T01:04:20.618706+0000","last_peered":"2024-09-12T01:04:20.618706+0000","last_clean":"2024-09-12T01:04:20.618706+0000","last_became_active":"2024-09-12T00:21:44.495299+0000","last_became_peered":"2024-09-12T00:21:44.495299+0000","last_unstale":"2024-09-12T01:04:20.618706+0000","last_undegraded":"2024-09-12T01:04:20.618706+0000","last_fullsized":"2024-09-12T01:04:20.618706+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":653,"num_read_kb":535,"num_write":221,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'226","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.596992+0000","last_change":"2024-09-12T00:21:42.511183+0000","last_active":"2024-09-12T01:05:46.596992+0000","last_peered":"2024-09-12T01:05:46.596992+0000","last_clean":"2024-09-12T01:05:46.596992+0000","last_became_active":"2024-09-12T00:21:42.510774+0000","last_became_peered":"2024-09-12T00:21:42.510774+0000","last_unstale":"2024-09-12T01:05:46.596992+0000","last_undegraded":"2024-09-12T01:05:46.596992+0000","last_fullsized":"2024-09-12T01:05:46.596992+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:35.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6805157,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":384,"num_read_kb":10210,"num_write":868,"num_write_kb":22659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574388+0000","last_change":"2024-09-12T00:21:46.499247+0000","last_active":"2024-09-12T01:03:49.574388+0000","last_peered":"2024-09-12T01:03:49.574388+0000","last_clean":"2024-09-12T01:03:49.574388+0000","last_became_active":"2024-09-12T00:21:46.498536+0000","last_became_peered":"2024-09-12T00:21:46.498536+0000","last_unstale":"2024-09-12T01:03:49.574388+0000","last_undegraded":"2024-09-12T01:03:49.574388+0000","last_fullsized":"2024-09-12T01:03:49.574388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:23.854256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'42","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.160500+0000","last_change":"2024-09-12T00:21:48.530906+0000","last_active":"2024-09-12T01:04:59.160500+0000","last_peered":"2024-09-12T01:04:59.160500+0000","last_clean":"2024-09-12T01:04:59.160500+0000","last_became_active":"2024-09-12T00:21:48.528299+0000","last_became_peered":"2024-09-12T00:21:48.528299+0000","last_unstale":"2024-09-12T01:04:59.160500+0000","last_undegraded":"2024-09-12T01:04:59.160500+0000","last_fullsized":"2024-09-12T01:04:59.160500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:04.289536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.744259+0000","last_change":"2024-09-12T00:21:50.555449+0000","last_active":"2024-09-12T01:03:54.744259+0000","last_peered":"2024-09-12T01:03:54.744259+0000","last_clean":"2024-09-12T01:03:54.744259+0000","last_became_active":"2024-09-12T00:21:50.553714+0000","last_became_peered":"2024-09-12T00:21:50.553714+0000","last_unstale":"2024-09-12T01:03:54.744259+0000","last_undegraded":"2024-09-12T01:03:54.744259+0000","last_fullsized":"2024-09-12T01:03:54.744259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:49.756435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'214","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.327000+0000","last_change":"2024-09-12T00:21:52.557187+0000","last_active":"2024-09-12T01:06:07.327000+0000","last_peered":"2024-09-12T01:06:07.327000+0000","last_clean":"2024-09-12T01:06:07.327000+0000","last_became_active":"2024-09-12T00:21:52.556407+0000","last_became_peered":"2024-09-12T00:21:52.556407+0000","last_unstale":"2024-09-12T01:06:07.327000+0000","last_undegraded":"2024-09-12T01:06:07.327000+0000","last_fullsized":"2024-09-12T01:06:07.327000+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.366159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":286,"num_write":472,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'340","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.973379+0000","last_change":"2024-09-12T00:21:44.501770+0000","last_active":"2024-09-12T01:04:13.973379+0000","last_peered":"2024-09-12T01:04:13.973379+0000","last_clean":"2024-09-12T01:04:13.973379+0000","last_became_active":"2024-09-12T00:21:44.499891+0000","last_became_peered":"2024-09-12T00:21:44.499891+0000","last_unstale":"2024-09-12T01:04:13.973379+0000","last_undegraded":"2024-09-12T01:04:13.973379+0000","last_fullsized":"2024-09-12T01:04:13.973379+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.959531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1519,"num_read_kb":1239,"num_write":521,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'249","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.016790+0000","last_change":"2024-09-12T00:21:42.534894+0000","last_active":"2024-09-12T01:06:03.016790+0000","last_peered":"2024-09-12T01:06:03.016790+0000","last_clean":"2024-09-12T01:06:03.016790+0000","last_became_active":"2024-09-12T00:21:42.534537+0000","last_became_peered":"2024-09-12T00:21:42.534537+0000","last_unstale":"2024-09-12T01:06:03.016790+0000","last_undegraded":"2024-09-12T01:06:03.016790+0000","last_fullsized":"2024-09-12T01:06:03.016790+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.812543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224401,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":327,"num_read_kb":22569,"num_write":906,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743057+0000","last_change":"2024-09-12T00:21:46.489769+0000","last_active":"2024-09-12T01:03:49.743057+0000","last_peered":"2024-09-12T01:03:49.743057+0000","last_clean":"2024-09-12T01:03:49.743057+0000","last_became_active":"2024-09-12T00:21:46.489054+0000","last_became_peered":"2024-09-12T00:21:46.489054+0000","last_unstale":"2024-09-12T01:03:49.743057+0000","last_undegraded":"2024-09-12T01:03:49.743057+0000","last_fullsized":"2024-09-12T01:03:49.743057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:29.459282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'291","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.866262+0000","last_change":"2024-09-12T00:21:48.550280+0000","last_active":"2024-09-12T01:07:26.866262+0000","last_peered":"2024-09-12T01:07:26.866262+0000","last_clean":"2024-09-12T01:07:26.866262+0000","last_became_active":"2024-09-12T00:21:48.549368+0000","last_became_peered":"2024-09-12T00:21:48.549368+0000","last_unstale":"2024-09-12T01:07:26.866262+0000","last_undegraded":"2024-09-12T01:07:26.866262+0000","last_fullsized":"2024-09-12T01:07:26.866262+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:05.929053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56273,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1054,"num_write":388,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.765195+0000","last_change":"2024-09-12T00:21:50.566488+0000","last_active":"2024-09-12T01:03:54.765195+0000","last_peered":"2024-09-12T01:03:54.765195+0000","last_clean":"2024-09-12T01:03:54.765195+0000","last_became_active":"2024-09-12T00:21:50.565753+0000","last_became_peered":"2024-09-12T00:21:50.565753+0000","last_unstale":"2024-09-12T01:03:54.765195+0000","last_undegraded":"2024-09-12T01:03:54.765195+0000","last_fullsized":"2024-09-12T01:03:54.765195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:49.492114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.980755+0000","last_change":"2024-09-12T00:21:52.565618+0000","last_active":"2024-09-12T01:05:39.980755+0000","last_peered":"2024-09-12T01:05:39.980755+0000","last_clean":"2024-09-12T01:05:39.980755+0000","last_became_active":"2024-09-12T00:21:52.559213+0000","last_became_peered":"2024-09-12T00:21:52.559213+0000","last_unstale":"2024-09-12T01:05:39.980755+0000","last_undegraded":"2024-09-12T01:05:39.980755+0000","last_fullsized":"2024-09-12T01:05:39.980755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.549214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":329,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'146","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.117283+0000","last_change":"2024-09-12T00:21:44.508192+0000","last_active":"2024-09-12T01:05:42.117283+0000","last_peered":"2024-09-12T01:05:42.117283+0000","last_clean":"2024-09-12T01:05:42.117283+0000","last_became_active":"2024-09-12T00:21:44.507460+0000","last_became_peered":"2024-09-12T00:21:44.507460+0000","last_unstale":"2024-09-12T01:05:42.117283+0000","last_undegraded":"2024-09-12T01:05:42.117283+0000","last_fullsized":"2024-09-12T01:05:42.117283+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:54.113624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":507,"num_write":216,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'276","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.370911+0000","last_change":"2024-09-12T00:21:42.520089+0000","last_active":"2024-09-12T01:04:18.370911+0000","last_peered":"2024-09-12T01:04:18.370911+0000","last_clean":"2024-09-12T01:04:18.370911+0000","last_became_active":"2024-09-12T00:21:42.517333+0000","last_became_peered":"2024-09-12T00:21:42.517333+0000","last_unstale":"2024-09-12T01:04:18.370911+0000","last_undegraded":"2024-09-12T01:04:18.370911+0000","last_fullsized":"2024-09-12T01:04:18.370911+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.752943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14478325,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":375,"num_read_kb":50264,"num_write":980,"num_write_kb":41560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618453+0000","last_change":"2024-09-12T00:21:46.502471+0000","last_active":"2024-09-12T01:03:49.618453+0000","last_peered":"2024-09-12T01:03:49.618453+0000","last_clean":"2024-09-12T01:03:49.618453+0000","last_became_active":"2024-09-12T00:21:46.501673+0000","last_became_peered":"2024-09-12T00:21:46.501673+0000","last_unstale":"2024-09-12T01:03:49.618453+0000","last_undegraded":"2024-09-12T01:03:49.618453+0000","last_fullsized":"2024-09-12T01:03:49.618453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'268","reported_seq":833,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:09.614123+0000","last_change":"2024-09-12T00:21:48.538585+0000","last_active":"2024-09-12T01:06:09.614123+0000","last_peered":"2024-09-12T01:06:09.614123+0000","last_clean":"2024-09-12T01:06:09.614123+0000","last_became_active":"2024-09-12T00:21:48.537864+0000","last_became_peered":"2024-09-12T00:21:48.537864+0000","last_unstale":"2024-09-12T01:06:09.614123+0000","last_undegraded":"2024-09-12T01:06:09.614123+0000","last_fullsized":"2024-09-12T01:06:09.614123+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:33.610420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58259,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":936,"num_write":366,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581973+0000","last_change":"2024-09-12T00:21:50.561361+0000","last_active":"2024-09-12T01:03:53.581973+0000","last_peered":"2024-09-12T01:03:53.581973+0000","last_clean":"2024-09-12T01:03:53.581973+0000","last_became_active":"2024-09-12T00:21:50.560805+0000","last_became_peered":"2024-09-12T00:21:50.560805+0000","last_unstale":"2024-09-12T01:03:53.581973+0000","last_undegraded":"2024-09-12T01:03:53.581973+0000","last_fullsized":"2024-09-12T01:03:53.581973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:00.373479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'385","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.779861+0000","last_change":"2024-09-12T00:21:44.516768+0000","last_active":"2024-09-12T01:04:59.779861+0000","last_peered":"2024-09-12T01:04:59.779861+0000","last_clean":"2024-09-12T01:04:59.779861+0000","last_became_active":"2024-09-12T00:21:44.516321+0000","last_became_peered":"2024-09-12T00:21:44.516321+0000","last_unstale":"2024-09-12T01:04:59.779861+0000","last_undegraded":"2024-09-12T01:04:59.779861+0000","last_fullsized":"2024-09-12T01:04:59.779861+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:16.398087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1787,"num_read_kb":1547,"num_write":658,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'271","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.971040+0000","last_change":"2024-09-12T00:22:13.520852+0000","last_active":"2024-09-12T01:03:13.971040+0000","last_peered":"2024-09-12T01:03:13.971040+0000","last_clean":"2024-09-12T01:03:13.971040+0000","last_became_active":"2024-09-12T00:22:13.519954+0000","last_became_peered":"2024-09-12T00:22:13.519954+0000","last_unstale":"2024-09-12T01:03:13.971040+0000","last_undegraded":"2024-09-12T01:03:13.971040+0000","last_fullsized":"2024-09-12T01:03:13.971040+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:59.772753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6272573,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":412,"num_read_kb":32939,"num_write":1035,"num_write_kb":17030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.579239+0000","last_change":"2024-09-12T00:21:46.504485+0000","last_active":"2024-09-12T01:03:59.579239+0000","last_peered":"2024-09-12T01:03:59.579239+0000","last_clean":"2024-09-12T01:03:59.579239+0000","last_became_active":"2024-09-12T00:21:46.503646+0000","last_became_peered":"2024-09-12T00:21:46.503646+0000","last_unstale":"2024-09-12T01:03:59.579239+0000","last_undegraded":"2024-09-12T01:03:59.579239+0000","last_fullsized":"2024-09-12T01:03:59.579239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:24.062861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'512","reported_seq":1133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.804264+0000","last_change":"2024-09-12T00:21:48.548531+0000","last_active":"2024-09-12T01:07:12.804264+0000","last_peered":"2024-09-12T01:07:12.804264+0000","last_clean":"2024-09-12T01:07:12.804264+0000","last_became_active":"2024-09-12T00:21:48.547827+0000","last_became_peered":"2024-09-12T00:21:48.547827+0000","last_unstale":"2024-09-12T01:07:12.804264+0000","last_undegraded":"2024-09-12T01:07:12.804264+0000","last_fullsized":"2024-09-12T01:07:12.804264+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136620,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":930,"num_read_kb":2049,"num_write":822,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.751771+0000","last_change":"2024-09-12T00:21:50.554994+0000","last_active":"2024-09-12T01:04:24.751771+0000","last_peered":"2024-09-12T01:04:24.751771+0000","last_clean":"2024-09-12T01:04:24.751771+0000","last_became_active":"2024-09-12T00:21:50.554194+0000","last_became_peered":"2024-09-12T00:21:50.554194+0000","last_unstale":"2024-09-12T01:04:24.751771+0000","last_undegraded":"2024-09-12T01:04:24.751771+0000","last_fullsized":"2024-09-12T01:04:24.751771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.351737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'158","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.556466+0000","last_change":"2024-09-12T00:21:52.558812+0000","last_active":"2024-09-12T01:06:06.556466+0000","last_peered":"2024-09-12T01:06:06.556466+0000","last_clean":"2024-09-12T01:06:06.556466+0000","last_became_active":"2024-09-12T00:21:52.558070+0000","last_became_peered":"2024-09-12T00:21:52.558070+0000","last_unstale":"2024-09-12T01:06:06.556466+0000","last_undegraded":"2024-09-12T01:06:06.556466+0000","last_fullsized":"2024-09-12T01:06:06.556466+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:23.383768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":234,"num_write":361,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'83","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.789441+0000","last_change":"2024-09-12T00:21:44.502471+0000","last_active":"2024-09-12T01:03:54.789441+0000","last_peered":"2024-09-12T01:03:54.789441+0000","last_clean":"2024-09-12T01:03:54.789441+0000","last_became_active":"2024-09-12T00:21:44.501836+0000","last_became_peered":"2024-09-12T00:21:44.501836+0000","last_unstale":"2024-09-12T01:03:54.789441+0000","last_undegraded":"2024-09-12T01:03:54.789441+0000","last_fullsized":"2024-09-12T01:03:54.789441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:34.189402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":399,"num_read_kb":345,"num_write":130,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'247","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.025681+0000","last_change":"2024-09-12T00:21:42.497979+0000","last_active":"2024-09-12T01:06:03.025681+0000","last_peered":"2024-09-12T01:06:03.025681+0000","last_clean":"2024-09-12T01:06:03.025681+0000","last_became_active":"2024-09-12T00:21:42.496837+0000","last_became_peered":"2024-09-12T00:21:42.496837+0000","last_unstale":"2024-09-12T01:06:03.025681+0000","last_undegraded":"2024-09-12T01:06:03.025681+0000","last_fullsized":"2024-09-12T01:06:03.025681+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4841815,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":295,"num_read_kb":1485,"num_write":833,"num_write_kb":29678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.738284+0000","last_change":"2024-09-12T00:21:46.499289+0000","last_active":"2024-09-12T01:03:29.738284+0000","last_peered":"2024-09-12T01:03:29.738284+0000","last_clean":"2024-09-12T01:03:29.738284+0000","last_became_active":"2024-09-12T00:21:46.498517+0000","last_became_peered":"2024-09-12T00:21:46.498517+0000","last_unstale":"2024-09-12T01:03:29.738284+0000","last_undegraded":"2024-09-12T01:03:29.738284+0000","last_fullsized":"2024-09-12T01:03:29.738284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:50.960412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'295","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.420278+0000","last_change":"2024-09-12T00:21:48.539854+0000","last_active":"2024-09-12T01:06:49.420278+0000","last_peered":"2024-09-12T01:06:49.420278+0000","last_clean":"2024-09-12T01:06:49.420278+0000","last_became_active":"2024-09-12T00:21:48.539419+0000","last_became_peered":"2024-09-12T00:21:48.539419+0000","last_unstale":"2024-09-12T01:06:49.420278+0000","last_undegraded":"2024-09-12T01:06:49.420278+0000","last_fullsized":"2024-09-12T01:06:49.420278+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:42.243175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1025,"num_write":422,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.608749+0000","last_change":"2024-09-12T00:21:50.565460+0000","last_active":"2024-09-12T01:04:24.608749+0000","last_peered":"2024-09-12T01:04:24.608749+0000","last_clean":"2024-09-12T01:04:24.608749+0000","last_became_active":"2024-09-12T00:21:50.564610+0000","last_became_peered":"2024-09-12T00:21:50.564610+0000","last_unstale":"2024-09-12T01:04:24.608749+0000","last_undegraded":"2024-09-12T01:04:24.608749+0000","last_fullsized":"2024-09-12T01:04:24.608749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'152","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.192650+0000","last_change":"2024-09-12T00:21:52.560731+0000","last_active":"2024-09-12T01:05:01.192650+0000","last_peered":"2024-09-12T01:05:01.192650+0000","last_clean":"2024-09-12T01:05:01.192650+0000","last_became_active":"2024-09-12T00:21:52.559989+0000","last_became_peered":"2024-09-12T00:21:52.559989+0000","last_unstale":"2024-09-12T01:05:01.192650+0000","last_undegraded":"2024-09-12T01:05:01.192650+0000","last_fullsized":"2024-09-12T01:05:01.192650+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.302197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":167,"num_write":448,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'180","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.587709+0000","last_change":"2024-09-12T00:21:44.515569+0000","last_active":"2024-09-12T01:04:18.587709+0000","last_peered":"2024-09-12T01:04:18.587709+0000","last_clean":"2024-09-12T01:04:18.587709+0000","last_became_active":"2024-09-12T00:21:44.515059+0000","last_became_peered":"2024-09-12T00:21:44.515059+0000","last_unstale":"2024-09-12T01:04:18.587709+0000","last_undegraded":"2024-09-12T01:04:18.587709+0000","last_fullsized":"2024-09-12T01:04:18.587709+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.436679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":674,"num_write":306,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'261","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.713210+0000","last_change":"2024-09-12T00:21:42.528216+0000","last_active":"2024-09-12T01:05:45.713210+0000","last_peered":"2024-09-12T01:05:45.713210+0000","last_clean":"2024-09-12T01:05:45.713210+0000","last_became_active":"2024-09-12T00:21:42.527838+0000","last_became_peered":"2024-09-12T00:21:42.527838+0000","last_unstale":"2024-09-12T01:05:45.713210+0000","last_undegraded":"2024-09-12T01:05:45.713210+0000","last_fullsized":"2024-09-12T01:05:45.713210+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:49.488680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3596652,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":446,"num_read_kb":57947,"num_write":959,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.750536+0000","last_change":"2024-09-12T00:21:46.487430+0000","last_active":"2024-09-12T01:04:19.750536+0000","last_peered":"2024-09-12T01:04:19.750536+0000","last_clean":"2024-09-12T01:04:19.750536+0000","last_became_active":"2024-09-12T00:21:46.486768+0000","last_became_peered":"2024-09-12T00:21:46.486768+0000","last_unstale":"2024-09-12T01:04:19.750536+0000","last_undegraded":"2024-09-12T01:04:19.750536+0000","last_fullsized":"2024-09-12T01:04:19.750536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:46.811644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'286","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.599971+0000","last_change":"2024-09-12T00:21:48.546553+0000","last_active":"2024-09-12T01:05:34.599971+0000","last_peered":"2024-09-12T01:05:34.599971+0000","last_clean":"2024-09-12T01:05:34.599971+0000","last_became_active":"2024-09-12T00:21:48.545589+0000","last_became_peered":"2024-09-12T00:21:48.545589+0000","last_unstale":"2024-09-12T01:05:34.599971+0000","last_undegraded":"2024-09-12T01:05:34.599971+0000","last_fullsized":"2024-09-12T01:05:34.599971+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:05.509631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":970,"num_write":392,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.584221+0000","last_change":"2024-09-12T00:21:50.557751+0000","last_active":"2024-09-12T01:04:03.584221+0000","last_peered":"2024-09-12T01:04:03.584221+0000","last_clean":"2024-09-12T01:04:03.584221+0000","last_became_active":"2024-09-12T00:21:50.556333+0000","last_became_peered":"2024-09-12T00:21:50.556333+0000","last_unstale":"2024-09-12T01:04:03.584221+0000","last_undegraded":"2024-09-12T01:04:03.584221+0000","last_fullsized":"2024-09-12T01:04:03.584221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.592627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'204","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.864522+0000","last_change":"2024-09-12T00:21:52.566691+0000","last_active":"2024-09-12T01:07:12.864522+0000","last_peered":"2024-09-12T01:07:12.864522+0000","last_clean":"2024-09-12T01:07:12.864522+0000","last_became_active":"2024-09-12T00:21:52.565109+0000","last_became_peered":"2024-09-12T00:21:52.565109+0000","last_unstale":"2024-09-12T01:07:12.864522+0000","last_undegraded":"2024-09-12T01:07:12.864522+0000","last_fullsized":"2024-09-12T01:07:12.864522+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:52.766859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'131","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.241463+0000","last_change":"2024-09-12T00:21:44.489287+0000","last_active":"2024-09-12T01:05:45.241463+0000","last_peered":"2024-09-12T01:05:45.241463+0000","last_clean":"2024-09-12T01:05:45.241463+0000","last_became_active":"2024-09-12T00:21:44.488546+0000","last_became_peered":"2024-09-12T00:21:44.488546+0000","last_unstale":"2024-09-12T01:05:45.241463+0000","last_undegraded":"2024-09-12T01:05:45.241463+0000","last_fullsized":"2024-09-12T01:05:45.241463+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:32.061615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":436,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'281","reported_seq":904,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.103263+0000","last_change":"2024-09-12T00:21:42.514641+0000","last_active":"2024-09-12T01:04:57.103263+0000","last_peered":"2024-09-12T01:04:57.103263+0000","last_clean":"2024-09-12T01:04:57.103263+0000","last_became_active":"2024-09-12T00:21:42.513837+0000","last_became_peered":"2024-09-12T00:21:42.513837+0000","last_unstale":"2024-09-12T01:04:57.103263+0000","last_undegraded":"2024-09-12T01:04:57.103263+0000","last_fullsized":"2024-09-12T01:04:57.103263+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:59.737503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6712997,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":371,"num_read_kb":19207,"num_write":962,"num_write_kb":45165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.580850+0000","last_change":"2024-09-12T00:21:46.493177+0000","last_active":"2024-09-12T01:04:19.580850+0000","last_peered":"2024-09-12T01:04:19.580850+0000","last_clean":"2024-09-12T01:04:19.580850+0000","last_became_active":"2024-09-12T00:21:46.492502+0000","last_became_peered":"2024-09-12T00:21:46.492502+0000","last_unstale":"2024-09-12T01:04:19.580850+0000","last_undegraded":"2024-09-12T01:04:19.580850+0000","last_fullsized":"2024-09-12T01:04:19.580850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:29.059786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'96","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:59.651411+0000","last_change":"2024-09-12T00:21:48.548949+0000","last_active":"2024-09-12T01:05:59.651411+0000","last_peered":"2024-09-12T01:05:59.651411+0000","last_clean":"2024-09-12T01:05:59.651411+0000","last_became_active":"2024-09-12T00:21:48.544915+0000","last_became_peered":"2024-09-12T00:21:48.544915+0000","last_unstale":"2024-09-12T01:05:59.651411+0000","last_undegraded":"2024-09-12T01:05:59.651411+0000","last_fullsized":"2024-09-12T01:05:59.651411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:44.234342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":128,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'777","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947295+0000","last_change":"2024-09-12T00:21:50.550332+0000","last_active":"2024-09-12T01:07:12.947295+0000","last_peered":"2024-09-12T01:07:12.947295+0000","last_clean":"2024-09-12T01:07:12.947295+0000","last_became_active":"2024-09-12T00:21:50.549552+0000","last_became_peered":"2024-09-12T00:21:50.549552+0000","last_unstale":"2024-09-12T01:07:12.947295+0000","last_undegraded":"2024-09-12T01:07:12.947295+0000","last_fullsized":"2024-09-12T01:07:12.947295+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:44.130994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'170","reported_seq":686,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.303926+0000","last_change":"2024-09-12T00:21:52.566510+0000","last_active":"2024-09-12T01:05:46.303926+0000","last_peered":"2024-09-12T01:05:46.303926+0000","last_clean":"2024-09-12T01:05:46.303926+0000","last_became_active":"2024-09-12T00:21:52.565872+0000","last_became_peered":"2024-09-12T00:21:52.565872+0000","last_unstale":"2024-09-12T01:05:46.303926+0000","last_undegraded":"2024-09-12T01:05:46.303926+0000","last_fullsized":"2024-09-12T01:05:46.303926+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:54.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":199,"num_write":407,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'4284","reported_seq":4939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749378+0000","last_change":"2024-09-12T00:21:44.521635+0000","last_active":"2024-09-12T01:04:14.749378+0000","last_peered":"2024-09-12T01:04:14.749378+0000","last_clean":"2024-09-12T01:04:14.749378+0000","last_became_active":"2024-09-12T00:21:44.521310+0000","last_became_peered":"2024-09-12T00:21:44.521310+0000","last_unstale":"2024-09-12T01:04:14.749378+0000","last_undegraded":"2024-09-12T01:04:14.749378+0000","last_fullsized":"2024-09-12T01:04:14.749378+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":3000,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:18.886376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17290,"num_read_kb":14479,"num_write":6455,"num_write_kb":3215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'335","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.350057+0000","last_change":"2024-09-12T00:21:42.508020+0000","last_active":"2024-09-12T01:07:11.350057+0000","last_peered":"2024-09-12T01:07:11.350057+0000","last_clean":"2024-09-12T01:07:11.350057+0000","last_became_active":"2024-09-12T00:21:42.507712+0000","last_became_peered":"2024-09-12T00:21:42.507712+0000","last_unstale":"2024-09-12T01:07:11.350057+0000","last_undegraded":"2024-09-12T01:07:11.350057+0000","last_fullsized":"2024-09-12T01:07:11.350057+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:04.367696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11806959,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":540,"num_read_kb":35216,"num_write":1267,"num_write_kb":36033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.770689+0000","last_change":"2024-09-12T00:21:46.514629+0000","last_active":"2024-09-12T01:04:19.770689+0000","last_peered":"2024-09-12T01:04:19.770689+0000","last_clean":"2024-09-12T01:04:19.770689+0000","last_became_active":"2024-09-12T00:21:46.514146+0000","last_became_peered":"2024-09-12T00:21:46.514146+0000","last_unstale":"2024-09-12T01:04:19.770689+0000","last_undegraded":"2024-09-12T01:04:19.770689+0000","last_fullsized":"2024-09-12T01:04:19.770689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:04.796502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'326","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.604419+0000","last_change":"2024-09-12T00:21:48.545059+0000","last_active":"2024-09-12T01:05:29.604419+0000","last_peered":"2024-09-12T01:05:29.604419+0000","last_clean":"2024-09-12T01:05:29.604419+0000","last_became_active":"2024-09-12T00:21:48.543993+0000","last_became_peered":"2024-09-12T00:21:48.543993+0000","last_unstale":"2024-09-12T01:05:29.604419+0000","last_undegraded":"2024-09-12T01:05:29.604419+0000","last_fullsized":"2024-09-12T01:05:29.604419+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:00.172691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65257,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1041,"num_write":434,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.563509+0000","last_change":"2024-09-12T00:21:50.526640+0000","last_active":"2024-09-12T01:02:59.563509+0000","last_peered":"2024-09-12T01:02:59.563509+0000","last_clean":"2024-09-12T01:02:59.563509+0000","last_became_active":"2024-09-12T00:21:50.525885+0000","last_became_peered":"2024-09-12T00:21:50.525885+0000","last_unstale":"2024-09-12T01:02:59.563509+0000","last_undegraded":"2024-09-12T01:02:59.563509+0000","last_fullsized":"2024-09-12T01:02:59.563509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.636381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'113","reported_seq":614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.083293+0000","last_change":"2024-09-12T00:21:52.560445+0000","last_active":"2024-09-12T01:05:30.083293+0000","last_peered":"2024-09-12T01:05:30.083293+0000","last_clean":"2024-09-12T01:05:30.083293+0000","last_became_active":"2024-09-12T00:21:52.559361+0000","last_became_peered":"2024-09-12T00:21:52.559361+0000","last_unstale":"2024-09-12T01:05:30.083293+0000","last_undegraded":"2024-09-12T01:05:30.083293+0000","last_fullsized":"2024-09-12T01:05:30.083293+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:30.798988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":266,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'251","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.931531+0000","last_change":"2024-09-12T00:21:44.486385+0000","last_active":"2024-09-12T01:04:34.931531+0000","last_peered":"2024-09-12T01:04:34.931531+0000","last_clean":"2024-09-12T01:04:34.931531+0000","last_became_active":"2024-09-12T00:21:44.486014+0000","last_became_peered":"2024-09-12T00:21:44.486014+0000","last_unstale":"2024-09-12T01:04:34.931531+0000","last_undegraded":"2024-09-12T01:04:34.931531+0000","last_fullsized":"2024-09-12T01:04:34.931531+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:04.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1098,"num_read_kb":899,"num_write":369,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'260","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:50.634477+0000","last_change":"2024-09-12T00:21:42.492181+0000","last_active":"2024-09-12T01:05:50.634477+0000","last_peered":"2024-09-12T01:05:50.634477+0000","last_clean":"2024-09-12T01:05:50.634477+0000","last_became_active":"2024-09-12T00:21:42.491757+0000","last_became_peered":"2024-09-12T00:21:42.491757+0000","last_unstale":"2024-09-12T01:05:50.634477+0000","last_undegraded":"2024-09-12T01:05:50.634477+0000","last_fullsized":"2024-09-12T01:05:50.634477+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:19.920075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389249,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":402,"num_read_kb":76220,"num_write":982,"num_write_kb":46746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.750467+0000","last_change":"2024-09-12T00:21:46.503909+0000","last_active":"2024-09-12T01:04:19.750467+0000","last_peered":"2024-09-12T01:04:19.750467+0000","last_clean":"2024-09-12T01:04:19.750467+0000","last_became_active":"2024-09-12T00:21:46.503203+0000","last_became_peered":"2024-09-12T00:21:46.503203+0000","last_unstale":"2024-09-12T01:04:19.750467+0000","last_undegraded":"2024-09-12T01:04:19.750467+0000","last_fullsized":"2024-09-12T01:04:19.750467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:04.494436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'279","reported_seq":846,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594577+0000","last_change":"2024-09-12T00:21:48.537800+0000","last_active":"2024-09-12T01:05:19.594577+0000","last_peered":"2024-09-12T01:05:19.594577+0000","last_clean":"2024-09-12T01:05:19.594577+0000","last_became_active":"2024-09-12T00:21:48.536841+0000","last_became_peered":"2024-09-12T00:21:48.536841+0000","last_unstale":"2024-09-12T01:05:19.594577+0000","last_undegraded":"2024-09-12T01:05:19.594577+0000","last_fullsized":"2024-09-12T01:05:19.594577+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:36.935321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":984,"num_write":384,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.608163+0000","last_change":"2024-09-12T00:21:50.541922+0000","last_active":"2024-09-12T01:03:09.608163+0000","last_peered":"2024-09-12T01:03:09.608163+0000","last_clean":"2024-09-12T01:03:09.608163+0000","last_became_active":"2024-09-12T00:21:50.538041+0000","last_became_peered":"2024-09-12T00:21:50.538041+0000","last_unstale":"2024-09-12T01:03:09.608163+0000","last_undegraded":"2024-09-12T01:03:09.608163+0000","last_fullsized":"2024-09-12T01:03:09.608163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:16.216296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'125","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.684858+0000","last_change":"2024-09-12T00:21:52.564384+0000","last_active":"2024-09-12T01:05:19.684858+0000","last_peered":"2024-09-12T01:05:19.684858+0000","last_clean":"2024-09-12T01:05:19.684858+0000","last_became_active":"2024-09-12T00:21:52.560366+0000","last_became_peered":"2024-09-12T00:21:52.560366+0000","last_unstale":"2024-09-12T01:05:19.684858+0000","last_undegraded":"2024-09-12T01:05:19.684858+0000","last_fullsized":"2024-09-12T01:05:19.684858+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:27.682015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":163,"num_read_kb":157,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'212","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.678629+0000","last_change":"2024-09-12T00:21:44.513724+0000","last_active":"2024-09-12T01:04:47.678629+0000","last_peered":"2024-09-12T01:04:47.678629+0000","last_clean":"2024-09-12T01:04:47.678629+0000","last_became_active":"2024-09-12T00:21:44.512917+0000","last_became_peered":"2024-09-12T00:21:44.512917+0000","last_unstale":"2024-09-12T01:04:47.678629+0000","last_undegraded":"2024-09-12T01:04:47.678629+0000","last_fullsized":"2024-09-12T01:04:47.678629+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:10.484566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":716,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'308","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.625978+0000","last_change":"2024-09-12T00:21:42.517480+0000","last_active":"2024-09-12T01:05:51.625978+0000","last_peered":"2024-09-12T01:05:51.625978+0000","last_clean":"2024-09-12T01:05:51.625978+0000","last_became_active":"2024-09-12T00:21:42.516419+0000","last_became_peered":"2024-09-12T00:21:42.516419+0000","last_unstale":"2024-09-12T01:05:51.625978+0000","last_undegraded":"2024-09-12T01:05:51.625978+0000","last_fullsized":"2024-09-12T01:05:51.625978+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:55.919056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16419298,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":551,"num_read_kb":12934,"num_write":1185,"num_write_kb":32784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.750311+0000","last_change":"2024-09-12T00:21:46.504336+0000","last_active":"2024-09-12T01:02:54.750311+0000","last_peered":"2024-09-12T01:02:54.750311+0000","last_clean":"2024-09-12T01:02:54.750311+0000","last_became_active":"2024-09-12T00:21:46.503747+0000","last_became_peered":"2024-09-12T00:21:46.503747+0000","last_unstale":"2024-09-12T01:02:54.750311+0000","last_undegraded":"2024-09-12T01:02:54.750311+0000","last_fullsized":"2024-09-12T01:02:54.750311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:49.256627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'239","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.423033+0000","last_change":"2024-09-12T00:21:48.547112+0000","last_active":"2024-09-12T01:06:49.423033+0000","last_peered":"2024-09-12T01:06:49.423033+0000","last_clean":"2024-09-12T01:06:49.423033+0000","last_became_active":"2024-09-12T00:21:48.546392+0000","last_became_peered":"2024-09-12T00:21:48.546392+0000","last_unstale":"2024-09-12T01:06:49.423033+0000","last_undegraded":"2024-09-12T01:06:49.423033+0000","last_fullsized":"2024-09-12T01:06:49.423033+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:06.500945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":822,"num_write":306,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.627760+0000","last_change":"2024-09-12T00:21:50.549326+0000","last_active":"2024-09-12T01:04:24.627760+0000","last_peered":"2024-09-12T01:04:24.627760+0000","last_clean":"2024-09-12T01:04:24.627760+0000","last_became_active":"2024-09-12T00:21:50.548527+0000","last_became_peered":"2024-09-12T00:21:50.548527+0000","last_unstale":"2024-09-12T01:04:24.627760+0000","last_undegraded":"2024-09-12T01:04:24.627760+0000","last_fullsized":"2024-09-12T01:04:24.627760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:37.290906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'193","reported_seq":1701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.596270+0000","last_change":"2024-09-12T00:21:52.569731+0000","last_active":"2024-09-12T01:06:04.596270+0000","last_peered":"2024-09-12T01:06:04.596270+0000","last_clean":"2024-09-12T01:06:04.596270+0000","last_became_active":"2024-09-12T00:21:52.559360+0000","last_became_peered":"2024-09-12T00:21:52.559360+0000","last_unstale":"2024-09-12T01:06:04.596270+0000","last_undegraded":"2024-09-12T01:06:04.596270+0000","last_fullsized":"2024-09-12T01:06:04.596270+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:25.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1316,"num_write":423,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'81","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.145312+0000","last_change":"2024-09-12T00:21:44.485574+0000","last_active":"2024-09-12T01:04:56.145312+0000","last_peered":"2024-09-12T01:04:56.145312+0000","last_clean":"2024-09-12T01:04:56.145312+0000","last_became_active":"2024-09-12T00:21:44.485278+0000","last_became_peered":"2024-09-12T00:21:44.485278+0000","last_unstale":"2024-09-12T01:04:56.145312+0000","last_undegraded":"2024-09-12T01:04:56.145312+0000","last_fullsized":"2024-09-12T01:04:56.145312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:13.977255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":295,"num_write":139,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'261","reported_seq":895,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:22.470850+0000","last_change":"2024-09-12T00:21:42.524712+0000","last_active":"2024-09-12T01:04:22.470850+0000","last_peered":"2024-09-12T01:04:22.470850+0000","last_clean":"2024-09-12T01:04:22.470850+0000","last_became_active":"2024-09-12T00:21:42.520276+0000","last_became_peered":"2024-09-12T00:21:42.520276+0000","last_unstale":"2024-09-12T01:04:22.470850+0000","last_undegraded":"2024-09-12T01:04:22.470850+0000","last_fullsized":"2024-09-12T01:04:22.470850+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:35.769781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488903,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":405,"num_read_kb":35265,"num_write":964,"num_write_kb":28370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":975,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.723471+0000","last_change":"2024-09-12T00:21:46.495855+0000","last_active":"2024-09-12T01:07:12.723471+0000","last_peered":"2024-09-12T01:07:12.723471+0000","last_clean":"2024-09-12T01:07:12.723471+0000","last_became_active":"2024-09-12T00:21:46.495088+0000","last_became_peered":"2024-09-12T00:21:46.495088+0000","last_unstale":"2024-09-12T01:07:12.723471+0000","last_undegraded":"2024-09-12T01:07:12.723471+0000","last_fullsized":"2024-09-12T01:07:12.723471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:27.176611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'322","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:49.420157+0000","last_change":"2024-09-12T00:21:48.551157+0000","last_active":"2024-09-12T01:06:49.420157+0000","last_peered":"2024-09-12T01:06:49.420157+0000","last_clean":"2024-09-12T01:06:49.420157+0000","last_became_active":"2024-09-12T00:21:48.550441+0000","last_became_peered":"2024-09-12T00:21:48.550441+0000","last_unstale":"2024-09-12T01:06:49.420157+0000","last_undegraded":"2024-09-12T01:06:49.420157+0000","last_fullsized":"2024-09-12T01:06:49.420157+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:58.154347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1076,"num_write":438,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.581974+0000","last_change":"2024-09-12T00:21:50.566647+0000","last_active":"2024-09-12T01:04:24.581974+0000","last_peered":"2024-09-12T01:04:24.581974+0000","last_clean":"2024-09-12T01:04:24.581974+0000","last_became_active":"2024-09-12T00:21:50.565955+0000","last_became_peered":"2024-09-12T00:21:50.565955+0000","last_unstale":"2024-09-12T01:04:24.581974+0000","last_undegraded":"2024-09-12T01:04:24.581974+0000","last_fullsized":"2024-09-12T01:04:24.581974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:37.311871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'131","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.963224+0000","last_change":"2024-09-12T00:21:52.549770+0000","last_active":"2024-09-12T01:07:11.963224+0000","last_peered":"2024-09-12T01:07:11.963224+0000","last_clean":"2024-09-12T01:07:11.963224+0000","last_became_active":"2024-09-12T00:21:52.549080+0000","last_became_peered":"2024-09-12T00:21:52.549080+0000","last_unstale":"2024-09-12T01:07:11.963224+0000","last_undegraded":"2024-09-12T01:07:11.963224+0000","last_fullsized":"2024-09-12T01:07:11.963224+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.186294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'77","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.591355+0000","last_change":"2024-09-12T00:21:44.495955+0000","last_active":"2024-09-12T01:05:04.591355+0000","last_peered":"2024-09-12T01:05:04.591355+0000","last_clean":"2024-09-12T01:05:04.591355+0000","last_became_active":"2024-09-12T00:21:44.495122+0000","last_became_peered":"2024-09-12T00:21:44.495122+0000","last_unstale":"2024-09-12T01:05:04.591355+0000","last_undegraded":"2024-09-12T01:05:04.591355+0000","last_fullsized":"2024-09-12T01:05:04.591355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:03.274312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":290,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'290","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.545818+0000","last_change":"2024-09-12T00:21:42.492687+0000","last_active":"2024-09-12T01:05:28.545818+0000","last_peered":"2024-09-12T01:05:28.545818+0000","last_clean":"2024-09-12T01:05:28.545818+0000","last_became_active":"2024-09-12T00:21:42.492358+0000","last_became_peered":"2024-09-12T00:21:42.492358+0000","last_unstale":"2024-09-12T01:05:28.545818+0000","last_undegraded":"2024-09-12T01:05:28.545818+0000","last_fullsized":"2024-09-12T01:05:28.545818+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:04.601338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4782119,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":506,"num_read_kb":28331,"num_write":1111,"num_write_kb":34411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'258","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.198362+0000","last_change":"2024-09-12T00:21:44.518405+0000","last_active":"2024-09-12T01:05:20.198362+0000","last_peered":"2024-09-12T01:05:20.198362+0000","last_clean":"2024-09-12T01:05:20.198362+0000","last_became_active":"2024-09-12T00:21:44.515839+0000","last_became_peered":"2024-09-12T00:21:44.515839+0000","last_unstale":"2024-09-12T01:05:20.198362+0000","last_undegraded":"2024-09-12T01:05:20.198362+0000","last_fullsized":"2024-09-12T01:05:20.198362+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:06.067490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":1036,"num_write":423,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'449","reported_seq":1152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.665453+0000","last_change":"2024-09-12T00:21:42.503380+0000","last_active":"2024-09-12T01:07:27.665453+0000","last_peered":"2024-09-12T01:07:27.665453+0000","last_clean":"2024-09-12T01:07:27.665453+0000","last_became_active":"2024-09-12T00:21:42.502396+0000","last_became_peered":"2024-09-12T00:21:42.502396+0000","last_unstale":"2024-09-12T01:07:27.665453+0000","last_undegraded":"2024-09-12T01:07:27.665453+0000","last_fullsized":"2024-09-12T01:07:27.665453+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:34.541877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607324,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":742,"num_read_kb":17888,"num_write":1520,"num_write_kb":31183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'183","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.638098+0000","last_change":"2024-09-12T00:21:44.500052+0000","last_active":"2024-09-12T01:05:04.638098+0000","last_peered":"2024-09-12T01:05:04.638098+0000","last_clean":"2024-09-12T01:05:04.638098+0000","last_became_active":"2024-09-12T00:21:44.499805+0000","last_became_peered":"2024-09-12T00:21:44.499805+0000","last_unstale":"2024-09-12T01:05:04.638098+0000","last_undegraded":"2024-09-12T01:05:04.638098+0000","last_fullsized":"2024-09-12T01:05:04.638098+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:04.496825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":613,"num_write":283,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'399","reported_seq":1142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.017382+0000","last_change":"2024-09-12T00:21:42.519251+0000","last_active":"2024-09-12T01:06:03.017382+0000","last_peered":"2024-09-12T01:06:03.017382+0000","last_clean":"2024-09-12T01:06:03.017382+0000","last_became_active":"2024-09-12T00:21:42.518823+0000","last_became_peered":"2024-09-12T00:21:42.518823+0000","last_unstale":"2024-09-12T01:06:03.017382+0000","last_undegraded":"2024-09-12T01:06:03.017382+0000","last_fullsized":"2024-09-12T01:06:03.017382+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:20.503872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972276,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":898,"num_read_kb":24368,"num_write":1426,"num_write_kb":48727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'183","reported_seq":794,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.618714+0000","last_change":"2024-09-12T00:21:44.511626+0000","last_active":"2024-09-12T01:05:04.618714+0000","last_peered":"2024-09-12T01:05:04.618714+0000","last_clean":"2024-09-12T01:05:04.618714+0000","last_became_active":"2024-09-12T00:21:44.510818+0000","last_became_peered":"2024-09-12T00:21:44.510818+0000","last_unstale":"2024-09-12T01:05:04.618714+0000","last_undegraded":"2024-09-12T01:05:04.618714+0000","last_fullsized":"2024-09-12T01:05:04.618714+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:52.353228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":671,"num_write":265,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'280","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.208287+0000","last_change":"2024-09-12T00:21:42.526241+0000","last_active":"2024-09-12T01:05:19.208287+0000","last_peered":"2024-09-12T01:05:19.208287+0000","last_clean":"2024-09-12T01:05:19.208287+0000","last_became_active":"2024-09-12T00:21:42.525233+0000","last_became_peered":"2024-09-12T00:21:42.525233+0000","last_unstale":"2024-09-12T01:05:19.208287+0000","last_undegraded":"2024-09-12T01:05:19.208287+0000","last_fullsized":"2024-09-12T01:05:19.208287+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:21.684315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12271764,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":774,"num_read_kb":20384,"num_write":993,"num_write_kb":42665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'183","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.832023+0000","last_change":"2024-09-12T00:21:44.524491+0000","last_active":"2024-09-12T01:04:45.832023+0000","last_peered":"2024-09-12T01:04:45.832023+0000","last_clean":"2024-09-12T01:04:45.832023+0000","last_became_active":"2024-09-12T00:21:44.523632+0000","last_became_peered":"2024-09-12T00:21:44.523632+0000","last_unstale":"2024-09-12T01:04:45.832023+0000","last_undegraded":"2024-09-12T01:04:45.832023+0000","last_fullsized":"2024-09-12T01:04:45.832023+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:53.560876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":821,"num_read_kb":680,"num_write":294,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'325","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.844190+0000","last_change":"2024-09-12T00:21:42.504025+0000","last_active":"2024-09-12T01:07:07.844190+0000","last_peered":"2024-09-12T01:07:07.844190+0000","last_clean":"2024-09-12T01:07:07.844190+0000","last_became_active":"2024-09-12T00:21:42.501690+0000","last_became_peered":"2024-09-12T00:21:42.501690+0000","last_unstale":"2024-09-12T01:07:07.844190+0000","last_undegraded":"2024-09-12T01:07:07.844190+0000","last_fullsized":"2024-09-12T01:07:07.844190+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.312316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4491986,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":530,"num_read_kb":15191,"num_write":1265,"num_write_kb":28087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'132","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.849170+0000","last_change":"2024-09-12T00:21:44.506973+0000","last_active":"2024-09-12T01:04:50.849170+0000","last_peered":"2024-09-12T01:04:50.849170+0000","last_clean":"2024-09-12T01:04:50.849170+0000","last_became_active":"2024-09-12T00:21:44.505235+0000","last_became_peered":"2024-09-12T00:21:44.505235+0000","last_unstale":"2024-09-12T01:04:50.849170+0000","last_undegraded":"2024-09-12T01:04:50.849170+0000","last_fullsized":"2024-09-12T01:04:50.849170+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:20.444195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":497,"num_write":201,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'281","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.768427+0000","last_change":"2024-09-12T00:21:42.509646+0000","last_active":"2024-09-12T01:05:38.768427+0000","last_peered":"2024-09-12T01:05:38.768427+0000","last_clean":"2024-09-12T01:05:38.768427+0000","last_became_active":"2024-09-12T00:21:42.508673+0000","last_became_peered":"2024-09-12T00:21:42.508673+0000","last_unstale":"2024-09-12T01:05:38.768427+0000","last_undegraded":"2024-09-12T01:05:38.768427+0000","last_fullsized":"2024-09-12T01:05:38.768427+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:10.125063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4844272,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":550,"num_read_kb":49155,"num_write":1136,"num_write_kb":40891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'142","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.964429+0000","last_change":"2024-09-12T00:21:44.515765+0000","last_active":"2024-09-12T01:07:11.964429+0000","last_peered":"2024-09-12T01:07:11.964429+0000","last_clean":"2024-09-12T01:07:11.964429+0000","last_became_active":"2024-09-12T00:21:44.515206+0000","last_became_peered":"2024-09-12T00:21:44.515206+0000","last_unstale":"2024-09-12T01:07:11.964429+0000","last_undegraded":"2024-09-12T01:07:11.964429+0000","last_fullsized":"2024-09-12T01:07:11.964429+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:47.686425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":613,"num_write":237,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'281","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.215870+0000","last_change":"2024-09-12T00:21:42.489401+0000","last_active":"2024-09-12T01:05:53.215870+0000","last_peered":"2024-09-12T01:05:53.215870+0000","last_clean":"2024-09-12T01:05:53.215870+0000","last_became_active":"2024-09-12T00:21:42.486829+0000","last_became_peered":"2024-09-12T00:21:42.486829+0000","last_unstale":"2024-09-12T01:05:53.215870+0000","last_undegraded":"2024-09-12T01:05:53.215870+0000","last_fullsized":"2024-09-12T01:05:53.215870+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.611453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4540397,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":478,"num_read_kb":26644,"num_write":985,"num_write_kb":13447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'172","reported_seq":773,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.043569+0000","last_change":"2024-09-12T00:21:44.503743+0000","last_active":"2024-09-12T01:05:28.043569+0000","last_peered":"2024-09-12T01:05:28.043569+0000","last_clean":"2024-09-12T01:05:28.043569+0000","last_became_active":"2024-09-12T00:21:44.501384+0000","last_became_peered":"2024-09-12T00:21:44.501384+0000","last_unstale":"2024-09-12T01:05:28.043569+0000","last_undegraded":"2024-09-12T01:05:28.043569+0000","last_fullsized":"2024-09-12T01:05:28.043569+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:44.078748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":594,"num_write":251,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'283","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.647940+0000","last_change":"2024-09-12T00:21:42.534665+0000","last_active":"2024-09-12T01:05:42.647940+0000","last_peered":"2024-09-12T01:05:42.647940+0000","last_clean":"2024-09-12T01:05:42.647940+0000","last_became_active":"2024-09-12T00:21:42.533216+0000","last_became_peered":"2024-09-12T00:21:42.533216+0000","last_unstale":"2024-09-12T01:05:42.647940+0000","last_undegraded":"2024-09-12T01:05:42.647940+0000","last_fullsized":"2024-09-12T01:05:42.647940+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.651370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10089675,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":504,"num_read_kb":42167,"num_write":1121,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'107","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:48.581000+0000","last_change":"2024-09-12T00:21:44.515637+0000","last_active":"2024-09-12T01:03:48.581000+0000","last_peered":"2024-09-12T01:03:48.581000+0000","last_clean":"2024-09-12T01:03:48.581000+0000","last_became_active":"2024-09-12T00:21:44.514909+0000","last_became_peered":"2024-09-12T00:21:44.514909+0000","last_unstale":"2024-09-12T01:03:48.581000+0000","last_undegraded":"2024-09-12T01:03:48.581000+0000","last_fullsized":"2024-09-12T01:03:48.581000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:15.377389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":354,"num_write":152,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'309","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.526906+0000","last_change":"2024-09-12T00:21:42.529321+0000","last_active":"2024-09-12T01:05:47.526906+0000","last_peered":"2024-09-12T01:05:47.526906+0000","last_clean":"2024-09-12T01:05:47.526906+0000","last_became_active":"2024-09-12T00:21:42.528929+0000","last_became_peered":"2024-09-12T00:21:42.528929+0000","last_unstale":"2024-09-12T01:05:47.526906+0000","last_undegraded":"2024-09-12T01:05:47.526906+0000","last_fullsized":"2024-09-12T01:05:47.526906+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.595630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826969,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":551,"num_read_kb":14743,"num_write":1015,"num_write_kb":22917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'148","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.196493+0000","last_change":"2024-09-12T00:21:44.507845+0000","last_active":"2024-09-12T01:05:01.196493+0000","last_peered":"2024-09-12T01:05:01.196493+0000","last_clean":"2024-09-12T01:05:01.196493+0000","last_became_active":"2024-09-12T00:21:44.507579+0000","last_became_peered":"2024-09-12T00:21:44.507579+0000","last_unstale":"2024-09-12T01:05:01.196493+0000","last_undegraded":"2024-09-12T01:05:01.196493+0000","last_fullsized":"2024-09-12T01:05:01.196493+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:20.931149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":566,"num_write":233,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'312","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609831+0000","last_change":"2024-09-12T00:21:42.512593+0000","last_active":"2024-09-12T01:04:29.609831+0000","last_peered":"2024-09-12T01:04:29.609831+0000","last_clean":"2024-09-12T01:04:29.609831+0000","last_became_active":"2024-09-12T00:21:42.511703+0000","last_became_peered":"2024-09-12T00:21:42.511703+0000","last_unstale":"2024-09-12T01:04:29.609831+0000","last_undegraded":"2024-09-12T01:04:29.609831+0000","last_fullsized":"2024-09-12T01:04:29.609831+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:16.112281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561783,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":516,"num_read_kb":16282,"num_write":1149,"num_write_kb":34029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'32","reported_seq":574,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.235223+0000","last_change":"2024-09-12T00:21:44.512963+0000","last_active":"2024-09-12T01:05:51.235223+0000","last_peered":"2024-09-12T01:05:51.235223+0000","last_clean":"2024-09-12T01:05:51.235223+0000","last_became_active":"2024-09-12T00:21:44.509834+0000","last_became_peered":"2024-09-12T00:21:44.509834+0000","last_unstale":"2024-09-12T01:05:51.235223+0000","last_undegraded":"2024-09-12T01:05:51.235223+0000","last_fullsized":"2024-09-12T01:05:51.235223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:08.437585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'289","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.413211+0000","last_change":"2024-09-12T00:21:42.484617+0000","last_active":"2024-09-12T01:05:22.413211+0000","last_peered":"2024-09-12T01:05:22.413211+0000","last_clean":"2024-09-12T01:05:22.413211+0000","last_became_active":"2024-09-12T00:21:42.484073+0000","last_became_peered":"2024-09-12T00:21:42.484073+0000","last_unstale":"2024-09-12T01:05:22.413211+0000","last_undegraded":"2024-09-12T01:05:22.413211+0000","last_fullsized":"2024-09-12T01:05:22.413211+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:02.073875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19842851,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":466,"num_read_kb":37310,"num_write":1112,"num_write_kb":47723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'219","reported_seq":806,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.336782+0000","last_change":"2024-09-12T00:21:44.499442+0000","last_active":"2024-09-12T01:05:39.336782+0000","last_peered":"2024-09-12T01:05:39.336782+0000","last_clean":"2024-09-12T01:05:39.336782+0000","last_became_active":"2024-09-12T00:21:44.499043+0000","last_became_peered":"2024-09-12T00:21:44.499043+0000","last_unstale":"2024-09-12T01:05:39.336782+0000","last_undegraded":"2024-09-12T01:05:39.336782+0000","last_fullsized":"2024-09-12T01:05:39.336782+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:15.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":734,"num_write":347,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'316","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.234563+0000","last_change":"2024-09-12T00:21:42.483974+0000","last_active":"2024-09-12T01:06:03.234563+0000","last_peered":"2024-09-12T01:06:03.234563+0000","last_clean":"2024-09-12T01:06:03.234563+0000","last_became_active":"2024-09-12T00:21:42.482971+0000","last_became_peered":"2024-09-12T00:21:42.482971+0000","last_unstale":"2024-09-12T01:06:03.234563+0000","last_undegraded":"2024-09-12T01:06:03.234563+0000","last_fullsized":"2024-09-12T01:06:03.234563+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:02.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10637338,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":557,"num_read_kb":31089,"num_write":1085,"num_write_kb":20487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'217","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.418327+0000","last_change":"2024-09-12T00:21:44.526412+0000","last_active":"2024-09-12T01:06:44.418327+0000","last_peered":"2024-09-12T01:06:44.418327+0000","last_clean":"2024-09-12T01:06:44.418327+0000","last_became_active":"2024-09-12T00:21:44.526086+0000","last_became_peered":"2024-09-12T00:21:44.526086+0000","last_unstale":"2024-09-12T01:06:44.418327+0000","last_undegraded":"2024-09-12T01:06:44.418327+0000","last_fullsized":"2024-09-12T01:06:44.418327+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:23.397670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1006,"num_read_kb":865,"num_write":343,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'294","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.285557+0000","last_change":"2024-09-12T00:22:12.610824+0000","last_active":"2024-09-12T01:05:49.285557+0000","last_peered":"2024-09-12T01:05:49.285557+0000","last_clean":"2024-09-12T01:05:49.285557+0000","last_became_active":"2024-09-12T00:22:12.609837+0000","last_became_peered":"2024-09-12T00:22:12.609837+0000","last_unstale":"2024-09-12T01:05:49.285557+0000","last_undegraded":"2024-09-12T01:05:49.285557+0000","last_fullsized":"2024-09-12T01:05:49.285557+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:23.567602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8530495,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":772,"num_read_kb":34651,"num_write":1094,"num_write_kb":39913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2a","version":"267'441","reported_seq":1107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.368037+0000","last_change":"2024-09-12T00:21:44.512868+0000","last_active":"2024-09-12T01:05:25.368037+0000","last_peered":"2024-09-12T01:05:25.368037+0000","last_clean":"2024-09-12T01:05:25.368037+0000","last_became_active":"2024-09-12T00:21:44.511294+0000","last_became_peered":"2024-09-12T00:21:44.511294+0000","last_unstale":"2024-09-12T01:05:25.368037+0000","last_undegraded":"2024-09-12T01:05:25.368037+0000","last_fullsized":"2024-09-12T01:05:25.368037+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:11.069322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2157,"num_read_kb":1820,"num_write":750,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'284","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:03.225948+0000","last_change":"2024-09-12T00:21:42.530226+0000","last_active":"2024-09-12T01:06:03.225948+0000","last_peered":"2024-09-12T01:06:03.225948+0000","last_clean":"2024-09-12T01:06:03.225948+0000","last_became_active":"2024-09-12T00:21:42.528942+0000","last_became_peered":"2024-09-12T00:21:42.528942+0000","last_unstale":"2024-09-12T01:06:03.225948+0000","last_undegraded":"2024-09-12T01:06:03.225948+0000","last_fullsized":"2024-09-12T01:06:03.225948+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:58.270470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513679,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":444,"num_read_kb":48912,"num_write":1124,"num_write_kb":34098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'117","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.852107+0000","last_change":"2024-09-12T00:21:44.526377+0000","last_active":"2024-09-12T01:05:02.852107+0000","last_peered":"2024-09-12T01:05:02.852107+0000","last_clean":"2024-09-12T01:05:02.852107+0000","last_became_active":"2024-09-12T00:21:44.525685+0000","last_became_peered":"2024-09-12T00:21:44.525685+0000","last_unstale":"2024-09-12T01:05:02.852107+0000","last_undegraded":"2024-09-12T01:05:02.852107+0000","last_fullsized":"2024-09-12T01:05:02.852107+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.603436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":457,"num_write":189,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'328","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.607175+0000","last_change":"2024-09-12T00:21:42.503168+0000","last_active":"2024-09-12T01:07:27.607175+0000","last_peered":"2024-09-12T01:07:27.607175+0000","last_clean":"2024-09-12T01:07:27.607175+0000","last_became_active":"2024-09-12T00:21:42.499294+0000","last_became_peered":"2024-09-12T00:21:42.499294+0000","last_unstale":"2024-09-12T01:07:27.607175+0000","last_undegraded":"2024-09-12T01:07:27.607175+0000","last_fullsized":"2024-09-12T01:07:27.607175+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:30.172185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":11483,"num_write":1078,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'192","reported_seq":807,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:48.540662+0000","last_change":"2024-09-12T00:21:44.511953+0000","last_active":"2024-09-12T01:05:48.540662+0000","last_peered":"2024-09-12T01:05:48.540662+0000","last_clean":"2024-09-12T01:05:48.540662+0000","last_became_active":"2024-09-12T00:21:44.511085+0000","last_became_peered":"2024-09-12T00:21:44.511085+0000","last_unstale":"2024-09-12T01:05:48.540662+0000","last_undegraded":"2024-09-12T01:05:48.540662+0000","last_fullsized":"2024-09-12T01:05:48.540662+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:53.583649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":698,"num_write":312,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'311","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.708915+0000","last_change":"2024-09-12T00:21:42.519200+0000","last_active":"2024-09-12T01:07:05.708915+0000","last_peered":"2024-09-12T01:07:05.708915+0000","last_clean":"2024-09-12T01:07:05.708915+0000","last_became_active":"2024-09-12T00:21:42.518768+0000","last_became_peered":"2024-09-12T00:21:42.518768+0000","last_unstale":"2024-09-12T01:07:05.708915+0000","last_undegraded":"2024-09-12T01:07:05.708915+0000","last_fullsized":"2024-09-12T01:07:05.708915+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:58.092377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7638034,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":523,"num_read_kb":53651,"num_write":1035,"num_write_kb":23347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'248","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:16.319309+0000","last_change":"2024-09-12T00:21:42.495841+0000","last_active":"2024-09-12T01:04:16.319309+0000","last_peered":"2024-09-12T01:04:16.319309+0000","last_clean":"2024-09-12T01:04:16.319309+0000","last_became_active":"2024-09-12T00:21:42.495480+0000","last_became_peered":"2024-09-12T00:21:42.495480+0000","last_unstale":"2024-09-12T01:04:16.319309+0000","last_undegraded":"2024-09-12T01:04:16.319309+0000","last_fullsized":"2024-09-12T01:04:16.319309+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:30.083635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813200,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":356,"num_read_kb":25580,"num_write":877,"num_write_kb":28169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'195","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.324242+0000","last_change":"2024-09-12T00:21:44.527476+0000","last_active":"2024-09-12T01:04:19.324242+0000","last_peered":"2024-09-12T01:04:19.324242+0000","last_clean":"2024-09-12T01:04:19.324242+0000","last_became_active":"2024-09-12T00:21:44.526907+0000","last_became_peered":"2024-09-12T00:21:44.526907+0000","last_unstale":"2024-09-12T01:04:19.324242+0000","last_undegraded":"2024-09-12T01:04:19.324242+0000","last_fullsized":"2024-09-12T01:04:19.324242+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.457978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":917,"num_read_kb":786,"num_write":315,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'253","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.449829+0000","last_change":"2024-09-12T00:21:42.518641+0000","last_active":"2024-09-12T01:05:43.449829+0000","last_peered":"2024-09-12T01:05:43.449829+0000","last_clean":"2024-09-12T01:05:43.449829+0000","last_became_active":"2024-09-12T00:21:42.516614+0000","last_became_peered":"2024-09-12T00:21:42.516614+0000","last_unstale":"2024-09-12T01:05:43.449829+0000","last_undegraded":"2024-09-12T01:05:43.449829+0000","last_fullsized":"2024-09-12T01:05:43.449829+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:05.951966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10018583,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":355,"num_read_kb":30838,"num_write":863,"num_write_kb":38454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'102","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.972355+0000","last_change":"2024-09-12T00:21:44.497391+0000","last_active":"2024-09-12T01:05:40.972355+0000","last_peered":"2024-09-12T01:05:40.972355+0000","last_clean":"2024-09-12T01:05:40.972355+0000","last_became_active":"2024-09-12T00:21:44.496138+0000","last_became_peered":"2024-09-12T00:21:44.496138+0000","last_unstale":"2024-09-12T01:05:40.972355+0000","last_undegraded":"2024-09-12T01:05:40.972355+0000","last_fullsized":"2024-09-12T01:05:40.972355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:58.246589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5839,"num_read_kb":4146,"num_write":1942,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1113,"ondisk_log_size":1113,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14973,"num_read_kb":14645,"num_write":16791,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":568,"ondisk_log_size":568,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1871738,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17349,"num_read_kb":33635,"num_write":14619,"num_write_kb":11551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2994176,"data_stored":2493109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1829,"ondisk_log_size":1829,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":101832,"num_read_kb":85065,"num_write":36894,"num_write_kb":18565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3786,"ondisk_log_size":3786,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":463326797,"num_objects":4246,"num_object_clones":0,"num_object_copies":12738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4246,"num_whiteouts":0,"num_read":32222,"num_read_kb":1795869,"num_write":67897,"num_write_kb":2042491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":694878208,"data_stored":694878208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4408,"ondisk_log_size":4408,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73448742,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":150,"num_read_kb":206538,"num_write":165,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147996672,"data_stored":147994484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":71400014,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":147,"num_read_kb":195226,"num_write":166,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142802944,"data_stored":142800028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509996,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209920,"kb_used_data":128816,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94161920,"statfs":{"total":96636764160,"available":96421806080,"internally_reserved":0,"allocated":131907584,"data_stored":129847978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509997,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":428644,"kb_used_data":172628,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93943196,"statfs":{"total":96636764160,"available":96197832704,"internally_reserved":0,"allocated":176771072,"data_stored":174719875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509999,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303956,"kb_used_data":120132,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94067884,"statfs":{"total":96636764160,"available":96325513216,"internally_reserved":0,"allocated":123015168,"data_stored":120972731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509997,"num_pgs":123,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358648,"kb_used_data":169192,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94013192,"statfs":{"total":96636764160,"available":96269508608,"internally_reserved":0,"allocated":173252608,"data_stored":171214777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":193984968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510000,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249116,"kb_used_data":137420,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94122724,"statfs":{"total":96636764160,"available":96381669376,"internally_reserved":0,"allocated":140718080,"data_stored":138714461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509997,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375112,"kb_used_data":113464,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93996728,"statfs":{"total":96636764160,"available":96252649472,"internally_reserved":0,"allocated":116187136,"data_stored":114123792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509996,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260596,"kb_used_data":139236,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94111244,"statfs":{"total":96636764160,"available":96369913856,"internally_reserved":0,"allocated":142577664,"data_stored":140512320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542703,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243148,"kb_used_data":18796,"kb_used_omap":1,"kb_used_meta":224062,"kb_avail":94128692,"statfs":{"total":96636764160,"available":96387780608,"internally_reserved":0,"allocated":19247104,"data_stored":17260105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":229439946},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118882304,"data_stored":118882304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":89845760,"data_stored":89845760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":99635200,"data_stored":99635200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107778048,"data_stored":107778048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":82595840,"data_stored":82595840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":104267776,"data_stored":104267776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":76865536,"data_stored":76865536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15007744,"data_stored":15007744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":501806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":465157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":127090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":270653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":374988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":403118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":349499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44089344,"data_stored":44088614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27312128,"data_stored":27311400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27312128,"data_stored":27311400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29409280,"data_stored":29408550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39895040,"data_stored":39894312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:07:29.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:07:30.186 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:07:30.186 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":267,"fsid":"4e4db2d6-4863-4874-a7a6-6f11f6db62a8","created":"2024-09-12T00:21:06.555575+0000","modified":"2024-09-12T00:49:11.574646+0000","last_up_change":"2024-09-12T00:21:19.170181+0000","last_in_change":"2024-09-12T00:21:08.868628+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:21:19.418763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:21:24.767867+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:21:40.465335+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:21:42.807610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:21:44.587925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:21:46.598813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:21:48.558413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:21:50.688547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:36:35.928481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:38:05.635788+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:38:08.859780+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T00:49:09.383460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"267","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff6f8b2b-beff-4b5d-bcb3-4e4528352ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6801","nonce":775942033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6803","nonce":775942033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6807","nonce":775942033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":775942033},{"type":"v1","addr":"172.21.15.137:6805","nonce":775942033}]},"public_addr":"172.21.15.137:6801/775942033","cluster_addr":"172.21.15.137:6803/775942033","heartbeat_back_addr":"172.21.15.137:6807/775942033","heartbeat_front_addr":"172.21.15.137:6805/775942033","state":["exists","up"]},{"osd":1,"uuid":"1ae64a6c-1299-4d36-81b0-34fe50bcf159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6817","nonce":2821877990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6819","nonce":2821877990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6823","nonce":2821877990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2821877990},{"type":"v1","addr":"172.21.15.137:6821","nonce":2821877990}]},"public_addr":"172.21.15.137:6817/2821877990","cluster_addr":"172.21.15.137:6819/2821877990","heartbeat_back_addr":"172.21.15.137:6823/2821877990","heartbeat_front_addr":"172.21.15.137:6821/2821877990","state":["exists","up"]},{"osd":2,"uuid":"dd2171e0-3214-4952-921e-e023b694b0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6809","nonce":3452645018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6811","nonce":3452645018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6815","nonce":3452645018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3452645018},{"type":"v1","addr":"172.21.15.137:6813","nonce":3452645018}]},"public_addr":"172.21.15.137:6809/3452645018","cluster_addr":"172.21.15.137:6811/3452645018","heartbeat_back_addr":"172.21.15.137:6815/3452645018","heartbeat_front_addr":"172.21.15.137:6813/3452645018","state":["exists","up"]},{"osd":3,"uuid":"8d0ffcdf-c3c5-4498-b7b1-a72e6f1f95c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6825","nonce":2424472815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6827","nonce":2424472815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6831","nonce":2424472815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2424472815},{"type":"v1","addr":"172.21.15.137:6829","nonce":2424472815}]},"public_addr":"172.21.15.137:6825/2424472815","cluster_addr":"172.21.15.137:6827/2424472815","heartbeat_back_addr":"172.21.15.137:6831/2424472815","heartbeat_front_addr":"172.21.15.137:6829/2424472815","state":["exists","up"]},{"osd":4,"uuid":"31a3f465-82dc-43c4-a892-8ec5c08caff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6817","nonce":3675960294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6819","nonce":3675960294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6823","nonce":3675960294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":3675960294},{"type":"v1","addr":"172.21.15.150:6821","nonce":3675960294}]},"public_addr":"172.21.15.150:6817/3675960294","cluster_addr":"172.21.15.150:6819/3675960294","heartbeat_back_addr":"172.21.15.150:6823/3675960294","heartbeat_front_addr":"172.21.15.150:6821/3675960294","state":["exists","up"]},{"osd":5,"uuid":"e0acf37e-89cc-45d2-a440-e370c76f6ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6825","nonce":868007963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6827","nonce":868007963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6831","nonce":868007963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":868007963},{"type":"v1","addr":"172.21.15.150:6829","nonce":868007963}]},"public_addr":"172.21.15.150:6825/868007963","cluster_addr":"172.21.15.150:6827/868007963","heartbeat_back_addr":"172.21.15.150:6831/868007963","heartbeat_front_addr":"172.21.15.150:6829/868007963","state":["exists","up"]},{"osd":6,"uuid":"550dac1d-c031-4a10-92e2-93fbb3f7ec8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6809","nonce":2067574013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6811","nonce":2067574013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6815","nonce":2067574013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2067574013},{"type":"v1","addr":"172.21.15.150:6813","nonce":2067574013}]},"public_addr":"172.21.15.150:6809/2067574013","cluster_addr":"172.21.15.150:6811/2067574013","heartbeat_back_addr":"172.21.15.150:6815/2067574013","heartbeat_front_addr":"172.21.15.150:6813/2067574013","state":["exists","up"]},{"osd":7,"uuid":"231842bc-28cf-4aec-9025-00c0b9179c9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6801","nonce":1704738992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6803","nonce":1704738992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6807","nonce":1704738992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1704738992},{"type":"v1","addr":"172.21.15.150:6805","nonce":1704738992}]},"public_addr":"172.21.15.150:6801/1704738992","cluster_addr":"172.21.15.150:6803/1704738992","heartbeat_back_addr":"172.21.15.150:6807/1704738992","heartbeat_front_addr":"172.21.15.150:6805/1704738992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.635907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.831525+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.937124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.793632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.760113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:16.006577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.423577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:21:15.282953+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.a","mappings":[{"from":3,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":7}]},{"pgid":"3.2c","mappings":[{"from":0,"to":5}]},{"pgid":"3.35","mappings":[{"from":0,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:07:31.206 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:07:31.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:07:31.365 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T01:07:31.365 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:07:31.365 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T01:07:31.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:07:31.683 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:07:31.702 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:07:31.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:07:31.839 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T01:07:31.839 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:07:31.839 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T01:07:31.854 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:07:32.160 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:07:32.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:07:32.304 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T01:07:32.304 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:07:32.305 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T01:07:32.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:07:32.618 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:07:32.638 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:07:32.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:07:32.784 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T01:07:32.784 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:07:32.785 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T01:07:32.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:07:33.096 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:07:33.115 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:07:33.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:07:33.255 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T01:07:33.255 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:07:33.255 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T01:07:33.270 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:07:33.574 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:07:33.594 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:07:33.594 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:07:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T01:07:33.749 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:07:33.749 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T01:07:33.765 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:07:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:07:34.061 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:07:34.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:07:34.201 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T01:07:34.201 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:07:34.201 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T01:07:34.215 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:07:34.501 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:07:34.519 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:07:34.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:07:34.669 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-12T01:07:34.670 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:07:34.670 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-12T01:07:34.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:07:34.966 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:07:34.984 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:07:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:07:35.354 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T01:07:35.356 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1648,"stamp":"2024-09-12T01:07:35.132258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83396560,"num_objects":733,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":179311,"num_read_kb":2341483,"num_write":142743,"num_write_kb":2353740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12701,"ondisk_log_size":12701,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1660100,"kb_used_data":155428,"kb_used_omap":12,"kb_used_meta":1503987,"kb_avail":753314620,"statfs":{"total":773094113280,"available":771394170880,"internally_reserved":0,"allocated":159158272,"data_stored":143082942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1540083249},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-574696648,"num_objects":-4140,"num_object_clones":0,"num_object_copies":-12360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4140,"num_whiteouts":0,"num_read":4628,"num_read_kb":4142,"num_write":4391,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007146"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587141+0000","last_change":"2024-09-12T00:49:10.624205+0000","last_active":"2024-09-12T01:04:14.587141+0000","last_peered":"2024-09-12T01:04:14.587141+0000","last_clean":"2024-09-12T01:04:14.587141+0000","last_became_active":"2024-09-12T00:49:10.623491+0000","last_became_peered":"2024-09-12T00:49:10.623491+0000","last_unstale":"2024-09-12T01:04:14.587141+0000","last_undegraded":"2024-09-12T01:04:14.587141+0000","last_fullsized":"2024-09-12T01:04:14.587141+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.660122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"267'7","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.789961+0000","last_change":"2024-09-12T00:38:10.688649+0000","last_active":"2024-09-12T01:05:44.789961+0000","last_peered":"2024-09-12T01:05:44.789961+0000","last_clean":"2024-09-12T01:05:44.789961+0000","last_became_active":"2024-09-12T00:38:10.687911+0000","last_became_peered":"2024-09-12T00:38:10.687911+0000","last_unstale":"2024-09-12T01:05:44.789961+0000","last_undegraded":"2024-09-12T01:05:44.789961+0000","last_fullsized":"2024-09-12T01:05:44.789961+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:09.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.571671+0000","last_change":"2024-09-12T00:38:07.665498+0000","last_active":"2024-09-12T01:03:08.571671+0000","last_peered":"2024-09-12T01:03:08.571671+0000","last_clean":"2024-09-12T01:03:08.571671+0000","last_became_active":"2024-09-12T00:38:07.664779+0000","last_became_peered":"2024-09-12T00:38:07.664779+0000","last_unstale":"2024-09-12T01:03:08.571671+0000","last_undegraded":"2024-09-12T01:03:08.571671+0000","last_fullsized":"2024-09-12T01:03:08.571671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.524540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'50","reported_seq":182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.429135+0000","last_change":"2024-09-12T00:36:37.236134+0000","last_active":"2024-09-12T01:03:50.429135+0000","last_peered":"2024-09-12T01:03:50.429135+0000","last_clean":"2024-09-12T01:03:50.429135+0000","last_became_active":"2024-09-12T00:36:37.223686+0000","last_became_peered":"2024-09-12T00:36:37.223686+0000","last_unstale":"2024-09-12T01:03:50.429135+0000","last_undegraded":"2024-09-12T01:03:50.429135+0000","last_fullsized":"2024-09-12T01:03:50.429135+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:53.656045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":201,"num_write":87,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.582523+0000","last_change":"2024-09-12T00:49:10.625393+0000","last_active":"2024-09-12T01:04:14.582523+0000","last_peered":"2024-09-12T01:04:14.582523+0000","last_clean":"2024-09-12T01:04:14.582523+0000","last_became_active":"2024-09-12T00:49:10.624700+0000","last_became_peered":"2024-09-12T00:49:10.624700+0000","last_unstale":"2024-09-12T01:04:14.582523+0000","last_undegraded":"2024-09-12T01:04:14.582523+0000","last_fullsized":"2024-09-12T01:04:14.582523+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"267'8","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.769490+0000","last_change":"2024-09-12T00:38:10.696907+0000","last_active":"2024-09-12T01:05:44.769490+0000","last_peered":"2024-09-12T01:05:44.769490+0000","last_clean":"2024-09-12T01:05:44.769490+0000","last_became_active":"2024-09-12T00:38:10.691195+0000","last_became_peered":"2024-09-12T00:38:10.691195+0000","last_unstale":"2024-09-12T01:05:44.769490+0000","last_undegraded":"2024-09-12T01:05:44.769490+0000","last_fullsized":"2024-09-12T01:05:44.769490+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.105627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"267'8","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.627314+0000","last_change":"2024-09-12T00:38:07.665354+0000","last_active":"2024-09-12T01:05:39.627314+0000","last_peered":"2024-09-12T01:05:39.627314+0000","last_clean":"2024-09-12T01:05:39.627314+0000","last_became_active":"2024-09-12T00:38:07.664663+0000","last_became_peered":"2024-09-12T00:38:07.664663+0000","last_unstale":"2024-09-12T01:05:39.627314+0000","last_undegraded":"2024-09-12T01:05:39.627314+0000","last_fullsized":"2024-09-12T01:05:39.627314+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.495162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587630+0000","last_change":"2024-09-12T00:36:37.240047+0000","last_active":"2024-09-12T01:04:49.587630+0000","last_peered":"2024-09-12T01:04:49.587630+0000","last_clean":"2024-09-12T01:04:49.587630+0000","last_became_active":"2024-09-12T00:36:37.239199+0000","last_became_peered":"2024-09-12T00:36:37.239199+0000","last_unstale":"2024-09-12T01:04:49.587630+0000","last_undegraded":"2024-09-12T01:04:49.587630+0000","last_fullsized":"2024-09-12T01:04:49.587630+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:11.845055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.762541+0000","last_change":"2024-09-12T00:49:10.612385+0000","last_active":"2024-09-12T01:03:44.762541+0000","last_peered":"2024-09-12T01:03:44.762541+0000","last_clean":"2024-09-12T01:03:44.762541+0000","last_became_active":"2024-09-12T00:49:10.611715+0000","last_became_peered":"2024-09-12T00:49:10.611715+0000","last_unstale":"2024-09-12T01:03:44.762541+0000","last_undegraded":"2024-09-12T01:03:44.762541+0000","last_fullsized":"2024-09-12T01:03:44.762541+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:44.906371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"267'13","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.115134+0000","last_change":"2024-09-12T00:38:10.708434+0000","last_active":"2024-09-12T01:07:26.115134+0000","last_peered":"2024-09-12T01:07:26.115134+0000","last_clean":"2024-09-12T01:07:26.115134+0000","last_became_active":"2024-09-12T00:38:10.702832+0000","last_became_peered":"2024-09-12T00:38:10.702832+0000","last_unstale":"2024-09-12T01:07:26.115134+0000","last_undegraded":"2024-09-12T01:07:26.115134+0000","last_fullsized":"2024-09-12T01:07:26.115134+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:02.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26653,"num_write":18,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.586519+0000","last_change":"2024-09-12T00:38:07.656103+0000","last_active":"2024-09-12T01:04:13.586519+0000","last_peered":"2024-09-12T01:04:13.586519+0000","last_clean":"2024-09-12T01:04:13.586519+0000","last_became_active":"2024-09-12T00:38:07.654162+0000","last_became_peered":"2024-09-12T00:38:07.654162+0000","last_unstale":"2024-09-12T01:04:13.586519+0000","last_undegraded":"2024-09-12T01:04:13.586519+0000","last_fullsized":"2024-09-12T01:04:13.586519+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:51.681421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'61","reported_seq":215,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.745657+0000","last_change":"2024-09-12T00:36:37.244669+0000","last_active":"2024-09-12T01:05:03.745657+0000","last_peered":"2024-09-12T01:05:03.745657+0000","last_clean":"2024-09-12T01:05:03.745657+0000","last_became_active":"2024-09-12T00:36:37.243951+0000","last_became_peered":"2024-09-12T00:36:37.243951+0000","last_unstale":"2024-09-12T01:05:03.745657+0000","last_undegraded":"2024-09-12T01:05:03.745657+0000","last_fullsized":"2024-09-12T01:05:03.745657+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:02.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":228,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600226+0000","last_change":"2024-09-12T00:49:10.614295+0000","last_active":"2024-09-12T01:03:49.600226+0000","last_peered":"2024-09-12T01:03:49.600226+0000","last_clean":"2024-09-12T01:03:49.600226+0000","last_became_active":"2024-09-12T00:49:10.613525+0000","last_became_peered":"2024-09-12T00:49:10.613525+0000","last_unstale":"2024-09-12T01:03:49.600226+0000","last_undegraded":"2024-09-12T01:03:49.600226+0000","last_fullsized":"2024-09-12T01:03:49.600226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:34.120845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'12","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321339+0000","last_change":"2024-09-12T00:38:10.702125+0000","last_active":"2024-09-12T01:07:26.321339+0000","last_peered":"2024-09-12T01:07:26.321339+0000","last_clean":"2024-09-12T01:07:26.321339+0000","last_became_active":"2024-09-12T00:38:10.701406+0000","last_became_peered":"2024-09-12T00:38:10.701406+0000","last_unstale":"2024-09-12T01:07:26.321339+0000","last_undegraded":"2024-09-12T01:07:26.321339+0000","last_fullsized":"2024-09-12T01:07:26.321339+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.321347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'4","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.783176+0000","last_change":"2024-09-12T00:38:07.642044+0000","last_active":"2024-09-12T01:05:14.783176+0000","last_peered":"2024-09-12T01:05:14.783176+0000","last_clean":"2024-09-12T01:05:14.783176+0000","last_became_active":"2024-09-12T00:38:07.639897+0000","last_became_peered":"2024-09-12T00:38:07.639897+0000","last_unstale":"2024-09-12T01:05:14.783176+0000","last_undegraded":"2024-09-12T01:05:14.783176+0000","last_fullsized":"2024-09-12T01:05:14.783176+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:48.556221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4625,"num_write":4,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'49","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.581394+0000","last_change":"2024-09-12T00:36:37.236688+0000","last_active":"2024-09-12T01:04:09.581394+0000","last_peered":"2024-09-12T01:04:09.581394+0000","last_clean":"2024-09-12T01:04:09.581394+0000","last_became_active":"2024-09-12T00:36:37.235921+0000","last_became_peered":"2024-09-12T00:36:37.235921+0000","last_unstale":"2024-09-12T01:04:09.581394+0000","last_undegraded":"2024-09-12T01:04:09.581394+0000","last_fullsized":"2024-09-12T01:04:09.581394+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:57.656212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":160,"num_write":94,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.601979+0000","last_change":"2024-09-12T00:49:10.640862+0000","last_active":"2024-09-12T01:05:18.601979+0000","last_peered":"2024-09-12T01:05:18.601979+0000","last_clean":"2024-09-12T01:05:18.601979+0000","last_became_active":"2024-09-12T00:49:10.640187+0000","last_became_peered":"2024-09-12T00:49:10.640187+0000","last_unstale":"2024-09-12T01:05:18.601979+0000","last_undegraded":"2024-09-12T01:05:18.601979+0000","last_fullsized":"2024-09-12T01:05:18.601979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.913407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.596205+0000","last_change":"2024-09-12T00:38:10.702920+0000","last_active":"2024-09-12T01:04:54.596205+0000","last_peered":"2024-09-12T01:04:54.596205+0000","last_clean":"2024-09-12T01:04:54.596205+0000","last_became_active":"2024-09-12T00:38:10.702113+0000","last_became_peered":"2024-09-12T00:38:10.702113+0000","last_unstale":"2024-09-12T01:04:54.596205+0000","last_undegraded":"2024-09-12T01:04:54.596205+0000","last_fullsized":"2024-09-12T01:04:54.596205+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:03.161296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.613854+0000","last_change":"2024-09-12T00:38:07.661344+0000","last_active":"2024-09-12T01:04:44.613854+0000","last_peered":"2024-09-12T01:04:44.613854+0000","last_clean":"2024-09-12T01:04:44.613854+0000","last_became_active":"2024-09-12T00:38:07.660159+0000","last_became_peered":"2024-09-12T00:38:07.660159+0000","last_unstale":"2024-09-12T01:04:44.613854+0000","last_undegraded":"2024-09-12T01:04:44.613854+0000","last_fullsized":"2024-09-12T01:04:44.613854+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:05.309641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'28","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.675076+0000","last_change":"2024-09-12T00:36:37.251730+0000","last_active":"2024-09-12T01:04:15.675076+0000","last_peered":"2024-09-12T01:04:15.675076+0000","last_clean":"2024-09-12T01:04:15.675076+0000","last_became_active":"2024-09-12T00:36:37.248920+0000","last_became_peered":"2024-09-12T00:36:37.248920+0000","last_unstale":"2024-09-12T01:04:15.675076+0000","last_undegraded":"2024-09-12T01:04:15.675076+0000","last_fullsized":"2024-09-12T01:04:15.675076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.363028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574475+0000","last_change":"2024-09-12T00:49:10.640254+0000","last_active":"2024-09-12T01:03:49.574475+0000","last_peered":"2024-09-12T01:03:49.574475+0000","last_clean":"2024-09-12T01:03:49.574475+0000","last_became_active":"2024-09-12T00:49:10.638196+0000","last_became_peered":"2024-09-12T00:49:10.638196+0000","last_unstale":"2024-09-12T01:03:49.574475+0000","last_undegraded":"2024-09-12T01:03:49.574475+0000","last_fullsized":"2024-09-12T01:03:49.574475+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:50.165315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634261+0000","last_change":"2024-09-12T00:38:10.715254+0000","last_active":"2024-09-12T01:04:49.634261+0000","last_peered":"2024-09-12T01:04:49.634261+0000","last_clean":"2024-09-12T01:04:49.634261+0000","last_became_active":"2024-09-12T00:38:10.714503+0000","last_became_peered":"2024-09-12T00:38:10.714503+0000","last_unstale":"2024-09-12T01:04:49.634261+0000","last_undegraded":"2024-09-12T01:04:49.634261+0000","last_fullsized":"2024-09-12T01:04:49.634261+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.076577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"267'5","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:19.427278+0000","last_change":"2024-09-12T00:38:07.659781+0000","last_active":"2024-09-12T01:07:19.427278+0000","last_peered":"2024-09-12T01:07:19.427278+0000","last_clean":"2024-09-12T01:07:19.427278+0000","last_became_active":"2024-09-12T00:38:07.656570+0000","last_became_peered":"2024-09-12T00:38:07.656570+0000","last_unstale":"2024-09-12T01:07:19.427278+0000","last_undegraded":"2024-09-12T01:07:19.427278+0000","last_fullsized":"2024-09-12T01:07:19.427278+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.888062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'40","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.829646+0000","last_change":"2024-09-12T00:36:37.239747+0000","last_active":"2024-09-12T01:05:02.829646+0000","last_peered":"2024-09-12T01:05:02.829646+0000","last_clean":"2024-09-12T01:05:02.829646+0000","last_became_active":"2024-09-12T00:36:37.239055+0000","last_became_peered":"2024-09-12T00:36:37.239055+0000","last_unstale":"2024-09-12T01:05:02.829646+0000","last_undegraded":"2024-09-12T01:05:02.829646+0000","last_fullsized":"2024-09-12T01:05:02.829646+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:58.947633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":128,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748036+0000","last_change":"2024-09-12T00:49:10.625186+0000","last_active":"2024-09-12T01:04:09.748036+0000","last_peered":"2024-09-12T01:04:09.748036+0000","last_clean":"2024-09-12T01:04:09.748036+0000","last_became_active":"2024-09-12T00:49:10.624542+0000","last_became_peered":"2024-09-12T00:49:10.624542+0000","last_unstale":"2024-09-12T01:04:09.748036+0000","last_undegraded":"2024-09-12T01:04:09.748036+0000","last_fullsized":"2024-09-12T01:04:09.748036+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:44.317158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.734406+0000","last_change":"2024-09-12T00:38:10.698782+0000","last_active":"2024-09-12T01:03:14.734406+0000","last_peered":"2024-09-12T01:03:14.734406+0000","last_clean":"2024-09-12T01:03:14.734406+0000","last_became_active":"2024-09-12T00:38:10.698076+0000","last_became_peered":"2024-09-12T00:38:10.698076+0000","last_unstale":"2024-09-12T01:03:14.734406+0000","last_undegraded":"2024-09-12T01:03:14.734406+0000","last_fullsized":"2024-09-12T01:03:14.734406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.783233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.573024+0000","last_change":"2024-09-12T00:38:07.627893+0000","last_active":"2024-09-12T01:03:09.573024+0000","last_peered":"2024-09-12T01:03:09.573024+0000","last_clean":"2024-09-12T01:03:09.573024+0000","last_became_active":"2024-09-12T00:38:07.626956+0000","last_became_peered":"2024-09-12T00:38:07.626956+0000","last_unstale":"2024-09-12T01:03:09.573024+0000","last_undegraded":"2024-09-12T01:03:09.573024+0000","last_fullsized":"2024-09-12T01:03:09.573024+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.872892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'29","reported_seq":124,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.573884+0000","last_change":"2024-09-12T00:36:37.240924+0000","last_active":"2024-09-12T01:03:18.573884+0000","last_peered":"2024-09-12T01:03:18.573884+0000","last_clean":"2024-09-12T01:03:18.573884+0000","last_became_active":"2024-09-12T00:36:37.239412+0000","last_became_peered":"2024-09-12T00:36:37.239412+0000","last_unstale":"2024-09-12T01:03:18.573884+0000","last_undegraded":"2024-09-12T01:03:18.573884+0000","last_fullsized":"2024-09-12T01:03:18.573884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:01.137832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":107,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587293+0000","last_change":"2024-09-12T00:49:10.628369+0000","last_active":"2024-09-12T01:04:14.587293+0000","last_peered":"2024-09-12T01:04:14.587293+0000","last_clean":"2024-09-12T01:04:14.587293+0000","last_became_active":"2024-09-12T00:49:10.623930+0000","last_became_peered":"2024-09-12T00:49:10.623930+0000","last_unstale":"2024-09-12T01:04:14.587293+0000","last_undegraded":"2024-09-12T01:04:14.587293+0000","last_fullsized":"2024-09-12T01:04:14.587293+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.045569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.572802+0000","last_change":"2024-09-12T00:38:10.710382+0000","last_active":"2024-09-12T01:03:13.572802+0000","last_peered":"2024-09-12T01:03:13.572802+0000","last_clean":"2024-09-12T01:03:13.572802+0000","last_became_active":"2024-09-12T00:38:10.709065+0000","last_became_peered":"2024-09-12T00:38:10.709065+0000","last_unstale":"2024-09-12T01:03:13.572802+0000","last_undegraded":"2024-09-12T01:03:13.572802+0000","last_fullsized":"2024-09-12T01:03:13.572802+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:25.778926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"267'4","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.601013+0000","last_change":"2024-09-12T00:38:07.659182+0000","last_active":"2024-09-12T01:05:39.601013+0000","last_peered":"2024-09-12T01:05:39.601013+0000","last_clean":"2024-09-12T01:05:39.601013+0000","last_became_active":"2024-09-12T00:38:07.658039+0000","last_became_peered":"2024-09-12T00:38:07.658039+0000","last_unstale":"2024-09-12T01:05:39.601013+0000","last_undegraded":"2024-09-12T01:05:39.601013+0000","last_fullsized":"2024-09-12T01:05:39.601013+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:05.041242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'24","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567579+0000","last_change":"2024-09-12T00:36:37.243485+0000","last_active":"2024-09-12T01:03:14.567579+0000","last_peered":"2024-09-12T01:03:14.567579+0000","last_clean":"2024-09-12T01:03:14.567579+0000","last_became_active":"2024-09-12T00:36:37.238156+0000","last_became_peered":"2024-09-12T00:36:37.238156+0000","last_unstale":"2024-09-12T01:03:14.567579+0000","last_undegraded":"2024-09-12T01:03:14.567579+0000","last_fullsized":"2024-09-12T01:03:14.567579+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:40.335893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":66,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.591380+0000","last_change":"2024-09-12T00:49:10.614687+0000","last_active":"2024-09-12T01:03:14.591380+0000","last_peered":"2024-09-12T01:03:14.591380+0000","last_clean":"2024-09-12T01:03:14.591380+0000","last_became_active":"2024-09-12T00:49:10.614006+0000","last_became_peered":"2024-09-12T00:49:10.614006+0000","last_unstale":"2024-09-12T01:03:14.591380+0000","last_undegraded":"2024-09-12T01:03:14.591380+0000","last_fullsized":"2024-09-12T01:03:14.591380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.570199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.428804+0000","last_change":"2024-09-12T00:38:10.692661+0000","last_active":"2024-09-12T01:07:13.428804+0000","last_peered":"2024-09-12T01:07:13.428804+0000","last_clean":"2024-09-12T01:07:13.428804+0000","last_became_active":"2024-09-12T00:38:10.691887+0000","last_became_peered":"2024-09-12T00:38:10.691887+0000","last_unstale":"2024-09-12T01:07:13.428804+0000","last_undegraded":"2024-09-12T01:07:13.428804+0000","last_fullsized":"2024-09-12T01:07:13.428804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.050768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'8","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.621210+0000","last_change":"2024-09-12T00:38:07.654631+0000","last_active":"2024-09-12T01:07:26.621210+0000","last_peered":"2024-09-12T01:07:26.621210+0000","last_clean":"2024-09-12T01:07:26.621210+0000","last_became_active":"2024-09-12T00:38:07.653685+0000","last_became_peered":"2024-09-12T00:38:07.653685+0000","last_unstale":"2024-09-12T01:07:26.621210+0000","last_undegraded":"2024-09-12T01:07:26.621210+0000","last_fullsized":"2024-09-12T01:07:26.621210+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:49.445932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'8","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567005+0000","last_change":"2024-09-12T00:36:37.229918+0000","last_active":"2024-09-12T01:03:14.567005+0000","last_peered":"2024-09-12T01:03:14.567005+0000","last_clean":"2024-09-12T01:03:14.567005+0000","last_became_active":"2024-09-12T00:36:37.223860+0000","last_became_peered":"2024-09-12T00:36:37.223860+0000","last_unstale":"2024-09-12T01:03:14.567005+0000","last_undegraded":"2024-09-12T01:03:14.567005+0000","last_fullsized":"2024-09-12T01:03:14.567005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:21.022755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567701+0000","last_change":"2024-09-12T00:49:10.623954+0000","last_active":"2024-09-12T01:03:14.567701+0000","last_peered":"2024-09-12T01:03:14.567701+0000","last_clean":"2024-09-12T01:03:14.567701+0000","last_became_active":"2024-09-12T00:49:10.622347+0000","last_became_peered":"2024-09-12T00:49:10.622347+0000","last_unstale":"2024-09-12T01:03:14.567701+0000","last_undegraded":"2024-09-12T01:03:14.567701+0000","last_fullsized":"2024-09-12T01:03:14.567701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:20.923775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.602778+0000","last_change":"2024-09-12T00:38:10.718025+0000","last_active":"2024-09-12T01:03:59.602778+0000","last_peered":"2024-09-12T01:03:59.602778+0000","last_clean":"2024-09-12T01:03:59.602778+0000","last_became_active":"2024-09-12T00:38:10.717358+0000","last_became_peered":"2024-09-12T00:38:10.717358+0000","last_unstale":"2024-09-12T01:03:59.602778+0000","last_undegraded":"2024-09-12T01:03:59.602778+0000","last_fullsized":"2024-09-12T01:03:59.602778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:56.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.593987+0000","last_change":"2024-09-12T00:38:07.639460+0000","last_active":"2024-09-12T01:04:44.593987+0000","last_peered":"2024-09-12T01:04:44.593987+0000","last_clean":"2024-09-12T01:04:44.593987+0000","last_became_active":"2024-09-12T00:38:07.638712+0000","last_became_peered":"2024-09-12T00:38:07.638712+0000","last_unstale":"2024-09-12T01:04:44.593987+0000","last_undegraded":"2024-09-12T01:04:44.593987+0000","last_fullsized":"2024-09-12T01:04:44.593987+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:01.987566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'20","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.646910+0000","last_change":"2024-09-12T00:36:37.224823+0000","last_active":"2024-09-12T01:03:20.646910+0000","last_peered":"2024-09-12T01:03:20.646910+0000","last_clean":"2024-09-12T01:03:20.646910+0000","last_became_active":"2024-09-12T00:36:37.223487+0000","last_became_peered":"2024-09-12T00:36:37.223487+0000","last_unstale":"2024-09-12T01:03:20.646910+0000","last_undegraded":"2024-09-12T01:03:20.646910+0000","last_fullsized":"2024-09-12T01:03:20.646910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.907220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":70,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.733136+0000","last_change":"2024-09-12T00:49:10.612000+0000","last_active":"2024-09-12T01:03:09.733136+0000","last_peered":"2024-09-12T01:03:09.733136+0000","last_clean":"2024-09-12T01:03:09.733136+0000","last_became_active":"2024-09-12T00:49:10.611251+0000","last_became_peered":"2024-09-12T00:49:10.611251+0000","last_unstale":"2024-09-12T01:03:09.733136+0000","last_undegraded":"2024-09-12T01:03:09.733136+0000","last_fullsized":"2024-09-12T01:03:09.733136+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:41.354887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.558277+0000","last_change":"2024-09-12T00:38:10.707668+0000","last_active":"2024-09-12T01:07:26.558277+0000","last_peered":"2024-09-12T01:07:26.558277+0000","last_clean":"2024-09-12T01:07:26.558277+0000","last_became_active":"2024-09-12T00:38:10.706726+0000","last_became_peered":"2024-09-12T00:38:10.706726+0000","last_unstale":"2024-09-12T01:07:26.558277+0000","last_undegraded":"2024-09-12T01:07:26.558277+0000","last_fullsized":"2024-09-12T01:07:26.558277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:45.954816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321211+0000","last_change":"2024-09-12T00:38:07.668470+0000","last_active":"2024-09-12T01:07:26.321211+0000","last_peered":"2024-09-12T01:07:26.321211+0000","last_clean":"2024-09-12T01:07:26.321211+0000","last_became_active":"2024-09-12T00:38:07.667724+0000","last_became_peered":"2024-09-12T00:38:07.667724+0000","last_unstale":"2024-09-12T01:07:26.321211+0000","last_undegraded":"2024-09-12T01:07:26.321211+0000","last_fullsized":"2024-09-12T01:07:26.321211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:20.409038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'49","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.780052+0000","last_change":"2024-09-12T00:36:37.244938+0000","last_active":"2024-09-12T01:04:57.780052+0000","last_peered":"2024-09-12T01:04:57.780052+0000","last_clean":"2024-09-12T01:04:57.780052+0000","last_became_active":"2024-09-12T00:36:37.244259+0000","last_became_peered":"2024-09-12T00:36:37.244259+0000","last_unstale":"2024-09-12T01:04:57.780052+0000","last_undegraded":"2024-09-12T01:04:57.780052+0000","last_fullsized":"2024-09-12T01:04:57.780052+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.194885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":182,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.574047+0000","last_change":"2024-09-12T00:49:10.630411+0000","last_active":"2024-09-12T01:03:14.574047+0000","last_peered":"2024-09-12T01:03:14.574047+0000","last_clean":"2024-09-12T01:03:14.574047+0000","last_became_active":"2024-09-12T00:49:10.629746+0000","last_became_peered":"2024-09-12T00:49:10.629746+0000","last_unstale":"2024-09-12T01:03:14.574047+0000","last_undegraded":"2024-09-12T01:03:14.574047+0000","last_fullsized":"2024-09-12T01:03:14.574047+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:10.415361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:14.423894+0000","last_change":"2024-09-12T00:38:10.696938+0000","last_active":"2024-09-12T01:07:14.423894+0000","last_peered":"2024-09-12T01:07:14.423894+0000","last_clean":"2024-09-12T01:07:14.423894+0000","last_became_active":"2024-09-12T00:38:10.695688+0000","last_became_peered":"2024-09-12T00:38:10.695688+0000","last_unstale":"2024-09-12T01:07:14.423894+0000","last_undegraded":"2024-09-12T01:07:14.423894+0000","last_fullsized":"2024-09-12T01:07:14.423894+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:07.485587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.614081+0000","last_change":"2024-09-12T00:38:07.647799+0000","last_active":"2024-09-12T01:04:44.614081+0000","last_peered":"2024-09-12T01:04:44.614081+0000","last_clean":"2024-09-12T01:04:44.614081+0000","last_became_active":"2024-09-12T00:38:07.645284+0000","last_became_peered":"2024-09-12T00:38:07.645284+0000","last_unstale":"2024-09-12T01:04:44.614081+0000","last_undegraded":"2024-09-12T01:04:44.614081+0000","last_fullsized":"2024-09-12T01:04:44.614081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:30.146339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.633189+0000","last_change":"2024-09-12T00:36:37.221009+0000","last_active":"2024-09-12T01:04:44.633189+0000","last_peered":"2024-09-12T01:04:44.633189+0000","last_clean":"2024-09-12T01:04:44.633189+0000","last_became_active":"2024-09-12T00:36:37.220195+0000","last_became_peered":"2024-09-12T00:36:37.220195+0000","last_unstale":"2024-09-12T01:04:44.633189+0000","last_undegraded":"2024-09-12T01:04:44.633189+0000","last_fullsized":"2024-09-12T01:04:44.633189+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:56.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":108,"num_write":45,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.599208+0000","last_change":"2024-09-12T00:49:10.615352+0000","last_active":"2024-09-12T01:03:44.599208+0000","last_peered":"2024-09-12T01:03:44.599208+0000","last_clean":"2024-09-12T01:03:44.599208+0000","last_became_active":"2024-09-12T00:49:10.614661+0000","last_became_peered":"2024-09-12T00:49:10.614661+0000","last_unstale":"2024-09-12T01:03:44.599208+0000","last_undegraded":"2024-09-12T01:03:44.599208+0000","last_fullsized":"2024-09-12T01:03:44.599208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:28.781007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'3","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:14.635619+0000","last_change":"2024-09-12T00:38:10.704123+0000","last_active":"2024-09-12T01:06:14.635619+0000","last_peered":"2024-09-12T01:06:14.635619+0000","last_clean":"2024-09-12T01:06:14.635619+0000","last_became_active":"2024-09-12T00:38:10.702260+0000","last_became_peered":"2024-09-12T00:38:10.702260+0000","last_unstale":"2024-09-12T01:06:14.635619+0000","last_undegraded":"2024-09-12T01:06:14.635619+0000","last_fullsized":"2024-09-12T01:06:14.635619+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:52.661395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763803+0000","last_change":"2024-09-12T00:38:07.640472+0000","last_active":"2024-09-12T01:03:49.763803+0000","last_peered":"2024-09-12T01:03:49.763803+0000","last_clean":"2024-09-12T01:03:49.763803+0000","last_became_active":"2024-09-12T00:38:07.639687+0000","last_became_peered":"2024-09-12T00:38:07.639687+0000","last_unstale":"2024-09-12T01:03:49.763803+0000","last_undegraded":"2024-09-12T01:03:49.763803+0000","last_fullsized":"2024-09-12T01:03:49.763803+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:58.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'52","reported_seq":183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.631949+0000","last_change":"2024-09-12T00:36:37.241171+0000","last_active":"2024-09-12T01:04:39.631949+0000","last_peered":"2024-09-12T01:04:39.631949+0000","last_clean":"2024-09-12T01:04:39.631949+0000","last_became_active":"2024-09-12T00:36:37.239844+0000","last_became_peered":"2024-09-12T00:36:37.239844+0000","last_unstale":"2024-09-12T01:04:39.631949+0000","last_undegraded":"2024-09-12T01:04:39.631949+0000","last_fullsized":"2024-09-12T01:04:39.631949+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:34.727635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":188,"num_write":97,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574686+0000","last_change":"2024-09-12T00:49:10.632954+0000","last_active":"2024-09-12T01:03:44.574686+0000","last_peered":"2024-09-12T01:03:44.574686+0000","last_clean":"2024-09-12T01:03:44.574686+0000","last_became_active":"2024-09-12T00:49:10.632241+0000","last_became_peered":"2024-09-12T00:49:10.632241+0000","last_unstale":"2024-09-12T01:03:44.574686+0000","last_undegraded":"2024-09-12T01:03:44.574686+0000","last_fullsized":"2024-09-12T01:03:44.574686+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:12.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"267'5","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:14.635438+0000","last_change":"2024-09-12T00:38:10.714497+0000","last_active":"2024-09-12T01:06:14.635438+0000","last_peered":"2024-09-12T01:06:14.635438+0000","last_clean":"2024-09-12T01:06:14.635438+0000","last_became_active":"2024-09-12T00:38:10.713890+0000","last_became_peered":"2024-09-12T00:38:10.713890+0000","last_unstale":"2024-09-12T01:06:14.635438+0000","last_undegraded":"2024-09-12T01:06:14.635438+0000","last_fullsized":"2024-09-12T01:06:14.635438+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.839866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600291+0000","last_change":"2024-09-12T00:38:07.667759+0000","last_active":"2024-09-12T01:03:49.600291+0000","last_peered":"2024-09-12T01:03:49.600291+0000","last_clean":"2024-09-12T01:03:49.600291+0000","last_became_active":"2024-09-12T00:38:07.667180+0000","last_became_peered":"2024-09-12T00:38:07.667180+0000","last_unstale":"2024-09-12T01:03:49.600291+0000","last_undegraded":"2024-09-12T01:03:49.600291+0000","last_fullsized":"2024-09-12T01:03:49.600291+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.515772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'23","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.592102+0000","last_change":"2024-09-12T00:36:37.253314+0000","last_active":"2024-09-12T01:04:38.592102+0000","last_peered":"2024-09-12T01:04:38.592102+0000","last_clean":"2024-09-12T01:04:38.592102+0000","last_became_active":"2024-09-12T00:36:37.248733+0000","last_became_peered":"2024-09-12T00:36:37.248733+0000","last_unstale":"2024-09-12T01:04:38.592102+0000","last_undegraded":"2024-09-12T01:04:38.592102+0000","last_fullsized":"2024-09-12T01:04:38.592102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.498855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.568017+0000","last_change":"2024-09-12T00:49:10.639305+0000","last_active":"2024-09-12T01:03:19.568017+0000","last_peered":"2024-09-12T01:03:19.568017+0000","last_clean":"2024-09-12T01:03:19.568017+0000","last_became_active":"2024-09-12T00:49:10.638628+0000","last_became_peered":"2024-09-12T00:49:10.638628+0000","last_unstale":"2024-09-12T01:03:19.568017+0000","last_undegraded":"2024-09-12T01:03:19.568017+0000","last_fullsized":"2024-09-12T01:03:19.568017+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:12.353339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.582007+0000","last_change":"2024-09-12T00:38:10.691801+0000","last_active":"2024-09-12T01:03:53.582007+0000","last_peered":"2024-09-12T01:03:53.582007+0000","last_clean":"2024-09-12T01:03:53.582007+0000","last_became_active":"2024-09-12T00:38:10.691129+0000","last_became_peered":"2024-09-12T00:38:10.691129+0000","last_unstale":"2024-09-12T01:03:53.582007+0000","last_undegraded":"2024-09-12T01:03:53.582007+0000","last_fullsized":"2024-09-12T01:03:53.582007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:27.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763900+0000","last_change":"2024-09-12T00:38:07.642523+0000","last_active":"2024-09-12T01:03:49.763900+0000","last_peered":"2024-09-12T01:03:49.763900+0000","last_clean":"2024-09-12T01:03:49.763900+0000","last_became_active":"2024-09-12T00:38:07.641719+0000","last_became_peered":"2024-09-12T00:38:07.641719+0000","last_unstale":"2024-09-12T01:03:49.763900+0000","last_undegraded":"2024-09-12T01:03:49.763900+0000","last_fullsized":"2024-09-12T01:03:49.763900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.330959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'60","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.754899+0000","last_change":"2024-09-12T00:36:37.224160+0000","last_active":"2024-09-12T01:04:39.754899+0000","last_peered":"2024-09-12T01:04:39.754899+0000","last_clean":"2024-09-12T01:04:39.754899+0000","last_became_active":"2024-09-12T00:36:37.223432+0000","last_became_peered":"2024-09-12T00:36:37.223432+0000","last_unstale":"2024-09-12T01:04:39.754899+0000","last_undegraded":"2024-09-12T01:04:39.754899+0000","last_fullsized":"2024-09-12T01:04:39.754899+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:13.061629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":212,"num_write":101,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574626+0000","last_change":"2024-09-12T00:49:10.635230+0000","last_active":"2024-09-12T01:03:44.574626+0000","last_peered":"2024-09-12T01:03:44.574626+0000","last_clean":"2024-09-12T01:03:44.574626+0000","last_became_active":"2024-09-12T00:49:10.634783+0000","last_became_peered":"2024-09-12T00:49:10.634783+0000","last_unstale":"2024-09-12T01:03:44.574626+0000","last_undegraded":"2024-09-12T01:03:44.574626+0000","last_fullsized":"2024-09-12T01:03:44.574626+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:22.424861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619873+0000","last_change":"2024-09-12T00:38:10.709528+0000","last_active":"2024-09-12T01:03:54.619873+0000","last_peered":"2024-09-12T01:03:54.619873+0000","last_clean":"2024-09-12T01:03:54.619873+0000","last_became_active":"2024-09-12T00:38:10.708687+0000","last_became_peered":"2024-09-12T00:38:10.708687+0000","last_unstale":"2024-09-12T01:03:54.619873+0000","last_undegraded":"2024-09-12T01:03:54.619873+0000","last_fullsized":"2024-09-12T01:03:54.619873+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.079976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763955+0000","last_change":"2024-09-12T00:38:07.637056+0000","last_active":"2024-09-12T01:03:49.763955+0000","last_peered":"2024-09-12T01:03:49.763955+0000","last_clean":"2024-09-12T01:03:49.763955+0000","last_became_active":"2024-09-12T00:38:07.636298+0000","last_became_peered":"2024-09-12T00:38:07.636298+0000","last_unstale":"2024-09-12T01:03:49.763955+0000","last_undegraded":"2024-09-12T01:03:49.763955+0000","last_fullsized":"2024-09-12T01:03:49.763955+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.591991+0000","last_change":"2024-09-12T00:36:37.253687+0000","last_active":"2024-09-12T01:04:38.591991+0000","last_peered":"2024-09-12T01:04:38.591991+0000","last_clean":"2024-09-12T01:04:38.591991+0000","last_became_active":"2024-09-12T00:36:37.248770+0000","last_became_peered":"2024-09-12T00:36:37.248770+0000","last_unstale":"2024-09-12T01:04:38.591991+0000","last_undegraded":"2024-09-12T01:04:38.591991+0000","last_fullsized":"2024-09-12T01:04:38.591991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.878928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":141,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609918+0000","last_change":"2024-09-12T00:49:10.597538+0000","last_active":"2024-09-12T01:04:29.609918+0000","last_peered":"2024-09-12T01:04:29.609918+0000","last_clean":"2024-09-12T01:04:29.609918+0000","last_became_active":"2024-09-12T00:49:10.596695+0000","last_became_peered":"2024-09-12T00:49:10.596695+0000","last_unstale":"2024-09-12T01:04:29.609918+0000","last_undegraded":"2024-09-12T01:04:29.609918+0000","last_fullsized":"2024-09-12T01:04:29.609918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:51.074598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600399+0000","last_change":"2024-09-12T00:38:10.683836+0000","last_active":"2024-09-12T01:05:13.600399+0000","last_peered":"2024-09-12T01:05:13.600399+0000","last_clean":"2024-09-12T01:05:13.600399+0000","last_became_active":"2024-09-12T00:38:10.683024+0000","last_became_peered":"2024-09-12T00:38:10.683024+0000","last_unstale":"2024-09-12T01:05:13.600399+0000","last_undegraded":"2024-09-12T01:05:13.600399+0000","last_fullsized":"2024-09-12T01:05:13.600399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:08.556147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.761594+0000","last_change":"2024-09-12T00:38:07.664050+0000","last_active":"2024-09-12T01:05:09.761594+0000","last_peered":"2024-09-12T01:05:09.761594+0000","last_clean":"2024-09-12T01:05:09.761594+0000","last_became_active":"2024-09-12T00:38:07.663265+0000","last_became_peered":"2024-09-12T00:38:07.663265+0000","last_unstale":"2024-09-12T01:05:09.761594+0000","last_undegraded":"2024-09-12T01:05:09.761594+0000","last_fullsized":"2024-09-12T01:05:09.761594+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:28.984997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'15","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.579861+0000","last_change":"2024-09-12T00:36:37.248079+0000","last_active":"2024-09-12T01:03:43.579861+0000","last_peered":"2024-09-12T01:03:43.579861+0000","last_clean":"2024-09-12T01:03:43.579861+0000","last_became_active":"2024-09-12T00:36:37.247409+0000","last_became_peered":"2024-09-12T00:36:37.247409+0000","last_unstale":"2024-09-12T01:03:43.579861+0000","last_undegraded":"2024-09-12T01:03:43.579861+0000","last_fullsized":"2024-09-12T01:03:43.579861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:04.933898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":52,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.779758+0000","last_change":"2024-09-12T00:49:10.594239+0000","last_active":"2024-09-12T01:04:59.779758+0000","last_peered":"2024-09-12T01:04:59.779758+0000","last_clean":"2024-09-12T01:04:59.779758+0000","last_became_active":"2024-09-12T00:49:10.593471+0000","last_became_peered":"2024-09-12T00:49:10.593471+0000","last_unstale":"2024-09-12T01:04:59.779758+0000","last_undegraded":"2024-09-12T01:04:59.779758+0000","last_fullsized":"2024-09-12T01:04:59.779758+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:54.840220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"267'4","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321277+0000","last_change":"2024-09-12T00:38:10.709654+0000","last_active":"2024-09-12T01:07:26.321277+0000","last_peered":"2024-09-12T01:07:26.321277+0000","last_clean":"2024-09-12T01:07:26.321277+0000","last_became_active":"2024-09-12T00:38:10.708936+0000","last_became_peered":"2024-09-12T00:38:10.708936+0000","last_unstale":"2024-09-12T01:07:26.321277+0000","last_undegraded":"2024-09-12T01:07:26.321277+0000","last_fullsized":"2024-09-12T01:07:26.321277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:34.439374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'8","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321521+0000","last_change":"2024-09-12T00:38:07.651137+0000","last_active":"2024-09-12T01:07:26.321521+0000","last_peered":"2024-09-12T01:07:26.321521+0000","last_clean":"2024-09-12T01:07:26.321521+0000","last_became_active":"2024-09-12T00:38:07.650419+0000","last_became_peered":"2024-09-12T00:38:07.650419+0000","last_unstale":"2024-09-12T01:07:26.321521+0000","last_undegraded":"2024-09-12T01:07:26.321521+0000","last_fullsized":"2024-09-12T01:07:26.321521+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.557871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'98","reported_seq":352,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.615890+0000","last_change":"2024-09-12T00:36:37.227751+0000","last_active":"2024-09-12T01:03:39.615890+0000","last_peered":"2024-09-12T01:03:39.615890+0000","last_clean":"2024-09-12T01:03:39.615890+0000","last_became_active":"2024-09-12T00:36:37.225615+0000","last_became_peered":"2024-09-12T00:36:37.225615+0000","last_unstale":"2024-09-12T01:03:39.615890+0000","last_undegraded":"2024-09-12T01:03:39.615890+0000","last_fullsized":"2024-09-12T01:03:39.615890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:24.078167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":608,"num_read_kb":444,"num_write":119,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626251+0000","last_change":"2024-09-12T00:49:10.620839+0000","last_active":"2024-09-12T01:04:19.626251+0000","last_peered":"2024-09-12T01:04:19.626251+0000","last_clean":"2024-09-12T01:04:19.626251+0000","last_became_active":"2024-09-12T00:49:10.620169+0000","last_became_peered":"2024-09-12T00:49:10.620169+0000","last_unstale":"2024-09-12T01:04:19.626251+0000","last_undegraded":"2024-09-12T01:04:19.626251+0000","last_fullsized":"2024-09-12T01:04:19.626251+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.688639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.570450+0000","last_change":"2024-09-12T00:38:10.686990+0000","last_active":"2024-09-12T01:03:03.570450+0000","last_peered":"2024-09-12T01:03:03.570450+0000","last_clean":"2024-09-12T01:03:03.570450+0000","last_became_active":"2024-09-12T00:38:10.686216+0000","last_became_peered":"2024-09-12T00:38:10.686216+0000","last_unstale":"2024-09-12T01:03:03.570450+0000","last_undegraded":"2024-09-12T01:03:03.570450+0000","last_fullsized":"2024-09-12T01:03:03.570450+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:24.592600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"267'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.431292+0000","last_change":"2024-09-12T00:38:07.666660+0000","last_active":"2024-09-12T01:07:23.431292+0000","last_peered":"2024-09-12T01:07:23.431292+0000","last_clean":"2024-09-12T01:07:23.431292+0000","last_became_active":"2024-09-12T00:38:07.661932+0000","last_became_peered":"2024-09-12T00:38:07.661932+0000","last_unstale":"2024-09-12T01:07:23.431292+0000","last_undegraded":"2024-09-12T01:07:23.431292+0000","last_fullsized":"2024-09-12T01:07:23.431292+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:30.080552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'12","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.761390+0000","last_change":"2024-09-12T00:36:37.227779+0000","last_active":"2024-09-12T01:03:39.761390+0000","last_peered":"2024-09-12T01:03:39.761390+0000","last_clean":"2024-09-12T01:03:39.761390+0000","last_became_active":"2024-09-12T00:36:37.226992+0000","last_became_peered":"2024-09-12T00:36:37.226992+0000","last_unstale":"2024-09-12T01:03:39.761390+0000","last_undegraded":"2024-09-12T01:03:39.761390+0000","last_fullsized":"2024-09-12T01:03:39.761390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.657729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.771859+0000","last_change":"2024-09-12T00:49:10.598218+0000","last_active":"2024-09-12T01:04:24.771859+0000","last_peered":"2024-09-12T01:04:24.771859+0000","last_clean":"2024-09-12T01:04:24.771859+0000","last_became_active":"2024-09-12T00:49:10.597349+0000","last_became_peered":"2024-09-12T00:49:10.597349+0000","last_unstale":"2024-09-12T01:04:24.771859+0000","last_undegraded":"2024-09-12T01:04:24.771859+0000","last_fullsized":"2024-09-12T01:04:24.771859+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:32.342356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"267'11","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.114642+0000","last_change":"2024-09-12T00:38:10.701647+0000","last_active":"2024-09-12T01:07:26.114642+0000","last_peered":"2024-09-12T01:07:26.114642+0000","last_clean":"2024-09-12T01:07:26.114642+0000","last_became_active":"2024-09-12T00:38:10.700892+0000","last_became_peered":"2024-09-12T00:38:10.700892+0000","last_unstale":"2024-09-12T01:07:26.114642+0000","last_undegraded":"2024-09-12T01:07:26.114642+0000","last_fullsized":"2024-09-12T01:07:26.114642+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:36.388849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":16,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600506+0000","last_change":"2024-09-12T00:38:07.643675+0000","last_active":"2024-09-12T01:05:13.600506+0000","last_peered":"2024-09-12T01:05:13.600506+0000","last_clean":"2024-09-12T01:05:13.600506+0000","last_became_active":"2024-09-12T00:38:07.642924+0000","last_became_peered":"2024-09-12T00:38:07.642924+0000","last_unstale":"2024-09-12T01:05:13.600506+0000","last_undegraded":"2024-09-12T01:05:13.600506+0000","last_fullsized":"2024-09-12T01:05:13.600506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:03.027647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'31","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573415+0000","last_change":"2024-09-12T00:36:37.243786+0000","last_active":"2024-09-12T01:03:39.573415+0000","last_peered":"2024-09-12T01:03:39.573415+0000","last_clean":"2024-09-12T01:03:39.573415+0000","last_became_active":"2024-09-12T00:36:37.238481+0000","last_became_peered":"2024-09-12T00:36:37.238481+0000","last_unstale":"2024-09-12T01:03:39.573415+0000","last_undegraded":"2024-09-12T01:03:39.573415+0000","last_fullsized":"2024-09-12T01:03:39.573415+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:15.555438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":121,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.617607+0000","last_change":"2024-09-12T00:49:10.614315+0000","last_active":"2024-09-12T01:04:59.617607+0000","last_peered":"2024-09-12T01:04:59.617607+0000","last_clean":"2024-09-12T01:04:59.617607+0000","last_became_active":"2024-09-12T00:49:10.613613+0000","last_became_peered":"2024-09-12T00:49:10.613613+0000","last_unstale":"2024-09-12T01:04:59.617607+0000","last_undegraded":"2024-09-12T01:04:59.617607+0000","last_fullsized":"2024-09-12T01:04:59.617607+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:45.422915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.257884+0000","last_change":"2024-09-12T00:38:10.695438+0000","last_active":"2024-09-12T01:07:26.257884+0000","last_peered":"2024-09-12T01:07:26.257884+0000","last_clean":"2024-09-12T01:07:26.257884+0000","last_became_active":"2024-09-12T00:38:10.694714+0000","last_became_peered":"2024-09-12T00:38:10.694714+0000","last_unstale":"2024-09-12T01:07:26.257884+0000","last_undegraded":"2024-09-12T01:07:26.257884+0000","last_fullsized":"2024-09-12T01:07:26.257884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:46.770976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852962+0000","last_change":"2024-09-12T00:38:07.653886+0000","last_active":"2024-09-12T01:07:25.852962+0000","last_peered":"2024-09-12T01:07:25.852962+0000","last_clean":"2024-09-12T01:07:25.852962+0000","last_became_active":"2024-09-12T00:38:07.647225+0000","last_became_peered":"2024-09-12T00:38:07.647225+0000","last_unstale":"2024-09-12T01:07:25.852962+0000","last_undegraded":"2024-09-12T01:07:25.852962+0000","last_fullsized":"2024-09-12T01:07:25.852962+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:14.958030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'12","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573328+0000","last_change":"2024-09-12T00:36:37.249508+0000","last_active":"2024-09-12T01:03:39.573328+0000","last_peered":"2024-09-12T01:03:39.573328+0000","last_clean":"2024-09-12T01:03:39.573328+0000","last_became_active":"2024-09-12T00:36:37.246075+0000","last_became_peered":"2024-09-12T00:36:37.246075+0000","last_unstale":"2024-09-12T01:03:39.573328+0000","last_undegraded":"2024-09-12T01:03:39.573328+0000","last_fullsized":"2024-09-12T01:03:39.573328+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:45.712512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.759397+0000","last_change":"2024-09-12T00:49:10.598511+0000","last_active":"2024-09-12T01:04:59.759397+0000","last_peered":"2024-09-12T01:04:59.759397+0000","last_clean":"2024-09-12T01:04:59.759397+0000","last_became_active":"2024-09-12T00:49:10.597773+0000","last_became_peered":"2024-09-12T00:49:10.597773+0000","last_unstale":"2024-09-12T01:04:59.759397+0000","last_undegraded":"2024-09-12T01:04:59.759397+0000","last_fullsized":"2024-09-12T01:04:59.759397+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:51.989977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.782946+0000","last_change":"2024-09-12T00:38:10.698369+0000","last_active":"2024-09-12T01:07:25.782946+0000","last_peered":"2024-09-12T01:07:25.782946+0000","last_clean":"2024-09-12T01:07:25.782946+0000","last_became_active":"2024-09-12T00:38:10.697403+0000","last_became_peered":"2024-09-12T00:38:10.697403+0000","last_unstale":"2024-09-12T01:07:25.782946+0000","last_undegraded":"2024-09-12T01:07:25.782946+0000","last_fullsized":"2024-09-12T01:07:25.782946+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:19.999588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:19.636825+0000","last_change":"2024-09-12T00:38:07.668475+0000","last_active":"2024-09-12T01:06:19.636825+0000","last_peered":"2024-09-12T01:06:19.636825+0000","last_clean":"2024-09-12T01:06:19.636825+0000","last_became_active":"2024-09-12T00:38:07.667447+0000","last_became_peered":"2024-09-12T00:38:07.667447+0000","last_unstale":"2024-09-12T01:06:19.636825+0000","last_undegraded":"2024-09-12T01:06:19.636825+0000","last_fullsized":"2024-09-12T01:06:19.636825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:23.306315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.758150+0000","last_change":"2024-09-12T00:36:37.240933+0000","last_active":"2024-09-12T01:04:54.758150+0000","last_peered":"2024-09-12T01:04:54.758150+0000","last_clean":"2024-09-12T01:04:54.758150+0000","last_became_active":"2024-09-12T00:36:37.239946+0000","last_became_peered":"2024-09-12T00:36:37.239946+0000","last_unstale":"2024-09-12T01:04:54.758150+0000","last_undegraded":"2024-09-12T01:04:54.758150+0000","last_fullsized":"2024-09-12T01:04:54.758150+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:57.116646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.597511+0000","last_change":"2024-09-12T00:49:10.630825+0000","last_active":"2024-09-12T01:04:59.597511+0000","last_peered":"2024-09-12T01:04:59.597511+0000","last_clean":"2024-09-12T01:04:59.597511+0000","last_became_active":"2024-09-12T00:49:10.629903+0000","last_became_peered":"2024-09-12T00:49:10.629903+0000","last_unstale":"2024-09-12T01:04:59.597511+0000","last_undegraded":"2024-09-12T01:04:59.597511+0000","last_fullsized":"2024-09-12T01:04:59.597511+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:07.324326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.815403+0000","last_change":"2024-09-12T00:38:10.714505+0000","last_active":"2024-09-12T01:07:26.815403+0000","last_peered":"2024-09-12T01:07:26.815403+0000","last_clean":"2024-09-12T01:07:26.815403+0000","last_became_active":"2024-09-12T00:38:10.708820+0000","last_became_peered":"2024-09-12T00:38:10.708820+0000","last_unstale":"2024-09-12T01:07:26.815403+0000","last_undegraded":"2024-09-12T01:07:26.815403+0000","last_fullsized":"2024-09-12T01:07:26.815403+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:21.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'2","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:28.418371+0000","last_change":"2024-09-12T00:38:07.645572+0000","last_active":"2024-09-12T01:06:28.418371+0000","last_peered":"2024-09-12T01:06:28.418371+0000","last_clean":"2024-09-12T01:06:28.418371+0000","last_became_active":"2024-09-12T00:38:07.644752+0000","last_became_peered":"2024-09-12T00:38:07.644752+0000","last_unstale":"2024-09-12T01:06:28.418371+0000","last_undegraded":"2024-09-12T01:06:28.418371+0000","last_fullsized":"2024-09-12T01:06:28.418371+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:27.156732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"267'56","reported_seq":202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.615105+0000","last_change":"2024-09-12T00:36:37.247146+0000","last_active":"2024-09-12T01:04:49.615105+0000","last_peered":"2024-09-12T01:04:49.615105+0000","last_clean":"2024-09-12T01:04:49.615105+0000","last_became_active":"2024-09-12T00:36:37.246402+0000","last_became_peered":"2024-09-12T00:36:37.246402+0000","last_unstale":"2024-09-12T01:04:49.615105+0000","last_undegraded":"2024-09-12T01:04:49.615105+0000","last_fullsized":"2024-09-12T01:04:49.615105+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:50.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":211,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.597068+0000","last_change":"2024-09-12T00:49:10.627636+0000","last_active":"2024-09-12T01:04:58.597068+0000","last_peered":"2024-09-12T01:04:58.597068+0000","last_clean":"2024-09-12T01:04:58.597068+0000","last_became_active":"2024-09-12T00:49:10.626918+0000","last_became_peered":"2024-09-12T00:49:10.626918+0000","last_unstale":"2024-09-12T01:04:58.597068+0000","last_undegraded":"2024-09-12T01:04:58.597068+0000","last_fullsized":"2024-09-12T01:04:58.597068+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.462430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"267'7","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:34.416564+0000","last_change":"2024-09-12T00:38:10.706342+0000","last_active":"2024-09-12T01:06:34.416564+0000","last_peered":"2024-09-12T01:06:34.416564+0000","last_clean":"2024-09-12T01:06:34.416564+0000","last_became_active":"2024-09-12T00:38:10.705817+0000","last_became_peered":"2024-09-12T00:38:10.705817+0000","last_unstale":"2024-09-12T01:06:34.416564+0000","last_undegraded":"2024-09-12T01:06:34.416564+0000","last_fullsized":"2024-09-12T01:06:34.416564+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:39.296427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:24.428685+0000","last_change":"2024-09-12T00:38:07.655064+0000","last_active":"2024-09-12T01:07:24.428685+0000","last_peered":"2024-09-12T01:07:24.428685+0000","last_clean":"2024-09-12T01:07:24.428685+0000","last_became_active":"2024-09-12T00:38:07.654306+0000","last_became_peered":"2024-09-12T00:38:07.654306+0000","last_unstale":"2024-09-12T01:07:24.428685+0000","last_undegraded":"2024-09-12T01:07:24.428685+0000","last_fullsized":"2024-09-12T01:07:24.428685+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:13.318498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'60","reported_seq":249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.594897+0000","last_change":"2024-09-12T00:36:37.227571+0000","last_active":"2024-09-12T01:04:49.594897+0000","last_peered":"2024-09-12T01:04:49.594897+0000","last_clean":"2024-09-12T01:04:49.594897+0000","last_became_active":"2024-09-12T00:36:37.226845+0000","last_became_peered":"2024-09-12T00:36:37.226845+0000","last_unstale":"2024-09-12T01:04:49.594897+0000","last_undegraded":"2024-09-12T01:04:49.594897+0000","last_fullsized":"2024-09-12T01:04:49.594897+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.611933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":408,"num_read_kb":294,"num_write":66,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582015+0000","last_change":"2024-09-12T00:49:10.623449+0000","last_active":"2024-09-12T01:03:49.582015+0000","last_peered":"2024-09-12T01:03:49.582015+0000","last_clean":"2024-09-12T01:03:49.582015+0000","last_became_active":"2024-09-12T00:49:10.615566+0000","last_became_peered":"2024-09-12T00:49:10.615566+0000","last_unstale":"2024-09-12T01:03:49.582015+0000","last_undegraded":"2024-09-12T01:03:49.582015+0000","last_fullsized":"2024-09-12T01:03:49.582015+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:25.428504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'7","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.115026+0000","last_change":"2024-09-12T00:38:10.705943+0000","last_active":"2024-09-12T01:07:26.115026+0000","last_peered":"2024-09-12T01:07:26.115026+0000","last_clean":"2024-09-12T01:07:26.115026+0000","last_became_active":"2024-09-12T00:38:10.705207+0000","last_became_peered":"2024-09-12T00:38:10.705207+0000","last_unstale":"2024-09-12T01:07:26.115026+0000","last_undegraded":"2024-09-12T01:07:26.115026+0000","last_fullsized":"2024-09-12T01:07:26.115026+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:44.933546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'11","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852138+0000","last_change":"2024-09-12T00:38:07.663618+0000","last_active":"2024-09-12T01:07:25.852138+0000","last_peered":"2024-09-12T01:07:25.852138+0000","last_clean":"2024-09-12T01:07:25.852138+0000","last_became_active":"2024-09-12T00:38:07.663031+0000","last_became_peered":"2024-09-12T00:38:07.663031+0000","last_unstale":"2024-09-12T01:07:25.852138+0000","last_undegraded":"2024-09-12T01:07:25.852138+0000","last_fullsized":"2024-09-12T01:07:25.852138+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.928917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24578,"num_write":26,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'40","reported_seq":152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587717+0000","last_change":"2024-09-12T00:36:37.251472+0000","last_active":"2024-09-12T01:04:49.587717+0000","last_peered":"2024-09-12T01:04:49.587717+0000","last_clean":"2024-09-12T01:04:49.587717+0000","last_became_active":"2024-09-12T00:36:37.250649+0000","last_became_peered":"2024-09-12T00:36:37.250649+0000","last_unstale":"2024-09-12T01:04:49.587717+0000","last_undegraded":"2024-09-12T01:04:49.587717+0000","last_fullsized":"2024-09-12T01:04:49.587717+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:22.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":70,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582037+0000","last_change":"2024-09-12T00:49:10.634985+0000","last_active":"2024-09-12T01:03:49.582037+0000","last_peered":"2024-09-12T01:03:49.582037+0000","last_clean":"2024-09-12T01:03:49.582037+0000","last_became_active":"2024-09-12T00:49:10.634433+0000","last_became_peered":"2024-09-12T00:49:10.634433+0000","last_unstale":"2024-09-12T01:03:49.582037+0000","last_undegraded":"2024-09-12T01:03:49.582037+0000","last_fullsized":"2024-09-12T01:03:49.582037+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:02.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622352+0000","last_change":"2024-09-12T00:38:10.718774+0000","last_active":"2024-09-12T01:05:19.622352+0000","last_peered":"2024-09-12T01:05:19.622352+0000","last_clean":"2024-09-12T01:05:19.622352+0000","last_became_active":"2024-09-12T00:38:10.717307+0000","last_became_peered":"2024-09-12T00:38:10.717307+0000","last_unstale":"2024-09-12T01:05:19.622352+0000","last_undegraded":"2024-09-12T01:05:19.622352+0000","last_fullsized":"2024-09-12T01:05:19.622352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:10.837950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'10","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.523588+0000","last_change":"2024-09-12T00:38:07.660476+0000","last_active":"2024-09-12T01:07:27.523588+0000","last_peered":"2024-09-12T01:07:27.523588+0000","last_clean":"2024-09-12T01:07:27.523588+0000","last_became_active":"2024-09-12T00:38:07.659692+0000","last_became_peered":"2024-09-12T00:38:07.659692+0000","last_unstale":"2024-09-12T01:07:27.523588+0000","last_undegraded":"2024-09-12T01:07:27.523588+0000","last_fullsized":"2024-09-12T01:07:27.523588+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:05.518531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'22","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.817272+0000","last_change":"2024-09-12T00:36:37.228455+0000","last_active":"2024-09-12T01:05:02.817272+0000","last_peered":"2024-09-12T01:05:02.817272+0000","last_clean":"2024-09-12T01:05:02.817272+0000","last_became_active":"2024-09-12T00:36:37.226892+0000","last_became_peered":"2024-09-12T00:36:37.226892+0000","last_unstale":"2024-09-12T01:05:02.817272+0000","last_undegraded":"2024-09-12T01:05:02.817272+0000","last_fullsized":"2024-09-12T01:05:02.817272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:09.675401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622226+0000","last_change":"2024-09-12T00:49:10.632589+0000","last_active":"2024-09-12T01:05:19.622226+0000","last_peered":"2024-09-12T01:05:19.622226+0000","last_clean":"2024-09-12T01:05:19.622226+0000","last_became_active":"2024-09-12T00:49:10.631961+0000","last_became_peered":"2024-09-12T00:49:10.631961+0000","last_unstale":"2024-09-12T01:05:19.622226+0000","last_undegraded":"2024-09-12T01:05:19.622226+0000","last_fullsized":"2024-09-12T01:05:19.622226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:28.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'2","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:24.415112+0000","last_change":"2024-09-12T00:38:10.719998+0000","last_active":"2024-09-12T01:06:24.415112+0000","last_peered":"2024-09-12T01:06:24.415112+0000","last_clean":"2024-09-12T01:06:24.415112+0000","last_became_active":"2024-09-12T00:38:10.719337+0000","last_became_peered":"2024-09-12T00:38:10.719337+0000","last_unstale":"2024-09-12T01:06:24.415112+0000","last_undegraded":"2024-09-12T01:06:24.415112+0000","last_fullsized":"2024-09-12T01:06:24.415112+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:16.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"267'7","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:19.777203+0000","last_change":"2024-09-12T00:38:07.640549+0000","last_active":"2024-09-12T01:06:19.777203+0000","last_peered":"2024-09-12T01:06:19.777203+0000","last_clean":"2024-09-12T01:06:19.777203+0000","last_became_active":"2024-09-12T00:38:07.639751+0000","last_became_peered":"2024-09-12T00:38:07.639751+0000","last_unstale":"2024-09-12T01:06:19.777203+0000","last_undegraded":"2024-09-12T01:06:19.777203+0000","last_fullsized":"2024-09-12T01:06:19.777203+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:17.815510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'40","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743281+0000","last_change":"2024-09-12T00:36:37.248750+0000","last_active":"2024-09-12T01:03:49.743281+0000","last_peered":"2024-09-12T01:03:49.743281+0000","last_clean":"2024-09-12T01:03:49.743281+0000","last_became_active":"2024-09-12T00:36:37.248176+0000","last_became_peered":"2024-09-12T00:36:37.248176+0000","last_unstale":"2024-09-12T01:03:49.743281+0000","last_undegraded":"2024-09-12T01:03:49.743281+0000","last_fullsized":"2024-09-12T01:03:49.743281+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.812968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.616997+0000","last_change":"2024-09-12T00:49:10.635581+0000","last_active":"2024-09-12T01:03:44.616997+0000","last_peered":"2024-09-12T01:03:44.616997+0000","last_clean":"2024-09-12T01:03:44.616997+0000","last_became_active":"2024-09-12T00:49:10.634965+0000","last_became_peered":"2024-09-12T00:49:10.634965+0000","last_unstale":"2024-09-12T01:03:44.616997+0000","last_undegraded":"2024-09-12T01:03:44.616997+0000","last_fullsized":"2024-09-12T01:03:44.616997+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:00.298075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:24.416191+0000","last_change":"2024-09-12T00:38:10.695802+0000","last_active":"2024-09-12T01:06:24.416191+0000","last_peered":"2024-09-12T01:06:24.416191+0000","last_clean":"2024-09-12T01:06:24.416191+0000","last_became_active":"2024-09-12T00:38:10.694812+0000","last_became_peered":"2024-09-12T00:38:10.694812+0000","last_unstale":"2024-09-12T01:06:24.416191+0000","last_undegraded":"2024-09-12T01:06:24.416191+0000","last_fullsized":"2024-09-12T01:06:24.416191+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:47.266227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'6","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321457+0000","last_change":"2024-09-12T00:38:07.648782+0000","last_active":"2024-09-12T01:07:26.321457+0000","last_peered":"2024-09-12T01:07:26.321457+0000","last_clean":"2024-09-12T01:07:26.321457+0000","last_became_active":"2024-09-12T00:38:07.648061+0000","last_became_peered":"2024-09-12T00:38:07.648061+0000","last_unstale":"2024-09-12T01:07:26.321457+0000","last_undegraded":"2024-09-12T01:07:26.321457+0000","last_fullsized":"2024-09-12T01:07:26.321457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:11.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'35","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.768877+0000","last_change":"2024-09-12T00:36:37.244821+0000","last_active":"2024-09-12T01:04:21.768877+0000","last_peered":"2024-09-12T01:04:21.768877+0000","last_clean":"2024-09-12T01:04:21.768877+0000","last_became_active":"2024-09-12T00:36:37.244096+0000","last_became_peered":"2024-09-12T00:36:37.244096+0000","last_unstale":"2024-09-12T01:04:21.768877+0000","last_undegraded":"2024-09-12T01:04:21.768877+0000","last_fullsized":"2024-09-12T01:04:21.768877+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:50.671276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":53,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:23.588773+0000","last_change":"2024-09-12T00:49:10.626675+0000","last_active":"2024-09-12T01:04:23.588773+0000","last_peered":"2024-09-12T01:04:23.588773+0000","last_clean":"2024-09-12T01:04:23.588773+0000","last_became_active":"2024-09-12T00:49:10.621968+0000","last_became_peered":"2024-09-12T00:49:10.621968+0000","last_unstale":"2024-09-12T01:04:23.588773+0000","last_undegraded":"2024-09-12T01:04:23.588773+0000","last_fullsized":"2024-09-12T01:04:23.588773+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.338078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594658+0000","last_change":"2024-09-12T00:38:10.718573+0000","last_active":"2024-09-12T01:05:19.594658+0000","last_peered":"2024-09-12T01:05:19.594658+0000","last_clean":"2024-09-12T01:05:19.594658+0000","last_became_active":"2024-09-12T00:38:10.717877+0000","last_became_peered":"2024-09-12T00:38:10.717877+0000","last_unstale":"2024-09-12T01:05:19.594658+0000","last_undegraded":"2024-09-12T01:05:19.594658+0000","last_fullsized":"2024-09-12T01:05:19.594658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:53.348539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"267'5","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852871+0000","last_change":"2024-09-12T00:38:07.649510+0000","last_active":"2024-09-12T01:07:25.852871+0000","last_peered":"2024-09-12T01:07:25.852871+0000","last_clean":"2024-09-12T01:07:25.852871+0000","last_became_active":"2024-09-12T00:38:07.648786+0000","last_became_peered":"2024-09-12T00:38:07.648786+0000","last_unstale":"2024-09-12T01:07:25.852871+0000","last_undegraded":"2024-09-12T01:07:25.852871+0000","last_fullsized":"2024-09-12T01:07:25.852871+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:57.221376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.741862+0000","last_change":"2024-09-12T00:36:37.238021+0000","last_active":"2024-09-12T01:03:44.741862+0000","last_peered":"2024-09-12T01:03:44.741862+0000","last_clean":"2024-09-12T01:03:44.741862+0000","last_became_active":"2024-09-12T00:36:37.237365+0000","last_became_peered":"2024-09-12T00:36:37.237365+0000","last_unstale":"2024-09-12T01:03:44.741862+0000","last_undegraded":"2024-09-12T01:03:44.741862+0000","last_fullsized":"2024-09-12T01:03:44.741862+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:44.575480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":152,"num_write":73,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.582095+0000","last_change":"2024-09-12T00:49:10.628791+0000","last_active":"2024-09-12T01:04:24.582095+0000","last_peered":"2024-09-12T01:04:24.582095+0000","last_clean":"2024-09-12T01:04:24.582095+0000","last_became_active":"2024-09-12T00:49:10.628111+0000","last_became_peered":"2024-09-12T00:49:10.628111+0000","last_unstale":"2024-09-12T01:04:24.582095+0000","last_undegraded":"2024-09-12T01:04:24.582095+0000","last_fullsized":"2024-09-12T01:04:24.582095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.022373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'6","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.186406+0000","last_change":"2024-09-12T00:38:10.702362+0000","last_active":"2024-09-12T01:07:26.186406+0000","last_peered":"2024-09-12T01:07:26.186406+0000","last_clean":"2024-09-12T01:07:26.186406+0000","last_became_active":"2024-09-12T00:38:10.696553+0000","last_became_peered":"2024-09-12T00:38:10.696553+0000","last_unstale":"2024-09-12T01:07:26.186406+0000","last_undegraded":"2024-09-12T01:07:26.186406+0000","last_fullsized":"2024-09-12T01:07:26.186406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:21.987094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3168,"num_write":6,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'4","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:19.427237+0000","last_change":"2024-09-12T00:38:07.670741+0000","last_active":"2024-09-12T01:07:19.427237+0000","last_peered":"2024-09-12T01:07:19.427237+0000","last_clean":"2024-09-12T01:07:19.427237+0000","last_became_active":"2024-09-12T00:38:07.669959+0000","last_became_peered":"2024-09-12T00:38:07.669959+0000","last_unstale":"2024-09-12T01:07:19.427237+0000","last_undegraded":"2024-09-12T01:07:19.427237+0000","last_fullsized":"2024-09-12T01:07:19.427237+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:21.025381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":96,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617129+0000","last_change":"2024-09-12T00:36:37.229680+0000","last_active":"2024-09-12T01:03:44.617129+0000","last_peered":"2024-09-12T01:03:44.617129+0000","last_clean":"2024-09-12T01:03:44.617129+0000","last_became_active":"2024-09-12T00:36:37.228954+0000","last_became_peered":"2024-09-12T00:36:37.228954+0000","last_unstale":"2024-09-12T01:03:44.617129+0000","last_undegraded":"2024-09-12T01:03:44.617129+0000","last_fullsized":"2024-09-12T01:03:44.617129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:42.010486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600391+0000","last_change":"2024-09-12T00:49:10.593501+0000","last_active":"2024-09-12T01:03:49.600391+0000","last_peered":"2024-09-12T01:03:49.600391+0000","last_clean":"2024-09-12T01:03:49.600391+0000","last_became_active":"2024-09-12T00:49:10.592753+0000","last_became_peered":"2024-09-12T00:49:10.592753+0000","last_unstale":"2024-09-12T01:03:49.600391+0000","last_undegraded":"2024-09-12T01:03:49.600391+0000","last_fullsized":"2024-09-12T01:03:49.600391+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:14.659960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763857+0000","last_change":"2024-09-12T00:38:10.703751+0000","last_active":"2024-09-12T01:05:19.763857+0000","last_peered":"2024-09-12T01:05:19.763857+0000","last_clean":"2024-09-12T01:05:19.763857+0000","last_became_active":"2024-09-12T00:38:10.702958+0000","last_became_peered":"2024-09-12T00:38:10.702958+0000","last_unstale":"2024-09-12T01:05:19.763857+0000","last_undegraded":"2024-09-12T01:05:19.763857+0000","last_fullsized":"2024-09-12T01:05:19.763857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:12.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.595391+0000","last_change":"2024-09-12T00:38:07.650713+0000","last_active":"2024-09-12T01:05:14.595391+0000","last_peered":"2024-09-12T01:05:14.595391+0000","last_clean":"2024-09-12T01:05:14.595391+0000","last_became_active":"2024-09-12T00:38:07.650035+0000","last_became_peered":"2024-09-12T00:38:07.650035+0000","last_unstale":"2024-09-12T01:05:14.595391+0000","last_undegraded":"2024-09-12T01:05:14.595391+0000","last_fullsized":"2024-09-12T01:05:14.595391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.848243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"258'11","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617043+0000","last_change":"2024-09-12T00:36:37.223313+0000","last_active":"2024-09-12T01:03:44.617043+0000","last_peered":"2024-09-12T01:03:44.617043+0000","last_clean":"2024-09-12T01:03:44.617043+0000","last_became_active":"2024-09-12T00:36:37.222545+0000","last_became_peered":"2024-09-12T00:36:37.222545+0000","last_unstale":"2024-09-12T01:03:44.617043+0000","last_undegraded":"2024-09-12T01:03:44.617043+0000","last_fullsized":"2024-09-12T01:03:44.617043+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:28.704973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618658+0000","last_change":"2024-09-12T00:49:10.613325+0000","last_active":"2024-09-12T01:03:49.618658+0000","last_peered":"2024-09-12T01:03:49.618658+0000","last_clean":"2024-09-12T01:03:49.618658+0000","last_became_active":"2024-09-12T00:49:10.612680+0000","last_became_peered":"2024-09-12T00:49:10.612680+0000","last_unstale":"2024-09-12T01:03:49.618658+0000","last_undegraded":"2024-09-12T01:03:49.618658+0000","last_fullsized":"2024-09-12T01:03:49.618658+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.686773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763779+0000","last_change":"2024-09-12T00:38:10.698273+0000","last_active":"2024-09-12T01:05:19.763779+0000","last_peered":"2024-09-12T01:05:19.763779+0000","last_clean":"2024-09-12T01:05:19.763779+0000","last_became_active":"2024-09-12T00:38:10.691107+0000","last_became_peered":"2024-09-12T00:38:10.691107+0000","last_unstale":"2024-09-12T01:05:19.763779+0000","last_undegraded":"2024-09-12T01:05:19.763779+0000","last_fullsized":"2024-09-12T01:05:19.763779+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.535876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"267'6","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.320162+0000","last_change":"2024-09-12T00:38:07.657937+0000","last_active":"2024-09-12T01:07:26.320162+0000","last_peered":"2024-09-12T01:07:26.320162+0000","last_clean":"2024-09-12T01:07:26.320162+0000","last_became_active":"2024-09-12T00:38:07.657155+0000","last_became_peered":"2024-09-12T00:38:07.657155+0000","last_unstale":"2024-09-12T01:07:26.320162+0000","last_undegraded":"2024-09-12T01:07:26.320162+0000","last_fullsized":"2024-09-12T01:07:26.320162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:32.225678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"267'20","reported_seq":101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.541498+0000","last_change":"2024-09-12T00:36:37.222927+0000","last_active":"2024-09-12T01:05:02.541498+0000","last_peered":"2024-09-12T01:05:02.541498+0000","last_clean":"2024-09-12T01:05:02.541498+0000","last_became_active":"2024-09-12T00:36:37.221980+0000","last_became_peered":"2024-09-12T00:36:37.221980+0000","last_unstale":"2024-09-12T01:05:02.541498+0000","last_undegraded":"2024-09-12T01:05:02.541498+0000","last_fullsized":"2024-09-12T01:05:02.541498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:08.085009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'360","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.700958+0000","last_change":"2024-09-12T00:21:42.528797+0000","last_active":"2024-09-12T01:07:27.700958+0000","last_peered":"2024-09-12T01:07:27.700958+0000","last_clean":"2024-09-12T01:07:27.700958+0000","last_became_active":"2024-09-12T00:21:42.528236+0000","last_became_peered":"2024-09-12T00:21:42.528236+0000","last_unstale":"2024-09-12T01:07:27.700958+0000","last_undegraded":"2024-09-12T01:07:27.700958+0000","last_fullsized":"2024-09-12T01:07:27.700958+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812630,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":8804,"num_write":1192,"num_write_kb":22191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'52","reported_seq":604,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.310893+0000","last_change":"2024-09-12T00:21:44.504479+0000","last_active":"2024-09-12T01:05:23.310893+0000","last_peered":"2024-09-12T01:05:23.310893+0000","last_clean":"2024-09-12T01:05:23.310893+0000","last_became_active":"2024-09-12T00:21:44.499494+0000","last_became_peered":"2024-09-12T00:21:44.499494+0000","last_unstale":"2024-09-12T01:05:23.310893+0000","last_undegraded":"2024-09-12T01:05:23.310893+0000","last_fullsized":"2024-09-12T01:05:23.310893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:43.715105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":187,"num_write":87,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'464","reported_seq":1143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.655988+0000","last_change":"2024-09-12T00:21:42.512960+0000","last_active":"2024-09-12T01:07:27.655988+0000","last_peered":"2024-09-12T01:07:27.655988+0000","last_clean":"2024-09-12T01:07:27.655988+0000","last_became_active":"2024-09-12T00:21:42.511901+0000","last_became_peered":"2024-09-12T00:21:42.511901+0000","last_unstale":"2024-09-12T01:07:27.655988+0000","last_undegraded":"2024-09-12T01:07:27.655988+0000","last_fullsized":"2024-09-12T01:07:27.655988+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759316,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":14453,"num_write":1384,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'102","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.581466+0000","last_change":"2024-09-12T00:21:44.498811+0000","last_active":"2024-09-12T01:05:38.581466+0000","last_peered":"2024-09-12T01:05:38.581466+0000","last_clean":"2024-09-12T01:05:38.581466+0000","last_became_active":"2024-09-12T00:21:44.498503+0000","last_became_peered":"2024-09-12T00:21:44.498503+0000","last_unstale":"2024-09-12T01:05:38.581466+0000","last_undegraded":"2024-09-12T01:05:38.581466+0000","last_fullsized":"2024-09-12T01:05:38.581466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:31.431088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":343,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'310","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.694120+0000","last_change":"2024-09-12T00:21:42.535770+0000","last_active":"2024-09-12T01:07:27.694120+0000","last_peered":"2024-09-12T01:07:27.694120+0000","last_clean":"2024-09-12T01:07:27.694120+0000","last_became_active":"2024-09-12T00:21:42.535071+0000","last_became_peered":"2024-09-12T00:21:42.535071+0000","last_unstale":"2024-09-12T01:07:27.694120+0000","last_undegraded":"2024-09-12T01:07:27.694120+0000","last_fullsized":"2024-09-12T01:07:27.694120+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328055,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":751,"num_read_kb":29454,"num_write":966,"num_write_kb":25069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'217","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.419030+0000","last_change":"2024-09-12T00:21:44.498204+0000","last_active":"2024-09-12T01:06:44.419030+0000","last_peered":"2024-09-12T01:06:44.419030+0000","last_clean":"2024-09-12T01:06:44.419030+0000","last_became_active":"2024-09-12T00:21:44.497569+0000","last_became_peered":"2024-09-12T00:21:44.497569+0000","last_unstale":"2024-09-12T01:06:44.419030+0000","last_undegraded":"2024-09-12T01:06:44.419030+0000","last_fullsized":"2024-09-12T01:06:44.419030+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.653439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":917,"num_read_kb":735,"num_write":338,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.666634+0000","last_change":"2024-09-12T00:21:42.528466+0000","last_active":"2024-09-12T01:07:27.666634+0000","last_peered":"2024-09-12T01:07:27.666634+0000","last_clean":"2024-09-12T01:07:27.666634+0000","last_became_active":"2024-09-12T00:21:42.528057+0000","last_became_peered":"2024-09-12T00:21:42.528057+0000","last_unstale":"2024-09-12T01:07:27.666634+0000","last_undegraded":"2024-09-12T01:07:27.666634+0000","last_fullsized":"2024-09-12T01:07:27.666634+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:39.430016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2018898,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":607,"num_read_kb":8621,"num_write":1230,"num_write_kb":31712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'137","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.579683+0000","last_change":"2024-09-12T00:21:44.480273+0000","last_active":"2024-09-12T01:04:14.579683+0000","last_peered":"2024-09-12T01:04:14.579683+0000","last_clean":"2024-09-12T01:04:14.579683+0000","last_became_active":"2024-09-12T00:21:44.479037+0000","last_became_peered":"2024-09-12T00:21:44.479037+0000","last_unstale":"2024-09-12T01:04:14.579683+0000","last_undegraded":"2024-09-12T01:04:14.579683+0000","last_fullsized":"2024-09-12T01:04:14.579683+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:47.501743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":200,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'373","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.667508+0000","last_change":"2024-09-12T00:21:42.515893+0000","last_active":"2024-09-12T01:07:27.667508+0000","last_peered":"2024-09-12T01:07:27.667508+0000","last_clean":"2024-09-12T01:07:27.667508+0000","last_became_active":"2024-09-12T00:21:42.515464+0000","last_became_peered":"2024-09-12T00:21:42.515464+0000","last_unstale":"2024-09-12T01:07:27.667508+0000","last_undegraded":"2024-09-12T01:07:27.667508+0000","last_fullsized":"2024-09-12T01:07:27.667508+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:46.082315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":28078,"num_write":1274,"num_write_kb":29332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'4286","reported_seq":4956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.151752+0000","last_change":"2024-09-12T00:21:44.496471+0000","last_active":"2024-09-12T01:05:25.151752+0000","last_peered":"2024-09-12T01:05:25.151752+0000","last_clean":"2024-09-12T01:05:25.151752+0000","last_became_active":"2024-09-12T00:21:44.495734+0000","last_became_peered":"2024-09-12T00:21:44.495734+0000","last_unstale":"2024-09-12T01:05:25.151752+0000","last_undegraded":"2024-09-12T01:05:25.151752+0000","last_fullsized":"2024-09-12T01:05:25.151752+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":3000,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:24.946491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17226,"num_read_kb":14426,"num_write":6464,"num_write_kb":3218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'375","reported_seq":1010,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.689978+0000","last_change":"2024-09-12T00:21:42.534954+0000","last_active":"2024-09-12T01:07:27.689978+0000","last_peered":"2024-09-12T01:07:27.689978+0000","last_clean":"2024-09-12T01:07:27.689978+0000","last_became_active":"2024-09-12T00:21:42.534582+0000","last_became_peered":"2024-09-12T00:21:42.534582+0000","last_unstale":"2024-09-12T01:07:27.689978+0000","last_undegraded":"2024-09-12T01:07:27.689978+0000","last_fullsized":"2024-09-12T01:07:27.689978+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:20.859536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":25303,"num_write":1128,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'161","reported_seq":808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.330913+0000","last_change":"2024-09-12T00:21:44.511727+0000","last_active":"2024-09-12T01:06:07.330913+0000","last_peered":"2024-09-12T01:06:07.330913+0000","last_clean":"2024-09-12T01:06:07.330913+0000","last_became_active":"2024-09-12T00:21:44.510410+0000","last_became_peered":"2024-09-12T00:21:44.510410+0000","last_unstale":"2024-09-12T01:06:07.330913+0000","last_undegraded":"2024-09-12T01:06:07.330913+0000","last_fullsized":"2024-09-12T01:06:07.330913+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":577,"num_write":213,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1231,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.641618+0000","last_change":"2024-09-12T00:21:42.531705+0000","last_active":"2024-09-12T01:07:27.641618+0000","last_peered":"2024-09-12T01:07:27.641618+0000","last_clean":"2024-09-12T01:07:27.641618+0000","last_became_active":"2024-09-12T00:21:42.530155+0000","last_became_peered":"2024-09-12T00:21:42.530155+0000","last_unstale":"2024-09-12T01:07:27.641618+0000","last_undegraded":"2024-09-12T01:07:27.641618+0000","last_fullsized":"2024-09-12T01:07:27.641618+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:16.745757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1030,"num_read_kb":26574,"num_write":1137,"num_write_kb":18888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'160","reported_seq":771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.766084+0000","last_change":"2024-09-12T00:21:44.484205+0000","last_active":"2024-09-12T01:05:29.766084+0000","last_peered":"2024-09-12T01:05:29.766084+0000","last_clean":"2024-09-12T01:05:29.766084+0000","last_became_active":"2024-09-12T00:21:44.483825+0000","last_became_peered":"2024-09-12T00:21:44.483825+0000","last_unstale":"2024-09-12T01:05:29.766084+0000","last_undegraded":"2024-09-12T01:05:29.766084+0000","last_fullsized":"2024-09-12T01:05:29.766084+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":577,"num_write":242,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'407","reported_seq":1073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.682711+0000","last_change":"2024-09-12T00:22:12.621823+0000","last_active":"2024-09-12T01:07:27.682711+0000","last_peered":"2024-09-12T01:07:27.682711+0000","last_clean":"2024-09-12T01:07:27.682711+0000","last_became_active":"2024-09-12T00:22:12.620753+0000","last_became_peered":"2024-09-12T00:22:12.620753+0000","last_unstale":"2024-09-12T01:07:27.682711+0000","last_undegraded":"2024-09-12T01:07:27.682711+0000","last_fullsized":"2024-09-12T01:07:27.682711+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:42.887841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":588,"num_read_kb":16569,"num_write":1344,"num_write_kb":33151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'179","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.868849+0000","last_change":"2024-09-12T00:21:44.528812+0000","last_active":"2024-09-12T01:05:49.868849+0000","last_peered":"2024-09-12T01:05:49.868849+0000","last_clean":"2024-09-12T01:05:49.868849+0000","last_became_active":"2024-09-12T00:21:44.528311+0000","last_became_peered":"2024-09-12T00:21:44.528311+0000","last_unstale":"2024-09-12T01:05:49.868849+0000","last_undegraded":"2024-09-12T01:05:49.868849+0000","last_fullsized":"2024-09-12T01:05:49.868849+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":638,"num_write":310,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'108","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.649963+0000","last_change":"2024-09-12T00:21:44.494924+0000","last_active":"2024-09-12T01:04:18.649963+0000","last_peered":"2024-09-12T01:04:18.649963+0000","last_clean":"2024-09-12T01:04:18.649963+0000","last_became_active":"2024-09-12T00:21:44.493767+0000","last_became_peered":"2024-09-12T00:21:44.493767+0000","last_unstale":"2024-09-12T01:04:18.649963+0000","last_undegraded":"2024-09-12T01:04:18.649963+0000","last_fullsized":"2024-09-12T01:04:18.649963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:36.428208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":357,"num_write":148,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'315","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.666852+0000","last_change":"2024-09-12T00:21:42.515019+0000","last_active":"2024-09-12T01:07:27.666852+0000","last_peered":"2024-09-12T01:07:27.666852+0000","last_clean":"2024-09-12T01:07:27.666852+0000","last_became_active":"2024-09-12T00:21:42.514489+0000","last_became_peered":"2024-09-12T00:21:42.514489+0000","last_unstale":"2024-09-12T01:07:27.666852+0000","last_undegraded":"2024-09-12T01:07:27.666852+0000","last_fullsized":"2024-09-12T01:07:27.666852+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:26.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480914,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":6553,"num_write":1087,"num_write_kb":16882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'52","reported_seq":605,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.796075+0000","last_change":"2024-09-12T00:21:44.510300+0000","last_active":"2024-09-12T01:05:30.796075+0000","last_peered":"2024-09-12T01:05:30.796075+0000","last_clean":"2024-09-12T01:05:30.796075+0000","last_became_active":"2024-09-12T00:21:44.509895+0000","last_became_peered":"2024-09-12T00:21:44.509895+0000","last_unstale":"2024-09-12T01:05:30.796075+0000","last_undegraded":"2024-09-12T01:05:30.796075+0000","last_fullsized":"2024-09-12T01:05:30.796075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.091723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":198,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'260","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.620747+0000","last_change":"2024-09-12T00:21:42.491403+0000","last_active":"2024-09-12T01:07:27.620747+0000","last_peered":"2024-09-12T01:07:27.620747+0000","last_clean":"2024-09-12T01:07:27.620747+0000","last_became_active":"2024-09-12T00:21:42.490660+0000","last_became_peered":"2024-09-12T00:21:42.490660+0000","last_unstale":"2024-09-12T01:07:27.620747+0000","last_undegraded":"2024-09-12T01:07:27.620747+0000","last_fullsized":"2024-09-12T01:07:27.620747+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:10.128469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":4406,"num_write":788,"num_write_kb":22345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'258","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.249226+0000","last_change":"2024-09-12T00:21:44.515348+0000","last_active":"2024-09-12T01:05:47.249226+0000","last_peered":"2024-09-12T01:05:47.249226+0000","last_clean":"2024-09-12T01:05:47.249226+0000","last_became_active":"2024-09-12T00:21:44.514893+0000","last_became_peered":"2024-09-12T00:21:44.514893+0000","last_unstale":"2024-09-12T01:05:47.249226+0000","last_undegraded":"2024-09-12T01:05:47.249226+0000","last_fullsized":"2024-09-12T01:05:47.249226+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.665865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1166,"num_read_kb":956,"num_write":431,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'341","reported_seq":960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.569245+0000","last_change":"2024-09-12T00:22:13.552941+0000","last_active":"2024-09-12T01:07:27.569245+0000","last_peered":"2024-09-12T01:07:27.569245+0000","last_clean":"2024-09-12T01:07:27.569245+0000","last_became_active":"2024-09-12T00:22:13.552126+0000","last_became_peered":"2024-09-12T00:22:13.552126+0000","last_unstale":"2024-09-12T01:07:27.569245+0000","last_undegraded":"2024-09-12T01:07:27.569245+0000","last_fullsized":"2024-09-12T01:07:27.569245+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.367793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194436,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":9788,"num_write":1143,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'125","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.824816+0000","last_change":"2024-09-12T00:21:44.521066+0000","last_active":"2024-09-12T01:03:50.824816+0000","last_peered":"2024-09-12T01:03:50.824816+0000","last_clean":"2024-09-12T01:03:50.824816+0000","last_became_active":"2024-09-12T00:21:44.520441+0000","last_became_peered":"2024-09-12T00:21:44.520441+0000","last_unstale":"2024-09-12T01:03:50.824816+0000","last_undegraded":"2024-09-12T01:03:50.824816+0000","last_fullsized":"2024-09-12T01:03:50.824816+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:58.395313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":459,"num_write":198,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'341","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.536509+0000","last_change":"2024-09-12T00:21:42.506242+0000","last_active":"2024-09-12T01:07:27.536509+0000","last_peered":"2024-09-12T01:07:27.536509+0000","last_clean":"2024-09-12T01:07:27.536509+0000","last_became_active":"2024-09-12T00:21:42.505754+0000","last_became_peered":"2024-09-12T00:21:42.505754+0000","last_unstale":"2024-09-12T01:07:27.536509+0000","last_undegraded":"2024-09-12T01:07:27.536509+0000","last_fullsized":"2024-09-12T01:07:27.536509+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:17.644717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524521,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":484,"num_read_kb":23994,"num_write":1133,"num_write_kb":44987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'533","reported_seq":1294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.156332+0000","last_change":"2024-09-12T00:21:44.510694+0000","last_active":"2024-09-12T01:04:59.156332+0000","last_peered":"2024-09-12T01:04:59.156332+0000","last_clean":"2024-09-12T01:04:59.156332+0000","last_became_active":"2024-09-12T00:21:44.509840+0000","last_became_peered":"2024-09-12T00:21:44.509840+0000","last_unstale":"2024-09-12T01:04:59.156332+0000","last_undegraded":"2024-09-12T01:04:59.156332+0000","last_fullsized":"2024-09-12T01:04:59.156332+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:05.378563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2527,"num_read_kb":2144,"num_write":948,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'354","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.569116+0000","last_change":"2024-09-12T00:21:42.531184+0000","last_active":"2024-09-12T01:07:27.569116+0000","last_peered":"2024-09-12T01:07:27.569116+0000","last_clean":"2024-09-12T01:07:27.569116+0000","last_became_active":"2024-09-12T00:21:42.529312+0000","last_became_peered":"2024-09-12T00:21:42.529312+0000","last_unstale":"2024-09-12T01:07:27.569116+0000","last_undegraded":"2024-09-12T01:07:27.569116+0000","last_fullsized":"2024-09-12T01:07:27.569116+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:28.828303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":660,"num_write":1093,"num_write_kb":45878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'102","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.071243+0000","last_change":"2024-09-12T00:21:44.499519+0000","last_active":"2024-09-12T01:05:04.071243+0000","last_peered":"2024-09-12T01:05:04.071243+0000","last_clean":"2024-09-12T01:05:04.071243+0000","last_became_active":"2024-09-12T00:21:44.499173+0000","last_became_peered":"2024-09-12T00:21:44.499173+0000","last_unstale":"2024-09-12T01:05:04.071243+0000","last_undegraded":"2024-09-12T01:05:04.071243+0000","last_fullsized":"2024-09-12T01:05:04.071243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:51.311165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":398,"num_write":158,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'370","reported_seq":1025,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.626404+0000","last_change":"2024-09-12T00:21:42.530559+0000","last_active":"2024-09-12T01:07:27.626404+0000","last_peered":"2024-09-12T01:07:27.626404+0000","last_clean":"2024-09-12T01:07:27.626404+0000","last_became_active":"2024-09-12T00:21:42.529873+0000","last_became_peered":"2024-09-12T00:21:42.529873+0000","last_unstale":"2024-09-12T01:07:27.626404+0000","last_undegraded":"2024-09-12T01:07:27.626404+0000","last_fullsized":"2024-09-12T01:07:27.626404+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:42.813481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730168,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":35149,"num_write":1229,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'136","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.400586+0000","last_change":"2024-09-12T00:21:52.546288+0000","last_active":"2024-09-12T01:06:07.400586+0000","last_peered":"2024-09-12T01:06:07.400586+0000","last_clean":"2024-09-12T01:06:07.400586+0000","last_became_active":"2024-09-12T00:21:52.545571+0000","last_became_peered":"2024-09-12T00:21:52.545571+0000","last_unstale":"2024-09-12T01:06:07.400586+0000","last_undegraded":"2024-09-12T01:06:07.400586+0000","last_fullsized":"2024-09-12T01:06:07.400586+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:55.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'88","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.478850+0000","last_change":"2024-09-12T00:21:44.485322+0000","last_active":"2024-09-12T01:05:20.478850+0000","last_peered":"2024-09-12T01:05:20.478850+0000","last_clean":"2024-09-12T01:05:20.478850+0000","last_became_active":"2024-09-12T00:21:44.484514+0000","last_became_peered":"2024-09-12T00:21:44.484514+0000","last_unstale":"2024-09-12T01:05:20.478850+0000","last_undegraded":"2024-09-12T01:05:20.478850+0000","last_fullsized":"2024-09-12T01:05:20.478850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:59.343439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":321,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'347","reported_seq":1010,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.677199+0000","last_change":"2024-09-12T00:21:42.496374+0000","last_active":"2024-09-12T01:07:27.677199+0000","last_peered":"2024-09-12T01:07:27.677199+0000","last_clean":"2024-09-12T01:07:27.677199+0000","last_became_active":"2024-09-12T00:21:42.495808+0000","last_became_peered":"2024-09-12T00:21:42.495808+0000","last_unstale":"2024-09-12T01:07:27.677199+0000","last_undegraded":"2024-09-12T01:07:27.677199+0000","last_fullsized":"2024-09-12T01:07:27.677199+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:30.009676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432703,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":20340,"num_write":1070,"num_write_kb":31693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.604524+0000","last_change":"2024-09-12T00:21:46.515667+0000","last_active":"2024-09-12T01:02:54.604524+0000","last_peered":"2024-09-12T01:02:54.604524+0000","last_clean":"2024-09-12T01:02:54.604524+0000","last_became_active":"2024-09-12T00:21:46.515363+0000","last_became_peered":"2024-09-12T00:21:46.515363+0000","last_unstale":"2024-09-12T01:02:54.604524+0000","last_undegraded":"2024-09-12T01:02:54.604524+0000","last_fullsized":"2024-09-12T01:02:54.604524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:03.935806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'330","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.250629+0000","last_change":"2024-09-12T00:21:48.528210+0000","last_active":"2024-09-12T01:07:27.250629+0000","last_peered":"2024-09-12T01:07:27.250629+0000","last_clean":"2024-09-12T01:07:27.250629+0000","last_became_active":"2024-09-12T00:21:48.524091+0000","last_became_peered":"2024-09-12T00:21:48.524091+0000","last_unstale":"2024-09-12T01:07:27.250629+0000","last_undegraded":"2024-09-12T01:07:27.250629+0000","last_fullsized":"2024-09-12T01:07:27.250629+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:14.328463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48797,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1088,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.751663+0000","last_change":"2024-09-12T00:21:50.552444+0000","last_active":"2024-09-12T01:02:59.751663+0000","last_peered":"2024-09-12T01:02:59.751663+0000","last_clean":"2024-09-12T01:02:59.751663+0000","last_became_active":"2024-09-12T00:21:50.551742+0000","last_became_peered":"2024-09-12T00:21:50.551742+0000","last_unstale":"2024-09-12T01:02:59.751663+0000","last_undegraded":"2024-09-12T01:02:59.751663+0000","last_fullsized":"2024-09-12T01:02:59.751663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:41.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'173","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.384837+0000","last_change":"2024-09-12T00:21:52.546442+0000","last_active":"2024-09-12T01:06:06.384837+0000","last_peered":"2024-09-12T01:06:06.384837+0000","last_clean":"2024-09-12T01:06:06.384837+0000","last_became_active":"2024-09-12T00:21:52.544469+0000","last_became_peered":"2024-09-12T00:21:52.544469+0000","last_unstale":"2024-09-12T01:06:06.384837+0000","last_undegraded":"2024-09-12T01:06:06.384837+0000","last_fullsized":"2024-09-12T01:06:06.384837+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:08.007114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":251,"num_write":350,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'4223","reported_seq":4854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.512839+0000","last_change":"2024-09-12T00:21:44.500660+0000","last_active":"2024-09-12T01:04:03.512839+0000","last_peered":"2024-09-12T01:04:03.512839+0000","last_clean":"2024-09-12T01:04:03.512839+0000","last_became_active":"2024-09-12T00:21:44.500367+0000","last_became_peered":"2024-09-12T00:21:44.500367+0000","last_unstale":"2024-09-12T01:04:03.512839+0000","last_undegraded":"2024-09-12T01:04:03.512839+0000","last_fullsized":"2024-09-12T01:04:03.512839+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:22.788119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17010,"num_read_kb":14247,"num_write":6340,"num_write_kb":3163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'379","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.641762+0000","last_change":"2024-09-12T00:21:42.500670+0000","last_active":"2024-09-12T01:07:27.641762+0000","last_peered":"2024-09-12T01:07:27.641762+0000","last_clean":"2024-09-12T01:07:27.641762+0000","last_became_active":"2024-09-12T00:21:42.492572+0000","last_became_peered":"2024-09-12T00:21:42.492572+0000","last_unstale":"2024-09-12T01:07:27.641762+0000","last_undegraded":"2024-09-12T01:07:27.641762+0000","last_fullsized":"2024-09-12T01:07:27.641762+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:45.219943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":145927,"num_write":1169,"num_write_kb":64533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.576546+0000","last_change":"2024-09-12T00:21:46.491690+0000","last_active":"2024-09-12T01:03:59.576546+0000","last_peered":"2024-09-12T01:03:59.576546+0000","last_clean":"2024-09-12T01:03:59.576546+0000","last_became_active":"2024-09-12T00:21:46.490985+0000","last_became_peered":"2024-09-12T00:21:46.490985+0000","last_unstale":"2024-09-12T01:03:59.576546+0000","last_undegraded":"2024-09-12T01:03:59.576546+0000","last_fullsized":"2024-09-12T01:03:59.576546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:41.609896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'84","reported_seq":618,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.296129+0000","last_change":"2024-09-12T00:21:48.535909+0000","last_active":"2024-09-12T01:04:55.296129+0000","last_peered":"2024-09-12T01:04:55.296129+0000","last_clean":"2024-09-12T01:04:55.296129+0000","last_became_active":"2024-09-12T00:21:48.535190+0000","last_became_peered":"2024-09-12T00:21:48.535190+0000","last_unstale":"2024-09-12T01:04:55.296129+0000","last_undegraded":"2024-09-12T01:04:55.296129+0000","last_fullsized":"2024-09-12T01:04:55.296129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.533022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.751597+0000","last_change":"2024-09-12T00:21:50.551431+0000","last_active":"2024-09-12T01:02:59.751597+0000","last_peered":"2024-09-12T01:02:59.751597+0000","last_clean":"2024-09-12T01:02:59.751597+0000","last_became_active":"2024-09-12T00:21:50.550214+0000","last_became_peered":"2024-09-12T00:21:50.550214+0000","last_unstale":"2024-09-12T01:02:59.751597+0000","last_undegraded":"2024-09-12T01:02:59.751597+0000","last_fullsized":"2024-09-12T01:02:59.751597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:11.439485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'124","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.000458+0000","last_change":"2024-09-12T00:21:52.545902+0000","last_active":"2024-09-12T01:05:53.000458+0000","last_peered":"2024-09-12T01:05:53.000458+0000","last_clean":"2024-09-12T01:05:53.000458+0000","last_became_active":"2024-09-12T00:21:52.545166+0000","last_became_peered":"2024-09-12T00:21:52.545166+0000","last_unstale":"2024-09-12T01:05:53.000458+0000","last_undegraded":"2024-09-12T01:05:53.000458+0000","last_fullsized":"2024-09-12T01:05:53.000458+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:01.544361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":292,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'288","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.243846+0000","last_change":"2024-09-12T00:21:44.520746+0000","last_active":"2024-09-12T01:04:15.243846+0000","last_peered":"2024-09-12T01:04:15.243846+0000","last_clean":"2024-09-12T01:04:15.243846+0000","last_became_active":"2024-09-12T00:21:44.520057+0000","last_became_peered":"2024-09-12T00:21:44.520057+0000","last_unstale":"2024-09-12T01:04:15.243846+0000","last_undegraded":"2024-09-12T01:04:15.243846+0000","last_fullsized":"2024-09-12T01:04:15.243846+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:54.675479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1259,"num_read_kb":1089,"num_write":465,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'321","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.670508+0000","last_change":"2024-09-12T00:21:42.497428+0000","last_active":"2024-09-12T01:07:27.670508+0000","last_peered":"2024-09-12T01:07:27.670508+0000","last_clean":"2024-09-12T01:07:27.670508+0000","last_became_active":"2024-09-12T00:21:42.496059+0000","last_became_peered":"2024-09-12T00:21:42.496059+0000","last_unstale":"2024-09-12T01:07:27.670508+0000","last_undegraded":"2024-09-12T01:07:27.670508+0000","last_fullsized":"2024-09-12T01:07:27.670508+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:13.046572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":8629,"num_write":994,"num_write_kb":21953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.562551+0000","last_change":"2024-09-12T00:21:46.501997+0000","last_active":"2024-09-12T01:02:54.562551+0000","last_peered":"2024-09-12T01:02:54.562551+0000","last_clean":"2024-09-12T01:02:54.562551+0000","last_became_active":"2024-09-12T00:21:46.501407+0000","last_became_peered":"2024-09-12T00:21:46.501407+0000","last_unstale":"2024-09-12T01:02:54.562551+0000","last_undegraded":"2024-09-12T01:02:54.562551+0000","last_fullsized":"2024-09-12T01:02:54.562551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.795256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'122","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.317364+0000","last_change":"2024-09-12T00:21:48.542081+0000","last_active":"2024-09-12T01:04:21.317364+0000","last_peered":"2024-09-12T01:04:21.317364+0000","last_clean":"2024-09-12T01:04:21.317364+0000","last_became_active":"2024-09-12T00:21:48.541231+0000","last_became_peered":"2024-09-12T00:21:48.541231+0000","last_unstale":"2024-09-12T01:04:21.317364+0000","last_undegraded":"2024-09-12T01:04:21.317364+0000","last_fullsized":"2024-09-12T01:04:21.317364+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.064538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'788","reported_seq":2514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.919316+0000","last_change":"2024-09-12T00:21:50.569545+0000","last_active":"2024-09-12T01:07:26.919316+0000","last_peered":"2024-09-12T01:07:26.919316+0000","last_clean":"2024-09-12T01:07:26.919316+0000","last_became_active":"2024-09-12T00:21:50.568825+0000","last_became_peered":"2024-09-12T00:21:50.568825+0000","last_unstale":"2024-09-12T01:07:26.919316+0000","last_undegraded":"2024-09-12T01:07:26.919316+0000","last_fullsized":"2024-09-12T01:07:26.919316+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'222","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.469146+0000","last_change":"2024-09-12T00:21:52.555837+0000","last_active":"2024-09-12T01:06:07.469146+0000","last_peered":"2024-09-12T01:06:07.469146+0000","last_clean":"2024-09-12T01:06:07.469146+0000","last_became_active":"2024-09-12T00:21:52.554865+0000","last_became_peered":"2024-09-12T00:21:52.554865+0000","last_unstale":"2024-09-12T01:06:07.469146+0000","last_undegraded":"2024-09-12T01:06:07.469146+0000","last_fullsized":"2024-09-12T01:06:07.469146+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:47.453983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":708,"num_read_kb":679,"num_write":497,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'135","reported_seq":691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.308334+0000","last_change":"2024-09-12T00:21:44.523637+0000","last_active":"2024-09-12T01:04:13.308334+0000","last_peered":"2024-09-12T01:04:13.308334+0000","last_clean":"2024-09-12T01:04:13.308334+0000","last_became_active":"2024-09-12T00:21:44.522830+0000","last_became_peered":"2024-09-12T00:21:44.522830+0000","last_unstale":"2024-09-12T01:04:13.308334+0000","last_undegraded":"2024-09-12T01:04:13.308334+0000","last_fullsized":"2024-09-12T01:04:13.308334+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:29.081489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":469,"num_write":207,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'328","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.611420+0000","last_change":"2024-09-12T01:07:33.611420+0000","last_active":"2024-09-12T01:07:33.611420+0000","last_peered":"2024-09-12T01:07:33.611420+0000","last_clean":"2024-09-12T01:07:33.611420+0000","last_became_active":"2024-09-12T00:21:42.516625+0000","last_became_peered":"2024-09-12T00:21:42.516625+0000","last_unstale":"2024-09-12T01:07:33.611420+0000","last_undegraded":"2024-09-12T01:07:33.611420+0000","last_fullsized":"2024-09-12T01:07:33.611420+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.611301+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:46.786030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":2651,"num_write":1122,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.604571+0000","last_change":"2024-09-12T00:21:46.504025+0000","last_active":"2024-09-12T01:02:54.604571+0000","last_peered":"2024-09-12T01:02:54.604571+0000","last_clean":"2024-09-12T01:02:54.604571+0000","last_became_active":"2024-09-12T00:21:46.503686+0000","last_became_peered":"2024-09-12T00:21:46.503686+0000","last_unstale":"2024-09-12T01:02:54.604571+0000","last_undegraded":"2024-09-12T01:02:54.604571+0000","last_fullsized":"2024-09-12T01:02:54.604571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:46.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'284","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.927781+0000","last_change":"2024-09-12T00:21:48.540014+0000","last_active":"2024-09-12T01:07:26.927781+0000","last_peered":"2024-09-12T01:07:26.927781+0000","last_clean":"2024-09-12T01:07:26.927781+0000","last_became_active":"2024-09-12T00:21:48.539522+0000","last_became_peered":"2024-09-12T00:21:48.539522+0000","last_unstale":"2024-09-12T01:07:26.927781+0000","last_undegraded":"2024-09-12T01:07:26.927781+0000","last_fullsized":"2024-09-12T01:07:26.927781+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:51.751137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47885,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1089,"num_write":388,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'780","reported_seq":2466,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.266973+0000","last_change":"2024-09-12T00:21:50.565919+0000","last_active":"2024-09-12T01:07:27.266973+0000","last_peered":"2024-09-12T01:07:27.266973+0000","last_clean":"2024-09-12T01:07:27.266973+0000","last_became_active":"2024-09-12T00:21:50.564483+0000","last_became_peered":"2024-09-12T00:21:50.564483+0000","last_unstale":"2024-09-12T01:07:27.266973+0000","last_undegraded":"2024-09-12T01:07:27.266973+0000","last_fullsized":"2024-09-12T01:07:27.266973+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'576","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.637851+0000","last_change":"2024-09-12T00:21:44.501308+0000","last_active":"2024-09-12T01:05:04.637851+0000","last_peered":"2024-09-12T01:05:04.637851+0000","last_clean":"2024-09-12T01:05:04.637851+0000","last_became_active":"2024-09-12T00:21:44.497754+0000","last_became_peered":"2024-09-12T00:21:44.497754+0000","last_unstale":"2024-09-12T01:05:04.637851+0000","last_undegraded":"2024-09-12T01:05:04.637851+0000","last_fullsized":"2024-09-12T01:05:04.637851+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:01.259088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2710,"num_read_kb":2241,"num_write":1007,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'379","reported_seq":1096,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:31.968974+0000","last_change":"2024-09-12T01:07:31.968974+0000","last_active":"2024-09-12T01:07:31.968974+0000","last_peered":"2024-09-12T01:07:31.968974+0000","last_clean":"2024-09-12T01:07:31.968974+0000","last_became_active":"2024-09-12T00:21:42.528138+0000","last_became_peered":"2024-09-12T00:21:42.528138+0000","last_unstale":"2024-09-12T01:07:31.968974+0000","last_undegraded":"2024-09-12T01:07:31.968974+0000","last_fullsized":"2024-09-12T01:07:31.968974+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_clean_scrub_stamp":"2024-09-12T01:07:31.968881+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:08.369394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":24539,"num_write":1088,"num_write_kb":22675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.781947+0000","last_change":"2024-09-12T00:21:46.503402+0000","last_active":"2024-09-12T01:05:09.781947+0000","last_peered":"2024-09-12T01:05:09.781947+0000","last_clean":"2024-09-12T01:05:09.781947+0000","last_became_active":"2024-09-12T00:21:46.503041+0000","last_became_peered":"2024-09-12T00:21:46.503041+0000","last_unstale":"2024-09-12T01:05:09.781947+0000","last_undegraded":"2024-09-12T01:05:09.781947+0000","last_fullsized":"2024-09-12T01:05:09.781947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.602442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'366","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.516899+0000","last_change":"2024-09-12T00:21:48.539441+0000","last_active":"2024-09-12T01:07:27.516899+0000","last_peered":"2024-09-12T01:07:27.516899+0000","last_clean":"2024-09-12T01:07:27.516899+0000","last_became_active":"2024-09-12T00:21:48.538727+0000","last_became_peered":"2024-09-12T00:21:48.538727+0000","last_unstale":"2024-09-12T01:07:27.516899+0000","last_undegraded":"2024-09-12T01:07:27.516899+0000","last_fullsized":"2024-09-12T01:07:27.516899+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48773,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":589,"num_read_kb":1209,"num_write":464,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.587751+0000","last_change":"2024-09-12T00:21:50.545196+0000","last_active":"2024-09-12T01:04:39.587751+0000","last_peered":"2024-09-12T01:04:39.587751+0000","last_clean":"2024-09-12T01:04:39.587751+0000","last_became_active":"2024-09-12T00:21:50.544432+0000","last_became_peered":"2024-09-12T00:21:50.544432+0000","last_unstale":"2024-09-12T01:04:39.587751+0000","last_undegraded":"2024-09-12T01:04:39.587751+0000","last_fullsized":"2024-09-12T01:04:39.587751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.923643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'549","reported_seq":1360,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.865258+0000","last_change":"2024-09-12T00:21:52.563743+0000","last_active":"2024-09-12T01:07:12.865258+0000","last_peered":"2024-09-12T01:07:12.865258+0000","last_clean":"2024-09-12T01:07:12.865258+0000","last_became_active":"2024-09-12T00:21:52.563086+0000","last_became_peered":"2024-09-12T00:21:52.563086+0000","last_unstale":"2024-09-12T01:07:12.865258+0000","last_undegraded":"2024-09-12T01:07:12.865258+0000","last_fullsized":"2024-09-12T01:07:12.865258+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:09.343801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1274,"num_read_kb":1271,"num_write":1130,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'524","reported_seq":1304,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.780894+0000","last_change":"2024-09-12T00:21:44.511296+0000","last_active":"2024-09-12T01:05:04.780894+0000","last_peered":"2024-09-12T01:05:04.780894+0000","last_clean":"2024-09-12T01:05:04.780894+0000","last_became_active":"2024-09-12T00:21:44.510918+0000","last_became_peered":"2024-09-12T00:21:44.510918+0000","last_unstale":"2024-09-12T01:05:04.780894+0000","last_undegraded":"2024-09-12T01:05:04.780894+0000","last_fullsized":"2024-09-12T01:05:04.780894+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:54.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2468,"num_read_kb":2089,"num_write":789,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'326","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.222218+0000","last_change":"2024-09-12T01:07:33.222218+0000","last_active":"2024-09-12T01:07:33.222218+0000","last_peered":"2024-09-12T01:07:33.222218+0000","last_clean":"2024-09-12T01:07:33.222218+0000","last_became_active":"2024-09-12T00:21:42.513031+0000","last_became_peered":"2024-09-12T00:21:42.513031+0000","last_unstale":"2024-09-12T01:07:33.222218+0000","last_undegraded":"2024-09-12T01:07:33.222218+0000","last_fullsized":"2024-09-12T01:07:33.222218+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.222064+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:44.352540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730153,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":476,"num_read_kb":44893,"num_write":1011,"num_write_kb":33699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.594203+0000","last_change":"2024-09-12T00:21:46.519542+0000","last_active":"2024-09-12T01:05:09.594203+0000","last_peered":"2024-09-12T01:05:09.594203+0000","last_clean":"2024-09-12T01:05:09.594203+0000","last_became_active":"2024-09-12T00:21:46.517981+0000","last_became_peered":"2024-09-12T00:21:46.517981+0000","last_unstale":"2024-09-12T01:05:09.594203+0000","last_undegraded":"2024-09-12T01:05:09.594203+0000","last_fullsized":"2024-09-12T01:05:09.594203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:03.803070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'274","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.314493+0000","last_change":"2024-09-12T00:21:48.523626+0000","last_active":"2024-09-12T01:07:26.314493+0000","last_peered":"2024-09-12T01:07:26.314493+0000","last_clean":"2024-09-12T01:07:26.314493+0000","last_became_active":"2024-09-12T00:21:48.522920+0000","last_became_peered":"2024-09-12T00:21:48.522920+0000","last_unstale":"2024-09-12T01:07:26.314493+0000","last_undegraded":"2024-09-12T01:07:26.314493+0000","last_fullsized":"2024-09-12T01:07:26.314493+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:28.182271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1024,"num_write":366,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.595926+0000","last_change":"2024-09-12T00:21:50.545714+0000","last_active":"2024-09-12T01:05:24.595926+0000","last_peered":"2024-09-12T01:05:24.595926+0000","last_clean":"2024-09-12T01:05:24.595926+0000","last_became_active":"2024-09-12T00:21:50.543639+0000","last_became_peered":"2024-09-12T00:21:50.543639+0000","last_unstale":"2024-09-12T01:05:24.595926+0000","last_undegraded":"2024-09-12T01:05:24.595926+0000","last_fullsized":"2024-09-12T01:05:24.595926+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2371","reported_seq":4212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.690521+0000","last_change":"2024-09-12T00:21:52.538444+0000","last_active":"2024-09-12T01:06:56.690521+0000","last_peered":"2024-09-12T01:06:56.690521+0000","last_clean":"2024-09-12T01:06:56.690521+0000","last_became_active":"2024-09-12T00:21:52.537701+0000","last_became_peered":"2024-09-12T00:21:52.537701+0000","last_unstale":"2024-09-12T01:06:56.690521+0000","last_undegraded":"2024-09-12T01:06:56.690521+0000","last_fullsized":"2024-09-12T01:06:56.690521+0000","mapping_epoch":36,"log_start":"267'2300","ondisk_log_start":"267'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:39.923689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5977,"num_write":4771,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'112","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.997112+0000","last_change":"2024-09-12T00:21:44.494633+0000","last_active":"2024-09-12T01:05:52.997112+0000","last_peered":"2024-09-12T01:05:52.997112+0000","last_clean":"2024-09-12T01:05:52.997112+0000","last_became_active":"2024-09-12T00:21:44.494313+0000","last_became_peered":"2024-09-12T00:21:44.494313+0000","last_unstale":"2024-09-12T01:05:52.997112+0000","last_undegraded":"2024-09-12T01:05:52.997112+0000","last_fullsized":"2024-09-12T01:05:52.997112+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:22.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":397,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'345","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.690659+0000","last_change":"2024-09-12T00:21:42.529770+0000","last_active":"2024-09-12T01:07:27.690659+0000","last_peered":"2024-09-12T01:07:27.690659+0000","last_clean":"2024-09-12T01:07:27.690659+0000","last_became_active":"2024-09-12T00:21:42.529372+0000","last_became_peered":"2024-09-12T00:21:42.529372+0000","last_unstale":"2024-09-12T01:07:27.690659+0000","last_undegraded":"2024-09-12T01:07:27.690659+0000","last_fullsized":"2024-09-12T01:07:27.690659+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.798589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12055,"num_write":1241,"num_write_kb":31958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611469+0000","last_change":"2024-09-12T00:21:46.512407+0000","last_active":"2024-09-12T01:04:34.611469+0000","last_peered":"2024-09-12T01:04:34.611469+0000","last_clean":"2024-09-12T01:04:34.611469+0000","last_became_active":"2024-09-12T00:21:46.511704+0000","last_became_peered":"2024-09-12T00:21:46.511704+0000","last_unstale":"2024-09-12T01:04:34.611469+0000","last_undegraded":"2024-09-12T01:04:34.611469+0000","last_fullsized":"2024-09-12T01:04:34.611469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:04.950564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'284","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.649069+0000","last_change":"2024-09-12T00:21:48.552567+0000","last_active":"2024-09-12T01:07:27.649069+0000","last_peered":"2024-09-12T01:07:27.649069+0000","last_clean":"2024-09-12T01:07:27.649069+0000","last_became_active":"2024-09-12T00:21:48.551752+0000","last_became_peered":"2024-09-12T00:21:48.551752+0000","last_unstale":"2024-09-12T01:07:27.649069+0000","last_undegraded":"2024-09-12T01:07:27.649069+0000","last_fullsized":"2024-09-12T01:07:27.649069+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.243890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42024,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":467,"num_read_kb":1006,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'781","reported_seq":4659,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.267764+0000","last_change":"2024-09-12T00:21:50.562293+0000","last_active":"2024-09-12T01:07:27.267764+0000","last_peered":"2024-09-12T01:07:27.267764+0000","last_clean":"2024-09-12T01:07:27.267764+0000","last_became_active":"2024-09-12T00:21:50.561680+0000","last_became_peered":"2024-09-12T00:21:50.561680+0000","last_unstale":"2024-09-12T01:07:27.267764+0000","last_undegraded":"2024-09-12T01:07:27.267764+0000","last_fullsized":"2024-09-12T01:07:27.267764+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:35.170696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'119","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.966637+0000","last_change":"2024-09-12T00:21:52.547626+0000","last_active":"2024-09-12T01:07:11.966637+0000","last_peered":"2024-09-12T01:07:11.966637+0000","last_clean":"2024-09-12T01:07:11.966637+0000","last_became_active":"2024-09-12T00:21:52.546889+0000","last_became_peered":"2024-09-12T00:21:52.546889+0000","last_unstale":"2024-09-12T01:07:11.966637+0000","last_undegraded":"2024-09-12T01:07:11.966637+0000","last_fullsized":"2024-09-12T01:07:11.966637+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:06.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":121,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'188","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.081285+0000","last_change":"2024-09-12T00:21:44.519531+0000","last_active":"2024-09-12T01:05:30.081285+0000","last_peered":"2024-09-12T01:05:30.081285+0000","last_clean":"2024-09-12T01:05:30.081285+0000","last_became_active":"2024-09-12T00:21:44.518595+0000","last_became_peered":"2024-09-12T00:21:44.518595+0000","last_unstale":"2024-09-12T01:05:30.081285+0000","last_undegraded":"2024-09-12T01:05:30.081285+0000","last_fullsized":"2024-09-12T01:05:30.081285+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.767338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":656,"num_write":281,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'267","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.002912+0000","last_change":"2024-09-12T01:07:33.002912+0000","last_active":"2024-09-12T01:07:33.002912+0000","last_peered":"2024-09-12T01:07:33.002912+0000","last_clean":"2024-09-12T01:07:33.002912+0000","last_became_active":"2024-09-12T00:21:42.497992+0000","last_became_peered":"2024-09-12T00:21:42.497992+0000","last_unstale":"2024-09-12T01:07:33.002912+0000","last_undegraded":"2024-09-12T01:07:33.002912+0000","last_fullsized":"2024-09-12T01:07:33.002912+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'267","last_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_deep_scrub":"267'267","last_deep_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.002601+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:20.061473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":82463,"num_write":854,"num_write_kb":27861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.596516+0000","last_change":"2024-09-12T00:21:46.512131+0000","last_active":"2024-09-12T01:05:19.596516+0000","last_peered":"2024-09-12T01:05:19.596516+0000","last_clean":"2024-09-12T01:05:19.596516+0000","last_became_active":"2024-09-12T00:21:46.511365+0000","last_became_peered":"2024-09-12T00:21:46.511365+0000","last_unstale":"2024-09-12T01:05:19.596516+0000","last_undegraded":"2024-09-12T01:05:19.596516+0000","last_fullsized":"2024-09-12T01:05:19.596516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:52.291093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'473","reported_seq":1115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.492185+0000","last_change":"2024-09-12T00:21:48.526015+0000","last_active":"2024-09-12T01:07:26.492185+0000","last_peered":"2024-09-12T01:07:26.492185+0000","last_clean":"2024-09-12T01:07:26.492185+0000","last_became_active":"2024-09-12T00:21:48.524173+0000","last_became_peered":"2024-09-12T00:21:48.524173+0000","last_unstale":"2024-09-12T01:07:26.492185+0000","last_undegraded":"2024-09-12T01:07:26.492185+0000","last_fullsized":"2024-09-12T01:07:26.492185+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:01.094285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1944,"num_write":668,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.620896+0000","last_change":"2024-09-12T00:21:50.562375+0000","last_active":"2024-09-12T01:05:14.620896+0000","last_peered":"2024-09-12T01:05:14.620896+0000","last_clean":"2024-09-12T01:05:14.620896+0000","last_became_active":"2024-09-12T00:21:50.561720+0000","last_became_peered":"2024-09-12T00:21:50.561720+0000","last_unstale":"2024-09-12T01:05:14.620896+0000","last_undegraded":"2024-09-12T01:05:14.620896+0000","last_fullsized":"2024-09-12T01:05:14.620896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:55.724402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'124","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.185203+0000","last_change":"2024-09-12T00:21:52.565860+0000","last_active":"2024-09-12T01:05:29.185203+0000","last_peered":"2024-09-12T01:05:29.185203+0000","last_clean":"2024-09-12T01:05:29.185203+0000","last_became_active":"2024-09-12T00:21:52.565276+0000","last_became_peered":"2024-09-12T00:21:52.565276+0000","last_unstale":"2024-09-12T01:05:29.185203+0000","last_undegraded":"2024-09-12T01:05:29.185203+0000","last_fullsized":"2024-09-12T01:05:29.185203+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:19.050097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'92","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.590887+0000","last_change":"2024-09-12T00:21:44.505865+0000","last_active":"2024-09-12T01:04:29.590887+0000","last_peered":"2024-09-12T01:04:29.590887+0000","last_clean":"2024-09-12T01:04:29.590887+0000","last_became_active":"2024-09-12T00:21:44.504866+0000","last_became_peered":"2024-09-12T00:21:44.504866+0000","last_unstale":"2024-09-12T01:04:29.590887+0000","last_undegraded":"2024-09-12T01:04:29.590887+0000","last_fullsized":"2024-09-12T01:04:29.590887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:00.702193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":364,"num_write":125,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'360","reported_seq":1010,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.690221+0000","last_change":"2024-09-12T00:21:42.513602+0000","last_active":"2024-09-12T01:07:27.690221+0000","last_peered":"2024-09-12T01:07:27.690221+0000","last_clean":"2024-09-12T01:07:27.690221+0000","last_became_active":"2024-09-12T00:21:42.511762+0000","last_became_peered":"2024-09-12T00:21:42.511762+0000","last_unstale":"2024-09-12T01:07:27.690221+0000","last_undegraded":"2024-09-12T01:07:27.690221+0000","last_fullsized":"2024-09-12T01:07:27.690221+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:56.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":36352,"num_write":1101,"num_write_kb":41720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:33.591024+0000","last_change":"2024-09-12T00:21:46.515246+0000","last_active":"2024-09-12T01:04:33.591024+0000","last_peered":"2024-09-12T01:04:33.591024+0000","last_clean":"2024-09-12T01:04:33.591024+0000","last_became_active":"2024-09-12T00:21:46.514486+0000","last_became_peered":"2024-09-12T00:21:46.514486+0000","last_unstale":"2024-09-12T01:04:33.591024+0000","last_undegraded":"2024-09-12T01:04:33.591024+0000","last_fullsized":"2024-09-12T01:04:33.591024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:53.736171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'318","reported_seq":904,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.551916+0000","last_change":"2024-09-12T00:21:48.548232+0000","last_active":"2024-09-12T01:07:26.551916+0000","last_peered":"2024-09-12T01:07:26.551916+0000","last_clean":"2024-09-12T01:07:26.551916+0000","last_became_active":"2024-09-12T00:21:48.547356+0000","last_became_peered":"2024-09-12T00:21:48.547356+0000","last_unstale":"2024-09-12T01:07:26.551916+0000","last_undegraded":"2024-09-12T01:07:26.551916+0000","last_fullsized":"2024-09-12T01:07:26.551916+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:38.710415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55196,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":458,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.594618+0000","last_change":"2024-09-12T00:21:50.556901+0000","last_active":"2024-09-12T01:04:48.594618+0000","last_peered":"2024-09-12T01:04:48.594618+0000","last_clean":"2024-09-12T01:04:48.594618+0000","last_became_active":"2024-09-12T00:21:50.556220+0000","last_became_peered":"2024-09-12T00:21:50.556220+0000","last_unstale":"2024-09-12T01:04:48.594618+0000","last_undegraded":"2024-09-12T01:04:48.594618+0000","last_fullsized":"2024-09-12T01:04:48.594618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.780602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.632683+0000","last_change":"2024-09-12T00:21:52.567877+0000","last_active":"2024-09-12T01:06:04.632683+0000","last_peered":"2024-09-12T01:06:04.632683+0000","last_clean":"2024-09-12T01:06:04.632683+0000","last_became_active":"2024-09-12T00:21:52.567273+0000","last_became_peered":"2024-09-12T00:21:52.567273+0000","last_unstale":"2024-09-12T01:06:04.632683+0000","last_undegraded":"2024-09-12T01:06:04.632683+0000","last_fullsized":"2024-09-12T01:06:04.632683+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:22.583804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'124","reported_seq":703,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.523823+0000","last_change":"2024-09-12T00:21:44.503225+0000","last_active":"2024-09-12T01:06:06.523823+0000","last_peered":"2024-09-12T01:06:06.523823+0000","last_clean":"2024-09-12T01:06:06.523823+0000","last_became_active":"2024-09-12T00:21:44.502965+0000","last_became_peered":"2024-09-12T00:21:44.502965+0000","last_unstale":"2024-09-12T01:06:06.523823+0000","last_undegraded":"2024-09-12T01:06:06.523823+0000","last_fullsized":"2024-09-12T01:06:06.523823+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:31.381032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":435,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'354","reported_seq":1015,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.668069+0000","last_change":"2024-09-12T00:22:13.521128+0000","last_active":"2024-09-12T01:07:27.668069+0000","last_peered":"2024-09-12T01:07:27.668069+0000","last_clean":"2024-09-12T01:07:27.668069+0000","last_became_active":"2024-09-12T00:22:13.520026+0000","last_became_peered":"2024-09-12T00:22:13.520026+0000","last_unstale":"2024-09-12T01:07:27.668069+0000","last_undegraded":"2024-09-12T01:07:27.668069+0000","last_fullsized":"2024-09-12T01:07:27.668069+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:58.425398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254518,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":616,"num_read_kb":38314,"num_write":1135,"num_write_kb":31045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611545+0000","last_change":"2024-09-12T00:21:46.508177+0000","last_active":"2024-09-12T01:04:34.611545+0000","last_peered":"2024-09-12T01:04:34.611545+0000","last_clean":"2024-09-12T01:04:34.611545+0000","last_became_active":"2024-09-12T00:21:46.507456+0000","last_became_peered":"2024-09-12T00:21:46.507456+0000","last_unstale":"2024-09-12T01:04:34.611545+0000","last_undegraded":"2024-09-12T01:04:34.611545+0000","last_fullsized":"2024-09-12T01:04:34.611545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.624519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'310","reported_seq":892,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.108146+0000","last_change":"2024-09-12T00:21:48.541207+0000","last_active":"2024-09-12T01:07:26.108146+0000","last_peered":"2024-09-12T01:07:26.108146+0000","last_clean":"2024-09-12T01:07:26.108146+0000","last_became_active":"2024-09-12T00:21:48.535782+0000","last_became_peered":"2024-09-12T00:21:48.535782+0000","last_unstale":"2024-09-12T01:07:26.108146+0000","last_undegraded":"2024-09-12T01:07:26.108146+0000","last_fullsized":"2024-09-12T01:07:26.108146+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:36.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1134,"num_write":412,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'751","reported_seq":2246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.508497+0000","last_change":"2024-09-12T00:21:50.558383+0000","last_active":"2024-09-12T01:07:25.508497+0000","last_peered":"2024-09-12T01:07:25.508497+0000","last_clean":"2024-09-12T01:07:25.508497+0000","last_became_active":"2024-09-12T00:21:50.557158+0000","last_became_peered":"2024-09-12T00:21:50.557158+0000","last_unstale":"2024-09-12T01:07:25.508497+0000","last_undegraded":"2024-09-12T01:07:25.508497+0000","last_fullsized":"2024-09-12T01:07:25.508497+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:51.183200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'134","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.252744+0000","last_change":"2024-09-12T00:21:52.546563+0000","last_active":"2024-09-12T01:05:47.252744+0000","last_peered":"2024-09-12T01:05:47.252744+0000","last_clean":"2024-09-12T01:05:47.252744+0000","last_became_active":"2024-09-12T00:21:52.545876+0000","last_became_peered":"2024-09-12T00:21:52.545876+0000","last_unstale":"2024-09-12T01:05:47.252744+0000","last_undegraded":"2024-09-12T01:05:47.252744+0000","last_fullsized":"2024-09-12T01:05:47.252744+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.003099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":172,"num_write":354,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'141","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.454853+0000","last_change":"2024-09-12T00:21:44.494799+0000","last_active":"2024-09-12T01:05:00.454853+0000","last_peered":"2024-09-12T01:05:00.454853+0000","last_clean":"2024-09-12T01:05:00.454853+0000","last_became_active":"2024-09-12T00:21:44.494386+0000","last_became_peered":"2024-09-12T00:21:44.494386+0000","last_unstale":"2024-09-12T01:05:00.454853+0000","last_undegraded":"2024-09-12T01:05:00.454853+0000","last_fullsized":"2024-09-12T01:05:00.454853+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:48.947337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":627,"num_read_kb":527,"num_write":195,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'416","reported_seq":1105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.680806+0000","last_change":"2024-09-12T00:21:42.529220+0000","last_active":"2024-09-12T01:07:27.680806+0000","last_peered":"2024-09-12T01:07:27.680806+0000","last_clean":"2024-09-12T01:07:27.680806+0000","last_became_active":"2024-09-12T00:21:42.528782+0000","last_became_peered":"2024-09-12T00:21:42.528782+0000","last_unstale":"2024-09-12T01:07:27.680806+0000","last_undegraded":"2024-09-12T01:07:27.680806+0000","last_fullsized":"2024-09-12T01:07:27.680806+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:42.093500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170245,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":31515,"num_write":1240,"num_write_kb":36332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'7","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.473745+0000","last_change":"2024-09-12T00:21:46.504153+0000","last_active":"2024-09-12T01:07:25.473745+0000","last_peered":"2024-09-12T01:07:25.473745+0000","last_clean":"2024-09-12T01:07:25.473745+0000","last_became_active":"2024-09-12T00:21:46.503412+0000","last_became_peered":"2024-09-12T00:21:46.503412+0000","last_unstale":"2024-09-12T01:07:25.473745+0000","last_undegraded":"2024-09-12T01:07:25.473745+0000","last_fullsized":"2024-09-12T01:07:25.473745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:47.686112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1686,"num_read_kb":2152,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'73","reported_seq":588,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.311430+0000","last_change":"2024-09-12T00:21:48.546361+0000","last_active":"2024-09-12T01:04:48.311430+0000","last_peered":"2024-09-12T01:04:48.311430+0000","last_clean":"2024-09-12T01:04:48.311430+0000","last_became_active":"2024-09-12T00:21:48.545388+0000","last_became_peered":"2024-09-12T00:21:48.545388+0000","last_unstale":"2024-09-12T01:04:48.311430+0000","last_undegraded":"2024-09-12T01:04:48.311430+0000","last_fullsized":"2024-09-12T01:04:48.311430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.386351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":4011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.509944+0000","last_change":"2024-09-12T00:21:50.537415+0000","last_active":"2024-09-12T01:07:25.509944+0000","last_peered":"2024-09-12T01:07:25.509944+0000","last_clean":"2024-09-12T01:07:25.509944+0000","last_became_active":"2024-09-12T00:21:50.536672+0000","last_became_peered":"2024-09-12T00:21:50.536672+0000","last_unstale":"2024-09-12T01:07:25.509944+0000","last_undegraded":"2024-09-12T01:07:25.509944+0000","last_fullsized":"2024-09-12T01:07:25.509944+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.799043+0000","last_change":"2024-09-12T00:21:52.557213+0000","last_active":"2024-09-12T01:05:30.799043+0000","last_peered":"2024-09-12T01:05:30.799043+0000","last_clean":"2024-09-12T01:05:30.799043+0000","last_became_active":"2024-09-12T00:21:52.556523+0000","last_became_peered":"2024-09-12T00:21:52.556523+0000","last_unstale":"2024-09-12T01:05:30.799043+0000","last_undegraded":"2024-09-12T01:05:30.799043+0000","last_fullsized":"2024-09-12T01:05:30.799043+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:13.223517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":161,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'217","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.545950+0000","last_change":"2024-09-12T00:21:44.515428+0000","last_active":"2024-09-12T01:04:58.545950+0000","last_peered":"2024-09-12T01:04:58.545950+0000","last_clean":"2024-09-12T01:04:58.545950+0000","last_became_active":"2024-09-12T00:21:44.514085+0000","last_became_peered":"2024-09-12T00:21:44.514085+0000","last_unstale":"2024-09-12T01:04:58.545950+0000","last_undegraded":"2024-09-12T01:04:58.545950+0000","last_fullsized":"2024-09-12T01:04:58.545950+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:56.006782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":987,"num_read_kb":820,"num_write":332,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'341","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.612427+0000","last_change":"2024-09-12T00:21:42.485706+0000","last_active":"2024-09-12T01:07:27.612427+0000","last_peered":"2024-09-12T01:07:27.612427+0000","last_clean":"2024-09-12T01:07:27.612427+0000","last_became_active":"2024-09-12T00:21:42.484728+0000","last_became_peered":"2024-09-12T00:21:42.484728+0000","last_unstale":"2024-09-12T01:07:27.612427+0000","last_undegraded":"2024-09-12T01:07:27.612427+0000","last_fullsized":"2024-09-12T01:07:27.612427+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:46.673395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":1781,"num_write":1014,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.630684+0000","last_change":"2024-09-12T00:21:46.515775+0000","last_active":"2024-09-12T01:04:34.630684+0000","last_peered":"2024-09-12T01:04:34.630684+0000","last_clean":"2024-09-12T01:04:34.630684+0000","last_became_active":"2024-09-12T00:21:46.515469+0000","last_became_peered":"2024-09-12T00:21:46.515469+0000","last_unstale":"2024-09-12T01:04:34.630684+0000","last_undegraded":"2024-09-12T01:04:34.630684+0000","last_fullsized":"2024-09-12T01:04:34.630684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:12.258449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'342","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.310858+0000","last_change":"2024-09-12T00:21:48.524169+0000","last_active":"2024-09-12T01:07:27.310858+0000","last_peered":"2024-09-12T01:07:27.310858+0000","last_clean":"2024-09-12T01:07:27.310858+0000","last_became_active":"2024-09-12T00:21:48.523392+0000","last_became_peered":"2024-09-12T00:21:48.523392+0000","last_unstale":"2024-09-12T01:07:27.310858+0000","last_undegraded":"2024-09-12T01:07:27.310858+0000","last_fullsized":"2024-09-12T01:07:27.310858+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:05.832531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50746,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1171,"num_write":440,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.755012+0000","last_change":"2024-09-12T00:21:50.567348+0000","last_active":"2024-09-12T01:04:39.755012+0000","last_peered":"2024-09-12T01:04:39.755012+0000","last_clean":"2024-09-12T01:04:39.755012+0000","last_became_active":"2024-09-12T00:21:50.566831+0000","last_became_peered":"2024-09-12T00:21:50.566831+0000","last_unstale":"2024-09-12T01:04:39.755012+0000","last_undegraded":"2024-09-12T01:04:39.755012+0000","last_fullsized":"2024-09-12T01:04:39.755012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:07.974869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'158","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.073492+0000","last_change":"2024-09-12T00:21:52.563487+0000","last_active":"2024-09-12T01:05:34.073492+0000","last_peered":"2024-09-12T01:05:34.073492+0000","last_clean":"2024-09-12T01:05:34.073492+0000","last_became_active":"2024-09-12T00:21:52.562716+0000","last_became_peered":"2024-09-12T00:21:52.562716+0000","last_unstale":"2024-09-12T01:05:34.073492+0000","last_undegraded":"2024-09-12T01:05:34.073492+0000","last_fullsized":"2024-09-12T01:05:34.073492+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:57.280882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":186,"num_write":388,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'137","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.221538+0000","last_change":"2024-09-12T00:21:44.503230+0000","last_active":"2024-09-12T01:05:43.221538+0000","last_peered":"2024-09-12T01:05:43.221538+0000","last_clean":"2024-09-12T01:05:43.221538+0000","last_became_active":"2024-09-12T00:21:44.502832+0000","last_became_peered":"2024-09-12T00:21:44.502832+0000","last_unstale":"2024-09-12T01:05:43.221538+0000","last_undegraded":"2024-09-12T01:05:43.221538+0000","last_fullsized":"2024-09-12T01:05:43.221538+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:03.323487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":521,"num_write":201,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.580210+0000","last_change":"2024-09-12T01:07:32.580034+0000","last_active":"2024-09-12T01:07:32.580210+0000","last_peered":"2024-09-12T01:07:32.580210+0000","last_clean":"2024-09-12T01:07:32.580210+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T01:07:32.580210+0000","last_undegraded":"2024-09-12T01:07:32.580210+0000","last_fullsized":"2024-09-12T01:07:32.580210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_clean_scrub_stamp":"2024-09-12T01:07:32.579842+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:04.507720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640578+0000","last_change":"2024-09-12T00:21:28.254766+0000","last_active":"2024-09-12T01:05:14.640578+0000","last_peered":"2024-09-12T01:05:14.640578+0000","last_clean":"2024-09-12T01:05:14.640578+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T01:05:14.640578+0000","last_undegraded":"2024-09-12T01:05:14.640578+0000","last_fullsized":"2024-09-12T01:05:14.640578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:37.352626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'330","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.395101+0000","last_change":"2024-09-12T01:07:34.394877+0000","last_active":"2024-09-12T01:07:34.395101+0000","last_peered":"2024-09-12T01:07:34.395101+0000","last_clean":"2024-09-12T01:07:34.395101+0000","last_became_active":"2024-09-12T00:21:42.513672+0000","last_became_peered":"2024-09-12T00:21:42.513672+0000","last_unstale":"2024-09-12T01:07:34.395101+0000","last_undegraded":"2024-09-12T01:07:34.395101+0000","last_fullsized":"2024-09-12T01:07:34.395101+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.394679+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:03.112904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":4546,"num_write":1074,"num_write_kb":26678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.577808+0000","last_change":"2024-09-12T00:21:46.506706+0000","last_active":"2024-09-12T01:03:29.577808+0000","last_peered":"2024-09-12T01:03:29.577808+0000","last_clean":"2024-09-12T01:03:29.577808+0000","last_became_active":"2024-09-12T00:21:46.506196+0000","last_became_peered":"2024-09-12T00:21:46.506196+0000","last_unstale":"2024-09-12T01:03:29.577808+0000","last_undegraded":"2024-09-12T01:03:29.577808+0000","last_fullsized":"2024-09-12T01:03:29.577808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:37.852267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'732","reported_seq":1443,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.450106+0000","last_change":"2024-09-12T00:21:48.545130+0000","last_active":"2024-09-12T01:07:27.450106+0000","last_peered":"2024-09-12T01:07:27.450106+0000","last_clean":"2024-09-12T01:07:27.450106+0000","last_became_active":"2024-09-12T00:21:48.544327+0000","last_became_peered":"2024-09-12T00:21:48.544327+0000","last_unstale":"2024-09-12T01:07:27.450106+0000","last_undegraded":"2024-09-12T01:07:27.450106+0000","last_fullsized":"2024-09-12T01:07:27.450106+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:21.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135809,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1416,"num_read_kb":3269,"num_write":1306,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621223+0000","last_change":"2024-09-12T00:21:50.565245+0000","last_active":"2024-09-12T01:05:14.621223+0000","last_peered":"2024-09-12T01:05:14.621223+0000","last_clean":"2024-09-12T01:05:14.621223+0000","last_became_active":"2024-09-12T00:21:50.564442+0000","last_became_peered":"2024-09-12T00:21:50.564442+0000","last_unstale":"2024-09-12T01:05:14.621223+0000","last_undegraded":"2024-09-12T01:05:14.621223+0000","last_fullsized":"2024-09-12T01:05:14.621223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'206","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.344626+0000","last_change":"2024-09-12T00:21:52.557348+0000","last_active":"2024-09-12T01:06:07.344626+0000","last_peered":"2024-09-12T01:06:07.344626+0000","last_clean":"2024-09-12T01:06:07.344626+0000","last_became_active":"2024-09-12T00:21:52.550903+0000","last_became_peered":"2024-09-12T00:21:52.550903+0000","last_unstale":"2024-09-12T01:06:07.344626+0000","last_undegraded":"2024-09-12T01:06:07.344626+0000","last_fullsized":"2024-09-12T01:06:07.344626+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:10.990623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":429,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'100","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.182137+0000","last_change":"2024-09-12T00:21:44.519572+0000","last_active":"2024-09-12T01:05:29.182137+0000","last_peered":"2024-09-12T01:05:29.182137+0000","last_clean":"2024-09-12T01:05:29.182137+0000","last_became_active":"2024-09-12T00:21:44.518873+0000","last_became_peered":"2024-09-12T00:21:44.518873+0000","last_unstale":"2024-09-12T01:05:29.182137+0000","last_undegraded":"2024-09-12T01:05:29.182137+0000","last_fullsized":"2024-09-12T01:05:29.182137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:37.792281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":399,"num_write":140,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.899120+0000","last_change":"2024-09-12T01:07:33.899120+0000","last_active":"2024-09-12T01:07:33.899120+0000","last_peered":"2024-09-12T01:07:33.899120+0000","last_clean":"2024-09-12T01:07:33.899120+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T01:07:33.899120+0000","last_undegraded":"2024-09-12T01:07:33.899120+0000","last_fullsized":"2024-09-12T01:07:33.899120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.899012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:18.503999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'343","reported_seq":1168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.681906+0000","last_change":"2024-09-12T00:21:42.530775+0000","last_active":"2024-09-12T01:07:27.681906+0000","last_peered":"2024-09-12T01:07:27.681906+0000","last_clean":"2024-09-12T01:07:27.681906+0000","last_became_active":"2024-09-12T00:21:42.530049+0000","last_became_peered":"2024-09-12T00:21:42.530049+0000","last_unstale":"2024-09-12T01:07:27.681906+0000","last_undegraded":"2024-09-12T01:07:27.681906+0000","last_fullsized":"2024-09-12T01:07:27.681906+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.562005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":794,"num_read_kb":7845,"num_write":1116,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.639489+0000","last_change":"2024-09-12T00:21:46.506977+0000","last_active":"2024-09-12T01:05:09.639489+0000","last_peered":"2024-09-12T01:05:09.639489+0000","last_clean":"2024-09-12T01:05:09.639489+0000","last_became_active":"2024-09-12T00:21:46.506303+0000","last_became_peered":"2024-09-12T00:21:46.506303+0000","last_unstale":"2024-09-12T01:05:09.639489+0000","last_undegraded":"2024-09-12T01:05:09.639489+0000","last_fullsized":"2024-09-12T01:05:09.639489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:15.859039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1265","reported_seq":2749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.380915+0000","last_change":"2024-09-12T00:21:48.539139+0000","last_active":"2024-09-12T01:07:27.380915+0000","last_peered":"2024-09-12T01:07:27.380915+0000","last_clean":"2024-09-12T01:07:27.380915+0000","last_became_active":"2024-09-12T00:21:48.538447+0000","last_became_peered":"2024-09-12T00:21:48.538447+0000","last_unstale":"2024-09-12T01:07:27.380915+0000","last_undegraded":"2024-09-12T01:07:27.380915+0000","last_fullsized":"2024-09-12T01:07:27.380915+0000","mapping_epoch":32,"log_start":"267'1200","ondisk_log_start":"267'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:58.399951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157796,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2036,"num_read_kb":3848,"num_write":1138,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617264+0000","last_change":"2024-09-12T00:21:50.569042+0000","last_active":"2024-09-12T01:03:44.617264+0000","last_peered":"2024-09-12T01:03:44.617264+0000","last_clean":"2024-09-12T01:03:44.617264+0000","last_became_active":"2024-09-12T00:21:50.568353+0000","last_became_peered":"2024-09-12T00:21:50.568353+0000","last_unstale":"2024-09-12T01:03:44.617264+0000","last_undegraded":"2024-09-12T01:03:44.617264+0000","last_fullsized":"2024-09-12T01:03:44.617264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'220","reported_seq":750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.623554+0000","last_change":"2024-09-12T00:21:52.560037+0000","last_active":"2024-09-12T01:05:24.623554+0000","last_peered":"2024-09-12T01:05:24.623554+0000","last_clean":"2024-09-12T01:05:24.623554+0000","last_became_active":"2024-09-12T00:21:52.559325+0000","last_became_peered":"2024-09-12T00:21:52.559325+0000","last_unstale":"2024-09-12T01:05:24.623554+0000","last_undegraded":"2024-09-12T01:05:24.623554+0000","last_fullsized":"2024-09-12T01:05:24.623554+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":373,"num_write":495,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'235","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.199872+0000","last_change":"2024-09-12T00:21:44.499926+0000","last_active":"2024-09-12T01:05:36.199872+0000","last_peered":"2024-09-12T01:05:36.199872+0000","last_clean":"2024-09-12T01:05:36.199872+0000","last_became_active":"2024-09-12T00:21:44.499405+0000","last_became_peered":"2024-09-12T00:21:44.499405+0000","last_unstale":"2024-09-12T01:05:36.199872+0000","last_undegraded":"2024-09-12T01:05:36.199872+0000","last_fullsized":"2024-09-12T01:05:36.199872+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:43.127372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":847,"num_write":402,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600239+0000","last_change":"2024-09-12T00:21:28.255269+0000","last_active":"2024-09-12T01:05:13.600239+0000","last_peered":"2024-09-12T01:05:13.600239+0000","last_clean":"2024-09-12T01:05:13.600239+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T01:05:13.600239+0000","last_undegraded":"2024-09-12T01:05:13.600239+0000","last_fullsized":"2024-09-12T01:05:13.600239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:37.489457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'318","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.596982+0000","last_change":"2024-09-12T00:21:42.537155+0000","last_active":"2024-09-12T01:07:27.596982+0000","last_peered":"2024-09-12T01:07:27.596982+0000","last_clean":"2024-09-12T01:07:27.596982+0000","last_became_active":"2024-09-12T00:21:42.533356+0000","last_became_peered":"2024-09-12T00:21:42.533356+0000","last_unstale":"2024-09-12T01:07:27.596982+0000","last_undegraded":"2024-09-12T01:07:27.596982+0000","last_fullsized":"2024-09-12T01:07:27.596982+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":11281,"num_write":971,"num_write_kb":25420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.599241+0000","last_change":"2024-09-12T00:21:46.511151+0000","last_active":"2024-09-12T01:05:08.599241+0000","last_peered":"2024-09-12T01:05:08.599241+0000","last_clean":"2024-09-12T01:05:08.599241+0000","last_became_active":"2024-09-12T00:21:46.510230+0000","last_became_peered":"2024-09-12T00:21:46.510230+0000","last_unstale":"2024-09-12T01:05:08.599241+0000","last_undegraded":"2024-09-12T01:05:08.599241+0000","last_fullsized":"2024-09-12T01:05:08.599241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:33.182597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'236","reported_seq":1333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.947368+0000","last_change":"2024-09-12T00:21:48.543106+0000","last_active":"2024-09-12T01:07:12.947368+0000","last_peered":"2024-09-12T01:07:12.947368+0000","last_clean":"2024-09-12T01:07:12.947368+0000","last_became_active":"2024-09-12T00:21:48.541987+0000","last_became_peered":"2024-09-12T00:21:48.541987+0000","last_unstale":"2024-09-12T01:07:12.947368+0000","last_undegraded":"2024-09-12T01:07:12.947368+0000","last_fullsized":"2024-09-12T01:07:12.947368+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:35.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.571245+0000","last_change":"2024-09-12T00:21:50.550098+0000","last_active":"2024-09-12T01:03:34.571245+0000","last_peered":"2024-09-12T01:03:34.571245+0000","last_clean":"2024-09-12T01:03:34.571245+0000","last_became_active":"2024-09-12T00:21:50.549468+0000","last_became_peered":"2024-09-12T00:21:50.549468+0000","last_unstale":"2024-09-12T01:03:34.571245+0000","last_undegraded":"2024-09-12T01:03:34.571245+0000","last_fullsized":"2024-09-12T01:03:34.571245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:51.226795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'266","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.525444+0000","last_change":"2024-09-12T00:21:52.553306+0000","last_active":"2024-09-12T01:06:07.525444+0000","last_peered":"2024-09-12T01:06:07.525444+0000","last_clean":"2024-09-12T01:06:07.525444+0000","last_became_active":"2024-09-12T00:21:52.552571+0000","last_became_peered":"2024-09-12T00:21:52.552571+0000","last_unstale":"2024-09-12T01:06:07.525444+0000","last_undegraded":"2024-09-12T01:06:07.525444+0000","last_fullsized":"2024-09-12T01:06:07.525444+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.410934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":539,"num_write":598,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'152","reported_seq":767,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.302354+0000","last_change":"2024-09-12T00:21:44.494446+0000","last_active":"2024-09-12T01:05:46.302354+0000","last_peered":"2024-09-12T01:05:46.302354+0000","last_clean":"2024-09-12T01:05:46.302354+0000","last_became_active":"2024-09-12T00:21:44.493744+0000","last_became_peered":"2024-09-12T00:21:44.493744+0000","last_unstale":"2024-09-12T01:05:46.302354+0000","last_undegraded":"2024-09-12T01:05:46.302354+0000","last_fullsized":"2024-09-12T01:05:46.302354+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.811924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":592,"num_write":229,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640540+0000","last_change":"2024-09-12T00:21:28.255515+0000","last_active":"2024-09-12T01:05:14.640540+0000","last_peered":"2024-09-12T01:05:14.640540+0000","last_clean":"2024-09-12T01:05:14.640540+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T01:05:14.640540+0000","last_undegraded":"2024-09-12T01:05:14.640540+0000","last_fullsized":"2024-09-12T01:05:14.640540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:43.203836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'327","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.015691+0000","last_change":"2024-09-12T01:07:34.015525+0000","last_active":"2024-09-12T01:07:34.015691+0000","last_peered":"2024-09-12T01:07:34.015691+0000","last_clean":"2024-09-12T01:07:34.015691+0000","last_became_active":"2024-09-12T00:21:42.528949+0000","last_became_peered":"2024-09-12T00:21:42.528949+0000","last_unstale":"2024-09-12T01:07:34.015691+0000","last_undegraded":"2024-09-12T01:07:34.015691+0000","last_fullsized":"2024-09-12T01:07:34.015691+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.015318+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.629212+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":67654,"num_write":1033,"num_write_kb":55160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:38.578580+0000","last_change":"2024-09-12T00:21:46.518181+0000","last_active":"2024-09-12T01:03:38.578580+0000","last_peered":"2024-09-12T01:03:38.578580+0000","last_clean":"2024-09-12T01:03:38.578580+0000","last_became_active":"2024-09-12T00:21:46.517381+0000","last_became_peered":"2024-09-12T00:21:46.517381+0000","last_unstale":"2024-09-12T01:03:38.578580+0000","last_undegraded":"2024-09-12T01:03:38.578580+0000","last_fullsized":"2024-09-12T01:03:38.578580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:55.356740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'120","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.029686+0000","last_change":"2024-09-12T00:21:48.553881+0000","last_active":"2024-09-12T01:07:13.029686+0000","last_peered":"2024-09-12T01:07:13.029686+0000","last_clean":"2024-09-12T01:07:13.029686+0000","last_became_active":"2024-09-12T00:21:48.553129+0000","last_became_peered":"2024-09-12T00:21:48.553129+0000","last_unstale":"2024-09-12T01:07:13.029686+0000","last_undegraded":"2024-09-12T01:07:13.029686+0000","last_fullsized":"2024-09-12T01:07:13.029686+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:52.650170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640743+0000","last_change":"2024-09-12T00:21:50.545732+0000","last_active":"2024-09-12T01:05:14.640743+0000","last_peered":"2024-09-12T01:05:14.640743+0000","last_clean":"2024-09-12T01:05:14.640743+0000","last_became_active":"2024-09-12T00:21:50.545037+0000","last_became_peered":"2024-09-12T00:21:50.545037+0000","last_unstale":"2024-09-12T01:05:14.640743+0000","last_undegraded":"2024-09-12T01:05:14.640743+0000","last_fullsized":"2024-09-12T01:05:14.640743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'98","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.414533+0000","last_change":"2024-09-12T00:21:52.541609+0000","last_active":"2024-09-12T01:06:07.414533+0000","last_peered":"2024-09-12T01:06:07.414533+0000","last_clean":"2024-09-12T01:06:07.414533+0000","last_became_active":"2024-09-12T00:21:52.540900+0000","last_became_peered":"2024-09-12T00:21:52.540900+0000","last_unstale":"2024-09-12T01:06:07.414533+0000","last_undegraded":"2024-09-12T01:06:07.414533+0000","last_fullsized":"2024-09-12T01:06:07.414533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:38.138742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":212,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'221","reported_seq":831,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.598681+0000","last_change":"2024-09-12T00:21:44.498171+0000","last_active":"2024-09-12T01:05:29.598681+0000","last_peered":"2024-09-12T01:05:29.598681+0000","last_clean":"2024-09-12T01:05:29.598681+0000","last_became_active":"2024-09-12T00:21:44.497354+0000","last_became_peered":"2024-09-12T00:21:44.497354+0000","last_unstale":"2024-09-12T01:05:29.598681+0000","last_undegraded":"2024-09-12T01:05:29.598681+0000","last_fullsized":"2024-09-12T01:05:29.598681+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:14.091559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":990,"num_read_kb":806,"num_write":357,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'303","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.246713+0000","last_change":"2024-09-12T01:07:34.246713+0000","last_active":"2024-09-12T01:07:34.246713+0000","last_peered":"2024-09-12T01:07:34.246713+0000","last_clean":"2024-09-12T01:07:34.246713+0000","last_became_active":"2024-09-12T00:21:42.521990+0000","last_became_peered":"2024-09-12T00:21:42.521990+0000","last_unstale":"2024-09-12T01:07:34.246713+0000","last_undegraded":"2024-09-12T01:07:34.246713+0000","last_fullsized":"2024-09-12T01:07:34.246713+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'303","last_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_deep_scrub":"267'303","last_deep_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.246523+0000","objects_scrubbed":10,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.373734+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829291,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":446,"num_read_kb":61837,"num_write":1004,"num_write_kb":29041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621065+0000","last_change":"2024-09-12T00:21:28.750763+0000","last_active":"2024-09-12T01:05:14.621065+0000","last_peered":"2024-09-12T01:05:14.621065+0000","last_clean":"2024-09-12T01:05:14.621065+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T01:05:14.621065+0000","last_undegraded":"2024-09-12T01:05:14.621065+0000","last_fullsized":"2024-09-12T01:05:14.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:40.130897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.570148+0000","last_change":"2024-09-12T00:21:46.499113+0000","last_active":"2024-09-12T01:03:29.570148+0000","last_peered":"2024-09-12T01:03:29.570148+0000","last_clean":"2024-09-12T01:03:29.570148+0000","last_became_active":"2024-09-12T00:21:46.498378+0000","last_became_peered":"2024-09-12T00:21:46.498378+0000","last_unstale":"2024-09-12T01:03:29.570148+0000","last_undegraded":"2024-09-12T01:03:29.570148+0000","last_fullsized":"2024-09-12T01:03:29.570148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:56.000475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'578","reported_seq":1246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.989988+0000","last_change":"2024-09-12T00:21:48.535483+0000","last_active":"2024-09-12T01:07:26.989988+0000","last_peered":"2024-09-12T01:07:26.989988+0000","last_clean":"2024-09-12T01:07:26.989988+0000","last_became_active":"2024-09-12T00:21:48.534749+0000","last_became_peered":"2024-09-12T00:21:48.534749+0000","last_unstale":"2024-09-12T01:07:26.989988+0000","last_undegraded":"2024-09-12T01:07:26.989988+0000","last_fullsized":"2024-09-12T01:07:26.989988+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:39.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96095,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1602,"num_read_kb":2762,"num_write":2078,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.739282+0000","last_change":"2024-09-12T00:21:50.556186+0000","last_active":"2024-09-12T01:03:34.739282+0000","last_peered":"2024-09-12T01:03:34.739282+0000","last_clean":"2024-09-12T01:03:34.739282+0000","last_became_active":"2024-09-12T00:21:50.554728+0000","last_became_peered":"2024-09-12T00:21:50.554728+0000","last_unstale":"2024-09-12T01:03:34.739282+0000","last_undegraded":"2024-09-12T01:03:34.739282+0000","last_fullsized":"2024-09-12T01:03:34.739282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:49.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'174","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.400639+0000","last_change":"2024-09-12T00:21:52.558976+0000","last_active":"2024-09-12T01:05:25.400639+0000","last_peered":"2024-09-12T01:05:25.400639+0000","last_clean":"2024-09-12T01:05:25.400639+0000","last_became_active":"2024-09-12T00:21:52.558203+0000","last_became_peered":"2024-09-12T00:21:52.558203+0000","last_unstale":"2024-09-12T01:05:25.400639+0000","last_undegraded":"2024-09-12T01:05:25.400639+0000","last_fullsized":"2024-09-12T01:05:25.400639+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:46.691847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1145,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":410,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'196","reported_seq":827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:52.162347+0000","last_change":"2024-09-12T00:21:44.498346+0000","last_active":"2024-09-12T01:05:52.162347+0000","last_peered":"2024-09-12T01:05:52.162347+0000","last_clean":"2024-09-12T01:05:52.162347+0000","last_became_active":"2024-09-12T00:21:44.497510+0000","last_became_peered":"2024-09-12T00:21:44.497510+0000","last_unstale":"2024-09-12T01:05:52.162347+0000","last_undegraded":"2024-09-12T01:05:52.162347+0000","last_fullsized":"2024-09-12T01:05:52.162347+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:28.893058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":719,"num_write":306,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'327","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.701182+0000","last_change":"2024-09-12T00:21:42.529749+0000","last_active":"2024-09-12T01:07:27.701182+0000","last_peered":"2024-09-12T01:07:27.701182+0000","last_clean":"2024-09-12T01:07:27.701182+0000","last_became_active":"2024-09-12T00:21:42.529084+0000","last_became_peered":"2024-09-12T00:21:42.529084+0000","last_unstale":"2024-09-12T01:07:27.701182+0000","last_undegraded":"2024-09-12T01:07:27.701182+0000","last_fullsized":"2024-09-12T01:07:27.701182+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:23.266713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":3172,"num_write":1083,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.643720+0000","last_change":"2024-09-12T00:21:28.256092+0000","last_active":"2024-09-12T01:05:24.643720+0000","last_peered":"2024-09-12T01:05:24.643720+0000","last_clean":"2024-09-12T01:05:24.643720+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T01:05:24.643720+0000","last_undegraded":"2024-09-12T01:05:24.643720+0000","last_fullsized":"2024-09-12T01:05:24.643720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.577690+0000","last_change":"2024-09-12T00:21:46.507947+0000","last_active":"2024-09-12T01:03:29.577690+0000","last_peered":"2024-09-12T01:03:29.577690+0000","last_clean":"2024-09-12T01:03:29.577690+0000","last_became_active":"2024-09-12T00:21:46.507150+0000","last_became_peered":"2024-09-12T00:21:46.507150+0000","last_unstale":"2024-09-12T01:03:29.577690+0000","last_undegraded":"2024-09-12T01:03:29.577690+0000","last_fullsized":"2024-09-12T01:03:29.577690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:27.994405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'166","reported_seq":730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.042400+0000","last_change":"2024-09-12T00:21:48.546326+0000","last_active":"2024-09-12T01:04:58.042400+0000","last_peered":"2024-09-12T01:04:58.042400+0000","last_clean":"2024-09-12T01:04:58.042400+0000","last_became_active":"2024-09-12T00:21:48.545244+0000","last_became_peered":"2024-09-12T00:21:48.545244+0000","last_unstale":"2024-09-12T01:04:58.042400+0000","last_undegraded":"2024-09-12T01:04:58.042400+0000","last_fullsized":"2024-09-12T01:04:58.042400+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.959520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'771","reported_seq":2801,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.504563+0000","last_change":"2024-09-12T00:21:50.566794+0000","last_active":"2024-09-12T01:07:25.504563+0000","last_peered":"2024-09-12T01:07:25.504563+0000","last_clean":"2024-09-12T01:07:25.504563+0000","last_became_active":"2024-09-12T00:21:50.565930+0000","last_became_peered":"2024-09-12T00:21:50.565930+0000","last_unstale":"2024-09-12T01:07:25.504563+0000","last_undegraded":"2024-09-12T01:07:25.504563+0000","last_fullsized":"2024-09-12T01:07:25.504563+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:10.827538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.868125+0000","last_change":"2024-09-12T00:21:52.563826+0000","last_active":"2024-09-12T01:07:12.868125+0000","last_peered":"2024-09-12T01:07:12.868125+0000","last_clean":"2024-09-12T01:07:12.868125+0000","last_became_active":"2024-09-12T00:21:52.562765+0000","last_became_peered":"2024-09-12T00:21:52.562765+0000","last_unstale":"2024-09-12T01:07:12.868125+0000","last_undegraded":"2024-09-12T01:07:12.868125+0000","last_fullsized":"2024-09-12T01:07:12.868125+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.216884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":136,"num_write":336,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'106","reported_seq":691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.575375+0000","last_change":"2024-09-12T00:21:44.493205+0000","last_active":"2024-09-12T01:03:54.575375+0000","last_peered":"2024-09-12T01:03:54.575375+0000","last_clean":"2024-09-12T01:03:54.575375+0000","last_became_active":"2024-09-12T00:21:44.492443+0000","last_became_peered":"2024-09-12T00:21:44.492443+0000","last_unstale":"2024-09-12T01:03:54.575375+0000","last_undegraded":"2024-09-12T01:03:54.575375+0000","last_fullsized":"2024-09-12T01:03:54.575375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:20.383680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":379,"num_write":156,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'324","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.610887+0000","last_change":"2024-09-12T00:21:42.506233+0000","last_active":"2024-09-12T01:07:27.610887+0000","last_peered":"2024-09-12T01:07:27.610887+0000","last_clean":"2024-09-12T01:07:27.610887+0000","last_became_active":"2024-09-12T00:21:42.505355+0000","last_became_peered":"2024-09-12T00:21:42.505355+0000","last_unstale":"2024-09-12T01:07:27.610887+0000","last_undegraded":"2024-09-12T01:07:27.610887+0000","last_fullsized":"2024-09-12T01:07:27.610887+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:51.142709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":8879,"num_write":1116,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587669+0000","last_change":"2024-09-12T00:21:28.670456+0000","last_active":"2024-09-12T01:04:49.587669+0000","last_peered":"2024-09-12T01:04:49.587669+0000","last_clean":"2024-09-12T01:04:49.587669+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T01:04:49.587669+0000","last_undegraded":"2024-09-12T01:04:49.587669+0000","last_fullsized":"2024-09-12T01:04:49.587669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:30.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.613152+0000","last_change":"2024-09-12T00:21:46.507186+0000","last_active":"2024-09-12T01:03:29.613152+0000","last_peered":"2024-09-12T01:03:29.613152+0000","last_clean":"2024-09-12T01:03:29.613152+0000","last_became_active":"2024-09-12T00:21:46.506416+0000","last_became_peered":"2024-09-12T00:21:46.506416+0000","last_unstale":"2024-09-12T01:03:29.613152+0000","last_undegraded":"2024-09-12T01:03:29.613152+0000","last_fullsized":"2024-09-12T01:03:29.613152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:06.407604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'112","reported_seq":655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.074689+0000","last_change":"2024-09-12T00:21:48.541779+0000","last_active":"2024-09-12T01:05:04.074689+0000","last_peered":"2024-09-12T01:05:04.074689+0000","last_clean":"2024-09-12T01:05:04.074689+0000","last_became_active":"2024-09-12T00:21:48.541051+0000","last_became_peered":"2024-09-12T00:21:48.541051+0000","last_unstale":"2024-09-12T01:05:04.074689+0000","last_undegraded":"2024-09-12T01:05:04.074689+0000","last_fullsized":"2024-09-12T01:05:04.074689+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:48.095228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'781","reported_seq":2255,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.265377+0000","last_change":"2024-09-12T00:21:50.565496+0000","last_active":"2024-09-12T01:07:27.265377+0000","last_peered":"2024-09-12T01:07:27.265377+0000","last_clean":"2024-09-12T01:07:27.265377+0000","last_became_active":"2024-09-12T00:21:50.564982+0000","last_became_peered":"2024-09-12T00:21:50.564982+0000","last_unstale":"2024-09-12T01:07:27.265377+0000","last_undegraded":"2024-09-12T01:07:27.265377+0000","last_fullsized":"2024-09-12T01:07:27.265377+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:45.360699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'150","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.238137+0000","last_change":"2024-09-12T00:21:52.556569+0000","last_active":"2024-09-12T01:05:51.238137+0000","last_peered":"2024-09-12T01:05:51.238137+0000","last_clean":"2024-09-12T01:05:51.238137+0000","last_became_active":"2024-09-12T00:21:52.555909+0000","last_became_peered":"2024-09-12T00:21:52.555909+0000","last_unstale":"2024-09-12T01:05:51.238137+0000","last_undegraded":"2024-09-12T01:05:51.238137+0000","last_fullsized":"2024-09-12T01:05:51.238137+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:36.848678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":331,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'167","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:02.030951+0000","last_change":"2024-09-12T00:21:44.494606+0000","last_active":"2024-09-12T01:06:02.030951+0000","last_peered":"2024-09-12T01:06:02.030951+0000","last_clean":"2024-09-12T01:06:02.030951+0000","last_became_active":"2024-09-12T00:21:44.494215+0000","last_became_peered":"2024-09-12T00:21:44.494215+0000","last_unstale":"2024-09-12T01:06:02.030951+0000","last_undegraded":"2024-09-12T01:06:02.030951+0000","last_fullsized":"2024-09-12T01:06:02.030951+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":568,"num_write":276,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'381","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.685832+0000","last_change":"2024-09-12T00:21:42.495485+0000","last_active":"2024-09-12T01:07:27.685832+0000","last_peered":"2024-09-12T01:07:27.685832+0000","last_clean":"2024-09-12T01:07:27.685832+0000","last_became_active":"2024-09-12T00:21:42.494486+0000","last_became_peered":"2024-09-12T00:21:42.494486+0000","last_unstale":"2024-09-12T01:07:27.685832+0000","last_undegraded":"2024-09-12T01:07:27.685832+0000","last_fullsized":"2024-09-12T01:07:27.685832+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.868593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":23252,"num_write":1238,"num_write_kb":41943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634565+0000","last_change":"2024-09-12T00:21:28.255394+0000","last_active":"2024-09-12T01:04:49.634565+0000","last_peered":"2024-09-12T01:04:49.634565+0000","last_clean":"2024-09-12T01:04:49.634565+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T01:04:49.634565+0000","last_undegraded":"2024-09-12T01:04:49.634565+0000","last_fullsized":"2024-09-12T01:04:49.634565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:25.204719+0000","last_clean_scrub_stamp":"2024-09-12T00:21:25.204719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:59.294638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.576422+0000","last_change":"2024-09-12T00:21:46.491161+0000","last_active":"2024-09-12T01:03:59.576422+0000","last_peered":"2024-09-12T01:03:59.576422+0000","last_clean":"2024-09-12T01:03:59.576422+0000","last_became_active":"2024-09-12T00:21:46.490398+0000","last_became_peered":"2024-09-12T00:21:46.490398+0000","last_unstale":"2024-09-12T01:03:59.576422+0000","last_undegraded":"2024-09-12T01:03:59.576422+0000","last_fullsized":"2024-09-12T01:03:59.576422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:39.280351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'716","reported_seq":1443,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.184440+0000","last_change":"2024-09-12T00:21:48.545913+0000","last_active":"2024-09-12T01:07:27.184440+0000","last_peered":"2024-09-12T01:07:27.184440+0000","last_clean":"2024-09-12T01:07:27.184440+0000","last_became_active":"2024-09-12T00:21:48.543101+0000","last_became_peered":"2024-09-12T00:21:48.543101+0000","last_unstale":"2024-09-12T01:07:27.184440+0000","last_undegraded":"2024-09-12T01:07:27.184440+0000","last_fullsized":"2024-09-12T01:07:27.184440+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":700,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1291,"num_read_kb":3081,"num_write":1048,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.571169+0000","last_change":"2024-09-12T00:21:50.551312+0000","last_active":"2024-09-12T01:03:34.571169+0000","last_peered":"2024-09-12T01:03:34.571169+0000","last_clean":"2024-09-12T01:03:34.571169+0000","last_became_active":"2024-09-12T00:21:50.549692+0000","last_became_peered":"2024-09-12T00:21:50.549692+0000","last_unstale":"2024-09-12T01:03:34.571169+0000","last_undegraded":"2024-09-12T01:03:34.571169+0000","last_fullsized":"2024-09-12T01:03:34.571169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:16.254094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'107","reported_seq":601,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.235026+0000","last_change":"2024-09-12T00:21:52.556774+0000","last_active":"2024-09-12T01:05:43.235026+0000","last_peered":"2024-09-12T01:05:43.235026+0000","last_clean":"2024-09-12T01:05:43.235026+0000","last_became_active":"2024-09-12T00:21:52.556038+0000","last_became_peered":"2024-09-12T00:21:52.556038+0000","last_unstale":"2024-09-12T01:05:43.235026+0000","last_undegraded":"2024-09-12T01:05:43.235026+0000","last_fullsized":"2024-09-12T01:05:43.235026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:26.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":258,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'117","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.624149+0000","last_change":"2024-09-12T00:21:52.538201+0000","last_active":"2024-09-12T01:06:06.624149+0000","last_peered":"2024-09-12T01:06:06.624149+0000","last_clean":"2024-09-12T01:06:06.624149+0000","last_became_active":"2024-09-12T00:21:52.537464+0000","last_became_peered":"2024-09-12T00:21:52.537464+0000","last_unstale":"2024-09-12T01:06:06.624149+0000","last_undegraded":"2024-09-12T01:06:06.624149+0000","last_fullsized":"2024-09-12T01:06:06.624149+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:06.332481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":226,"num_write":297,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'147","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.222011+0000","last_change":"2024-09-12T00:21:44.507294+0000","last_active":"2024-09-12T01:04:11.222011+0000","last_peered":"2024-09-12T01:04:11.222011+0000","last_clean":"2024-09-12T01:04:11.222011+0000","last_became_active":"2024-09-12T00:21:44.494375+0000","last_became_peered":"2024-09-12T00:21:44.494375+0000","last_unstale":"2024-09-12T01:04:11.222011+0000","last_undegraded":"2024-09-12T01:04:11.222011+0000","last_fullsized":"2024-09-12T01:04:11.222011+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:57.052664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":613,"num_write":235,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'406","reported_seq":1108,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.647016+0000","last_change":"2024-09-12T00:21:42.495876+0000","last_active":"2024-09-12T01:07:27.647016+0000","last_peered":"2024-09-12T01:07:27.647016+0000","last_clean":"2024-09-12T01:07:27.647016+0000","last_became_active":"2024-09-12T00:21:42.495160+0000","last_became_peered":"2024-09-12T00:21:42.495160+0000","last_unstale":"2024-09-12T01:07:27.647016+0000","last_undegraded":"2024-09-12T01:07:27.647016+0000","last_fullsized":"2024-09-12T01:07:27.647016+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.406950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":36670,"num_write":1291,"num_write_kb":30706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.576962+0000","last_change":"2024-09-12T00:21:46.504482+0000","last_active":"2024-09-12T01:03:49.576962+0000","last_peered":"2024-09-12T01:03:49.576962+0000","last_clean":"2024-09-12T01:03:49.576962+0000","last_became_active":"2024-09-12T00:21:46.503594+0000","last_became_peered":"2024-09-12T00:21:46.503594+0000","last_unstale":"2024-09-12T01:03:49.576962+0000","last_undegraded":"2024-09-12T01:03:49.576962+0000","last_fullsized":"2024-09-12T01:03:49.576962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:50.259430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'273","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.582225+0000","last_change":"2024-09-12T00:21:48.546884+0000","last_active":"2024-09-12T01:07:27.582225+0000","last_peered":"2024-09-12T01:07:27.582225+0000","last_clean":"2024-09-12T01:07:27.582225+0000","last_became_active":"2024-09-12T00:21:48.546213+0000","last_became_peered":"2024-09-12T00:21:48.546213+0000","last_unstale":"2024-09-12T01:07:27.582225+0000","last_undegraded":"2024-09-12T01:07:27.582225+0000","last_fullsized":"2024-09-12T01:07:27.582225+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:17.869108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44075,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":436,"num_read_kb":989,"num_write":348,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581894+0000","last_change":"2024-09-12T00:21:50.549810+0000","last_active":"2024-09-12T01:03:53.581894+0000","last_peered":"2024-09-12T01:03:53.581894+0000","last_clean":"2024-09-12T01:03:53.581894+0000","last_became_active":"2024-09-12T00:21:50.549135+0000","last_became_peered":"2024-09-12T00:21:50.549135+0000","last_unstale":"2024-09-12T01:03:53.581894+0000","last_undegraded":"2024-09-12T01:03:53.581894+0000","last_fullsized":"2024-09-12T01:03:53.581894+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:36.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'126","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.920723+0000","last_change":"2024-09-12T00:21:52.563982+0000","last_active":"2024-09-12T01:07:11.920723+0000","last_peered":"2024-09-12T01:07:11.920723+0000","last_clean":"2024-09-12T01:07:11.920723+0000","last_became_active":"2024-09-12T00:21:52.563303+0000","last_became_peered":"2024-09-12T00:21:52.563303+0000","last_unstale":"2024-09-12T01:07:11.920723+0000","last_undegraded":"2024-09-12T01:07:11.920723+0000","last_fullsized":"2024-09-12T01:07:11.920723+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:33.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":144,"num_write":323,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'152","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.618706+0000","last_change":"2024-09-12T00:21:44.498404+0000","last_active":"2024-09-12T01:04:20.618706+0000","last_peered":"2024-09-12T01:04:20.618706+0000","last_clean":"2024-09-12T01:04:20.618706+0000","last_became_active":"2024-09-12T00:21:44.495299+0000","last_became_peered":"2024-09-12T00:21:44.495299+0000","last_unstale":"2024-09-12T01:04:20.618706+0000","last_undegraded":"2024-09-12T01:04:20.618706+0000","last_fullsized":"2024-09-12T01:04:20.618706+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":653,"num_read_kb":535,"num_write":221,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'287","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.578077+0000","last_change":"2024-09-12T00:21:42.511183+0000","last_active":"2024-09-12T01:07:27.578077+0000","last_peered":"2024-09-12T01:07:27.578077+0000","last_clean":"2024-09-12T01:07:27.578077+0000","last_became_active":"2024-09-12T00:21:42.510774+0000","last_became_peered":"2024-09-12T00:21:42.510774+0000","last_unstale":"2024-09-12T01:07:27.578077+0000","last_undegraded":"2024-09-12T01:07:27.578077+0000","last_fullsized":"2024-09-12T01:07:27.578077+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:35.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254443,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":10210,"num_write":929,"num_write_kb":22659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574388+0000","last_change":"2024-09-12T00:21:46.499247+0000","last_active":"2024-09-12T01:03:49.574388+0000","last_peered":"2024-09-12T01:03:49.574388+0000","last_clean":"2024-09-12T01:03:49.574388+0000","last_became_active":"2024-09-12T00:21:46.498536+0000","last_became_peered":"2024-09-12T00:21:46.498536+0000","last_unstale":"2024-09-12T01:03:49.574388+0000","last_undegraded":"2024-09-12T01:03:49.574388+0000","last_fullsized":"2024-09-12T01:03:49.574388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:23.854256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'42","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.160500+0000","last_change":"2024-09-12T00:21:48.530906+0000","last_active":"2024-09-12T01:04:59.160500+0000","last_peered":"2024-09-12T01:04:59.160500+0000","last_clean":"2024-09-12T01:04:59.160500+0000","last_became_active":"2024-09-12T00:21:48.528299+0000","last_became_peered":"2024-09-12T00:21:48.528299+0000","last_unstale":"2024-09-12T01:04:59.160500+0000","last_undegraded":"2024-09-12T01:04:59.160500+0000","last_fullsized":"2024-09-12T01:04:59.160500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:04.289536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.744259+0000","last_change":"2024-09-12T00:21:50.555449+0000","last_active":"2024-09-12T01:03:54.744259+0000","last_peered":"2024-09-12T01:03:54.744259+0000","last_clean":"2024-09-12T01:03:54.744259+0000","last_became_active":"2024-09-12T00:21:50.553714+0000","last_became_peered":"2024-09-12T00:21:50.553714+0000","last_unstale":"2024-09-12T01:03:54.744259+0000","last_undegraded":"2024-09-12T01:03:54.744259+0000","last_fullsized":"2024-09-12T01:03:54.744259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:49.756435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'214","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.327000+0000","last_change":"2024-09-12T00:21:52.557187+0000","last_active":"2024-09-12T01:06:07.327000+0000","last_peered":"2024-09-12T01:06:07.327000+0000","last_clean":"2024-09-12T01:06:07.327000+0000","last_became_active":"2024-09-12T00:21:52.556407+0000","last_became_peered":"2024-09-12T00:21:52.556407+0000","last_unstale":"2024-09-12T01:06:07.327000+0000","last_undegraded":"2024-09-12T01:06:07.327000+0000","last_fullsized":"2024-09-12T01:06:07.327000+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.366159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":286,"num_write":472,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'340","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.973379+0000","last_change":"2024-09-12T00:21:44.501770+0000","last_active":"2024-09-12T01:04:13.973379+0000","last_peered":"2024-09-12T01:04:13.973379+0000","last_clean":"2024-09-12T01:04:13.973379+0000","last_became_active":"2024-09-12T00:21:44.499891+0000","last_became_peered":"2024-09-12T00:21:44.499891+0000","last_unstale":"2024-09-12T01:04:13.973379+0000","last_undegraded":"2024-09-12T01:04:13.973379+0000","last_fullsized":"2024-09-12T01:04:13.973379+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.959531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1519,"num_read_kb":1239,"num_write":521,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'307","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.616746+0000","last_change":"2024-09-12T00:21:42.534894+0000","last_active":"2024-09-12T01:07:27.616746+0000","last_peered":"2024-09-12T01:07:27.616746+0000","last_clean":"2024-09-12T01:07:27.616746+0000","last_became_active":"2024-09-12T00:21:42.534537+0000","last_became_peered":"2024-09-12T00:21:42.534537+0000","last_unstale":"2024-09-12T01:07:27.616746+0000","last_undegraded":"2024-09-12T01:07:27.616746+0000","last_fullsized":"2024-09-12T01:07:27.616746+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.812543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194356,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":22569,"num_write":963,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743057+0000","last_change":"2024-09-12T00:21:46.489769+0000","last_active":"2024-09-12T01:03:49.743057+0000","last_peered":"2024-09-12T01:03:49.743057+0000","last_clean":"2024-09-12T01:03:49.743057+0000","last_became_active":"2024-09-12T00:21:46.489054+0000","last_became_peered":"2024-09-12T00:21:46.489054+0000","last_unstale":"2024-09-12T01:03:49.743057+0000","last_undegraded":"2024-09-12T01:03:49.743057+0000","last_fullsized":"2024-09-12T01:03:49.743057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:29.459282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'291","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.866262+0000","last_change":"2024-09-12T00:21:48.550280+0000","last_active":"2024-09-12T01:07:26.866262+0000","last_peered":"2024-09-12T01:07:26.866262+0000","last_clean":"2024-09-12T01:07:26.866262+0000","last_became_active":"2024-09-12T00:21:48.549368+0000","last_became_peered":"2024-09-12T00:21:48.549368+0000","last_unstale":"2024-09-12T01:07:26.866262+0000","last_undegraded":"2024-09-12T01:07:26.866262+0000","last_fullsized":"2024-09-12T01:07:26.866262+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:05.929053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56273,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1054,"num_write":388,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.765195+0000","last_change":"2024-09-12T00:21:50.566488+0000","last_active":"2024-09-12T01:03:54.765195+0000","last_peered":"2024-09-12T01:03:54.765195+0000","last_clean":"2024-09-12T01:03:54.765195+0000","last_became_active":"2024-09-12T00:21:50.565753+0000","last_became_peered":"2024-09-12T00:21:50.565753+0000","last_unstale":"2024-09-12T01:03:54.765195+0000","last_undegraded":"2024-09-12T01:03:54.765195+0000","last_fullsized":"2024-09-12T01:03:54.765195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:49.492114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.980755+0000","last_change":"2024-09-12T00:21:52.565618+0000","last_active":"2024-09-12T01:05:39.980755+0000","last_peered":"2024-09-12T01:05:39.980755+0000","last_clean":"2024-09-12T01:05:39.980755+0000","last_became_active":"2024-09-12T00:21:52.559213+0000","last_became_peered":"2024-09-12T00:21:52.559213+0000","last_unstale":"2024-09-12T01:05:39.980755+0000","last_undegraded":"2024-09-12T01:05:39.980755+0000","last_fullsized":"2024-09-12T01:05:39.980755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.549214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":329,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'146","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.117283+0000","last_change":"2024-09-12T00:21:44.508192+0000","last_active":"2024-09-12T01:05:42.117283+0000","last_peered":"2024-09-12T01:05:42.117283+0000","last_clean":"2024-09-12T01:05:42.117283+0000","last_became_active":"2024-09-12T00:21:44.507460+0000","last_became_peered":"2024-09-12T00:21:44.507460+0000","last_unstale":"2024-09-12T01:05:42.117283+0000","last_undegraded":"2024-09-12T01:05:42.117283+0000","last_fullsized":"2024-09-12T01:05:42.117283+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:54.113624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":507,"num_write":216,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'342","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.607737+0000","last_change":"2024-09-12T00:21:42.520089+0000","last_active":"2024-09-12T01:07:27.607737+0000","last_peered":"2024-09-12T01:07:27.607737+0000","last_clean":"2024-09-12T01:07:27.607737+0000","last_became_active":"2024-09-12T00:21:42.517333+0000","last_became_peered":"2024-09-12T00:21:42.517333+0000","last_unstale":"2024-09-12T01:07:27.607737+0000","last_undegraded":"2024-09-12T01:07:27.607737+0000","last_fullsized":"2024-09-12T01:07:27.607737+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.752943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":50264,"num_write":1046,"num_write_kb":41560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618453+0000","last_change":"2024-09-12T00:21:46.502471+0000","last_active":"2024-09-12T01:03:49.618453+0000","last_peered":"2024-09-12T01:03:49.618453+0000","last_clean":"2024-09-12T01:03:49.618453+0000","last_became_active":"2024-09-12T00:21:46.501673+0000","last_became_peered":"2024-09-12T00:21:46.501673+0000","last_unstale":"2024-09-12T01:03:49.618453+0000","last_undegraded":"2024-09-12T01:03:49.618453+0000","last_fullsized":"2024-09-12T01:03:49.618453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'273","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.679151+0000","last_change":"2024-09-12T00:21:48.538585+0000","last_active":"2024-09-12T01:07:26.679151+0000","last_peered":"2024-09-12T01:07:26.679151+0000","last_clean":"2024-09-12T01:07:26.679151+0000","last_became_active":"2024-09-12T00:21:48.537864+0000","last_became_peered":"2024-09-12T00:21:48.537864+0000","last_unstale":"2024-09-12T01:07:26.679151+0000","last_undegraded":"2024-09-12T01:07:26.679151+0000","last_fullsized":"2024-09-12T01:07:26.679151+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:33.610420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47500,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1067,"num_write":372,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581973+0000","last_change":"2024-09-12T00:21:50.561361+0000","last_active":"2024-09-12T01:03:53.581973+0000","last_peered":"2024-09-12T01:03:53.581973+0000","last_clean":"2024-09-12T01:03:53.581973+0000","last_became_active":"2024-09-12T00:21:50.560805+0000","last_became_peered":"2024-09-12T00:21:50.560805+0000","last_unstale":"2024-09-12T01:03:53.581973+0000","last_undegraded":"2024-09-12T01:03:53.581973+0000","last_fullsized":"2024-09-12T01:03:53.581973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:00.373479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'385","reported_seq":1086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.645095+0000","last_change":"2024-09-12T00:21:44.516768+0000","last_active":"2024-09-12T01:05:29.645095+0000","last_peered":"2024-09-12T01:05:29.645095+0000","last_clean":"2024-09-12T01:05:29.645095+0000","last_became_active":"2024-09-12T00:21:44.516321+0000","last_became_peered":"2024-09-12T00:21:44.516321+0000","last_unstale":"2024-09-12T01:05:29.645095+0000","last_undegraded":"2024-09-12T01:05:29.645095+0000","last_fullsized":"2024-09-12T01:05:29.645095+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1787,"num_read_kb":1547,"num_write":658,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'343","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.597565+0000","last_change":"2024-09-12T00:22:13.520852+0000","last_active":"2024-09-12T01:07:27.597565+0000","last_peered":"2024-09-12T01:07:27.597565+0000","last_clean":"2024-09-12T01:07:27.597565+0000","last_became_active":"2024-09-12T00:22:13.519954+0000","last_became_peered":"2024-09-12T00:22:13.519954+0000","last_unstale":"2024-09-12T01:07:27.597565+0000","last_undegraded":"2024-09-12T01:07:27.597565+0000","last_fullsized":"2024-09-12T01:07:27.597565+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:59.772753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":32939,"num_write":1107,"num_write_kb":17030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.579239+0000","last_change":"2024-09-12T00:21:46.504485+0000","last_active":"2024-09-12T01:03:59.579239+0000","last_peered":"2024-09-12T01:03:59.579239+0000","last_clean":"2024-09-12T01:03:59.579239+0000","last_became_active":"2024-09-12T00:21:46.503646+0000","last_became_peered":"2024-09-12T00:21:46.503646+0000","last_unstale":"2024-09-12T01:03:59.579239+0000","last_undegraded":"2024-09-12T01:03:59.579239+0000","last_fullsized":"2024-09-12T01:03:59.579239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:24.062861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'522","reported_seq":1153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.613803+0000","last_change":"2024-09-12T00:21:48.548531+0000","last_active":"2024-09-12T01:07:26.613803+0000","last_peered":"2024-09-12T01:07:26.613803+0000","last_clean":"2024-09-12T01:07:26.613803+0000","last_became_active":"2024-09-12T00:21:48.547827+0000","last_became_peered":"2024-09-12T00:21:48.547827+0000","last_unstale":"2024-09-12T01:07:26.613803+0000","last_undegraded":"2024-09-12T01:07:26.613803+0000","last_fullsized":"2024-09-12T01:07:26.613803+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106077,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":956,"num_read_kb":2347,"num_write":834,"num_write_kb":757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.751771+0000","last_change":"2024-09-12T00:21:50.554994+0000","last_active":"2024-09-12T01:04:24.751771+0000","last_peered":"2024-09-12T01:04:24.751771+0000","last_clean":"2024-09-12T01:04:24.751771+0000","last_became_active":"2024-09-12T00:21:50.554194+0000","last_became_peered":"2024-09-12T00:21:50.554194+0000","last_unstale":"2024-09-12T01:04:24.751771+0000","last_undegraded":"2024-09-12T01:04:24.751771+0000","last_fullsized":"2024-09-12T01:04:24.751771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.351737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'158","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.556466+0000","last_change":"2024-09-12T00:21:52.558812+0000","last_active":"2024-09-12T01:06:06.556466+0000","last_peered":"2024-09-12T01:06:06.556466+0000","last_clean":"2024-09-12T01:06:06.556466+0000","last_became_active":"2024-09-12T00:21:52.558070+0000","last_became_peered":"2024-09-12T00:21:52.558070+0000","last_unstale":"2024-09-12T01:06:06.556466+0000","last_undegraded":"2024-09-12T01:06:06.556466+0000","last_fullsized":"2024-09-12T01:06:06.556466+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:23.383768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":234,"num_write":361,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'83","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.789441+0000","last_change":"2024-09-12T00:21:44.502471+0000","last_active":"2024-09-12T01:03:54.789441+0000","last_peered":"2024-09-12T01:03:54.789441+0000","last_clean":"2024-09-12T01:03:54.789441+0000","last_became_active":"2024-09-12T00:21:44.501836+0000","last_became_peered":"2024-09-12T00:21:44.501836+0000","last_unstale":"2024-09-12T01:03:54.789441+0000","last_undegraded":"2024-09-12T01:03:54.789441+0000","last_fullsized":"2024-09-12T01:03:54.789441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:34.189402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":399,"num_read_kb":345,"num_write":130,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'311","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.563842+0000","last_change":"2024-09-12T00:21:42.497979+0000","last_active":"2024-09-12T01:07:27.563842+0000","last_peered":"2024-09-12T01:07:27.563842+0000","last_clean":"2024-09-12T01:07:27.563842+0000","last_became_active":"2024-09-12T00:21:42.496837+0000","last_became_peered":"2024-09-12T00:21:42.496837+0000","last_unstale":"2024-09-12T01:07:27.563842+0000","last_undegraded":"2024-09-12T01:07:27.563842+0000","last_fullsized":"2024-09-12T01:07:27.563842+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:18.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":560106,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":359,"num_read_kb":1485,"num_write":897,"num_write_kb":29678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.738284+0000","last_change":"2024-09-12T00:21:46.499289+0000","last_active":"2024-09-12T01:03:29.738284+0000","last_peered":"2024-09-12T01:03:29.738284+0000","last_clean":"2024-09-12T01:03:29.738284+0000","last_became_active":"2024-09-12T00:21:46.498517+0000","last_became_peered":"2024-09-12T00:21:46.498517+0000","last_unstale":"2024-09-12T01:03:29.738284+0000","last_undegraded":"2024-09-12T01:03:29.738284+0000","last_fullsized":"2024-09-12T01:03:29.738284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:50.960412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'300","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.747147+0000","last_change":"2024-09-12T00:21:48.539854+0000","last_active":"2024-09-12T01:07:26.747147+0000","last_peered":"2024-09-12T01:07:26.747147+0000","last_clean":"2024-09-12T01:07:26.747147+0000","last_became_active":"2024-09-12T00:21:48.539419+0000","last_became_peered":"2024-09-12T00:21:48.539419+0000","last_unstale":"2024-09-12T01:07:26.747147+0000","last_undegraded":"2024-09-12T01:07:26.747147+0000","last_fullsized":"2024-09-12T01:07:26.747147+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:42.243175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":1160,"num_write":428,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.608749+0000","last_change":"2024-09-12T00:21:50.565460+0000","last_active":"2024-09-12T01:04:24.608749+0000","last_peered":"2024-09-12T01:04:24.608749+0000","last_clean":"2024-09-12T01:04:24.608749+0000","last_became_active":"2024-09-12T00:21:50.564610+0000","last_became_peered":"2024-09-12T00:21:50.564610+0000","last_unstale":"2024-09-12T01:04:24.608749+0000","last_undegraded":"2024-09-12T01:04:24.608749+0000","last_fullsized":"2024-09-12T01:04:24.608749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'152","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.192650+0000","last_change":"2024-09-12T00:21:52.560731+0000","last_active":"2024-09-12T01:05:01.192650+0000","last_peered":"2024-09-12T01:05:01.192650+0000","last_clean":"2024-09-12T01:05:01.192650+0000","last_became_active":"2024-09-12T00:21:52.559989+0000","last_became_peered":"2024-09-12T00:21:52.559989+0000","last_unstale":"2024-09-12T01:05:01.192650+0000","last_undegraded":"2024-09-12T01:05:01.192650+0000","last_fullsized":"2024-09-12T01:05:01.192650+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.302197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":167,"num_write":448,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'180","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.587709+0000","last_change":"2024-09-12T00:21:44.515569+0000","last_active":"2024-09-12T01:04:18.587709+0000","last_peered":"2024-09-12T01:04:18.587709+0000","last_clean":"2024-09-12T01:04:18.587709+0000","last_became_active":"2024-09-12T00:21:44.515059+0000","last_became_peered":"2024-09-12T00:21:44.515059+0000","last_unstale":"2024-09-12T01:04:18.587709+0000","last_undegraded":"2024-09-12T01:04:18.587709+0000","last_fullsized":"2024-09-12T01:04:18.587709+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.436679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":674,"num_write":306,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'322","reported_seq":987,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.675043+0000","last_change":"2024-09-12T00:21:42.528216+0000","last_active":"2024-09-12T01:07:27.675043+0000","last_peered":"2024-09-12T01:07:27.675043+0000","last_clean":"2024-09-12T01:07:27.675043+0000","last_became_active":"2024-09-12T00:21:42.527838+0000","last_became_peered":"2024-09-12T00:21:42.527838+0000","last_unstale":"2024-09-12T01:07:27.675043+0000","last_undegraded":"2024-09-12T01:07:27.675043+0000","last_fullsized":"2024-09-12T01:07:27.675043+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:49.488680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373192,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":57949,"num_write":1020,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.750536+0000","last_change":"2024-09-12T00:21:46.487430+0000","last_active":"2024-09-12T01:04:19.750536+0000","last_peered":"2024-09-12T01:04:19.750536+0000","last_clean":"2024-09-12T01:04:19.750536+0000","last_became_active":"2024-09-12T00:21:46.486768+0000","last_became_peered":"2024-09-12T00:21:46.486768+0000","last_unstale":"2024-09-12T01:04:19.750536+0000","last_undegraded":"2024-09-12T01:04:19.750536+0000","last_fullsized":"2024-09-12T01:04:19.750536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:46.811644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'291","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.776422+0000","last_change":"2024-09-12T00:21:48.546553+0000","last_active":"2024-09-12T01:07:25.776422+0000","last_peered":"2024-09-12T01:07:25.776422+0000","last_clean":"2024-09-12T01:07:25.776422+0000","last_became_active":"2024-09-12T00:21:48.545589+0000","last_became_peered":"2024-09-12T00:21:48.545589+0000","last_unstale":"2024-09-12T01:07:25.776422+0000","last_undegraded":"2024-09-12T01:07:25.776422+0000","last_fullsized":"2024-09-12T01:07:25.776422+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:05.509631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":1095,"num_write":398,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.584221+0000","last_change":"2024-09-12T00:21:50.557751+0000","last_active":"2024-09-12T01:04:03.584221+0000","last_peered":"2024-09-12T01:04:03.584221+0000","last_clean":"2024-09-12T01:04:03.584221+0000","last_became_active":"2024-09-12T00:21:50.556333+0000","last_became_peered":"2024-09-12T00:21:50.556333+0000","last_unstale":"2024-09-12T01:04:03.584221+0000","last_undegraded":"2024-09-12T01:04:03.584221+0000","last_fullsized":"2024-09-12T01:04:03.584221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.592627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'204","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.864522+0000","last_change":"2024-09-12T00:21:52.566691+0000","last_active":"2024-09-12T01:07:12.864522+0000","last_peered":"2024-09-12T01:07:12.864522+0000","last_clean":"2024-09-12T01:07:12.864522+0000","last_became_active":"2024-09-12T00:21:52.565109+0000","last_became_peered":"2024-09-12T00:21:52.565109+0000","last_unstale":"2024-09-12T01:07:12.864522+0000","last_undegraded":"2024-09-12T01:07:12.864522+0000","last_fullsized":"2024-09-12T01:07:12.864522+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:52.766859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'131","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.241463+0000","last_change":"2024-09-12T00:21:44.489287+0000","last_active":"2024-09-12T01:05:45.241463+0000","last_peered":"2024-09-12T01:05:45.241463+0000","last_clean":"2024-09-12T01:05:45.241463+0000","last_became_active":"2024-09-12T00:21:44.488546+0000","last_became_peered":"2024-09-12T00:21:44.488546+0000","last_unstale":"2024-09-12T01:05:45.241463+0000","last_undegraded":"2024-09-12T01:05:45.241463+0000","last_fullsized":"2024-09-12T01:05:45.241463+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:32.061615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":436,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'359","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.671626+0000","last_change":"2024-09-12T00:21:42.514641+0000","last_active":"2024-09-12T01:07:27.671626+0000","last_peered":"2024-09-12T01:07:27.671626+0000","last_clean":"2024-09-12T01:07:27.671626+0000","last_became_active":"2024-09-12T00:21:42.513837+0000","last_became_peered":"2024-09-12T00:21:42.513837+0000","last_unstale":"2024-09-12T01:07:27.671626+0000","last_undegraded":"2024-09-12T01:07:27.671626+0000","last_fullsized":"2024-09-12T01:07:27.671626+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:59.737503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":19207,"num_write":1040,"num_write_kb":45165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.580850+0000","last_change":"2024-09-12T00:21:46.493177+0000","last_active":"2024-09-12T01:04:19.580850+0000","last_peered":"2024-09-12T01:04:19.580850+0000","last_clean":"2024-09-12T01:04:19.580850+0000","last_became_active":"2024-09-12T00:21:46.492502+0000","last_became_peered":"2024-09-12T00:21:46.492502+0000","last_unstale":"2024-09-12T01:04:19.580850+0000","last_undegraded":"2024-09-12T01:04:19.580850+0000","last_fullsized":"2024-09-12T01:04:19.580850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:29.059786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'96","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:59.651411+0000","last_change":"2024-09-12T00:21:48.548949+0000","last_active":"2024-09-12T01:05:59.651411+0000","last_peered":"2024-09-12T01:05:59.651411+0000","last_clean":"2024-09-12T01:05:59.651411+0000","last_became_active":"2024-09-12T00:21:48.544915+0000","last_became_peered":"2024-09-12T00:21:48.544915+0000","last_unstale":"2024-09-12T01:05:59.651411+0000","last_undegraded":"2024-09-12T01:05:59.651411+0000","last_fullsized":"2024-09-12T01:05:59.651411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:44.234342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":128,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'782","reported_seq":2224,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.456232+0000","last_change":"2024-09-12T00:21:50.550332+0000","last_active":"2024-09-12T01:07:27.456232+0000","last_peered":"2024-09-12T01:07:27.456232+0000","last_clean":"2024-09-12T01:07:27.456232+0000","last_became_active":"2024-09-12T00:21:50.549552+0000","last_became_peered":"2024-09-12T00:21:50.549552+0000","last_unstale":"2024-09-12T01:07:27.456232+0000","last_undegraded":"2024-09-12T01:07:27.456232+0000","last_fullsized":"2024-09-12T01:07:27.456232+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:44.130994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'170","reported_seq":686,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.303926+0000","last_change":"2024-09-12T00:21:52.566510+0000","last_active":"2024-09-12T01:05:46.303926+0000","last_peered":"2024-09-12T01:05:46.303926+0000","last_clean":"2024-09-12T01:05:46.303926+0000","last_became_active":"2024-09-12T00:21:52.565872+0000","last_became_peered":"2024-09-12T00:21:52.565872+0000","last_unstale":"2024-09-12T01:05:46.303926+0000","last_undegraded":"2024-09-12T01:05:46.303926+0000","last_fullsized":"2024-09-12T01:05:46.303926+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:54.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":199,"num_write":407,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'4284","reported_seq":4939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.749378+0000","last_change":"2024-09-12T00:21:44.521635+0000","last_active":"2024-09-12T01:04:14.749378+0000","last_peered":"2024-09-12T01:04:14.749378+0000","last_clean":"2024-09-12T01:04:14.749378+0000","last_became_active":"2024-09-12T00:21:44.521310+0000","last_became_peered":"2024-09-12T00:21:44.521310+0000","last_unstale":"2024-09-12T01:04:14.749378+0000","last_undegraded":"2024-09-12T01:04:14.749378+0000","last_fullsized":"2024-09-12T01:04:14.749378+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":3000,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:18.886376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17290,"num_read_kb":14479,"num_write":6455,"num_write_kb":3215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'412","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.691368+0000","last_change":"2024-09-12T00:21:42.508020+0000","last_active":"2024-09-12T01:07:27.691368+0000","last_peered":"2024-09-12T01:07:27.691368+0000","last_clean":"2024-09-12T01:07:27.691368+0000","last_became_active":"2024-09-12T00:21:42.507712+0000","last_became_peered":"2024-09-12T00:21:42.507712+0000","last_unstale":"2024-09-12T01:07:27.691368+0000","last_undegraded":"2024-09-12T01:07:27.691368+0000","last_fullsized":"2024-09-12T01:07:27.691368+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:04.367696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992333,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":35222,"num_write":1344,"num_write_kb":36033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.770689+0000","last_change":"2024-09-12T00:21:46.514629+0000","last_active":"2024-09-12T01:04:19.770689+0000","last_peered":"2024-09-12T01:04:19.770689+0000","last_clean":"2024-09-12T01:04:19.770689+0000","last_became_active":"2024-09-12T00:21:46.514146+0000","last_became_peered":"2024-09-12T00:21:46.514146+0000","last_unstale":"2024-09-12T01:04:19.770689+0000","last_undegraded":"2024-09-12T01:04:19.770689+0000","last_fullsized":"2024-09-12T01:04:19.770689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:04.796502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'331","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.180639+0000","last_change":"2024-09-12T00:21:48.545059+0000","last_active":"2024-09-12T01:07:26.180639+0000","last_peered":"2024-09-12T01:07:26.180639+0000","last_clean":"2024-09-12T01:07:26.180639+0000","last_became_active":"2024-09-12T00:21:48.543993+0000","last_became_peered":"2024-09-12T00:21:48.543993+0000","last_unstale":"2024-09-12T01:07:26.180639+0000","last_undegraded":"2024-09-12T01:07:26.180639+0000","last_fullsized":"2024-09-12T01:07:26.180639+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:00.172691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50118,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1190,"num_write":440,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.563509+0000","last_change":"2024-09-12T00:21:50.526640+0000","last_active":"2024-09-12T01:02:59.563509+0000","last_peered":"2024-09-12T01:02:59.563509+0000","last_clean":"2024-09-12T01:02:59.563509+0000","last_became_active":"2024-09-12T00:21:50.525885+0000","last_became_peered":"2024-09-12T00:21:50.525885+0000","last_unstale":"2024-09-12T01:02:59.563509+0000","last_undegraded":"2024-09-12T01:02:59.563509+0000","last_fullsized":"2024-09-12T01:02:59.563509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.636381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'113","reported_seq":614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.083293+0000","last_change":"2024-09-12T00:21:52.560445+0000","last_active":"2024-09-12T01:05:30.083293+0000","last_peered":"2024-09-12T01:05:30.083293+0000","last_clean":"2024-09-12T01:05:30.083293+0000","last_became_active":"2024-09-12T00:21:52.559361+0000","last_became_peered":"2024-09-12T00:21:52.559361+0000","last_unstale":"2024-09-12T01:05:30.083293+0000","last_undegraded":"2024-09-12T01:05:30.083293+0000","last_fullsized":"2024-09-12T01:05:30.083293+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:30.798988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":266,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'251","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.931531+0000","last_change":"2024-09-12T00:21:44.486385+0000","last_active":"2024-09-12T01:04:34.931531+0000","last_peered":"2024-09-12T01:04:34.931531+0000","last_clean":"2024-09-12T01:04:34.931531+0000","last_became_active":"2024-09-12T00:21:44.486014+0000","last_became_peered":"2024-09-12T00:21:44.486014+0000","last_unstale":"2024-09-12T01:04:34.931531+0000","last_undegraded":"2024-09-12T01:04:34.931531+0000","last_fullsized":"2024-09-12T01:04:34.931531+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:04.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1098,"num_read_kb":899,"num_write":369,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'313","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.596659+0000","last_change":"2024-09-12T00:21:42.492181+0000","last_active":"2024-09-12T01:07:27.596659+0000","last_peered":"2024-09-12T01:07:27.596659+0000","last_clean":"2024-09-12T01:07:27.596659+0000","last_became_active":"2024-09-12T00:21:42.491757+0000","last_became_peered":"2024-09-12T00:21:42.491757+0000","last_unstale":"2024-09-12T01:07:27.596659+0000","last_undegraded":"2024-09-12T01:07:27.596659+0000","last_fullsized":"2024-09-12T01:07:27.596659+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:19.920075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":76220,"num_write":1035,"num_write_kb":46746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.750467+0000","last_change":"2024-09-12T00:21:46.503909+0000","last_active":"2024-09-12T01:04:19.750467+0000","last_peered":"2024-09-12T01:04:19.750467+0000","last_clean":"2024-09-12T01:04:19.750467+0000","last_became_active":"2024-09-12T00:21:46.503203+0000","last_became_peered":"2024-09-12T00:21:46.503203+0000","last_unstale":"2024-09-12T01:04:19.750467+0000","last_undegraded":"2024-09-12T01:04:19.750467+0000","last_fullsized":"2024-09-12T01:04:19.750467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:04.494436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'284","reported_seq":856,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.251646+0000","last_change":"2024-09-12T00:21:48.537800+0000","last_active":"2024-09-12T01:07:26.251646+0000","last_peered":"2024-09-12T01:07:26.251646+0000","last_clean":"2024-09-12T01:07:26.251646+0000","last_became_active":"2024-09-12T00:21:48.536841+0000","last_became_peered":"2024-09-12T00:21:48.536841+0000","last_unstale":"2024-09-12T01:07:26.251646+0000","last_undegraded":"2024-09-12T01:07:26.251646+0000","last_fullsized":"2024-09-12T01:07:26.251646+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:36.935321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48050,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1127,"num_write":390,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.608163+0000","last_change":"2024-09-12T00:21:50.541922+0000","last_active":"2024-09-12T01:03:09.608163+0000","last_peered":"2024-09-12T01:03:09.608163+0000","last_clean":"2024-09-12T01:03:09.608163+0000","last_became_active":"2024-09-12T00:21:50.538041+0000","last_became_peered":"2024-09-12T00:21:50.538041+0000","last_unstale":"2024-09-12T01:03:09.608163+0000","last_undegraded":"2024-09-12T01:03:09.608163+0000","last_fullsized":"2024-09-12T01:03:09.608163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:16.216296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'125","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.684858+0000","last_change":"2024-09-12T00:21:52.564384+0000","last_active":"2024-09-12T01:05:19.684858+0000","last_peered":"2024-09-12T01:05:19.684858+0000","last_clean":"2024-09-12T01:05:19.684858+0000","last_became_active":"2024-09-12T00:21:52.560366+0000","last_became_peered":"2024-09-12T00:21:52.560366+0000","last_unstale":"2024-09-12T01:05:19.684858+0000","last_undegraded":"2024-09-12T01:05:19.684858+0000","last_fullsized":"2024-09-12T01:05:19.684858+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:27.682015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":163,"num_read_kb":157,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'212","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.678629+0000","last_change":"2024-09-12T00:21:44.513724+0000","last_active":"2024-09-12T01:04:47.678629+0000","last_peered":"2024-09-12T01:04:47.678629+0000","last_clean":"2024-09-12T01:04:47.678629+0000","last_became_active":"2024-09-12T00:21:44.512917+0000","last_became_peered":"2024-09-12T00:21:44.512917+0000","last_unstale":"2024-09-12T01:04:47.678629+0000","last_undegraded":"2024-09-12T01:04:47.678629+0000","last_fullsized":"2024-09-12T01:04:47.678629+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:10.484566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":716,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'387","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.685931+0000","last_change":"2024-09-12T00:21:42.517480+0000","last_active":"2024-09-12T01:07:27.685931+0000","last_peered":"2024-09-12T01:07:27.685931+0000","last_clean":"2024-09-12T01:07:27.685931+0000","last_became_active":"2024-09-12T00:21:42.516419+0000","last_became_peered":"2024-09-12T00:21:42.516419+0000","last_unstale":"2024-09-12T01:07:27.685931+0000","last_undegraded":"2024-09-12T01:07:27.685931+0000","last_fullsized":"2024-09-12T01:07:27.685931+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:55.919056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1662646,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":630,"num_read_kb":12934,"num_write":1264,"num_write_kb":32784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.750311+0000","last_change":"2024-09-12T00:21:46.504336+0000","last_active":"2024-09-12T01:02:54.750311+0000","last_peered":"2024-09-12T01:02:54.750311+0000","last_clean":"2024-09-12T01:02:54.750311+0000","last_became_active":"2024-09-12T00:21:46.503747+0000","last_became_peered":"2024-09-12T00:21:46.503747+0000","last_unstale":"2024-09-12T01:02:54.750311+0000","last_undegraded":"2024-09-12T01:02:54.750311+0000","last_fullsized":"2024-09-12T01:02:54.750311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:49.256627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'244","reported_seq":805,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.702741+0000","last_change":"2024-09-12T00:21:48.547112+0000","last_active":"2024-09-12T01:07:27.702741+0000","last_peered":"2024-09-12T01:07:27.702741+0000","last_clean":"2024-09-12T01:07:27.702741+0000","last_became_active":"2024-09-12T00:21:48.546392+0000","last_became_peered":"2024-09-12T00:21:48.546392+0000","last_unstale":"2024-09-12T01:07:27.702741+0000","last_undegraded":"2024-09-12T01:07:27.702741+0000","last_fullsized":"2024-09-12T01:07:27.702741+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:06.500945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54260,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":387,"num_read_kb":921,"num_write":312,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.627760+0000","last_change":"2024-09-12T00:21:50.549326+0000","last_active":"2024-09-12T01:04:24.627760+0000","last_peered":"2024-09-12T01:04:24.627760+0000","last_clean":"2024-09-12T01:04:24.627760+0000","last_became_active":"2024-09-12T00:21:50.548527+0000","last_became_peered":"2024-09-12T00:21:50.548527+0000","last_unstale":"2024-09-12T01:04:24.627760+0000","last_undegraded":"2024-09-12T01:04:24.627760+0000","last_fullsized":"2024-09-12T01:04:24.627760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:37.290906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'193","reported_seq":1701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.596270+0000","last_change":"2024-09-12T00:21:52.569731+0000","last_active":"2024-09-12T01:06:04.596270+0000","last_peered":"2024-09-12T01:06:04.596270+0000","last_clean":"2024-09-12T01:06:04.596270+0000","last_became_active":"2024-09-12T00:21:52.559360+0000","last_became_peered":"2024-09-12T00:21:52.559360+0000","last_unstale":"2024-09-12T01:06:04.596270+0000","last_undegraded":"2024-09-12T01:06:04.596270+0000","last_fullsized":"2024-09-12T01:06:04.596270+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:25.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1316,"num_write":423,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'81","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.145312+0000","last_change":"2024-09-12T00:21:44.485574+0000","last_active":"2024-09-12T01:04:56.145312+0000","last_peered":"2024-09-12T01:04:56.145312+0000","last_clean":"2024-09-12T01:04:56.145312+0000","last_became_active":"2024-09-12T00:21:44.485278+0000","last_became_peered":"2024-09-12T00:21:44.485278+0000","last_unstale":"2024-09-12T01:04:56.145312+0000","last_undegraded":"2024-09-12T01:04:56.145312+0000","last_fullsized":"2024-09-12T01:04:56.145312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:13.977255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":295,"num_write":139,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'331","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.671618+0000","last_change":"2024-09-12T00:21:42.524712+0000","last_active":"2024-09-12T01:07:27.671618+0000","last_peered":"2024-09-12T01:07:27.671618+0000","last_clean":"2024-09-12T01:07:27.671618+0000","last_became_active":"2024-09-12T00:21:42.520276+0000","last_became_peered":"2024-09-12T00:21:42.520276+0000","last_unstale":"2024-09-12T01:07:27.671618+0000","last_undegraded":"2024-09-12T01:07:27.671618+0000","last_fullsized":"2024-09-12T01:07:27.671618+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35265,"num_write":1034,"num_write_kb":28370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.459443+0000","last_change":"2024-09-12T00:21:46.495855+0000","last_active":"2024-09-12T01:07:25.459443+0000","last_peered":"2024-09-12T01:07:25.459443+0000","last_clean":"2024-09-12T01:07:25.459443+0000","last_became_active":"2024-09-12T00:21:46.495088+0000","last_became_peered":"2024-09-12T00:21:46.495088+0000","last_unstale":"2024-09-12T01:07:25.459443+0000","last_undegraded":"2024-09-12T01:07:25.459443+0000","last_fullsized":"2024-09-12T01:07:25.459443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:27.176611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'327","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.845349+0000","last_change":"2024-09-12T00:21:48.551157+0000","last_active":"2024-09-12T01:07:25.845349+0000","last_peered":"2024-09-12T01:07:25.845349+0000","last_clean":"2024-09-12T01:07:25.845349+0000","last_became_active":"2024-09-12T00:21:48.550441+0000","last_became_peered":"2024-09-12T00:21:48.550441+0000","last_unstale":"2024-09-12T01:07:25.845349+0000","last_undegraded":"2024-09-12T01:07:25.845349+0000","last_fullsized":"2024-09-12T01:07:25.845349+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:58.154347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54992,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1211,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.581974+0000","last_change":"2024-09-12T00:21:50.566647+0000","last_active":"2024-09-12T01:04:24.581974+0000","last_peered":"2024-09-12T01:04:24.581974+0000","last_clean":"2024-09-12T01:04:24.581974+0000","last_became_active":"2024-09-12T00:21:50.565955+0000","last_became_peered":"2024-09-12T00:21:50.565955+0000","last_unstale":"2024-09-12T01:04:24.581974+0000","last_undegraded":"2024-09-12T01:04:24.581974+0000","last_fullsized":"2024-09-12T01:04:24.581974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:37.311871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'131","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.963224+0000","last_change":"2024-09-12T00:21:52.549770+0000","last_active":"2024-09-12T01:07:11.963224+0000","last_peered":"2024-09-12T01:07:11.963224+0000","last_clean":"2024-09-12T01:07:11.963224+0000","last_became_active":"2024-09-12T00:21:52.549080+0000","last_became_peered":"2024-09-12T00:21:52.549080+0000","last_unstale":"2024-09-12T01:07:11.963224+0000","last_undegraded":"2024-09-12T01:07:11.963224+0000","last_fullsized":"2024-09-12T01:07:11.963224+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.186294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'77","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.591355+0000","last_change":"2024-09-12T00:21:44.495955+0000","last_active":"2024-09-12T01:05:04.591355+0000","last_peered":"2024-09-12T01:05:04.591355+0000","last_clean":"2024-09-12T01:05:04.591355+0000","last_became_active":"2024-09-12T00:21:44.495122+0000","last_became_peered":"2024-09-12T00:21:44.495122+0000","last_unstale":"2024-09-12T01:05:04.591355+0000","last_undegraded":"2024-09-12T01:05:04.591355+0000","last_fullsized":"2024-09-12T01:05:04.591355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:03.274312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":290,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'356","reported_seq":1025,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.677513+0000","last_change":"2024-09-12T00:21:42.492687+0000","last_active":"2024-09-12T01:07:27.677513+0000","last_peered":"2024-09-12T01:07:27.677513+0000","last_clean":"2024-09-12T01:07:27.677513+0000","last_became_active":"2024-09-12T00:21:42.492358+0000","last_became_peered":"2024-09-12T00:21:42.492358+0000","last_unstale":"2024-09-12T01:07:27.677513+0000","last_undegraded":"2024-09-12T01:07:27.677513+0000","last_fullsized":"2024-09-12T01:07:27.677513+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262257,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":28331,"num_write":1177,"num_write_kb":34411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'258","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.198362+0000","last_change":"2024-09-12T00:21:44.518405+0000","last_active":"2024-09-12T01:05:20.198362+0000","last_peered":"2024-09-12T01:05:20.198362+0000","last_clean":"2024-09-12T01:05:20.198362+0000","last_became_active":"2024-09-12T00:21:44.515839+0000","last_became_peered":"2024-09-12T00:21:44.515839+0000","last_unstale":"2024-09-12T01:05:20.198362+0000","last_undegraded":"2024-09-12T01:05:20.198362+0000","last_fullsized":"2024-09-12T01:05:20.198362+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:06.067490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":1036,"num_write":423,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'449","reported_seq":1153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.696241+0000","last_change":"2024-09-12T00:21:42.503380+0000","last_active":"2024-09-12T01:07:27.696241+0000","last_peered":"2024-09-12T01:07:27.696241+0000","last_clean":"2024-09-12T01:07:27.696241+0000","last_became_active":"2024-09-12T00:21:42.502396+0000","last_became_peered":"2024-09-12T00:21:42.502396+0000","last_unstale":"2024-09-12T01:07:27.696241+0000","last_undegraded":"2024-09-12T01:07:27.696241+0000","last_fullsized":"2024-09-12T01:07:27.696241+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:34.541877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607324,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":742,"num_read_kb":17888,"num_write":1520,"num_write_kb":31183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'183","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.638098+0000","last_change":"2024-09-12T00:21:44.500052+0000","last_active":"2024-09-12T01:05:04.638098+0000","last_peered":"2024-09-12T01:05:04.638098+0000","last_clean":"2024-09-12T01:05:04.638098+0000","last_became_active":"2024-09-12T00:21:44.499805+0000","last_became_peered":"2024-09-12T00:21:44.499805+0000","last_unstale":"2024-09-12T01:05:04.638098+0000","last_undegraded":"2024-09-12T01:05:04.638098+0000","last_fullsized":"2024-09-12T01:05:04.638098+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:04.496825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":613,"num_write":283,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'459","reported_seq":1203,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.639969+0000","last_change":"2024-09-12T00:21:42.519251+0000","last_active":"2024-09-12T01:07:27.639969+0000","last_peered":"2024-09-12T01:07:27.639969+0000","last_clean":"2024-09-12T01:07:27.639969+0000","last_became_active":"2024-09-12T00:21:42.518823+0000","last_became_peered":"2024-09-12T00:21:42.518823+0000","last_unstale":"2024-09-12T01:07:27.639969+0000","last_undegraded":"2024-09-12T01:07:27.639969+0000","last_fullsized":"2024-09-12T01:07:27.639969+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194369,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":958,"num_read_kb":24368,"num_write":1486,"num_write_kb":48727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'183","reported_seq":794,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.618714+0000","last_change":"2024-09-12T00:21:44.511626+0000","last_active":"2024-09-12T01:05:04.618714+0000","last_peered":"2024-09-12T01:05:04.618714+0000","last_clean":"2024-09-12T01:05:04.618714+0000","last_became_active":"2024-09-12T00:21:44.510818+0000","last_became_peered":"2024-09-12T00:21:44.510818+0000","last_unstale":"2024-09-12T01:05:04.618714+0000","last_undegraded":"2024-09-12T01:05:04.618714+0000","last_fullsized":"2024-09-12T01:05:04.618714+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:52.353228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":671,"num_write":265,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'350","reported_seq":1129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.619795+0000","last_change":"2024-09-12T00:21:42.526241+0000","last_active":"2024-09-12T01:07:27.619795+0000","last_peered":"2024-09-12T01:07:27.619795+0000","last_clean":"2024-09-12T01:07:27.619795+0000","last_became_active":"2024-09-12T00:21:42.525233+0000","last_became_peered":"2024-09-12T00:21:42.525233+0000","last_unstale":"2024-09-12T01:07:27.619795+0000","last_undegraded":"2024-09-12T01:07:27.619795+0000","last_fullsized":"2024-09-12T01:07:27.619795+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:21.684315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":844,"num_read_kb":20388,"num_write":1063,"num_write_kb":42665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'183","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.832023+0000","last_change":"2024-09-12T00:21:44.524491+0000","last_active":"2024-09-12T01:04:45.832023+0000","last_peered":"2024-09-12T01:04:45.832023+0000","last_clean":"2024-09-12T01:04:45.832023+0000","last_became_active":"2024-09-12T00:21:44.523632+0000","last_became_peered":"2024-09-12T00:21:44.523632+0000","last_unstale":"2024-09-12T01:04:45.832023+0000","last_undegraded":"2024-09-12T01:04:45.832023+0000","last_fullsized":"2024-09-12T01:04:45.832023+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:53.560876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":821,"num_read_kb":680,"num_write":294,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'392","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.607735+0000","last_change":"2024-09-12T00:21:42.504025+0000","last_active":"2024-09-12T01:07:27.607735+0000","last_peered":"2024-09-12T01:07:27.607735+0000","last_clean":"2024-09-12T01:07:27.607735+0000","last_became_active":"2024-09-12T00:21:42.501690+0000","last_became_peered":"2024-09-12T00:21:42.501690+0000","last_unstale":"2024-09-12T01:07:27.607735+0000","last_undegraded":"2024-09-12T01:07:27.607735+0000","last_fullsized":"2024-09-12T01:07:27.607735+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.312316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":15193,"num_write":1332,"num_write_kb":28087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'132","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.604509+0000","last_change":"2024-09-12T00:21:44.506973+0000","last_active":"2024-09-12T01:05:29.604509+0000","last_peered":"2024-09-12T01:05:29.604509+0000","last_clean":"2024-09-12T01:05:29.604509+0000","last_became_active":"2024-09-12T00:21:44.505235+0000","last_became_peered":"2024-09-12T00:21:44.505235+0000","last_unstale":"2024-09-12T01:05:29.604509+0000","last_undegraded":"2024-09-12T01:05:29.604509+0000","last_fullsized":"2024-09-12T01:05:29.604509+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":497,"num_write":201,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'335","reported_seq":1015,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.667417+0000","last_change":"2024-09-12T00:21:42.509646+0000","last_active":"2024-09-12T01:07:27.667417+0000","last_peered":"2024-09-12T01:07:27.667417+0000","last_clean":"2024-09-12T01:07:27.667417+0000","last_became_active":"2024-09-12T00:21:42.508673+0000","last_became_peered":"2024-09-12T00:21:42.508673+0000","last_unstale":"2024-09-12T01:07:27.667417+0000","last_undegraded":"2024-09-12T01:07:27.667417+0000","last_fullsized":"2024-09-12T01:07:27.667417+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:10.125063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":604,"num_read_kb":49155,"num_write":1190,"num_write_kb":40891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'142","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.973682+0000","last_change":"2024-09-12T00:21:44.515765+0000","last_active":"2024-09-12T01:07:11.973682+0000","last_peered":"2024-09-12T01:07:11.973682+0000","last_clean":"2024-09-12T01:07:11.973682+0000","last_became_active":"2024-09-12T00:21:44.515206+0000","last_became_peered":"2024-09-12T00:21:44.515206+0000","last_unstale":"2024-09-12T01:07:11.973682+0000","last_undegraded":"2024-09-12T01:07:11.973682+0000","last_fullsized":"2024-09-12T01:07:11.973682+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:47.686425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":613,"num_write":237,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'349","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.616430+0000","last_change":"2024-09-12T00:21:42.489401+0000","last_active":"2024-09-12T01:07:27.616430+0000","last_peered":"2024-09-12T01:07:27.616430+0000","last_clean":"2024-09-12T01:07:27.616430+0000","last_became_active":"2024-09-12T00:21:42.486829+0000","last_became_peered":"2024-09-12T00:21:42.486829+0000","last_unstale":"2024-09-12T01:07:27.616430+0000","last_undegraded":"2024-09-12T01:07:27.616430+0000","last_fullsized":"2024-09-12T01:07:27.616430+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.611453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":546,"num_read_kb":26644,"num_write":1053,"num_write_kb":13447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'172","reported_seq":774,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.786443+0000","last_change":"2024-09-12T00:21:44.503743+0000","last_active":"2024-09-12T01:05:29.786443+0000","last_peered":"2024-09-12T01:05:29.786443+0000","last_clean":"2024-09-12T01:05:29.786443+0000","last_became_active":"2024-09-12T00:21:44.501384+0000","last_became_peered":"2024-09-12T00:21:44.501384+0000","last_unstale":"2024-09-12T01:05:29.786443+0000","last_undegraded":"2024-09-12T01:05:29.786443+0000","last_fullsized":"2024-09-12T01:05:29.786443+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":594,"num_write":251,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'349","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.676202+0000","last_change":"2024-09-12T00:21:42.534665+0000","last_active":"2024-09-12T01:07:27.676202+0000","last_peered":"2024-09-12T01:07:27.676202+0000","last_clean":"2024-09-12T01:07:27.676202+0000","last_became_active":"2024-09-12T00:21:42.533216+0000","last_became_peered":"2024-09-12T00:21:42.533216+0000","last_unstale":"2024-09-12T01:07:27.676202+0000","last_undegraded":"2024-09-12T01:07:27.676202+0000","last_fullsized":"2024-09-12T01:07:27.676202+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.651370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":42167,"num_write":1187,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'107","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:48.581000+0000","last_change":"2024-09-12T00:21:44.515637+0000","last_active":"2024-09-12T01:03:48.581000+0000","last_peered":"2024-09-12T01:03:48.581000+0000","last_clean":"2024-09-12T01:03:48.581000+0000","last_became_active":"2024-09-12T00:21:44.514909+0000","last_became_peered":"2024-09-12T00:21:44.514909+0000","last_unstale":"2024-09-12T01:03:48.581000+0000","last_undegraded":"2024-09-12T01:03:48.581000+0000","last_fullsized":"2024-09-12T01:03:48.581000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:15.377389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":354,"num_write":152,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'370","reported_seq":1025,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.696935+0000","last_change":"2024-09-12T00:21:42.529321+0000","last_active":"2024-09-12T01:07:27.696935+0000","last_peered":"2024-09-12T01:07:27.696935+0000","last_clean":"2024-09-12T01:07:27.696935+0000","last_became_active":"2024-09-12T00:21:42.528929+0000","last_became_peered":"2024-09-12T00:21:42.528929+0000","last_unstale":"2024-09-12T01:07:27.696935+0000","last_undegraded":"2024-09-12T01:07:27.696935+0000","last_fullsized":"2024-09-12T01:07:27.696935+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.595630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739017,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":14743,"num_write":1076,"num_write_kb":22917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'148","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.196493+0000","last_change":"2024-09-12T00:21:44.507845+0000","last_active":"2024-09-12T01:05:01.196493+0000","last_peered":"2024-09-12T01:05:01.196493+0000","last_clean":"2024-09-12T01:05:01.196493+0000","last_became_active":"2024-09-12T00:21:44.507579+0000","last_became_peered":"2024-09-12T00:21:44.507579+0000","last_unstale":"2024-09-12T01:05:01.196493+0000","last_undegraded":"2024-09-12T01:05:01.196493+0000","last_fullsized":"2024-09-12T01:05:01.196493+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:20.931149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":566,"num_write":233,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'388","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.690710+0000","last_change":"2024-09-12T00:21:42.512593+0000","last_active":"2024-09-12T01:07:27.690710+0000","last_peered":"2024-09-12T01:07:27.690710+0000","last_clean":"2024-09-12T01:07:27.690710+0000","last_became_active":"2024-09-12T00:21:42.511703+0000","last_became_peered":"2024-09-12T00:21:42.511703+0000","last_unstale":"2024-09-12T01:07:27.690710+0000","last_undegraded":"2024-09-12T01:07:27.690710+0000","last_fullsized":"2024-09-12T01:07:27.690710+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:16.112281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":16290,"num_write":1225,"num_write_kb":34029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'32","reported_seq":574,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.235223+0000","last_change":"2024-09-12T00:21:44.512963+0000","last_active":"2024-09-12T01:05:51.235223+0000","last_peered":"2024-09-12T01:05:51.235223+0000","last_clean":"2024-09-12T01:05:51.235223+0000","last_became_active":"2024-09-12T00:21:44.509834+0000","last_became_peered":"2024-09-12T00:21:44.509834+0000","last_unstale":"2024-09-12T01:05:51.235223+0000","last_undegraded":"2024-09-12T01:05:51.235223+0000","last_fullsized":"2024-09-12T01:05:51.235223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:08.437585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'345","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.636450+0000","last_change":"2024-09-12T00:21:42.484617+0000","last_active":"2024-09-12T01:07:27.636450+0000","last_peered":"2024-09-12T01:07:27.636450+0000","last_clean":"2024-09-12T01:07:27.636450+0000","last_became_active":"2024-09-12T00:21:42.484073+0000","last_became_peered":"2024-09-12T00:21:42.484073+0000","last_unstale":"2024-09-12T01:07:27.636450+0000","last_undegraded":"2024-09-12T01:07:27.636450+0000","last_fullsized":"2024-09-12T01:07:27.636450+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:02.073875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992329,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":37312,"num_write":1168,"num_write_kb":47723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'219","reported_seq":806,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.336782+0000","last_change":"2024-09-12T00:21:44.499442+0000","last_active":"2024-09-12T01:05:39.336782+0000","last_peered":"2024-09-12T01:05:39.336782+0000","last_clean":"2024-09-12T01:05:39.336782+0000","last_became_active":"2024-09-12T00:21:44.499043+0000","last_became_peered":"2024-09-12T00:21:44.499043+0000","last_unstale":"2024-09-12T01:05:39.336782+0000","last_undegraded":"2024-09-12T01:05:39.336782+0000","last_fullsized":"2024-09-12T01:05:39.336782+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:15.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":734,"num_write":347,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'399","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.670794+0000","last_change":"2024-09-12T00:21:42.483974+0000","last_active":"2024-09-12T01:07:27.670794+0000","last_peered":"2024-09-12T01:07:27.670794+0000","last_clean":"2024-09-12T01:07:27.670794+0000","last_became_active":"2024-09-12T00:21:42.482971+0000","last_became_peered":"2024-09-12T00:21:42.482971+0000","last_unstale":"2024-09-12T01:07:27.670794+0000","last_undegraded":"2024-09-12T01:07:27.670794+0000","last_fullsized":"2024-09-12T01:07:27.670794+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:02.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5391930,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":31089,"num_write":1168,"num_write_kb":20487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'217","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.418327+0000","last_change":"2024-09-12T00:21:44.526412+0000","last_active":"2024-09-12T01:06:44.418327+0000","last_peered":"2024-09-12T01:06:44.418327+0000","last_clean":"2024-09-12T01:06:44.418327+0000","last_became_active":"2024-09-12T00:21:44.526086+0000","last_became_peered":"2024-09-12T00:21:44.526086+0000","last_unstale":"2024-09-12T01:06:44.418327+0000","last_undegraded":"2024-09-12T01:06:44.418327+0000","last_fullsized":"2024-09-12T01:06:44.418327+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:23.397670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1006,"num_read_kb":865,"num_write":343,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'363","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.696477+0000","last_change":"2024-09-12T00:22:12.610824+0000","last_active":"2024-09-12T01:07:27.696477+0000","last_peered":"2024-09-12T01:07:27.696477+0000","last_clean":"2024-09-12T01:07:27.696477+0000","last_became_active":"2024-09-12T00:22:12.609837+0000","last_became_peered":"2024-09-12T00:22:12.609837+0000","last_unstale":"2024-09-12T01:07:27.696477+0000","last_undegraded":"2024-09-12T01:07:27.696477+0000","last_fullsized":"2024-09-12T01:07:27.696477+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:23.567602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48804,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":34651,"num_write":1163,"num_write_kb":39913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2a","version":"267'441","reported_seq":1107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.368037+0000","last_change":"2024-09-12T00:21:44.512868+0000","last_active":"2024-09-12T01:05:25.368037+0000","last_peered":"2024-09-12T01:05:25.368037+0000","last_clean":"2024-09-12T01:05:25.368037+0000","last_became_active":"2024-09-12T00:21:44.511294+0000","last_became_peered":"2024-09-12T00:21:44.511294+0000","last_unstale":"2024-09-12T01:05:25.368037+0000","last_undegraded":"2024-09-12T01:05:25.368037+0000","last_fullsized":"2024-09-12T01:05:25.368037+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:11.069322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2157,"num_read_kb":1820,"num_write":750,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'349","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.568181+0000","last_change":"2024-09-12T00:21:42.530226+0000","last_active":"2024-09-12T01:07:27.568181+0000","last_peered":"2024-09-12T01:07:27.568181+0000","last_clean":"2024-09-12T01:07:27.568181+0000","last_became_active":"2024-09-12T00:21:42.528942+0000","last_became_peered":"2024-09-12T00:21:42.528942+0000","last_unstale":"2024-09-12T01:07:27.568181+0000","last_undegraded":"2024-09-12T01:07:27.568181+0000","last_fullsized":"2024-09-12T01:07:27.568181+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:58.270470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":48912,"num_write":1189,"num_write_kb":34098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'117","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.852107+0000","last_change":"2024-09-12T00:21:44.526377+0000","last_active":"2024-09-12T01:05:02.852107+0000","last_peered":"2024-09-12T01:05:02.852107+0000","last_clean":"2024-09-12T01:05:02.852107+0000","last_became_active":"2024-09-12T00:21:44.525685+0000","last_became_peered":"2024-09-12T00:21:44.525685+0000","last_unstale":"2024-09-12T01:05:02.852107+0000","last_undegraded":"2024-09-12T01:05:02.852107+0000","last_fullsized":"2024-09-12T01:05:02.852107+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.603436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":457,"num_write":189,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'328","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.607175+0000","last_change":"2024-09-12T00:21:42.503168+0000","last_active":"2024-09-12T01:07:27.607175+0000","last_peered":"2024-09-12T01:07:27.607175+0000","last_clean":"2024-09-12T01:07:27.607175+0000","last_became_active":"2024-09-12T00:21:42.499294+0000","last_became_peered":"2024-09-12T00:21:42.499294+0000","last_unstale":"2024-09-12T01:07:27.607175+0000","last_undegraded":"2024-09-12T01:07:27.607175+0000","last_fullsized":"2024-09-12T01:07:27.607175+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:30.172185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":11483,"num_write":1078,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'192","reported_seq":807,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:48.540662+0000","last_change":"2024-09-12T00:21:44.511953+0000","last_active":"2024-09-12T01:05:48.540662+0000","last_peered":"2024-09-12T01:05:48.540662+0000","last_clean":"2024-09-12T01:05:48.540662+0000","last_became_active":"2024-09-12T00:21:44.511085+0000","last_became_peered":"2024-09-12T00:21:44.511085+0000","last_unstale":"2024-09-12T01:05:48.540662+0000","last_undegraded":"2024-09-12T01:05:48.540662+0000","last_fullsized":"2024-09-12T01:05:48.540662+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:53.583649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":698,"num_write":312,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'380","reported_seq":1049,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.665132+0000","last_change":"2024-09-12T00:21:42.519200+0000","last_active":"2024-09-12T01:07:27.665132+0000","last_peered":"2024-09-12T01:07:27.665132+0000","last_clean":"2024-09-12T01:07:27.665132+0000","last_became_active":"2024-09-12T00:21:42.518768+0000","last_became_peered":"2024-09-12T00:21:42.518768+0000","last_unstale":"2024-09-12T01:07:27.665132+0000","last_undegraded":"2024-09-12T01:07:27.665132+0000","last_fullsized":"2024-09-12T01:07:27.665132+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:58.092377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984139,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":53651,"num_write":1104,"num_write_kb":23347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'311","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.665883+0000","last_change":"2024-09-12T00:21:42.495841+0000","last_active":"2024-09-12T01:07:27.665883+0000","last_peered":"2024-09-12T01:07:27.665883+0000","last_clean":"2024-09-12T01:07:27.665883+0000","last_became_active":"2024-09-12T00:21:42.495480+0000","last_became_peered":"2024-09-12T00:21:42.495480+0000","last_unstale":"2024-09-12T01:07:27.665883+0000","last_undegraded":"2024-09-12T01:07:27.665883+0000","last_fullsized":"2024-09-12T01:07:27.665883+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:30.083635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":25580,"num_write":940,"num_write_kb":28169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'195","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.324242+0000","last_change":"2024-09-12T00:21:44.527476+0000","last_active":"2024-09-12T01:04:19.324242+0000","last_peered":"2024-09-12T01:04:19.324242+0000","last_clean":"2024-09-12T01:04:19.324242+0000","last_became_active":"2024-09-12T00:21:44.526907+0000","last_became_peered":"2024-09-12T00:21:44.526907+0000","last_unstale":"2024-09-12T01:04:19.324242+0000","last_undegraded":"2024-09-12T01:04:19.324242+0000","last_fullsized":"2024-09-12T01:04:19.324242+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.457978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":917,"num_read_kb":786,"num_write":315,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.655976+0000","last_change":"2024-09-12T00:21:42.518641+0000","last_active":"2024-09-12T01:07:27.655976+0000","last_peered":"2024-09-12T01:07:27.655976+0000","last_clean":"2024-09-12T01:07:27.655976+0000","last_became_active":"2024-09-12T00:21:42.516614+0000","last_became_peered":"2024-09-12T00:21:42.516614+0000","last_unstale":"2024-09-12T01:07:27.655976+0000","last_undegraded":"2024-09-12T01:07:27.655976+0000","last_fullsized":"2024-09-12T01:07:27.655976+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:41.453930+0000","last_clean_scrub_stamp":"2024-09-12T00:21:41.453930+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:05.951966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":551234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":30838,"num_write":927,"num_write_kb":38454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'102","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.972355+0000","last_change":"2024-09-12T00:21:44.497391+0000","last_active":"2024-09-12T01:05:40.972355+0000","last_peered":"2024-09-12T01:05:40.972355+0000","last_clean":"2024-09-12T01:05:40.972355+0000","last_became_active":"2024-09-12T00:21:44.496138+0000","last_became_peered":"2024-09-12T00:21:44.496138+0000","last_unstale":"2024-09-12T01:05:40.972355+0000","last_undegraded":"2024-09-12T01:05:40.972355+0000","last_fullsized":"2024-09-12T01:05:40.972355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:58.246589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5839,"num_read_kb":4146,"num_write":1942,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1113,"ondisk_log_size":1113,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14973,"num_read_kb":14645,"num_write":16791,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":601,"ondisk_log_size":601,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1609364,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17687,"num_read_kb":36971,"num_write":14775,"num_write_kb":11603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1859,"ondisk_log_size":1859,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":101832,"num_read_kb":85065,"num_write":36894,"num_write_kb":18565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3786,"ondisk_log_size":3786,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":81179371,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36143,"num_read_kb":1795948,"num_write":71818,"num_write_kb":2042491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123875328,"data_stored":123875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3430,"ondisk_log_size":3430,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":206538,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":195226,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509998,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110336,"kb_used_data":20640,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94261504,"statfs":{"total":96636764160,"available":96523780096,"internally_reserved":0,"allocated":21135360,"data_stored":19116983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509999,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273492,"kb_used_data":21636,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098348,"statfs":{"total":96636764160,"available":96356708352,"internally_reserved":0,"allocated":22155264,"data_stored":20133475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510001,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200892,"kb_used_data":21228,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94170948,"statfs":{"total":96636764160,"available":96431050752,"internally_reserved":0,"allocated":21737472,"data_stored":19736193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509999,"num_pgs":123,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257480,"kb_used_data":19448,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94114360,"statfs":{"total":96636764160,"available":96373104640,"internally_reserved":0,"allocated":19914752,"data_stored":17899204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":243726792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510002,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145376,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94226464,"statfs":{"total":96636764160,"available":96487899136,"internally_reserved":0,"allocated":24526848,"data_stored":22535733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509999,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282432,"kb_used_data":12464,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94089408,"statfs":{"total":96636764160,"available":96347553792,"internally_reserved":0,"allocated":12763136,"data_stored":10743931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509998,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146944,"kb_used_data":17264,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94224896,"statfs":{"total":96636764160,"available":96486293504,"internally_reserved":0,"allocated":17678336,"data_stored":15657318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542704,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243148,"kb_used_data":18796,"kb_used_omap":1,"kb_used_meta":224062,"kb_avail":94128692,"statfs":{"total":96636764160,"available":96387780608,"internally_reserved":0,"allocated":19247104,"data_stored":17260105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":229439946},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13402112,"data_stored":13402112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7901184,"data_stored":7901184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20283392,"data_stored":20283392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17481728,"data_stored":17481728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17289216,"data_stored":17289216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16863232,"data_stored":16863232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15007744,"data_stored":15007744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:07:35.380 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.380 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.381 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.381 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.381 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.381 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.381 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.382 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.382 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.382 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.382 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.382 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.383 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.383 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.383 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.383 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.383 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.384 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.384 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.384 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.384 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.384 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.385 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.385 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.385 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.385 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.385 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.386 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.386 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.386 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.386 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.386 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.387 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.387 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.387 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.387 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.387 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.388 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.388 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.388 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.388 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.388 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.389 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.389 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.389 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.389 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.390 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.390 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.390 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.390 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.390 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.391 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.391 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.391 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.391 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.391 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.391 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.392 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.392 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.392 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.392 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.392 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.393 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.393 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.393 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.393 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.393 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.394 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.394 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.394 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.394 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.394 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.395 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.395 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.395 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.395 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.395 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.396 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.396 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.396 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.396 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.396 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.396 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.397 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.397 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.397 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.397 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.398 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.398 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.398 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.398 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.398 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.399 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.399 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.399 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.399 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.399 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.399 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.400 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.400 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.400 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.400 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.401 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.401 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.401 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.401 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.401 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.402 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.402 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.402 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.402 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.402 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.402 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.403 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.403 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.403 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.403 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.403 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.404 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.404 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.404 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.404 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.404 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.405 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.405 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.405 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.405 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.405 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.406 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.406 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.406 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.406 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.406 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.406 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.407 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.407 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.407 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.407 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.407 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.408 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.408 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.408 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.408 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.408 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.408 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.409 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.409 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.409 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.409 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.409 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.410 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.410 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.410 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.410 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.410 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.411 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.411 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.411 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.411 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.411 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.411 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.412 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.412 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.412 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.412 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.412 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.412 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.413 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.413 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.413 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.413 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.413 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.414 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.414 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.414 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.414 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.414 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.415 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.415 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.415 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.415 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.415 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.416 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.416 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.416 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.416 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.416 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.417 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.417 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.417 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.417 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.417 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.417 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.418 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.418 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.418 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.418 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.418 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.419 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.419 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.419 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.419 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.419 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.419 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.420 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.420 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.420 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.420 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.420 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.421 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.421 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.421 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.421 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.421 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.422 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.422 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.422 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.422 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.422 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.423 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.423 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.423 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.423 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.423 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.424 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.424 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:21:25.204719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.424 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.424 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.425 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.425 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.425 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.425 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.425 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.425 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:21:25.204719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.426 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.427 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.427 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:21:25.204719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.427 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.427 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.427 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.427 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.427 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.427 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:21:25.204719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:21:25.204719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.428 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:21:25.204719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.429 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:21:25.204719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.430 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.431 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.432 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.433 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.434 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.435 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.436 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.437 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.438 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.438 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.438 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.438 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.438 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.438 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.438 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.438 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.439 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.440 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.441 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.442 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.442 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.442 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.442 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:21:41.453930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.442 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:35.442 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:07:55.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:07:55.783 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:07:55.795 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T01:07:55.800 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1658,"stamp":"2024-09-12T01:07:55.145354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83396560,"num_objects":733,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":179311,"num_read_kb":2341483,"num_write":142743,"num_write_kb":2353740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":572672,"num_omap_keys":1372,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12793,"ondisk_log_size":12793,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1642916,"kb_used_data":155428,"kb_used_omap":12,"kb_used_meta":1487347,"kb_avail":753331804,"statfs":{"total":773094113280,"available":771411767296,"internally_reserved":0,"allocated":159158272,"data_stored":143082942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1523043889},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":542916,"num_omap_keys":1253,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007898"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587141+0000","last_change":"2024-09-12T00:49:10.624205+0000","last_active":"2024-09-12T01:04:14.587141+0000","last_peered":"2024-09-12T01:04:14.587141+0000","last_clean":"2024-09-12T01:04:14.587141+0000","last_became_active":"2024-09-12T00:49:10.623491+0000","last_became_peered":"2024-09-12T00:49:10.623491+0000","last_unstale":"2024-09-12T01:04:14.587141+0000","last_undegraded":"2024-09-12T01:04:14.587141+0000","last_fullsized":"2024-09-12T01:04:14.587141+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:17.660122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"267'7","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.789961+0000","last_change":"2024-09-12T00:38:10.688649+0000","last_active":"2024-09-12T01:05:44.789961+0000","last_peered":"2024-09-12T01:05:44.789961+0000","last_clean":"2024-09-12T01:05:44.789961+0000","last_became_active":"2024-09-12T00:38:10.687911+0000","last_became_peered":"2024-09-12T00:38:10.687911+0000","last_unstale":"2024-09-12T01:05:44.789961+0000","last_undegraded":"2024-09-12T01:05:44.789961+0000","last_fullsized":"2024-09-12T01:05:44.789961+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:09.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.571671+0000","last_change":"2024-09-12T00:38:07.665498+0000","last_active":"2024-09-12T01:03:08.571671+0000","last_peered":"2024-09-12T01:03:08.571671+0000","last_clean":"2024-09-12T01:03:08.571671+0000","last_became_active":"2024-09-12T00:38:07.664779+0000","last_became_peered":"2024-09-12T00:38:07.664779+0000","last_unstale":"2024-09-12T01:03:08.571671+0000","last_undegraded":"2024-09-12T01:03:08.571671+0000","last_fullsized":"2024-09-12T01:03:08.571671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.524540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'50","reported_seq":183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.601950+0000","last_change":"2024-09-12T00:36:37.236134+0000","last_active":"2024-09-12T01:05:49.601950+0000","last_peered":"2024-09-12T01:05:49.601950+0000","last_clean":"2024-09-12T01:05:49.601950+0000","last_became_active":"2024-09-12T00:36:37.223686+0000","last_became_peered":"2024-09-12T00:36:37.223686+0000","last_unstale":"2024-09-12T01:05:49.601950+0000","last_undegraded":"2024-09-12T01:05:49.601950+0000","last_fullsized":"2024-09-12T01:05:49.601950+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":201,"num_write":87,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.582523+0000","last_change":"2024-09-12T00:49:10.625393+0000","last_active":"2024-09-12T01:04:14.582523+0000","last_peered":"2024-09-12T01:04:14.582523+0000","last_clean":"2024-09-12T01:04:14.582523+0000","last_became_active":"2024-09-12T00:49:10.624700+0000","last_became_peered":"2024-09-12T00:49:10.624700+0000","last_unstale":"2024-09-12T01:04:14.582523+0000","last_undegraded":"2024-09-12T01:04:14.582523+0000","last_fullsized":"2024-09-12T01:04:14.582523+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"267'8","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.769490+0000","last_change":"2024-09-12T00:38:10.696907+0000","last_active":"2024-09-12T01:05:44.769490+0000","last_peered":"2024-09-12T01:05:44.769490+0000","last_clean":"2024-09-12T01:05:44.769490+0000","last_became_active":"2024-09-12T00:38:10.691195+0000","last_became_peered":"2024-09-12T00:38:10.691195+0000","last_unstale":"2024-09-12T01:05:44.769490+0000","last_undegraded":"2024-09-12T01:05:44.769490+0000","last_fullsized":"2024-09-12T01:05:44.769490+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.105627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"267'8","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.627314+0000","last_change":"2024-09-12T00:38:07.665354+0000","last_active":"2024-09-12T01:05:39.627314+0000","last_peered":"2024-09-12T01:05:39.627314+0000","last_clean":"2024-09-12T01:05:39.627314+0000","last_became_active":"2024-09-12T00:38:07.664663+0000","last_became_peered":"2024-09-12T00:38:07.664663+0000","last_unstale":"2024-09-12T01:05:39.627314+0000","last_undegraded":"2024-09-12T01:05:39.627314+0000","last_fullsized":"2024-09-12T01:05:39.627314+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.495162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587630+0000","last_change":"2024-09-12T00:36:37.240047+0000","last_active":"2024-09-12T01:04:49.587630+0000","last_peered":"2024-09-12T01:04:49.587630+0000","last_clean":"2024-09-12T01:04:49.587630+0000","last_became_active":"2024-09-12T00:36:37.239199+0000","last_became_peered":"2024-09-12T00:36:37.239199+0000","last_unstale":"2024-09-12T01:04:49.587630+0000","last_undegraded":"2024-09-12T01:04:49.587630+0000","last_fullsized":"2024-09-12T01:04:49.587630+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:11.845055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.762541+0000","last_change":"2024-09-12T00:49:10.612385+0000","last_active":"2024-09-12T01:03:44.762541+0000","last_peered":"2024-09-12T01:03:44.762541+0000","last_clean":"2024-09-12T01:03:44.762541+0000","last_became_active":"2024-09-12T00:49:10.611715+0000","last_became_peered":"2024-09-12T00:49:10.611715+0000","last_unstale":"2024-09-12T01:03:44.762541+0000","last_undegraded":"2024-09-12T01:03:44.762541+0000","last_fullsized":"2024-09-12T01:03:44.762541+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:44.906371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"267'13","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.115134+0000","last_change":"2024-09-12T00:38:10.708434+0000","last_active":"2024-09-12T01:07:26.115134+0000","last_peered":"2024-09-12T01:07:26.115134+0000","last_clean":"2024-09-12T01:07:26.115134+0000","last_became_active":"2024-09-12T00:38:10.702832+0000","last_became_peered":"2024-09-12T00:38:10.702832+0000","last_unstale":"2024-09-12T01:07:26.115134+0000","last_undegraded":"2024-09-12T01:07:26.115134+0000","last_fullsized":"2024-09-12T01:07:26.115134+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:02.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26653,"num_write":18,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:13.586519+0000","last_change":"2024-09-12T00:38:07.656103+0000","last_active":"2024-09-12T01:04:13.586519+0000","last_peered":"2024-09-12T01:04:13.586519+0000","last_clean":"2024-09-12T01:04:13.586519+0000","last_became_active":"2024-09-12T00:38:07.654162+0000","last_became_peered":"2024-09-12T00:38:07.654162+0000","last_unstale":"2024-09-12T01:04:13.586519+0000","last_undegraded":"2024-09-12T01:04:13.586519+0000","last_fullsized":"2024-09-12T01:04:13.586519+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:51.681421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'61","reported_seq":215,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.745657+0000","last_change":"2024-09-12T00:36:37.244669+0000","last_active":"2024-09-12T01:05:03.745657+0000","last_peered":"2024-09-12T01:05:03.745657+0000","last_clean":"2024-09-12T01:05:03.745657+0000","last_became_active":"2024-09-12T00:36:37.243951+0000","last_became_peered":"2024-09-12T00:36:37.243951+0000","last_unstale":"2024-09-12T01:05:03.745657+0000","last_undegraded":"2024-09-12T01:05:03.745657+0000","last_fullsized":"2024-09-12T01:05:03.745657+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:02.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":228,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600226+0000","last_change":"2024-09-12T00:49:10.614295+0000","last_active":"2024-09-12T01:03:49.600226+0000","last_peered":"2024-09-12T01:03:49.600226+0000","last_clean":"2024-09-12T01:03:49.600226+0000","last_became_active":"2024-09-12T00:49:10.613525+0000","last_became_peered":"2024-09-12T00:49:10.613525+0000","last_unstale":"2024-09-12T01:03:49.600226+0000","last_undegraded":"2024-09-12T01:03:49.600226+0000","last_fullsized":"2024-09-12T01:03:49.600226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:34.120845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'12","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321339+0000","last_change":"2024-09-12T00:38:10.702125+0000","last_active":"2024-09-12T01:07:26.321339+0000","last_peered":"2024-09-12T01:07:26.321339+0000","last_clean":"2024-09-12T01:07:26.321339+0000","last_became_active":"2024-09-12T00:38:10.701406+0000","last_became_peered":"2024-09-12T00:38:10.701406+0000","last_unstale":"2024-09-12T01:07:26.321339+0000","last_undegraded":"2024-09-12T01:07:26.321339+0000","last_fullsized":"2024-09-12T01:07:26.321339+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.321347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'4","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.783176+0000","last_change":"2024-09-12T00:38:07.642044+0000","last_active":"2024-09-12T01:05:14.783176+0000","last_peered":"2024-09-12T01:05:14.783176+0000","last_clean":"2024-09-12T01:05:14.783176+0000","last_became_active":"2024-09-12T00:38:07.639897+0000","last_became_peered":"2024-09-12T00:38:07.639897+0000","last_unstale":"2024-09-12T01:05:14.783176+0000","last_undegraded":"2024-09-12T01:05:14.783176+0000","last_fullsized":"2024-09-12T01:05:14.783176+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:48.556221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4625,"num_write":4,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'49","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.581394+0000","last_change":"2024-09-12T00:36:37.236688+0000","last_active":"2024-09-12T01:04:09.581394+0000","last_peered":"2024-09-12T01:04:09.581394+0000","last_clean":"2024-09-12T01:04:09.581394+0000","last_became_active":"2024-09-12T00:36:37.235921+0000","last_became_peered":"2024-09-12T00:36:37.235921+0000","last_unstale":"2024-09-12T01:04:09.581394+0000","last_undegraded":"2024-09-12T01:04:09.581394+0000","last_fullsized":"2024-09-12T01:04:09.581394+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:57.656212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":160,"num_write":94,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.601979+0000","last_change":"2024-09-12T00:49:10.640862+0000","last_active":"2024-09-12T01:05:18.601979+0000","last_peered":"2024-09-12T01:05:18.601979+0000","last_clean":"2024-09-12T01:05:18.601979+0000","last_became_active":"2024-09-12T00:49:10.640187+0000","last_became_peered":"2024-09-12T00:49:10.640187+0000","last_unstale":"2024-09-12T01:05:18.601979+0000","last_undegraded":"2024-09-12T01:05:18.601979+0000","last_fullsized":"2024-09-12T01:05:18.601979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.913407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.596205+0000","last_change":"2024-09-12T00:38:10.702920+0000","last_active":"2024-09-12T01:04:54.596205+0000","last_peered":"2024-09-12T01:04:54.596205+0000","last_clean":"2024-09-12T01:04:54.596205+0000","last_became_active":"2024-09-12T00:38:10.702113+0000","last_became_peered":"2024-09-12T00:38:10.702113+0000","last_unstale":"2024-09-12T01:04:54.596205+0000","last_undegraded":"2024-09-12T01:04:54.596205+0000","last_fullsized":"2024-09-12T01:04:54.596205+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:03.161296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.613854+0000","last_change":"2024-09-12T00:38:07.661344+0000","last_active":"2024-09-12T01:04:44.613854+0000","last_peered":"2024-09-12T01:04:44.613854+0000","last_clean":"2024-09-12T01:04:44.613854+0000","last_became_active":"2024-09-12T00:38:07.660159+0000","last_became_peered":"2024-09-12T00:38:07.660159+0000","last_unstale":"2024-09-12T01:04:44.613854+0000","last_undegraded":"2024-09-12T01:04:44.613854+0000","last_fullsized":"2024-09-12T01:04:44.613854+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:05.309641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'28","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:15.675076+0000","last_change":"2024-09-12T00:36:37.251730+0000","last_active":"2024-09-12T01:04:15.675076+0000","last_peered":"2024-09-12T01:04:15.675076+0000","last_clean":"2024-09-12T01:04:15.675076+0000","last_became_active":"2024-09-12T00:36:37.248920+0000","last_became_peered":"2024-09-12T00:36:37.248920+0000","last_unstale":"2024-09-12T01:04:15.675076+0000","last_undegraded":"2024-09-12T01:04:15.675076+0000","last_fullsized":"2024-09-12T01:04:15.675076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.363028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.574475+0000","last_change":"2024-09-12T00:49:10.640254+0000","last_active":"2024-09-12T01:03:49.574475+0000","last_peered":"2024-09-12T01:03:49.574475+0000","last_clean":"2024-09-12T01:03:49.574475+0000","last_became_active":"2024-09-12T00:49:10.638196+0000","last_became_peered":"2024-09-12T00:49:10.638196+0000","last_unstale":"2024-09-12T01:03:49.574475+0000","last_undegraded":"2024-09-12T01:03:49.574475+0000","last_fullsized":"2024-09-12T01:03:49.574475+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:50.165315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634261+0000","last_change":"2024-09-12T00:38:10.715254+0000","last_active":"2024-09-12T01:04:49.634261+0000","last_peered":"2024-09-12T01:04:49.634261+0000","last_clean":"2024-09-12T01:04:49.634261+0000","last_became_active":"2024-09-12T00:38:10.714503+0000","last_became_peered":"2024-09-12T00:38:10.714503+0000","last_unstale":"2024-09-12T01:04:49.634261+0000","last_undegraded":"2024-09-12T01:04:49.634261+0000","last_fullsized":"2024-09-12T01:04:49.634261+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.076577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"267'5","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:19.427278+0000","last_change":"2024-09-12T00:38:07.659781+0000","last_active":"2024-09-12T01:07:19.427278+0000","last_peered":"2024-09-12T01:07:19.427278+0000","last_clean":"2024-09-12T01:07:19.427278+0000","last_became_active":"2024-09-12T00:38:07.656570+0000","last_became_peered":"2024-09-12T00:38:07.656570+0000","last_unstale":"2024-09-12T01:07:19.427278+0000","last_undegraded":"2024-09-12T01:07:19.427278+0000","last_fullsized":"2024-09-12T01:07:19.427278+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.888062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'40","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.829646+0000","last_change":"2024-09-12T00:36:37.239747+0000","last_active":"2024-09-12T01:05:02.829646+0000","last_peered":"2024-09-12T01:05:02.829646+0000","last_clean":"2024-09-12T01:05:02.829646+0000","last_became_active":"2024-09-12T00:36:37.239055+0000","last_became_peered":"2024-09-12T00:36:37.239055+0000","last_unstale":"2024-09-12T01:05:02.829646+0000","last_undegraded":"2024-09-12T01:05:02.829646+0000","last_fullsized":"2024-09-12T01:05:02.829646+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:58.947633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":128,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748036+0000","last_change":"2024-09-12T00:49:10.625186+0000","last_active":"2024-09-12T01:04:09.748036+0000","last_peered":"2024-09-12T01:04:09.748036+0000","last_clean":"2024-09-12T01:04:09.748036+0000","last_became_active":"2024-09-12T00:49:10.624542+0000","last_became_peered":"2024-09-12T00:49:10.624542+0000","last_unstale":"2024-09-12T01:04:09.748036+0000","last_undegraded":"2024-09-12T01:04:09.748036+0000","last_fullsized":"2024-09-12T01:04:09.748036+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:44.317158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.734406+0000","last_change":"2024-09-12T00:38:10.698782+0000","last_active":"2024-09-12T01:03:14.734406+0000","last_peered":"2024-09-12T01:03:14.734406+0000","last_clean":"2024-09-12T01:03:14.734406+0000","last_became_active":"2024-09-12T00:38:10.698076+0000","last_became_peered":"2024-09-12T00:38:10.698076+0000","last_unstale":"2024-09-12T01:03:14.734406+0000","last_undegraded":"2024-09-12T01:03:14.734406+0000","last_fullsized":"2024-09-12T01:03:14.734406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:50.783233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.573024+0000","last_change":"2024-09-12T00:38:07.627893+0000","last_active":"2024-09-12T01:03:09.573024+0000","last_peered":"2024-09-12T01:03:09.573024+0000","last_clean":"2024-09-12T01:03:09.573024+0000","last_became_active":"2024-09-12T00:38:07.626956+0000","last_became_peered":"2024-09-12T00:38:07.626956+0000","last_unstale":"2024-09-12T01:03:09.573024+0000","last_undegraded":"2024-09-12T01:03:09.573024+0000","last_fullsized":"2024-09-12T01:03:09.573024+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.872892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'29","reported_seq":124,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.573884+0000","last_change":"2024-09-12T00:36:37.240924+0000","last_active":"2024-09-12T01:03:18.573884+0000","last_peered":"2024-09-12T01:03:18.573884+0000","last_clean":"2024-09-12T01:03:18.573884+0000","last_became_active":"2024-09-12T00:36:37.239412+0000","last_became_peered":"2024-09-12T00:36:37.239412+0000","last_unstale":"2024-09-12T01:03:18.573884+0000","last_undegraded":"2024-09-12T01:03:18.573884+0000","last_fullsized":"2024-09-12T01:03:18.573884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:01.137832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":107,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.587293+0000","last_change":"2024-09-12T00:49:10.628369+0000","last_active":"2024-09-12T01:04:14.587293+0000","last_peered":"2024-09-12T01:04:14.587293+0000","last_clean":"2024-09-12T01:04:14.587293+0000","last_became_active":"2024-09-12T00:49:10.623930+0000","last_became_peered":"2024-09-12T00:49:10.623930+0000","last_unstale":"2024-09-12T01:04:14.587293+0000","last_undegraded":"2024-09-12T01:04:14.587293+0000","last_fullsized":"2024-09-12T01:04:14.587293+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.045569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.572802+0000","last_change":"2024-09-12T00:38:10.710382+0000","last_active":"2024-09-12T01:03:13.572802+0000","last_peered":"2024-09-12T01:03:13.572802+0000","last_clean":"2024-09-12T01:03:13.572802+0000","last_became_active":"2024-09-12T00:38:10.709065+0000","last_became_peered":"2024-09-12T00:38:10.709065+0000","last_unstale":"2024-09-12T01:03:13.572802+0000","last_undegraded":"2024-09-12T01:03:13.572802+0000","last_fullsized":"2024-09-12T01:03:13.572802+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:25.778926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"267'4","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.601013+0000","last_change":"2024-09-12T00:38:07.659182+0000","last_active":"2024-09-12T01:05:39.601013+0000","last_peered":"2024-09-12T01:05:39.601013+0000","last_clean":"2024-09-12T01:05:39.601013+0000","last_became_active":"2024-09-12T00:38:07.658039+0000","last_became_peered":"2024-09-12T00:38:07.658039+0000","last_unstale":"2024-09-12T01:05:39.601013+0000","last_undegraded":"2024-09-12T01:05:39.601013+0000","last_fullsized":"2024-09-12T01:05:39.601013+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:05.041242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'24","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567579+0000","last_change":"2024-09-12T00:36:37.243485+0000","last_active":"2024-09-12T01:03:14.567579+0000","last_peered":"2024-09-12T01:03:14.567579+0000","last_clean":"2024-09-12T01:03:14.567579+0000","last_became_active":"2024-09-12T00:36:37.238156+0000","last_became_peered":"2024-09-12T00:36:37.238156+0000","last_unstale":"2024-09-12T01:03:14.567579+0000","last_undegraded":"2024-09-12T01:03:14.567579+0000","last_fullsized":"2024-09-12T01:03:14.567579+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:40.335893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":66,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.625939+0000","last_change":"2024-09-12T00:49:10.614687+0000","last_active":"2024-09-12T01:05:34.625939+0000","last_peered":"2024-09-12T01:05:34.625939+0000","last_clean":"2024-09-12T01:05:34.625939+0000","last_became_active":"2024-09-12T00:49:10.614006+0000","last_became_peered":"2024-09-12T00:49:10.614006+0000","last_unstale":"2024-09-12T01:05:34.625939+0000","last_undegraded":"2024-09-12T01:05:34.625939+0000","last_fullsized":"2024-09-12T01:05:34.625939+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.428804+0000","last_change":"2024-09-12T00:38:10.692661+0000","last_active":"2024-09-12T01:07:13.428804+0000","last_peered":"2024-09-12T01:07:13.428804+0000","last_clean":"2024-09-12T01:07:13.428804+0000","last_became_active":"2024-09-12T00:38:10.691887+0000","last_became_peered":"2024-09-12T00:38:10.691887+0000","last_unstale":"2024-09-12T01:07:13.428804+0000","last_undegraded":"2024-09-12T01:07:13.428804+0000","last_fullsized":"2024-09-12T01:07:13.428804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.050768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'8","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.621210+0000","last_change":"2024-09-12T00:38:07.654631+0000","last_active":"2024-09-12T01:07:26.621210+0000","last_peered":"2024-09-12T01:07:26.621210+0000","last_clean":"2024-09-12T01:07:26.621210+0000","last_became_active":"2024-09-12T00:38:07.653685+0000","last_became_peered":"2024-09-12T00:38:07.653685+0000","last_unstale":"2024-09-12T01:07:26.621210+0000","last_undegraded":"2024-09-12T01:07:26.621210+0000","last_fullsized":"2024-09-12T01:07:26.621210+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:49.445932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'8","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.567005+0000","last_change":"2024-09-12T00:36:37.229918+0000","last_active":"2024-09-12T01:03:14.567005+0000","last_peered":"2024-09-12T01:03:14.567005+0000","last_clean":"2024-09-12T01:03:14.567005+0000","last_became_active":"2024-09-12T00:36:37.223860+0000","last_became_peered":"2024-09-12T00:36:37.223860+0000","last_unstale":"2024-09-12T01:03:14.567005+0000","last_undegraded":"2024-09-12T01:03:14.567005+0000","last_fullsized":"2024-09-12T01:03:14.567005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:21.022755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.599856+0000","last_change":"2024-09-12T00:49:10.623954+0000","last_active":"2024-09-12T01:05:34.599856+0000","last_peered":"2024-09-12T01:05:34.599856+0000","last_clean":"2024-09-12T01:05:34.599856+0000","last_became_active":"2024-09-12T00:49:10.622347+0000","last_became_peered":"2024-09-12T00:49:10.622347+0000","last_unstale":"2024-09-12T01:05:34.599856+0000","last_undegraded":"2024-09-12T01:05:34.599856+0000","last_fullsized":"2024-09-12T01:05:34.599856+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.602778+0000","last_change":"2024-09-12T00:38:10.718025+0000","last_active":"2024-09-12T01:03:59.602778+0000","last_peered":"2024-09-12T01:03:59.602778+0000","last_clean":"2024-09-12T01:03:59.602778+0000","last_became_active":"2024-09-12T00:38:10.717358+0000","last_became_peered":"2024-09-12T00:38:10.717358+0000","last_unstale":"2024-09-12T01:03:59.602778+0000","last_undegraded":"2024-09-12T01:03:59.602778+0000","last_fullsized":"2024-09-12T01:03:59.602778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:56.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.593987+0000","last_change":"2024-09-12T00:38:07.639460+0000","last_active":"2024-09-12T01:04:44.593987+0000","last_peered":"2024-09-12T01:04:44.593987+0000","last_clean":"2024-09-12T01:04:44.593987+0000","last_became_active":"2024-09-12T00:38:07.638712+0000","last_became_peered":"2024-09-12T00:38:07.638712+0000","last_unstale":"2024-09-12T01:04:44.593987+0000","last_undegraded":"2024-09-12T01:04:44.593987+0000","last_fullsized":"2024-09-12T01:04:44.593987+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:01.987566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'20","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.646910+0000","last_change":"2024-09-12T00:36:37.224823+0000","last_active":"2024-09-12T01:03:20.646910+0000","last_peered":"2024-09-12T01:03:20.646910+0000","last_clean":"2024-09-12T01:03:20.646910+0000","last_became_active":"2024-09-12T00:36:37.223487+0000","last_became_peered":"2024-09-12T00:36:37.223487+0000","last_unstale":"2024-09-12T01:03:20.646910+0000","last_undegraded":"2024-09-12T01:03:20.646910+0000","last_fullsized":"2024-09-12T01:03:20.646910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.907220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":70,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.765888+0000","last_change":"2024-09-12T00:49:10.612000+0000","last_active":"2024-09-12T01:05:29.765888+0000","last_peered":"2024-09-12T01:05:29.765888+0000","last_clean":"2024-09-12T01:05:29.765888+0000","last_became_active":"2024-09-12T00:49:10.611251+0000","last_became_peered":"2024-09-12T00:49:10.611251+0000","last_unstale":"2024-09-12T01:05:29.765888+0000","last_undegraded":"2024-09-12T01:05:29.765888+0000","last_fullsized":"2024-09-12T01:05:29.765888+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.558277+0000","last_change":"2024-09-12T00:38:10.707668+0000","last_active":"2024-09-12T01:07:26.558277+0000","last_peered":"2024-09-12T01:07:26.558277+0000","last_clean":"2024-09-12T01:07:26.558277+0000","last_became_active":"2024-09-12T00:38:10.706726+0000","last_became_peered":"2024-09-12T00:38:10.706726+0000","last_unstale":"2024-09-12T01:07:26.558277+0000","last_undegraded":"2024-09-12T01:07:26.558277+0000","last_fullsized":"2024-09-12T01:07:26.558277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:45.954816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321211+0000","last_change":"2024-09-12T00:38:07.668470+0000","last_active":"2024-09-12T01:07:26.321211+0000","last_peered":"2024-09-12T01:07:26.321211+0000","last_clean":"2024-09-12T01:07:26.321211+0000","last_became_active":"2024-09-12T00:38:07.667724+0000","last_became_peered":"2024-09-12T00:38:07.667724+0000","last_unstale":"2024-09-12T01:07:26.321211+0000","last_undegraded":"2024-09-12T01:07:26.321211+0000","last_fullsized":"2024-09-12T01:07:26.321211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:20.409038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'49","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.780052+0000","last_change":"2024-09-12T00:36:37.244938+0000","last_active":"2024-09-12T01:04:57.780052+0000","last_peered":"2024-09-12T01:04:57.780052+0000","last_clean":"2024-09-12T01:04:57.780052+0000","last_became_active":"2024-09-12T00:36:37.244259+0000","last_became_peered":"2024-09-12T00:36:37.244259+0000","last_unstale":"2024-09-12T01:04:57.780052+0000","last_undegraded":"2024-09-12T01:04:57.780052+0000","last_fullsized":"2024-09-12T01:04:57.780052+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.194885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":182,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.605798+0000","last_change":"2024-09-12T00:49:10.630411+0000","last_active":"2024-09-12T01:05:34.605798+0000","last_peered":"2024-09-12T01:05:34.605798+0000","last_clean":"2024-09-12T01:05:34.605798+0000","last_became_active":"2024-09-12T00:49:10.629746+0000","last_became_peered":"2024-09-12T00:49:10.629746+0000","last_unstale":"2024-09-12T01:05:34.605798+0000","last_undegraded":"2024-09-12T01:05:34.605798+0000","last_fullsized":"2024-09-12T01:05:34.605798+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:14.423894+0000","last_change":"2024-09-12T00:38:10.696938+0000","last_active":"2024-09-12T01:07:14.423894+0000","last_peered":"2024-09-12T01:07:14.423894+0000","last_clean":"2024-09-12T01:07:14.423894+0000","last_became_active":"2024-09-12T00:38:10.695688+0000","last_became_peered":"2024-09-12T00:38:10.695688+0000","last_unstale":"2024-09-12T01:07:14.423894+0000","last_undegraded":"2024-09-12T01:07:14.423894+0000","last_fullsized":"2024-09-12T01:07:14.423894+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:07.485587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.614081+0000","last_change":"2024-09-12T00:38:07.647799+0000","last_active":"2024-09-12T01:04:44.614081+0000","last_peered":"2024-09-12T01:04:44.614081+0000","last_clean":"2024-09-12T01:04:44.614081+0000","last_became_active":"2024-09-12T00:38:07.645284+0000","last_became_peered":"2024-09-12T00:38:07.645284+0000","last_unstale":"2024-09-12T01:04:44.614081+0000","last_undegraded":"2024-09-12T01:04:44.614081+0000","last_fullsized":"2024-09-12T01:04:44.614081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:30.146339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.633189+0000","last_change":"2024-09-12T00:36:37.221009+0000","last_active":"2024-09-12T01:04:44.633189+0000","last_peered":"2024-09-12T01:04:44.633189+0000","last_clean":"2024-09-12T01:04:44.633189+0000","last_became_active":"2024-09-12T00:36:37.220195+0000","last_became_peered":"2024-09-12T00:36:37.220195+0000","last_unstale":"2024-09-12T01:04:44.633189+0000","last_undegraded":"2024-09-12T01:04:44.633189+0000","last_fullsized":"2024-09-12T01:04:44.633189+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:56.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":108,"num_write":45,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.599208+0000","last_change":"2024-09-12T00:49:10.615352+0000","last_active":"2024-09-12T01:03:44.599208+0000","last_peered":"2024-09-12T01:03:44.599208+0000","last_clean":"2024-09-12T01:03:44.599208+0000","last_became_active":"2024-09-12T00:49:10.614661+0000","last_became_peered":"2024-09-12T00:49:10.614661+0000","last_unstale":"2024-09-12T01:03:44.599208+0000","last_undegraded":"2024-09-12T01:03:44.599208+0000","last_fullsized":"2024-09-12T01:03:44.599208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:28.781007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'3","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:14.635619+0000","last_change":"2024-09-12T00:38:10.704123+0000","last_active":"2024-09-12T01:06:14.635619+0000","last_peered":"2024-09-12T01:06:14.635619+0000","last_clean":"2024-09-12T01:06:14.635619+0000","last_became_active":"2024-09-12T00:38:10.702260+0000","last_became_peered":"2024-09-12T00:38:10.702260+0000","last_unstale":"2024-09-12T01:06:14.635619+0000","last_undegraded":"2024-09-12T01:06:14.635619+0000","last_fullsized":"2024-09-12T01:06:14.635619+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:52.661395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763803+0000","last_change":"2024-09-12T00:38:07.640472+0000","last_active":"2024-09-12T01:03:49.763803+0000","last_peered":"2024-09-12T01:03:49.763803+0000","last_clean":"2024-09-12T01:03:49.763803+0000","last_became_active":"2024-09-12T00:38:07.639687+0000","last_became_peered":"2024-09-12T00:38:07.639687+0000","last_unstale":"2024-09-12T01:03:49.763803+0000","last_undegraded":"2024-09-12T01:03:49.763803+0000","last_fullsized":"2024-09-12T01:03:49.763803+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:58.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'52","reported_seq":183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.631949+0000","last_change":"2024-09-12T00:36:37.241171+0000","last_active":"2024-09-12T01:04:39.631949+0000","last_peered":"2024-09-12T01:04:39.631949+0000","last_clean":"2024-09-12T01:04:39.631949+0000","last_became_active":"2024-09-12T00:36:37.239844+0000","last_became_peered":"2024-09-12T00:36:37.239844+0000","last_unstale":"2024-09-12T01:04:39.631949+0000","last_undegraded":"2024-09-12T01:04:39.631949+0000","last_fullsized":"2024-09-12T01:04:39.631949+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:34.727635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":188,"num_write":97,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574686+0000","last_change":"2024-09-12T00:49:10.632954+0000","last_active":"2024-09-12T01:03:44.574686+0000","last_peered":"2024-09-12T01:03:44.574686+0000","last_clean":"2024-09-12T01:03:44.574686+0000","last_became_active":"2024-09-12T00:49:10.632241+0000","last_became_peered":"2024-09-12T00:49:10.632241+0000","last_unstale":"2024-09-12T01:03:44.574686+0000","last_undegraded":"2024-09-12T01:03:44.574686+0000","last_fullsized":"2024-09-12T01:03:44.574686+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:12.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"267'5","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:14.635438+0000","last_change":"2024-09-12T00:38:10.714497+0000","last_active":"2024-09-12T01:06:14.635438+0000","last_peered":"2024-09-12T01:06:14.635438+0000","last_clean":"2024-09-12T01:06:14.635438+0000","last_became_active":"2024-09-12T00:38:10.713890+0000","last_became_peered":"2024-09-12T00:38:10.713890+0000","last_unstale":"2024-09-12T01:06:14.635438+0000","last_undegraded":"2024-09-12T01:06:14.635438+0000","last_fullsized":"2024-09-12T01:06:14.635438+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.839866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600291+0000","last_change":"2024-09-12T00:38:07.667759+0000","last_active":"2024-09-12T01:03:49.600291+0000","last_peered":"2024-09-12T01:03:49.600291+0000","last_clean":"2024-09-12T01:03:49.600291+0000","last_became_active":"2024-09-12T00:38:07.667180+0000","last_became_peered":"2024-09-12T00:38:07.667180+0000","last_unstale":"2024-09-12T01:03:49.600291+0000","last_undegraded":"2024-09-12T01:03:49.600291+0000","last_fullsized":"2024-09-12T01:03:49.600291+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.515772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'23","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.592102+0000","last_change":"2024-09-12T00:36:37.253314+0000","last_active":"2024-09-12T01:04:38.592102+0000","last_peered":"2024-09-12T01:04:38.592102+0000","last_clean":"2024-09-12T01:04:38.592102+0000","last_became_active":"2024-09-12T00:36:37.248733+0000","last_became_peered":"2024-09-12T00:36:37.248733+0000","last_unstale":"2024-09-12T01:04:38.592102+0000","last_undegraded":"2024-09-12T01:04:38.592102+0000","last_fullsized":"2024-09-12T01:04:38.592102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.498855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.568017+0000","last_change":"2024-09-12T00:49:10.639305+0000","last_active":"2024-09-12T01:03:19.568017+0000","last_peered":"2024-09-12T01:03:19.568017+0000","last_clean":"2024-09-12T01:03:19.568017+0000","last_became_active":"2024-09-12T00:49:10.638628+0000","last_became_peered":"2024-09-12T00:49:10.638628+0000","last_unstale":"2024-09-12T01:03:19.568017+0000","last_undegraded":"2024-09-12T01:03:19.568017+0000","last_fullsized":"2024-09-12T01:03:19.568017+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:12.353339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.582007+0000","last_change":"2024-09-12T00:38:10.691801+0000","last_active":"2024-09-12T01:03:53.582007+0000","last_peered":"2024-09-12T01:03:53.582007+0000","last_clean":"2024-09-12T01:03:53.582007+0000","last_became_active":"2024-09-12T00:38:10.691129+0000","last_became_peered":"2024-09-12T00:38:10.691129+0000","last_unstale":"2024-09-12T01:03:53.582007+0000","last_undegraded":"2024-09-12T01:03:53.582007+0000","last_fullsized":"2024-09-12T01:03:53.582007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:27.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763900+0000","last_change":"2024-09-12T00:38:07.642523+0000","last_active":"2024-09-12T01:03:49.763900+0000","last_peered":"2024-09-12T01:03:49.763900+0000","last_clean":"2024-09-12T01:03:49.763900+0000","last_became_active":"2024-09-12T00:38:07.641719+0000","last_became_peered":"2024-09-12T00:38:07.641719+0000","last_unstale":"2024-09-12T01:03:49.763900+0000","last_undegraded":"2024-09-12T01:03:49.763900+0000","last_fullsized":"2024-09-12T01:03:49.763900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.330959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'60","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.754899+0000","last_change":"2024-09-12T00:36:37.224160+0000","last_active":"2024-09-12T01:04:39.754899+0000","last_peered":"2024-09-12T01:04:39.754899+0000","last_clean":"2024-09-12T01:04:39.754899+0000","last_became_active":"2024-09-12T00:36:37.223432+0000","last_became_peered":"2024-09-12T00:36:37.223432+0000","last_unstale":"2024-09-12T01:04:39.754899+0000","last_undegraded":"2024-09-12T01:04:39.754899+0000","last_fullsized":"2024-09-12T01:04:39.754899+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:13.061629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":212,"num_write":101,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574626+0000","last_change":"2024-09-12T00:49:10.635230+0000","last_active":"2024-09-12T01:03:44.574626+0000","last_peered":"2024-09-12T01:03:44.574626+0000","last_clean":"2024-09-12T01:03:44.574626+0000","last_became_active":"2024-09-12T00:49:10.634783+0000","last_became_peered":"2024-09-12T00:49:10.634783+0000","last_unstale":"2024-09-12T01:03:44.574626+0000","last_undegraded":"2024-09-12T01:03:44.574626+0000","last_fullsized":"2024-09-12T01:03:44.574626+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:22.424861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619873+0000","last_change":"2024-09-12T00:38:10.709528+0000","last_active":"2024-09-12T01:03:54.619873+0000","last_peered":"2024-09-12T01:03:54.619873+0000","last_clean":"2024-09-12T01:03:54.619873+0000","last_became_active":"2024-09-12T00:38:10.708687+0000","last_became_peered":"2024-09-12T00:38:10.708687+0000","last_unstale":"2024-09-12T01:03:54.619873+0000","last_undegraded":"2024-09-12T01:03:54.619873+0000","last_fullsized":"2024-09-12T01:03:54.619873+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.079976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.763955+0000","last_change":"2024-09-12T00:38:07.637056+0000","last_active":"2024-09-12T01:03:49.763955+0000","last_peered":"2024-09-12T01:03:49.763955+0000","last_clean":"2024-09-12T01:03:49.763955+0000","last_became_active":"2024-09-12T00:38:07.636298+0000","last_became_peered":"2024-09-12T00:38:07.636298+0000","last_unstale":"2024-09-12T01:03:49.763955+0000","last_undegraded":"2024-09-12T01:03:49.763955+0000","last_fullsized":"2024-09-12T01:03:49.763955+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.591991+0000","last_change":"2024-09-12T00:36:37.253687+0000","last_active":"2024-09-12T01:04:38.591991+0000","last_peered":"2024-09-12T01:04:38.591991+0000","last_clean":"2024-09-12T01:04:38.591991+0000","last_became_active":"2024-09-12T00:36:37.248770+0000","last_became_peered":"2024-09-12T00:36:37.248770+0000","last_unstale":"2024-09-12T01:04:38.591991+0000","last_undegraded":"2024-09-12T01:04:38.591991+0000","last_fullsized":"2024-09-12T01:04:38.591991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.878928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":141,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609918+0000","last_change":"2024-09-12T00:49:10.597538+0000","last_active":"2024-09-12T01:04:29.609918+0000","last_peered":"2024-09-12T01:04:29.609918+0000","last_clean":"2024-09-12T01:04:29.609918+0000","last_became_active":"2024-09-12T00:49:10.596695+0000","last_became_peered":"2024-09-12T00:49:10.596695+0000","last_unstale":"2024-09-12T01:04:29.609918+0000","last_undegraded":"2024-09-12T01:04:29.609918+0000","last_fullsized":"2024-09-12T01:04:29.609918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:51.074598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600399+0000","last_change":"2024-09-12T00:38:10.683836+0000","last_active":"2024-09-12T01:05:13.600399+0000","last_peered":"2024-09-12T01:05:13.600399+0000","last_clean":"2024-09-12T01:05:13.600399+0000","last_became_active":"2024-09-12T00:38:10.683024+0000","last_became_peered":"2024-09-12T00:38:10.683024+0000","last_unstale":"2024-09-12T01:05:13.600399+0000","last_undegraded":"2024-09-12T01:05:13.600399+0000","last_fullsized":"2024-09-12T01:05:13.600399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:08.556147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.761594+0000","last_change":"2024-09-12T00:38:07.664050+0000","last_active":"2024-09-12T01:05:09.761594+0000","last_peered":"2024-09-12T01:05:09.761594+0000","last_clean":"2024-09-12T01:05:09.761594+0000","last_became_active":"2024-09-12T00:38:07.663265+0000","last_became_peered":"2024-09-12T00:38:07.663265+0000","last_unstale":"2024-09-12T01:05:09.761594+0000","last_undegraded":"2024-09-12T01:05:09.761594+0000","last_fullsized":"2024-09-12T01:05:09.761594+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:28.984997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'15","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.579861+0000","last_change":"2024-09-12T00:36:37.248079+0000","last_active":"2024-09-12T01:03:43.579861+0000","last_peered":"2024-09-12T01:03:43.579861+0000","last_clean":"2024-09-12T01:03:43.579861+0000","last_became_active":"2024-09-12T00:36:37.247409+0000","last_became_peered":"2024-09-12T00:36:37.247409+0000","last_unstale":"2024-09-12T01:03:43.579861+0000","last_undegraded":"2024-09-12T01:03:43.579861+0000","last_fullsized":"2024-09-12T01:03:43.579861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:04.933898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":52,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.779758+0000","last_change":"2024-09-12T00:49:10.594239+0000","last_active":"2024-09-12T01:04:59.779758+0000","last_peered":"2024-09-12T01:04:59.779758+0000","last_clean":"2024-09-12T01:04:59.779758+0000","last_became_active":"2024-09-12T00:49:10.593471+0000","last_became_peered":"2024-09-12T00:49:10.593471+0000","last_unstale":"2024-09-12T01:04:59.779758+0000","last_undegraded":"2024-09-12T01:04:59.779758+0000","last_fullsized":"2024-09-12T01:04:59.779758+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:54.840220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"267'4","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321277+0000","last_change":"2024-09-12T00:38:10.709654+0000","last_active":"2024-09-12T01:07:26.321277+0000","last_peered":"2024-09-12T01:07:26.321277+0000","last_clean":"2024-09-12T01:07:26.321277+0000","last_became_active":"2024-09-12T00:38:10.708936+0000","last_became_peered":"2024-09-12T00:38:10.708936+0000","last_unstale":"2024-09-12T01:07:26.321277+0000","last_undegraded":"2024-09-12T01:07:26.321277+0000","last_fullsized":"2024-09-12T01:07:26.321277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:34.439374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'8","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321521+0000","last_change":"2024-09-12T00:38:07.651137+0000","last_active":"2024-09-12T01:07:26.321521+0000","last_peered":"2024-09-12T01:07:26.321521+0000","last_clean":"2024-09-12T01:07:26.321521+0000","last_became_active":"2024-09-12T00:38:07.650419+0000","last_became_peered":"2024-09-12T00:38:07.650419+0000","last_unstale":"2024-09-12T01:07:26.321521+0000","last_undegraded":"2024-09-12T01:07:26.321521+0000","last_fullsized":"2024-09-12T01:07:26.321521+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:32.557871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'98","reported_seq":352,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.615890+0000","last_change":"2024-09-12T00:36:37.227751+0000","last_active":"2024-09-12T01:03:39.615890+0000","last_peered":"2024-09-12T01:03:39.615890+0000","last_clean":"2024-09-12T01:03:39.615890+0000","last_became_active":"2024-09-12T00:36:37.225615+0000","last_became_peered":"2024-09-12T00:36:37.225615+0000","last_unstale":"2024-09-12T01:03:39.615890+0000","last_undegraded":"2024-09-12T01:03:39.615890+0000","last_fullsized":"2024-09-12T01:03:39.615890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:24.078167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":608,"num_read_kb":444,"num_write":119,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626251+0000","last_change":"2024-09-12T00:49:10.620839+0000","last_active":"2024-09-12T01:04:19.626251+0000","last_peered":"2024-09-12T01:04:19.626251+0000","last_clean":"2024-09-12T01:04:19.626251+0000","last_became_active":"2024-09-12T00:49:10.620169+0000","last_became_peered":"2024-09-12T00:49:10.620169+0000","last_unstale":"2024-09-12T01:04:19.626251+0000","last_undegraded":"2024-09-12T01:04:19.626251+0000","last_fullsized":"2024-09-12T01:04:19.626251+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.688639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.602083+0000","last_change":"2024-09-12T00:38:10.686990+0000","last_active":"2024-09-12T01:05:18.602083+0000","last_peered":"2024-09-12T01:05:18.602083+0000","last_clean":"2024-09-12T01:05:18.602083+0000","last_became_active":"2024-09-12T00:38:10.686216+0000","last_became_peered":"2024-09-12T00:38:10.686216+0000","last_unstale":"2024-09-12T01:05:18.602083+0000","last_undegraded":"2024-09-12T01:05:18.602083+0000","last_fullsized":"2024-09-12T01:05:18.602083+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"267'4","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.431292+0000","last_change":"2024-09-12T00:38:07.666660+0000","last_active":"2024-09-12T01:07:23.431292+0000","last_peered":"2024-09-12T01:07:23.431292+0000","last_clean":"2024-09-12T01:07:23.431292+0000","last_became_active":"2024-09-12T00:38:07.661932+0000","last_became_peered":"2024-09-12T00:38:07.661932+0000","last_unstale":"2024-09-12T01:07:23.431292+0000","last_undegraded":"2024-09-12T01:07:23.431292+0000","last_fullsized":"2024-09-12T01:07:23.431292+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:30.080552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'12","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.761390+0000","last_change":"2024-09-12T00:36:37.227779+0000","last_active":"2024-09-12T01:03:39.761390+0000","last_peered":"2024-09-12T01:03:39.761390+0000","last_clean":"2024-09-12T01:03:39.761390+0000","last_became_active":"2024-09-12T00:36:37.226992+0000","last_became_peered":"2024-09-12T00:36:37.226992+0000","last_unstale":"2024-09-12T01:03:39.761390+0000","last_undegraded":"2024-09-12T01:03:39.761390+0000","last_fullsized":"2024-09-12T01:03:39.761390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.657729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.771859+0000","last_change":"2024-09-12T00:49:10.598218+0000","last_active":"2024-09-12T01:04:24.771859+0000","last_peered":"2024-09-12T01:04:24.771859+0000","last_clean":"2024-09-12T01:04:24.771859+0000","last_became_active":"2024-09-12T00:49:10.597349+0000","last_became_peered":"2024-09-12T00:49:10.597349+0000","last_unstale":"2024-09-12T01:04:24.771859+0000","last_undegraded":"2024-09-12T01:04:24.771859+0000","last_fullsized":"2024-09-12T01:04:24.771859+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:32.342356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"267'11","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.114642+0000","last_change":"2024-09-12T00:38:10.701647+0000","last_active":"2024-09-12T01:07:26.114642+0000","last_peered":"2024-09-12T01:07:26.114642+0000","last_clean":"2024-09-12T01:07:26.114642+0000","last_became_active":"2024-09-12T00:38:10.700892+0000","last_became_peered":"2024-09-12T00:38:10.700892+0000","last_unstale":"2024-09-12T01:07:26.114642+0000","last_undegraded":"2024-09-12T01:07:26.114642+0000","last_fullsized":"2024-09-12T01:07:26.114642+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:36.388849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":16,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600506+0000","last_change":"2024-09-12T00:38:07.643675+0000","last_active":"2024-09-12T01:05:13.600506+0000","last_peered":"2024-09-12T01:05:13.600506+0000","last_clean":"2024-09-12T01:05:13.600506+0000","last_became_active":"2024-09-12T00:38:07.642924+0000","last_became_peered":"2024-09-12T00:38:07.642924+0000","last_unstale":"2024-09-12T01:05:13.600506+0000","last_undegraded":"2024-09-12T01:05:13.600506+0000","last_fullsized":"2024-09-12T01:05:13.600506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:03.027647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'31","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573415+0000","last_change":"2024-09-12T00:36:37.243786+0000","last_active":"2024-09-12T01:03:39.573415+0000","last_peered":"2024-09-12T01:03:39.573415+0000","last_clean":"2024-09-12T01:03:39.573415+0000","last_became_active":"2024-09-12T00:36:37.238481+0000","last_became_peered":"2024-09-12T00:36:37.238481+0000","last_unstale":"2024-09-12T01:03:39.573415+0000","last_undegraded":"2024-09-12T01:03:39.573415+0000","last_fullsized":"2024-09-12T01:03:39.573415+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:15.555438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":121,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.617607+0000","last_change":"2024-09-12T00:49:10.614315+0000","last_active":"2024-09-12T01:04:59.617607+0000","last_peered":"2024-09-12T01:04:59.617607+0000","last_clean":"2024-09-12T01:04:59.617607+0000","last_became_active":"2024-09-12T00:49:10.613613+0000","last_became_peered":"2024-09-12T00:49:10.613613+0000","last_unstale":"2024-09-12T01:04:59.617607+0000","last_undegraded":"2024-09-12T01:04:59.617607+0000","last_fullsized":"2024-09-12T01:04:59.617607+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:45.422915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.257884+0000","last_change":"2024-09-12T00:38:10.695438+0000","last_active":"2024-09-12T01:07:26.257884+0000","last_peered":"2024-09-12T01:07:26.257884+0000","last_clean":"2024-09-12T01:07:26.257884+0000","last_became_active":"2024-09-12T00:38:10.694714+0000","last_became_peered":"2024-09-12T00:38:10.694714+0000","last_unstale":"2024-09-12T01:07:26.257884+0000","last_undegraded":"2024-09-12T01:07:26.257884+0000","last_fullsized":"2024-09-12T01:07:26.257884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:46.770976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852962+0000","last_change":"2024-09-12T00:38:07.653886+0000","last_active":"2024-09-12T01:07:25.852962+0000","last_peered":"2024-09-12T01:07:25.852962+0000","last_clean":"2024-09-12T01:07:25.852962+0000","last_became_active":"2024-09-12T00:38:07.647225+0000","last_became_peered":"2024-09-12T00:38:07.647225+0000","last_unstale":"2024-09-12T01:07:25.852962+0000","last_undegraded":"2024-09-12T01:07:25.852962+0000","last_fullsized":"2024-09-12T01:07:25.852962+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:14.958030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'12","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.573328+0000","last_change":"2024-09-12T00:36:37.249508+0000","last_active":"2024-09-12T01:03:39.573328+0000","last_peered":"2024-09-12T01:03:39.573328+0000","last_clean":"2024-09-12T01:03:39.573328+0000","last_became_active":"2024-09-12T00:36:37.246075+0000","last_became_peered":"2024-09-12T00:36:37.246075+0000","last_unstale":"2024-09-12T01:03:39.573328+0000","last_undegraded":"2024-09-12T01:03:39.573328+0000","last_fullsized":"2024-09-12T01:03:39.573328+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:45.712512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.759397+0000","last_change":"2024-09-12T00:49:10.598511+0000","last_active":"2024-09-12T01:04:59.759397+0000","last_peered":"2024-09-12T01:04:59.759397+0000","last_clean":"2024-09-12T01:04:59.759397+0000","last_became_active":"2024-09-12T00:49:10.597773+0000","last_became_peered":"2024-09-12T00:49:10.597773+0000","last_unstale":"2024-09-12T01:04:59.759397+0000","last_undegraded":"2024-09-12T01:04:59.759397+0000","last_fullsized":"2024-09-12T01:04:59.759397+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:51.989977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.782946+0000","last_change":"2024-09-12T00:38:10.698369+0000","last_active":"2024-09-12T01:07:25.782946+0000","last_peered":"2024-09-12T01:07:25.782946+0000","last_clean":"2024-09-12T01:07:25.782946+0000","last_became_active":"2024-09-12T00:38:10.697403+0000","last_became_peered":"2024-09-12T00:38:10.697403+0000","last_unstale":"2024-09-12T01:07:25.782946+0000","last_undegraded":"2024-09-12T01:07:25.782946+0000","last_fullsized":"2024-09-12T01:07:25.782946+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:19.999588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:19.636825+0000","last_change":"2024-09-12T00:38:07.668475+0000","last_active":"2024-09-12T01:06:19.636825+0000","last_peered":"2024-09-12T01:06:19.636825+0000","last_clean":"2024-09-12T01:06:19.636825+0000","last_became_active":"2024-09-12T00:38:07.667447+0000","last_became_peered":"2024-09-12T00:38:07.667447+0000","last_unstale":"2024-09-12T01:06:19.636825+0000","last_undegraded":"2024-09-12T01:06:19.636825+0000","last_fullsized":"2024-09-12T01:06:19.636825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:23.306315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.758150+0000","last_change":"2024-09-12T00:36:37.240933+0000","last_active":"2024-09-12T01:04:54.758150+0000","last_peered":"2024-09-12T01:04:54.758150+0000","last_clean":"2024-09-12T01:04:54.758150+0000","last_became_active":"2024-09-12T00:36:37.239946+0000","last_became_peered":"2024-09-12T00:36:37.239946+0000","last_unstale":"2024-09-12T01:04:54.758150+0000","last_undegraded":"2024-09-12T01:04:54.758150+0000","last_fullsized":"2024-09-12T01:04:54.758150+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:57.116646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.597511+0000","last_change":"2024-09-12T00:49:10.630825+0000","last_active":"2024-09-12T01:04:59.597511+0000","last_peered":"2024-09-12T01:04:59.597511+0000","last_clean":"2024-09-12T01:04:59.597511+0000","last_became_active":"2024-09-12T00:49:10.629903+0000","last_became_peered":"2024-09-12T00:49:10.629903+0000","last_unstale":"2024-09-12T01:04:59.597511+0000","last_undegraded":"2024-09-12T01:04:59.597511+0000","last_fullsized":"2024-09-12T01:04:59.597511+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:07.324326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.815403+0000","last_change":"2024-09-12T00:38:10.714505+0000","last_active":"2024-09-12T01:07:26.815403+0000","last_peered":"2024-09-12T01:07:26.815403+0000","last_clean":"2024-09-12T01:07:26.815403+0000","last_became_active":"2024-09-12T00:38:10.708820+0000","last_became_peered":"2024-09-12T00:38:10.708820+0000","last_unstale":"2024-09-12T01:07:26.815403+0000","last_undegraded":"2024-09-12T01:07:26.815403+0000","last_fullsized":"2024-09-12T01:07:26.815403+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:21.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'2","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:28.418371+0000","last_change":"2024-09-12T00:38:07.645572+0000","last_active":"2024-09-12T01:06:28.418371+0000","last_peered":"2024-09-12T01:06:28.418371+0000","last_clean":"2024-09-12T01:06:28.418371+0000","last_became_active":"2024-09-12T00:38:07.644752+0000","last_became_peered":"2024-09-12T00:38:07.644752+0000","last_unstale":"2024-09-12T01:06:28.418371+0000","last_undegraded":"2024-09-12T01:06:28.418371+0000","last_fullsized":"2024-09-12T01:06:28.418371+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:27.156732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"267'56","reported_seq":202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.615105+0000","last_change":"2024-09-12T00:36:37.247146+0000","last_active":"2024-09-12T01:04:49.615105+0000","last_peered":"2024-09-12T01:04:49.615105+0000","last_clean":"2024-09-12T01:04:49.615105+0000","last_became_active":"2024-09-12T00:36:37.246402+0000","last_became_peered":"2024-09-12T00:36:37.246402+0000","last_unstale":"2024-09-12T01:04:49.615105+0000","last_undegraded":"2024-09-12T01:04:49.615105+0000","last_fullsized":"2024-09-12T01:04:49.615105+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:50.978182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":211,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.597068+0000","last_change":"2024-09-12T00:49:10.627636+0000","last_active":"2024-09-12T01:04:58.597068+0000","last_peered":"2024-09-12T01:04:58.597068+0000","last_clean":"2024-09-12T01:04:58.597068+0000","last_became_active":"2024-09-12T00:49:10.626918+0000","last_became_peered":"2024-09-12T00:49:10.626918+0000","last_unstale":"2024-09-12T01:04:58.597068+0000","last_undegraded":"2024-09-12T01:04:58.597068+0000","last_fullsized":"2024-09-12T01:04:58.597068+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.462430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"267'7","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:34.416564+0000","last_change":"2024-09-12T00:38:10.706342+0000","last_active":"2024-09-12T01:06:34.416564+0000","last_peered":"2024-09-12T01:06:34.416564+0000","last_clean":"2024-09-12T01:06:34.416564+0000","last_became_active":"2024-09-12T00:38:10.705817+0000","last_became_peered":"2024-09-12T00:38:10.705817+0000","last_unstale":"2024-09-12T01:06:34.416564+0000","last_undegraded":"2024-09-12T01:06:34.416564+0000","last_fullsized":"2024-09-12T01:06:34.416564+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:39.296427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:24.428685+0000","last_change":"2024-09-12T00:38:07.655064+0000","last_active":"2024-09-12T01:07:24.428685+0000","last_peered":"2024-09-12T01:07:24.428685+0000","last_clean":"2024-09-12T01:07:24.428685+0000","last_became_active":"2024-09-12T00:38:07.654306+0000","last_became_peered":"2024-09-12T00:38:07.654306+0000","last_unstale":"2024-09-12T01:07:24.428685+0000","last_undegraded":"2024-09-12T01:07:24.428685+0000","last_fullsized":"2024-09-12T01:07:24.428685+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:13.318498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'60","reported_seq":249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.594897+0000","last_change":"2024-09-12T00:36:37.227571+0000","last_active":"2024-09-12T01:04:49.594897+0000","last_peered":"2024-09-12T01:04:49.594897+0000","last_clean":"2024-09-12T01:04:49.594897+0000","last_became_active":"2024-09-12T00:36:37.226845+0000","last_became_peered":"2024-09-12T00:36:37.226845+0000","last_unstale":"2024-09-12T01:04:49.594897+0000","last_undegraded":"2024-09-12T01:04:49.594897+0000","last_fullsized":"2024-09-12T01:04:49.594897+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.611933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":408,"num_read_kb":294,"num_write":66,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582015+0000","last_change":"2024-09-12T00:49:10.623449+0000","last_active":"2024-09-12T01:03:49.582015+0000","last_peered":"2024-09-12T01:03:49.582015+0000","last_clean":"2024-09-12T01:03:49.582015+0000","last_became_active":"2024-09-12T00:49:10.615566+0000","last_became_peered":"2024-09-12T00:49:10.615566+0000","last_unstale":"2024-09-12T01:03:49.582015+0000","last_undegraded":"2024-09-12T01:03:49.582015+0000","last_fullsized":"2024-09-12T01:03:49.582015+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:25.428504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'7","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.115026+0000","last_change":"2024-09-12T00:38:10.705943+0000","last_active":"2024-09-12T01:07:26.115026+0000","last_peered":"2024-09-12T01:07:26.115026+0000","last_clean":"2024-09-12T01:07:26.115026+0000","last_became_active":"2024-09-12T00:38:10.705207+0000","last_became_peered":"2024-09-12T00:38:10.705207+0000","last_unstale":"2024-09-12T01:07:26.115026+0000","last_undegraded":"2024-09-12T01:07:26.115026+0000","last_fullsized":"2024-09-12T01:07:26.115026+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:44.933546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'11","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852138+0000","last_change":"2024-09-12T00:38:07.663618+0000","last_active":"2024-09-12T01:07:25.852138+0000","last_peered":"2024-09-12T01:07:25.852138+0000","last_clean":"2024-09-12T01:07:25.852138+0000","last_became_active":"2024-09-12T00:38:07.663031+0000","last_became_peered":"2024-09-12T00:38:07.663031+0000","last_unstale":"2024-09-12T01:07:25.852138+0000","last_undegraded":"2024-09-12T01:07:25.852138+0000","last_fullsized":"2024-09-12T01:07:25.852138+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.928917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24578,"num_write":26,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'40","reported_seq":152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.587717+0000","last_change":"2024-09-12T00:36:37.251472+0000","last_active":"2024-09-12T01:04:49.587717+0000","last_peered":"2024-09-12T01:04:49.587717+0000","last_clean":"2024-09-12T01:04:49.587717+0000","last_became_active":"2024-09-12T00:36:37.250649+0000","last_became_peered":"2024-09-12T00:36:37.250649+0000","last_unstale":"2024-09-12T01:04:49.587717+0000","last_undegraded":"2024-09-12T01:04:49.587717+0000","last_fullsized":"2024-09-12T01:04:49.587717+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:22.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":70,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.582037+0000","last_change":"2024-09-12T00:49:10.634985+0000","last_active":"2024-09-12T01:03:49.582037+0000","last_peered":"2024-09-12T01:03:49.582037+0000","last_clean":"2024-09-12T01:03:49.582037+0000","last_became_active":"2024-09-12T00:49:10.634433+0000","last_became_peered":"2024-09-12T00:49:10.634433+0000","last_unstale":"2024-09-12T01:03:49.582037+0000","last_undegraded":"2024-09-12T01:03:49.582037+0000","last_fullsized":"2024-09-12T01:03:49.582037+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:02.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622352+0000","last_change":"2024-09-12T00:38:10.718774+0000","last_active":"2024-09-12T01:05:19.622352+0000","last_peered":"2024-09-12T01:05:19.622352+0000","last_clean":"2024-09-12T01:05:19.622352+0000","last_became_active":"2024-09-12T00:38:10.717307+0000","last_became_peered":"2024-09-12T00:38:10.717307+0000","last_unstale":"2024-09-12T01:05:19.622352+0000","last_undegraded":"2024-09-12T01:05:19.622352+0000","last_fullsized":"2024-09-12T01:05:19.622352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:10.837950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'10","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.523588+0000","last_change":"2024-09-12T00:38:07.660476+0000","last_active":"2024-09-12T01:07:27.523588+0000","last_peered":"2024-09-12T01:07:27.523588+0000","last_clean":"2024-09-12T01:07:27.523588+0000","last_became_active":"2024-09-12T00:38:07.659692+0000","last_became_peered":"2024-09-12T00:38:07.659692+0000","last_unstale":"2024-09-12T01:07:27.523588+0000","last_undegraded":"2024-09-12T01:07:27.523588+0000","last_fullsized":"2024-09-12T01:07:27.523588+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:05.518531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'22","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.817272+0000","last_change":"2024-09-12T00:36:37.228455+0000","last_active":"2024-09-12T01:05:02.817272+0000","last_peered":"2024-09-12T01:05:02.817272+0000","last_clean":"2024-09-12T01:05:02.817272+0000","last_became_active":"2024-09-12T00:36:37.226892+0000","last_became_peered":"2024-09-12T00:36:37.226892+0000","last_unstale":"2024-09-12T01:05:02.817272+0000","last_undegraded":"2024-09-12T01:05:02.817272+0000","last_fullsized":"2024-09-12T01:05:02.817272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:09.675401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622226+0000","last_change":"2024-09-12T00:49:10.632589+0000","last_active":"2024-09-12T01:05:19.622226+0000","last_peered":"2024-09-12T01:05:19.622226+0000","last_clean":"2024-09-12T01:05:19.622226+0000","last_became_active":"2024-09-12T00:49:10.631961+0000","last_became_peered":"2024-09-12T00:49:10.631961+0000","last_unstale":"2024-09-12T01:05:19.622226+0000","last_undegraded":"2024-09-12T01:05:19.622226+0000","last_fullsized":"2024-09-12T01:05:19.622226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:28.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'2","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:24.415112+0000","last_change":"2024-09-12T00:38:10.719998+0000","last_active":"2024-09-12T01:06:24.415112+0000","last_peered":"2024-09-12T01:06:24.415112+0000","last_clean":"2024-09-12T01:06:24.415112+0000","last_became_active":"2024-09-12T00:38:10.719337+0000","last_became_peered":"2024-09-12T00:38:10.719337+0000","last_unstale":"2024-09-12T01:06:24.415112+0000","last_undegraded":"2024-09-12T01:06:24.415112+0000","last_fullsized":"2024-09-12T01:06:24.415112+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:16.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"267'7","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:19.777203+0000","last_change":"2024-09-12T00:38:07.640549+0000","last_active":"2024-09-12T01:06:19.777203+0000","last_peered":"2024-09-12T01:06:19.777203+0000","last_clean":"2024-09-12T01:06:19.777203+0000","last_became_active":"2024-09-12T00:38:07.639751+0000","last_became_peered":"2024-09-12T00:38:07.639751+0000","last_unstale":"2024-09-12T01:06:19.777203+0000","last_undegraded":"2024-09-12T01:06:19.777203+0000","last_fullsized":"2024-09-12T01:06:19.777203+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:17.815510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'40","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.743281+0000","last_change":"2024-09-12T00:36:37.248750+0000","last_active":"2024-09-12T01:03:49.743281+0000","last_peered":"2024-09-12T01:03:49.743281+0000","last_clean":"2024-09-12T01:03:49.743281+0000","last_became_active":"2024-09-12T00:36:37.248176+0000","last_became_peered":"2024-09-12T00:36:37.248176+0000","last_unstale":"2024-09-12T01:03:49.743281+0000","last_undegraded":"2024-09-12T01:03:49.743281+0000","last_fullsized":"2024-09-12T01:03:49.743281+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.812968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.649578+0000","last_change":"2024-09-12T00:49:10.635581+0000","last_active":"2024-09-12T01:05:49.649578+0000","last_peered":"2024-09-12T01:05:49.649578+0000","last_clean":"2024-09-12T01:05:49.649578+0000","last_became_active":"2024-09-12T00:49:10.634965+0000","last_became_peered":"2024-09-12T00:49:10.634965+0000","last_unstale":"2024-09-12T01:05:49.649578+0000","last_undegraded":"2024-09-12T01:05:49.649578+0000","last_fullsized":"2024-09-12T01:05:49.649578+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:24.416191+0000","last_change":"2024-09-12T00:38:10.695802+0000","last_active":"2024-09-12T01:06:24.416191+0000","last_peered":"2024-09-12T01:06:24.416191+0000","last_clean":"2024-09-12T01:06:24.416191+0000","last_became_active":"2024-09-12T00:38:10.694812+0000","last_became_peered":"2024-09-12T00:38:10.694812+0000","last_unstale":"2024-09-12T01:06:24.416191+0000","last_undegraded":"2024-09-12T01:06:24.416191+0000","last_fullsized":"2024-09-12T01:06:24.416191+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:47.266227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'6","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321457+0000","last_change":"2024-09-12T00:38:07.648782+0000","last_active":"2024-09-12T01:07:26.321457+0000","last_peered":"2024-09-12T01:07:26.321457+0000","last_clean":"2024-09-12T01:07:26.321457+0000","last_became_active":"2024-09-12T00:38:07.648061+0000","last_became_peered":"2024-09-12T00:38:07.648061+0000","last_unstale":"2024-09-12T01:07:26.321457+0000","last_undegraded":"2024-09-12T01:07:26.321457+0000","last_fullsized":"2024-09-12T01:07:26.321457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:11.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'35","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:48.609166+0000","last_change":"2024-09-12T00:36:37.244821+0000","last_active":"2024-09-12T01:05:48.609166+0000","last_peered":"2024-09-12T01:05:48.609166+0000","last_clean":"2024-09-12T01:05:48.609166+0000","last_became_active":"2024-09-12T00:36:37.244096+0000","last_became_peered":"2024-09-12T00:36:37.244096+0000","last_unstale":"2024-09-12T01:05:48.609166+0000","last_undegraded":"2024-09-12T01:05:48.609166+0000","last_fullsized":"2024-09-12T01:05:48.609166+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":53,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:23.588773+0000","last_change":"2024-09-12T00:49:10.626675+0000","last_active":"2024-09-12T01:04:23.588773+0000","last_peered":"2024-09-12T01:04:23.588773+0000","last_clean":"2024-09-12T01:04:23.588773+0000","last_became_active":"2024-09-12T00:49:10.621968+0000","last_became_peered":"2024-09-12T00:49:10.621968+0000","last_unstale":"2024-09-12T01:04:23.588773+0000","last_undegraded":"2024-09-12T01:04:23.588773+0000","last_fullsized":"2024-09-12T01:04:23.588773+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.338078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594658+0000","last_change":"2024-09-12T00:38:10.718573+0000","last_active":"2024-09-12T01:05:19.594658+0000","last_peered":"2024-09-12T01:05:19.594658+0000","last_clean":"2024-09-12T01:05:19.594658+0000","last_became_active":"2024-09-12T00:38:10.717877+0000","last_became_peered":"2024-09-12T00:38:10.717877+0000","last_unstale":"2024-09-12T01:05:19.594658+0000","last_undegraded":"2024-09-12T01:05:19.594658+0000","last_fullsized":"2024-09-12T01:05:19.594658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:53.348539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"267'5","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852871+0000","last_change":"2024-09-12T00:38:07.649510+0000","last_active":"2024-09-12T01:07:25.852871+0000","last_peered":"2024-09-12T01:07:25.852871+0000","last_clean":"2024-09-12T01:07:25.852871+0000","last_became_active":"2024-09-12T00:38:07.648786+0000","last_became_peered":"2024-09-12T00:38:07.648786+0000","last_unstale":"2024-09-12T01:07:25.852871+0000","last_undegraded":"2024-09-12T01:07:25.852871+0000","last_fullsized":"2024-09-12T01:07:25.852871+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:57.221376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.770566+0000","last_change":"2024-09-12T00:36:37.238021+0000","last_active":"2024-09-12T01:05:49.770566+0000","last_peered":"2024-09-12T01:05:49.770566+0000","last_clean":"2024-09-12T01:05:49.770566+0000","last_became_active":"2024-09-12T00:36:37.237365+0000","last_became_peered":"2024-09-12T00:36:37.237365+0000","last_unstale":"2024-09-12T01:05:49.770566+0000","last_undegraded":"2024-09-12T01:05:49.770566+0000","last_fullsized":"2024-09-12T01:05:49.770566+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":152,"num_write":73,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.582095+0000","last_change":"2024-09-12T00:49:10.628791+0000","last_active":"2024-09-12T01:04:24.582095+0000","last_peered":"2024-09-12T01:04:24.582095+0000","last_clean":"2024-09-12T01:04:24.582095+0000","last_became_active":"2024-09-12T00:49:10.628111+0000","last_became_peered":"2024-09-12T00:49:10.628111+0000","last_unstale":"2024-09-12T01:04:24.582095+0000","last_undegraded":"2024-09-12T01:04:24.582095+0000","last_fullsized":"2024-09-12T01:04:24.582095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.022373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'6","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.186406+0000","last_change":"2024-09-12T00:38:10.702362+0000","last_active":"2024-09-12T01:07:26.186406+0000","last_peered":"2024-09-12T01:07:26.186406+0000","last_clean":"2024-09-12T01:07:26.186406+0000","last_became_active":"2024-09-12T00:38:10.696553+0000","last_became_peered":"2024-09-12T00:38:10.696553+0000","last_unstale":"2024-09-12T01:07:26.186406+0000","last_undegraded":"2024-09-12T01:07:26.186406+0000","last_fullsized":"2024-09-12T01:07:26.186406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:21.987094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3168,"num_write":6,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'4","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:19.427237+0000","last_change":"2024-09-12T00:38:07.670741+0000","last_active":"2024-09-12T01:07:19.427237+0000","last_peered":"2024-09-12T01:07:19.427237+0000","last_clean":"2024-09-12T01:07:19.427237+0000","last_became_active":"2024-09-12T00:38:07.669959+0000","last_became_peered":"2024-09-12T00:38:07.669959+0000","last_unstale":"2024-09-12T01:07:19.427237+0000","last_undegraded":"2024-09-12T01:07:19.427237+0000","last_fullsized":"2024-09-12T01:07:19.427237+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:21.025381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.649720+0000","last_change":"2024-09-12T00:36:37.229680+0000","last_active":"2024-09-12T01:05:49.649720+0000","last_peered":"2024-09-12T01:05:49.649720+0000","last_clean":"2024-09-12T01:05:49.649720+0000","last_became_active":"2024-09-12T00:36:37.228954+0000","last_became_peered":"2024-09-12T00:36:37.228954+0000","last_unstale":"2024-09-12T01:05:49.649720+0000","last_undegraded":"2024-09-12T01:05:49.649720+0000","last_fullsized":"2024-09-12T01:05:49.649720+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600391+0000","last_change":"2024-09-12T00:49:10.593501+0000","last_active":"2024-09-12T01:03:49.600391+0000","last_peered":"2024-09-12T01:03:49.600391+0000","last_clean":"2024-09-12T01:03:49.600391+0000","last_became_active":"2024-09-12T00:49:10.592753+0000","last_became_peered":"2024-09-12T00:49:10.592753+0000","last_unstale":"2024-09-12T01:03:49.600391+0000","last_undegraded":"2024-09-12T01:03:49.600391+0000","last_fullsized":"2024-09-12T01:03:49.600391+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:14.659960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763857+0000","last_change":"2024-09-12T00:38:10.703751+0000","last_active":"2024-09-12T01:05:19.763857+0000","last_peered":"2024-09-12T01:05:19.763857+0000","last_clean":"2024-09-12T01:05:19.763857+0000","last_became_active":"2024-09-12T00:38:10.702958+0000","last_became_peered":"2024-09-12T00:38:10.702958+0000","last_unstale":"2024-09-12T01:05:19.763857+0000","last_undegraded":"2024-09-12T01:05:19.763857+0000","last_fullsized":"2024-09-12T01:05:19.763857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:12.605629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.595391+0000","last_change":"2024-09-12T00:38:07.650713+0000","last_active":"2024-09-12T01:05:14.595391+0000","last_peered":"2024-09-12T01:05:14.595391+0000","last_clean":"2024-09-12T01:05:14.595391+0000","last_became_active":"2024-09-12T00:38:07.650035+0000","last_became_peered":"2024-09-12T00:38:07.650035+0000","last_unstale":"2024-09-12T01:05:14.595391+0000","last_undegraded":"2024-09-12T01:05:14.595391+0000","last_fullsized":"2024-09-12T01:05:14.595391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.848243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"258'11","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.649623+0000","last_change":"2024-09-12T00:36:37.223313+0000","last_active":"2024-09-12T01:05:49.649623+0000","last_peered":"2024-09-12T01:05:49.649623+0000","last_clean":"2024-09-12T01:05:49.649623+0000","last_became_active":"2024-09-12T00:36:37.222545+0000","last_became_peered":"2024-09-12T00:36:37.222545+0000","last_unstale":"2024-09-12T01:05:49.649623+0000","last_undegraded":"2024-09-12T01:05:49.649623+0000","last_fullsized":"2024-09-12T01:05:49.649623+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618658+0000","last_change":"2024-09-12T00:49:10.613325+0000","last_active":"2024-09-12T01:03:49.618658+0000","last_peered":"2024-09-12T01:03:49.618658+0000","last_clean":"2024-09-12T01:03:49.618658+0000","last_became_active":"2024-09-12T00:49:10.612680+0000","last_became_peered":"2024-09-12T00:49:10.612680+0000","last_unstale":"2024-09-12T01:03:49.618658+0000","last_undegraded":"2024-09-12T01:03:49.618658+0000","last_fullsized":"2024-09-12T01:03:49.618658+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.686773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.763779+0000","last_change":"2024-09-12T00:38:10.698273+0000","last_active":"2024-09-12T01:05:19.763779+0000","last_peered":"2024-09-12T01:05:19.763779+0000","last_clean":"2024-09-12T01:05:19.763779+0000","last_became_active":"2024-09-12T00:38:10.691107+0000","last_became_peered":"2024-09-12T00:38:10.691107+0000","last_unstale":"2024-09-12T01:05:19.763779+0000","last_undegraded":"2024-09-12T01:05:19.763779+0000","last_fullsized":"2024-09-12T01:05:19.763779+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.535876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"267'6","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.320162+0000","last_change":"2024-09-12T00:38:07.657937+0000","last_active":"2024-09-12T01:07:26.320162+0000","last_peered":"2024-09-12T01:07:26.320162+0000","last_clean":"2024-09-12T01:07:26.320162+0000","last_became_active":"2024-09-12T00:38:07.657155+0000","last_became_peered":"2024-09-12T00:38:07.657155+0000","last_unstale":"2024-09-12T01:07:26.320162+0000","last_undegraded":"2024-09-12T01:07:26.320162+0000","last_fullsized":"2024-09-12T01:07:26.320162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:32.225678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"267'20","reported_seq":101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.541498+0000","last_change":"2024-09-12T00:36:37.222927+0000","last_active":"2024-09-12T01:05:02.541498+0000","last_peered":"2024-09-12T01:05:02.541498+0000","last_clean":"2024-09-12T01:05:02.541498+0000","last_became_active":"2024-09-12T00:36:37.221980+0000","last_became_peered":"2024-09-12T00:36:37.221980+0000","last_unstale":"2024-09-12T01:05:02.541498+0000","last_undegraded":"2024-09-12T01:05:02.541498+0000","last_fullsized":"2024-09-12T01:05:02.541498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:08.085009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'360","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.018639+0000","last_change":"2024-09-12T01:07:43.018639+0000","last_active":"2024-09-12T01:07:43.018639+0000","last_peered":"2024-09-12T01:07:43.018639+0000","last_clean":"2024-09-12T01:07:43.018639+0000","last_became_active":"2024-09-12T00:21:42.528236+0000","last_became_peered":"2024-09-12T00:21:42.528236+0000","last_unstale":"2024-09-12T01:07:43.018639+0000","last_undegraded":"2024-09-12T01:07:43.018639+0000","last_fullsized":"2024-09-12T01:07:43.018639+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'360","last_scrub_stamp":"2024-09-12T01:07:43.018341+0000","last_deep_scrub":"267'360","last_deep_scrub_stamp":"2024-09-12T01:07:43.018341+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.018341+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:20.272306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812630,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":8804,"num_write":1192,"num_write_kb":22191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'52","reported_seq":612,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.538350+0000","last_change":"2024-09-12T01:07:45.538350+0000","last_active":"2024-09-12T01:07:45.538350+0000","last_peered":"2024-09-12T01:07:45.538350+0000","last_clean":"2024-09-12T01:07:45.538350+0000","last_became_active":"2024-09-12T00:21:44.499494+0000","last_became_peered":"2024-09-12T00:21:44.499494+0000","last_unstale":"2024-09-12T01:07:45.538350+0000","last_undegraded":"2024-09-12T01:07:45.538350+0000","last_fullsized":"2024-09-12T01:07:45.538350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:07:45.538159+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:07:45.538159+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.538159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:29.457414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":187,"num_write":87,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'464","reported_seq":1151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.037595+0000","last_change":"2024-09-12T01:07:48.037595+0000","last_active":"2024-09-12T01:07:48.037595+0000","last_peered":"2024-09-12T01:07:48.037595+0000","last_clean":"2024-09-12T01:07:48.037595+0000","last_became_active":"2024-09-12T00:21:42.511901+0000","last_became_peered":"2024-09-12T00:21:42.511901+0000","last_unstale":"2024-09-12T01:07:48.037595+0000","last_undegraded":"2024-09-12T01:07:48.037595+0000","last_fullsized":"2024-09-12T01:07:48.037595+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'464","last_scrub_stamp":"2024-09-12T01:07:48.037389+0000","last_deep_scrub":"267'464","last_deep_scrub_stamp":"2024-09-12T01:07:48.037389+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.037389+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:29.223858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759316,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":14453,"num_write":1384,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'102","reported_seq":669,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.917935+0000","last_change":"2024-09-12T01:07:51.917935+0000","last_active":"2024-09-12T01:07:51.917935+0000","last_peered":"2024-09-12T01:07:51.917935+0000","last_clean":"2024-09-12T01:07:51.917935+0000","last_became_active":"2024-09-12T00:21:44.498503+0000","last_became_peered":"2024-09-12T00:21:44.498503+0000","last_unstale":"2024-09-12T01:07:51.917935+0000","last_undegraded":"2024-09-12T01:07:51.917935+0000","last_fullsized":"2024-09-12T01:07:51.917935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:51.917714+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:51.917714+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.917714+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:34.326748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":343,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'310","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.047030+0000","last_change":"2024-09-12T01:07:47.047030+0000","last_active":"2024-09-12T01:07:47.047030+0000","last_peered":"2024-09-12T01:07:47.047030+0000","last_clean":"2024-09-12T01:07:47.047030+0000","last_became_active":"2024-09-12T00:21:42.535071+0000","last_became_peered":"2024-09-12T00:21:42.535071+0000","last_unstale":"2024-09-12T01:07:47.047030+0000","last_undegraded":"2024-09-12T01:07:47.047030+0000","last_fullsized":"2024-09-12T01:07:47.047030+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'310","last_scrub_stamp":"2024-09-12T01:07:47.046642+0000","last_deep_scrub":"267'310","last_deep_scrub_stamp":"2024-09-12T01:07:47.046642+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.046642+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.764157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328055,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":751,"num_read_kb":29454,"num_write":966,"num_write_kb":25069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'217","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.419030+0000","last_change":"2024-09-12T00:21:44.498204+0000","last_active":"2024-09-12T01:06:44.419030+0000","last_peered":"2024-09-12T01:06:44.419030+0000","last_clean":"2024-09-12T01:06:44.419030+0000","last_became_active":"2024-09-12T00:21:44.497569+0000","last_became_peered":"2024-09-12T00:21:44.497569+0000","last_unstale":"2024-09-12T01:06:44.419030+0000","last_undegraded":"2024-09-12T01:06:44.419030+0000","last_fullsized":"2024-09-12T01:06:44.419030+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.653439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":917,"num_read_kb":735,"num_write":338,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.334560+0000","last_change":"2024-09-12T01:07:39.334379+0000","last_active":"2024-09-12T01:07:39.334560+0000","last_peered":"2024-09-12T01:07:39.334560+0000","last_clean":"2024-09-12T01:07:39.334560+0000","last_became_active":"2024-09-12T00:21:42.528057+0000","last_became_peered":"2024-09-12T00:21:42.528057+0000","last_unstale":"2024-09-12T01:07:39.334560+0000","last_undegraded":"2024-09-12T01:07:39.334560+0000","last_fullsized":"2024-09-12T01:07:39.334560+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-09-12T01:07:39.334128+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-09-12T01:07:39.334128+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.334128+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.207806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2018898,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":607,"num_read_kb":8621,"num_write":1230,"num_write_kb":31712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'138","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.346916+0000","last_change":"2024-09-12T01:07:49.346916+0000","last_active":"2024-09-12T01:07:49.346916+0000","last_peered":"2024-09-12T01:07:49.346916+0000","last_clean":"2024-09-12T01:07:49.346916+0000","last_became_active":"2024-09-12T00:21:44.479037+0000","last_became_peered":"2024-09-12T00:21:44.479037+0000","last_unstale":"2024-09-12T01:07:49.346916+0000","last_undegraded":"2024-09-12T01:07:49.346916+0000","last_fullsized":"2024-09-12T01:07:49.346916+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T01:07:49.346723+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T01:07:49.346723+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.346723+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:01.160030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":200,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'373","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.034540+0000","last_change":"2024-09-12T01:07:39.034540+0000","last_active":"2024-09-12T01:07:39.034540+0000","last_peered":"2024-09-12T01:07:39.034540+0000","last_clean":"2024-09-12T01:07:39.034540+0000","last_became_active":"2024-09-12T00:21:42.515464+0000","last_became_peered":"2024-09-12T00:21:42.515464+0000","last_unstale":"2024-09-12T01:07:39.034540+0000","last_undegraded":"2024-09-12T01:07:39.034540+0000","last_fullsized":"2024-09-12T01:07:39.034540+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-09-12T01:07:39.034299+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-09-12T01:07:39.034299+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.034299+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:13.031612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":28078,"num_write":1274,"num_write_kb":29332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'4286","reported_seq":4964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.054390+0000","last_change":"2024-09-12T01:07:48.054390+0000","last_active":"2024-09-12T01:07:48.054390+0000","last_peered":"2024-09-12T01:07:48.054390+0000","last_clean":"2024-09-12T01:07:48.054390+0000","last_became_active":"2024-09-12T00:21:44.495734+0000","last_became_peered":"2024-09-12T00:21:44.495734+0000","last_unstale":"2024-09-12T01:07:48.054390+0000","last_undegraded":"2024-09-12T01:07:48.054390+0000","last_fullsized":"2024-09-12T01:07:48.054390+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4286","last_scrub_stamp":"2024-09-12T01:07:48.054213+0000","last_deep_scrub":"267'4286","last_deep_scrub_stamp":"2024-09-12T01:07:48.054213+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.054213+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":3000,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:38.885788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17226,"num_read_kb":14426,"num_write":6464,"num_write_kb":3218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'375","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.278173+0000","last_change":"2024-09-12T01:07:37.278173+0000","last_active":"2024-09-12T01:07:37.278173+0000","last_peered":"2024-09-12T01:07:37.278173+0000","last_clean":"2024-09-12T01:07:37.278173+0000","last_became_active":"2024-09-12T00:21:42.534582+0000","last_became_peered":"2024-09-12T00:21:42.534582+0000","last_unstale":"2024-09-12T01:07:37.278173+0000","last_undegraded":"2024-09-12T01:07:37.278173+0000","last_fullsized":"2024-09-12T01:07:37.278173+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T01:07:37.277868+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T01:07:37.277868+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.277868+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:05.857538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":25303,"num_write":1128,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'161","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.097307+0000","last_change":"2024-09-12T01:07:47.097307+0000","last_active":"2024-09-12T01:07:47.097307+0000","last_peered":"2024-09-12T01:07:47.097307+0000","last_clean":"2024-09-12T01:07:47.097307+0000","last_became_active":"2024-09-12T00:21:44.510410+0000","last_became_peered":"2024-09-12T00:21:44.510410+0000","last_unstale":"2024-09-12T01:07:47.097307+0000","last_undegraded":"2024-09-12T01:07:47.097307+0000","last_fullsized":"2024-09-12T01:07:47.097307+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:07:47.097118+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:07:47.097118+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.097118+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.442505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":577,"num_write":213,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1239,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.025855+0000","last_change":"2024-09-12T01:07:36.025855+0000","last_active":"2024-09-12T01:07:36.025855+0000","last_peered":"2024-09-12T01:07:36.025855+0000","last_clean":"2024-09-12T01:07:36.025855+0000","last_became_active":"2024-09-12T00:21:42.530155+0000","last_became_peered":"2024-09-12T00:21:42.530155+0000","last_unstale":"2024-09-12T01:07:36.025855+0000","last_undegraded":"2024-09-12T01:07:36.025855+0000","last_fullsized":"2024-09-12T01:07:36.025855+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T01:07:36.025559+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T01:07:36.025559+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.025559+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:05.061004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1030,"num_read_kb":26574,"num_write":1137,"num_write_kb":18888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'161","reported_seq":780,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.227104+0000","last_change":"2024-09-12T01:07:46.227104+0000","last_active":"2024-09-12T01:07:46.227104+0000","last_peered":"2024-09-12T01:07:46.227104+0000","last_clean":"2024-09-12T01:07:46.227104+0000","last_became_active":"2024-09-12T00:21:44.483825+0000","last_became_peered":"2024-09-12T00:21:44.483825+0000","last_unstale":"2024-09-12T01:07:46.227104+0000","last_undegraded":"2024-09-12T01:07:46.227104+0000","last_fullsized":"2024-09-12T01:07:46.227104+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:07:46.226919+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:07:46.226919+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.226919+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:25.645752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":577,"num_write":242,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'407","reported_seq":1081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.012599+0000","last_change":"2024-09-12T01:07:44.012599+0000","last_active":"2024-09-12T01:07:44.012599+0000","last_peered":"2024-09-12T01:07:44.012599+0000","last_clean":"2024-09-12T01:07:44.012599+0000","last_became_active":"2024-09-12T00:22:12.620753+0000","last_became_peered":"2024-09-12T00:22:12.620753+0000","last_unstale":"2024-09-12T01:07:44.012599+0000","last_undegraded":"2024-09-12T01:07:44.012599+0000","last_fullsized":"2024-09-12T01:07:44.012599+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T01:07:44.012256+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T01:07:44.012256+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.012256+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:21.935270+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":588,"num_read_kb":16569,"num_write":1344,"num_write_kb":33151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'179","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.868849+0000","last_change":"2024-09-12T00:21:44.528812+0000","last_active":"2024-09-12T01:05:49.868849+0000","last_peered":"2024-09-12T01:05:49.868849+0000","last_clean":"2024-09-12T01:05:49.868849+0000","last_became_active":"2024-09-12T00:21:44.528311+0000","last_became_peered":"2024-09-12T00:21:44.528311+0000","last_unstale":"2024-09-12T01:05:49.868849+0000","last_undegraded":"2024-09-12T01:05:49.868849+0000","last_fullsized":"2024-09-12T01:05:49.868849+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":638,"num_write":310,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'108","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:18.649963+0000","last_change":"2024-09-12T00:21:44.494924+0000","last_active":"2024-09-12T01:04:18.649963+0000","last_peered":"2024-09-12T01:04:18.649963+0000","last_clean":"2024-09-12T01:04:18.649963+0000","last_became_active":"2024-09-12T00:21:44.493767+0000","last_became_peered":"2024-09-12T00:21:44.493767+0000","last_unstale":"2024-09-12T01:04:18.649963+0000","last_undegraded":"2024-09-12T01:04:18.649963+0000","last_fullsized":"2024-09-12T01:04:18.649963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:36.428208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":357,"num_write":148,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'315","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.652696+0000","last_change":"2024-09-12T01:07:34.652629+0000","last_active":"2024-09-12T01:07:34.652696+0000","last_peered":"2024-09-12T01:07:34.652696+0000","last_clean":"2024-09-12T01:07:34.652696+0000","last_became_active":"2024-09-12T00:21:42.514489+0000","last_became_peered":"2024-09-12T00:21:42.514489+0000","last_unstale":"2024-09-12T01:07:34.652696+0000","last_undegraded":"2024-09-12T01:07:34.652696+0000","last_fullsized":"2024-09-12T01:07:34.652696+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'315","last_scrub_stamp":"2024-09-12T01:07:34.652525+0000","last_deep_scrub":"267'315","last_deep_scrub_stamp":"2024-09-12T01:07:34.652525+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.652525+0000","objects_scrubbed":8,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:00.027136+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480914,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":6553,"num_write":1087,"num_write_kb":16882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'52","reported_seq":613,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.053490+0000","last_change":"2024-09-12T01:07:42.053490+0000","last_active":"2024-09-12T01:07:42.053490+0000","last_peered":"2024-09-12T01:07:42.053490+0000","last_clean":"2024-09-12T01:07:42.053490+0000","last_became_active":"2024-09-12T00:21:44.509895+0000","last_became_peered":"2024-09-12T00:21:44.509895+0000","last_unstale":"2024-09-12T01:07:42.053490+0000","last_undegraded":"2024-09-12T01:07:42.053490+0000","last_fullsized":"2024-09-12T01:07:42.053490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:07:42.053309+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:07:42.053309+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.053309+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:52.856138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":198,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'260","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.988730+0000","last_change":"2024-09-12T01:07:36.988584+0000","last_active":"2024-09-12T01:07:36.988730+0000","last_peered":"2024-09-12T01:07:36.988730+0000","last_clean":"2024-09-12T01:07:36.988730+0000","last_became_active":"2024-09-12T00:21:42.490660+0000","last_became_peered":"2024-09-12T00:21:42.490660+0000","last_unstale":"2024-09-12T01:07:36.988730+0000","last_undegraded":"2024-09-12T01:07:36.988730+0000","last_fullsized":"2024-09-12T01:07:36.988730+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'260","last_scrub_stamp":"2024-09-12T01:07:36.988372+0000","last_deep_scrub":"267'260","last_deep_scrub_stamp":"2024-09-12T01:07:36.988372+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.988372+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:05.939444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":4406,"num_write":788,"num_write_kb":22345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'258","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.542895+0000","last_change":"2024-09-12T01:07:44.542895+0000","last_active":"2024-09-12T01:07:44.542895+0000","last_peered":"2024-09-12T01:07:44.542895+0000","last_clean":"2024-09-12T01:07:44.542895+0000","last_became_active":"2024-09-12T00:21:44.514893+0000","last_became_peered":"2024-09-12T00:21:44.514893+0000","last_unstale":"2024-09-12T01:07:44.542895+0000","last_undegraded":"2024-09-12T01:07:44.542895+0000","last_fullsized":"2024-09-12T01:07:44.542895+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:07:44.542721+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:07:44.542721+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.542721+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:09.993567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1166,"num_read_kb":956,"num_write":431,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'341","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.402230+0000","last_change":"2024-09-12T01:07:44.402230+0000","last_active":"2024-09-12T01:07:44.402230+0000","last_peered":"2024-09-12T01:07:44.402230+0000","last_clean":"2024-09-12T01:07:44.402230+0000","last_became_active":"2024-09-12T00:22:13.552126+0000","last_became_peered":"2024-09-12T00:22:13.552126+0000","last_unstale":"2024-09-12T01:07:44.402230+0000","last_undegraded":"2024-09-12T01:07:44.402230+0000","last_fullsized":"2024-09-12T01:07:44.402230+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:44.401991+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:44.401991+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.401991+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:52.498973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194436,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":9788,"num_write":1143,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'125","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.334204+0000","last_change":"2024-09-12T01:07:49.334204+0000","last_active":"2024-09-12T01:07:49.334204+0000","last_peered":"2024-09-12T01:07:49.334204+0000","last_clean":"2024-09-12T01:07:49.334204+0000","last_became_active":"2024-09-12T00:21:44.520441+0000","last_became_peered":"2024-09-12T00:21:44.520441+0000","last_unstale":"2024-09-12T01:07:49.334204+0000","last_undegraded":"2024-09-12T01:07:49.334204+0000","last_fullsized":"2024-09-12T01:07:49.334204+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'125","last_scrub_stamp":"2024-09-12T01:07:49.333960+0000","last_deep_scrub":"267'125","last_deep_scrub_stamp":"2024-09-12T01:07:49.333960+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.333960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:29.920627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":459,"num_write":198,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'341","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.001918+0000","last_change":"2024-09-12T01:07:38.001684+0000","last_active":"2024-09-12T01:07:38.001918+0000","last_peered":"2024-09-12T01:07:38.001918+0000","last_clean":"2024-09-12T01:07:38.001918+0000","last_became_active":"2024-09-12T00:21:42.505754+0000","last_became_peered":"2024-09-12T00:21:42.505754+0000","last_unstale":"2024-09-12T01:07:38.001918+0000","last_undegraded":"2024-09-12T01:07:38.001918+0000","last_fullsized":"2024-09-12T01:07:38.001918+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:38.001353+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:38.001353+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.001353+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:05.323675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524521,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":484,"num_read_kb":23994,"num_write":1133,"num_write_kb":44987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'533","reported_seq":1295,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621096+0000","last_change":"2024-09-12T00:21:44.510694+0000","last_active":"2024-09-12T01:05:14.621096+0000","last_peered":"2024-09-12T01:05:14.621096+0000","last_clean":"2024-09-12T01:05:14.621096+0000","last_became_active":"2024-09-12T00:21:44.509840+0000","last_became_peered":"2024-09-12T00:21:44.509840+0000","last_unstale":"2024-09-12T01:05:14.621096+0000","last_undegraded":"2024-09-12T01:05:14.621096+0000","last_fullsized":"2024-09-12T01:05:14.621096+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2527,"num_read_kb":2144,"num_write":948,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'354","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.349736+0000","last_change":"2024-09-12T01:07:40.349736+0000","last_active":"2024-09-12T01:07:40.349736+0000","last_peered":"2024-09-12T01:07:40.349736+0000","last_clean":"2024-09-12T01:07:40.349736+0000","last_became_active":"2024-09-12T00:21:42.529312+0000","last_became_peered":"2024-09-12T00:21:42.529312+0000","last_unstale":"2024-09-12T01:07:40.349736+0000","last_undegraded":"2024-09-12T01:07:40.349736+0000","last_fullsized":"2024-09-12T01:07:40.349736+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T01:07:40.349528+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T01:07:40.349528+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.349528+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:32.841636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":660,"num_write":1093,"num_write_kb":45878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'102","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.560572+0000","last_change":"2024-09-12T01:07:43.560572+0000","last_active":"2024-09-12T01:07:43.560572+0000","last_peered":"2024-09-12T01:07:43.560572+0000","last_clean":"2024-09-12T01:07:43.560572+0000","last_became_active":"2024-09-12T00:21:44.499173+0000","last_became_peered":"2024-09-12T00:21:44.499173+0000","last_unstale":"2024-09-12T01:07:43.560572+0000","last_undegraded":"2024-09-12T01:07:43.560572+0000","last_fullsized":"2024-09-12T01:07:43.560572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:43.560396+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:43.560396+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.560396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:27.157753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":398,"num_write":158,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'370","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.319443+0000","last_change":"2024-09-12T01:07:42.319443+0000","last_active":"2024-09-12T01:07:42.319443+0000","last_peered":"2024-09-12T01:07:42.319443+0000","last_clean":"2024-09-12T01:07:42.319443+0000","last_became_active":"2024-09-12T00:21:42.529873+0000","last_became_peered":"2024-09-12T00:21:42.529873+0000","last_unstale":"2024-09-12T01:07:42.319443+0000","last_undegraded":"2024-09-12T01:07:42.319443+0000","last_fullsized":"2024-09-12T01:07:42.319443+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-12T01:07:42.319216+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-12T01:07:42.319216+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.319216+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:35.891445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730168,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":35149,"num_write":1229,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'136","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.419806+0000","last_change":"2024-09-12T00:21:52.546288+0000","last_active":"2024-09-12T01:06:07.419806+0000","last_peered":"2024-09-12T01:06:07.419806+0000","last_clean":"2024-09-12T01:06:07.419806+0000","last_became_active":"2024-09-12T00:21:52.545571+0000","last_became_peered":"2024-09-12T00:21:52.545571+0000","last_unstale":"2024-09-12T01:06:07.419806+0000","last_undegraded":"2024-09-12T01:06:07.419806+0000","last_fullsized":"2024-09-12T01:06:07.419806+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'88","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.344902+0000","last_change":"2024-09-12T01:07:46.344902+0000","last_active":"2024-09-12T01:07:46.344902+0000","last_peered":"2024-09-12T01:07:46.344902+0000","last_clean":"2024-09-12T01:07:46.344902+0000","last_became_active":"2024-09-12T00:21:44.484514+0000","last_became_peered":"2024-09-12T00:21:44.484514+0000","last_unstale":"2024-09-12T01:07:46.344902+0000","last_undegraded":"2024-09-12T01:07:46.344902+0000","last_fullsized":"2024-09-12T01:07:46.344902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'88","last_scrub_stamp":"2024-09-12T01:07:46.344724+0000","last_deep_scrub":"267'88","last_deep_scrub_stamp":"2024-09-12T01:07:46.344724+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.344724+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:38.020778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":321,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'347","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.938138+0000","last_change":"2024-09-12T01:07:44.938138+0000","last_active":"2024-09-12T01:07:44.938138+0000","last_peered":"2024-09-12T01:07:44.938138+0000","last_clean":"2024-09-12T01:07:44.938138+0000","last_became_active":"2024-09-12T00:21:42.495808+0000","last_became_peered":"2024-09-12T00:21:42.495808+0000","last_unstale":"2024-09-12T01:07:44.938138+0000","last_undegraded":"2024-09-12T01:07:44.938138+0000","last_fullsized":"2024-09-12T01:07:44.938138+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T01:07:44.937896+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T01:07:44.937896+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.937896+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.094251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432703,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":20340,"num_write":1070,"num_write_kb":31693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.641930+0000","last_change":"2024-09-12T00:21:46.515667+0000","last_active":"2024-09-12T01:05:19.641930+0000","last_peered":"2024-09-12T01:05:19.641930+0000","last_clean":"2024-09-12T01:05:19.641930+0000","last_became_active":"2024-09-12T00:21:46.515363+0000","last_became_peered":"2024-09-12T00:21:46.515363+0000","last_unstale":"2024-09-12T01:05:19.641930+0000","last_undegraded":"2024-09-12T01:05:19.641930+0000","last_fullsized":"2024-09-12T01:05:19.641930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'330","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.251543+0000","last_change":"2024-09-12T00:21:48.528210+0000","last_active":"2024-09-12T01:07:27.251543+0000","last_peered":"2024-09-12T01:07:27.251543+0000","last_clean":"2024-09-12T01:07:27.251543+0000","last_became_active":"2024-09-12T00:21:48.524091+0000","last_became_peered":"2024-09-12T00:21:48.524091+0000","last_unstale":"2024-09-12T01:07:27.251543+0000","last_undegraded":"2024-09-12T01:07:27.251543+0000","last_fullsized":"2024-09-12T01:07:27.251543+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48797,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1088,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.785438+0000","last_change":"2024-09-12T00:21:50.552444+0000","last_active":"2024-09-12T01:05:24.785438+0000","last_peered":"2024-09-12T01:05:24.785438+0000","last_clean":"2024-09-12T01:05:24.785438+0000","last_became_active":"2024-09-12T00:21:50.551742+0000","last_became_peered":"2024-09-12T00:21:50.551742+0000","last_unstale":"2024-09-12T01:05:24.785438+0000","last_undegraded":"2024-09-12T01:05:24.785438+0000","last_fullsized":"2024-09-12T01:05:24.785438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'173","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.384837+0000","last_change":"2024-09-12T00:21:52.546442+0000","last_active":"2024-09-12T01:06:06.384837+0000","last_peered":"2024-09-12T01:06:06.384837+0000","last_clean":"2024-09-12T01:06:06.384837+0000","last_became_active":"2024-09-12T00:21:52.544469+0000","last_became_peered":"2024-09-12T00:21:52.544469+0000","last_unstale":"2024-09-12T01:06:06.384837+0000","last_undegraded":"2024-09-12T01:06:06.384837+0000","last_fullsized":"2024-09-12T01:06:06.384837+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:08.007114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":251,"num_write":350,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'4223","reported_seq":4855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640662+0000","last_change":"2024-09-12T00:21:44.500660+0000","last_active":"2024-09-12T01:05:14.640662+0000","last_peered":"2024-09-12T01:05:14.640662+0000","last_clean":"2024-09-12T01:05:14.640662+0000","last_became_active":"2024-09-12T00:21:44.500367+0000","last_became_peered":"2024-09-12T00:21:44.500367+0000","last_unstale":"2024-09-12T01:05:14.640662+0000","last_undegraded":"2024-09-12T01:05:14.640662+0000","last_fullsized":"2024-09-12T01:05:14.640662+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17010,"num_read_kb":14247,"num_write":6340,"num_write_kb":3163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'379","reported_seq":1087,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.372378+0000","last_change":"2024-09-12T01:07:39.372378+0000","last_active":"2024-09-12T01:07:39.372378+0000","last_peered":"2024-09-12T01:07:39.372378+0000","last_clean":"2024-09-12T01:07:39.372378+0000","last_became_active":"2024-09-12T00:21:42.492572+0000","last_became_peered":"2024-09-12T00:21:42.492572+0000","last_unstale":"2024-09-12T01:07:39.372378+0000","last_undegraded":"2024-09-12T01:07:39.372378+0000","last_fullsized":"2024-09-12T01:07:39.372378+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:39.372054+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:39.372054+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.372054+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:10.885705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":145927,"num_write":1169,"num_write_kb":64533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.367076+0000","last_change":"2024-09-12T01:07:54.367076+0000","last_active":"2024-09-12T01:07:54.367076+0000","last_peered":"2024-09-12T01:07:54.367076+0000","last_clean":"2024-09-12T01:07:54.367076+0000","last_became_active":"2024-09-12T00:21:46.490985+0000","last_became_peered":"2024-09-12T00:21:46.490985+0000","last_unstale":"2024-09-12T01:07:54.367076+0000","last_undegraded":"2024-09-12T01:07:54.367076+0000","last_fullsized":"2024-09-12T01:07:54.367076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.366884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.366884+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.366884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:54.269774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'84","reported_seq":619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.784354+0000","last_change":"2024-09-12T00:21:48.535909+0000","last_active":"2024-09-12T01:05:19.784354+0000","last_peered":"2024-09-12T01:05:19.784354+0000","last_clean":"2024-09-12T01:05:19.784354+0000","last_became_active":"2024-09-12T00:21:48.535190+0000","last_became_peered":"2024-09-12T00:21:48.535190+0000","last_unstale":"2024-09-12T01:05:19.784354+0000","last_undegraded":"2024-09-12T01:05:19.784354+0000","last_fullsized":"2024-09-12T01:05:19.784354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.785352+0000","last_change":"2024-09-12T00:21:50.551431+0000","last_active":"2024-09-12T01:05:24.785352+0000","last_peered":"2024-09-12T01:05:24.785352+0000","last_clean":"2024-09-12T01:05:24.785352+0000","last_became_active":"2024-09-12T00:21:50.550214+0000","last_became_peered":"2024-09-12T00:21:50.550214+0000","last_unstale":"2024-09-12T01:05:24.785352+0000","last_undegraded":"2024-09-12T01:05:24.785352+0000","last_fullsized":"2024-09-12T01:05:24.785352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'124","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:53.000458+0000","last_change":"2024-09-12T00:21:52.545902+0000","last_active":"2024-09-12T01:05:53.000458+0000","last_peered":"2024-09-12T01:05:53.000458+0000","last_clean":"2024-09-12T01:05:53.000458+0000","last_became_active":"2024-09-12T00:21:52.545166+0000","last_became_peered":"2024-09-12T00:21:52.545166+0000","last_unstale":"2024-09-12T01:05:53.000458+0000","last_undegraded":"2024-09-12T01:05:53.000458+0000","last_fullsized":"2024-09-12T01:05:53.000458+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:01.544361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":292,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'288","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.016647+0000","last_change":"2024-09-12T01:07:51.016647+0000","last_active":"2024-09-12T01:07:51.016647+0000","last_peered":"2024-09-12T01:07:51.016647+0000","last_clean":"2024-09-12T01:07:51.016647+0000","last_became_active":"2024-09-12T00:21:44.520057+0000","last_became_peered":"2024-09-12T00:21:44.520057+0000","last_unstale":"2024-09-12T01:07:51.016647+0000","last_undegraded":"2024-09-12T01:07:51.016647+0000","last_fullsized":"2024-09-12T01:07:51.016647+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'288","last_scrub_stamp":"2024-09-12T01:07:51.016419+0000","last_deep_scrub":"267'288","last_deep_scrub_stamp":"2024-09-12T01:07:51.016419+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.016419+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:13.071098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1259,"num_read_kb":1089,"num_write":465,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'321","reported_seq":960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.918798+0000","last_change":"2024-09-12T01:07:36.918798+0000","last_active":"2024-09-12T01:07:36.918798+0000","last_peered":"2024-09-12T01:07:36.918798+0000","last_clean":"2024-09-12T01:07:36.918798+0000","last_became_active":"2024-09-12T00:21:42.496059+0000","last_became_peered":"2024-09-12T00:21:42.496059+0000","last_unstale":"2024-09-12T01:07:36.918798+0000","last_undegraded":"2024-09-12T01:07:36.918798+0000","last_fullsized":"2024-09-12T01:07:36.918798+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'321","last_scrub_stamp":"2024-09-12T01:07:36.918576+0000","last_deep_scrub":"267'321","last_deep_scrub_stamp":"2024-09-12T01:07:36.918576+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.918576+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:39.909942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":8629,"num_write":994,"num_write_kb":21953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594885+0000","last_change":"2024-09-12T00:21:46.501997+0000","last_active":"2024-09-12T01:05:19.594885+0000","last_peered":"2024-09-12T01:05:19.594885+0000","last_clean":"2024-09-12T01:05:19.594885+0000","last_became_active":"2024-09-12T00:21:46.501407+0000","last_became_peered":"2024-09-12T00:21:46.501407+0000","last_unstale":"2024-09-12T01:05:19.594885+0000","last_undegraded":"2024-09-12T01:05:19.594885+0000","last_fullsized":"2024-09-12T01:05:19.594885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'122","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.317364+0000","last_change":"2024-09-12T00:21:48.542081+0000","last_active":"2024-09-12T01:04:21.317364+0000","last_peered":"2024-09-12T01:04:21.317364+0000","last_clean":"2024-09-12T01:04:21.317364+0000","last_became_active":"2024-09-12T00:21:48.541231+0000","last_became_peered":"2024-09-12T00:21:48.541231+0000","last_unstale":"2024-09-12T01:04:21.317364+0000","last_undegraded":"2024-09-12T01:04:21.317364+0000","last_fullsized":"2024-09-12T01:04:21.317364+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.064538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'788","reported_seq":2515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.708110+0000","last_change":"2024-09-12T00:21:50.569545+0000","last_active":"2024-09-12T01:07:27.708110+0000","last_peered":"2024-09-12T01:07:27.708110+0000","last_clean":"2024-09-12T01:07:27.708110+0000","last_became_active":"2024-09-12T00:21:50.568825+0000","last_became_peered":"2024-09-12T00:21:50.568825+0000","last_unstale":"2024-09-12T01:07:27.708110+0000","last_undegraded":"2024-09-12T01:07:27.708110+0000","last_fullsized":"2024-09-12T01:07:27.708110+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'222","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.469146+0000","last_change":"2024-09-12T00:21:52.555837+0000","last_active":"2024-09-12T01:06:07.469146+0000","last_peered":"2024-09-12T01:06:07.469146+0000","last_clean":"2024-09-12T01:06:07.469146+0000","last_became_active":"2024-09-12T00:21:52.554865+0000","last_became_peered":"2024-09-12T00:21:52.554865+0000","last_unstale":"2024-09-12T01:06:07.469146+0000","last_undegraded":"2024-09-12T01:06:07.469146+0000","last_fullsized":"2024-09-12T01:06:07.469146+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:47.453983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":708,"num_read_kb":679,"num_write":497,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'136","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.992340+0000","last_change":"2024-09-12T01:07:51.992340+0000","last_active":"2024-09-12T01:07:51.992340+0000","last_peered":"2024-09-12T01:07:51.992340+0000","last_clean":"2024-09-12T01:07:51.992340+0000","last_became_active":"2024-09-12T00:21:44.522830+0000","last_became_peered":"2024-09-12T00:21:44.522830+0000","last_unstale":"2024-09-12T01:07:51.992340+0000","last_undegraded":"2024-09-12T01:07:51.992340+0000","last_fullsized":"2024-09-12T01:07:51.992340+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'136","last_scrub_stamp":"2024-09-12T01:07:51.992145+0000","last_deep_scrub":"267'136","last_deep_scrub_stamp":"2024-09-12T01:07:51.992145+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.992145+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:19.587323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":469,"num_write":207,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'328","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.611420+0000","last_change":"2024-09-12T01:07:33.611420+0000","last_active":"2024-09-12T01:07:33.611420+0000","last_peered":"2024-09-12T01:07:33.611420+0000","last_clean":"2024-09-12T01:07:33.611420+0000","last_became_active":"2024-09-12T00:21:42.516625+0000","last_became_peered":"2024-09-12T00:21:42.516625+0000","last_unstale":"2024-09-12T01:07:33.611420+0000","last_undegraded":"2024-09-12T01:07:33.611420+0000","last_fullsized":"2024-09-12T01:07:33.611420+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.611301+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:46.786030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":2651,"num_write":1122,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.642015+0000","last_change":"2024-09-12T00:21:46.504025+0000","last_active":"2024-09-12T01:05:19.642015+0000","last_peered":"2024-09-12T01:05:19.642015+0000","last_clean":"2024-09-12T01:05:19.642015+0000","last_became_active":"2024-09-12T00:21:46.503686+0000","last_became_peered":"2024-09-12T00:21:46.503686+0000","last_unstale":"2024-09-12T01:05:19.642015+0000","last_undegraded":"2024-09-12T01:05:19.642015+0000","last_fullsized":"2024-09-12T01:05:19.642015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'288","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.199449+0000","last_change":"2024-09-12T01:07:52.199449+0000","last_active":"2024-09-12T01:07:52.199449+0000","last_peered":"2024-09-12T01:07:52.199449+0000","last_clean":"2024-09-12T01:07:52.199449+0000","last_became_active":"2024-09-12T00:21:48.539522+0000","last_became_peered":"2024-09-12T00:21:48.539522+0000","last_unstale":"2024-09-12T01:07:52.199449+0000","last_undegraded":"2024-09-12T01:07:52.199449+0000","last_fullsized":"2024-09-12T01:07:52.199449+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'288","last_scrub_stamp":"2024-09-12T01:07:52.199255+0000","last_deep_scrub":"267'288","last_deep_scrub_stamp":"2024-09-12T01:07:52.199255+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.199255+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:02.995276+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47885,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1089,"num_write":388,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'780","reported_seq":2466,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.266973+0000","last_change":"2024-09-12T00:21:50.565919+0000","last_active":"2024-09-12T01:07:27.266973+0000","last_peered":"2024-09-12T01:07:27.266973+0000","last_clean":"2024-09-12T01:07:27.266973+0000","last_became_active":"2024-09-12T00:21:50.564483+0000","last_became_peered":"2024-09-12T00:21:50.564483+0000","last_unstale":"2024-09-12T01:07:27.266973+0000","last_undegraded":"2024-09-12T01:07:27.266973+0000","last_fullsized":"2024-09-12T01:07:27.266973+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:06.991341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'576","reported_seq":1373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.904435+0000","last_change":"2024-09-12T01:07:50.904435+0000","last_active":"2024-09-12T01:07:50.904435+0000","last_peered":"2024-09-12T01:07:50.904435+0000","last_clean":"2024-09-12T01:07:50.904435+0000","last_became_active":"2024-09-12T00:21:44.497754+0000","last_became_peered":"2024-09-12T00:21:44.497754+0000","last_unstale":"2024-09-12T01:07:50.904435+0000","last_undegraded":"2024-09-12T01:07:50.904435+0000","last_fullsized":"2024-09-12T01:07:50.904435+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'576","last_scrub_stamp":"2024-09-12T01:07:50.904242+0000","last_deep_scrub":"267'576","last_deep_scrub_stamp":"2024-09-12T01:07:50.904242+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.904242+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:34.973282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2710,"num_read_kb":2241,"num_write":1007,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'379","reported_seq":1096,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:31.968974+0000","last_change":"2024-09-12T01:07:31.968974+0000","last_active":"2024-09-12T01:07:31.968974+0000","last_peered":"2024-09-12T01:07:31.968974+0000","last_clean":"2024-09-12T01:07:31.968974+0000","last_became_active":"2024-09-12T00:21:42.528138+0000","last_became_peered":"2024-09-12T00:21:42.528138+0000","last_unstale":"2024-09-12T01:07:31.968974+0000","last_undegraded":"2024-09-12T01:07:31.968974+0000","last_fullsized":"2024-09-12T01:07:31.968974+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_clean_scrub_stamp":"2024-09-12T01:07:31.968881+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:08.369394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":24539,"num_write":1088,"num_write_kb":22675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.602402+0000","last_change":"2024-09-12T01:07:48.602402+0000","last_active":"2024-09-12T01:07:48.602402+0000","last_peered":"2024-09-12T01:07:48.602402+0000","last_clean":"2024-09-12T01:07:48.602402+0000","last_became_active":"2024-09-12T00:21:46.503041+0000","last_became_peered":"2024-09-12T00:21:46.503041+0000","last_unstale":"2024-09-12T01:07:48.602402+0000","last_undegraded":"2024-09-12T01:07:48.602402+0000","last_fullsized":"2024-09-12T01:07:48.602402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.602219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.602219+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.602219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:00.262764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'375","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045785+0000","last_change":"2024-09-12T01:07:50.045785+0000","last_active":"2024-09-12T01:07:50.045785+0000","last_peered":"2024-09-12T01:07:50.045785+0000","last_clean":"2024-09-12T01:07:50.045785+0000","last_became_active":"2024-09-12T00:21:48.538727+0000","last_became_peered":"2024-09-12T00:21:48.538727+0000","last_unstale":"2024-09-12T01:07:50.045785+0000","last_undegraded":"2024-09-12T01:07:50.045785+0000","last_fullsized":"2024-09-12T01:07:50.045785+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T01:07:50.045578+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T01:07:50.045578+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.045578+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:24.408858+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48773,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":589,"num_read_kb":1209,"num_write":464,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.587751+0000","last_change":"2024-09-12T00:21:50.545196+0000","last_active":"2024-09-12T01:04:39.587751+0000","last_peered":"2024-09-12T01:04:39.587751+0000","last_clean":"2024-09-12T01:04:39.587751+0000","last_became_active":"2024-09-12T00:21:50.544432+0000","last_became_peered":"2024-09-12T00:21:50.544432+0000","last_unstale":"2024-09-12T01:04:39.587751+0000","last_undegraded":"2024-09-12T01:04:39.587751+0000","last_fullsized":"2024-09-12T01:04:39.587751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.923643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'549","reported_seq":1361,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.875398+0000","last_change":"2024-09-12T00:21:52.563743+0000","last_active":"2024-09-12T01:07:12.875398+0000","last_peered":"2024-09-12T01:07:12.875398+0000","last_clean":"2024-09-12T01:07:12.875398+0000","last_became_active":"2024-09-12T00:21:52.563086+0000","last_became_peered":"2024-09-12T00:21:52.563086+0000","last_unstale":"2024-09-12T01:07:12.875398+0000","last_undegraded":"2024-09-12T01:07:12.875398+0000","last_fullsized":"2024-09-12T01:07:12.875398+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1274,"num_read_kb":1271,"num_write":1130,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'526","reported_seq":1314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.643971+0000","last_change":"2024-09-12T01:07:36.643971+0000","last_active":"2024-09-12T01:07:36.643971+0000","last_peered":"2024-09-12T01:07:36.643971+0000","last_clean":"2024-09-12T01:07:36.643971+0000","last_became_active":"2024-09-12T00:21:44.510918+0000","last_became_peered":"2024-09-12T00:21:44.510918+0000","last_unstale":"2024-09-12T01:07:36.643971+0000","last_undegraded":"2024-09-12T01:07:36.643971+0000","last_fullsized":"2024-09-12T01:07:36.643971+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'526","last_scrub_stamp":"2024-09-12T01:07:36.643792+0000","last_deep_scrub":"267'526","last_deep_scrub_stamp":"2024-09-12T01:07:36.643792+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.643792+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.857231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2468,"num_read_kb":2089,"num_write":789,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29756,"num_omap_keys":119,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'326","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.222218+0000","last_change":"2024-09-12T01:07:33.222218+0000","last_active":"2024-09-12T01:07:33.222218+0000","last_peered":"2024-09-12T01:07:33.222218+0000","last_clean":"2024-09-12T01:07:33.222218+0000","last_became_active":"2024-09-12T00:21:42.513031+0000","last_became_peered":"2024-09-12T00:21:42.513031+0000","last_unstale":"2024-09-12T01:07:33.222218+0000","last_undegraded":"2024-09-12T01:07:33.222218+0000","last_fullsized":"2024-09-12T01:07:33.222218+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.222064+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:44.352540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730153,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":476,"num_read_kb":44893,"num_write":1011,"num_write_kb":33699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.362478+0000","last_change":"2024-09-12T01:07:51.362478+0000","last_active":"2024-09-12T01:07:51.362478+0000","last_peered":"2024-09-12T01:07:51.362478+0000","last_clean":"2024-09-12T01:07:51.362478+0000","last_became_active":"2024-09-12T00:21:46.517981+0000","last_became_peered":"2024-09-12T00:21:46.517981+0000","last_unstale":"2024-09-12T01:07:51.362478+0000","last_undegraded":"2024-09-12T01:07:51.362478+0000","last_fullsized":"2024-09-12T01:07:51.362478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:51.362295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:51.362295+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.362295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:14.300895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'274","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.314493+0000","last_change":"2024-09-12T00:21:48.523626+0000","last_active":"2024-09-12T01:07:26.314493+0000","last_peered":"2024-09-12T01:07:26.314493+0000","last_clean":"2024-09-12T01:07:26.314493+0000","last_became_active":"2024-09-12T00:21:48.522920+0000","last_became_peered":"2024-09-12T00:21:48.522920+0000","last_unstale":"2024-09-12T01:07:26.314493+0000","last_undegraded":"2024-09-12T01:07:26.314493+0000","last_fullsized":"2024-09-12T01:07:26.314493+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:28.182271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1024,"num_write":366,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.595926+0000","last_change":"2024-09-12T00:21:50.545714+0000","last_active":"2024-09-12T01:05:24.595926+0000","last_peered":"2024-09-12T01:05:24.595926+0000","last_clean":"2024-09-12T01:05:24.595926+0000","last_became_active":"2024-09-12T00:21:50.543639+0000","last_became_peered":"2024-09-12T00:21:50.543639+0000","last_unstale":"2024-09-12T01:05:24.595926+0000","last_undegraded":"2024-09-12T01:05:24.595926+0000","last_fullsized":"2024-09-12T01:05:24.595926+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2371","reported_seq":4213,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:02.198126+0000","last_change":"2024-09-12T00:21:52.538444+0000","last_active":"2024-09-12T01:07:02.198126+0000","last_peered":"2024-09-12T01:07:02.198126+0000","last_clean":"2024-09-12T01:07:02.198126+0000","last_became_active":"2024-09-12T00:21:52.537701+0000","last_became_peered":"2024-09-12T00:21:52.537701+0000","last_unstale":"2024-09-12T01:07:02.198126+0000","last_undegraded":"2024-09-12T01:07:02.198126+0000","last_fullsized":"2024-09-12T01:07:02.198126+0000","mapping_epoch":36,"log_start":"267'2300","ondisk_log_start":"267'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5977,"num_write":4771,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'112","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.271862+0000","last_change":"2024-09-12T01:07:41.271862+0000","last_active":"2024-09-12T01:07:41.271862+0000","last_peered":"2024-09-12T01:07:41.271862+0000","last_clean":"2024-09-12T01:07:41.271862+0000","last_became_active":"2024-09-12T00:21:44.494313+0000","last_became_peered":"2024-09-12T00:21:44.494313+0000","last_unstale":"2024-09-12T01:07:41.271862+0000","last_undegraded":"2024-09-12T01:07:41.271862+0000","last_fullsized":"2024-09-12T01:07:41.271862+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'112","last_scrub_stamp":"2024-09-12T01:07:41.271428+0000","last_deep_scrub":"267'112","last_deep_scrub_stamp":"2024-09-12T01:07:41.271428+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.271428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:21.911085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":397,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'345","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.915359+0000","last_change":"2024-09-12T01:07:49.915359+0000","last_active":"2024-09-12T01:07:49.915359+0000","last_peered":"2024-09-12T01:07:49.915359+0000","last_clean":"2024-09-12T01:07:49.915359+0000","last_became_active":"2024-09-12T00:21:42.529372+0000","last_became_peered":"2024-09-12T00:21:42.529372+0000","last_unstale":"2024-09-12T01:07:49.915359+0000","last_undegraded":"2024-09-12T01:07:49.915359+0000","last_fullsized":"2024-09-12T01:07:49.915359+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T01:07:49.915120+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T01:07:49.915120+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.915120+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:20.870747+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12055,"num_write":1241,"num_write_kb":31958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611469+0000","last_change":"2024-09-12T00:21:46.512407+0000","last_active":"2024-09-12T01:04:34.611469+0000","last_peered":"2024-09-12T01:04:34.611469+0000","last_clean":"2024-09-12T01:04:34.611469+0000","last_became_active":"2024-09-12T00:21:46.511704+0000","last_became_peered":"2024-09-12T00:21:46.511704+0000","last_unstale":"2024-09-12T01:04:34.611469+0000","last_undegraded":"2024-09-12T01:04:34.611469+0000","last_fullsized":"2024-09-12T01:04:34.611469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:04.950564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'284","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.649069+0000","last_change":"2024-09-12T00:21:48.552567+0000","last_active":"2024-09-12T01:07:27.649069+0000","last_peered":"2024-09-12T01:07:27.649069+0000","last_clean":"2024-09-12T01:07:27.649069+0000","last_became_active":"2024-09-12T00:21:48.551752+0000","last_became_peered":"2024-09-12T00:21:48.551752+0000","last_unstale":"2024-09-12T01:07:27.649069+0000","last_undegraded":"2024-09-12T01:07:27.649069+0000","last_fullsized":"2024-09-12T01:07:27.649069+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.243890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42024,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":467,"num_read_kb":1006,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'781","reported_seq":4659,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.267764+0000","last_change":"2024-09-12T00:21:50.562293+0000","last_active":"2024-09-12T01:07:27.267764+0000","last_peered":"2024-09-12T01:07:27.267764+0000","last_clean":"2024-09-12T01:07:27.267764+0000","last_became_active":"2024-09-12T00:21:50.561680+0000","last_became_peered":"2024-09-12T00:21:50.561680+0000","last_unstale":"2024-09-12T01:07:27.267764+0000","last_undegraded":"2024-09-12T01:07:27.267764+0000","last_fullsized":"2024-09-12T01:07:27.267764+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:35.170696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'119","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.966637+0000","last_change":"2024-09-12T00:21:52.547626+0000","last_active":"2024-09-12T01:07:11.966637+0000","last_peered":"2024-09-12T01:07:11.966637+0000","last_clean":"2024-09-12T01:07:11.966637+0000","last_became_active":"2024-09-12T00:21:52.546889+0000","last_became_peered":"2024-09-12T00:21:52.546889+0000","last_unstale":"2024-09-12T01:07:11.966637+0000","last_undegraded":"2024-09-12T01:07:11.966637+0000","last_fullsized":"2024-09-12T01:07:11.966637+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:06.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":121,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'188","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.987877+0000","last_change":"2024-09-12T01:07:49.987877+0000","last_active":"2024-09-12T01:07:49.987877+0000","last_peered":"2024-09-12T01:07:49.987877+0000","last_clean":"2024-09-12T01:07:49.987877+0000","last_became_active":"2024-09-12T00:21:44.518595+0000","last_became_peered":"2024-09-12T00:21:44.518595+0000","last_unstale":"2024-09-12T01:07:49.987877+0000","last_undegraded":"2024-09-12T01:07:49.987877+0000","last_fullsized":"2024-09-12T01:07:49.987877+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'188","last_scrub_stamp":"2024-09-12T01:07:49.987691+0000","last_deep_scrub":"267'188","last_deep_scrub_stamp":"2024-09-12T01:07:49.987691+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.987691+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:57.684878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":656,"num_write":281,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'267","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.002912+0000","last_change":"2024-09-12T01:07:33.002912+0000","last_active":"2024-09-12T01:07:33.002912+0000","last_peered":"2024-09-12T01:07:33.002912+0000","last_clean":"2024-09-12T01:07:33.002912+0000","last_became_active":"2024-09-12T00:21:42.497992+0000","last_became_peered":"2024-09-12T00:21:42.497992+0000","last_unstale":"2024-09-12T01:07:33.002912+0000","last_undegraded":"2024-09-12T01:07:33.002912+0000","last_fullsized":"2024-09-12T01:07:33.002912+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'267","last_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_deep_scrub":"267'267","last_deep_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.002601+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:20.061473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":82463,"num_write":854,"num_write_kb":27861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.333366+0000","last_change":"2024-09-12T01:07:52.333366+0000","last_active":"2024-09-12T01:07:52.333366+0000","last_peered":"2024-09-12T01:07:52.333366+0000","last_clean":"2024-09-12T01:07:52.333366+0000","last_became_active":"2024-09-12T00:21:46.511365+0000","last_became_peered":"2024-09-12T00:21:46.511365+0000","last_unstale":"2024-09-12T01:07:52.333366+0000","last_undegraded":"2024-09-12T01:07:52.333366+0000","last_fullsized":"2024-09-12T01:07:52.333366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.333162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.333162+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.333162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:19.202850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'473","reported_seq":1115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.492185+0000","last_change":"2024-09-12T00:21:48.526015+0000","last_active":"2024-09-12T01:07:26.492185+0000","last_peered":"2024-09-12T01:07:26.492185+0000","last_clean":"2024-09-12T01:07:26.492185+0000","last_became_active":"2024-09-12T00:21:48.524173+0000","last_became_peered":"2024-09-12T00:21:48.524173+0000","last_unstale":"2024-09-12T01:07:26.492185+0000","last_undegraded":"2024-09-12T01:07:26.492185+0000","last_fullsized":"2024-09-12T01:07:26.492185+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:01.094285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1944,"num_write":668,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.620896+0000","last_change":"2024-09-12T00:21:50.562375+0000","last_active":"2024-09-12T01:05:14.620896+0000","last_peered":"2024-09-12T01:05:14.620896+0000","last_clean":"2024-09-12T01:05:14.620896+0000","last_became_active":"2024-09-12T00:21:50.561720+0000","last_became_peered":"2024-09-12T00:21:50.561720+0000","last_unstale":"2024-09-12T01:05:14.620896+0000","last_undegraded":"2024-09-12T01:05:14.620896+0000","last_fullsized":"2024-09-12T01:05:14.620896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:55.724402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'124","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.185203+0000","last_change":"2024-09-12T00:21:52.565860+0000","last_active":"2024-09-12T01:05:29.185203+0000","last_peered":"2024-09-12T01:05:29.185203+0000","last_clean":"2024-09-12T01:05:29.185203+0000","last_became_active":"2024-09-12T00:21:52.565276+0000","last_became_peered":"2024-09-12T00:21:52.565276+0000","last_unstale":"2024-09-12T01:05:29.185203+0000","last_undegraded":"2024-09-12T01:05:29.185203+0000","last_fullsized":"2024-09-12T01:05:29.185203+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:19.050097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'92","reported_seq":695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.018654+0000","last_change":"2024-09-12T01:07:41.018654+0000","last_active":"2024-09-12T01:07:41.018654+0000","last_peered":"2024-09-12T01:07:41.018654+0000","last_clean":"2024-09-12T01:07:41.018654+0000","last_became_active":"2024-09-12T00:21:44.504866+0000","last_became_peered":"2024-09-12T00:21:44.504866+0000","last_unstale":"2024-09-12T01:07:41.018654+0000","last_undegraded":"2024-09-12T01:07:41.018654+0000","last_fullsized":"2024-09-12T01:07:41.018654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'92","last_scrub_stamp":"2024-09-12T01:07:41.018456+0000","last_deep_scrub":"267'92","last_deep_scrub_stamp":"2024-09-12T01:07:41.018456+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.018456+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:57.826698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":364,"num_write":125,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'360","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.122169+0000","last_change":"2024-09-12T01:07:35.122169+0000","last_active":"2024-09-12T01:07:35.122169+0000","last_peered":"2024-09-12T01:07:35.122169+0000","last_clean":"2024-09-12T01:07:35.122169+0000","last_became_active":"2024-09-12T00:21:42.511762+0000","last_became_peered":"2024-09-12T00:21:42.511762+0000","last_unstale":"2024-09-12T01:07:35.122169+0000","last_undegraded":"2024-09-12T01:07:35.122169+0000","last_fullsized":"2024-09-12T01:07:35.122169+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'360","last_scrub_stamp":"2024-09-12T01:07:35.121973+0000","last_deep_scrub":"267'360","last_deep_scrub_stamp":"2024-09-12T01:07:35.121973+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.121973+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:10.214969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":36352,"num_write":1101,"num_write_kb":41720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.241978+0000","last_change":"2024-09-12T01:07:48.241978+0000","last_active":"2024-09-12T01:07:48.241978+0000","last_peered":"2024-09-12T01:07:48.241978+0000","last_clean":"2024-09-12T01:07:48.241978+0000","last_became_active":"2024-09-12T00:21:46.514486+0000","last_became_peered":"2024-09-12T00:21:46.514486+0000","last_unstale":"2024-09-12T01:07:48.241978+0000","last_undegraded":"2024-09-12T01:07:48.241978+0000","last_fullsized":"2024-09-12T01:07:48.241978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.241783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.241783+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.241783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.010975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'324","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.612716+0000","last_change":"2024-09-12T01:07:51.612716+0000","last_active":"2024-09-12T01:07:51.612716+0000","last_peered":"2024-09-12T01:07:51.612716+0000","last_clean":"2024-09-12T01:07:51.612716+0000","last_became_active":"2024-09-12T00:21:48.547356+0000","last_became_peered":"2024-09-12T00:21:48.547356+0000","last_unstale":"2024-09-12T01:07:51.612716+0000","last_undegraded":"2024-09-12T01:07:51.612716+0000","last_fullsized":"2024-09-12T01:07:51.612716+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-12T01:07:51.612333+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-12T01:07:51.612333+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.612333+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.550390+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55196,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":458,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.258274+0000","last_change":"2024-09-12T01:07:52.258274+0000","last_active":"2024-09-12T01:07:52.258274+0000","last_peered":"2024-09-12T01:07:52.258274+0000","last_clean":"2024-09-12T01:07:52.258274+0000","last_became_active":"2024-09-12T00:21:50.556220+0000","last_became_peered":"2024-09-12T00:21:50.556220+0000","last_unstale":"2024-09-12T01:07:52.258274+0000","last_undegraded":"2024-09-12T01:07:52.258274+0000","last_fullsized":"2024-09-12T01:07:52.258274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.258094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.258094+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.258094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.161738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.632683+0000","last_change":"2024-09-12T00:21:52.567877+0000","last_active":"2024-09-12T01:06:04.632683+0000","last_peered":"2024-09-12T01:06:04.632683+0000","last_clean":"2024-09-12T01:06:04.632683+0000","last_became_active":"2024-09-12T00:21:52.567273+0000","last_became_peered":"2024-09-12T00:21:52.567273+0000","last_unstale":"2024-09-12T01:06:04.632683+0000","last_undegraded":"2024-09-12T01:06:04.632683+0000","last_fullsized":"2024-09-12T01:06:04.632683+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:22.583804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'124","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.917629+0000","last_change":"2024-09-12T01:07:53.917629+0000","last_active":"2024-09-12T01:07:53.917629+0000","last_peered":"2024-09-12T01:07:53.917629+0000","last_clean":"2024-09-12T01:07:53.917629+0000","last_became_active":"2024-09-12T00:21:44.502965+0000","last_became_peered":"2024-09-12T00:21:44.502965+0000","last_unstale":"2024-09-12T01:07:53.917629+0000","last_undegraded":"2024-09-12T01:07:53.917629+0000","last_fullsized":"2024-09-12T01:07:53.917629+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'124","last_scrub_stamp":"2024-09-12T01:07:53.917407+0000","last_deep_scrub":"267'124","last_deep_scrub_stamp":"2024-09-12T01:07:53.917407+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.917407+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:24.103740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":435,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'354","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.386999+0000","last_change":"2024-09-12T01:07:37.386999+0000","last_active":"2024-09-12T01:07:37.386999+0000","last_peered":"2024-09-12T01:07:37.386999+0000","last_clean":"2024-09-12T01:07:37.386999+0000","last_became_active":"2024-09-12T00:22:13.520026+0000","last_became_peered":"2024-09-12T00:22:13.520026+0000","last_unstale":"2024-09-12T01:07:37.386999+0000","last_undegraded":"2024-09-12T01:07:37.386999+0000","last_fullsized":"2024-09-12T01:07:37.386999+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T01:07:37.386628+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T01:07:37.386628+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.386628+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:48.359725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254518,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":616,"num_read_kb":38314,"num_write":1135,"num_write_kb":31045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.611545+0000","last_change":"2024-09-12T00:21:46.508177+0000","last_active":"2024-09-12T01:04:34.611545+0000","last_peered":"2024-09-12T01:04:34.611545+0000","last_clean":"2024-09-12T01:04:34.611545+0000","last_became_active":"2024-09-12T00:21:46.507456+0000","last_became_peered":"2024-09-12T00:21:46.507456+0000","last_unstale":"2024-09-12T01:04:34.611545+0000","last_undegraded":"2024-09-12T01:04:34.611545+0000","last_fullsized":"2024-09-12T01:04:34.611545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.624519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'310","reported_seq":892,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.108146+0000","last_change":"2024-09-12T00:21:48.541207+0000","last_active":"2024-09-12T01:07:26.108146+0000","last_peered":"2024-09-12T01:07:26.108146+0000","last_clean":"2024-09-12T01:07:26.108146+0000","last_became_active":"2024-09-12T00:21:48.535782+0000","last_became_peered":"2024-09-12T00:21:48.535782+0000","last_unstale":"2024-09-12T01:07:26.108146+0000","last_undegraded":"2024-09-12T01:07:26.108146+0000","last_fullsized":"2024-09-12T01:07:26.108146+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:36.216700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1134,"num_write":412,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'751","reported_seq":2254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.277045+0000","last_change":"2024-09-12T01:07:50.277045+0000","last_active":"2024-09-12T01:07:50.277045+0000","last_peered":"2024-09-12T01:07:50.277045+0000","last_clean":"2024-09-12T01:07:50.277045+0000","last_became_active":"2024-09-12T00:21:50.557158+0000","last_became_peered":"2024-09-12T00:21:50.557158+0000","last_unstale":"2024-09-12T01:07:50.277045+0000","last_undegraded":"2024-09-12T01:07:50.277045+0000","last_fullsized":"2024-09-12T01:07:50.277045+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-12T01:07:50.276867+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-12T01:07:50.276867+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.276867+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:14.558606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'134","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:05.004395+0000","last_change":"2024-09-12T00:21:52.546563+0000","last_active":"2024-09-12T01:06:05.004395+0000","last_peered":"2024-09-12T01:06:05.004395+0000","last_clean":"2024-09-12T01:06:05.004395+0000","last_became_active":"2024-09-12T00:21:52.545876+0000","last_became_peered":"2024-09-12T00:21:52.545876+0000","last_unstale":"2024-09-12T01:06:05.004395+0000","last_undegraded":"2024-09-12T01:06:05.004395+0000","last_fullsized":"2024-09-12T01:06:05.004395+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":172,"num_write":354,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'141","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.298300+0000","last_change":"2024-09-12T01:07:42.298300+0000","last_active":"2024-09-12T01:07:42.298300+0000","last_peered":"2024-09-12T01:07:42.298300+0000","last_clean":"2024-09-12T01:07:42.298300+0000","last_became_active":"2024-09-12T00:21:44.494386+0000","last_became_peered":"2024-09-12T00:21:44.494386+0000","last_unstale":"2024-09-12T01:07:42.298300+0000","last_undegraded":"2024-09-12T01:07:42.298300+0000","last_fullsized":"2024-09-12T01:07:42.298300+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T01:07:42.298107+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T01:07:42.298107+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.298107+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:49.298297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":627,"num_read_kb":527,"num_write":195,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'416","reported_seq":1113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.903721+0000","last_change":"2024-09-12T01:07:34.903721+0000","last_active":"2024-09-12T01:07:34.903721+0000","last_peered":"2024-09-12T01:07:34.903721+0000","last_clean":"2024-09-12T01:07:34.903721+0000","last_became_active":"2024-09-12T00:21:42.528782+0000","last_became_peered":"2024-09-12T00:21:42.528782+0000","last_unstale":"2024-09-12T01:07:34.903721+0000","last_undegraded":"2024-09-12T01:07:34.903721+0000","last_fullsized":"2024-09-12T01:07:34.903721+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-12T01:07:34.903475+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-12T01:07:34.903475+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.903475+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.315924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170245,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":31515,"num_write":1240,"num_write_kb":36332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"267'10","reported_seq":1955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.565753+0000","last_change":"2024-09-12T01:07:47.565753+0000","last_active":"2024-09-12T01:07:47.565753+0000","last_peered":"2024-09-12T01:07:47.565753+0000","last_clean":"2024-09-12T01:07:47.565753+0000","last_became_active":"2024-09-12T00:21:46.503412+0000","last_became_peered":"2024-09-12T00:21:46.503412+0000","last_unstale":"2024-09-12T01:07:47.565753+0000","last_undegraded":"2024-09-12T01:07:47.565753+0000","last_fullsized":"2024-09-12T01:07:47.565753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T01:07:47.565529+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T01:07:47.565529+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.565529+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:17.675182+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1686,"num_read_kb":2152,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'73","reported_seq":588,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.311430+0000","last_change":"2024-09-12T00:21:48.546361+0000","last_active":"2024-09-12T01:04:48.311430+0000","last_peered":"2024-09-12T01:04:48.311430+0000","last_clean":"2024-09-12T01:04:48.311430+0000","last_became_active":"2024-09-12T00:21:48.545388+0000","last_became_peered":"2024-09-12T00:21:48.545388+0000","last_unstale":"2024-09-12T01:04:48.311430+0000","last_undegraded":"2024-09-12T01:04:48.311430+0000","last_fullsized":"2024-09-12T01:04:48.311430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.386351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":4011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.509944+0000","last_change":"2024-09-12T00:21:50.537415+0000","last_active":"2024-09-12T01:07:25.509944+0000","last_peered":"2024-09-12T01:07:25.509944+0000","last_clean":"2024-09-12T01:07:25.509944+0000","last_became_active":"2024-09-12T00:21:50.536672+0000","last_became_peered":"2024-09-12T00:21:50.536672+0000","last_unstale":"2024-09-12T01:07:25.509944+0000","last_undegraded":"2024-09-12T01:07:25.509944+0000","last_fullsized":"2024-09-12T01:07:25.509944+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":635,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.768222+0000","last_change":"2024-09-12T00:21:52.557213+0000","last_active":"2024-09-12T01:05:39.768222+0000","last_peered":"2024-09-12T01:05:39.768222+0000","last_clean":"2024-09-12T01:05:39.768222+0000","last_became_active":"2024-09-12T00:21:52.556523+0000","last_became_peered":"2024-09-12T00:21:52.556523+0000","last_unstale":"2024-09-12T01:05:39.768222+0000","last_undegraded":"2024-09-12T01:05:39.768222+0000","last_fullsized":"2024-09-12T01:05:39.768222+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":161,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'217","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.091763+0000","last_change":"2024-09-12T01:07:40.091763+0000","last_active":"2024-09-12T01:07:40.091763+0000","last_peered":"2024-09-12T01:07:40.091763+0000","last_clean":"2024-09-12T01:07:40.091763+0000","last_became_active":"2024-09-12T00:21:44.514085+0000","last_became_peered":"2024-09-12T00:21:44.514085+0000","last_unstale":"2024-09-12T01:07:40.091763+0000","last_undegraded":"2024-09-12T01:07:40.091763+0000","last_fullsized":"2024-09-12T01:07:40.091763+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'217","last_scrub_stamp":"2024-09-12T01:07:40.091578+0000","last_deep_scrub":"267'217","last_deep_scrub_stamp":"2024-09-12T01:07:40.091578+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.091578+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:49.279255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":987,"num_read_kb":820,"num_write":332,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'341","reported_seq":965,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.355510+0000","last_change":"2024-09-12T01:07:36.355510+0000","last_active":"2024-09-12T01:07:36.355510+0000","last_peered":"2024-09-12T01:07:36.355510+0000","last_clean":"2024-09-12T01:07:36.355510+0000","last_became_active":"2024-09-12T00:21:42.484728+0000","last_became_peered":"2024-09-12T00:21:42.484728+0000","last_unstale":"2024-09-12T01:07:36.355510+0000","last_undegraded":"2024-09-12T01:07:36.355510+0000","last_fullsized":"2024-09-12T01:07:36.355510+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:36.355185+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:36.355185+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.355185+0000","objects_scrubbed":9,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:41.361142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":1781,"num_write":1014,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:34.630684+0000","last_change":"2024-09-12T00:21:46.515775+0000","last_active":"2024-09-12T01:04:34.630684+0000","last_peered":"2024-09-12T01:04:34.630684+0000","last_clean":"2024-09-12T01:04:34.630684+0000","last_became_active":"2024-09-12T00:21:46.515469+0000","last_became_peered":"2024-09-12T00:21:46.515469+0000","last_unstale":"2024-09-12T01:04:34.630684+0000","last_undegraded":"2024-09-12T01:04:34.630684+0000","last_fullsized":"2024-09-12T01:04:34.630684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:12.258449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'349","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.611743+0000","last_change":"2024-09-12T01:07:50.611743+0000","last_active":"2024-09-12T01:07:50.611743+0000","last_peered":"2024-09-12T01:07:50.611743+0000","last_clean":"2024-09-12T01:07:50.611743+0000","last_became_active":"2024-09-12T00:21:48.523392+0000","last_became_peered":"2024-09-12T00:21:48.523392+0000","last_unstale":"2024-09-12T01:07:50.611743+0000","last_undegraded":"2024-09-12T01:07:50.611743+0000","last_fullsized":"2024-09-12T01:07:50.611743+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:50.611343+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:50.611343+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.611343+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:19.848968+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50746,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1171,"num_write":440,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.158670+0000","last_change":"2024-09-12T01:07:53.158670+0000","last_active":"2024-09-12T01:07:53.158670+0000","last_peered":"2024-09-12T01:07:53.158670+0000","last_clean":"2024-09-12T01:07:53.158670+0000","last_became_active":"2024-09-12T00:21:50.566831+0000","last_became_peered":"2024-09-12T00:21:50.566831+0000","last_unstale":"2024-09-12T01:07:53.158670+0000","last_undegraded":"2024-09-12T01:07:53.158670+0000","last_fullsized":"2024-09-12T01:07:53.158670+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.158455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.158455+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.158455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.192498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'158","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.606623+0000","last_change":"2024-09-12T00:21:52.563487+0000","last_active":"2024-09-12T01:05:38.606623+0000","last_peered":"2024-09-12T01:05:38.606623+0000","last_clean":"2024-09-12T01:05:38.606623+0000","last_became_active":"2024-09-12T00:21:52.562716+0000","last_became_peered":"2024-09-12T00:21:52.562716+0000","last_unstale":"2024-09-12T01:05:38.606623+0000","last_undegraded":"2024-09-12T01:05:38.606623+0000","last_fullsized":"2024-09-12T01:05:38.606623+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":186,"num_write":388,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'137","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.915375+0000","last_change":"2024-09-12T01:07:52.915375+0000","last_active":"2024-09-12T01:07:52.915375+0000","last_peered":"2024-09-12T01:07:52.915375+0000","last_clean":"2024-09-12T01:07:52.915375+0000","last_became_active":"2024-09-12T00:21:44.502832+0000","last_became_peered":"2024-09-12T00:21:44.502832+0000","last_unstale":"2024-09-12T01:07:52.915375+0000","last_undegraded":"2024-09-12T01:07:52.915375+0000","last_fullsized":"2024-09-12T01:07:52.915375+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-12T01:07:52.915187+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-12T01:07:52.915187+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.915187+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:13.701531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":521,"num_write":201,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.580210+0000","last_change":"2024-09-12T01:07:32.580034+0000","last_active":"2024-09-12T01:07:32.580210+0000","last_peered":"2024-09-12T01:07:32.580210+0000","last_clean":"2024-09-12T01:07:32.580210+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T01:07:32.580210+0000","last_undegraded":"2024-09-12T01:07:32.580210+0000","last_fullsized":"2024-09-12T01:07:32.580210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_clean_scrub_stamp":"2024-09-12T01:07:32.579842+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:04.507720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.906029+0000","last_change":"2024-09-12T01:07:35.906029+0000","last_active":"2024-09-12T01:07:35.906029+0000","last_peered":"2024-09-12T01:07:35.906029+0000","last_clean":"2024-09-12T01:07:35.906029+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T01:07:35.906029+0000","last_undegraded":"2024-09-12T01:07:35.906029+0000","last_fullsized":"2024-09-12T01:07:35.906029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:35.905826+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:35.905826+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.905826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:16.286458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'330","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.395101+0000","last_change":"2024-09-12T01:07:34.394877+0000","last_active":"2024-09-12T01:07:34.395101+0000","last_peered":"2024-09-12T01:07:34.395101+0000","last_clean":"2024-09-12T01:07:34.395101+0000","last_became_active":"2024-09-12T00:21:42.513672+0000","last_became_peered":"2024-09-12T00:21:42.513672+0000","last_unstale":"2024-09-12T01:07:34.395101+0000","last_undegraded":"2024-09-12T01:07:34.395101+0000","last_fullsized":"2024-09-12T01:07:34.395101+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.394679+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:03.112904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":4546,"num_write":1074,"num_write_kb":26678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.033296+0000","last_change":"2024-09-12T01:07:53.033296+0000","last_active":"2024-09-12T01:07:53.033296+0000","last_peered":"2024-09-12T01:07:53.033296+0000","last_clean":"2024-09-12T01:07:53.033296+0000","last_became_active":"2024-09-12T00:21:46.506196+0000","last_became_peered":"2024-09-12T00:21:46.506196+0000","last_unstale":"2024-09-12T01:07:53.033296+0000","last_undegraded":"2024-09-12T01:07:53.033296+0000","last_fullsized":"2024-09-12T01:07:53.033296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.033120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.033120+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.033120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:50.956403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'732","reported_seq":1443,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.450106+0000","last_change":"2024-09-12T00:21:48.545130+0000","last_active":"2024-09-12T01:07:27.450106+0000","last_peered":"2024-09-12T01:07:27.450106+0000","last_clean":"2024-09-12T01:07:27.450106+0000","last_became_active":"2024-09-12T00:21:48.544327+0000","last_became_peered":"2024-09-12T00:21:48.544327+0000","last_unstale":"2024-09-12T01:07:27.450106+0000","last_undegraded":"2024-09-12T01:07:27.450106+0000","last_fullsized":"2024-09-12T01:07:27.450106+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:21.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135809,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1416,"num_read_kb":3269,"num_write":1306,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.621223+0000","last_change":"2024-09-12T00:21:50.565245+0000","last_active":"2024-09-12T01:05:14.621223+0000","last_peered":"2024-09-12T01:05:14.621223+0000","last_clean":"2024-09-12T01:05:14.621223+0000","last_became_active":"2024-09-12T00:21:50.564442+0000","last_became_peered":"2024-09-12T00:21:50.564442+0000","last_unstale":"2024-09-12T01:05:14.621223+0000","last_undegraded":"2024-09-12T01:05:14.621223+0000","last_fullsized":"2024-09-12T01:05:14.621223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'208","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.998487+0000","last_change":"2024-09-12T01:07:53.998487+0000","last_active":"2024-09-12T01:07:53.998487+0000","last_peered":"2024-09-12T01:07:53.998487+0000","last_clean":"2024-09-12T01:07:53.998487+0000","last_became_active":"2024-09-12T00:21:52.550903+0000","last_became_peered":"2024-09-12T00:21:52.550903+0000","last_unstale":"2024-09-12T01:07:53.998487+0000","last_undegraded":"2024-09-12T01:07:53.998487+0000","last_fullsized":"2024-09-12T01:07:53.998487+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-12T01:07:53.998298+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-12T01:07:53.998298+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.998298+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:09.883248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":429,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'100","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.989390+0000","last_change":"2024-09-12T01:07:48.989390+0000","last_active":"2024-09-12T01:07:48.989390+0000","last_peered":"2024-09-12T01:07:48.989390+0000","last_clean":"2024-09-12T01:07:48.989390+0000","last_became_active":"2024-09-12T00:21:44.518873+0000","last_became_peered":"2024-09-12T00:21:44.518873+0000","last_unstale":"2024-09-12T01:07:48.989390+0000","last_undegraded":"2024-09-12T01:07:48.989390+0000","last_fullsized":"2024-09-12T01:07:48.989390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-09-12T01:07:48.989211+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-09-12T01:07:48.989211+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.989211+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:37.038222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":399,"num_write":140,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.899210+0000","last_change":"2024-09-12T01:07:33.899120+0000","last_active":"2024-09-12T01:07:33.899210+0000","last_peered":"2024-09-12T01:07:33.899210+0000","last_clean":"2024-09-12T01:07:33.899210+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T01:07:33.899210+0000","last_undegraded":"2024-09-12T01:07:33.899210+0000","last_fullsized":"2024-09-12T01:07:33.899210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.899012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:18.503999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'343","reported_seq":1176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.346185+0000","last_change":"2024-09-12T01:07:35.346185+0000","last_active":"2024-09-12T01:07:35.346185+0000","last_peered":"2024-09-12T01:07:35.346185+0000","last_clean":"2024-09-12T01:07:35.346185+0000","last_became_active":"2024-09-12T00:21:42.530049+0000","last_became_peered":"2024-09-12T00:21:42.530049+0000","last_unstale":"2024-09-12T01:07:35.346185+0000","last_undegraded":"2024-09-12T01:07:35.346185+0000","last_fullsized":"2024-09-12T01:07:35.346185+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T01:07:35.345949+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T01:07:35.345949+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.345949+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.411177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":794,"num_read_kb":7845,"num_write":1116,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.639489+0000","last_change":"2024-09-12T00:21:46.506977+0000","last_active":"2024-09-12T01:05:09.639489+0000","last_peered":"2024-09-12T01:05:09.639489+0000","last_clean":"2024-09-12T01:05:09.639489+0000","last_became_active":"2024-09-12T00:21:46.506303+0000","last_became_peered":"2024-09-12T00:21:46.506303+0000","last_unstale":"2024-09-12T01:05:09.639489+0000","last_undegraded":"2024-09-12T01:05:09.639489+0000","last_fullsized":"2024-09-12T01:05:09.639489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:15.859039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1273","reported_seq":2766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.281768+0000","last_change":"2024-09-12T01:07:51.281768+0000","last_active":"2024-09-12T01:07:51.281768+0000","last_peered":"2024-09-12T01:07:51.281768+0000","last_clean":"2024-09-12T01:07:51.281768+0000","last_became_active":"2024-09-12T00:21:48.538447+0000","last_became_peered":"2024-09-12T00:21:48.538447+0000","last_unstale":"2024-09-12T01:07:51.281768+0000","last_undegraded":"2024-09-12T01:07:51.281768+0000","last_fullsized":"2024-09-12T01:07:51.281768+0000","mapping_epoch":32,"log_start":"267'1200","ondisk_log_start":"267'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1273","last_scrub_stamp":"2024-09-12T01:07:51.281563+0000","last_deep_scrub":"267'1273","last_deep_scrub_stamp":"2024-09-12T01:07:51.281563+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.281563+0000","objects_scrubbed":12,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.388345+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157796,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2036,"num_read_kb":3848,"num_write":1138,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.617264+0000","last_change":"2024-09-12T00:21:50.569042+0000","last_active":"2024-09-12T01:03:44.617264+0000","last_peered":"2024-09-12T01:03:44.617264+0000","last_clean":"2024-09-12T01:03:44.617264+0000","last_became_active":"2024-09-12T00:21:50.568353+0000","last_became_peered":"2024-09-12T00:21:50.568353+0000","last_unstale":"2024-09-12T01:03:44.617264+0000","last_undegraded":"2024-09-12T01:03:44.617264+0000","last_fullsized":"2024-09-12T01:03:44.617264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:29.701524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'220","reported_seq":750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.623554+0000","last_change":"2024-09-12T00:21:52.560037+0000","last_active":"2024-09-12T01:05:24.623554+0000","last_peered":"2024-09-12T01:05:24.623554+0000","last_clean":"2024-09-12T01:05:24.623554+0000","last_became_active":"2024-09-12T00:21:52.559325+0000","last_became_peered":"2024-09-12T00:21:52.559325+0000","last_unstale":"2024-09-12T01:05:24.623554+0000","last_undegraded":"2024-09-12T01:05:24.623554+0000","last_fullsized":"2024-09-12T01:05:24.623554+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":373,"num_write":495,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'235","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.322614+0000","last_change":"2024-09-12T01:07:47.322614+0000","last_active":"2024-09-12T01:07:47.322614+0000","last_peered":"2024-09-12T01:07:47.322614+0000","last_clean":"2024-09-12T01:07:47.322614+0000","last_became_active":"2024-09-12T00:21:44.499405+0000","last_became_peered":"2024-09-12T00:21:44.499405+0000","last_unstale":"2024-09-12T01:07:47.322614+0000","last_undegraded":"2024-09-12T01:07:47.322614+0000","last_fullsized":"2024-09-12T01:07:47.322614+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'235","last_scrub_stamp":"2024-09-12T01:07:47.322434+0000","last_deep_scrub":"267'235","last_deep_scrub_stamp":"2024-09-12T01:07:47.322434+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.322434+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:14.108801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":847,"num_write":402,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.153871+0000","last_change":"2024-09-12T01:07:36.153871+0000","last_active":"2024-09-12T01:07:36.153871+0000","last_peered":"2024-09-12T01:07:36.153871+0000","last_clean":"2024-09-12T01:07:36.153871+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T01:07:36.153871+0000","last_undegraded":"2024-09-12T01:07:36.153871+0000","last_fullsized":"2024-09-12T01:07:36.153871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:36.153692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:36.153692+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.153692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:30.299331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'318","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.085677+0000","last_change":"2024-09-12T01:07:36.085507+0000","last_active":"2024-09-12T01:07:36.085677+0000","last_peered":"2024-09-12T01:07:36.085677+0000","last_clean":"2024-09-12T01:07:36.085677+0000","last_became_active":"2024-09-12T00:21:42.533356+0000","last_became_peered":"2024-09-12T00:21:42.533356+0000","last_unstale":"2024-09-12T01:07:36.085677+0000","last_undegraded":"2024-09-12T01:07:36.085677+0000","last_fullsized":"2024-09-12T01:07:36.085677+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'318","last_scrub_stamp":"2024-09-12T01:07:36.085311+0000","last_deep_scrub":"267'318","last_deep_scrub_stamp":"2024-09-12T01:07:36.085311+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.085311+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:29.914431+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":11281,"num_write":971,"num_write_kb":25420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.238554+0000","last_change":"2024-09-12T01:07:47.238554+0000","last_active":"2024-09-12T01:07:47.238554+0000","last_peered":"2024-09-12T01:07:47.238554+0000","last_clean":"2024-09-12T01:07:47.238554+0000","last_became_active":"2024-09-12T00:21:46.510230+0000","last_became_peered":"2024-09-12T00:21:46.510230+0000","last_unstale":"2024-09-12T01:07:47.238554+0000","last_undegraded":"2024-09-12T01:07:47.238554+0000","last_fullsized":"2024-09-12T01:07:47.238554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:47.238372+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:47.238372+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.238372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:41.000780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'245","reported_seq":1351,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.046686+0000","last_change":"2024-09-12T01:07:49.046525+0000","last_active":"2024-09-12T01:07:49.046686+0000","last_peered":"2024-09-12T01:07:49.046686+0000","last_clean":"2024-09-12T01:07:49.046686+0000","last_became_active":"2024-09-12T00:21:48.541987+0000","last_became_peered":"2024-09-12T00:21:48.541987+0000","last_unstale":"2024-09-12T01:07:49.046686+0000","last_undegraded":"2024-09-12T01:07:49.046686+0000","last_fullsized":"2024-09-12T01:07:49.046686+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-12T01:07:49.046303+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-12T01:07:49.046303+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.046303+0000","objects_scrubbed":9,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.771459+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.599394+0000","last_change":"2024-09-12T00:21:50.550098+0000","last_active":"2024-09-12T01:05:39.599394+0000","last_peered":"2024-09-12T01:05:39.599394+0000","last_clean":"2024-09-12T01:05:39.599394+0000","last_became_active":"2024-09-12T00:21:50.549468+0000","last_became_peered":"2024-09-12T00:21:50.549468+0000","last_unstale":"2024-09-12T01:05:39.599394+0000","last_undegraded":"2024-09-12T01:05:39.599394+0000","last_fullsized":"2024-09-12T01:05:39.599394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'266","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.525444+0000","last_change":"2024-09-12T00:21:52.553306+0000","last_active":"2024-09-12T01:06:07.525444+0000","last_peered":"2024-09-12T01:06:07.525444+0000","last_clean":"2024-09-12T01:06:07.525444+0000","last_became_active":"2024-09-12T00:21:52.552571+0000","last_became_peered":"2024-09-12T00:21:52.552571+0000","last_unstale":"2024-09-12T01:06:07.525444+0000","last_undegraded":"2024-09-12T01:06:07.525444+0000","last_fullsized":"2024-09-12T01:06:07.525444+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.410934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":539,"num_write":598,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'152","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.362750+0000","last_change":"2024-09-12T01:07:45.362750+0000","last_active":"2024-09-12T01:07:45.362750+0000","last_peered":"2024-09-12T01:07:45.362750+0000","last_clean":"2024-09-12T01:07:45.362750+0000","last_became_active":"2024-09-12T00:21:44.493744+0000","last_became_peered":"2024-09-12T00:21:44.493744+0000","last_unstale":"2024-09-12T01:07:45.362750+0000","last_undegraded":"2024-09-12T01:07:45.362750+0000","last_fullsized":"2024-09-12T01:07:45.362750+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:07:45.362559+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:07:45.362559+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.362559+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:35.283238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":592,"num_write":229,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.900196+0000","last_change":"2024-09-12T01:07:38.900196+0000","last_active":"2024-09-12T01:07:38.900196+0000","last_peered":"2024-09-12T01:07:38.900196+0000","last_clean":"2024-09-12T01:07:38.900196+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T01:07:38.900196+0000","last_undegraded":"2024-09-12T01:07:38.900196+0000","last_fullsized":"2024-09-12T01:07:38.900196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:07:38.899976+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:07:38.899976+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.899976+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.986434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'327","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.015691+0000","last_change":"2024-09-12T01:07:34.015525+0000","last_active":"2024-09-12T01:07:34.015691+0000","last_peered":"2024-09-12T01:07:34.015691+0000","last_clean":"2024-09-12T01:07:34.015691+0000","last_became_active":"2024-09-12T00:21:42.528949+0000","last_became_peered":"2024-09-12T00:21:42.528949+0000","last_unstale":"2024-09-12T01:07:34.015691+0000","last_undegraded":"2024-09-12T01:07:34.015691+0000","last_fullsized":"2024-09-12T01:07:34.015691+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.015318+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.629212+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":67654,"num_write":1033,"num_write_kb":55160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.190802+0000","last_change":"2024-09-12T01:07:46.190671+0000","last_active":"2024-09-12T01:07:46.190802+0000","last_peered":"2024-09-12T01:07:46.190802+0000","last_clean":"2024-09-12T01:07:46.190802+0000","last_became_active":"2024-09-12T00:21:46.517381+0000","last_became_peered":"2024-09-12T00:21:46.517381+0000","last_unstale":"2024-09-12T01:07:46.190802+0000","last_undegraded":"2024-09-12T01:07:46.190802+0000","last_fullsized":"2024-09-12T01:07:46.190802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:46.190493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:46.190493+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.190493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:43.299136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'120","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.029686+0000","last_change":"2024-09-12T00:21:48.553881+0000","last_active":"2024-09-12T01:07:13.029686+0000","last_peered":"2024-09-12T01:07:13.029686+0000","last_clean":"2024-09-12T01:07:13.029686+0000","last_became_active":"2024-09-12T00:21:48.553129+0000","last_became_peered":"2024-09-12T00:21:48.553129+0000","last_unstale":"2024-09-12T01:07:13.029686+0000","last_undegraded":"2024-09-12T01:07:13.029686+0000","last_fullsized":"2024-09-12T01:07:13.029686+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:52.650170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.640743+0000","last_change":"2024-09-12T00:21:50.545732+0000","last_active":"2024-09-12T01:05:14.640743+0000","last_peered":"2024-09-12T01:05:14.640743+0000","last_clean":"2024-09-12T01:05:14.640743+0000","last_became_active":"2024-09-12T00:21:50.545037+0000","last_became_peered":"2024-09-12T00:21:50.545037+0000","last_unstale":"2024-09-12T01:05:14.640743+0000","last_undegraded":"2024-09-12T01:05:14.640743+0000","last_fullsized":"2024-09-12T01:05:14.640743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'98","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.414533+0000","last_change":"2024-09-12T00:21:52.541609+0000","last_active":"2024-09-12T01:06:07.414533+0000","last_peered":"2024-09-12T01:06:07.414533+0000","last_clean":"2024-09-12T01:06:07.414533+0000","last_became_active":"2024-09-12T00:21:52.540900+0000","last_became_peered":"2024-09-12T00:21:52.540900+0000","last_unstale":"2024-09-12T01:06:07.414533+0000","last_undegraded":"2024-09-12T01:06:07.414533+0000","last_fullsized":"2024-09-12T01:06:07.414533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:38.138742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":212,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'221","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.354086+0000","last_change":"2024-09-12T01:07:43.354086+0000","last_active":"2024-09-12T01:07:43.354086+0000","last_peered":"2024-09-12T01:07:43.354086+0000","last_clean":"2024-09-12T01:07:43.354086+0000","last_became_active":"2024-09-12T00:21:44.497354+0000","last_became_peered":"2024-09-12T00:21:44.497354+0000","last_unstale":"2024-09-12T01:07:43.354086+0000","last_undegraded":"2024-09-12T01:07:43.354086+0000","last_fullsized":"2024-09-12T01:07:43.354086+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'221","last_scrub_stamp":"2024-09-12T01:07:43.353908+0000","last_deep_scrub":"267'221","last_deep_scrub_stamp":"2024-09-12T01:07:43.353908+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.353908+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.870435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":990,"num_read_kb":806,"num_write":357,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'303","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.246792+0000","last_change":"2024-09-12T01:07:34.246713+0000","last_active":"2024-09-12T01:07:34.246792+0000","last_peered":"2024-09-12T01:07:34.246792+0000","last_clean":"2024-09-12T01:07:34.246792+0000","last_became_active":"2024-09-12T00:21:42.521990+0000","last_became_peered":"2024-09-12T00:21:42.521990+0000","last_unstale":"2024-09-12T01:07:34.246792+0000","last_undegraded":"2024-09-12T01:07:34.246792+0000","last_fullsized":"2024-09-12T01:07:34.246792+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'303","last_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_deep_scrub":"267'303","last_deep_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.246523+0000","objects_scrubbed":10,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.373734+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829291,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":446,"num_read_kb":61837,"num_write":1004,"num_write_kb":29041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.063098+0000","last_change":"2024-09-12T01:07:35.063098+0000","last_active":"2024-09-12T01:07:35.063098+0000","last_peered":"2024-09-12T01:07:35.063098+0000","last_clean":"2024-09-12T01:07:35.063098+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T01:07:35.063098+0000","last_undegraded":"2024-09-12T01:07:35.063098+0000","last_fullsized":"2024-09-12T01:07:35.063098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:35.062821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:35.062821+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.062821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:09.059649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.293267+0000","last_change":"2024-09-12T01:07:52.293267+0000","last_active":"2024-09-12T01:07:52.293267+0000","last_peered":"2024-09-12T01:07:52.293267+0000","last_clean":"2024-09-12T01:07:52.293267+0000","last_became_active":"2024-09-12T00:21:46.498378+0000","last_became_peered":"2024-09-12T00:21:46.498378+0000","last_unstale":"2024-09-12T01:07:52.293267+0000","last_undegraded":"2024-09-12T01:07:52.293267+0000","last_fullsized":"2024-09-12T01:07:52.293267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.293052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.293052+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.293052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:39.789136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'587","reported_seq":1263,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.284958+0000","last_change":"2024-09-12T01:07:49.284958+0000","last_active":"2024-09-12T01:07:49.284958+0000","last_peered":"2024-09-12T01:07:49.284958+0000","last_clean":"2024-09-12T01:07:49.284958+0000","last_became_active":"2024-09-12T00:21:48.534749+0000","last_became_peered":"2024-09-12T00:21:48.534749+0000","last_unstale":"2024-09-12T01:07:49.284958+0000","last_undegraded":"2024-09-12T01:07:49.284958+0000","last_fullsized":"2024-09-12T01:07:49.284958+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'587","last_scrub_stamp":"2024-09-12T01:07:49.284741+0000","last_deep_scrub":"267'587","last_deep_scrub_stamp":"2024-09-12T01:07:49.284741+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.284741+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:51.464003+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96095,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1602,"num_read_kb":2762,"num_write":2078,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508332,"num_omap_keys":1154,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.138849+0000","last_change":"2024-09-12T01:07:54.138849+0000","last_active":"2024-09-12T01:07:54.138849+0000","last_peered":"2024-09-12T01:07:54.138849+0000","last_clean":"2024-09-12T01:07:54.138849+0000","last_became_active":"2024-09-12T00:21:50.554728+0000","last_became_peered":"2024-09-12T00:21:50.554728+0000","last_unstale":"2024-09-12T01:07:54.138849+0000","last_undegraded":"2024-09-12T01:07:54.138849+0000","last_fullsized":"2024-09-12T01:07:54.138849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.138667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.138667+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.138667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:32.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'174","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.400639+0000","last_change":"2024-09-12T00:21:52.558976+0000","last_active":"2024-09-12T01:05:25.400639+0000","last_peered":"2024-09-12T01:05:25.400639+0000","last_clean":"2024-09-12T01:05:25.400639+0000","last_became_active":"2024-09-12T00:21:52.558203+0000","last_became_peered":"2024-09-12T00:21:52.558203+0000","last_unstale":"2024-09-12T01:05:25.400639+0000","last_undegraded":"2024-09-12T01:05:25.400639+0000","last_fullsized":"2024-09-12T01:05:25.400639+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:46.691847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1145,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":410,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'196","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.367538+0000","last_change":"2024-09-12T01:07:50.367538+0000","last_active":"2024-09-12T01:07:50.367538+0000","last_peered":"2024-09-12T01:07:50.367538+0000","last_clean":"2024-09-12T01:07:50.367538+0000","last_became_active":"2024-09-12T00:21:44.497510+0000","last_became_peered":"2024-09-12T00:21:44.497510+0000","last_unstale":"2024-09-12T01:07:50.367538+0000","last_undegraded":"2024-09-12T01:07:50.367538+0000","last_fullsized":"2024-09-12T01:07:50.367538+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T01:07:50.367359+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T01:07:50.367359+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.367359+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:59.657265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":719,"num_write":306,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'327","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.363959+0000","last_change":"2024-09-12T01:07:36.363959+0000","last_active":"2024-09-12T01:07:36.363959+0000","last_peered":"2024-09-12T01:07:36.363959+0000","last_clean":"2024-09-12T01:07:36.363959+0000","last_became_active":"2024-09-12T00:21:42.529084+0000","last_became_peered":"2024-09-12T00:21:42.529084+0000","last_unstale":"2024-09-12T01:07:36.363959+0000","last_undegraded":"2024-09-12T01:07:36.363959+0000","last_fullsized":"2024-09-12T01:07:36.363959+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:36.363681+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:36.363681+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.363681+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:32.434284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":3172,"num_write":1083,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.918656+0000","last_change":"2024-09-12T01:07:37.918656+0000","last_active":"2024-09-12T01:07:37.918656+0000","last_peered":"2024-09-12T01:07:37.918656+0000","last_clean":"2024-09-12T01:07:37.918656+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T01:07:37.918656+0000","last_undegraded":"2024-09-12T01:07:37.918656+0000","last_fullsized":"2024-09-12T01:07:37.918656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:37.918454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:37.918454+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.918454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:38.398571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.053317+0000","last_change":"2024-09-12T01:07:45.053317+0000","last_active":"2024-09-12T01:07:45.053317+0000","last_peered":"2024-09-12T01:07:45.053317+0000","last_clean":"2024-09-12T01:07:45.053317+0000","last_became_active":"2024-09-12T00:21:46.507150+0000","last_became_peered":"2024-09-12T00:21:46.507150+0000","last_unstale":"2024-09-12T01:07:45.053317+0000","last_undegraded":"2024-09-12T01:07:45.053317+0000","last_fullsized":"2024-09-12T01:07:45.053317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:45.053133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:45.053133+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.053133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:32.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'166","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.599744+0000","last_change":"2024-09-12T00:21:48.546326+0000","last_active":"2024-09-12T01:05:34.599744+0000","last_peered":"2024-09-12T01:05:34.599744+0000","last_clean":"2024-09-12T01:05:34.599744+0000","last_became_active":"2024-09-12T00:21:48.545244+0000","last_became_peered":"2024-09-12T00:21:48.545244+0000","last_unstale":"2024-09-12T01:05:34.599744+0000","last_undegraded":"2024-09-12T01:05:34.599744+0000","last_fullsized":"2024-09-12T01:05:34.599744+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'771","reported_seq":2809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.556779+0000","last_change":"2024-09-12T01:07:53.556779+0000","last_active":"2024-09-12T01:07:53.556779+0000","last_peered":"2024-09-12T01:07:53.556779+0000","last_clean":"2024-09-12T01:07:53.556779+0000","last_became_active":"2024-09-12T00:21:50.565930+0000","last_became_peered":"2024-09-12T00:21:50.565930+0000","last_unstale":"2024-09-12T01:07:53.556779+0000","last_undegraded":"2024-09-12T01:07:53.556779+0000","last_fullsized":"2024-09-12T01:07:53.556779+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-09-12T01:07:53.556571+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-09-12T01:07:53.556571+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.556571+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:43.011606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.868125+0000","last_change":"2024-09-12T00:21:52.563826+0000","last_active":"2024-09-12T01:07:12.868125+0000","last_peered":"2024-09-12T01:07:12.868125+0000","last_clean":"2024-09-12T01:07:12.868125+0000","last_became_active":"2024-09-12T00:21:52.562765+0000","last_became_peered":"2024-09-12T00:21:52.562765+0000","last_unstale":"2024-09-12T01:07:12.868125+0000","last_undegraded":"2024-09-12T01:07:12.868125+0000","last_fullsized":"2024-09-12T01:07:12.868125+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.216884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":136,"num_write":336,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'107","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.465315+0000","last_change":"2024-09-12T01:07:43.465139+0000","last_active":"2024-09-12T01:07:43.465315+0000","last_peered":"2024-09-12T01:07:43.465315+0000","last_clean":"2024-09-12T01:07:43.465315+0000","last_became_active":"2024-09-12T00:21:44.492443+0000","last_became_peered":"2024-09-12T00:21:44.492443+0000","last_unstale":"2024-09-12T01:07:43.465315+0000","last_undegraded":"2024-09-12T01:07:43.465315+0000","last_fullsized":"2024-09-12T01:07:43.465315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-12T01:07:43.464916+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-12T01:07:43.464916+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.464916+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:25.554086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":379,"num_write":156,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'324","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.352910+0000","last_change":"2024-09-12T01:07:35.352910+0000","last_active":"2024-09-12T01:07:35.352910+0000","last_peered":"2024-09-12T01:07:35.352910+0000","last_clean":"2024-09-12T01:07:35.352910+0000","last_became_active":"2024-09-12T00:21:42.505355+0000","last_became_peered":"2024-09-12T00:21:42.505355+0000","last_unstale":"2024-09-12T01:07:35.352910+0000","last_undegraded":"2024-09-12T01:07:35.352910+0000","last_fullsized":"2024-09-12T01:07:35.352910+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-12T01:07:35.352717+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-12T01:07:35.352717+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.352717+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:26.053174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":8879,"num_write":1116,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.499649+0000","last_change":"2024-09-12T01:07:40.499649+0000","last_active":"2024-09-12T01:07:40.499649+0000","last_peered":"2024-09-12T01:07:40.499649+0000","last_clean":"2024-09-12T01:07:40.499649+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T01:07:40.499649+0000","last_undegraded":"2024-09-12T01:07:40.499649+0000","last_fullsized":"2024-09-12T01:07:40.499649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:40.499465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:40.499465+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.499465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:44.908987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.646093+0000","last_change":"2024-09-12T00:21:46.507186+0000","last_active":"2024-09-12T01:05:34.646093+0000","last_peered":"2024-09-12T01:05:34.646093+0000","last_clean":"2024-09-12T01:05:34.646093+0000","last_became_active":"2024-09-12T00:21:46.506416+0000","last_became_peered":"2024-09-12T00:21:46.506416+0000","last_unstale":"2024-09-12T01:05:34.646093+0000","last_undegraded":"2024-09-12T01:05:34.646093+0000","last_fullsized":"2024-09-12T01:05:34.646093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'112","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.646213+0000","last_change":"2024-09-12T00:21:48.541779+0000","last_active":"2024-09-12T01:05:34.646213+0000","last_peered":"2024-09-12T01:05:34.646213+0000","last_clean":"2024-09-12T01:05:34.646213+0000","last_became_active":"2024-09-12T00:21:48.541051+0000","last_became_peered":"2024-09-12T00:21:48.541051+0000","last_unstale":"2024-09-12T01:05:34.646213+0000","last_undegraded":"2024-09-12T01:05:34.646213+0000","last_fullsized":"2024-09-12T01:05:34.646213+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'781","reported_seq":2256,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.711606+0000","last_change":"2024-09-12T00:21:50.565496+0000","last_active":"2024-09-12T01:07:27.711606+0000","last_peered":"2024-09-12T01:07:27.711606+0000","last_clean":"2024-09-12T01:07:27.711606+0000","last_became_active":"2024-09-12T00:21:50.564982+0000","last_became_peered":"2024-09-12T00:21:50.564982+0000","last_unstale":"2024-09-12T01:07:27.711606+0000","last_undegraded":"2024-09-12T01:07:27.711606+0000","last_fullsized":"2024-09-12T01:07:27.711606+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'150","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.238137+0000","last_change":"2024-09-12T00:21:52.556569+0000","last_active":"2024-09-12T01:05:51.238137+0000","last_peered":"2024-09-12T01:05:51.238137+0000","last_clean":"2024-09-12T01:05:51.238137+0000","last_became_active":"2024-09-12T00:21:52.555909+0000","last_became_peered":"2024-09-12T00:21:52.555909+0000","last_unstale":"2024-09-12T01:05:51.238137+0000","last_undegraded":"2024-09-12T01:05:51.238137+0000","last_fullsized":"2024-09-12T01:05:51.238137+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:36.848678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":331,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'167","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.277506+0000","last_change":"2024-09-12T01:07:40.277506+0000","last_active":"2024-09-12T01:07:40.277506+0000","last_peered":"2024-09-12T01:07:40.277506+0000","last_clean":"2024-09-12T01:07:40.277506+0000","last_became_active":"2024-09-12T00:21:44.494215+0000","last_became_peered":"2024-09-12T00:21:44.494215+0000","last_unstale":"2024-09-12T01:07:40.277506+0000","last_undegraded":"2024-09-12T01:07:40.277506+0000","last_fullsized":"2024-09-12T01:07:40.277506+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T01:07:40.277272+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T01:07:40.277272+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.277272+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:51.529239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":568,"num_write":276,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'381","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.449381+0000","last_change":"2024-09-12T01:07:38.449381+0000","last_active":"2024-09-12T01:07:38.449381+0000","last_peered":"2024-09-12T01:07:38.449381+0000","last_clean":"2024-09-12T01:07:38.449381+0000","last_became_active":"2024-09-12T00:21:42.494486+0000","last_became_peered":"2024-09-12T00:21:42.494486+0000","last_unstale":"2024-09-12T01:07:38.449381+0000","last_undegraded":"2024-09-12T01:07:38.449381+0000","last_fullsized":"2024-09-12T01:07:38.449381+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-09-12T01:07:38.449164+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-09-12T01:07:38.449164+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.449164+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:59.455133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":23252,"num_write":1238,"num_write_kb":41943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.889902+0000","last_change":"2024-09-12T01:07:39.889902+0000","last_active":"2024-09-12T01:07:39.889902+0000","last_peered":"2024-09-12T01:07:39.889902+0000","last_clean":"2024-09-12T01:07:39.889902+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T01:07:39.889902+0000","last_undegraded":"2024-09-12T01:07:39.889902+0000","last_fullsized":"2024-09-12T01:07:39.889902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:39.889727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:39.889727+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.889727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:24.646676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.349312+0000","last_change":"2024-09-12T01:07:50.349312+0000","last_active":"2024-09-12T01:07:50.349312+0000","last_peered":"2024-09-12T01:07:50.349312+0000","last_clean":"2024-09-12T01:07:50.349312+0000","last_became_active":"2024-09-12T00:21:46.490398+0000","last_became_peered":"2024-09-12T00:21:46.490398+0000","last_unstale":"2024-09-12T01:07:50.349312+0000","last_undegraded":"2024-09-12T01:07:50.349312+0000","last_fullsized":"2024-09-12T01:07:50.349312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:50.349131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:50.349131+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.349131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:36.059419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'722","reported_seq":1458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.063819+0000","last_change":"2024-09-12T01:07:51.063819+0000","last_active":"2024-09-12T01:07:51.063819+0000","last_peered":"2024-09-12T01:07:51.063819+0000","last_clean":"2024-09-12T01:07:51.063819+0000","last_became_active":"2024-09-12T00:21:48.543101+0000","last_became_peered":"2024-09-12T00:21:48.543101+0000","last_unstale":"2024-09-12T01:07:51.063819+0000","last_undegraded":"2024-09-12T01:07:51.063819+0000","last_fullsized":"2024-09-12T01:07:51.063819+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'722","last_scrub_stamp":"2024-09-12T01:07:51.063535+0000","last_deep_scrub":"267'722","last_deep_scrub_stamp":"2024-09-12T01:07:51.063535+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.063535+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:28.632717+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1291,"num_read_kb":3081,"num_write":1048,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.599257+0000","last_change":"2024-09-12T00:21:50.551312+0000","last_active":"2024-09-12T01:05:39.599257+0000","last_peered":"2024-09-12T01:05:39.599257+0000","last_clean":"2024-09-12T01:05:39.599257+0000","last_became_active":"2024-09-12T00:21:50.549692+0000","last_became_peered":"2024-09-12T00:21:50.549692+0000","last_unstale":"2024-09-12T01:05:39.599257+0000","last_undegraded":"2024-09-12T01:05:39.599257+0000","last_fullsized":"2024-09-12T01:05:39.599257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'107","reported_seq":601,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.235026+0000","last_change":"2024-09-12T00:21:52.556774+0000","last_active":"2024-09-12T01:05:43.235026+0000","last_peered":"2024-09-12T01:05:43.235026+0000","last_clean":"2024-09-12T01:05:43.235026+0000","last_became_active":"2024-09-12T00:21:52.556038+0000","last_became_peered":"2024-09-12T00:21:52.556038+0000","last_unstale":"2024-09-12T01:05:43.235026+0000","last_undegraded":"2024-09-12T01:05:43.235026+0000","last_fullsized":"2024-09-12T01:05:43.235026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:26.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":258,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'117","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.476671+0000","last_change":"2024-09-12T00:21:52.538201+0000","last_active":"2024-09-12T01:06:07.476671+0000","last_peered":"2024-09-12T01:06:07.476671+0000","last_clean":"2024-09-12T01:06:07.476671+0000","last_became_active":"2024-09-12T00:21:52.537464+0000","last_became_peered":"2024-09-12T00:21:52.537464+0000","last_unstale":"2024-09-12T01:06:07.476671+0000","last_undegraded":"2024-09-12T01:06:07.476671+0000","last_fullsized":"2024-09-12T01:06:07.476671+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":226,"num_write":297,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'147","reported_seq":785,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.217289+0000","last_change":"2024-09-12T01:07:45.217289+0000","last_active":"2024-09-12T01:07:45.217289+0000","last_peered":"2024-09-12T01:07:45.217289+0000","last_clean":"2024-09-12T01:07:45.217289+0000","last_became_active":"2024-09-12T00:21:44.494375+0000","last_became_peered":"2024-09-12T00:21:44.494375+0000","last_unstale":"2024-09-12T01:07:45.217289+0000","last_undegraded":"2024-09-12T01:07:45.217289+0000","last_fullsized":"2024-09-12T01:07:45.217289+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-12T01:07:45.217105+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-12T01:07:45.217105+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.217105+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:38.718060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":613,"num_write":235,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'406","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.925561+0000","last_change":"2024-09-12T01:07:40.925561+0000","last_active":"2024-09-12T01:07:40.925561+0000","last_peered":"2024-09-12T01:07:40.925561+0000","last_clean":"2024-09-12T01:07:40.925561+0000","last_became_active":"2024-09-12T00:21:42.495160+0000","last_became_peered":"2024-09-12T00:21:42.495160+0000","last_unstale":"2024-09-12T01:07:40.925561+0000","last_undegraded":"2024-09-12T01:07:40.925561+0000","last_fullsized":"2024-09-12T01:07:40.925561+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'406","last_scrub_stamp":"2024-09-12T01:07:40.925325+0000","last_deep_scrub":"267'406","last_deep_scrub_stamp":"2024-09-12T01:07:40.925325+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.925325+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:38.062084+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":36670,"num_write":1291,"num_write_kb":30706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.354604+0000","last_change":"2024-09-12T01:07:53.354604+0000","last_active":"2024-09-12T01:07:53.354604+0000","last_peered":"2024-09-12T01:07:53.354604+0000","last_clean":"2024-09-12T01:07:53.354604+0000","last_became_active":"2024-09-12T00:21:46.503594+0000","last_became_peered":"2024-09-12T00:21:46.503594+0000","last_unstale":"2024-09-12T01:07:53.354604+0000","last_undegraded":"2024-09-12T01:07:53.354604+0000","last_fullsized":"2024-09-12T01:07:53.354604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.354423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.354423+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.354423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:33.541746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'273","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.582225+0000","last_change":"2024-09-12T00:21:48.546884+0000","last_active":"2024-09-12T01:07:27.582225+0000","last_peered":"2024-09-12T01:07:27.582225+0000","last_clean":"2024-09-12T01:07:27.582225+0000","last_became_active":"2024-09-12T00:21:48.546213+0000","last_became_peered":"2024-09-12T00:21:48.546213+0000","last_unstale":"2024-09-12T01:07:27.582225+0000","last_undegraded":"2024-09-12T01:07:27.582225+0000","last_fullsized":"2024-09-12T01:07:27.582225+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:17.869108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44075,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":436,"num_read_kb":989,"num_write":348,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.258390+0000","last_change":"2024-09-12T01:07:53.258390+0000","last_active":"2024-09-12T01:07:53.258390+0000","last_peered":"2024-09-12T01:07:53.258390+0000","last_clean":"2024-09-12T01:07:53.258390+0000","last_became_active":"2024-09-12T00:21:50.549135+0000","last_became_peered":"2024-09-12T00:21:50.549135+0000","last_unstale":"2024-09-12T01:07:53.258390+0000","last_undegraded":"2024-09-12T01:07:53.258390+0000","last_fullsized":"2024-09-12T01:07:53.258390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.258184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.258184+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.258184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:36.236772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'126","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.920723+0000","last_change":"2024-09-12T00:21:52.563982+0000","last_active":"2024-09-12T01:07:11.920723+0000","last_peered":"2024-09-12T01:07:11.920723+0000","last_clean":"2024-09-12T01:07:11.920723+0000","last_became_active":"2024-09-12T00:21:52.563303+0000","last_became_peered":"2024-09-12T00:21:52.563303+0000","last_unstale":"2024-09-12T01:07:11.920723+0000","last_undegraded":"2024-09-12T01:07:11.920723+0000","last_fullsized":"2024-09-12T01:07:11.920723+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:33.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":144,"num_write":323,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'152","reported_seq":751,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.418480+0000","last_change":"2024-09-12T01:07:44.418480+0000","last_active":"2024-09-12T01:07:44.418480+0000","last_peered":"2024-09-12T01:07:44.418480+0000","last_clean":"2024-09-12T01:07:44.418480+0000","last_became_active":"2024-09-12T00:21:44.495299+0000","last_became_peered":"2024-09-12T00:21:44.495299+0000","last_unstale":"2024-09-12T01:07:44.418480+0000","last_undegraded":"2024-09-12T01:07:44.418480+0000","last_fullsized":"2024-09-12T01:07:44.418480+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:07:44.418260+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:07:44.418260+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.418260+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:51.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":653,"num_read_kb":535,"num_write":221,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'287","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.010747+0000","last_change":"2024-09-12T01:07:35.010674+0000","last_active":"2024-09-12T01:07:35.010747+0000","last_peered":"2024-09-12T01:07:35.010747+0000","last_clean":"2024-09-12T01:07:35.010747+0000","last_became_active":"2024-09-12T00:21:42.510774+0000","last_became_peered":"2024-09-12T00:21:42.510774+0000","last_unstale":"2024-09-12T01:07:35.010747+0000","last_undegraded":"2024-09-12T01:07:35.010747+0000","last_fullsized":"2024-09-12T01:07:35.010747+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'287","last_scrub_stamp":"2024-09-12T01:07:35.010519+0000","last_deep_scrub":"267'287","last_deep_scrub_stamp":"2024-09-12T01:07:35.010519+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.010519+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:26.256328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254443,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":10210,"num_write":929,"num_write_kb":22659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.338763+0000","last_change":"2024-09-12T01:07:53.338763+0000","last_active":"2024-09-12T01:07:53.338763+0000","last_peered":"2024-09-12T01:07:53.338763+0000","last_clean":"2024-09-12T01:07:53.338763+0000","last_became_active":"2024-09-12T00:21:46.498536+0000","last_became_peered":"2024-09-12T00:21:46.498536+0000","last_unstale":"2024-09-12T01:07:53.338763+0000","last_undegraded":"2024-09-12T01:07:53.338763+0000","last_fullsized":"2024-09-12T01:07:53.338763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.338543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.338543+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.338543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:08.882729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'42","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.160500+0000","last_change":"2024-09-12T00:21:48.530906+0000","last_active":"2024-09-12T01:04:59.160500+0000","last_peered":"2024-09-12T01:04:59.160500+0000","last_clean":"2024-09-12T01:04:59.160500+0000","last_became_active":"2024-09-12T00:21:48.528299+0000","last_became_peered":"2024-09-12T00:21:48.528299+0000","last_unstale":"2024-09-12T01:04:59.160500+0000","last_undegraded":"2024-09-12T01:04:59.160500+0000","last_fullsized":"2024-09-12T01:04:59.160500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:04.289536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.744259+0000","last_change":"2024-09-12T00:21:50.555449+0000","last_active":"2024-09-12T01:03:54.744259+0000","last_peered":"2024-09-12T01:03:54.744259+0000","last_clean":"2024-09-12T01:03:54.744259+0000","last_became_active":"2024-09-12T00:21:50.553714+0000","last_became_peered":"2024-09-12T00:21:50.553714+0000","last_unstale":"2024-09-12T01:03:54.744259+0000","last_undegraded":"2024-09-12T01:03:54.744259+0000","last_fullsized":"2024-09-12T01:03:54.744259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:49.756435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'214","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.327000+0000","last_change":"2024-09-12T00:21:52.557187+0000","last_active":"2024-09-12T01:06:07.327000+0000","last_peered":"2024-09-12T01:06:07.327000+0000","last_clean":"2024-09-12T01:06:07.327000+0000","last_became_active":"2024-09-12T00:21:52.556407+0000","last_became_peered":"2024-09-12T00:21:52.556407+0000","last_unstale":"2024-09-12T01:06:07.327000+0000","last_undegraded":"2024-09-12T01:06:07.327000+0000","last_fullsized":"2024-09-12T01:06:07.327000+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.366159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":286,"num_write":472,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'340","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.437472+0000","last_change":"2024-09-12T01:07:42.437472+0000","last_active":"2024-09-12T01:07:42.437472+0000","last_peered":"2024-09-12T01:07:42.437472+0000","last_clean":"2024-09-12T01:07:42.437472+0000","last_became_active":"2024-09-12T00:21:44.499891+0000","last_became_peered":"2024-09-12T00:21:44.499891+0000","last_unstale":"2024-09-12T01:07:42.437472+0000","last_undegraded":"2024-09-12T01:07:42.437472+0000","last_fullsized":"2024-09-12T01:07:42.437472+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T01:07:42.437296+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T01:07:42.437296+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.437296+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:04.391073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1519,"num_read_kb":1239,"num_write":521,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'307","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.260295+0000","last_change":"2024-09-12T01:07:36.260148+0000","last_active":"2024-09-12T01:07:36.260295+0000","last_peered":"2024-09-12T01:07:36.260295+0000","last_clean":"2024-09-12T01:07:36.260295+0000","last_became_active":"2024-09-12T00:21:42.534537+0000","last_became_peered":"2024-09-12T00:21:42.534537+0000","last_unstale":"2024-09-12T01:07:36.260295+0000","last_undegraded":"2024-09-12T01:07:36.260295+0000","last_fullsized":"2024-09-12T01:07:36.260295+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T01:07:36.259915+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T01:07:36.259915+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.259915+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:37.365491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194356,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":22569,"num_write":963,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.230337+0000","last_change":"2024-09-12T01:07:49.230337+0000","last_active":"2024-09-12T01:07:49.230337+0000","last_peered":"2024-09-12T01:07:49.230337+0000","last_clean":"2024-09-12T01:07:49.230337+0000","last_became_active":"2024-09-12T00:21:46.489054+0000","last_became_peered":"2024-09-12T00:21:46.489054+0000","last_unstale":"2024-09-12T01:07:49.230337+0000","last_undegraded":"2024-09-12T01:07:49.230337+0000","last_fullsized":"2024-09-12T01:07:49.230337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:49.230156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:49.230156+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.230156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.131892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'291","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.866262+0000","last_change":"2024-09-12T00:21:48.550280+0000","last_active":"2024-09-12T01:07:26.866262+0000","last_peered":"2024-09-12T01:07:26.866262+0000","last_clean":"2024-09-12T01:07:26.866262+0000","last_became_active":"2024-09-12T00:21:48.549368+0000","last_became_peered":"2024-09-12T00:21:48.549368+0000","last_unstale":"2024-09-12T01:07:26.866262+0000","last_undegraded":"2024-09-12T01:07:26.866262+0000","last_fullsized":"2024-09-12T01:07:26.866262+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:05.929053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56273,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1054,"num_write":388,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.765195+0000","last_change":"2024-09-12T00:21:50.566488+0000","last_active":"2024-09-12T01:03:54.765195+0000","last_peered":"2024-09-12T01:03:54.765195+0000","last_clean":"2024-09-12T01:03:54.765195+0000","last_became_active":"2024-09-12T00:21:50.565753+0000","last_became_peered":"2024-09-12T00:21:50.565753+0000","last_unstale":"2024-09-12T01:03:54.765195+0000","last_undegraded":"2024-09-12T01:03:54.765195+0000","last_fullsized":"2024-09-12T01:03:54.765195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:49.492114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.980755+0000","last_change":"2024-09-12T00:21:52.565618+0000","last_active":"2024-09-12T01:05:39.980755+0000","last_peered":"2024-09-12T01:05:39.980755+0000","last_clean":"2024-09-12T01:05:39.980755+0000","last_became_active":"2024-09-12T00:21:52.559213+0000","last_became_peered":"2024-09-12T00:21:52.559213+0000","last_unstale":"2024-09-12T01:05:39.980755+0000","last_undegraded":"2024-09-12T01:05:39.980755+0000","last_fullsized":"2024-09-12T01:05:39.980755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.549214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":329,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'146","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.111403+0000","last_change":"2024-09-12T01:07:38.111403+0000","last_active":"2024-09-12T01:07:38.111403+0000","last_peered":"2024-09-12T01:07:38.111403+0000","last_clean":"2024-09-12T01:07:38.111403+0000","last_became_active":"2024-09-12T00:21:44.507460+0000","last_became_peered":"2024-09-12T00:21:44.507460+0000","last_unstale":"2024-09-12T01:07:38.111403+0000","last_undegraded":"2024-09-12T01:07:38.111403+0000","last_fullsized":"2024-09-12T01:07:38.111403+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-12T01:07:38.111226+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-12T01:07:38.111226+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.111226+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:36.723181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":507,"num_write":216,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'342","reported_seq":977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.072519+0000","last_change":"2024-09-12T01:07:37.072371+0000","last_active":"2024-09-12T01:07:37.072519+0000","last_peered":"2024-09-12T01:07:37.072519+0000","last_clean":"2024-09-12T01:07:37.072519+0000","last_became_active":"2024-09-12T00:21:42.517333+0000","last_became_peered":"2024-09-12T00:21:42.517333+0000","last_unstale":"2024-09-12T01:07:37.072519+0000","last_undegraded":"2024-09-12T01:07:37.072519+0000","last_fullsized":"2024-09-12T01:07:37.072519+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-09-12T01:07:37.072146+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-09-12T01:07:37.072146+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.072146+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.002439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":50264,"num_write":1046,"num_write_kb":41560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.618453+0000","last_change":"2024-09-12T00:21:46.502471+0000","last_active":"2024-09-12T01:03:49.618453+0000","last_peered":"2024-09-12T01:03:49.618453+0000","last_clean":"2024-09-12T01:03:49.618453+0000","last_became_active":"2024-09-12T00:21:46.501673+0000","last_became_peered":"2024-09-12T00:21:46.501673+0000","last_unstale":"2024-09-12T01:03:49.618453+0000","last_undegraded":"2024-09-12T01:03:49.618453+0000","last_fullsized":"2024-09-12T01:03:49.618453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'276","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.086938+0000","last_change":"2024-09-12T01:07:46.086938+0000","last_active":"2024-09-12T01:07:46.086938+0000","last_peered":"2024-09-12T01:07:46.086938+0000","last_clean":"2024-09-12T01:07:46.086938+0000","last_became_active":"2024-09-12T00:21:48.537864+0000","last_became_peered":"2024-09-12T00:21:48.537864+0000","last_unstale":"2024-09-12T01:07:46.086938+0000","last_undegraded":"2024-09-12T01:07:46.086938+0000","last_fullsized":"2024-09-12T01:07:46.086938+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'276","last_scrub_stamp":"2024-09-12T01:07:46.086739+0000","last_deep_scrub":"267'276","last_deep_scrub_stamp":"2024-09-12T01:07:46.086739+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.086739+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:32.656541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47500,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1067,"num_write":372,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.581973+0000","last_change":"2024-09-12T00:21:50.561361+0000","last_active":"2024-09-12T01:03:53.581973+0000","last_peered":"2024-09-12T01:03:53.581973+0000","last_clean":"2024-09-12T01:03:53.581973+0000","last_became_active":"2024-09-12T00:21:50.560805+0000","last_became_peered":"2024-09-12T00:21:50.560805+0000","last_unstale":"2024-09-12T01:03:53.581973+0000","last_undegraded":"2024-09-12T01:03:53.581973+0000","last_fullsized":"2024-09-12T01:03:53.581973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:00.373479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'385","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.945989+0000","last_change":"2024-09-12T01:07:47.945989+0000","last_active":"2024-09-12T01:07:47.945989+0000","last_peered":"2024-09-12T01:07:47.945989+0000","last_clean":"2024-09-12T01:07:47.945989+0000","last_became_active":"2024-09-12T00:21:44.516321+0000","last_became_peered":"2024-09-12T00:21:44.516321+0000","last_unstale":"2024-09-12T01:07:47.945989+0000","last_undegraded":"2024-09-12T01:07:47.945989+0000","last_fullsized":"2024-09-12T01:07:47.945989+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-12T01:07:47.945804+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-12T01:07:47.945804+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.945804+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:05.496224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1787,"num_read_kb":1547,"num_write":658,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'343","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.099435+0000","last_change":"2024-09-12T01:07:38.099297+0000","last_active":"2024-09-12T01:07:38.099435+0000","last_peered":"2024-09-12T01:07:38.099435+0000","last_clean":"2024-09-12T01:07:38.099435+0000","last_became_active":"2024-09-12T00:22:13.519954+0000","last_became_peered":"2024-09-12T00:22:13.519954+0000","last_unstale":"2024-09-12T01:07:38.099435+0000","last_undegraded":"2024-09-12T01:07:38.099435+0000","last_fullsized":"2024-09-12T01:07:38.099435+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T01:07:38.099074+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T01:07:38.099074+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.099074+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:06.565768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":32939,"num_write":1107,"num_write_kb":17030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.347535+0000","last_change":"2024-09-12T01:07:54.347535+0000","last_active":"2024-09-12T01:07:54.347535+0000","last_peered":"2024-09-12T01:07:54.347535+0000","last_clean":"2024-09-12T01:07:54.347535+0000","last_became_active":"2024-09-12T00:21:46.503646+0000","last_became_peered":"2024-09-12T00:21:46.503646+0000","last_unstale":"2024-09-12T01:07:54.347535+0000","last_undegraded":"2024-09-12T01:07:54.347535+0000","last_fullsized":"2024-09-12T01:07:54.347535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.347353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.347353+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.347353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:41.432753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'522","reported_seq":1153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.613803+0000","last_change":"2024-09-12T00:21:48.548531+0000","last_active":"2024-09-12T01:07:26.613803+0000","last_peered":"2024-09-12T01:07:26.613803+0000","last_clean":"2024-09-12T01:07:26.613803+0000","last_became_active":"2024-09-12T00:21:48.547827+0000","last_became_peered":"2024-09-12T00:21:48.547827+0000","last_unstale":"2024-09-12T01:07:26.613803+0000","last_undegraded":"2024-09-12T01:07:26.613803+0000","last_fullsized":"2024-09-12T01:07:26.613803+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.633665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106077,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":956,"num_read_kb":2347,"num_write":834,"num_write_kb":757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.751771+0000","last_change":"2024-09-12T00:21:50.554994+0000","last_active":"2024-09-12T01:04:24.751771+0000","last_peered":"2024-09-12T01:04:24.751771+0000","last_clean":"2024-09-12T01:04:24.751771+0000","last_became_active":"2024-09-12T00:21:50.554194+0000","last_became_peered":"2024-09-12T00:21:50.554194+0000","last_unstale":"2024-09-12T01:04:24.751771+0000","last_undegraded":"2024-09-12T01:04:24.751771+0000","last_fullsized":"2024-09-12T01:04:24.751771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.351737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'158","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:06.556466+0000","last_change":"2024-09-12T00:21:52.558812+0000","last_active":"2024-09-12T01:06:06.556466+0000","last_peered":"2024-09-12T01:06:06.556466+0000","last_clean":"2024-09-12T01:06:06.556466+0000","last_became_active":"2024-09-12T00:21:52.558070+0000","last_became_peered":"2024-09-12T00:21:52.558070+0000","last_unstale":"2024-09-12T01:06:06.556466+0000","last_undegraded":"2024-09-12T01:06:06.556466+0000","last_fullsized":"2024-09-12T01:06:06.556466+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:23.383768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":234,"num_write":361,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'83","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.370404+0000","last_change":"2024-09-12T01:07:46.370250+0000","last_active":"2024-09-12T01:07:46.370404+0000","last_peered":"2024-09-12T01:07:46.370404+0000","last_clean":"2024-09-12T01:07:46.370404+0000","last_became_active":"2024-09-12T00:21:44.501836+0000","last_became_peered":"2024-09-12T00:21:44.501836+0000","last_unstale":"2024-09-12T01:07:46.370404+0000","last_undegraded":"2024-09-12T01:07:46.370404+0000","last_fullsized":"2024-09-12T01:07:46.370404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'83","last_scrub_stamp":"2024-09-12T01:07:46.370079+0000","last_deep_scrub":"267'83","last_deep_scrub_stamp":"2024-09-12T01:07:46.370079+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.370079+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:28.842724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":399,"num_read_kb":345,"num_write":130,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'311","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.400773+0000","last_change":"2024-09-12T01:07:37.400631+0000","last_active":"2024-09-12T01:07:37.400773+0000","last_peered":"2024-09-12T01:07:37.400773+0000","last_clean":"2024-09-12T01:07:37.400773+0000","last_became_active":"2024-09-12T00:21:42.496837+0000","last_became_peered":"2024-09-12T00:21:42.496837+0000","last_unstale":"2024-09-12T01:07:37.400773+0000","last_undegraded":"2024-09-12T01:07:37.400773+0000","last_fullsized":"2024-09-12T01:07:37.400773+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:07:37.400384+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:07:37.400384+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.400384+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:35.621576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":560106,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":359,"num_read_kb":1485,"num_write":897,"num_write_kb":29678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.182093+0000","last_change":"2024-09-12T01:07:50.182093+0000","last_active":"2024-09-12T01:07:50.182093+0000","last_peered":"2024-09-12T01:07:50.182093+0000","last_clean":"2024-09-12T01:07:50.182093+0000","last_became_active":"2024-09-12T00:21:46.498517+0000","last_became_peered":"2024-09-12T00:21:46.498517+0000","last_unstale":"2024-09-12T01:07:50.182093+0000","last_undegraded":"2024-09-12T01:07:50.182093+0000","last_fullsized":"2024-09-12T01:07:50.182093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:50.181910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:50.181910+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.181910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:16.300016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'300","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.747147+0000","last_change":"2024-09-12T00:21:48.539854+0000","last_active":"2024-09-12T01:07:26.747147+0000","last_peered":"2024-09-12T01:07:26.747147+0000","last_clean":"2024-09-12T01:07:26.747147+0000","last_became_active":"2024-09-12T00:21:48.539419+0000","last_became_peered":"2024-09-12T00:21:48.539419+0000","last_unstale":"2024-09-12T01:07:26.747147+0000","last_undegraded":"2024-09-12T01:07:26.747147+0000","last_fullsized":"2024-09-12T01:07:26.747147+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:42.243175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":1160,"num_write":428,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.608749+0000","last_change":"2024-09-12T00:21:50.565460+0000","last_active":"2024-09-12T01:04:24.608749+0000","last_peered":"2024-09-12T01:04:24.608749+0000","last_clean":"2024-09-12T01:04:24.608749+0000","last_became_active":"2024-09-12T00:21:50.564610+0000","last_became_peered":"2024-09-12T00:21:50.564610+0000","last_unstale":"2024-09-12T01:04:24.608749+0000","last_undegraded":"2024-09-12T01:04:24.608749+0000","last_fullsized":"2024-09-12T01:04:24.608749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:32.319224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'152","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.192650+0000","last_change":"2024-09-12T00:21:52.560731+0000","last_active":"2024-09-12T01:05:01.192650+0000","last_peered":"2024-09-12T01:05:01.192650+0000","last_clean":"2024-09-12T01:05:01.192650+0000","last_became_active":"2024-09-12T00:21:52.559989+0000","last_became_peered":"2024-09-12T00:21:52.559989+0000","last_unstale":"2024-09-12T01:05:01.192650+0000","last_undegraded":"2024-09-12T01:05:01.192650+0000","last_fullsized":"2024-09-12T01:05:01.192650+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.302197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":167,"num_write":448,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'181","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.087272+0000","last_change":"2024-09-12T01:07:42.087272+0000","last_active":"2024-09-12T01:07:42.087272+0000","last_peered":"2024-09-12T01:07:42.087272+0000","last_clean":"2024-09-12T01:07:42.087272+0000","last_became_active":"2024-09-12T00:21:44.515059+0000","last_became_peered":"2024-09-12T00:21:44.515059+0000","last_unstale":"2024-09-12T01:07:42.087272+0000","last_undegraded":"2024-09-12T01:07:42.087272+0000","last_fullsized":"2024-09-12T01:07:42.087272+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T01:07:42.087093+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T01:07:42.087093+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.087093+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:57.089560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":674,"num_write":306,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'322","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.658246+0000","last_change":"2024-09-12T01:07:35.658246+0000","last_active":"2024-09-12T01:07:35.658246+0000","last_peered":"2024-09-12T01:07:35.658246+0000","last_clean":"2024-09-12T01:07:35.658246+0000","last_became_active":"2024-09-12T00:21:42.527838+0000","last_became_peered":"2024-09-12T00:21:42.527838+0000","last_unstale":"2024-09-12T01:07:35.658246+0000","last_undegraded":"2024-09-12T01:07:35.658246+0000","last_fullsized":"2024-09-12T01:07:35.658246+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'322","last_scrub_stamp":"2024-09-12T01:07:35.657997+0000","last_deep_scrub":"267'322","last_deep_scrub_stamp":"2024-09-12T01:07:35.657997+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.657997+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.365955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373192,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":57949,"num_write":1020,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.190368+0000","last_change":"2024-09-12T01:07:48.190368+0000","last_active":"2024-09-12T01:07:48.190368+0000","last_peered":"2024-09-12T01:07:48.190368+0000","last_clean":"2024-09-12T01:07:48.190368+0000","last_became_active":"2024-09-12T00:21:46.486768+0000","last_became_peered":"2024-09-12T00:21:46.486768+0000","last_unstale":"2024-09-12T01:07:48.190368+0000","last_undegraded":"2024-09-12T01:07:48.190368+0000","last_fullsized":"2024-09-12T01:07:48.190368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.190178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.190178+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.190178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.612879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'291","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.777512+0000","last_change":"2024-09-12T00:21:48.546553+0000","last_active":"2024-09-12T01:07:25.777512+0000","last_peered":"2024-09-12T01:07:25.777512+0000","last_clean":"2024-09-12T01:07:25.777512+0000","last_became_active":"2024-09-12T00:21:48.545589+0000","last_became_peered":"2024-09-12T00:21:48.545589+0000","last_unstale":"2024-09-12T01:07:25.777512+0000","last_undegraded":"2024-09-12T01:07:25.777512+0000","last_fullsized":"2024-09-12T01:07:25.777512+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":1095,"num_write":398,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:03.584221+0000","last_change":"2024-09-12T00:21:50.557751+0000","last_active":"2024-09-12T01:04:03.584221+0000","last_peered":"2024-09-12T01:04:03.584221+0000","last_clean":"2024-09-12T01:04:03.584221+0000","last_became_active":"2024-09-12T00:21:50.556333+0000","last_became_peered":"2024-09-12T00:21:50.556333+0000","last_unstale":"2024-09-12T01:04:03.584221+0000","last_undegraded":"2024-09-12T01:04:03.584221+0000","last_fullsized":"2024-09-12T01:04:03.584221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.592627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'204","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.864522+0000","last_change":"2024-09-12T00:21:52.566691+0000","last_active":"2024-09-12T01:07:12.864522+0000","last_peered":"2024-09-12T01:07:12.864522+0000","last_clean":"2024-09-12T01:07:12.864522+0000","last_became_active":"2024-09-12T00:21:52.565109+0000","last_became_peered":"2024-09-12T00:21:52.565109+0000","last_unstale":"2024-09-12T01:07:12.864522+0000","last_undegraded":"2024-09-12T01:07:12.864522+0000","last_fullsized":"2024-09-12T01:07:12.864522+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:52.766859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'131","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.419785+0000","last_change":"2024-09-12T01:07:45.419785+0000","last_active":"2024-09-12T01:07:45.419785+0000","last_peered":"2024-09-12T01:07:45.419785+0000","last_clean":"2024-09-12T01:07:45.419785+0000","last_became_active":"2024-09-12T00:21:44.488546+0000","last_became_peered":"2024-09-12T00:21:44.488546+0000","last_unstale":"2024-09-12T01:07:45.419785+0000","last_undegraded":"2024-09-12T01:07:45.419785+0000","last_fullsized":"2024-09-12T01:07:45.419785+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:07:45.419606+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:07:45.419606+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.419606+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:27.301674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":436,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'359","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.479909+0000","last_change":"2024-09-12T01:07:39.479909+0000","last_active":"2024-09-12T01:07:39.479909+0000","last_peered":"2024-09-12T01:07:39.479909+0000","last_clean":"2024-09-12T01:07:39.479909+0000","last_became_active":"2024-09-12T00:21:42.513837+0000","last_became_peered":"2024-09-12T00:21:42.513837+0000","last_unstale":"2024-09-12T01:07:39.479909+0000","last_undegraded":"2024-09-12T01:07:39.479909+0000","last_fullsized":"2024-09-12T01:07:39.479909+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'359","last_scrub_stamp":"2024-09-12T01:07:39.479604+0000","last_deep_scrub":"267'359","last_deep_scrub_stamp":"2024-09-12T01:07:39.479604+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.479604+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:45.652858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":19207,"num_write":1040,"num_write_kb":45165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.580850+0000","last_change":"2024-09-12T00:21:46.493177+0000","last_active":"2024-09-12T01:04:19.580850+0000","last_peered":"2024-09-12T01:04:19.580850+0000","last_clean":"2024-09-12T01:04:19.580850+0000","last_became_active":"2024-09-12T00:21:46.492502+0000","last_became_peered":"2024-09-12T00:21:46.492502+0000","last_unstale":"2024-09-12T01:04:19.580850+0000","last_undegraded":"2024-09-12T01:04:19.580850+0000","last_fullsized":"2024-09-12T01:04:19.580850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:29.059786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'96","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:59.651411+0000","last_change":"2024-09-12T00:21:48.548949+0000","last_active":"2024-09-12T01:05:59.651411+0000","last_peered":"2024-09-12T01:05:59.651411+0000","last_clean":"2024-09-12T01:05:59.651411+0000","last_became_active":"2024-09-12T00:21:48.544915+0000","last_became_peered":"2024-09-12T00:21:48.544915+0000","last_unstale":"2024-09-12T01:05:59.651411+0000","last_undegraded":"2024-09-12T01:05:59.651411+0000","last_fullsized":"2024-09-12T01:05:59.651411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:44.234342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":128,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'782","reported_seq":2225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.706010+0000","last_change":"2024-09-12T00:21:50.550332+0000","last_active":"2024-09-12T01:07:27.706010+0000","last_peered":"2024-09-12T01:07:27.706010+0000","last_clean":"2024-09-12T01:07:27.706010+0000","last_became_active":"2024-09-12T00:21:50.549552+0000","last_became_peered":"2024-09-12T00:21:50.549552+0000","last_unstale":"2024-09-12T01:07:27.706010+0000","last_undegraded":"2024-09-12T01:07:27.706010+0000","last_fullsized":"2024-09-12T01:07:27.706010+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'170","reported_seq":686,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.303926+0000","last_change":"2024-09-12T00:21:52.566510+0000","last_active":"2024-09-12T01:05:46.303926+0000","last_peered":"2024-09-12T01:05:46.303926+0000","last_clean":"2024-09-12T01:05:46.303926+0000","last_became_active":"2024-09-12T00:21:52.565872+0000","last_became_peered":"2024-09-12T00:21:52.565872+0000","last_unstale":"2024-09-12T01:05:46.303926+0000","last_undegraded":"2024-09-12T01:05:46.303926+0000","last_fullsized":"2024-09-12T01:05:46.303926+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:54.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":199,"num_write":407,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'4285","reported_seq":4948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.202447+0000","last_change":"2024-09-12T01:07:47.202447+0000","last_active":"2024-09-12T01:07:47.202447+0000","last_peered":"2024-09-12T01:07:47.202447+0000","last_clean":"2024-09-12T01:07:47.202447+0000","last_became_active":"2024-09-12T00:21:44.521310+0000","last_became_peered":"2024-09-12T00:21:44.521310+0000","last_unstale":"2024-09-12T01:07:47.202447+0000","last_undegraded":"2024-09-12T01:07:47.202447+0000","last_fullsized":"2024-09-12T01:07:47.202447+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4285","last_scrub_stamp":"2024-09-12T01:07:47.202270+0000","last_deep_scrub":"267'4285","last_deep_scrub_stamp":"2024-09-12T01:07:47.202270+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.202270+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:42.173767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17290,"num_read_kb":14479,"num_write":6455,"num_write_kb":3215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'412","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.695539+0000","last_change":"2024-09-12T01:07:37.695539+0000","last_active":"2024-09-12T01:07:37.695539+0000","last_peered":"2024-09-12T01:07:37.695539+0000","last_clean":"2024-09-12T01:07:37.695539+0000","last_became_active":"2024-09-12T00:21:42.507712+0000","last_became_peered":"2024-09-12T00:21:42.507712+0000","last_unstale":"2024-09-12T01:07:37.695539+0000","last_undegraded":"2024-09-12T01:07:37.695539+0000","last_fullsized":"2024-09-12T01:07:37.695539+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-09-12T01:07:37.695311+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-09-12T01:07:37.695311+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.695311+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:19.588168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992333,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":35222,"num_write":1344,"num_write_kb":36033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.578853+0000","last_change":"2024-09-12T01:07:52.578853+0000","last_active":"2024-09-12T01:07:52.578853+0000","last_peered":"2024-09-12T01:07:52.578853+0000","last_clean":"2024-09-12T01:07:52.578853+0000","last_became_active":"2024-09-12T00:21:46.514146+0000","last_became_peered":"2024-09-12T00:21:46.514146+0000","last_unstale":"2024-09-12T01:07:52.578853+0000","last_undegraded":"2024-09-12T01:07:52.578853+0000","last_fullsized":"2024-09-12T01:07:52.578853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.578598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.578598+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.578598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:11.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'341","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.052641+0000","last_change":"2024-09-12T01:07:52.052641+0000","last_active":"2024-09-12T01:07:52.052641+0000","last_peered":"2024-09-12T01:07:52.052641+0000","last_clean":"2024-09-12T01:07:52.052641+0000","last_became_active":"2024-09-12T00:21:48.543993+0000","last_became_peered":"2024-09-12T00:21:48.543993+0000","last_unstale":"2024-09-12T01:07:52.052641+0000","last_undegraded":"2024-09-12T01:07:52.052641+0000","last_fullsized":"2024-09-12T01:07:52.052641+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:52.052427+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:52.052427+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.052427+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:19.461377+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50118,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1190,"num_write":440,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.595827+0000","last_change":"2024-09-12T00:21:50.526640+0000","last_active":"2024-09-12T01:05:24.595827+0000","last_peered":"2024-09-12T01:05:24.595827+0000","last_clean":"2024-09-12T01:05:24.595827+0000","last_became_active":"2024-09-12T00:21:50.525885+0000","last_became_peered":"2024-09-12T00:21:50.525885+0000","last_unstale":"2024-09-12T01:05:24.595827+0000","last_undegraded":"2024-09-12T01:05:24.595827+0000","last_fullsized":"2024-09-12T01:05:24.595827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'113","reported_seq":615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.714165+0000","last_change":"2024-09-12T00:21:52.560445+0000","last_active":"2024-09-12T01:06:04.714165+0000","last_peered":"2024-09-12T01:06:04.714165+0000","last_clean":"2024-09-12T01:06:04.714165+0000","last_became_active":"2024-09-12T00:21:52.559361+0000","last_became_peered":"2024-09-12T00:21:52.559361+0000","last_unstale":"2024-09-12T01:06:04.714165+0000","last_undegraded":"2024-09-12T01:06:04.714165+0000","last_fullsized":"2024-09-12T01:06:04.714165+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":266,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'251","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.238428+0000","last_change":"2024-09-12T01:07:44.238428+0000","last_active":"2024-09-12T01:07:44.238428+0000","last_peered":"2024-09-12T01:07:44.238428+0000","last_clean":"2024-09-12T01:07:44.238428+0000","last_became_active":"2024-09-12T00:21:44.486014+0000","last_became_peered":"2024-09-12T00:21:44.486014+0000","last_unstale":"2024-09-12T01:07:44.238428+0000","last_undegraded":"2024-09-12T01:07:44.238428+0000","last_fullsized":"2024-09-12T01:07:44.238428+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-12T01:07:44.238257+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-12T01:07:44.238257+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.238257+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:57.856443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1098,"num_read_kb":899,"num_write":369,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'313","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.889993+0000","last_change":"2024-09-12T01:07:43.889993+0000","last_active":"2024-09-12T01:07:43.889993+0000","last_peered":"2024-09-12T01:07:43.889993+0000","last_clean":"2024-09-12T01:07:43.889993+0000","last_became_active":"2024-09-12T00:21:42.491757+0000","last_became_peered":"2024-09-12T00:21:42.491757+0000","last_unstale":"2024-09-12T01:07:43.889993+0000","last_undegraded":"2024-09-12T01:07:43.889993+0000","last_fullsized":"2024-09-12T01:07:43.889993+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'313","last_scrub_stamp":"2024-09-12T01:07:43.889701+0000","last_deep_scrub":"267'313","last_deep_scrub_stamp":"2024-09-12T01:07:43.889701+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.889701+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:25.943315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":76220,"num_write":1035,"num_write_kb":46746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.158201+0000","last_change":"2024-09-12T01:07:51.158201+0000","last_active":"2024-09-12T01:07:51.158201+0000","last_peered":"2024-09-12T01:07:51.158201+0000","last_clean":"2024-09-12T01:07:51.158201+0000","last_became_active":"2024-09-12T00:21:46.503203+0000","last_became_peered":"2024-09-12T00:21:46.503203+0000","last_unstale":"2024-09-12T01:07:51.158201+0000","last_undegraded":"2024-09-12T01:07:51.158201+0000","last_fullsized":"2024-09-12T01:07:51.158201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:51.158024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:51.158024+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.158024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:20.104900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'284","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.252558+0000","last_change":"2024-09-12T00:21:48.537800+0000","last_active":"2024-09-12T01:07:26.252558+0000","last_peered":"2024-09-12T01:07:26.252558+0000","last_clean":"2024-09-12T01:07:26.252558+0000","last_became_active":"2024-09-12T00:21:48.536841+0000","last_became_peered":"2024-09-12T00:21:48.536841+0000","last_unstale":"2024-09-12T01:07:26.252558+0000","last_undegraded":"2024-09-12T01:07:26.252558+0000","last_fullsized":"2024-09-12T01:07:26.252558+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48050,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1127,"num_write":390,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.608163+0000","last_change":"2024-09-12T00:21:50.541922+0000","last_active":"2024-09-12T01:03:09.608163+0000","last_peered":"2024-09-12T01:03:09.608163+0000","last_clean":"2024-09-12T01:03:09.608163+0000","last_became_active":"2024-09-12T00:21:50.538041+0000","last_became_peered":"2024-09-12T00:21:50.538041+0000","last_unstale":"2024-09-12T01:03:09.608163+0000","last_undegraded":"2024-09-12T01:03:09.608163+0000","last_fullsized":"2024-09-12T01:03:09.608163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:16.216296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'125","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.623750+0000","last_change":"2024-09-12T00:21:52.564384+0000","last_active":"2024-09-12T01:05:24.623750+0000","last_peered":"2024-09-12T01:05:24.623750+0000","last_clean":"2024-09-12T01:05:24.623750+0000","last_became_active":"2024-09-12T00:21:52.560366+0000","last_became_peered":"2024-09-12T00:21:52.560366+0000","last_unstale":"2024-09-12T01:05:24.623750+0000","last_undegraded":"2024-09-12T01:05:24.623750+0000","last_fullsized":"2024-09-12T01:05:24.623750+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":163,"num_read_kb":157,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'212","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.109151+0000","last_change":"2024-09-12T01:07:41.109151+0000","last_active":"2024-09-12T01:07:41.109151+0000","last_peered":"2024-09-12T01:07:41.109151+0000","last_clean":"2024-09-12T01:07:41.109151+0000","last_became_active":"2024-09-12T00:21:44.512917+0000","last_became_peered":"2024-09-12T00:21:44.512917+0000","last_unstale":"2024-09-12T01:07:41.109151+0000","last_undegraded":"2024-09-12T01:07:41.109151+0000","last_fullsized":"2024-09-12T01:07:41.109151+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-12T01:07:41.108966+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-12T01:07:41.108966+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.108966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:25.227949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":716,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'387","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.063601+0000","last_change":"2024-09-12T01:07:39.063458+0000","last_active":"2024-09-12T01:07:39.063601+0000","last_peered":"2024-09-12T01:07:39.063601+0000","last_clean":"2024-09-12T01:07:39.063601+0000","last_became_active":"2024-09-12T00:21:42.516419+0000","last_became_peered":"2024-09-12T00:21:42.516419+0000","last_unstale":"2024-09-12T01:07:39.063601+0000","last_undegraded":"2024-09-12T01:07:39.063601+0000","last_fullsized":"2024-09-12T01:07:39.063601+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-09-12T01:07:39.063230+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-09-12T01:07:39.063230+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.063230+0000","objects_scrubbed":10,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:19.966999+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1662646,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":630,"num_read_kb":12934,"num_write":1264,"num_write_kb":32784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.641054+0000","last_change":"2024-09-12T01:07:49.641054+0000","last_active":"2024-09-12T01:07:49.641054+0000","last_peered":"2024-09-12T01:07:49.641054+0000","last_clean":"2024-09-12T01:07:49.641054+0000","last_became_active":"2024-09-12T00:21:46.503747+0000","last_became_peered":"2024-09-12T00:21:46.503747+0000","last_unstale":"2024-09-12T01:07:49.641054+0000","last_undegraded":"2024-09-12T01:07:49.641054+0000","last_fullsized":"2024-09-12T01:07:49.641054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:49.640866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:49.640866+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.640866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:15.512638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'244","reported_seq":805,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.702741+0000","last_change":"2024-09-12T00:21:48.547112+0000","last_active":"2024-09-12T01:07:27.702741+0000","last_peered":"2024-09-12T01:07:27.702741+0000","last_clean":"2024-09-12T01:07:27.702741+0000","last_became_active":"2024-09-12T00:21:48.546392+0000","last_became_peered":"2024-09-12T00:21:48.546392+0000","last_unstale":"2024-09-12T01:07:27.702741+0000","last_undegraded":"2024-09-12T01:07:27.702741+0000","last_fullsized":"2024-09-12T01:07:27.702741+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:06.500945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54260,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":387,"num_read_kb":921,"num_write":312,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.627760+0000","last_change":"2024-09-12T00:21:50.549326+0000","last_active":"2024-09-12T01:04:24.627760+0000","last_peered":"2024-09-12T01:04:24.627760+0000","last_clean":"2024-09-12T01:04:24.627760+0000","last_became_active":"2024-09-12T00:21:50.548527+0000","last_became_peered":"2024-09-12T00:21:50.548527+0000","last_unstale":"2024-09-12T01:04:24.627760+0000","last_undegraded":"2024-09-12T01:04:24.627760+0000","last_fullsized":"2024-09-12T01:04:24.627760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:37.290906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'193","reported_seq":1702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.652386+0000","last_change":"2024-09-12T00:21:52.569731+0000","last_active":"2024-09-12T01:06:04.652386+0000","last_peered":"2024-09-12T01:06:04.652386+0000","last_clean":"2024-09-12T01:06:04.652386+0000","last_became_active":"2024-09-12T00:21:52.559360+0000","last_became_peered":"2024-09-12T00:21:52.559360+0000","last_unstale":"2024-09-12T01:06:04.652386+0000","last_undegraded":"2024-09-12T01:06:04.652386+0000","last_fullsized":"2024-09-12T01:06:04.652386+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1316,"num_write":423,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'81","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.269673+0000","last_change":"2024-09-12T01:07:43.269673+0000","last_active":"2024-09-12T01:07:43.269673+0000","last_peered":"2024-09-12T01:07:43.269673+0000","last_clean":"2024-09-12T01:07:43.269673+0000","last_became_active":"2024-09-12T00:21:44.485278+0000","last_became_peered":"2024-09-12T00:21:44.485278+0000","last_unstale":"2024-09-12T01:07:43.269673+0000","last_undegraded":"2024-09-12T01:07:43.269673+0000","last_fullsized":"2024-09-12T01:07:43.269673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-12T01:07:43.269425+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-12T01:07:43.269425+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.269425+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:25.610398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":295,"num_write":139,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'331","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.020797+0000","last_change":"2024-09-12T01:07:40.020797+0000","last_active":"2024-09-12T01:07:40.020797+0000","last_peered":"2024-09-12T01:07:40.020797+0000","last_clean":"2024-09-12T01:07:40.020797+0000","last_became_active":"2024-09-12T00:21:42.520276+0000","last_became_peered":"2024-09-12T00:21:42.520276+0000","last_unstale":"2024-09-12T01:07:40.020797+0000","last_undegraded":"2024-09-12T01:07:40.020797+0000","last_fullsized":"2024-09-12T01:07:40.020797+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-09-12T01:07:40.020532+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-09-12T01:07:40.020532+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.020532+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.026913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35265,"num_write":1034,"num_write_kb":28370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.496186+0000","last_change":"2024-09-12T00:21:46.495855+0000","last_active":"2024-09-12T01:07:25.496186+0000","last_peered":"2024-09-12T01:07:25.496186+0000","last_clean":"2024-09-12T01:07:25.496186+0000","last_became_active":"2024-09-12T00:21:46.495088+0000","last_became_peered":"2024-09-12T00:21:46.495088+0000","last_unstale":"2024-09-12T01:07:25.496186+0000","last_undegraded":"2024-09-12T01:07:25.496186+0000","last_fullsized":"2024-09-12T01:07:25.496186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:45.467905+0000","last_clean_scrub_stamp":"2024-09-12T00:21:45.467905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'327","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.845349+0000","last_change":"2024-09-12T00:21:48.551157+0000","last_active":"2024-09-12T01:07:25.845349+0000","last_peered":"2024-09-12T01:07:25.845349+0000","last_clean":"2024-09-12T01:07:25.845349+0000","last_became_active":"2024-09-12T00:21:48.550441+0000","last_became_peered":"2024-09-12T00:21:48.550441+0000","last_unstale":"2024-09-12T01:07:25.845349+0000","last_undegraded":"2024-09-12T01:07:25.845349+0000","last_fullsized":"2024-09-12T01:07:25.845349+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:58.154347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54992,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1211,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.581974+0000","last_change":"2024-09-12T00:21:50.566647+0000","last_active":"2024-09-12T01:04:24.581974+0000","last_peered":"2024-09-12T01:04:24.581974+0000","last_clean":"2024-09-12T01:04:24.581974+0000","last_became_active":"2024-09-12T00:21:50.565955+0000","last_became_peered":"2024-09-12T00:21:50.565955+0000","last_unstale":"2024-09-12T01:04:24.581974+0000","last_undegraded":"2024-09-12T01:04:24.581974+0000","last_fullsized":"2024-09-12T01:04:24.581974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:37.311871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'131","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.963224+0000","last_change":"2024-09-12T00:21:52.549770+0000","last_active":"2024-09-12T01:07:11.963224+0000","last_peered":"2024-09-12T01:07:11.963224+0000","last_clean":"2024-09-12T01:07:11.963224+0000","last_became_active":"2024-09-12T00:21:52.549080+0000","last_became_peered":"2024-09-12T00:21:52.549080+0000","last_unstale":"2024-09-12T01:07:11.963224+0000","last_undegraded":"2024-09-12T01:07:11.963224+0000","last_fullsized":"2024-09-12T01:07:11.963224+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.186294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'77","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.329440+0000","last_change":"2024-09-12T01:07:47.329440+0000","last_active":"2024-09-12T01:07:47.329440+0000","last_peered":"2024-09-12T01:07:47.329440+0000","last_clean":"2024-09-12T01:07:47.329440+0000","last_became_active":"2024-09-12T00:21:44.495122+0000","last_became_peered":"2024-09-12T00:21:44.495122+0000","last_unstale":"2024-09-12T01:07:47.329440+0000","last_undegraded":"2024-09-12T01:07:47.329440+0000","last_fullsized":"2024-09-12T01:07:47.329440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'77","last_scrub_stamp":"2024-09-12T01:07:47.329261+0000","last_deep_scrub":"267'77","last_deep_scrub_stamp":"2024-09-12T01:07:47.329261+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.329261+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:47.321608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":290,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'356","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.326370+0000","last_change":"2024-09-12T01:07:38.326370+0000","last_active":"2024-09-12T01:07:38.326370+0000","last_peered":"2024-09-12T01:07:38.326370+0000","last_clean":"2024-09-12T01:07:38.326370+0000","last_became_active":"2024-09-12T00:21:42.492358+0000","last_became_peered":"2024-09-12T00:21:42.492358+0000","last_unstale":"2024-09-12T01:07:38.326370+0000","last_undegraded":"2024-09-12T01:07:38.326370+0000","last_fullsized":"2024-09-12T01:07:38.326370+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'356","last_scrub_stamp":"2024-09-12T01:07:38.326089+0000","last_deep_scrub":"267'356","last_deep_scrub_stamp":"2024-09-12T01:07:38.326089+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.326089+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:59.129648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262257,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":28331,"num_write":1177,"num_write_kb":34411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'258","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.117862+0000","last_change":"2024-09-12T01:07:43.117862+0000","last_active":"2024-09-12T01:07:43.117862+0000","last_peered":"2024-09-12T01:07:43.117862+0000","last_clean":"2024-09-12T01:07:43.117862+0000","last_became_active":"2024-09-12T00:21:44.515839+0000","last_became_peered":"2024-09-12T00:21:44.515839+0000","last_unstale":"2024-09-12T01:07:43.117862+0000","last_undegraded":"2024-09-12T01:07:43.117862+0000","last_fullsized":"2024-09-12T01:07:43.117862+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:07:43.117677+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:07:43.117677+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.117677+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":1036,"num_write":423,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'449","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.076589+0000","last_change":"2024-09-12T01:07:39.076589+0000","last_active":"2024-09-12T01:07:39.076589+0000","last_peered":"2024-09-12T01:07:39.076589+0000","last_clean":"2024-09-12T01:07:39.076589+0000","last_became_active":"2024-09-12T00:21:42.502396+0000","last_became_peered":"2024-09-12T00:21:42.502396+0000","last_unstale":"2024-09-12T01:07:39.076589+0000","last_undegraded":"2024-09-12T01:07:39.076589+0000","last_fullsized":"2024-09-12T01:07:39.076589+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'449","last_scrub_stamp":"2024-09-12T01:07:39.076357+0000","last_deep_scrub":"267'449","last_deep_scrub_stamp":"2024-09-12T01:07:39.076357+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.076357+0000","objects_scrubbed":10,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:36.125871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607324,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":742,"num_read_kb":17888,"num_write":1520,"num_write_kb":31183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'183","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.638098+0000","last_change":"2024-09-12T00:21:44.500052+0000","last_active":"2024-09-12T01:05:04.638098+0000","last_peered":"2024-09-12T01:05:04.638098+0000","last_clean":"2024-09-12T01:05:04.638098+0000","last_became_active":"2024-09-12T00:21:44.499805+0000","last_became_peered":"2024-09-12T00:21:44.499805+0000","last_unstale":"2024-09-12T01:05:04.638098+0000","last_undegraded":"2024-09-12T01:05:04.638098+0000","last_fullsized":"2024-09-12T01:05:04.638098+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:04.496825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":613,"num_write":283,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'459","reported_seq":1211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.936240+0000","last_change":"2024-09-12T01:07:46.936240+0000","last_active":"2024-09-12T01:07:46.936240+0000","last_peered":"2024-09-12T01:07:46.936240+0000","last_clean":"2024-09-12T01:07:46.936240+0000","last_became_active":"2024-09-12T00:21:42.518823+0000","last_became_peered":"2024-09-12T00:21:42.518823+0000","last_unstale":"2024-09-12T01:07:46.936240+0000","last_undegraded":"2024-09-12T01:07:46.936240+0000","last_fullsized":"2024-09-12T01:07:46.936240+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'459","last_scrub_stamp":"2024-09-12T01:07:46.935967+0000","last_deep_scrub":"267'459","last_deep_scrub_stamp":"2024-09-12T01:07:46.935967+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.935967+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:07.773715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194369,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":958,"num_read_kb":24368,"num_write":1486,"num_write_kb":48727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'184","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.018711+0000","last_change":"2024-09-12T01:07:54.018711+0000","last_active":"2024-09-12T01:07:54.018711+0000","last_peered":"2024-09-12T01:07:54.018711+0000","last_clean":"2024-09-12T01:07:54.018711+0000","last_became_active":"2024-09-12T00:21:44.510818+0000","last_became_peered":"2024-09-12T00:21:44.510818+0000","last_unstale":"2024-09-12T01:07:54.018711+0000","last_undegraded":"2024-09-12T01:07:54.018711+0000","last_fullsized":"2024-09-12T01:07:54.018711+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-12T01:07:54.018527+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-12T01:07:54.018527+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.018527+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:05.725799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":671,"num_write":265,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'350","reported_seq":1138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.997261+0000","last_change":"2024-09-12T01:07:40.997011+0000","last_active":"2024-09-12T01:07:40.997261+0000","last_peered":"2024-09-12T01:07:40.997261+0000","last_clean":"2024-09-12T01:07:40.997261+0000","last_became_active":"2024-09-12T00:21:42.525233+0000","last_became_peered":"2024-09-12T00:21:42.525233+0000","last_unstale":"2024-09-12T01:07:40.997261+0000","last_undegraded":"2024-09-12T01:07:40.997261+0000","last_fullsized":"2024-09-12T01:07:40.997261+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-12T01:07:40.996743+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-12T01:07:40.996743+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.996743+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:28.641437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":844,"num_read_kb":20388,"num_write":1063,"num_write_kb":42665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'183","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.022367+0000","last_change":"2024-09-12T01:07:53.022367+0000","last_active":"2024-09-12T01:07:53.022367+0000","last_peered":"2024-09-12T01:07:53.022367+0000","last_clean":"2024-09-12T01:07:53.022367+0000","last_became_active":"2024-09-12T00:21:44.523632+0000","last_became_peered":"2024-09-12T00:21:44.523632+0000","last_unstale":"2024-09-12T01:07:53.022367+0000","last_undegraded":"2024-09-12T01:07:53.022367+0000","last_fullsized":"2024-09-12T01:07:53.022367+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-12T01:07:53.022187+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-12T01:07:53.022187+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.022187+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.672407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":821,"num_read_kb":680,"num_write":294,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'392","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.353558+0000","last_change":"2024-09-12T01:07:38.353558+0000","last_active":"2024-09-12T01:07:38.353558+0000","last_peered":"2024-09-12T01:07:38.353558+0000","last_clean":"2024-09-12T01:07:38.353558+0000","last_became_active":"2024-09-12T00:21:42.501690+0000","last_became_peered":"2024-09-12T00:21:42.501690+0000","last_unstale":"2024-09-12T01:07:38.353558+0000","last_undegraded":"2024-09-12T01:07:38.353558+0000","last_fullsized":"2024-09-12T01:07:38.353558+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T01:07:38.353347+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T01:07:38.353347+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.353347+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.350580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":15193,"num_write":1332,"num_write_kb":28087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'132","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.987108+0000","last_change":"2024-09-12T01:07:39.987108+0000","last_active":"2024-09-12T01:07:39.987108+0000","last_peered":"2024-09-12T01:07:39.987108+0000","last_clean":"2024-09-12T01:07:39.987108+0000","last_became_active":"2024-09-12T00:21:44.505235+0000","last_became_peered":"2024-09-12T00:21:44.505235+0000","last_unstale":"2024-09-12T01:07:39.987108+0000","last_undegraded":"2024-09-12T01:07:39.987108+0000","last_fullsized":"2024-09-12T01:07:39.987108+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-12T01:07:39.986839+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-12T01:07:39.986839+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.986839+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:55.921394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":497,"num_write":201,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'335","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.339544+0000","last_change":"2024-09-12T01:07:41.339544+0000","last_active":"2024-09-12T01:07:41.339544+0000","last_peered":"2024-09-12T01:07:41.339544+0000","last_clean":"2024-09-12T01:07:41.339544+0000","last_became_active":"2024-09-12T00:21:42.508673+0000","last_became_peered":"2024-09-12T00:21:42.508673+0000","last_unstale":"2024-09-12T01:07:41.339544+0000","last_undegraded":"2024-09-12T01:07:41.339544+0000","last_fullsized":"2024-09-12T01:07:41.339544+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-12T01:07:41.339325+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-12T01:07:41.339325+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.339325+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:53.386446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":604,"num_read_kb":49155,"num_write":1190,"num_write_kb":40891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'142","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.352041+0000","last_change":"2024-09-12T01:07:48.352041+0000","last_active":"2024-09-12T01:07:48.352041+0000","last_peered":"2024-09-12T01:07:48.352041+0000","last_clean":"2024-09-12T01:07:48.352041+0000","last_became_active":"2024-09-12T00:21:44.515206+0000","last_became_peered":"2024-09-12T00:21:44.515206+0000","last_unstale":"2024-09-12T01:07:48.352041+0000","last_undegraded":"2024-09-12T01:07:48.352041+0000","last_fullsized":"2024-09-12T01:07:48.352041+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-12T01:07:48.351764+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-12T01:07:48.351764+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.351764+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:43.602157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":613,"num_write":237,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'349","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.216592+0000","last_change":"2024-09-12T01:07:35.216592+0000","last_active":"2024-09-12T01:07:35.216592+0000","last_peered":"2024-09-12T01:07:35.216592+0000","last_clean":"2024-09-12T01:07:35.216592+0000","last_became_active":"2024-09-12T00:21:42.486829+0000","last_became_peered":"2024-09-12T00:21:42.486829+0000","last_unstale":"2024-09-12T01:07:35.216592+0000","last_undegraded":"2024-09-12T01:07:35.216592+0000","last_fullsized":"2024-09-12T01:07:35.216592+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:35.216329+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:35.216329+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.216329+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:13.259415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":546,"num_read_kb":26644,"num_write":1053,"num_write_kb":13447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'172","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.681254+0000","last_change":"2024-09-12T01:07:39.681254+0000","last_active":"2024-09-12T01:07:39.681254+0000","last_peered":"2024-09-12T01:07:39.681254+0000","last_clean":"2024-09-12T01:07:39.681254+0000","last_became_active":"2024-09-12T00:21:44.501384+0000","last_became_peered":"2024-09-12T00:21:44.501384+0000","last_unstale":"2024-09-12T01:07:39.681254+0000","last_undegraded":"2024-09-12T01:07:39.681254+0000","last_fullsized":"2024-09-12T01:07:39.681254+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'172","last_scrub_stamp":"2024-09-12T01:07:39.681065+0000","last_deep_scrub":"267'172","last_deep_scrub_stamp":"2024-09-12T01:07:39.681065+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.681065+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:09.758134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":594,"num_write":251,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'349","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.976693+0000","last_change":"2024-09-12T01:07:41.976693+0000","last_active":"2024-09-12T01:07:41.976693+0000","last_peered":"2024-09-12T01:07:41.976693+0000","last_clean":"2024-09-12T01:07:41.976693+0000","last_became_active":"2024-09-12T00:21:42.533216+0000","last_became_peered":"2024-09-12T00:21:42.533216+0000","last_unstale":"2024-09-12T01:07:41.976693+0000","last_undegraded":"2024-09-12T01:07:41.976693+0000","last_fullsized":"2024-09-12T01:07:41.976693+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:41.976497+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:41.976497+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.976497+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.595660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":42167,"num_write":1187,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'107","reported_seq":648,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.168220+0000","last_change":"2024-09-12T01:07:45.168220+0000","last_active":"2024-09-12T01:07:45.168220+0000","last_peered":"2024-09-12T01:07:45.168220+0000","last_clean":"2024-09-12T01:07:45.168220+0000","last_became_active":"2024-09-12T00:21:44.514909+0000","last_became_peered":"2024-09-12T00:21:44.514909+0000","last_unstale":"2024-09-12T01:07:45.168220+0000","last_undegraded":"2024-09-12T01:07:45.168220+0000","last_fullsized":"2024-09-12T01:07:45.168220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-12T01:07:45.168048+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-12T01:07:45.168048+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.168048+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:49.895766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":354,"num_write":152,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'370","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.936009+0000","last_change":"2024-09-12T01:07:41.936009+0000","last_active":"2024-09-12T01:07:41.936009+0000","last_peered":"2024-09-12T01:07:41.936009+0000","last_clean":"2024-09-12T01:07:41.936009+0000","last_became_active":"2024-09-12T00:21:42.528929+0000","last_became_peered":"2024-09-12T00:21:42.528929+0000","last_unstale":"2024-09-12T01:07:41.936009+0000","last_undegraded":"2024-09-12T01:07:41.936009+0000","last_fullsized":"2024-09-12T01:07:41.936009+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-12T01:07:41.935688+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-12T01:07:41.935688+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.935688+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:34.868286+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739017,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":14743,"num_write":1076,"num_write_kb":22917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'148","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.021040+0000","last_change":"2024-09-12T01:07:44.021040+0000","last_active":"2024-09-12T01:07:44.021040+0000","last_peered":"2024-09-12T01:07:44.021040+0000","last_clean":"2024-09-12T01:07:44.021040+0000","last_became_active":"2024-09-12T00:21:44.507579+0000","last_became_peered":"2024-09-12T00:21:44.507579+0000","last_unstale":"2024-09-12T01:07:44.021040+0000","last_undegraded":"2024-09-12T01:07:44.021040+0000","last_fullsized":"2024-09-12T01:07:44.021040+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'148","last_scrub_stamp":"2024-09-12T01:07:44.020852+0000","last_deep_scrub":"267'148","last_deep_scrub_stamp":"2024-09-12T01:07:44.020852+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.020852+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.933243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":566,"num_write":233,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'388","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.012237+0000","last_change":"2024-09-12T01:07:43.012237+0000","last_active":"2024-09-12T01:07:43.012237+0000","last_peered":"2024-09-12T01:07:43.012237+0000","last_clean":"2024-09-12T01:07:43.012237+0000","last_became_active":"2024-09-12T00:21:42.511703+0000","last_became_peered":"2024-09-12T00:21:42.511703+0000","last_unstale":"2024-09-12T01:07:43.012237+0000","last_undegraded":"2024-09-12T01:07:43.012237+0000","last_fullsized":"2024-09-12T01:07:43.012237+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'388","last_scrub_stamp":"2024-09-12T01:07:43.011885+0000","last_deep_scrub":"267'388","last_deep_scrub_stamp":"2024-09-12T01:07:43.011885+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.011885+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:55.733392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":16290,"num_write":1225,"num_write_kb":34029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'32","reported_seq":574,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:51.235223+0000","last_change":"2024-09-12T00:21:44.512963+0000","last_active":"2024-09-12T01:05:51.235223+0000","last_peered":"2024-09-12T01:05:51.235223+0000","last_clean":"2024-09-12T01:05:51.235223+0000","last_became_active":"2024-09-12T00:21:44.509834+0000","last_became_peered":"2024-09-12T00:21:44.509834+0000","last_unstale":"2024-09-12T01:05:51.235223+0000","last_undegraded":"2024-09-12T01:05:51.235223+0000","last_fullsized":"2024-09-12T01:05:51.235223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:43.460640+0000","last_clean_scrub_stamp":"2024-09-12T00:21:43.460640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:08.437585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'345","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.645905+0000","last_change":"2024-09-12T01:07:40.645905+0000","last_active":"2024-09-12T01:07:40.645905+0000","last_peered":"2024-09-12T01:07:40.645905+0000","last_clean":"2024-09-12T01:07:40.645905+0000","last_became_active":"2024-09-12T00:21:42.484073+0000","last_became_peered":"2024-09-12T00:21:42.484073+0000","last_unstale":"2024-09-12T01:07:40.645905+0000","last_undegraded":"2024-09-12T01:07:40.645905+0000","last_fullsized":"2024-09-12T01:07:40.645905+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T01:07:40.645425+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T01:07:40.645425+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.645425+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.525871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992329,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":37312,"num_write":1168,"num_write_kb":47723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'220","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.580102+0000","last_change":"2024-09-12T01:07:42.580102+0000","last_active":"2024-09-12T01:07:42.580102+0000","last_peered":"2024-09-12T01:07:42.580102+0000","last_clean":"2024-09-12T01:07:42.580102+0000","last_became_active":"2024-09-12T00:21:44.499043+0000","last_became_peered":"2024-09-12T00:21:44.499043+0000","last_unstale":"2024-09-12T01:07:42.580102+0000","last_undegraded":"2024-09-12T01:07:42.580102+0000","last_fullsized":"2024-09-12T01:07:42.580102+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-12T01:07:42.579921+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-12T01:07:42.579921+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.579921+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:04.824993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":734,"num_write":347,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'399","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.486946+0000","last_change":"2024-09-12T01:07:41.486946+0000","last_active":"2024-09-12T01:07:41.486946+0000","last_peered":"2024-09-12T01:07:41.486946+0000","last_clean":"2024-09-12T01:07:41.486946+0000","last_became_active":"2024-09-12T00:21:42.482971+0000","last_became_peered":"2024-09-12T00:21:42.482971+0000","last_unstale":"2024-09-12T01:07:41.486946+0000","last_undegraded":"2024-09-12T01:07:41.486946+0000","last_fullsized":"2024-09-12T01:07:41.486946+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-12T01:07:41.486689+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-12T01:07:41.486689+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.486689+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:42.636122+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5391930,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":31089,"num_write":1168,"num_write_kb":20487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'219","reported_seq":892,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.623877+0000","last_change":"2024-09-12T01:07:41.623877+0000","last_active":"2024-09-12T01:07:41.623877+0000","last_peered":"2024-09-12T01:07:41.623877+0000","last_clean":"2024-09-12T01:07:41.623877+0000","last_became_active":"2024-09-12T00:21:44.526086+0000","last_became_peered":"2024-09-12T00:21:44.526086+0000","last_unstale":"2024-09-12T01:07:41.623877+0000","last_undegraded":"2024-09-12T01:07:41.623877+0000","last_fullsized":"2024-09-12T01:07:41.623877+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T01:07:41.623704+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T01:07:41.623704+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.623704+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:51.380240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1006,"num_read_kb":865,"num_write":343,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3377,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'363","reported_seq":1106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.022461+0000","last_change":"2024-09-12T01:07:46.022461+0000","last_active":"2024-09-12T01:07:46.022461+0000","last_peered":"2024-09-12T01:07:46.022461+0000","last_clean":"2024-09-12T01:07:46.022461+0000","last_became_active":"2024-09-12T00:22:12.609837+0000","last_became_peered":"2024-09-12T00:22:12.609837+0000","last_unstale":"2024-09-12T01:07:46.022461+0000","last_undegraded":"2024-09-12T01:07:46.022461+0000","last_fullsized":"2024-09-12T01:07:46.022461+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'363","last_scrub_stamp":"2024-09-12T01:07:46.022232+0000","last_deep_scrub":"267'363","last_deep_scrub_stamp":"2024-09-12T01:07:46.022232+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.022232+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:19.433845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48804,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":34651,"num_write":1163,"num_write_kb":39913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2a","version":"267'442","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.138669+0000","last_change":"2024-09-12T01:07:44.138669+0000","last_active":"2024-09-12T01:07:44.138669+0000","last_peered":"2024-09-12T01:07:44.138669+0000","last_clean":"2024-09-12T01:07:44.138669+0000","last_became_active":"2024-09-12T00:21:44.511294+0000","last_became_peered":"2024-09-12T00:21:44.511294+0000","last_unstale":"2024-09-12T01:07:44.138669+0000","last_undegraded":"2024-09-12T01:07:44.138669+0000","last_fullsized":"2024-09-12T01:07:44.138669+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-09-12T01:07:44.138494+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-09-12T01:07:44.138494+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.138494+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.489890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2157,"num_read_kb":1820,"num_write":750,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'349","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.924944+0000","last_change":"2024-09-12T01:07:48.924944+0000","last_active":"2024-09-12T01:07:48.924944+0000","last_peered":"2024-09-12T01:07:48.924944+0000","last_clean":"2024-09-12T01:07:48.924944+0000","last_became_active":"2024-09-12T00:21:42.528942+0000","last_became_peered":"2024-09-12T00:21:42.528942+0000","last_unstale":"2024-09-12T01:07:48.924944+0000","last_undegraded":"2024-09-12T01:07:48.924944+0000","last_fullsized":"2024-09-12T01:07:48.924944+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:48.924728+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:48.924728+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.924728+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:56.808821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":48912,"num_write":1189,"num_write_kb":34098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'117","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.317201+0000","last_change":"2024-09-12T01:07:48.317201+0000","last_active":"2024-09-12T01:07:48.317201+0000","last_peered":"2024-09-12T01:07:48.317201+0000","last_clean":"2024-09-12T01:07:48.317201+0000","last_became_active":"2024-09-12T00:21:44.525685+0000","last_became_peered":"2024-09-12T00:21:44.525685+0000","last_unstale":"2024-09-12T01:07:48.317201+0000","last_undegraded":"2024-09-12T01:07:48.317201+0000","last_fullsized":"2024-09-12T01:07:48.317201+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:07:48.316987+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:07:48.316987+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.316987+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:57.147053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":457,"num_write":189,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'328","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.128313+0000","last_change":"2024-09-12T01:07:37.128313+0000","last_active":"2024-09-12T01:07:37.128313+0000","last_peered":"2024-09-12T01:07:37.128313+0000","last_clean":"2024-09-12T01:07:37.128313+0000","last_became_active":"2024-09-12T00:21:42.499294+0000","last_became_peered":"2024-09-12T00:21:42.499294+0000","last_unstale":"2024-09-12T01:07:37.128313+0000","last_undegraded":"2024-09-12T01:07:37.128313+0000","last_fullsized":"2024-09-12T01:07:37.128313+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:37.127984+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:37.127984+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.127984+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:09.845259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":11483,"num_write":1078,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'192","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.681453+0000","last_change":"2024-09-12T01:07:38.681453+0000","last_active":"2024-09-12T01:07:38.681453+0000","last_peered":"2024-09-12T01:07:38.681453+0000","last_clean":"2024-09-12T01:07:38.681453+0000","last_became_active":"2024-09-12T00:21:44.511085+0000","last_became_peered":"2024-09-12T00:21:44.511085+0000","last_unstale":"2024-09-12T01:07:38.681453+0000","last_undegraded":"2024-09-12T01:07:38.681453+0000","last_fullsized":"2024-09-12T01:07:38.681453+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-12T01:07:38.681238+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-12T01:07:38.681238+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.681238+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:47.137512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":698,"num_write":312,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'380","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.889331+0000","last_change":"2024-09-12T01:07:42.889331+0000","last_active":"2024-09-12T01:07:42.889331+0000","last_peered":"2024-09-12T01:07:42.889331+0000","last_clean":"2024-09-12T01:07:42.889331+0000","last_became_active":"2024-09-12T00:21:42.518768+0000","last_became_peered":"2024-09-12T00:21:42.518768+0000","last_unstale":"2024-09-12T01:07:42.889331+0000","last_undegraded":"2024-09-12T01:07:42.889331+0000","last_fullsized":"2024-09-12T01:07:42.889331+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-12T01:07:42.889092+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-12T01:07:42.889092+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.889092+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:00.397455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984139,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":53651,"num_write":1104,"num_write_kb":23347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'311","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.916905+0000","last_change":"2024-09-12T01:07:45.916905+0000","last_active":"2024-09-12T01:07:45.916905+0000","last_peered":"2024-09-12T01:07:45.916905+0000","last_clean":"2024-09-12T01:07:45.916905+0000","last_became_active":"2024-09-12T00:21:42.495480+0000","last_became_peered":"2024-09-12T00:21:42.495480+0000","last_unstale":"2024-09-12T01:07:45.916905+0000","last_undegraded":"2024-09-12T01:07:45.916905+0000","last_fullsized":"2024-09-12T01:07:45.916905+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:07:45.916689+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:07:45.916689+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.916689+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:26.278518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":25580,"num_write":940,"num_write_kb":28169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'195","reported_seq":853,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.322966+0000","last_change":"2024-09-12T01:07:51.322966+0000","last_active":"2024-09-12T01:07:51.322966+0000","last_peered":"2024-09-12T01:07:51.322966+0000","last_clean":"2024-09-12T01:07:51.322966+0000","last_became_active":"2024-09-12T00:21:44.526907+0000","last_became_peered":"2024-09-12T00:21:44.526907+0000","last_unstale":"2024-09-12T01:07:51.322966+0000","last_undegraded":"2024-09-12T01:07:51.322966+0000","last_fullsized":"2024-09-12T01:07:51.322966+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'195","last_scrub_stamp":"2024-09-12T01:07:51.322766+0000","last_deep_scrub":"267'195","last_deep_scrub_stamp":"2024-09-12T01:07:51.322766+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.322766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:48.700283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":917,"num_read_kb":786,"num_write":315,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'317","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.060525+0000","last_change":"2024-09-12T01:07:45.060525+0000","last_active":"2024-09-12T01:07:45.060525+0000","last_peered":"2024-09-12T01:07:45.060525+0000","last_clean":"2024-09-12T01:07:45.060525+0000","last_became_active":"2024-09-12T00:21:42.516614+0000","last_became_peered":"2024-09-12T00:21:42.516614+0000","last_unstale":"2024-09-12T01:07:45.060525+0000","last_undegraded":"2024-09-12T01:07:45.060525+0000","last_fullsized":"2024-09-12T01:07:45.060525+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T01:07:45.060335+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T01:07:45.060335+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.060335+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:33.065278+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":551234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":30838,"num_write":927,"num_write_kb":38454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'102","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.511593+0000","last_change":"2024-09-12T01:07:46.511593+0000","last_active":"2024-09-12T01:07:46.511593+0000","last_peered":"2024-09-12T01:07:46.511593+0000","last_clean":"2024-09-12T01:07:46.511593+0000","last_became_active":"2024-09-12T00:21:44.496138+0000","last_became_peered":"2024-09-12T00:21:44.496138+0000","last_unstale":"2024-09-12T01:07:46.511593+0000","last_undegraded":"2024-09-12T01:07:46.511593+0000","last_fullsized":"2024-09-12T01:07:46.511593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:46.511410+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:46.511410+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.511410+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:58.055004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5839,"num_read_kb":4146,"num_write":1942,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1113,"ondisk_log_size":1113,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14973,"num_read_kb":14645,"num_write":16791,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":601,"ondisk_log_size":601,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1609364,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17687,"num_read_kb":36971,"num_write":14775,"num_write_kb":11603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":536358,"num_omap_keys":1224,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1930,"ondisk_log_size":1930,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":101832,"num_read_kb":85065,"num_write":36894,"num_write_kb":18565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36248,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3799,"ondisk_log_size":3799,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":81179371,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36143,"num_read_kb":1795948,"num_write":71818,"num_write_kb":2042491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123875328,"data_stored":123875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3430,"ondisk_log_size":3430,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":206538,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":195226,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510002,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110064,"kb_used_data":20640,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94261776,"statfs":{"total":96636764160,"available":96524058624,"internally_reserved":0,"allocated":21135360,"data_stored":19116983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510003,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273492,"kb_used_data":21636,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098348,"statfs":{"total":96636764160,"available":96356708352,"internally_reserved":0,"allocated":22155264,"data_stored":20133475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510005,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200892,"kb_used_data":21228,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94170948,"statfs":{"total":96636764160,"available":96431050752,"internally_reserved":0,"allocated":21737472,"data_stored":19736193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510003,"num_pgs":123,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257480,"kb_used_data":19448,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94114360,"statfs":{"total":96636764160,"available":96373104640,"internally_reserved":0,"allocated":19914752,"data_stored":17899204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":243726792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510006,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145376,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94226464,"statfs":{"total":96636764160,"available":96487899136,"internally_reserved":0,"allocated":24526848,"data_stored":22535733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510003,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282432,"kb_used_data":12464,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94089408,"statfs":{"total":96636764160,"available":96347553792,"internally_reserved":0,"allocated":12763136,"data_stored":10743931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510002,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146944,"kb_used_data":17264,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94224896,"statfs":{"total":96636764160,"available":96486293504,"internally_reserved":0,"allocated":17678336,"data_stored":15657318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542708,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226236,"kb_used_data":18796,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94145604,"statfs":{"total":96636764160,"available":96405098496,"internally_reserved":0,"allocated":19247104,"data_stored":17260105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13402112,"data_stored":13402112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7901184,"data_stored":7901184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20283392,"data_stored":20283392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17481728,"data_stored":17481728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17289216,"data_stored":17289216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16863232,"data_stored":16863232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15007744,"data_stored":15007744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:07:55.866 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.867 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.867 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.867 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.867 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.867 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.867 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.867 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.867 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.868 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.869 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.870 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.871 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.871 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.871 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.871 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.871 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.871 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.871 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.871 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.872 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.873 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.874 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.875 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.876 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.877 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.878 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.879 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.880 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.881 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.881 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.881 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.881 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.881 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.881 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.882 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.882 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.882 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.882 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.882 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.882 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.882 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.882 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.883 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.883 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.883 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.883 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.883 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.883 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.883 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.884 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.884 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.884 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.884 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.884 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.884 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.884 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.884 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.885 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.885 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.885 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.885 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.885 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.885 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.885 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.885 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.886 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.886 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.886 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.886 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.886 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.886 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.886 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.887 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.887 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.887 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.887 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.887 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.887 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.887 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.888 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.888 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.888 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.888 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.888 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.888 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.888 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.889 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.889 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.889 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.889 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.889 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.889 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.889 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.889 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.890 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.891 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.892 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.892 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.892 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.892 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.892 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.892 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.892 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.892 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.893 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:21:45.467905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.893 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.893 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.893 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.893 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.893 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:21:43.460640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:07:55.894 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:08:15.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:08:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:08:16.275 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T01:08:16.287 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1668,"stamp":"2024-09-12T01:08:15.160177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83396560,"num_objects":733,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":179311,"num_read_kb":2341483,"num_write":142743,"num_write_kb":2353740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":716873,"num_omap_keys":1728,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12903,"ondisk_log_size":12903,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1647076,"kb_used_data":155428,"kb_used_omap":12,"kb_used_meta":1491507,"kb_avail":753327644,"statfs":{"total":773094113280,"available":771407507456,"internally_reserved":0,"allocated":159158272,"data_stored":143082942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1527303729},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106486,"num_omap_keys":260,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008209"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.054822+0000","last_change":"2024-09-12T01:08:10.054822+0000","last_active":"2024-09-12T01:08:10.054822+0000","last_peered":"2024-09-12T01:08:10.054822+0000","last_clean":"2024-09-12T01:08:10.054822+0000","last_became_active":"2024-09-12T00:49:10.623491+0000","last_became_peered":"2024-09-12T00:49:10.623491+0000","last_unstale":"2024-09-12T01:08:10.054822+0000","last_undegraded":"2024-09-12T01:08:10.054822+0000","last_fullsized":"2024-09-12T01:08:10.054822+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.054640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.054640+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.054640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:35.071276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"267'7","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.606226+0000","last_change":"2024-09-12T01:08:08.606069+0000","last_active":"2024-09-12T01:08:08.606226+0000","last_peered":"2024-09-12T01:08:08.606226+0000","last_clean":"2024-09-12T01:08:08.606226+0000","last_became_active":"2024-09-12T00:38:10.687911+0000","last_became_peered":"2024-09-12T00:38:10.687911+0000","last_unstale":"2024-09-12T01:08:08.606226+0000","last_undegraded":"2024-09-12T01:08:08.606226+0000","last_fullsized":"2024-09-12T01:08:08.606226+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:08.605857+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:08.605857+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.605857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:58.041544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.347173+0000","last_change":"2024-09-12T01:08:12.347173+0000","last_active":"2024-09-12T01:08:12.347173+0000","last_peered":"2024-09-12T01:08:12.347173+0000","last_clean":"2024-09-12T01:08:12.347173+0000","last_became_active":"2024-09-12T00:38:07.664779+0000","last_became_peered":"2024-09-12T00:38:07.664779+0000","last_unstale":"2024-09-12T01:08:12.347173+0000","last_undegraded":"2024-09-12T01:08:12.347173+0000","last_fullsized":"2024-09-12T01:08:12.347173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:12.346976+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:12.346976+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.346976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:41.632394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'50","reported_seq":183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.601950+0000","last_change":"2024-09-12T00:36:37.236134+0000","last_active":"2024-09-12T01:05:49.601950+0000","last_peered":"2024-09-12T01:05:49.601950+0000","last_clean":"2024-09-12T01:05:49.601950+0000","last_became_active":"2024-09-12T00:36:37.223686+0000","last_became_peered":"2024-09-12T00:36:37.223686+0000","last_unstale":"2024-09-12T01:05:49.601950+0000","last_undegraded":"2024-09-12T01:05:49.601950+0000","last_fullsized":"2024-09-12T01:05:49.601950+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":201,"num_write":87,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:14.582523+0000","last_change":"2024-09-12T00:49:10.625393+0000","last_active":"2024-09-12T01:04:14.582523+0000","last_peered":"2024-09-12T01:04:14.582523+0000","last_clean":"2024-09-12T01:04:14.582523+0000","last_became_active":"2024-09-12T00:49:10.624700+0000","last_became_peered":"2024-09-12T00:49:10.624700+0000","last_unstale":"2024-09-12T01:04:14.582523+0000","last_undegraded":"2024-09-12T01:04:14.582523+0000","last_fullsized":"2024-09-12T01:04:14.582523+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"267'8","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.272062+0000","last_change":"2024-09-12T01:08:13.271925+0000","last_active":"2024-09-12T01:08:13.272062+0000","last_peered":"2024-09-12T01:08:13.272062+0000","last_clean":"2024-09-12T01:08:13.272062+0000","last_became_active":"2024-09-12T00:38:10.691195+0000","last_became_peered":"2024-09-12T00:38:10.691195+0000","last_unstale":"2024-09-12T01:08:13.272062+0000","last_undegraded":"2024-09-12T01:08:13.272062+0000","last_fullsized":"2024-09-12T01:08:13.272062+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.271714+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.271714+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.271714+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:08.269903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"267'8","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852777+0000","last_change":"2024-09-12T00:38:07.665354+0000","last_active":"2024-09-12T01:07:25.852777+0000","last_peered":"2024-09-12T01:07:25.852777+0000","last_clean":"2024-09-12T01:07:25.852777+0000","last_became_active":"2024-09-12T00:38:07.664663+0000","last_became_peered":"2024-09-12T00:38:07.664663+0000","last_unstale":"2024-09-12T01:07:25.852777+0000","last_undegraded":"2024-09-12T01:07:25.852777+0000","last_fullsized":"2024-09-12T01:07:25.852777+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.575204+0000","last_change":"2024-09-12T01:08:14.575204+0000","last_active":"2024-09-12T01:08:14.575204+0000","last_peered":"2024-09-12T01:08:14.575204+0000","last_clean":"2024-09-12T01:08:14.575204+0000","last_became_active":"2024-09-12T00:36:37.239199+0000","last_became_peered":"2024-09-12T00:36:37.239199+0000","last_unstale":"2024-09-12T01:08:14.575204+0000","last_undegraded":"2024-09-12T01:08:14.575204+0000","last_fullsized":"2024-09-12T01:08:14.575204+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:14.575015+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:14.575015+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.575015+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:49.586544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.592098+0000","last_change":"2024-09-12T01:08:12.592098+0000","last_active":"2024-09-12T01:08:12.592098+0000","last_peered":"2024-09-12T01:08:12.592098+0000","last_clean":"2024-09-12T01:08:12.592098+0000","last_became_active":"2024-09-12T00:49:10.611715+0000","last_became_peered":"2024-09-12T00:49:10.611715+0000","last_unstale":"2024-09-12T01:08:12.592098+0000","last_undegraded":"2024-09-12T01:08:12.592098+0000","last_fullsized":"2024-09-12T01:08:12.592098+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:12.591892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:12.591892+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.591892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:16.236185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"267'13","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.115134+0000","last_change":"2024-09-12T00:38:10.708434+0000","last_active":"2024-09-12T01:07:26.115134+0000","last_peered":"2024-09-12T01:07:26.115134+0000","last_clean":"2024-09-12T01:07:26.115134+0000","last_became_active":"2024-09-12T00:38:10.702832+0000","last_became_peered":"2024-09-12T00:38:10.702832+0000","last_unstale":"2024-09-12T01:07:26.115134+0000","last_undegraded":"2024-09-12T01:07:26.115134+0000","last_fullsized":"2024-09-12T01:07:26.115134+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:02.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26653,"num_write":18,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.315534+0000","last_change":"2024-09-12T01:08:13.315534+0000","last_active":"2024-09-12T01:08:13.315534+0000","last_peered":"2024-09-12T01:08:13.315534+0000","last_clean":"2024-09-12T01:08:13.315534+0000","last_became_active":"2024-09-12T00:38:07.654162+0000","last_became_peered":"2024-09-12T00:38:07.654162+0000","last_unstale":"2024-09-12T01:08:13.315534+0000","last_undegraded":"2024-09-12T01:08:13.315534+0000","last_fullsized":"2024-09-12T01:08:13.315534+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:13.315358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:13.315358+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.315358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:31.740346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'61","reported_seq":223,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.285338+0000","last_change":"2024-09-12T01:08:11.285338+0000","last_active":"2024-09-12T01:08:11.285338+0000","last_peered":"2024-09-12T01:08:11.285338+0000","last_clean":"2024-09-12T01:08:11.285338+0000","last_became_active":"2024-09-12T00:36:37.243951+0000","last_became_peered":"2024-09-12T00:36:37.243951+0000","last_unstale":"2024-09-12T01:08:11.285338+0000","last_undegraded":"2024-09-12T01:08:11.285338+0000","last_fullsized":"2024-09-12T01:08:11.285338+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'61","last_scrub_stamp":"2024-09-12T01:08:11.285152+0000","last_deep_scrub":"267'61","last_deep_scrub_stamp":"2024-09-12T01:08:11.285152+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.285152+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:38.177940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":228,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600226+0000","last_change":"2024-09-12T00:49:10.614295+0000","last_active":"2024-09-12T01:03:49.600226+0000","last_peered":"2024-09-12T01:03:49.600226+0000","last_clean":"2024-09-12T01:03:49.600226+0000","last_became_active":"2024-09-12T00:49:10.613525+0000","last_became_peered":"2024-09-12T00:49:10.613525+0000","last_unstale":"2024-09-12T01:03:49.600226+0000","last_undegraded":"2024-09-12T01:03:49.600226+0000","last_fullsized":"2024-09-12T01:03:49.600226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:34.120845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'12","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321339+0000","last_change":"2024-09-12T00:38:10.702125+0000","last_active":"2024-09-12T01:07:26.321339+0000","last_peered":"2024-09-12T01:07:26.321339+0000","last_clean":"2024-09-12T01:07:26.321339+0000","last_became_active":"2024-09-12T00:38:10.701406+0000","last_became_peered":"2024-09-12T00:38:10.701406+0000","last_unstale":"2024-09-12T01:07:26.321339+0000","last_undegraded":"2024-09-12T01:07:26.321339+0000","last_fullsized":"2024-09-12T01:07:26.321339+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.321347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'4","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.599017+0000","last_change":"2024-09-12T01:08:07.599017+0000","last_active":"2024-09-12T01:08:07.599017+0000","last_peered":"2024-09-12T01:08:07.599017+0000","last_clean":"2024-09-12T01:08:07.599017+0000","last_became_active":"2024-09-12T00:38:07.639897+0000","last_became_peered":"2024-09-12T00:38:07.639897+0000","last_unstale":"2024-09-12T01:08:07.599017+0000","last_undegraded":"2024-09-12T01:08:07.599017+0000","last_fullsized":"2024-09-12T01:08:07.599017+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:08:07.598817+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:08:07.598817+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.598817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:19.008558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4625,"num_write":4,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'49","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.265543+0000","last_change":"2024-09-12T01:08:10.265543+0000","last_active":"2024-09-12T01:08:10.265543+0000","last_peered":"2024-09-12T01:08:10.265543+0000","last_clean":"2024-09-12T01:08:10.265543+0000","last_became_active":"2024-09-12T00:36:37.235921+0000","last_became_peered":"2024-09-12T00:36:37.235921+0000","last_unstale":"2024-09-12T01:08:10.265543+0000","last_undegraded":"2024-09-12T01:08:10.265543+0000","last_fullsized":"2024-09-12T01:08:10.265543+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'49","last_scrub_stamp":"2024-09-12T01:08:10.265370+0000","last_deep_scrub":"267'49","last_deep_scrub_stamp":"2024-09-12T01:08:10.265370+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.265370+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:23.396702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":160,"num_write":94,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.601979+0000","last_change":"2024-09-12T00:49:10.640862+0000","last_active":"2024-09-12T01:05:18.601979+0000","last_peered":"2024-09-12T01:05:18.601979+0000","last_clean":"2024-09-12T01:05:18.601979+0000","last_became_active":"2024-09-12T00:49:10.640187+0000","last_became_peered":"2024-09-12T00:49:10.640187+0000","last_unstale":"2024-09-12T01:05:18.601979+0000","last_undegraded":"2024-09-12T01:05:18.601979+0000","last_fullsized":"2024-09-12T01:05:18.601979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.913407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.067106+0000","last_change":"2024-09-12T01:08:02.067106+0000","last_active":"2024-09-12T01:08:02.067106+0000","last_peered":"2024-09-12T01:08:02.067106+0000","last_clean":"2024-09-12T01:08:02.067106+0000","last_became_active":"2024-09-12T00:38:10.702113+0000","last_became_peered":"2024-09-12T00:38:10.702113+0000","last_unstale":"2024-09-12T01:08:02.067106+0000","last_undegraded":"2024-09-12T01:08:02.067106+0000","last_fullsized":"2024-09-12T01:08:02.067106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:02.066913+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:02.066913+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.066913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:16.587948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.613854+0000","last_change":"2024-09-12T00:38:07.661344+0000","last_active":"2024-09-12T01:04:44.613854+0000","last_peered":"2024-09-12T01:04:44.613854+0000","last_clean":"2024-09-12T01:04:44.613854+0000","last_became_active":"2024-09-12T00:38:07.660159+0000","last_became_peered":"2024-09-12T00:38:07.660159+0000","last_unstale":"2024-09-12T01:04:44.613854+0000","last_undegraded":"2024-09-12T01:04:44.613854+0000","last_fullsized":"2024-09-12T01:04:44.613854+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:05.309641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'28","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.296991+0000","last_change":"2024-09-12T01:08:09.296991+0000","last_active":"2024-09-12T01:08:09.296991+0000","last_peered":"2024-09-12T01:08:09.296991+0000","last_clean":"2024-09-12T01:08:09.296991+0000","last_became_active":"2024-09-12T00:36:37.248920+0000","last_became_peered":"2024-09-12T00:36:37.248920+0000","last_unstale":"2024-09-12T01:08:09.296991+0000","last_undegraded":"2024-09-12T01:08:09.296991+0000","last_fullsized":"2024-09-12T01:08:09.296991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T01:08:09.296777+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T01:08:09.296777+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.296777+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:14.544546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:54.603533+0000","last_change":"2024-09-12T00:49:10.640254+0000","last_active":"2024-09-12T01:05:54.603533+0000","last_peered":"2024-09-12T01:05:54.603533+0000","last_clean":"2024-09-12T01:05:54.603533+0000","last_became_active":"2024-09-12T00:49:10.638196+0000","last_became_peered":"2024-09-12T00:49:10.638196+0000","last_unstale":"2024-09-12T01:05:54.603533+0000","last_undegraded":"2024-09-12T01:05:54.603533+0000","last_fullsized":"2024-09-12T01:05:54.603533+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634261+0000","last_change":"2024-09-12T00:38:10.715254+0000","last_active":"2024-09-12T01:04:49.634261+0000","last_peered":"2024-09-12T01:04:49.634261+0000","last_clean":"2024-09-12T01:04:49.634261+0000","last_became_active":"2024-09-12T00:38:10.714503+0000","last_became_peered":"2024-09-12T00:38:10.714503+0000","last_unstale":"2024-09-12T01:04:49.634261+0000","last_undegraded":"2024-09-12T01:04:49.634261+0000","last_fullsized":"2024-09-12T01:04:49.634261+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.076577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"267'5","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:19.427278+0000","last_change":"2024-09-12T00:38:07.659781+0000","last_active":"2024-09-12T01:07:19.427278+0000","last_peered":"2024-09-12T01:07:19.427278+0000","last_clean":"2024-09-12T01:07:19.427278+0000","last_became_active":"2024-09-12T00:38:07.656570+0000","last_became_peered":"2024-09-12T00:38:07.656570+0000","last_unstale":"2024-09-12T01:07:19.427278+0000","last_undegraded":"2024-09-12T01:07:19.427278+0000","last_fullsized":"2024-09-12T01:07:19.427278+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:44.888062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'40","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.069684+0000","last_change":"2024-09-12T01:08:05.069684+0000","last_active":"2024-09-12T01:08:05.069684+0000","last_peered":"2024-09-12T01:08:05.069684+0000","last_clean":"2024-09-12T01:08:05.069684+0000","last_became_active":"2024-09-12T00:36:37.239055+0000","last_became_peered":"2024-09-12T00:36:37.239055+0000","last_unstale":"2024-09-12T01:08:05.069684+0000","last_undegraded":"2024-09-12T01:08:05.069684+0000","last_fullsized":"2024-09-12T01:08:05.069684+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:05.069464+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:05.069464+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.069464+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:25.091455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":128,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:09.748036+0000","last_change":"2024-09-12T00:49:10.625186+0000","last_active":"2024-09-12T01:04:09.748036+0000","last_peered":"2024-09-12T01:04:09.748036+0000","last_clean":"2024-09-12T01:04:09.748036+0000","last_became_active":"2024-09-12T00:49:10.624542+0000","last_became_peered":"2024-09-12T00:49:10.624542+0000","last_unstale":"2024-09-12T01:04:09.748036+0000","last_undegraded":"2024-09-12T01:04:09.748036+0000","last_fullsized":"2024-09-12T01:04:09.748036+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:44.317158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.188462+0000","last_change":"2024-09-12T01:08:11.188325+0000","last_active":"2024-09-12T01:08:11.188462+0000","last_peered":"2024-09-12T01:08:11.188462+0000","last_clean":"2024-09-12T01:08:11.188462+0000","last_became_active":"2024-09-12T00:38:10.698076+0000","last_became_peered":"2024-09-12T00:38:10.698076+0000","last_unstale":"2024-09-12T01:08:11.188462+0000","last_undegraded":"2024-09-12T01:08:11.188462+0000","last_fullsized":"2024-09-12T01:08:11.188462+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.188141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.188141+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.188141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:59.829689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.018764+0000","last_change":"2024-09-12T01:08:01.018642+0000","last_active":"2024-09-12T01:08:01.018764+0000","last_peered":"2024-09-12T01:08:01.018764+0000","last_clean":"2024-09-12T01:08:01.018764+0000","last_became_active":"2024-09-12T00:38:07.626956+0000","last_became_peered":"2024-09-12T00:38:07.626956+0000","last_unstale":"2024-09-12T01:08:01.018764+0000","last_undegraded":"2024-09-12T01:08:01.018764+0000","last_fullsized":"2024-09-12T01:08:01.018764+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:01.018436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:01.018436+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.018436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:14.899789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'29","reported_seq":133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.366021+0000","last_change":"2024-09-12T01:08:06.365759+0000","last_active":"2024-09-12T01:08:06.366021+0000","last_peered":"2024-09-12T01:08:06.366021+0000","last_clean":"2024-09-12T01:08:06.366021+0000","last_became_active":"2024-09-12T00:36:37.239412+0000","last_became_peered":"2024-09-12T00:36:37.239412+0000","last_unstale":"2024-09-12T01:08:06.366021+0000","last_undegraded":"2024-09-12T01:08:06.366021+0000","last_fullsized":"2024-09-12T01:08:06.366021+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T01:08:06.365544+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T01:08:06.365544+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.365544+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.997295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":107,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.086539+0000","last_change":"2024-09-12T01:08:09.086539+0000","last_active":"2024-09-12T01:08:09.086539+0000","last_peered":"2024-09-12T01:08:09.086539+0000","last_clean":"2024-09-12T01:08:09.086539+0000","last_became_active":"2024-09-12T00:49:10.623930+0000","last_became_peered":"2024-09-12T00:49:10.623930+0000","last_unstale":"2024-09-12T01:08:09.086539+0000","last_undegraded":"2024-09-12T01:08:09.086539+0000","last_fullsized":"2024-09-12T01:08:09.086539+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.086352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.086352+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.086352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:30.887710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.607951+0000","last_change":"2024-09-12T00:38:10.710382+0000","last_active":"2024-09-12T01:05:43.607951+0000","last_peered":"2024-09-12T01:05:43.607951+0000","last_clean":"2024-09-12T01:05:43.607951+0000","last_became_active":"2024-09-12T00:38:10.709065+0000","last_became_peered":"2024-09-12T00:38:10.709065+0000","last_unstale":"2024-09-12T01:05:43.607951+0000","last_undegraded":"2024-09-12T01:05:43.607951+0000","last_fullsized":"2024-09-12T01:05:43.607951+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"267'4","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.300089+0000","last_change":"2024-09-12T01:08:14.300089+0000","last_active":"2024-09-12T01:08:14.300089+0000","last_peered":"2024-09-12T01:08:14.300089+0000","last_clean":"2024-09-12T01:08:14.300089+0000","last_became_active":"2024-09-12T00:38:07.658039+0000","last_became_peered":"2024-09-12T00:38:07.658039+0000","last_unstale":"2024-09-12T01:08:14.300089+0000","last_undegraded":"2024-09-12T01:08:14.300089+0000","last_fullsized":"2024-09-12T01:08:14.300089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:14.299865+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:14.299865+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.299865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:52.543724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'24","reported_seq":109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.307701+0000","last_change":"2024-09-12T01:08:08.307701+0000","last_active":"2024-09-12T01:08:08.307701+0000","last_peered":"2024-09-12T01:08:08.307701+0000","last_clean":"2024-09-12T01:08:08.307701+0000","last_became_active":"2024-09-12T00:36:37.238156+0000","last_became_peered":"2024-09-12T00:36:37.238156+0000","last_unstale":"2024-09-12T01:08:08.307701+0000","last_undegraded":"2024-09-12T01:08:08.307701+0000","last_fullsized":"2024-09-12T01:08:08.307701+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'24","last_scrub_stamp":"2024-09-12T01:08:08.307532+0000","last_deep_scrub":"267'24","last_deep_scrub_stamp":"2024-09-12T01:08:08.307532+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.307532+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.600072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":66,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.625939+0000","last_change":"2024-09-12T00:49:10.614687+0000","last_active":"2024-09-12T01:05:34.625939+0000","last_peered":"2024-09-12T01:05:34.625939+0000","last_clean":"2024-09-12T01:05:34.625939+0000","last_became_active":"2024-09-12T00:49:10.614006+0000","last_became_peered":"2024-09-12T00:49:10.614006+0000","last_unstale":"2024-09-12T01:05:34.625939+0000","last_undegraded":"2024-09-12T01:05:34.625939+0000","last_fullsized":"2024-09-12T01:05:34.625939+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.428804+0000","last_change":"2024-09-12T00:38:10.692661+0000","last_active":"2024-09-12T01:07:13.428804+0000","last_peered":"2024-09-12T01:07:13.428804+0000","last_clean":"2024-09-12T01:07:13.428804+0000","last_became_active":"2024-09-12T00:38:10.691887+0000","last_became_peered":"2024-09-12T00:38:10.691887+0000","last_unstale":"2024-09-12T01:07:13.428804+0000","last_undegraded":"2024-09-12T01:07:13.428804+0000","last_fullsized":"2024-09-12T01:07:13.428804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.050768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'8","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.621210+0000","last_change":"2024-09-12T00:38:07.654631+0000","last_active":"2024-09-12T01:07:26.621210+0000","last_peered":"2024-09-12T01:07:26.621210+0000","last_clean":"2024-09-12T01:07:26.621210+0000","last_became_active":"2024-09-12T00:38:07.653685+0000","last_became_peered":"2024-09-12T00:38:07.653685+0000","last_unstale":"2024-09-12T01:07:26.621210+0000","last_undegraded":"2024-09-12T01:07:26.621210+0000","last_fullsized":"2024-09-12T01:07:26.621210+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:49.445932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.551191+0000","last_change":"2024-09-12T01:08:13.551191+0000","last_active":"2024-09-12T01:08:13.551191+0000","last_peered":"2024-09-12T01:08:13.551191+0000","last_clean":"2024-09-12T01:08:13.551191+0000","last_became_active":"2024-09-12T00:36:37.223860+0000","last_became_peered":"2024-09-12T00:36:37.223860+0000","last_unstale":"2024-09-12T01:08:13.551191+0000","last_undegraded":"2024-09-12T01:08:13.551191+0000","last_fullsized":"2024-09-12T01:08:13.551191+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.550870+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.550870+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.550870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:17.887059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.599856+0000","last_change":"2024-09-12T00:49:10.623954+0000","last_active":"2024-09-12T01:05:34.599856+0000","last_peered":"2024-09-12T01:05:34.599856+0000","last_clean":"2024-09-12T01:05:34.599856+0000","last_became_active":"2024-09-12T00:49:10.622347+0000","last_became_peered":"2024-09-12T00:49:10.622347+0000","last_unstale":"2024-09-12T01:05:34.599856+0000","last_undegraded":"2024-09-12T01:05:34.599856+0000","last_fullsized":"2024-09-12T01:05:34.599856+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:59.602778+0000","last_change":"2024-09-12T00:38:10.718025+0000","last_active":"2024-09-12T01:03:59.602778+0000","last_peered":"2024-09-12T01:03:59.602778+0000","last_clean":"2024-09-12T01:03:59.602778+0000","last_became_active":"2024-09-12T00:38:10.717358+0000","last_became_peered":"2024-09-12T00:38:10.717358+0000","last_unstale":"2024-09-12T01:03:59.602778+0000","last_undegraded":"2024-09-12T01:03:59.602778+0000","last_fullsized":"2024-09-12T01:03:59.602778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:56.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'3","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.010467+0000","last_change":"2024-09-12T01:07:56.010467+0000","last_active":"2024-09-12T01:07:56.010467+0000","last_peered":"2024-09-12T01:07:56.010467+0000","last_clean":"2024-09-12T01:07:56.010467+0000","last_became_active":"2024-09-12T00:38:07.638712+0000","last_became_peered":"2024-09-12T00:38:07.638712+0000","last_unstale":"2024-09-12T01:07:56.010467+0000","last_undegraded":"2024-09-12T01:07:56.010467+0000","last_fullsized":"2024-09-12T01:07:56.010467+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:07:56.010283+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:07:56.010283+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.010283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:12.789520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'20","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.549580+0000","last_change":"2024-09-12T01:08:12.549580+0000","last_active":"2024-09-12T01:08:12.549580+0000","last_peered":"2024-09-12T01:08:12.549580+0000","last_clean":"2024-09-12T01:08:12.549580+0000","last_became_active":"2024-09-12T00:36:37.223487+0000","last_became_peered":"2024-09-12T00:36:37.223487+0000","last_unstale":"2024-09-12T01:08:12.549580+0000","last_undegraded":"2024-09-12T01:08:12.549580+0000","last_fullsized":"2024-09-12T01:08:12.549580+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:08:12.549398+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:08:12.549398+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.549398+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:47.373141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":70,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.765888+0000","last_change":"2024-09-12T00:49:10.612000+0000","last_active":"2024-09-12T01:05:29.765888+0000","last_peered":"2024-09-12T01:05:29.765888+0000","last_clean":"2024-09-12T01:05:29.765888+0000","last_became_active":"2024-09-12T00:49:10.611251+0000","last_became_peered":"2024-09-12T00:49:10.611251+0000","last_unstale":"2024-09-12T01:05:29.765888+0000","last_undegraded":"2024-09-12T01:05:29.765888+0000","last_fullsized":"2024-09-12T01:05:29.765888+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.558277+0000","last_change":"2024-09-12T00:38:10.707668+0000","last_active":"2024-09-12T01:07:26.558277+0000","last_peered":"2024-09-12T01:07:26.558277+0000","last_clean":"2024-09-12T01:07:26.558277+0000","last_became_active":"2024-09-12T00:38:10.706726+0000","last_became_peered":"2024-09-12T00:38:10.706726+0000","last_unstale":"2024-09-12T01:07:26.558277+0000","last_undegraded":"2024-09-12T01:07:26.558277+0000","last_fullsized":"2024-09-12T01:07:26.558277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:45.954816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'4","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.310827+0000","last_change":"2024-09-12T01:08:10.310827+0000","last_active":"2024-09-12T01:08:10.310827+0000","last_peered":"2024-09-12T01:08:10.310827+0000","last_clean":"2024-09-12T01:08:10.310827+0000","last_became_active":"2024-09-12T00:38:07.667724+0000","last_became_peered":"2024-09-12T00:38:07.667724+0000","last_unstale":"2024-09-12T01:08:10.310827+0000","last_undegraded":"2024-09-12T01:08:10.310827+0000","last_fullsized":"2024-09-12T01:08:10.310827+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:10.310639+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:10.310639+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.310639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:33.973549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'49","reported_seq":187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.330682+0000","last_change":"2024-09-12T01:08:07.330682+0000","last_active":"2024-09-12T01:08:07.330682+0000","last_peered":"2024-09-12T01:08:07.330682+0000","last_clean":"2024-09-12T01:08:07.330682+0000","last_became_active":"2024-09-12T00:36:37.244259+0000","last_became_peered":"2024-09-12T00:36:37.244259+0000","last_unstale":"2024-09-12T01:08:07.330682+0000","last_undegraded":"2024-09-12T01:08:07.330682+0000","last_fullsized":"2024-09-12T01:08:07.330682+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'49","last_scrub_stamp":"2024-09-12T01:08:07.330420+0000","last_deep_scrub":"267'49","last_deep_scrub_stamp":"2024-09-12T01:08:07.330420+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.330420+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:12.111873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":182,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.058375+0000","last_change":"2024-09-12T01:08:08.058375+0000","last_active":"2024-09-12T01:08:08.058375+0000","last_peered":"2024-09-12T01:08:08.058375+0000","last_clean":"2024-09-12T01:08:08.058375+0000","last_became_active":"2024-09-12T00:49:10.629746+0000","last_became_peered":"2024-09-12T00:49:10.629746+0000","last_unstale":"2024-09-12T01:08:08.058375+0000","last_undegraded":"2024-09-12T01:08:08.058375+0000","last_fullsized":"2024-09-12T01:08:08.058375+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:08.058153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:08.058153+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.058153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:21.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.113806+0000","last_change":"2024-09-12T01:08:04.113806+0000","last_active":"2024-09-12T01:08:04.113806+0000","last_peered":"2024-09-12T01:08:04.113806+0000","last_clean":"2024-09-12T01:08:04.113806+0000","last_became_active":"2024-09-12T00:38:10.695688+0000","last_became_peered":"2024-09-12T00:38:10.695688+0000","last_unstale":"2024-09-12T01:08:04.113806+0000","last_undegraded":"2024-09-12T01:08:04.113806+0000","last_fullsized":"2024-09-12T01:08:04.113806+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:04.113621+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:04.113621+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.113621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:20.002680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.614081+0000","last_change":"2024-09-12T00:38:07.647799+0000","last_active":"2024-09-12T01:04:44.614081+0000","last_peered":"2024-09-12T01:04:44.614081+0000","last_clean":"2024-09-12T01:04:44.614081+0000","last_became_active":"2024-09-12T00:38:07.645284+0000","last_became_peered":"2024-09-12T00:38:07.645284+0000","last_unstale":"2024-09-12T01:04:44.614081+0000","last_undegraded":"2024-09-12T01:04:44.614081+0000","last_fullsized":"2024-09-12T01:04:44.614081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:30.146339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'28","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:44.633189+0000","last_change":"2024-09-12T00:36:37.221009+0000","last_active":"2024-09-12T01:04:44.633189+0000","last_peered":"2024-09-12T01:04:44.633189+0000","last_clean":"2024-09-12T01:04:44.633189+0000","last_became_active":"2024-09-12T00:36:37.220195+0000","last_became_peered":"2024-09-12T00:36:37.220195+0000","last_unstale":"2024-09-12T01:04:44.633189+0000","last_undegraded":"2024-09-12T01:04:44.633189+0000","last_fullsized":"2024-09-12T01:04:44.633189+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:56.729275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":108,"num_write":45,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.599208+0000","last_change":"2024-09-12T00:49:10.615352+0000","last_active":"2024-09-12T01:03:44.599208+0000","last_peered":"2024-09-12T01:03:44.599208+0000","last_clean":"2024-09-12T01:03:44.599208+0000","last_became_active":"2024-09-12T00:49:10.614661+0000","last_became_peered":"2024-09-12T00:49:10.614661+0000","last_unstale":"2024-09-12T01:03:44.599208+0000","last_undegraded":"2024-09-12T01:03:44.599208+0000","last_fullsized":"2024-09-12T01:03:44.599208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:28.781007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'3","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:14.635619+0000","last_change":"2024-09-12T00:38:10.704123+0000","last_active":"2024-09-12T01:06:14.635619+0000","last_peered":"2024-09-12T01:06:14.635619+0000","last_clean":"2024-09-12T01:06:14.635619+0000","last_became_active":"2024-09-12T00:38:10.702260+0000","last_became_peered":"2024-09-12T00:38:10.702260+0000","last_unstale":"2024-09-12T01:06:14.635619+0000","last_undegraded":"2024-09-12T01:06:14.635619+0000","last_fullsized":"2024-09-12T01:06:14.635619+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:52.661395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'4","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.623671+0000","last_change":"2024-09-12T01:08:05.623671+0000","last_active":"2024-09-12T01:08:05.623671+0000","last_peered":"2024-09-12T01:08:05.623671+0000","last_clean":"2024-09-12T01:08:05.623671+0000","last_became_active":"2024-09-12T00:38:07.639687+0000","last_became_peered":"2024-09-12T00:38:07.639687+0000","last_unstale":"2024-09-12T01:08:05.623671+0000","last_undegraded":"2024-09-12T01:08:05.623671+0000","last_fullsized":"2024-09-12T01:08:05.623671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:08:05.623473+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:08:05.623473+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.623473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:53.792955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'52","reported_seq":183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.631949+0000","last_change":"2024-09-12T00:36:37.241171+0000","last_active":"2024-09-12T01:04:39.631949+0000","last_peered":"2024-09-12T01:04:39.631949+0000","last_clean":"2024-09-12T01:04:39.631949+0000","last_became_active":"2024-09-12T00:36:37.239844+0000","last_became_peered":"2024-09-12T00:36:37.239844+0000","last_unstale":"2024-09-12T01:04:39.631949+0000","last_undegraded":"2024-09-12T01:04:39.631949+0000","last_fullsized":"2024-09-12T01:04:39.631949+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:34.727635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":188,"num_write":97,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574686+0000","last_change":"2024-09-12T00:49:10.632954+0000","last_active":"2024-09-12T01:03:44.574686+0000","last_peered":"2024-09-12T01:03:44.574686+0000","last_clean":"2024-09-12T01:03:44.574686+0000","last_became_active":"2024-09-12T00:49:10.632241+0000","last_became_peered":"2024-09-12T00:49:10.632241+0000","last_unstale":"2024-09-12T01:03:44.574686+0000","last_undegraded":"2024-09-12T01:03:44.574686+0000","last_fullsized":"2024-09-12T01:03:44.574686+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:12.021164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"267'5","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:14.635438+0000","last_change":"2024-09-12T00:38:10.714497+0000","last_active":"2024-09-12T01:06:14.635438+0000","last_peered":"2024-09-12T01:06:14.635438+0000","last_clean":"2024-09-12T01:06:14.635438+0000","last_became_active":"2024-09-12T00:38:10.713890+0000","last_became_peered":"2024-09-12T00:38:10.713890+0000","last_unstale":"2024-09-12T01:06:14.635438+0000","last_undegraded":"2024-09-12T01:06:14.635438+0000","last_fullsized":"2024-09-12T01:06:14.635438+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.839866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'3","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.600291+0000","last_change":"2024-09-12T00:38:07.667759+0000","last_active":"2024-09-12T01:03:49.600291+0000","last_peered":"2024-09-12T01:03:49.600291+0000","last_clean":"2024-09-12T01:03:49.600291+0000","last_became_active":"2024-09-12T00:38:07.667180+0000","last_became_peered":"2024-09-12T00:38:07.667180+0000","last_unstale":"2024-09-12T01:03:49.600291+0000","last_undegraded":"2024-09-12T01:03:49.600291+0000","last_fullsized":"2024-09-12T01:03:49.600291+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.515772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'23","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.339206+0000","last_change":"2024-09-12T01:08:04.339206+0000","last_active":"2024-09-12T01:08:04.339206+0000","last_peered":"2024-09-12T01:08:04.339206+0000","last_clean":"2024-09-12T01:08:04.339206+0000","last_became_active":"2024-09-12T00:36:37.248733+0000","last_became_peered":"2024-09-12T00:36:37.248733+0000","last_unstale":"2024-09-12T01:08:04.339206+0000","last_undegraded":"2024-09-12T01:08:04.339206+0000","last_fullsized":"2024-09-12T01:08:04.339206+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-12T01:08:04.339027+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-12T01:08:04.339027+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.339027+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.309511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.599350+0000","last_change":"2024-09-12T00:49:10.639305+0000","last_active":"2024-09-12T01:05:39.599350+0000","last_peered":"2024-09-12T01:05:39.599350+0000","last_clean":"2024-09-12T01:05:39.599350+0000","last_became_active":"2024-09-12T00:49:10.638628+0000","last_became_peered":"2024-09-12T00:49:10.638628+0000","last_unstale":"2024-09-12T01:05:39.599350+0000","last_undegraded":"2024-09-12T01:05:39.599350+0000","last_fullsized":"2024-09-12T01:05:39.599350+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:53.582007+0000","last_change":"2024-09-12T00:38:10.691801+0000","last_active":"2024-09-12T01:03:53.582007+0000","last_peered":"2024-09-12T01:03:53.582007+0000","last_clean":"2024-09-12T01:03:53.582007+0000","last_became_active":"2024-09-12T00:38:10.691129+0000","last_became_peered":"2024-09-12T00:38:10.691129+0000","last_unstale":"2024-09-12T01:03:53.582007+0000","last_undegraded":"2024-09-12T01:03:53.582007+0000","last_fullsized":"2024-09-12T01:03:53.582007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:27.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.610422+0000","last_change":"2024-09-12T01:08:10.610422+0000","last_active":"2024-09-12T01:08:10.610422+0000","last_peered":"2024-09-12T01:08:10.610422+0000","last_clean":"2024-09-12T01:08:10.610422+0000","last_became_active":"2024-09-12T00:38:07.641719+0000","last_became_peered":"2024-09-12T00:38:07.641719+0000","last_unstale":"2024-09-12T01:08:10.610422+0000","last_undegraded":"2024-09-12T01:08:10.610422+0000","last_fullsized":"2024-09-12T01:08:10.610422+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.610239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.610239+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.610239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:01.189388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'60","reported_seq":212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.108244+0000","last_change":"2024-09-12T01:08:04.108244+0000","last_active":"2024-09-12T01:08:04.108244+0000","last_peered":"2024-09-12T01:08:04.108244+0000","last_clean":"2024-09-12T01:08:04.108244+0000","last_became_active":"2024-09-12T00:36:37.223432+0000","last_became_peered":"2024-09-12T00:36:37.223432+0000","last_unstale":"2024-09-12T01:08:04.108244+0000","last_undegraded":"2024-09-12T01:08:04.108244+0000","last_fullsized":"2024-09-12T01:08:04.108244+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'60","last_scrub_stamp":"2024-09-12T01:08:04.107973+0000","last_deep_scrub":"267'60","last_deep_scrub_stamp":"2024-09-12T01:08:04.107973+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.107973+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:41.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":212,"num_write":101,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.574626+0000","last_change":"2024-09-12T00:49:10.635230+0000","last_active":"2024-09-12T01:03:44.574626+0000","last_peered":"2024-09-12T01:03:44.574626+0000","last_clean":"2024-09-12T01:03:44.574626+0000","last_became_active":"2024-09-12T00:49:10.634783+0000","last_became_peered":"2024-09-12T00:49:10.634783+0000","last_unstale":"2024-09-12T01:03:44.574626+0000","last_undegraded":"2024-09-12T01:03:44.574626+0000","last_fullsized":"2024-09-12T01:03:44.574626+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:22.424861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:03:54.619873+0000","last_change":"2024-09-12T00:38:10.709528+0000","last_active":"2024-09-12T01:03:54.619873+0000","last_peered":"2024-09-12T01:03:54.619873+0000","last_clean":"2024-09-12T01:03:54.619873+0000","last_became_active":"2024-09-12T00:38:10.708687+0000","last_became_peered":"2024-09-12T00:38:10.708687+0000","last_unstale":"2024-09-12T01:03:54.619873+0000","last_undegraded":"2024-09-12T01:03:54.619873+0000","last_fullsized":"2024-09-12T01:03:54.619873+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.079976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.604898+0000","last_change":"2024-09-12T01:08:06.604898+0000","last_active":"2024-09-12T01:08:06.604898+0000","last_peered":"2024-09-12T01:08:06.604898+0000","last_clean":"2024-09-12T01:08:06.604898+0000","last_became_active":"2024-09-12T00:38:07.636298+0000","last_became_peered":"2024-09-12T00:38:07.636298+0000","last_unstale":"2024-09-12T01:08:06.604898+0000","last_undegraded":"2024-09-12T01:08:06.604898+0000","last_fullsized":"2024-09-12T01:08:06.604898+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.604708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.604708+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.604708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:16.801689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.370709+0000","last_change":"2024-09-12T01:08:02.370709+0000","last_active":"2024-09-12T01:08:02.370709+0000","last_peered":"2024-09-12T01:08:02.370709+0000","last_clean":"2024-09-12T01:08:02.370709+0000","last_became_active":"2024-09-12T00:36:37.248770+0000","last_became_peered":"2024-09-12T00:36:37.248770+0000","last_unstale":"2024-09-12T01:08:02.370709+0000","last_undegraded":"2024-09-12T01:08:02.370709+0000","last_fullsized":"2024-09-12T01:08:02.370709+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-12T01:08:02.370499+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-12T01:08:02.370499+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.370499+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:07.319315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":141,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.609918+0000","last_change":"2024-09-12T00:49:10.597538+0000","last_active":"2024-09-12T01:04:29.609918+0000","last_peered":"2024-09-12T01:04:29.609918+0000","last_clean":"2024-09-12T01:04:29.609918+0000","last_became_active":"2024-09-12T00:49:10.596695+0000","last_became_peered":"2024-09-12T00:49:10.596695+0000","last_unstale":"2024-09-12T01:04:29.609918+0000","last_undegraded":"2024-09-12T01:04:29.609918+0000","last_fullsized":"2024-09-12T01:04:29.609918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:51.074598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.600399+0000","last_change":"2024-09-12T00:38:10.683836+0000","last_active":"2024-09-12T01:05:13.600399+0000","last_peered":"2024-09-12T01:05:13.600399+0000","last_clean":"2024-09-12T01:05:13.600399+0000","last_became_active":"2024-09-12T00:38:10.683024+0000","last_became_peered":"2024-09-12T00:38:10.683024+0000","last_unstale":"2024-09-12T01:05:13.600399+0000","last_undegraded":"2024-09-12T01:05:13.600399+0000","last_fullsized":"2024-09-12T01:05:13.600399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:08.556147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.303906+0000","last_change":"2024-09-12T01:08:14.303906+0000","last_active":"2024-09-12T01:08:14.303906+0000","last_peered":"2024-09-12T01:08:14.303906+0000","last_clean":"2024-09-12T01:08:14.303906+0000","last_became_active":"2024-09-12T00:38:07.663265+0000","last_became_peered":"2024-09-12T00:38:07.663265+0000","last_unstale":"2024-09-12T01:08:14.303906+0000","last_undegraded":"2024-09-12T01:08:14.303906+0000","last_fullsized":"2024-09-12T01:08:14.303906+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:14.303710+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:14.303710+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.303710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:35.415473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'15","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.416913+0000","last_change":"2024-09-12T01:08:01.416913+0000","last_active":"2024-09-12T01:08:01.416913+0000","last_peered":"2024-09-12T01:08:01.416913+0000","last_clean":"2024-09-12T01:08:01.416913+0000","last_became_active":"2024-09-12T00:36:37.247409+0000","last_became_peered":"2024-09-12T00:36:37.247409+0000","last_unstale":"2024-09-12T01:08:01.416913+0000","last_undegraded":"2024-09-12T01:08:01.416913+0000","last_fullsized":"2024-09-12T01:08:01.416913+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T01:08:01.416734+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T01:08:01.416734+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.416734+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:53.049074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":52,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.591961+0000","last_change":"2024-09-12T01:08:11.591961+0000","last_active":"2024-09-12T01:08:11.591961+0000","last_peered":"2024-09-12T01:08:11.591961+0000","last_clean":"2024-09-12T01:08:11.591961+0000","last_became_active":"2024-09-12T00:49:10.593471+0000","last_became_peered":"2024-09-12T00:49:10.593471+0000","last_unstale":"2024-09-12T01:08:11.591961+0000","last_undegraded":"2024-09-12T01:08:11.591961+0000","last_fullsized":"2024-09-12T01:08:11.591961+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.591737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.591737+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.591737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:19.864450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"267'4","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321277+0000","last_change":"2024-09-12T00:38:10.709654+0000","last_active":"2024-09-12T01:07:26.321277+0000","last_peered":"2024-09-12T01:07:26.321277+0000","last_clean":"2024-09-12T01:07:26.321277+0000","last_became_active":"2024-09-12T00:38:10.708936+0000","last_became_peered":"2024-09-12T00:38:10.708936+0000","last_unstale":"2024-09-12T01:07:26.321277+0000","last_undegraded":"2024-09-12T01:07:26.321277+0000","last_fullsized":"2024-09-12T01:07:26.321277+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:34.439374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'8","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.280620+0000","last_change":"2024-09-12T01:08:13.280620+0000","last_active":"2024-09-12T01:08:13.280620+0000","last_peered":"2024-09-12T01:08:13.280620+0000","last_clean":"2024-09-12T01:08:13.280620+0000","last_became_active":"2024-09-12T00:38:07.650419+0000","last_became_peered":"2024-09-12T00:38:07.650419+0000","last_unstale":"2024-09-12T01:08:13.280620+0000","last_undegraded":"2024-09-12T01:08:13.280620+0000","last_fullsized":"2024-09-12T01:08:13.280620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.280450+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.280450+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.280450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:22.910988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'98","reported_seq":353,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:54.650672+0000","last_change":"2024-09-12T00:36:37.227751+0000","last_active":"2024-09-12T01:05:54.650672+0000","last_peered":"2024-09-12T01:05:54.650672+0000","last_clean":"2024-09-12T01:05:54.650672+0000","last_became_active":"2024-09-12T00:36:37.225615+0000","last_became_peered":"2024-09-12T00:36:37.225615+0000","last_unstale":"2024-09-12T01:05:54.650672+0000","last_undegraded":"2024-09-12T01:05:54.650672+0000","last_fullsized":"2024-09-12T01:05:54.650672+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":608,"num_read_kb":444,"num_write":119,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626251+0000","last_change":"2024-09-12T00:49:10.620839+0000","last_active":"2024-09-12T01:04:19.626251+0000","last_peered":"2024-09-12T01:04:19.626251+0000","last_clean":"2024-09-12T01:04:19.626251+0000","last_became_active":"2024-09-12T00:49:10.620169+0000","last_became_peered":"2024-09-12T00:49:10.620169+0000","last_unstale":"2024-09-12T01:04:19.626251+0000","last_undegraded":"2024-09-12T01:04:19.626251+0000","last_fullsized":"2024-09-12T01:04:19.626251+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.688639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.602083+0000","last_change":"2024-09-12T00:38:10.686990+0000","last_active":"2024-09-12T01:05:18.602083+0000","last_peered":"2024-09-12T01:05:18.602083+0000","last_clean":"2024-09-12T01:05:18.602083+0000","last_became_active":"2024-09-12T00:38:10.686216+0000","last_became_peered":"2024-09-12T00:38:10.686216+0000","last_unstale":"2024-09-12T01:05:18.602083+0000","last_undegraded":"2024-09-12T01:05:18.602083+0000","last_fullsized":"2024-09-12T01:05:18.602083+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"267'4","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.326125+0000","last_change":"2024-09-12T01:08:09.326125+0000","last_active":"2024-09-12T01:08:09.326125+0000","last_peered":"2024-09-12T01:08:09.326125+0000","last_clean":"2024-09-12T01:08:09.326125+0000","last_became_active":"2024-09-12T00:38:07.661932+0000","last_became_peered":"2024-09-12T00:38:07.661932+0000","last_unstale":"2024-09-12T01:08:09.326125+0000","last_undegraded":"2024-09-12T01:08:09.326125+0000","last_fullsized":"2024-09-12T01:08:09.326125+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:09.325954+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:09.325954+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.325954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:53.038590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'12","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.612359+0000","last_change":"2024-09-12T01:08:03.612143+0000","last_active":"2024-09-12T01:08:03.612359+0000","last_peered":"2024-09-12T01:08:03.612359+0000","last_clean":"2024-09-12T01:08:03.612359+0000","last_became_active":"2024-09-12T00:36:37.226992+0000","last_became_peered":"2024-09-12T00:36:37.226992+0000","last_unstale":"2024-09-12T01:08:03.612359+0000","last_undegraded":"2024-09-12T01:08:03.612359+0000","last_fullsized":"2024-09-12T01:08:03.612359+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:03.611953+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:03.611953+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.611953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:17.131804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.578158+0000","last_change":"2024-09-12T01:08:09.578158+0000","last_active":"2024-09-12T01:08:09.578158+0000","last_peered":"2024-09-12T01:08:09.578158+0000","last_clean":"2024-09-12T01:08:09.578158+0000","last_became_active":"2024-09-12T00:49:10.597349+0000","last_became_peered":"2024-09-12T00:49:10.597349+0000","last_unstale":"2024-09-12T01:08:09.578158+0000","last_undegraded":"2024-09-12T01:08:09.578158+0000","last_fullsized":"2024-09-12T01:08:09.578158+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.577973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.577973+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.577973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:36.223547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"267'11","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.114642+0000","last_change":"2024-09-12T00:38:10.701647+0000","last_active":"2024-09-12T01:07:26.114642+0000","last_peered":"2024-09-12T01:07:26.114642+0000","last_clean":"2024-09-12T01:07:26.114642+0000","last_became_active":"2024-09-12T00:38:10.700892+0000","last_became_peered":"2024-09-12T00:38:10.700892+0000","last_unstale":"2024-09-12T01:07:26.114642+0000","last_undegraded":"2024-09-12T01:07:26.114642+0000","last_fullsized":"2024-09-12T01:07:26.114642+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:36.388849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":16,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.324475+0000","last_change":"2024-09-12T01:08:11.324475+0000","last_active":"2024-09-12T01:08:11.324475+0000","last_peered":"2024-09-12T01:08:11.324475+0000","last_clean":"2024-09-12T01:08:11.324475+0000","last_became_active":"2024-09-12T00:38:07.642924+0000","last_became_peered":"2024-09-12T00:38:07.642924+0000","last_unstale":"2024-09-12T01:08:11.324475+0000","last_undegraded":"2024-09-12T01:08:11.324475+0000","last_fullsized":"2024-09-12T01:08:11.324475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.324299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.324299+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.324299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:47.427053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'31","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.317274+0000","last_change":"2024-09-12T01:08:06.317033+0000","last_active":"2024-09-12T01:08:06.317274+0000","last_peered":"2024-09-12T01:08:06.317274+0000","last_clean":"2024-09-12T01:08:06.317274+0000","last_became_active":"2024-09-12T00:36:37.238481+0000","last_became_peered":"2024-09-12T00:36:37.238481+0000","last_unstale":"2024-09-12T01:08:06.317274+0000","last_undegraded":"2024-09-12T01:08:06.317274+0000","last_fullsized":"2024-09-12T01:08:06.317274+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'31","last_scrub_stamp":"2024-09-12T01:08:06.316765+0000","last_deep_scrub":"267'31","last_deep_scrub_stamp":"2024-09-12T01:08:06.316765+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.316765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:48.687142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":121,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.617607+0000","last_change":"2024-09-12T00:49:10.614315+0000","last_active":"2024-09-12T01:04:59.617607+0000","last_peered":"2024-09-12T01:04:59.617607+0000","last_clean":"2024-09-12T01:04:59.617607+0000","last_became_active":"2024-09-12T00:49:10.613613+0000","last_became_peered":"2024-09-12T00:49:10.613613+0000","last_unstale":"2024-09-12T01:04:59.617607+0000","last_undegraded":"2024-09-12T01:04:59.617607+0000","last_fullsized":"2024-09-12T01:04:59.617607+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:45.422915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.257884+0000","last_change":"2024-09-12T00:38:10.695438+0000","last_active":"2024-09-12T01:07:26.257884+0000","last_peered":"2024-09-12T01:07:26.257884+0000","last_clean":"2024-09-12T01:07:26.257884+0000","last_became_active":"2024-09-12T00:38:10.694714+0000","last_became_peered":"2024-09-12T00:38:10.694714+0000","last_unstale":"2024-09-12T01:07:26.257884+0000","last_undegraded":"2024-09-12T01:07:26.257884+0000","last_fullsized":"2024-09-12T01:07:26.257884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:46.770976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.363751+0000","last_change":"2024-09-12T01:08:05.363751+0000","last_active":"2024-09-12T01:08:05.363751+0000","last_peered":"2024-09-12T01:08:05.363751+0000","last_clean":"2024-09-12T01:08:05.363751+0000","last_became_active":"2024-09-12T00:38:07.647225+0000","last_became_peered":"2024-09-12T00:38:07.647225+0000","last_unstale":"2024-09-12T01:08:05.363751+0000","last_undegraded":"2024-09-12T01:08:05.363751+0000","last_fullsized":"2024-09-12T01:08:05.363751+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:05.363578+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:05.363578+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.363578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:18.312235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.267524+0000","last_change":"2024-09-12T01:08:05.267395+0000","last_active":"2024-09-12T01:08:05.267524+0000","last_peered":"2024-09-12T01:08:05.267524+0000","last_clean":"2024-09-12T01:08:05.267524+0000","last_became_active":"2024-09-12T00:36:37.246075+0000","last_became_peered":"2024-09-12T00:36:37.246075+0000","last_unstale":"2024-09-12T01:08:05.267524+0000","last_undegraded":"2024-09-12T01:08:05.267524+0000","last_fullsized":"2024-09-12T01:08:05.267524+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:05.267221+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:05.267221+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.267221+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:18.024035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.759397+0000","last_change":"2024-09-12T00:49:10.598511+0000","last_active":"2024-09-12T01:04:59.759397+0000","last_peered":"2024-09-12T01:04:59.759397+0000","last_clean":"2024-09-12T01:04:59.759397+0000","last_became_active":"2024-09-12T00:49:10.597773+0000","last_became_peered":"2024-09-12T00:49:10.597773+0000","last_unstale":"2024-09-12T01:04:59.759397+0000","last_undegraded":"2024-09-12T01:04:59.759397+0000","last_fullsized":"2024-09-12T01:04:59.759397+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:51.989977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.225131+0000","last_change":"2024-09-12T01:08:12.225131+0000","last_active":"2024-09-12T01:08:12.225131+0000","last_peered":"2024-09-12T01:08:12.225131+0000","last_clean":"2024-09-12T01:08:12.225131+0000","last_became_active":"2024-09-12T00:38:10.697403+0000","last_became_peered":"2024-09-12T00:38:10.697403+0000","last_unstale":"2024-09-12T01:08:12.225131+0000","last_undegraded":"2024-09-12T01:08:12.225131+0000","last_fullsized":"2024-09-12T01:08:12.225131+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:12.224908+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:12.224908+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.224908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:50.759178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:19.636825+0000","last_change":"2024-09-12T00:38:07.668475+0000","last_active":"2024-09-12T01:06:19.636825+0000","last_peered":"2024-09-12T01:06:19.636825+0000","last_clean":"2024-09-12T01:06:19.636825+0000","last_became_active":"2024-09-12T00:38:07.667447+0000","last_became_peered":"2024-09-12T00:38:07.667447+0000","last_unstale":"2024-09-12T01:06:19.636825+0000","last_undegraded":"2024-09-12T01:06:19.636825+0000","last_fullsized":"2024-09-12T01:06:19.636825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:23.306315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'28","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.094804+0000","last_change":"2024-09-12T01:08:03.094804+0000","last_active":"2024-09-12T01:08:03.094804+0000","last_peered":"2024-09-12T01:08:03.094804+0000","last_clean":"2024-09-12T01:08:03.094804+0000","last_became_active":"2024-09-12T00:36:37.239946+0000","last_became_peered":"2024-09-12T00:36:37.239946+0000","last_unstale":"2024-09-12T01:08:03.094804+0000","last_undegraded":"2024-09-12T01:08:03.094804+0000","last_fullsized":"2024-09-12T01:08:03.094804+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T01:08:03.094601+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T01:08:03.094601+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.094601+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:09.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.042174+0000","last_change":"2024-09-12T01:08:06.042174+0000","last_active":"2024-09-12T01:08:06.042174+0000","last_peered":"2024-09-12T01:08:06.042174+0000","last_clean":"2024-09-12T01:08:06.042174+0000","last_became_active":"2024-09-12T00:49:10.629903+0000","last_became_peered":"2024-09-12T00:49:10.629903+0000","last_unstale":"2024-09-12T01:08:06.042174+0000","last_undegraded":"2024-09-12T01:08:06.042174+0000","last_fullsized":"2024-09-12T01:08:06.042174+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:06.041988+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:06.041988+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.041988+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.998494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.815403+0000","last_change":"2024-09-12T00:38:10.714505+0000","last_active":"2024-09-12T01:07:26.815403+0000","last_peered":"2024-09-12T01:07:26.815403+0000","last_clean":"2024-09-12T01:07:26.815403+0000","last_became_active":"2024-09-12T00:38:10.708820+0000","last_became_peered":"2024-09-12T00:38:10.708820+0000","last_unstale":"2024-09-12T01:07:26.815403+0000","last_undegraded":"2024-09-12T01:07:26.815403+0000","last_fullsized":"2024-09-12T01:07:26.815403+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:21.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.291167+0000","last_change":"2024-09-12T01:08:08.291167+0000","last_active":"2024-09-12T01:08:08.291167+0000","last_peered":"2024-09-12T01:08:08.291167+0000","last_clean":"2024-09-12T01:08:08.291167+0000","last_became_active":"2024-09-12T00:38:07.644752+0000","last_became_peered":"2024-09-12T00:38:07.644752+0000","last_unstale":"2024-09-12T01:08:08.291167+0000","last_undegraded":"2024-09-12T01:08:08.291167+0000","last_fullsized":"2024-09-12T01:08:08.291167+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:08.290956+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:08.290956+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.290956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:17.143413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"267'56","reported_seq":210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.846557+0000","last_change":"2024-09-12T01:08:12.846557+0000","last_active":"2024-09-12T01:08:12.846557+0000","last_peered":"2024-09-12T01:08:12.846557+0000","last_clean":"2024-09-12T01:08:12.846557+0000","last_became_active":"2024-09-12T00:36:37.246402+0000","last_became_peered":"2024-09-12T00:36:37.246402+0000","last_unstale":"2024-09-12T01:08:12.846557+0000","last_undegraded":"2024-09-12T01:08:12.846557+0000","last_fullsized":"2024-09-12T01:08:12.846557+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'56","last_scrub_stamp":"2024-09-12T01:08:12.846373+0000","last_deep_scrub":"267'56","last_deep_scrub_stamp":"2024-09-12T01:08:12.846373+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.846373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:19.960581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":211,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.597068+0000","last_change":"2024-09-12T00:49:10.627636+0000","last_active":"2024-09-12T01:04:58.597068+0000","last_peered":"2024-09-12T01:04:58.597068+0000","last_clean":"2024-09-12T01:04:58.597068+0000","last_became_active":"2024-09-12T00:49:10.626918+0000","last_became_peered":"2024-09-12T00:49:10.626918+0000","last_unstale":"2024-09-12T01:04:58.597068+0000","last_undegraded":"2024-09-12T01:04:58.597068+0000","last_fullsized":"2024-09-12T01:04:58.597068+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:55.462430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"267'7","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.080034+0000","last_change":"2024-09-12T01:08:03.080034+0000","last_active":"2024-09-12T01:08:03.080034+0000","last_peered":"2024-09-12T01:08:03.080034+0000","last_clean":"2024-09-12T01:08:03.080034+0000","last_became_active":"2024-09-12T00:38:10.705817+0000","last_became_peered":"2024-09-12T00:38:10.705817+0000","last_unstale":"2024-09-12T01:08:03.080034+0000","last_undegraded":"2024-09-12T01:08:03.080034+0000","last_fullsized":"2024-09-12T01:08:03.080034+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:03.079826+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:03.079826+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.079826+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:27.973354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:24.428685+0000","last_change":"2024-09-12T00:38:07.655064+0000","last_active":"2024-09-12T01:07:24.428685+0000","last_peered":"2024-09-12T01:07:24.428685+0000","last_clean":"2024-09-12T01:07:24.428685+0000","last_became_active":"2024-09-12T00:38:07.654306+0000","last_became_peered":"2024-09-12T00:38:07.654306+0000","last_unstale":"2024-09-12T01:07:24.428685+0000","last_undegraded":"2024-09-12T01:07:24.428685+0000","last_fullsized":"2024-09-12T01:07:24.428685+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:13.318498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"267'61","reported_seq":258,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.035695+0000","last_change":"2024-09-12T01:08:00.035695+0000","last_active":"2024-09-12T01:08:00.035695+0000","last_peered":"2024-09-12T01:08:00.035695+0000","last_clean":"2024-09-12T01:08:00.035695+0000","last_became_active":"2024-09-12T00:36:37.226845+0000","last_became_peered":"2024-09-12T00:36:37.226845+0000","last_unstale":"2024-09-12T01:08:00.035695+0000","last_undegraded":"2024-09-12T01:08:00.035695+0000","last_fullsized":"2024-09-12T01:08:00.035695+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'61","last_scrub_stamp":"2024-09-12T01:08:00.035462+0000","last_deep_scrub":"267'61","last_deep_scrub_stamp":"2024-09-12T01:08:00.035462+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.035462+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:09.421929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":408,"num_read_kb":294,"num_write":66,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3514,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.076548+0000","last_change":"2024-09-12T01:08:05.076548+0000","last_active":"2024-09-12T01:08:05.076548+0000","last_peered":"2024-09-12T01:08:05.076548+0000","last_clean":"2024-09-12T01:08:05.076548+0000","last_became_active":"2024-09-12T00:49:10.615566+0000","last_became_peered":"2024-09-12T00:49:10.615566+0000","last_unstale":"2024-09-12T01:08:05.076548+0000","last_undegraded":"2024-09-12T01:08:05.076548+0000","last_fullsized":"2024-09-12T01:08:05.076548+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:05.076371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:05.076371+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.076371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:05.804297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'7","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.115026+0000","last_change":"2024-09-12T00:38:10.705943+0000","last_active":"2024-09-12T01:07:26.115026+0000","last_peered":"2024-09-12T01:07:26.115026+0000","last_clean":"2024-09-12T01:07:26.115026+0000","last_became_active":"2024-09-12T00:38:10.705207+0000","last_became_peered":"2024-09-12T00:38:10.705207+0000","last_unstale":"2024-09-12T01:07:26.115026+0000","last_undegraded":"2024-09-12T01:07:26.115026+0000","last_fullsized":"2024-09-12T01:07:26.115026+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:44.933546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'11","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.852138+0000","last_change":"2024-09-12T00:38:07.663618+0000","last_active":"2024-09-12T01:07:25.852138+0000","last_peered":"2024-09-12T01:07:25.852138+0000","last_clean":"2024-09-12T01:07:25.852138+0000","last_became_active":"2024-09-12T00:38:07.663031+0000","last_became_peered":"2024-09-12T00:38:07.663031+0000","last_unstale":"2024-09-12T01:07:25.852138+0000","last_undegraded":"2024-09-12T01:07:25.852138+0000","last_fullsized":"2024-09-12T01:07:25.852138+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.928917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24578,"num_write":26,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'40","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.500368+0000","last_change":"2024-09-12T01:08:11.500368+0000","last_active":"2024-09-12T01:08:11.500368+0000","last_peered":"2024-09-12T01:08:11.500368+0000","last_clean":"2024-09-12T01:08:11.500368+0000","last_became_active":"2024-09-12T00:36:37.250649+0000","last_became_peered":"2024-09-12T00:36:37.250649+0000","last_unstale":"2024-09-12T01:08:11.500368+0000","last_undegraded":"2024-09-12T01:08:11.500368+0000","last_fullsized":"2024-09-12T01:08:11.500368+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:11.500148+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:11.500148+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.500148+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:48.043569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":70,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.064333+0000","last_change":"2024-09-12T01:08:07.064333+0000","last_active":"2024-09-12T01:08:07.064333+0000","last_peered":"2024-09-12T01:08:07.064333+0000","last_clean":"2024-09-12T01:08:07.064333+0000","last_became_active":"2024-09-12T00:49:10.634433+0000","last_became_peered":"2024-09-12T00:49:10.634433+0000","last_unstale":"2024-09-12T01:08:07.064333+0000","last_undegraded":"2024-09-12T01:08:07.064333+0000","last_fullsized":"2024-09-12T01:08:07.064333+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:07.064155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:07.064155+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.064155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.708114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622352+0000","last_change":"2024-09-12T00:38:10.718774+0000","last_active":"2024-09-12T01:05:19.622352+0000","last_peered":"2024-09-12T01:05:19.622352+0000","last_clean":"2024-09-12T01:05:19.622352+0000","last_became_active":"2024-09-12T00:38:10.717307+0000","last_became_peered":"2024-09-12T00:38:10.717307+0000","last_unstale":"2024-09-12T01:05:19.622352+0000","last_undegraded":"2024-09-12T01:05:19.622352+0000","last_fullsized":"2024-09-12T01:05:19.622352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:10.837950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'10","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.523588+0000","last_change":"2024-09-12T00:38:07.660476+0000","last_active":"2024-09-12T01:07:27.523588+0000","last_peered":"2024-09-12T01:07:27.523588+0000","last_clean":"2024-09-12T01:07:27.523588+0000","last_became_active":"2024-09-12T00:38:07.659692+0000","last_became_peered":"2024-09-12T00:38:07.659692+0000","last_unstale":"2024-09-12T01:07:27.523588+0000","last_undegraded":"2024-09-12T01:07:27.523588+0000","last_fullsized":"2024-09-12T01:07:27.523588+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:05.518531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'22","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.817272+0000","last_change":"2024-09-12T00:36:37.228455+0000","last_active":"2024-09-12T01:05:02.817272+0000","last_peered":"2024-09-12T01:05:02.817272+0000","last_clean":"2024-09-12T01:05:02.817272+0000","last_became_active":"2024-09-12T00:36:37.226892+0000","last_became_peered":"2024-09-12T00:36:37.226892+0000","last_unstale":"2024-09-12T01:05:02.817272+0000","last_undegraded":"2024-09-12T01:05:02.817272+0000","last_fullsized":"2024-09-12T01:05:02.817272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:09.675401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.622226+0000","last_change":"2024-09-12T00:49:10.632589+0000","last_active":"2024-09-12T01:05:19.622226+0000","last_peered":"2024-09-12T01:05:19.622226+0000","last_clean":"2024-09-12T01:05:19.622226+0000","last_became_active":"2024-09-12T00:49:10.631961+0000","last_became_peered":"2024-09-12T00:49:10.631961+0000","last_unstale":"2024-09-12T01:05:19.622226+0000","last_undegraded":"2024-09-12T01:05:19.622226+0000","last_fullsized":"2024-09-12T01:05:19.622226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:28.434654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.023173+0000","last_change":"2024-09-12T01:07:59.023173+0000","last_active":"2024-09-12T01:07:59.023173+0000","last_peered":"2024-09-12T01:07:59.023173+0000","last_clean":"2024-09-12T01:07:59.023173+0000","last_became_active":"2024-09-12T00:38:10.719337+0000","last_became_peered":"2024-09-12T00:38:10.719337+0000","last_unstale":"2024-09-12T01:07:59.023173+0000","last_undegraded":"2024-09-12T01:07:59.023173+0000","last_fullsized":"2024-09-12T01:07:59.023173+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:59.023072+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:59.023072+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.023072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:23.472503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"267'7","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.145572+0000","last_change":"2024-09-12T01:08:07.145572+0000","last_active":"2024-09-12T01:08:07.145572+0000","last_peered":"2024-09-12T01:08:07.145572+0000","last_clean":"2024-09-12T01:08:07.145572+0000","last_became_active":"2024-09-12T00:38:07.639751+0000","last_became_peered":"2024-09-12T00:38:07.639751+0000","last_unstale":"2024-09-12T01:08:07.145572+0000","last_undegraded":"2024-09-12T01:08:07.145572+0000","last_fullsized":"2024-09-12T01:08:07.145572+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:07.145408+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:07.145408+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.145408+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:59.224526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'40","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.098655+0000","last_change":"2024-09-12T01:08:06.098655+0000","last_active":"2024-09-12T01:08:06.098655+0000","last_peered":"2024-09-12T01:08:06.098655+0000","last_clean":"2024-09-12T01:08:06.098655+0000","last_became_active":"2024-09-12T00:36:37.248176+0000","last_became_peered":"2024-09-12T00:36:37.248176+0000","last_unstale":"2024-09-12T01:08:06.098655+0000","last_undegraded":"2024-09-12T01:08:06.098655+0000","last_fullsized":"2024-09-12T01:08:06.098655+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:06.098449+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:06.098449+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.098449+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:34.464246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.649578+0000","last_change":"2024-09-12T00:49:10.635581+0000","last_active":"2024-09-12T01:05:49.649578+0000","last_peered":"2024-09-12T01:05:49.649578+0000","last_clean":"2024-09-12T01:05:49.649578+0000","last_became_active":"2024-09-12T00:49:10.634965+0000","last_became_peered":"2024-09-12T00:49:10.634965+0000","last_unstale":"2024-09-12T01:05:49.649578+0000","last_undegraded":"2024-09-12T01:05:49.649578+0000","last_fullsized":"2024-09-12T01:05:49.649578+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:24.416191+0000","last_change":"2024-09-12T00:38:10.695802+0000","last_active":"2024-09-12T01:06:24.416191+0000","last_peered":"2024-09-12T01:06:24.416191+0000","last_clean":"2024-09-12T01:06:24.416191+0000","last_became_active":"2024-09-12T00:38:10.694812+0000","last_became_peered":"2024-09-12T00:38:10.694812+0000","last_unstale":"2024-09-12T01:06:24.416191+0000","last_undegraded":"2024-09-12T01:06:24.416191+0000","last_fullsized":"2024-09-12T01:06:24.416191+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:47.266227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'6","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.321457+0000","last_change":"2024-09-12T00:38:07.648782+0000","last_active":"2024-09-12T01:07:26.321457+0000","last_peered":"2024-09-12T01:07:26.321457+0000","last_clean":"2024-09-12T01:07:26.321457+0000","last_became_active":"2024-09-12T00:38:07.648061+0000","last_became_peered":"2024-09-12T00:38:07.648061+0000","last_unstale":"2024-09-12T01:07:26.321457+0000","last_undegraded":"2024-09-12T01:07:26.321457+0000","last_fullsized":"2024-09-12T01:07:26.321457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:11.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'35","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.335923+0000","last_change":"2024-09-12T01:08:03.335923+0000","last_active":"2024-09-12T01:08:03.335923+0000","last_peered":"2024-09-12T01:08:03.335923+0000","last_clean":"2024-09-12T01:08:03.335923+0000","last_became_active":"2024-09-12T00:36:37.244096+0000","last_became_peered":"2024-09-12T00:36:37.244096+0000","last_unstale":"2024-09-12T01:08:03.335923+0000","last_undegraded":"2024-09-12T01:08:03.335923+0000","last_fullsized":"2024-09-12T01:08:03.335923+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'35","last_scrub_stamp":"2024-09-12T01:08:03.335738+0000","last_deep_scrub":"267'35","last_deep_scrub_stamp":"2024-09-12T01:08:03.335738+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.335738+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:24.722385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":53,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:23.588773+0000","last_change":"2024-09-12T00:49:10.626675+0000","last_active":"2024-09-12T01:04:23.588773+0000","last_peered":"2024-09-12T01:04:23.588773+0000","last_clean":"2024-09-12T01:04:23.588773+0000","last_became_active":"2024-09-12T00:49:10.621968+0000","last_became_peered":"2024-09-12T00:49:10.621968+0000","last_unstale":"2024-09-12T01:04:23.588773+0000","last_undegraded":"2024-09-12T01:04:23.588773+0000","last_fullsized":"2024-09-12T01:04:23.588773+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.338078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.594658+0000","last_change":"2024-09-12T00:38:10.718573+0000","last_active":"2024-09-12T01:05:19.594658+0000","last_peered":"2024-09-12T01:05:19.594658+0000","last_clean":"2024-09-12T01:05:19.594658+0000","last_became_active":"2024-09-12T00:38:10.717877+0000","last_became_peered":"2024-09-12T00:38:10.717877+0000","last_unstale":"2024-09-12T01:05:19.594658+0000","last_undegraded":"2024-09-12T01:05:19.594658+0000","last_fullsized":"2024-09-12T01:05:19.594658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:53.348539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"267'5","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.185626+0000","last_change":"2024-09-12T01:08:08.185367+0000","last_active":"2024-09-12T01:08:08.185626+0000","last_peered":"2024-09-12T01:08:08.185626+0000","last_clean":"2024-09-12T01:08:08.185626+0000","last_became_active":"2024-09-12T00:38:07.648786+0000","last_became_peered":"2024-09-12T00:38:07.648786+0000","last_unstale":"2024-09-12T01:08:08.185626+0000","last_undegraded":"2024-09-12T01:08:08.185626+0000","last_fullsized":"2024-09-12T01:08:08.185626+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:08.185073+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:08.185073+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.185073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.827185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.142583+0000","last_change":"2024-09-12T01:08:02.142583+0000","last_active":"2024-09-12T01:08:02.142583+0000","last_peered":"2024-09-12T01:08:02.142583+0000","last_clean":"2024-09-12T01:08:02.142583+0000","last_became_active":"2024-09-12T00:36:37.237365+0000","last_became_peered":"2024-09-12T00:36:37.237365+0000","last_unstale":"2024-09-12T01:08:02.142583+0000","last_undegraded":"2024-09-12T01:08:02.142583+0000","last_fullsized":"2024-09-12T01:08:02.142583+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:08:02.142397+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:08:02.142397+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.142397+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:21.499061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":152,"num_write":73,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.582095+0000","last_change":"2024-09-12T00:49:10.628791+0000","last_active":"2024-09-12T01:04:24.582095+0000","last_peered":"2024-09-12T01:04:24.582095+0000","last_clean":"2024-09-12T01:04:24.582095+0000","last_became_active":"2024-09-12T00:49:10.628111+0000","last_became_peered":"2024-09-12T00:49:10.628111+0000","last_unstale":"2024-09-12T01:04:24.582095+0000","last_undegraded":"2024-09-12T01:04:24.582095+0000","last_fullsized":"2024-09-12T01:04:24.582095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.022373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'6","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.186406+0000","last_change":"2024-09-12T00:38:10.702362+0000","last_active":"2024-09-12T01:07:26.186406+0000","last_peered":"2024-09-12T01:07:26.186406+0000","last_clean":"2024-09-12T01:07:26.186406+0000","last_became_active":"2024-09-12T00:38:10.696553+0000","last_became_peered":"2024-09-12T00:38:10.696553+0000","last_unstale":"2024-09-12T01:07:26.186406+0000","last_undegraded":"2024-09-12T01:07:26.186406+0000","last_fullsized":"2024-09-12T01:07:26.186406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:21.987094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3168,"num_write":6,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'4","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:19.427237+0000","last_change":"2024-09-12T00:38:07.670741+0000","last_active":"2024-09-12T01:07:19.427237+0000","last_peered":"2024-09-12T01:07:19.427237+0000","last_clean":"2024-09-12T01:07:19.427237+0000","last_became_active":"2024-09-12T00:38:07.669959+0000","last_became_peered":"2024-09-12T00:38:07.669959+0000","last_unstale":"2024-09-12T01:07:19.427237+0000","last_undegraded":"2024-09-12T01:07:19.427237+0000","last_fullsized":"2024-09-12T01:07:19.427237+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:06.594371+0000","last_clean_scrub_stamp":"2024-09-12T00:38:06.594371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:21.025381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.649720+0000","last_change":"2024-09-12T00:36:37.229680+0000","last_active":"2024-09-12T01:05:49.649720+0000","last_peered":"2024-09-12T01:05:49.649720+0000","last_clean":"2024-09-12T01:05:49.649720+0000","last_became_active":"2024-09-12T00:36:37.228954+0000","last_became_peered":"2024-09-12T00:36:37.228954+0000","last_unstale":"2024-09-12T01:05:49.649720+0000","last_undegraded":"2024-09-12T01:05:49.649720+0000","last_fullsized":"2024-09-12T01:05:49.649720+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:36:36.187021+0000","last_clean_scrub_stamp":"2024-09-12T00:36:36.187021+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:54.630573+0000","last_change":"2024-09-12T00:49:10.593501+0000","last_active":"2024-09-12T01:05:54.630573+0000","last_peered":"2024-09-12T01:05:54.630573+0000","last_clean":"2024-09-12T01:05:54.630573+0000","last_became_active":"2024-09-12T00:49:10.592753+0000","last_became_peered":"2024-09-12T00:49:10.592753+0000","last_unstale":"2024-09-12T01:05:54.630573+0000","last_undegraded":"2024-09-12T01:05:54.630573+0000","last_fullsized":"2024-09-12T01:05:54.630573+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.161156+0000","last_change":"2024-09-12T01:08:10.161156+0000","last_active":"2024-09-12T01:08:10.161156+0000","last_peered":"2024-09-12T01:08:10.161156+0000","last_clean":"2024-09-12T01:08:10.161156+0000","last_became_active":"2024-09-12T00:38:10.702958+0000","last_became_peered":"2024-09-12T00:38:10.702958+0000","last_unstale":"2024-09-12T01:08:10.161156+0000","last_undegraded":"2024-09-12T01:08:10.161156+0000","last_fullsized":"2024-09-12T01:08:10.161156+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:10.160971+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:10.160971+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.160971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:00.071414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.262437+0000","last_change":"2024-09-12T01:08:12.262437+0000","last_active":"2024-09-12T01:08:12.262437+0000","last_peered":"2024-09-12T01:08:12.262437+0000","last_clean":"2024-09-12T01:08:12.262437+0000","last_became_active":"2024-09-12T00:38:07.650035+0000","last_became_peered":"2024-09-12T00:38:07.650035+0000","last_unstale":"2024-09-12T01:08:12.262437+0000","last_undegraded":"2024-09-12T01:08:12.262437+0000","last_fullsized":"2024-09-12T01:08:12.262437+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:12.262216+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:12.262216+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.262216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:23.548955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"258'11","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.254471+0000","last_change":"2024-09-12T01:08:14.254471+0000","last_active":"2024-09-12T01:08:14.254471+0000","last_peered":"2024-09-12T01:08:14.254471+0000","last_clean":"2024-09-12T01:08:14.254471+0000","last_became_active":"2024-09-12T00:36:37.222545+0000","last_became_peered":"2024-09-12T00:36:37.222545+0000","last_unstale":"2024-09-12T01:08:14.254471+0000","last_undegraded":"2024-09-12T01:08:14.254471+0000","last_fullsized":"2024-09-12T01:08:14.254471+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'11","last_scrub_stamp":"2024-09-12T01:08:14.254273+0000","last_deep_scrub":"258'11","last_deep_scrub_stamp":"2024-09-12T01:08:14.254273+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.254273+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:01.432581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:54.650621+0000","last_change":"2024-09-12T00:49:10.613325+0000","last_active":"2024-09-12T01:05:54.650621+0000","last_peered":"2024-09-12T01:05:54.650621+0000","last_clean":"2024-09-12T01:05:54.650621+0000","last_became_active":"2024-09-12T00:49:10.612680+0000","last_became_peered":"2024-09-12T00:49:10.612680+0000","last_unstale":"2024-09-12T01:05:54.650621+0000","last_undegraded":"2024-09-12T01:05:54.650621+0000","last_fullsized":"2024-09-12T01:05:54.650621+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.196800+0000","last_change":"2024-09-12T01:08:09.196800+0000","last_active":"2024-09-12T01:08:09.196800+0000","last_peered":"2024-09-12T01:08:09.196800+0000","last_clean":"2024-09-12T01:08:09.196800+0000","last_became_active":"2024-09-12T00:38:10.691107+0000","last_became_peered":"2024-09-12T00:38:10.691107+0000","last_unstale":"2024-09-12T01:08:09.196800+0000","last_undegraded":"2024-09-12T01:08:09.196800+0000","last_fullsized":"2024-09-12T01:08:09.196800+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.196531+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:20.537195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"267'6","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.625085+0000","last_change":"2024-09-12T01:08:04.625085+0000","last_active":"2024-09-12T01:08:04.625085+0000","last_peered":"2024-09-12T01:08:04.625085+0000","last_clean":"2024-09-12T01:08:04.625085+0000","last_became_active":"2024-09-12T00:38:07.657155+0000","last_became_peered":"2024-09-12T00:38:07.657155+0000","last_unstale":"2024-09-12T01:08:04.625085+0000","last_undegraded":"2024-09-12T01:08:04.625085+0000","last_fullsized":"2024-09-12T01:08:04.625085+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:04.624891+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:04.624891+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:59.672369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"267'20","reported_seq":109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.165704+0000","last_change":"2024-09-12T01:08:01.165704+0000","last_active":"2024-09-12T01:08:01.165704+0000","last_peered":"2024-09-12T01:08:01.165704+0000","last_clean":"2024-09-12T01:08:01.165704+0000","last_became_active":"2024-09-12T00:36:37.221980+0000","last_became_peered":"2024-09-12T00:36:37.221980+0000","last_unstale":"2024-09-12T01:08:01.165704+0000","last_undegraded":"2024-09-12T01:08:01.165704+0000","last_fullsized":"2024-09-12T01:08:01.165704+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:08:01.165485+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:08:01.165485+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.165485+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:34.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'360","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.018639+0000","last_change":"2024-09-12T01:07:43.018639+0000","last_active":"2024-09-12T01:07:43.018639+0000","last_peered":"2024-09-12T01:07:43.018639+0000","last_clean":"2024-09-12T01:07:43.018639+0000","last_became_active":"2024-09-12T00:21:42.528236+0000","last_became_peered":"2024-09-12T00:21:42.528236+0000","last_unstale":"2024-09-12T01:07:43.018639+0000","last_undegraded":"2024-09-12T01:07:43.018639+0000","last_fullsized":"2024-09-12T01:07:43.018639+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'360","last_scrub_stamp":"2024-09-12T01:07:43.018341+0000","last_deep_scrub":"267'360","last_deep_scrub_stamp":"2024-09-12T01:07:43.018341+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.018341+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:20.272306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812630,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":8804,"num_write":1192,"num_write_kb":22191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'52","reported_seq":612,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.538350+0000","last_change":"2024-09-12T01:07:45.538350+0000","last_active":"2024-09-12T01:07:45.538350+0000","last_peered":"2024-09-12T01:07:45.538350+0000","last_clean":"2024-09-12T01:07:45.538350+0000","last_became_active":"2024-09-12T00:21:44.499494+0000","last_became_peered":"2024-09-12T00:21:44.499494+0000","last_unstale":"2024-09-12T01:07:45.538350+0000","last_undegraded":"2024-09-12T01:07:45.538350+0000","last_fullsized":"2024-09-12T01:07:45.538350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:07:45.538159+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:07:45.538159+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.538159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:29.457414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":187,"num_write":87,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'464","reported_seq":1151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.037595+0000","last_change":"2024-09-12T01:07:48.037595+0000","last_active":"2024-09-12T01:07:48.037595+0000","last_peered":"2024-09-12T01:07:48.037595+0000","last_clean":"2024-09-12T01:07:48.037595+0000","last_became_active":"2024-09-12T00:21:42.511901+0000","last_became_peered":"2024-09-12T00:21:42.511901+0000","last_unstale":"2024-09-12T01:07:48.037595+0000","last_undegraded":"2024-09-12T01:07:48.037595+0000","last_fullsized":"2024-09-12T01:07:48.037595+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'464","last_scrub_stamp":"2024-09-12T01:07:48.037389+0000","last_deep_scrub":"267'464","last_deep_scrub_stamp":"2024-09-12T01:07:48.037389+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.037389+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:29.223858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759316,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":14453,"num_write":1384,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'102","reported_seq":669,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.917935+0000","last_change":"2024-09-12T01:07:51.917935+0000","last_active":"2024-09-12T01:07:51.917935+0000","last_peered":"2024-09-12T01:07:51.917935+0000","last_clean":"2024-09-12T01:07:51.917935+0000","last_became_active":"2024-09-12T00:21:44.498503+0000","last_became_peered":"2024-09-12T00:21:44.498503+0000","last_unstale":"2024-09-12T01:07:51.917935+0000","last_undegraded":"2024-09-12T01:07:51.917935+0000","last_fullsized":"2024-09-12T01:07:51.917935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:51.917714+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:51.917714+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.917714+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:34.326748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":343,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'310","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.047030+0000","last_change":"2024-09-12T01:07:47.047030+0000","last_active":"2024-09-12T01:07:47.047030+0000","last_peered":"2024-09-12T01:07:47.047030+0000","last_clean":"2024-09-12T01:07:47.047030+0000","last_became_active":"2024-09-12T00:21:42.535071+0000","last_became_peered":"2024-09-12T00:21:42.535071+0000","last_unstale":"2024-09-12T01:07:47.047030+0000","last_undegraded":"2024-09-12T01:07:47.047030+0000","last_fullsized":"2024-09-12T01:07:47.047030+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'310","last_scrub_stamp":"2024-09-12T01:07:47.046642+0000","last_deep_scrub":"267'310","last_deep_scrub_stamp":"2024-09-12T01:07:47.046642+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.046642+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.764157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328055,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":751,"num_read_kb":29454,"num_write":966,"num_write_kb":25069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'218","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.984124+0000","last_change":"2024-09-12T01:07:58.984124+0000","last_active":"2024-09-12T01:07:58.984124+0000","last_peered":"2024-09-12T01:07:58.984124+0000","last_clean":"2024-09-12T01:07:58.984124+0000","last_became_active":"2024-09-12T00:21:44.497569+0000","last_became_peered":"2024-09-12T00:21:44.497569+0000","last_unstale":"2024-09-12T01:07:58.984124+0000","last_undegraded":"2024-09-12T01:07:58.984124+0000","last_fullsized":"2024-09-12T01:07:58.984124+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:07:58.983934+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:07:58.983934+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.983934+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:06.787825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":917,"num_read_kb":735,"num_write":338,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8079,"num_omap_keys":32,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.334560+0000","last_change":"2024-09-12T01:07:39.334379+0000","last_active":"2024-09-12T01:07:39.334560+0000","last_peered":"2024-09-12T01:07:39.334560+0000","last_clean":"2024-09-12T01:07:39.334560+0000","last_became_active":"2024-09-12T00:21:42.528057+0000","last_became_peered":"2024-09-12T00:21:42.528057+0000","last_unstale":"2024-09-12T01:07:39.334560+0000","last_undegraded":"2024-09-12T01:07:39.334560+0000","last_fullsized":"2024-09-12T01:07:39.334560+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-09-12T01:07:39.334128+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-09-12T01:07:39.334128+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.334128+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.207806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2018898,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":607,"num_read_kb":8621,"num_write":1230,"num_write_kb":31712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'138","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.346916+0000","last_change":"2024-09-12T01:07:49.346916+0000","last_active":"2024-09-12T01:07:49.346916+0000","last_peered":"2024-09-12T01:07:49.346916+0000","last_clean":"2024-09-12T01:07:49.346916+0000","last_became_active":"2024-09-12T00:21:44.479037+0000","last_became_peered":"2024-09-12T00:21:44.479037+0000","last_unstale":"2024-09-12T01:07:49.346916+0000","last_undegraded":"2024-09-12T01:07:49.346916+0000","last_fullsized":"2024-09-12T01:07:49.346916+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T01:07:49.346723+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T01:07:49.346723+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.346723+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:01.160030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":200,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'373","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.034540+0000","last_change":"2024-09-12T01:07:39.034540+0000","last_active":"2024-09-12T01:07:39.034540+0000","last_peered":"2024-09-12T01:07:39.034540+0000","last_clean":"2024-09-12T01:07:39.034540+0000","last_became_active":"2024-09-12T00:21:42.515464+0000","last_became_peered":"2024-09-12T00:21:42.515464+0000","last_unstale":"2024-09-12T01:07:39.034540+0000","last_undegraded":"2024-09-12T01:07:39.034540+0000","last_fullsized":"2024-09-12T01:07:39.034540+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-09-12T01:07:39.034299+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-09-12T01:07:39.034299+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.034299+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:13.031612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":28078,"num_write":1274,"num_write_kb":29332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'4286","reported_seq":4965,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.054554+0000","last_change":"2024-09-12T01:07:48.054390+0000","last_active":"2024-09-12T01:07:48.054554+0000","last_peered":"2024-09-12T01:07:48.054554+0000","last_clean":"2024-09-12T01:07:48.054554+0000","last_became_active":"2024-09-12T00:21:44.495734+0000","last_became_peered":"2024-09-12T00:21:44.495734+0000","last_unstale":"2024-09-12T01:07:48.054554+0000","last_undegraded":"2024-09-12T01:07:48.054554+0000","last_fullsized":"2024-09-12T01:07:48.054554+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4286","last_scrub_stamp":"2024-09-12T01:07:48.054213+0000","last_deep_scrub":"267'4286","last_deep_scrub_stamp":"2024-09-12T01:07:48.054213+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.054213+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":3000,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:38.885788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17226,"num_read_kb":14426,"num_write":6464,"num_write_kb":3218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'375","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.278173+0000","last_change":"2024-09-12T01:07:37.278173+0000","last_active":"2024-09-12T01:07:37.278173+0000","last_peered":"2024-09-12T01:07:37.278173+0000","last_clean":"2024-09-12T01:07:37.278173+0000","last_became_active":"2024-09-12T00:21:42.534582+0000","last_became_peered":"2024-09-12T00:21:42.534582+0000","last_unstale":"2024-09-12T01:07:37.278173+0000","last_undegraded":"2024-09-12T01:07:37.278173+0000","last_fullsized":"2024-09-12T01:07:37.278173+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T01:07:37.277868+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T01:07:37.277868+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.277868+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:05.857538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":25303,"num_write":1128,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'161","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.097307+0000","last_change":"2024-09-12T01:07:47.097307+0000","last_active":"2024-09-12T01:07:47.097307+0000","last_peered":"2024-09-12T01:07:47.097307+0000","last_clean":"2024-09-12T01:07:47.097307+0000","last_became_active":"2024-09-12T00:21:44.510410+0000","last_became_peered":"2024-09-12T00:21:44.510410+0000","last_unstale":"2024-09-12T01:07:47.097307+0000","last_undegraded":"2024-09-12T01:07:47.097307+0000","last_fullsized":"2024-09-12T01:07:47.097307+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:07:47.097118+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:07:47.097118+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.097118+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.442505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":577,"num_write":213,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1239,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.025855+0000","last_change":"2024-09-12T01:07:36.025855+0000","last_active":"2024-09-12T01:07:36.025855+0000","last_peered":"2024-09-12T01:07:36.025855+0000","last_clean":"2024-09-12T01:07:36.025855+0000","last_became_active":"2024-09-12T00:21:42.530155+0000","last_became_peered":"2024-09-12T00:21:42.530155+0000","last_unstale":"2024-09-12T01:07:36.025855+0000","last_undegraded":"2024-09-12T01:07:36.025855+0000","last_fullsized":"2024-09-12T01:07:36.025855+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T01:07:36.025559+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T01:07:36.025559+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.025559+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:05.061004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1030,"num_read_kb":26574,"num_write":1137,"num_write_kb":18888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'161","reported_seq":780,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.227104+0000","last_change":"2024-09-12T01:07:46.227104+0000","last_active":"2024-09-12T01:07:46.227104+0000","last_peered":"2024-09-12T01:07:46.227104+0000","last_clean":"2024-09-12T01:07:46.227104+0000","last_became_active":"2024-09-12T00:21:44.483825+0000","last_became_peered":"2024-09-12T00:21:44.483825+0000","last_unstale":"2024-09-12T01:07:46.227104+0000","last_undegraded":"2024-09-12T01:07:46.227104+0000","last_fullsized":"2024-09-12T01:07:46.227104+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:07:46.226919+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:07:46.226919+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.226919+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:25.645752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":577,"num_write":242,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'407","reported_seq":1081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.012599+0000","last_change":"2024-09-12T01:07:44.012599+0000","last_active":"2024-09-12T01:07:44.012599+0000","last_peered":"2024-09-12T01:07:44.012599+0000","last_clean":"2024-09-12T01:07:44.012599+0000","last_became_active":"2024-09-12T00:22:12.620753+0000","last_became_peered":"2024-09-12T00:22:12.620753+0000","last_unstale":"2024-09-12T01:07:44.012599+0000","last_undegraded":"2024-09-12T01:07:44.012599+0000","last_fullsized":"2024-09-12T01:07:44.012599+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T01:07:44.012256+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T01:07:44.012256+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.012256+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:21.935270+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":588,"num_read_kb":16569,"num_write":1344,"num_write_kb":33151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'179","reported_seq":772,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.983715+0000","last_change":"2024-09-12T01:07:57.983715+0000","last_active":"2024-09-12T01:07:57.983715+0000","last_peered":"2024-09-12T01:07:57.983715+0000","last_clean":"2024-09-12T01:07:57.983715+0000","last_became_active":"2024-09-12T00:21:44.528311+0000","last_became_peered":"2024-09-12T00:21:44.528311+0000","last_unstale":"2024-09-12T01:07:57.983715+0000","last_undegraded":"2024-09-12T01:07:57.983715+0000","last_fullsized":"2024-09-12T01:07:57.983715+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'179","last_scrub_stamp":"2024-09-12T01:07:57.983537+0000","last_deep_scrub":"267'179","last_deep_scrub_stamp":"2024-09-12T01:07:57.983537+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.983537+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:37.042891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":638,"num_write":310,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'108","reported_seq":669,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.876584+0000","last_change":"2024-09-12T01:07:54.876584+0000","last_active":"2024-09-12T01:07:54.876584+0000","last_peered":"2024-09-12T01:07:54.876584+0000","last_clean":"2024-09-12T01:07:54.876584+0000","last_became_active":"2024-09-12T00:21:44.493767+0000","last_became_peered":"2024-09-12T00:21:44.493767+0000","last_unstale":"2024-09-12T01:07:54.876584+0000","last_undegraded":"2024-09-12T01:07:54.876584+0000","last_fullsized":"2024-09-12T01:07:54.876584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'108","last_scrub_stamp":"2024-09-12T01:07:54.876374+0000","last_deep_scrub":"267'108","last_deep_scrub_stamp":"2024-09-12T01:07:54.876374+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.876374+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:11.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":357,"num_write":148,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'315","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.652696+0000","last_change":"2024-09-12T01:07:34.652629+0000","last_active":"2024-09-12T01:07:34.652696+0000","last_peered":"2024-09-12T01:07:34.652696+0000","last_clean":"2024-09-12T01:07:34.652696+0000","last_became_active":"2024-09-12T00:21:42.514489+0000","last_became_peered":"2024-09-12T00:21:42.514489+0000","last_unstale":"2024-09-12T01:07:34.652696+0000","last_undegraded":"2024-09-12T01:07:34.652696+0000","last_fullsized":"2024-09-12T01:07:34.652696+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'315","last_scrub_stamp":"2024-09-12T01:07:34.652525+0000","last_deep_scrub":"267'315","last_deep_scrub_stamp":"2024-09-12T01:07:34.652525+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.652525+0000","objects_scrubbed":8,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:00.027136+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480914,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":6553,"num_write":1087,"num_write_kb":16882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'52","reported_seq":613,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.053490+0000","last_change":"2024-09-12T01:07:42.053490+0000","last_active":"2024-09-12T01:07:42.053490+0000","last_peered":"2024-09-12T01:07:42.053490+0000","last_clean":"2024-09-12T01:07:42.053490+0000","last_became_active":"2024-09-12T00:21:44.509895+0000","last_became_peered":"2024-09-12T00:21:44.509895+0000","last_unstale":"2024-09-12T01:07:42.053490+0000","last_undegraded":"2024-09-12T01:07:42.053490+0000","last_fullsized":"2024-09-12T01:07:42.053490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:07:42.053309+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:07:42.053309+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.053309+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:52.856138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":198,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'260","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.988730+0000","last_change":"2024-09-12T01:07:36.988584+0000","last_active":"2024-09-12T01:07:36.988730+0000","last_peered":"2024-09-12T01:07:36.988730+0000","last_clean":"2024-09-12T01:07:36.988730+0000","last_became_active":"2024-09-12T00:21:42.490660+0000","last_became_peered":"2024-09-12T00:21:42.490660+0000","last_unstale":"2024-09-12T01:07:36.988730+0000","last_undegraded":"2024-09-12T01:07:36.988730+0000","last_fullsized":"2024-09-12T01:07:36.988730+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'260","last_scrub_stamp":"2024-09-12T01:07:36.988372+0000","last_deep_scrub":"267'260","last_deep_scrub_stamp":"2024-09-12T01:07:36.988372+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.988372+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:05.939444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":4406,"num_write":788,"num_write_kb":22345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'258","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.542895+0000","last_change":"2024-09-12T01:07:44.542895+0000","last_active":"2024-09-12T01:07:44.542895+0000","last_peered":"2024-09-12T01:07:44.542895+0000","last_clean":"2024-09-12T01:07:44.542895+0000","last_became_active":"2024-09-12T00:21:44.514893+0000","last_became_peered":"2024-09-12T00:21:44.514893+0000","last_unstale":"2024-09-12T01:07:44.542895+0000","last_undegraded":"2024-09-12T01:07:44.542895+0000","last_fullsized":"2024-09-12T01:07:44.542895+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:07:44.542721+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:07:44.542721+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.542721+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:09.993567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1166,"num_read_kb":956,"num_write":431,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'341","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.402382+0000","last_change":"2024-09-12T01:07:44.402230+0000","last_active":"2024-09-12T01:07:44.402382+0000","last_peered":"2024-09-12T01:07:44.402382+0000","last_clean":"2024-09-12T01:07:44.402382+0000","last_became_active":"2024-09-12T00:22:13.552126+0000","last_became_peered":"2024-09-12T00:22:13.552126+0000","last_unstale":"2024-09-12T01:07:44.402382+0000","last_undegraded":"2024-09-12T01:07:44.402382+0000","last_fullsized":"2024-09-12T01:07:44.402382+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:44.401991+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:44.401991+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.401991+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:52.498973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194436,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":9788,"num_write":1143,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'125","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.334204+0000","last_change":"2024-09-12T01:07:49.334204+0000","last_active":"2024-09-12T01:07:49.334204+0000","last_peered":"2024-09-12T01:07:49.334204+0000","last_clean":"2024-09-12T01:07:49.334204+0000","last_became_active":"2024-09-12T00:21:44.520441+0000","last_became_peered":"2024-09-12T00:21:44.520441+0000","last_unstale":"2024-09-12T01:07:49.334204+0000","last_undegraded":"2024-09-12T01:07:49.334204+0000","last_fullsized":"2024-09-12T01:07:49.334204+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'125","last_scrub_stamp":"2024-09-12T01:07:49.333960+0000","last_deep_scrub":"267'125","last_deep_scrub_stamp":"2024-09-12T01:07:49.333960+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.333960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:29.920627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":459,"num_write":198,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'341","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.001918+0000","last_change":"2024-09-12T01:07:38.001684+0000","last_active":"2024-09-12T01:07:38.001918+0000","last_peered":"2024-09-12T01:07:38.001918+0000","last_clean":"2024-09-12T01:07:38.001918+0000","last_became_active":"2024-09-12T00:21:42.505754+0000","last_became_peered":"2024-09-12T00:21:42.505754+0000","last_unstale":"2024-09-12T01:07:38.001918+0000","last_undegraded":"2024-09-12T01:07:38.001918+0000","last_fullsized":"2024-09-12T01:07:38.001918+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:38.001353+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:38.001353+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.001353+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:05.323675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524521,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":484,"num_read_kb":23994,"num_write":1133,"num_write_kb":44987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'533","reported_seq":1303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.016723+0000","last_change":"2024-09-12T01:07:56.016723+0000","last_active":"2024-09-12T01:07:56.016723+0000","last_peered":"2024-09-12T01:07:56.016723+0000","last_clean":"2024-09-12T01:07:56.016723+0000","last_became_active":"2024-09-12T00:21:44.509840+0000","last_became_peered":"2024-09-12T00:21:44.509840+0000","last_unstale":"2024-09-12T01:07:56.016723+0000","last_undegraded":"2024-09-12T01:07:56.016723+0000","last_fullsized":"2024-09-12T01:07:56.016723+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'533","last_scrub_stamp":"2024-09-12T01:07:56.016549+0000","last_deep_scrub":"267'533","last_deep_scrub_stamp":"2024-09-12T01:07:56.016549+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.016549+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:38.339396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2527,"num_read_kb":2144,"num_write":948,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'354","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.349736+0000","last_change":"2024-09-12T01:07:40.349736+0000","last_active":"2024-09-12T01:07:40.349736+0000","last_peered":"2024-09-12T01:07:40.349736+0000","last_clean":"2024-09-12T01:07:40.349736+0000","last_became_active":"2024-09-12T00:21:42.529312+0000","last_became_peered":"2024-09-12T00:21:42.529312+0000","last_unstale":"2024-09-12T01:07:40.349736+0000","last_undegraded":"2024-09-12T01:07:40.349736+0000","last_fullsized":"2024-09-12T01:07:40.349736+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T01:07:40.349528+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T01:07:40.349528+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.349528+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:32.841636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":660,"num_write":1093,"num_write_kb":45878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'102","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.560572+0000","last_change":"2024-09-12T01:07:43.560572+0000","last_active":"2024-09-12T01:07:43.560572+0000","last_peered":"2024-09-12T01:07:43.560572+0000","last_clean":"2024-09-12T01:07:43.560572+0000","last_became_active":"2024-09-12T00:21:44.499173+0000","last_became_peered":"2024-09-12T00:21:44.499173+0000","last_unstale":"2024-09-12T01:07:43.560572+0000","last_undegraded":"2024-09-12T01:07:43.560572+0000","last_fullsized":"2024-09-12T01:07:43.560572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:43.560396+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:43.560396+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.560396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:27.157753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":398,"num_write":158,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'370","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.319443+0000","last_change":"2024-09-12T01:07:42.319443+0000","last_active":"2024-09-12T01:07:42.319443+0000","last_peered":"2024-09-12T01:07:42.319443+0000","last_clean":"2024-09-12T01:07:42.319443+0000","last_became_active":"2024-09-12T00:21:42.529873+0000","last_became_peered":"2024-09-12T00:21:42.529873+0000","last_unstale":"2024-09-12T01:07:42.319443+0000","last_undegraded":"2024-09-12T01:07:42.319443+0000","last_fullsized":"2024-09-12T01:07:42.319443+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-12T01:07:42.319216+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-12T01:07:42.319216+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.319216+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:35.891445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730168,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":35149,"num_write":1229,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'139","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.043273+0000","last_change":"2024-09-12T01:07:58.043273+0000","last_active":"2024-09-12T01:07:58.043273+0000","last_peered":"2024-09-12T01:07:58.043273+0000","last_clean":"2024-09-12T01:07:58.043273+0000","last_became_active":"2024-09-12T00:21:52.545571+0000","last_became_peered":"2024-09-12T00:21:52.545571+0000","last_unstale":"2024-09-12T01:07:58.043273+0000","last_undegraded":"2024-09-12T01:07:58.043273+0000","last_fullsized":"2024-09-12T01:07:58.043273+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'139","last_scrub_stamp":"2024-09-12T01:07:58.042992+0000","last_deep_scrub":"267'139","last_deep_scrub_stamp":"2024-09-12T01:07:58.042992+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.042992+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:35.015561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'88","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.344902+0000","last_change":"2024-09-12T01:07:46.344902+0000","last_active":"2024-09-12T01:07:46.344902+0000","last_peered":"2024-09-12T01:07:46.344902+0000","last_clean":"2024-09-12T01:07:46.344902+0000","last_became_active":"2024-09-12T00:21:44.484514+0000","last_became_peered":"2024-09-12T00:21:44.484514+0000","last_unstale":"2024-09-12T01:07:46.344902+0000","last_undegraded":"2024-09-12T01:07:46.344902+0000","last_fullsized":"2024-09-12T01:07:46.344902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'88","last_scrub_stamp":"2024-09-12T01:07:46.344724+0000","last_deep_scrub":"267'88","last_deep_scrub_stamp":"2024-09-12T01:07:46.344724+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.344724+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:38.020778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":321,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'347","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.938138+0000","last_change":"2024-09-12T01:07:44.938138+0000","last_active":"2024-09-12T01:07:44.938138+0000","last_peered":"2024-09-12T01:07:44.938138+0000","last_clean":"2024-09-12T01:07:44.938138+0000","last_became_active":"2024-09-12T00:21:42.495808+0000","last_became_peered":"2024-09-12T00:21:42.495808+0000","last_unstale":"2024-09-12T01:07:44.938138+0000","last_undegraded":"2024-09-12T01:07:44.938138+0000","last_fullsized":"2024-09-12T01:07:44.938138+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T01:07:44.937896+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T01:07:44.937896+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.937896+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.094251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432703,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":20340,"num_write":1070,"num_write_kb":31693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.024754+0000","last_change":"2024-09-12T01:08:03.024754+0000","last_active":"2024-09-12T01:08:03.024754+0000","last_peered":"2024-09-12T01:08:03.024754+0000","last_clean":"2024-09-12T01:08:03.024754+0000","last_became_active":"2024-09-12T00:21:46.515363+0000","last_became_peered":"2024-09-12T00:21:46.515363+0000","last_unstale":"2024-09-12T01:08:03.024754+0000","last_undegraded":"2024-09-12T01:08:03.024754+0000","last_fullsized":"2024-09-12T01:08:03.024754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:03.024572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:03.024572+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.024572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:19.093277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'336","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.370157+0000","last_change":"2024-09-12T01:08:01.370157+0000","last_active":"2024-09-12T01:08:01.370157+0000","last_peered":"2024-09-12T01:08:01.370157+0000","last_clean":"2024-09-12T01:08:01.370157+0000","last_became_active":"2024-09-12T00:21:48.524091+0000","last_became_peered":"2024-09-12T00:21:48.524091+0000","last_unstale":"2024-09-12T01:08:01.370157+0000","last_undegraded":"2024-09-12T01:08:01.370157+0000","last_fullsized":"2024-09-12T01:08:01.370157+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T01:08:01.369944+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T01:08:01.369944+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.369944+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:54.638067+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48797,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1088,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.514313+0000","last_change":"2024-09-12T01:07:59.514313+0000","last_active":"2024-09-12T01:07:59.514313+0000","last_peered":"2024-09-12T01:07:59.514313+0000","last_clean":"2024-09-12T01:07:59.514313+0000","last_became_active":"2024-09-12T00:21:50.551742+0000","last_became_peered":"2024-09-12T00:21:50.551742+0000","last_unstale":"2024-09-12T01:07:59.514313+0000","last_undegraded":"2024-09-12T01:07:59.514313+0000","last_fullsized":"2024-09-12T01:07:59.514313+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:59.514104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:59.514104+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.514104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:24.793889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'176","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.582167+0000","last_change":"2024-09-12T01:08:02.582167+0000","last_active":"2024-09-12T01:08:02.582167+0000","last_peered":"2024-09-12T01:08:02.582167+0000","last_clean":"2024-09-12T01:08:02.582167+0000","last_became_active":"2024-09-12T00:21:52.544469+0000","last_became_peered":"2024-09-12T00:21:52.544469+0000","last_unstale":"2024-09-12T01:08:02.582167+0000","last_undegraded":"2024-09-12T01:08:02.582167+0000","last_fullsized":"2024-09-12T01:08:02.582167+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'176","last_scrub_stamp":"2024-09-12T01:08:02.581978+0000","last_deep_scrub":"267'176","last_deep_scrub_stamp":"2024-09-12T01:08:02.581978+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.581978+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.917282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":251,"num_write":350,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'4223","reported_seq":4863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.886750+0000","last_change":"2024-09-12T01:07:55.886750+0000","last_active":"2024-09-12T01:07:55.886750+0000","last_peered":"2024-09-12T01:07:55.886750+0000","last_clean":"2024-09-12T01:07:55.886750+0000","last_became_active":"2024-09-12T00:21:44.500367+0000","last_became_peered":"2024-09-12T00:21:44.500367+0000","last_unstale":"2024-09-12T01:07:55.886750+0000","last_undegraded":"2024-09-12T01:07:55.886750+0000","last_fullsized":"2024-09-12T01:07:55.886750+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4223","last_scrub_stamp":"2024-09-12T01:07:55.886652+0000","last_deep_scrub":"267'4223","last_deep_scrub_stamp":"2024-09-12T01:07:55.886652+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.886652+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:31.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17010,"num_read_kb":14247,"num_write":6340,"num_write_kb":3163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'379","reported_seq":1087,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.372378+0000","last_change":"2024-09-12T01:07:39.372378+0000","last_active":"2024-09-12T01:07:39.372378+0000","last_peered":"2024-09-12T01:07:39.372378+0000","last_clean":"2024-09-12T01:07:39.372378+0000","last_became_active":"2024-09-12T00:21:42.492572+0000","last_became_peered":"2024-09-12T00:21:42.492572+0000","last_unstale":"2024-09-12T01:07:39.372378+0000","last_undegraded":"2024-09-12T01:07:39.372378+0000","last_fullsized":"2024-09-12T01:07:39.372378+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:39.372054+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:39.372054+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.372054+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:10.885705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":145927,"num_write":1169,"num_write_kb":64533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.367076+0000","last_change":"2024-09-12T01:07:54.367076+0000","last_active":"2024-09-12T01:07:54.367076+0000","last_peered":"2024-09-12T01:07:54.367076+0000","last_clean":"2024-09-12T01:07:54.367076+0000","last_became_active":"2024-09-12T00:21:46.490985+0000","last_became_peered":"2024-09-12T00:21:46.490985+0000","last_unstale":"2024-09-12T01:07:54.367076+0000","last_undegraded":"2024-09-12T01:07:54.367076+0000","last_fullsized":"2024-09-12T01:07:54.367076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.366884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.366884+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.366884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:54.269774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'88","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.609595+0000","last_change":"2024-09-12T01:07:55.609595+0000","last_active":"2024-09-12T01:07:55.609595+0000","last_peered":"2024-09-12T01:07:55.609595+0000","last_clean":"2024-09-12T01:07:55.609595+0000","last_became_active":"2024-09-12T00:21:48.535190+0000","last_became_peered":"2024-09-12T00:21:48.535190+0000","last_unstale":"2024-09-12T01:07:55.609595+0000","last_undegraded":"2024-09-12T01:07:55.609595+0000","last_fullsized":"2024-09-12T01:07:55.609595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'88","last_scrub_stamp":"2024-09-12T01:07:55.609509+0000","last_deep_scrub":"267'88","last_deep_scrub_stamp":"2024-09-12T01:07:55.609509+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.609509+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:29.653534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.578105+0000","last_change":"2024-09-12T01:07:56.578105+0000","last_active":"2024-09-12T01:07:56.578105+0000","last_peered":"2024-09-12T01:07:56.578105+0000","last_clean":"2024-09-12T01:07:56.578105+0000","last_became_active":"2024-09-12T00:21:50.550214+0000","last_became_peered":"2024-09-12T00:21:50.550214+0000","last_unstale":"2024-09-12T01:07:56.578105+0000","last_undegraded":"2024-09-12T01:07:56.578105+0000","last_fullsized":"2024-09-12T01:07:56.578105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:56.577932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:56.577932+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.577932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:42.970087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'129","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.314305+0000","last_change":"2024-09-12T01:08:04.314305+0000","last_active":"2024-09-12T01:08:04.314305+0000","last_peered":"2024-09-12T01:08:04.314305+0000","last_clean":"2024-09-12T01:08:04.314305+0000","last_became_active":"2024-09-12T00:21:52.545166+0000","last_became_peered":"2024-09-12T00:21:52.545166+0000","last_unstale":"2024-09-12T01:08:04.314305+0000","last_undegraded":"2024-09-12T01:08:04.314305+0000","last_fullsized":"2024-09-12T01:08:04.314305+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:08:04.314110+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:08:04.314110+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.314110+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:16.820858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":292,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'288","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.016647+0000","last_change":"2024-09-12T01:07:51.016647+0000","last_active":"2024-09-12T01:07:51.016647+0000","last_peered":"2024-09-12T01:07:51.016647+0000","last_clean":"2024-09-12T01:07:51.016647+0000","last_became_active":"2024-09-12T00:21:44.520057+0000","last_became_peered":"2024-09-12T00:21:44.520057+0000","last_unstale":"2024-09-12T01:07:51.016647+0000","last_undegraded":"2024-09-12T01:07:51.016647+0000","last_fullsized":"2024-09-12T01:07:51.016647+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'288","last_scrub_stamp":"2024-09-12T01:07:51.016419+0000","last_deep_scrub":"267'288","last_deep_scrub_stamp":"2024-09-12T01:07:51.016419+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.016419+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:13.071098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1259,"num_read_kb":1089,"num_write":465,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'321","reported_seq":960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.918798+0000","last_change":"2024-09-12T01:07:36.918798+0000","last_active":"2024-09-12T01:07:36.918798+0000","last_peered":"2024-09-12T01:07:36.918798+0000","last_clean":"2024-09-12T01:07:36.918798+0000","last_became_active":"2024-09-12T00:21:42.496059+0000","last_became_peered":"2024-09-12T00:21:42.496059+0000","last_unstale":"2024-09-12T01:07:36.918798+0000","last_undegraded":"2024-09-12T01:07:36.918798+0000","last_fullsized":"2024-09-12T01:07:36.918798+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'321","last_scrub_stamp":"2024-09-12T01:07:36.918576+0000","last_deep_scrub":"267'321","last_deep_scrub_stamp":"2024-09-12T01:07:36.918576+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.918576+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:39.909942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":8629,"num_write":994,"num_write_kb":21953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.365480+0000","last_change":"2024-09-12T01:07:55.365480+0000","last_active":"2024-09-12T01:07:55.365480+0000","last_peered":"2024-09-12T01:07:55.365480+0000","last_clean":"2024-09-12T01:07:55.365480+0000","last_became_active":"2024-09-12T00:21:46.501407+0000","last_became_peered":"2024-09-12T00:21:46.501407+0000","last_unstale":"2024-09-12T01:07:55.365480+0000","last_undegraded":"2024-09-12T01:07:55.365480+0000","last_fullsized":"2024-09-12T01:07:55.365480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.365302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.365302+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.365302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:38.230753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'129","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.376443+0000","last_change":"2024-09-12T01:08:02.376443+0000","last_active":"2024-09-12T01:08:02.376443+0000","last_peered":"2024-09-12T01:08:02.376443+0000","last_clean":"2024-09-12T01:08:02.376443+0000","last_became_active":"2024-09-12T00:21:48.541231+0000","last_became_peered":"2024-09-12T00:21:48.541231+0000","last_unstale":"2024-09-12T01:08:02.376443+0000","last_undegraded":"2024-09-12T01:08:02.376443+0000","last_fullsized":"2024-09-12T01:08:02.376443+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:08:02.376158+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:08:02.376158+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.376158+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:58.427365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'788","reported_seq":2515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.708110+0000","last_change":"2024-09-12T00:21:50.569545+0000","last_active":"2024-09-12T01:07:27.708110+0000","last_peered":"2024-09-12T01:07:27.708110+0000","last_clean":"2024-09-12T01:07:27.708110+0000","last_became_active":"2024-09-12T00:21:50.568825+0000","last_became_peered":"2024-09-12T00:21:50.568825+0000","last_unstale":"2024-09-12T01:07:27.708110+0000","last_undegraded":"2024-09-12T01:07:27.708110+0000","last_fullsized":"2024-09-12T01:07:27.708110+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'225","reported_seq":1078,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.199574+0000","last_change":"2024-09-12T01:08:00.199574+0000","last_active":"2024-09-12T01:08:00.199574+0000","last_peered":"2024-09-12T01:08:00.199574+0000","last_clean":"2024-09-12T01:08:00.199574+0000","last_became_active":"2024-09-12T00:21:52.554865+0000","last_became_peered":"2024-09-12T00:21:52.554865+0000","last_unstale":"2024-09-12T01:08:00.199574+0000","last_undegraded":"2024-09-12T01:08:00.199574+0000","last_fullsized":"2024-09-12T01:08:00.199574+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-12T01:08:00.199341+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-12T01:08:00.199341+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.199341+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:05.338489+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":708,"num_read_kb":679,"num_write":497,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'136","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.992340+0000","last_change":"2024-09-12T01:07:51.992340+0000","last_active":"2024-09-12T01:07:51.992340+0000","last_peered":"2024-09-12T01:07:51.992340+0000","last_clean":"2024-09-12T01:07:51.992340+0000","last_became_active":"2024-09-12T00:21:44.522830+0000","last_became_peered":"2024-09-12T00:21:44.522830+0000","last_unstale":"2024-09-12T01:07:51.992340+0000","last_undegraded":"2024-09-12T01:07:51.992340+0000","last_fullsized":"2024-09-12T01:07:51.992340+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'136","last_scrub_stamp":"2024-09-12T01:07:51.992145+0000","last_deep_scrub":"267'136","last_deep_scrub_stamp":"2024-09-12T01:07:51.992145+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.992145+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:19.587323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":469,"num_write":207,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'328","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.611420+0000","last_change":"2024-09-12T01:07:33.611420+0000","last_active":"2024-09-12T01:07:33.611420+0000","last_peered":"2024-09-12T01:07:33.611420+0000","last_clean":"2024-09-12T01:07:33.611420+0000","last_became_active":"2024-09-12T00:21:42.516625+0000","last_became_peered":"2024-09-12T00:21:42.516625+0000","last_unstale":"2024-09-12T01:07:33.611420+0000","last_undegraded":"2024-09-12T01:07:33.611420+0000","last_fullsized":"2024-09-12T01:07:33.611420+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.611301+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:46.786030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":2651,"num_write":1122,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.070311+0000","last_change":"2024-09-12T01:08:04.070311+0000","last_active":"2024-09-12T01:08:04.070311+0000","last_peered":"2024-09-12T01:08:04.070311+0000","last_clean":"2024-09-12T01:08:04.070311+0000","last_became_active":"2024-09-12T00:21:46.503686+0000","last_became_peered":"2024-09-12T00:21:46.503686+0000","last_unstale":"2024-09-12T01:08:04.070311+0000","last_undegraded":"2024-09-12T01:08:04.070311+0000","last_fullsized":"2024-09-12T01:08:04.070311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:04.070128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:04.070128+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.070128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:47.551310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'288","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.199449+0000","last_change":"2024-09-12T01:07:52.199449+0000","last_active":"2024-09-12T01:07:52.199449+0000","last_peered":"2024-09-12T01:07:52.199449+0000","last_clean":"2024-09-12T01:07:52.199449+0000","last_became_active":"2024-09-12T00:21:48.539522+0000","last_became_peered":"2024-09-12T00:21:48.539522+0000","last_unstale":"2024-09-12T01:07:52.199449+0000","last_undegraded":"2024-09-12T01:07:52.199449+0000","last_fullsized":"2024-09-12T01:07:52.199449+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'288","last_scrub_stamp":"2024-09-12T01:07:52.199255+0000","last_deep_scrub":"267'288","last_deep_scrub_stamp":"2024-09-12T01:07:52.199255+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.199255+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:02.995276+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47885,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1089,"num_write":388,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'781","reported_seq":2475,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.918460+0000","last_change":"2024-09-12T01:08:05.918460+0000","last_active":"2024-09-12T01:08:05.918460+0000","last_peered":"2024-09-12T01:08:05.918460+0000","last_clean":"2024-09-12T01:08:05.918460+0000","last_became_active":"2024-09-12T00:21:50.564483+0000","last_became_peered":"2024-09-12T00:21:50.564483+0000","last_unstale":"2024-09-12T01:08:05.918460+0000","last_undegraded":"2024-09-12T01:08:05.918460+0000","last_fullsized":"2024-09-12T01:08:05.918460+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-12T01:08:05.918233+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-12T01:08:05.918233+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.918233+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:41.622332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'576","reported_seq":1373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.904435+0000","last_change":"2024-09-12T01:07:50.904435+0000","last_active":"2024-09-12T01:07:50.904435+0000","last_peered":"2024-09-12T01:07:50.904435+0000","last_clean":"2024-09-12T01:07:50.904435+0000","last_became_active":"2024-09-12T00:21:44.497754+0000","last_became_peered":"2024-09-12T00:21:44.497754+0000","last_unstale":"2024-09-12T01:07:50.904435+0000","last_undegraded":"2024-09-12T01:07:50.904435+0000","last_fullsized":"2024-09-12T01:07:50.904435+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'576","last_scrub_stamp":"2024-09-12T01:07:50.904242+0000","last_deep_scrub":"267'576","last_deep_scrub_stamp":"2024-09-12T01:07:50.904242+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.904242+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:34.973282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2710,"num_read_kb":2241,"num_write":1007,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'379","reported_seq":1096,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:31.968974+0000","last_change":"2024-09-12T01:07:31.968974+0000","last_active":"2024-09-12T01:07:31.968974+0000","last_peered":"2024-09-12T01:07:31.968974+0000","last_clean":"2024-09-12T01:07:31.968974+0000","last_became_active":"2024-09-12T00:21:42.528138+0000","last_became_peered":"2024-09-12T00:21:42.528138+0000","last_unstale":"2024-09-12T01:07:31.968974+0000","last_undegraded":"2024-09-12T01:07:31.968974+0000","last_fullsized":"2024-09-12T01:07:31.968974+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_clean_scrub_stamp":"2024-09-12T01:07:31.968881+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:08.369394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":24539,"num_write":1088,"num_write_kb":22675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.602402+0000","last_change":"2024-09-12T01:07:48.602402+0000","last_active":"2024-09-12T01:07:48.602402+0000","last_peered":"2024-09-12T01:07:48.602402+0000","last_clean":"2024-09-12T01:07:48.602402+0000","last_became_active":"2024-09-12T00:21:46.503041+0000","last_became_peered":"2024-09-12T00:21:46.503041+0000","last_unstale":"2024-09-12T01:07:48.602402+0000","last_undegraded":"2024-09-12T01:07:48.602402+0000","last_fullsized":"2024-09-12T01:07:48.602402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.602219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.602219+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.602219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:00.262764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'375","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045785+0000","last_change":"2024-09-12T01:07:50.045785+0000","last_active":"2024-09-12T01:07:50.045785+0000","last_peered":"2024-09-12T01:07:50.045785+0000","last_clean":"2024-09-12T01:07:50.045785+0000","last_became_active":"2024-09-12T00:21:48.538727+0000","last_became_peered":"2024-09-12T00:21:48.538727+0000","last_unstale":"2024-09-12T01:07:50.045785+0000","last_undegraded":"2024-09-12T01:07:50.045785+0000","last_fullsized":"2024-09-12T01:07:50.045785+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T01:07:50.045578+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T01:07:50.045578+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.045578+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:24.408858+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48773,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":589,"num_read_kb":1209,"num_write":464,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.339748+0000","last_change":"2024-09-12T01:08:02.339748+0000","last_active":"2024-09-12T01:08:02.339748+0000","last_peered":"2024-09-12T01:08:02.339748+0000","last_clean":"2024-09-12T01:08:02.339748+0000","last_became_active":"2024-09-12T00:21:50.544432+0000","last_became_peered":"2024-09-12T00:21:50.544432+0000","last_unstale":"2024-09-12T01:08:02.339748+0000","last_undegraded":"2024-09-12T01:08:02.339748+0000","last_fullsized":"2024-09-12T01:08:02.339748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.339562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.339562+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.339562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:22.365617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'553","reported_seq":1373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.241100+0000","last_change":"2024-09-12T01:07:56.241100+0000","last_active":"2024-09-12T01:07:56.241100+0000","last_peered":"2024-09-12T01:07:56.241100+0000","last_clean":"2024-09-12T01:07:56.241100+0000","last_became_active":"2024-09-12T00:21:52.563086+0000","last_became_peered":"2024-09-12T00:21:52.563086+0000","last_unstale":"2024-09-12T01:07:56.241100+0000","last_undegraded":"2024-09-12T01:07:56.241100+0000","last_fullsized":"2024-09-12T01:07:56.241100+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'553","last_scrub_stamp":"2024-09-12T01:07:56.240896+0000","last_deep_scrub":"267'553","last_deep_scrub_stamp":"2024-09-12T01:07:56.240896+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.240896+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:00.278881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1274,"num_read_kb":1271,"num_write":1130,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'526","reported_seq":1314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.643971+0000","last_change":"2024-09-12T01:07:36.643971+0000","last_active":"2024-09-12T01:07:36.643971+0000","last_peered":"2024-09-12T01:07:36.643971+0000","last_clean":"2024-09-12T01:07:36.643971+0000","last_became_active":"2024-09-12T00:21:44.510918+0000","last_became_peered":"2024-09-12T00:21:44.510918+0000","last_unstale":"2024-09-12T01:07:36.643971+0000","last_undegraded":"2024-09-12T01:07:36.643971+0000","last_fullsized":"2024-09-12T01:07:36.643971+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'526","last_scrub_stamp":"2024-09-12T01:07:36.643792+0000","last_deep_scrub":"267'526","last_deep_scrub_stamp":"2024-09-12T01:07:36.643792+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.643792+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.857231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2468,"num_read_kb":2089,"num_write":789,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29756,"num_omap_keys":119,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'326","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.222218+0000","last_change":"2024-09-12T01:07:33.222218+0000","last_active":"2024-09-12T01:07:33.222218+0000","last_peered":"2024-09-12T01:07:33.222218+0000","last_clean":"2024-09-12T01:07:33.222218+0000","last_became_active":"2024-09-12T00:21:42.513031+0000","last_became_peered":"2024-09-12T00:21:42.513031+0000","last_unstale":"2024-09-12T01:07:33.222218+0000","last_undegraded":"2024-09-12T01:07:33.222218+0000","last_fullsized":"2024-09-12T01:07:33.222218+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.222064+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:44.352540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730153,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":476,"num_read_kb":44893,"num_write":1011,"num_write_kb":33699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.362478+0000","last_change":"2024-09-12T01:07:51.362478+0000","last_active":"2024-09-12T01:07:51.362478+0000","last_peered":"2024-09-12T01:07:51.362478+0000","last_clean":"2024-09-12T01:07:51.362478+0000","last_became_active":"2024-09-12T00:21:46.517981+0000","last_became_peered":"2024-09-12T00:21:46.517981+0000","last_unstale":"2024-09-12T01:07:51.362478+0000","last_undegraded":"2024-09-12T01:07:51.362478+0000","last_fullsized":"2024-09-12T01:07:51.362478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:51.362295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:51.362295+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.362295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:14.300895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'279","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.368682+0000","last_change":"2024-09-12T01:07:57.368682+0000","last_active":"2024-09-12T01:07:57.368682+0000","last_peered":"2024-09-12T01:07:57.368682+0000","last_clean":"2024-09-12T01:07:57.368682+0000","last_became_active":"2024-09-12T00:21:48.522920+0000","last_became_peered":"2024-09-12T00:21:48.522920+0000","last_unstale":"2024-09-12T01:07:57.368682+0000","last_undegraded":"2024-09-12T01:07:57.368682+0000","last_fullsized":"2024-09-12T01:07:57.368682+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'279","last_scrub_stamp":"2024-09-12T01:07:57.368482+0000","last_deep_scrub":"267'279","last_deep_scrub_stamp":"2024-09-12T01:07:57.368482+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.368482+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:44.666804+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1024,"num_write":366,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.414890+0000","last_change":"2024-09-12T01:08:06.414890+0000","last_active":"2024-09-12T01:08:06.414890+0000","last_peered":"2024-09-12T01:08:06.414890+0000","last_clean":"2024-09-12T01:08:06.414890+0000","last_became_active":"2024-09-12T00:21:50.543639+0000","last_became_peered":"2024-09-12T00:21:50.543639+0000","last_unstale":"2024-09-12T01:08:06.414890+0000","last_undegraded":"2024-09-12T01:08:06.414890+0000","last_fullsized":"2024-09-12T01:08:06.414890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.414613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.414613+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.414613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:57.975178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2374","reported_seq":4224,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.568799+0000","last_change":"2024-09-12T01:07:58.568799+0000","last_active":"2024-09-12T01:07:58.568799+0000","last_peered":"2024-09-12T01:07:58.568799+0000","last_clean":"2024-09-12T01:07:58.568799+0000","last_became_active":"2024-09-12T00:21:52.537701+0000","last_became_peered":"2024-09-12T00:21:52.537701+0000","last_unstale":"2024-09-12T01:07:58.568799+0000","last_undegraded":"2024-09-12T01:07:58.568799+0000","last_fullsized":"2024-09-12T01:07:58.568799+0000","mapping_epoch":36,"log_start":"267'2300","ondisk_log_start":"267'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2374","last_scrub_stamp":"2024-09-12T01:07:58.568601+0000","last_deep_scrub":"267'2374","last_deep_scrub_stamp":"2024-09-12T01:07:58.568601+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.568601+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":2300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:41.122451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5977,"num_write":4771,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'112","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.271862+0000","last_change":"2024-09-12T01:07:41.271862+0000","last_active":"2024-09-12T01:07:41.271862+0000","last_peered":"2024-09-12T01:07:41.271862+0000","last_clean":"2024-09-12T01:07:41.271862+0000","last_became_active":"2024-09-12T00:21:44.494313+0000","last_became_peered":"2024-09-12T00:21:44.494313+0000","last_unstale":"2024-09-12T01:07:41.271862+0000","last_undegraded":"2024-09-12T01:07:41.271862+0000","last_fullsized":"2024-09-12T01:07:41.271862+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'112","last_scrub_stamp":"2024-09-12T01:07:41.271428+0000","last_deep_scrub":"267'112","last_deep_scrub_stamp":"2024-09-12T01:07:41.271428+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.271428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:21.911085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":397,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'345","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.915359+0000","last_change":"2024-09-12T01:07:49.915359+0000","last_active":"2024-09-12T01:07:49.915359+0000","last_peered":"2024-09-12T01:07:49.915359+0000","last_clean":"2024-09-12T01:07:49.915359+0000","last_became_active":"2024-09-12T00:21:42.529372+0000","last_became_peered":"2024-09-12T00:21:42.529372+0000","last_unstale":"2024-09-12T01:07:49.915359+0000","last_undegraded":"2024-09-12T01:07:49.915359+0000","last_fullsized":"2024-09-12T01:07:49.915359+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T01:07:49.915120+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T01:07:49.915120+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.915120+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:20.870747+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12055,"num_write":1241,"num_write_kb":31958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.018618+0000","last_change":"2024-09-12T01:07:57.018618+0000","last_active":"2024-09-12T01:07:57.018618+0000","last_peered":"2024-09-12T01:07:57.018618+0000","last_clean":"2024-09-12T01:07:57.018618+0000","last_became_active":"2024-09-12T00:21:46.511704+0000","last_became_peered":"2024-09-12T00:21:46.511704+0000","last_unstale":"2024-09-12T01:07:57.018618+0000","last_undegraded":"2024-09-12T01:07:57.018618+0000","last_fullsized":"2024-09-12T01:07:57.018618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.018450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.018450+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.018450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:09.211088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'293","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.148340+0000","last_change":"2024-09-12T01:08:07.148340+0000","last_active":"2024-09-12T01:08:07.148340+0000","last_peered":"2024-09-12T01:08:07.148340+0000","last_clean":"2024-09-12T01:08:07.148340+0000","last_became_active":"2024-09-12T00:21:48.551752+0000","last_became_peered":"2024-09-12T00:21:48.551752+0000","last_unstale":"2024-09-12T01:08:07.148340+0000","last_undegraded":"2024-09-12T01:08:07.148340+0000","last_fullsized":"2024-09-12T01:08:07.148340+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'293","last_scrub_stamp":"2024-09-12T01:08:07.148130+0000","last_deep_scrub":"267'293","last_deep_scrub_stamp":"2024-09-12T01:08:07.148130+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.148130+0000","objects_scrubbed":9,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:20.946763+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42024,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":467,"num_read_kb":1006,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'782","reported_seq":4668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.907857+0000","last_change":"2024-09-12T01:08:04.907857+0000","last_active":"2024-09-12T01:08:04.907857+0000","last_peered":"2024-09-12T01:08:04.907857+0000","last_clean":"2024-09-12T01:08:04.907857+0000","last_became_active":"2024-09-12T00:21:50.561680+0000","last_became_peered":"2024-09-12T00:21:50.561680+0000","last_unstale":"2024-09-12T01:08:04.907857+0000","last_undegraded":"2024-09-12T01:08:04.907857+0000","last_fullsized":"2024-09-12T01:08:04.907857+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:08:04.907672+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:08:04.907672+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.907672+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":701,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:00.038489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'120","reported_seq":626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.318010+0000","last_change":"2024-09-12T01:08:03.318010+0000","last_active":"2024-09-12T01:08:03.318010+0000","last_peered":"2024-09-12T01:08:03.318010+0000","last_clean":"2024-09-12T01:08:03.318010+0000","last_became_active":"2024-09-12T00:21:52.546889+0000","last_became_peered":"2024-09-12T00:21:52.546889+0000","last_unstale":"2024-09-12T01:08:03.318010+0000","last_undegraded":"2024-09-12T01:08:03.318010+0000","last_fullsized":"2024-09-12T01:08:03.318010+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-12T01:08:03.317820+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-12T01:08:03.317820+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.317820+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.621333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":121,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'188","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.987877+0000","last_change":"2024-09-12T01:07:49.987877+0000","last_active":"2024-09-12T01:07:49.987877+0000","last_peered":"2024-09-12T01:07:49.987877+0000","last_clean":"2024-09-12T01:07:49.987877+0000","last_became_active":"2024-09-12T00:21:44.518595+0000","last_became_peered":"2024-09-12T00:21:44.518595+0000","last_unstale":"2024-09-12T01:07:49.987877+0000","last_undegraded":"2024-09-12T01:07:49.987877+0000","last_fullsized":"2024-09-12T01:07:49.987877+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'188","last_scrub_stamp":"2024-09-12T01:07:49.987691+0000","last_deep_scrub":"267'188","last_deep_scrub_stamp":"2024-09-12T01:07:49.987691+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.987691+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:57.684878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":656,"num_write":281,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'267","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.002912+0000","last_change":"2024-09-12T01:07:33.002912+0000","last_active":"2024-09-12T01:07:33.002912+0000","last_peered":"2024-09-12T01:07:33.002912+0000","last_clean":"2024-09-12T01:07:33.002912+0000","last_became_active":"2024-09-12T00:21:42.497992+0000","last_became_peered":"2024-09-12T00:21:42.497992+0000","last_unstale":"2024-09-12T01:07:33.002912+0000","last_undegraded":"2024-09-12T01:07:33.002912+0000","last_fullsized":"2024-09-12T01:07:33.002912+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'267","last_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_deep_scrub":"267'267","last_deep_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.002601+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:20.061473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":82463,"num_write":854,"num_write_kb":27861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.333366+0000","last_change":"2024-09-12T01:07:52.333366+0000","last_active":"2024-09-12T01:07:52.333366+0000","last_peered":"2024-09-12T01:07:52.333366+0000","last_clean":"2024-09-12T01:07:52.333366+0000","last_became_active":"2024-09-12T00:21:46.511365+0000","last_became_peered":"2024-09-12T00:21:46.511365+0000","last_unstale":"2024-09-12T01:07:52.333366+0000","last_undegraded":"2024-09-12T01:07:52.333366+0000","last_fullsized":"2024-09-12T01:07:52.333366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.333162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.333162+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.333162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:19.202850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'480","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.330685+0000","last_change":"2024-09-12T01:07:58.330685+0000","last_active":"2024-09-12T01:07:58.330685+0000","last_peered":"2024-09-12T01:07:58.330685+0000","last_clean":"2024-09-12T01:07:58.330685+0000","last_became_active":"2024-09-12T00:21:48.524173+0000","last_became_peered":"2024-09-12T00:21:48.524173+0000","last_unstale":"2024-09-12T01:07:58.330685+0000","last_undegraded":"2024-09-12T01:07:58.330685+0000","last_fullsized":"2024-09-12T01:07:58.330685+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'480","last_scrub_stamp":"2024-09-12T01:07:58.330481+0000","last_deep_scrub":"267'480","last_deep_scrub_stamp":"2024-09-12T01:07:58.330481+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.330481+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.060816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1944,"num_write":668,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.942552+0000","last_change":"2024-09-12T01:08:03.942552+0000","last_active":"2024-09-12T01:08:03.942552+0000","last_peered":"2024-09-12T01:08:03.942552+0000","last_clean":"2024-09-12T01:08:03.942552+0000","last_became_active":"2024-09-12T00:21:50.561720+0000","last_became_peered":"2024-09-12T00:21:50.561720+0000","last_unstale":"2024-09-12T01:08:03.942552+0000","last_undegraded":"2024-09-12T01:08:03.942552+0000","last_fullsized":"2024-09-12T01:08:03.942552+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:03.942372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:03.942372+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.942372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:41.505555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'126","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.404868+0000","last_change":"2024-09-12T01:07:57.404868+0000","last_active":"2024-09-12T01:07:57.404868+0000","last_peered":"2024-09-12T01:07:57.404868+0000","last_clean":"2024-09-12T01:07:57.404868+0000","last_became_active":"2024-09-12T00:21:52.565276+0000","last_became_peered":"2024-09-12T00:21:52.565276+0000","last_unstale":"2024-09-12T01:07:57.404868+0000","last_undegraded":"2024-09-12T01:07:57.404868+0000","last_fullsized":"2024-09-12T01:07:57.404868+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-09-12T01:07:57.404662+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-09-12T01:07:57.404662+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.404662+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:42.679468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'92","reported_seq":695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.018654+0000","last_change":"2024-09-12T01:07:41.018654+0000","last_active":"2024-09-12T01:07:41.018654+0000","last_peered":"2024-09-12T01:07:41.018654+0000","last_clean":"2024-09-12T01:07:41.018654+0000","last_became_active":"2024-09-12T00:21:44.504866+0000","last_became_peered":"2024-09-12T00:21:44.504866+0000","last_unstale":"2024-09-12T01:07:41.018654+0000","last_undegraded":"2024-09-12T01:07:41.018654+0000","last_fullsized":"2024-09-12T01:07:41.018654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'92","last_scrub_stamp":"2024-09-12T01:07:41.018456+0000","last_deep_scrub":"267'92","last_deep_scrub_stamp":"2024-09-12T01:07:41.018456+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.018456+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:57.826698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":364,"num_write":125,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'360","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.122169+0000","last_change":"2024-09-12T01:07:35.122169+0000","last_active":"2024-09-12T01:07:35.122169+0000","last_peered":"2024-09-12T01:07:35.122169+0000","last_clean":"2024-09-12T01:07:35.122169+0000","last_became_active":"2024-09-12T00:21:42.511762+0000","last_became_peered":"2024-09-12T00:21:42.511762+0000","last_unstale":"2024-09-12T01:07:35.122169+0000","last_undegraded":"2024-09-12T01:07:35.122169+0000","last_fullsized":"2024-09-12T01:07:35.122169+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'360","last_scrub_stamp":"2024-09-12T01:07:35.121973+0000","last_deep_scrub":"267'360","last_deep_scrub_stamp":"2024-09-12T01:07:35.121973+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.121973+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:10.214969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":36352,"num_write":1101,"num_write_kb":41720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.241978+0000","last_change":"2024-09-12T01:07:48.241978+0000","last_active":"2024-09-12T01:07:48.241978+0000","last_peered":"2024-09-12T01:07:48.241978+0000","last_clean":"2024-09-12T01:07:48.241978+0000","last_became_active":"2024-09-12T00:21:46.514486+0000","last_became_peered":"2024-09-12T00:21:46.514486+0000","last_unstale":"2024-09-12T01:07:48.241978+0000","last_undegraded":"2024-09-12T01:07:48.241978+0000","last_fullsized":"2024-09-12T01:07:48.241978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.241783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.241783+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.241783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.010975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'324","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.612716+0000","last_change":"2024-09-12T01:07:51.612716+0000","last_active":"2024-09-12T01:07:51.612716+0000","last_peered":"2024-09-12T01:07:51.612716+0000","last_clean":"2024-09-12T01:07:51.612716+0000","last_became_active":"2024-09-12T00:21:48.547356+0000","last_became_peered":"2024-09-12T00:21:48.547356+0000","last_unstale":"2024-09-12T01:07:51.612716+0000","last_undegraded":"2024-09-12T01:07:51.612716+0000","last_fullsized":"2024-09-12T01:07:51.612716+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-12T01:07:51.612333+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-12T01:07:51.612333+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.612333+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.550390+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55196,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":458,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.258274+0000","last_change":"2024-09-12T01:07:52.258274+0000","last_active":"2024-09-12T01:07:52.258274+0000","last_peered":"2024-09-12T01:07:52.258274+0000","last_clean":"2024-09-12T01:07:52.258274+0000","last_became_active":"2024-09-12T00:21:50.556220+0000","last_became_peered":"2024-09-12T00:21:50.556220+0000","last_unstale":"2024-09-12T01:07:52.258274+0000","last_undegraded":"2024-09-12T01:07:52.258274+0000","last_fullsized":"2024-09-12T01:07:52.258274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.258094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.258094+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.258094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.161738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'130","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.875681+0000","last_change":"2024-09-12T01:08:07.875681+0000","last_active":"2024-09-12T01:08:07.875681+0000","last_peered":"2024-09-12T01:08:07.875681+0000","last_clean":"2024-09-12T01:08:07.875681+0000","last_became_active":"2024-09-12T00:21:52.567273+0000","last_became_peered":"2024-09-12T00:21:52.567273+0000","last_unstale":"2024-09-12T01:08:07.875681+0000","last_undegraded":"2024-09-12T01:08:07.875681+0000","last_fullsized":"2024-09-12T01:08:07.875681+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'130","last_scrub_stamp":"2024-09-12T01:08:07.875498+0000","last_deep_scrub":"267'130","last_deep_scrub_stamp":"2024-09-12T01:08:07.875498+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.875498+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:35.875359+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'124","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.917629+0000","last_change":"2024-09-12T01:07:53.917629+0000","last_active":"2024-09-12T01:07:53.917629+0000","last_peered":"2024-09-12T01:07:53.917629+0000","last_clean":"2024-09-12T01:07:53.917629+0000","last_became_active":"2024-09-12T00:21:44.502965+0000","last_became_peered":"2024-09-12T00:21:44.502965+0000","last_unstale":"2024-09-12T01:07:53.917629+0000","last_undegraded":"2024-09-12T01:07:53.917629+0000","last_fullsized":"2024-09-12T01:07:53.917629+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'124","last_scrub_stamp":"2024-09-12T01:07:53.917407+0000","last_deep_scrub":"267'124","last_deep_scrub_stamp":"2024-09-12T01:07:53.917407+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.917407+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:24.103740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":435,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'354","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.387251+0000","last_change":"2024-09-12T01:07:37.386999+0000","last_active":"2024-09-12T01:07:37.387251+0000","last_peered":"2024-09-12T01:07:37.387251+0000","last_clean":"2024-09-12T01:07:37.387251+0000","last_became_active":"2024-09-12T00:22:13.520026+0000","last_became_peered":"2024-09-12T00:22:13.520026+0000","last_unstale":"2024-09-12T01:07:37.387251+0000","last_undegraded":"2024-09-12T01:07:37.387251+0000","last_fullsized":"2024-09-12T01:07:37.387251+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T01:07:37.386628+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T01:07:37.386628+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.386628+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:48.359725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254518,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":616,"num_read_kb":38314,"num_write":1135,"num_write_kb":31045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.002454+0000","last_change":"2024-09-12T01:08:00.002454+0000","last_active":"2024-09-12T01:08:00.002454+0000","last_peered":"2024-09-12T01:08:00.002454+0000","last_clean":"2024-09-12T01:08:00.002454+0000","last_became_active":"2024-09-12T00:21:46.507456+0000","last_became_peered":"2024-09-12T00:21:46.507456+0000","last_unstale":"2024-09-12T01:08:00.002454+0000","last_undegraded":"2024-09-12T01:08:00.002454+0000","last_fullsized":"2024-09-12T01:08:00.002454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.002274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.002274+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.002274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:36.717809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'317","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.994766+0000","last_change":"2024-09-12T01:08:00.994766+0000","last_active":"2024-09-12T01:08:00.994766+0000","last_peered":"2024-09-12T01:08:00.994766+0000","last_clean":"2024-09-12T01:08:00.994766+0000","last_became_active":"2024-09-12T00:21:48.535782+0000","last_became_peered":"2024-09-12T00:21:48.535782+0000","last_unstale":"2024-09-12T01:08:00.994766+0000","last_undegraded":"2024-09-12T01:08:00.994766+0000","last_fullsized":"2024-09-12T01:08:00.994766+0000","mapping_epoch":32,"log_start":"267'301","ondisk_log_start":"267'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T01:08:00.994518+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T01:08:00.994518+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.994518+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:25.545285+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1134,"num_write":412,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'751","reported_seq":2254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.277045+0000","last_change":"2024-09-12T01:07:50.277045+0000","last_active":"2024-09-12T01:07:50.277045+0000","last_peered":"2024-09-12T01:07:50.277045+0000","last_clean":"2024-09-12T01:07:50.277045+0000","last_became_active":"2024-09-12T00:21:50.557158+0000","last_became_peered":"2024-09-12T00:21:50.557158+0000","last_unstale":"2024-09-12T01:07:50.277045+0000","last_undegraded":"2024-09-12T01:07:50.277045+0000","last_fullsized":"2024-09-12T01:07:50.277045+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-12T01:07:50.276867+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-12T01:07:50.276867+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.276867+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:14.558606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'137","reported_seq":650,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.322253+0000","last_change":"2024-09-12T01:08:01.322253+0000","last_active":"2024-09-12T01:08:01.322253+0000","last_peered":"2024-09-12T01:08:01.322253+0000","last_clean":"2024-09-12T01:08:01.322253+0000","last_became_active":"2024-09-12T00:21:52.545876+0000","last_became_peered":"2024-09-12T00:21:52.545876+0000","last_unstale":"2024-09-12T01:08:01.322253+0000","last_undegraded":"2024-09-12T01:08:01.322253+0000","last_fullsized":"2024-09-12T01:08:01.322253+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-12T01:08:01.322059+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-12T01:08:01.322059+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.322059+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:03.008393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":172,"num_write":354,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'141","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.298300+0000","last_change":"2024-09-12T01:07:42.298300+0000","last_active":"2024-09-12T01:07:42.298300+0000","last_peered":"2024-09-12T01:07:42.298300+0000","last_clean":"2024-09-12T01:07:42.298300+0000","last_became_active":"2024-09-12T00:21:44.494386+0000","last_became_peered":"2024-09-12T00:21:44.494386+0000","last_unstale":"2024-09-12T01:07:42.298300+0000","last_undegraded":"2024-09-12T01:07:42.298300+0000","last_fullsized":"2024-09-12T01:07:42.298300+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T01:07:42.298107+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T01:07:42.298107+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.298107+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:49.298297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":627,"num_read_kb":527,"num_write":195,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'416","reported_seq":1113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.903721+0000","last_change":"2024-09-12T01:07:34.903721+0000","last_active":"2024-09-12T01:07:34.903721+0000","last_peered":"2024-09-12T01:07:34.903721+0000","last_clean":"2024-09-12T01:07:34.903721+0000","last_became_active":"2024-09-12T00:21:42.528782+0000","last_became_peered":"2024-09-12T00:21:42.528782+0000","last_unstale":"2024-09-12T01:07:34.903721+0000","last_undegraded":"2024-09-12T01:07:34.903721+0000","last_fullsized":"2024-09-12T01:07:34.903721+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-12T01:07:34.903475+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-12T01:07:34.903475+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.903475+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.315924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170245,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":31515,"num_write":1240,"num_write_kb":36332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"267'10","reported_seq":1955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.565753+0000","last_change":"2024-09-12T01:07:47.565753+0000","last_active":"2024-09-12T01:07:47.565753+0000","last_peered":"2024-09-12T01:07:47.565753+0000","last_clean":"2024-09-12T01:07:47.565753+0000","last_became_active":"2024-09-12T00:21:46.503412+0000","last_became_peered":"2024-09-12T00:21:46.503412+0000","last_unstale":"2024-09-12T01:07:47.565753+0000","last_undegraded":"2024-09-12T01:07:47.565753+0000","last_fullsized":"2024-09-12T01:07:47.565753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T01:07:47.565529+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T01:07:47.565529+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.565529+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:17.675182+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1686,"num_read_kb":2152,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'78","reported_seq":601,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.356185+0000","last_change":"2024-09-12T01:07:55.356185+0000","last_active":"2024-09-12T01:07:55.356185+0000","last_peered":"2024-09-12T01:07:55.356185+0000","last_clean":"2024-09-12T01:07:55.356185+0000","last_became_active":"2024-09-12T00:21:48.545388+0000","last_became_peered":"2024-09-12T00:21:48.545388+0000","last_unstale":"2024-09-12T01:07:55.356185+0000","last_undegraded":"2024-09-12T01:07:55.356185+0000","last_fullsized":"2024-09-12T01:07:55.356185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'78","last_scrub_stamp":"2024-09-12T01:07:55.355975+0000","last_deep_scrub":"267'78","last_deep_scrub_stamp":"2024-09-12T01:07:55.355975+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.355975+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:43.494932+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":4019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.572399+0000","last_change":"2024-09-12T01:07:54.572399+0000","last_active":"2024-09-12T01:07:54.572399+0000","last_peered":"2024-09-12T01:07:54.572399+0000","last_clean":"2024-09-12T01:07:54.572399+0000","last_became_active":"2024-09-12T00:21:50.536672+0000","last_became_peered":"2024-09-12T00:21:50.536672+0000","last_unstale":"2024-09-12T01:07:54.572399+0000","last_undegraded":"2024-09-12T01:07:54.572399+0000","last_fullsized":"2024-09-12T01:07:54.572399+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-12T01:07:54.572215+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-12T01:07:54.572215+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.572215+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:58.399564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'123","reported_seq":644,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.191191+0000","last_change":"2024-09-12T01:07:59.191191+0000","last_active":"2024-09-12T01:07:59.191191+0000","last_peered":"2024-09-12T01:07:59.191191+0000","last_clean":"2024-09-12T01:07:59.191191+0000","last_became_active":"2024-09-12T00:21:52.556523+0000","last_became_peered":"2024-09-12T00:21:52.556523+0000","last_unstale":"2024-09-12T01:07:59.191191+0000","last_undegraded":"2024-09-12T01:07:59.191191+0000","last_fullsized":"2024-09-12T01:07:59.191191+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T01:07:59.191010+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T01:07:59.191010+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.191010+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:19.235147+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":161,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'217","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.091763+0000","last_change":"2024-09-12T01:07:40.091763+0000","last_active":"2024-09-12T01:07:40.091763+0000","last_peered":"2024-09-12T01:07:40.091763+0000","last_clean":"2024-09-12T01:07:40.091763+0000","last_became_active":"2024-09-12T00:21:44.514085+0000","last_became_peered":"2024-09-12T00:21:44.514085+0000","last_unstale":"2024-09-12T01:07:40.091763+0000","last_undegraded":"2024-09-12T01:07:40.091763+0000","last_fullsized":"2024-09-12T01:07:40.091763+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'217","last_scrub_stamp":"2024-09-12T01:07:40.091578+0000","last_deep_scrub":"267'217","last_deep_scrub_stamp":"2024-09-12T01:07:40.091578+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.091578+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:49.279255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":987,"num_read_kb":820,"num_write":332,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'341","reported_seq":965,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.355510+0000","last_change":"2024-09-12T01:07:36.355510+0000","last_active":"2024-09-12T01:07:36.355510+0000","last_peered":"2024-09-12T01:07:36.355510+0000","last_clean":"2024-09-12T01:07:36.355510+0000","last_became_active":"2024-09-12T00:21:42.484728+0000","last_became_peered":"2024-09-12T00:21:42.484728+0000","last_unstale":"2024-09-12T01:07:36.355510+0000","last_undegraded":"2024-09-12T01:07:36.355510+0000","last_fullsized":"2024-09-12T01:07:36.355510+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:36.355185+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:36.355185+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.355185+0000","objects_scrubbed":9,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:41.361142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":1781,"num_write":1014,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.017730+0000","last_change":"2024-09-12T01:08:01.017730+0000","last_active":"2024-09-12T01:08:01.017730+0000","last_peered":"2024-09-12T01:08:01.017730+0000","last_clean":"2024-09-12T01:08:01.017730+0000","last_became_active":"2024-09-12T00:21:46.515469+0000","last_became_peered":"2024-09-12T00:21:46.515469+0000","last_unstale":"2024-09-12T01:08:01.017730+0000","last_undegraded":"2024-09-12T01:08:01.017730+0000","last_fullsized":"2024-09-12T01:08:01.017730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:01.017496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:01.017496+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.017496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:43.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'349","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.611743+0000","last_change":"2024-09-12T01:07:50.611743+0000","last_active":"2024-09-12T01:07:50.611743+0000","last_peered":"2024-09-12T01:07:50.611743+0000","last_clean":"2024-09-12T01:07:50.611743+0000","last_became_active":"2024-09-12T00:21:48.523392+0000","last_became_peered":"2024-09-12T00:21:48.523392+0000","last_unstale":"2024-09-12T01:07:50.611743+0000","last_undegraded":"2024-09-12T01:07:50.611743+0000","last_fullsized":"2024-09-12T01:07:50.611743+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:50.611343+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:50.611343+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.611343+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:19.848968+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50746,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1171,"num_write":440,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.158670+0000","last_change":"2024-09-12T01:07:53.158670+0000","last_active":"2024-09-12T01:07:53.158670+0000","last_peered":"2024-09-12T01:07:53.158670+0000","last_clean":"2024-09-12T01:07:53.158670+0000","last_became_active":"2024-09-12T00:21:50.566831+0000","last_became_peered":"2024-09-12T00:21:50.566831+0000","last_unstale":"2024-09-12T01:07:53.158670+0000","last_undegraded":"2024-09-12T01:07:53.158670+0000","last_fullsized":"2024-09-12T01:07:53.158670+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.158455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.158455+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.158455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.192498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'160","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.400800+0000","last_change":"2024-09-12T01:07:58.400800+0000","last_active":"2024-09-12T01:07:58.400800+0000","last_peered":"2024-09-12T01:07:58.400800+0000","last_clean":"2024-09-12T01:07:58.400800+0000","last_became_active":"2024-09-12T00:21:52.562716+0000","last_became_peered":"2024-09-12T00:21:52.562716+0000","last_unstale":"2024-09-12T01:07:58.400800+0000","last_undegraded":"2024-09-12T01:07:58.400800+0000","last_fullsized":"2024-09-12T01:07:58.400800+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-12T01:07:58.400599+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-12T01:07:58.400599+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.400599+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:15.165779+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":186,"num_write":388,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'137","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.915375+0000","last_change":"2024-09-12T01:07:52.915375+0000","last_active":"2024-09-12T01:07:52.915375+0000","last_peered":"2024-09-12T01:07:52.915375+0000","last_clean":"2024-09-12T01:07:52.915375+0000","last_became_active":"2024-09-12T00:21:44.502832+0000","last_became_peered":"2024-09-12T00:21:44.502832+0000","last_unstale":"2024-09-12T01:07:52.915375+0000","last_undegraded":"2024-09-12T01:07:52.915375+0000","last_fullsized":"2024-09-12T01:07:52.915375+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-12T01:07:52.915187+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-12T01:07:52.915187+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.915187+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:13.701531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":521,"num_write":201,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.580210+0000","last_change":"2024-09-12T01:07:32.580034+0000","last_active":"2024-09-12T01:07:32.580210+0000","last_peered":"2024-09-12T01:07:32.580210+0000","last_clean":"2024-09-12T01:07:32.580210+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T01:07:32.580210+0000","last_undegraded":"2024-09-12T01:07:32.580210+0000","last_fullsized":"2024-09-12T01:07:32.580210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_clean_scrub_stamp":"2024-09-12T01:07:32.579842+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:04.507720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.906029+0000","last_change":"2024-09-12T01:07:35.906029+0000","last_active":"2024-09-12T01:07:35.906029+0000","last_peered":"2024-09-12T01:07:35.906029+0000","last_clean":"2024-09-12T01:07:35.906029+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T01:07:35.906029+0000","last_undegraded":"2024-09-12T01:07:35.906029+0000","last_fullsized":"2024-09-12T01:07:35.906029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:35.905826+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:35.905826+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.905826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:16.286458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'330","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.395101+0000","last_change":"2024-09-12T01:07:34.394877+0000","last_active":"2024-09-12T01:07:34.395101+0000","last_peered":"2024-09-12T01:07:34.395101+0000","last_clean":"2024-09-12T01:07:34.395101+0000","last_became_active":"2024-09-12T00:21:42.513672+0000","last_became_peered":"2024-09-12T00:21:42.513672+0000","last_unstale":"2024-09-12T01:07:34.395101+0000","last_undegraded":"2024-09-12T01:07:34.395101+0000","last_fullsized":"2024-09-12T01:07:34.395101+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.394679+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:03.112904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":4546,"num_write":1074,"num_write_kb":26678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.033296+0000","last_change":"2024-09-12T01:07:53.033296+0000","last_active":"2024-09-12T01:07:53.033296+0000","last_peered":"2024-09-12T01:07:53.033296+0000","last_clean":"2024-09-12T01:07:53.033296+0000","last_became_active":"2024-09-12T00:21:46.506196+0000","last_became_peered":"2024-09-12T00:21:46.506196+0000","last_unstale":"2024-09-12T01:07:53.033296+0000","last_undegraded":"2024-09-12T01:07:53.033296+0000","last_fullsized":"2024-09-12T01:07:53.033296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.033120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.033120+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.033120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:50.956403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'739","reported_seq":1458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.125113+0000","last_change":"2024-09-12T01:08:06.125113+0000","last_active":"2024-09-12T01:08:06.125113+0000","last_peered":"2024-09-12T01:08:06.125113+0000","last_clean":"2024-09-12T01:08:06.125113+0000","last_became_active":"2024-09-12T00:21:48.544327+0000","last_became_peered":"2024-09-12T00:21:48.544327+0000","last_unstale":"2024-09-12T01:08:06.125113+0000","last_undegraded":"2024-09-12T01:08:06.125113+0000","last_fullsized":"2024-09-12T01:08:06.125113+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'739","last_scrub_stamp":"2024-09-12T01:08:06.124915+0000","last_deep_scrub":"267'739","last_deep_scrub_stamp":"2024-09-12T01:08:06.124915+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.124915+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:14.274030+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135809,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1416,"num_read_kb":3269,"num_write":1306,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89362,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.920070+0000","last_change":"2024-09-12T01:08:02.920070+0000","last_active":"2024-09-12T01:08:02.920070+0000","last_peered":"2024-09-12T01:08:02.920070+0000","last_clean":"2024-09-12T01:08:02.920070+0000","last_became_active":"2024-09-12T00:21:50.564442+0000","last_became_peered":"2024-09-12T00:21:50.564442+0000","last_unstale":"2024-09-12T01:08:02.920070+0000","last_undegraded":"2024-09-12T01:08:02.920070+0000","last_fullsized":"2024-09-12T01:08:02.920070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.919883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.919883+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.919883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:43.295107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'208","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.998487+0000","last_change":"2024-09-12T01:07:53.998487+0000","last_active":"2024-09-12T01:07:53.998487+0000","last_peered":"2024-09-12T01:07:53.998487+0000","last_clean":"2024-09-12T01:07:53.998487+0000","last_became_active":"2024-09-12T00:21:52.550903+0000","last_became_peered":"2024-09-12T00:21:52.550903+0000","last_unstale":"2024-09-12T01:07:53.998487+0000","last_undegraded":"2024-09-12T01:07:53.998487+0000","last_fullsized":"2024-09-12T01:07:53.998487+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-12T01:07:53.998298+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-12T01:07:53.998298+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.998298+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:09.883248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":429,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'100","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.989390+0000","last_change":"2024-09-12T01:07:48.989390+0000","last_active":"2024-09-12T01:07:48.989390+0000","last_peered":"2024-09-12T01:07:48.989390+0000","last_clean":"2024-09-12T01:07:48.989390+0000","last_became_active":"2024-09-12T00:21:44.518873+0000","last_became_peered":"2024-09-12T00:21:44.518873+0000","last_unstale":"2024-09-12T01:07:48.989390+0000","last_undegraded":"2024-09-12T01:07:48.989390+0000","last_fullsized":"2024-09-12T01:07:48.989390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-09-12T01:07:48.989211+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-09-12T01:07:48.989211+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.989211+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:37.038222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":399,"num_write":140,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.899210+0000","last_change":"2024-09-12T01:07:33.899120+0000","last_active":"2024-09-12T01:07:33.899210+0000","last_peered":"2024-09-12T01:07:33.899210+0000","last_clean":"2024-09-12T01:07:33.899210+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T01:07:33.899210+0000","last_undegraded":"2024-09-12T01:07:33.899210+0000","last_fullsized":"2024-09-12T01:07:33.899210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.899012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:18.503999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'343","reported_seq":1176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.346185+0000","last_change":"2024-09-12T01:07:35.346185+0000","last_active":"2024-09-12T01:07:35.346185+0000","last_peered":"2024-09-12T01:07:35.346185+0000","last_clean":"2024-09-12T01:07:35.346185+0000","last_became_active":"2024-09-12T00:21:42.530049+0000","last_became_peered":"2024-09-12T00:21:42.530049+0000","last_unstale":"2024-09-12T01:07:35.346185+0000","last_undegraded":"2024-09-12T01:07:35.346185+0000","last_fullsized":"2024-09-12T01:07:35.346185+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T01:07:35.345949+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T01:07:35.345949+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.345949+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.411177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":794,"num_read_kb":7845,"num_write":1116,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.018870+0000","last_change":"2024-09-12T01:08:00.018870+0000","last_active":"2024-09-12T01:08:00.018870+0000","last_peered":"2024-09-12T01:08:00.018870+0000","last_clean":"2024-09-12T01:08:00.018870+0000","last_became_active":"2024-09-12T00:21:46.506303+0000","last_became_peered":"2024-09-12T00:21:46.506303+0000","last_unstale":"2024-09-12T01:08:00.018870+0000","last_undegraded":"2024-09-12T01:08:00.018870+0000","last_fullsized":"2024-09-12T01:08:00.018870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.018690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.018690+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.018690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:02.431074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1273","reported_seq":2766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.281768+0000","last_change":"2024-09-12T01:07:51.281768+0000","last_active":"2024-09-12T01:07:51.281768+0000","last_peered":"2024-09-12T01:07:51.281768+0000","last_clean":"2024-09-12T01:07:51.281768+0000","last_became_active":"2024-09-12T00:21:48.538447+0000","last_became_peered":"2024-09-12T00:21:48.538447+0000","last_unstale":"2024-09-12T01:07:51.281768+0000","last_undegraded":"2024-09-12T01:07:51.281768+0000","last_fullsized":"2024-09-12T01:07:51.281768+0000","mapping_epoch":32,"log_start":"267'1200","ondisk_log_start":"267'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1273","last_scrub_stamp":"2024-09-12T01:07:51.281563+0000","last_deep_scrub":"267'1273","last_deep_scrub_stamp":"2024-09-12T01:07:51.281563+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.281563+0000","objects_scrubbed":12,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.388345+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157796,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2036,"num_read_kb":3848,"num_write":1138,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.186607+0000","last_change":"2024-09-12T01:08:10.186607+0000","last_active":"2024-09-12T01:08:10.186607+0000","last_peered":"2024-09-12T01:08:10.186607+0000","last_clean":"2024-09-12T01:08:10.186607+0000","last_became_active":"2024-09-12T00:21:50.568353+0000","last_became_peered":"2024-09-12T00:21:50.568353+0000","last_unstale":"2024-09-12T01:08:10.186607+0000","last_undegraded":"2024-09-12T01:08:10.186607+0000","last_fullsized":"2024-09-12T01:08:10.186607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.186425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.186425+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.186425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:21.871936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'223","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.863911+0000","last_change":"2024-09-12T01:08:08.863911+0000","last_active":"2024-09-12T01:08:08.863911+0000","last_peered":"2024-09-12T01:08:08.863911+0000","last_clean":"2024-09-12T01:08:08.863911+0000","last_became_active":"2024-09-12T00:21:52.559325+0000","last_became_peered":"2024-09-12T00:21:52.559325+0000","last_unstale":"2024-09-12T01:08:08.863911+0000","last_undegraded":"2024-09-12T01:08:08.863911+0000","last_fullsized":"2024-09-12T01:08:08.863911+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-12T01:08:08.863610+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-12T01:08:08.863610+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.863610+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:28.930627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":373,"num_write":495,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'235","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.322614+0000","last_change":"2024-09-12T01:07:47.322614+0000","last_active":"2024-09-12T01:07:47.322614+0000","last_peered":"2024-09-12T01:07:47.322614+0000","last_clean":"2024-09-12T01:07:47.322614+0000","last_became_active":"2024-09-12T00:21:44.499405+0000","last_became_peered":"2024-09-12T00:21:44.499405+0000","last_unstale":"2024-09-12T01:07:47.322614+0000","last_undegraded":"2024-09-12T01:07:47.322614+0000","last_fullsized":"2024-09-12T01:07:47.322614+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'235","last_scrub_stamp":"2024-09-12T01:07:47.322434+0000","last_deep_scrub":"267'235","last_deep_scrub_stamp":"2024-09-12T01:07:47.322434+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.322434+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:14.108801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":847,"num_write":402,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.153871+0000","last_change":"2024-09-12T01:07:36.153871+0000","last_active":"2024-09-12T01:07:36.153871+0000","last_peered":"2024-09-12T01:07:36.153871+0000","last_clean":"2024-09-12T01:07:36.153871+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T01:07:36.153871+0000","last_undegraded":"2024-09-12T01:07:36.153871+0000","last_fullsized":"2024-09-12T01:07:36.153871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:36.153692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:36.153692+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.153692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:30.299331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'318","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.085677+0000","last_change":"2024-09-12T01:07:36.085507+0000","last_active":"2024-09-12T01:07:36.085677+0000","last_peered":"2024-09-12T01:07:36.085677+0000","last_clean":"2024-09-12T01:07:36.085677+0000","last_became_active":"2024-09-12T00:21:42.533356+0000","last_became_peered":"2024-09-12T00:21:42.533356+0000","last_unstale":"2024-09-12T01:07:36.085677+0000","last_undegraded":"2024-09-12T01:07:36.085677+0000","last_fullsized":"2024-09-12T01:07:36.085677+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'318","last_scrub_stamp":"2024-09-12T01:07:36.085311+0000","last_deep_scrub":"267'318","last_deep_scrub_stamp":"2024-09-12T01:07:36.085311+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.085311+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:29.914431+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":11281,"num_write":971,"num_write_kb":25420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.238554+0000","last_change":"2024-09-12T01:07:47.238554+0000","last_active":"2024-09-12T01:07:47.238554+0000","last_peered":"2024-09-12T01:07:47.238554+0000","last_clean":"2024-09-12T01:07:47.238554+0000","last_became_active":"2024-09-12T00:21:46.510230+0000","last_became_peered":"2024-09-12T00:21:46.510230+0000","last_unstale":"2024-09-12T01:07:47.238554+0000","last_undegraded":"2024-09-12T01:07:47.238554+0000","last_fullsized":"2024-09-12T01:07:47.238554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:47.238372+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:47.238372+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.238372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:41.000780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'245","reported_seq":1351,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.046686+0000","last_change":"2024-09-12T01:07:49.046525+0000","last_active":"2024-09-12T01:07:49.046686+0000","last_peered":"2024-09-12T01:07:49.046686+0000","last_clean":"2024-09-12T01:07:49.046686+0000","last_became_active":"2024-09-12T00:21:48.541987+0000","last_became_peered":"2024-09-12T00:21:48.541987+0000","last_unstale":"2024-09-12T01:07:49.046686+0000","last_undegraded":"2024-09-12T01:07:49.046686+0000","last_fullsized":"2024-09-12T01:07:49.046686+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-12T01:07:49.046303+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-12T01:07:49.046303+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.046303+0000","objects_scrubbed":9,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.771459+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.386867+0000","last_change":"2024-09-12T01:08:05.386867+0000","last_active":"2024-09-12T01:08:05.386867+0000","last_peered":"2024-09-12T01:08:05.386867+0000","last_clean":"2024-09-12T01:08:05.386867+0000","last_became_active":"2024-09-12T00:21:50.549468+0000","last_became_peered":"2024-09-12T00:21:50.549468+0000","last_unstale":"2024-09-12T01:08:05.386867+0000","last_undegraded":"2024-09-12T01:08:05.386867+0000","last_fullsized":"2024-09-12T01:08:05.386867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:05.386687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:05.386687+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.386687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:01.916299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'268","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.536357+0000","last_change":"2024-09-12T01:08:09.536357+0000","last_active":"2024-09-12T01:08:09.536357+0000","last_peered":"2024-09-12T01:08:09.536357+0000","last_clean":"2024-09-12T01:08:09.536357+0000","last_became_active":"2024-09-12T00:21:52.552571+0000","last_became_peered":"2024-09-12T00:21:52.552571+0000","last_unstale":"2024-09-12T01:08:09.536357+0000","last_undegraded":"2024-09-12T01:08:09.536357+0000","last_fullsized":"2024-09-12T01:08:09.536357+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'268","last_scrub_stamp":"2024-09-12T01:08:09.536163+0000","last_deep_scrub":"267'268","last_deep_scrub_stamp":"2024-09-12T01:08:09.536163+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.536163+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.788178+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":539,"num_write":598,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'152","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.362750+0000","last_change":"2024-09-12T01:07:45.362750+0000","last_active":"2024-09-12T01:07:45.362750+0000","last_peered":"2024-09-12T01:07:45.362750+0000","last_clean":"2024-09-12T01:07:45.362750+0000","last_became_active":"2024-09-12T00:21:44.493744+0000","last_became_peered":"2024-09-12T00:21:44.493744+0000","last_unstale":"2024-09-12T01:07:45.362750+0000","last_undegraded":"2024-09-12T01:07:45.362750+0000","last_fullsized":"2024-09-12T01:07:45.362750+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:07:45.362559+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:07:45.362559+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.362559+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:35.283238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":592,"num_write":229,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.900196+0000","last_change":"2024-09-12T01:07:38.900196+0000","last_active":"2024-09-12T01:07:38.900196+0000","last_peered":"2024-09-12T01:07:38.900196+0000","last_clean":"2024-09-12T01:07:38.900196+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T01:07:38.900196+0000","last_undegraded":"2024-09-12T01:07:38.900196+0000","last_fullsized":"2024-09-12T01:07:38.900196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:07:38.899976+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:07:38.899976+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.899976+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.986434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'327","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.015691+0000","last_change":"2024-09-12T01:07:34.015525+0000","last_active":"2024-09-12T01:07:34.015691+0000","last_peered":"2024-09-12T01:07:34.015691+0000","last_clean":"2024-09-12T01:07:34.015691+0000","last_became_active":"2024-09-12T00:21:42.528949+0000","last_became_peered":"2024-09-12T00:21:42.528949+0000","last_unstale":"2024-09-12T01:07:34.015691+0000","last_undegraded":"2024-09-12T01:07:34.015691+0000","last_fullsized":"2024-09-12T01:07:34.015691+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.015318+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.629212+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":67654,"num_write":1033,"num_write_kb":55160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.190802+0000","last_change":"2024-09-12T01:07:46.190671+0000","last_active":"2024-09-12T01:07:46.190802+0000","last_peered":"2024-09-12T01:07:46.190802+0000","last_clean":"2024-09-12T01:07:46.190802+0000","last_became_active":"2024-09-12T00:21:46.517381+0000","last_became_peered":"2024-09-12T00:21:46.517381+0000","last_unstale":"2024-09-12T01:07:46.190802+0000","last_undegraded":"2024-09-12T01:07:46.190802+0000","last_fullsized":"2024-09-12T01:07:46.190802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:46.190493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:46.190493+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.190493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:43.299136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'127","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.023133+0000","last_change":"2024-09-12T01:07:59.023133+0000","last_active":"2024-09-12T01:07:59.023133+0000","last_peered":"2024-09-12T01:07:59.023133+0000","last_clean":"2024-09-12T01:07:59.023133+0000","last_became_active":"2024-09-12T00:21:48.553129+0000","last_became_peered":"2024-09-12T00:21:48.553129+0000","last_unstale":"2024-09-12T01:07:59.023133+0000","last_undegraded":"2024-09-12T01:07:59.023133+0000","last_fullsized":"2024-09-12T01:07:59.023133+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'127","last_scrub_stamp":"2024-09-12T01:07:59.022824+0000","last_deep_scrub":"267'127","last_deep_scrub_stamp":"2024-09-12T01:07:59.022824+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.022824+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:07.237907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.189927+0000","last_change":"2024-09-12T01:08:11.189927+0000","last_active":"2024-09-12T01:08:11.189927+0000","last_peered":"2024-09-12T01:08:11.189927+0000","last_clean":"2024-09-12T01:08:11.189927+0000","last_became_active":"2024-09-12T00:21:50.545037+0000","last_became_peered":"2024-09-12T00:21:50.545037+0000","last_unstale":"2024-09-12T01:08:11.189927+0000","last_undegraded":"2024-09-12T01:08:11.189927+0000","last_fullsized":"2024-09-12T01:08:11.189927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.189752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.189752+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.189752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:17.097362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'99","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.546452+0000","last_change":"2024-09-12T01:08:00.546452+0000","last_active":"2024-09-12T01:08:00.546452+0000","last_peered":"2024-09-12T01:08:00.546452+0000","last_clean":"2024-09-12T01:08:00.546452+0000","last_became_active":"2024-09-12T00:21:52.540900+0000","last_became_peered":"2024-09-12T00:21:52.540900+0000","last_unstale":"2024-09-12T01:08:00.546452+0000","last_undegraded":"2024-09-12T01:08:00.546452+0000","last_fullsized":"2024-09-12T01:08:00.546452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'99","last_scrub_stamp":"2024-09-12T01:08:00.546265+0000","last_deep_scrub":"267'99","last_deep_scrub_stamp":"2024-09-12T01:08:00.546265+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.546265+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:57.513145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":212,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'221","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.354086+0000","last_change":"2024-09-12T01:07:43.354086+0000","last_active":"2024-09-12T01:07:43.354086+0000","last_peered":"2024-09-12T01:07:43.354086+0000","last_clean":"2024-09-12T01:07:43.354086+0000","last_became_active":"2024-09-12T00:21:44.497354+0000","last_became_peered":"2024-09-12T00:21:44.497354+0000","last_unstale":"2024-09-12T01:07:43.354086+0000","last_undegraded":"2024-09-12T01:07:43.354086+0000","last_fullsized":"2024-09-12T01:07:43.354086+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'221","last_scrub_stamp":"2024-09-12T01:07:43.353908+0000","last_deep_scrub":"267'221","last_deep_scrub_stamp":"2024-09-12T01:07:43.353908+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.353908+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.870435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":990,"num_read_kb":806,"num_write":357,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'303","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.246792+0000","last_change":"2024-09-12T01:07:34.246713+0000","last_active":"2024-09-12T01:07:34.246792+0000","last_peered":"2024-09-12T01:07:34.246792+0000","last_clean":"2024-09-12T01:07:34.246792+0000","last_became_active":"2024-09-12T00:21:42.521990+0000","last_became_peered":"2024-09-12T00:21:42.521990+0000","last_unstale":"2024-09-12T01:07:34.246792+0000","last_undegraded":"2024-09-12T01:07:34.246792+0000","last_fullsized":"2024-09-12T01:07:34.246792+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'303","last_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_deep_scrub":"267'303","last_deep_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.246523+0000","objects_scrubbed":10,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.373734+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829291,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":446,"num_read_kb":61837,"num_write":1004,"num_write_kb":29041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.063098+0000","last_change":"2024-09-12T01:07:35.063098+0000","last_active":"2024-09-12T01:07:35.063098+0000","last_peered":"2024-09-12T01:07:35.063098+0000","last_clean":"2024-09-12T01:07:35.063098+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T01:07:35.063098+0000","last_undegraded":"2024-09-12T01:07:35.063098+0000","last_fullsized":"2024-09-12T01:07:35.063098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:35.062821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:35.062821+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.062821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:09.059649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.293267+0000","last_change":"2024-09-12T01:07:52.293267+0000","last_active":"2024-09-12T01:07:52.293267+0000","last_peered":"2024-09-12T01:07:52.293267+0000","last_clean":"2024-09-12T01:07:52.293267+0000","last_became_active":"2024-09-12T00:21:46.498378+0000","last_became_peered":"2024-09-12T00:21:46.498378+0000","last_unstale":"2024-09-12T01:07:52.293267+0000","last_undegraded":"2024-09-12T01:07:52.293267+0000","last_fullsized":"2024-09-12T01:07:52.293267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.293052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.293052+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.293052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:39.789136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'587","reported_seq":1264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.285111+0000","last_change":"2024-09-12T01:07:49.284958+0000","last_active":"2024-09-12T01:07:49.285111+0000","last_peered":"2024-09-12T01:07:49.285111+0000","last_clean":"2024-09-12T01:07:49.285111+0000","last_became_active":"2024-09-12T00:21:48.534749+0000","last_became_peered":"2024-09-12T00:21:48.534749+0000","last_unstale":"2024-09-12T01:07:49.285111+0000","last_undegraded":"2024-09-12T01:07:49.285111+0000","last_fullsized":"2024-09-12T01:07:49.285111+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'587","last_scrub_stamp":"2024-09-12T01:07:49.284741+0000","last_deep_scrub":"267'587","last_deep_scrub_stamp":"2024-09-12T01:07:49.284741+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.284741+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:51.464003+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96095,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1602,"num_read_kb":2762,"num_write":2078,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508332,"num_omap_keys":1154,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.138849+0000","last_change":"2024-09-12T01:07:54.138849+0000","last_active":"2024-09-12T01:07:54.138849+0000","last_peered":"2024-09-12T01:07:54.138849+0000","last_clean":"2024-09-12T01:07:54.138849+0000","last_became_active":"2024-09-12T00:21:50.554728+0000","last_became_peered":"2024-09-12T00:21:50.554728+0000","last_unstale":"2024-09-12T01:07:54.138849+0000","last_undegraded":"2024-09-12T01:07:54.138849+0000","last_fullsized":"2024-09-12T01:07:54.138849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.138667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.138667+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.138667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:32.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'180","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.868317+0000","last_change":"2024-09-12T01:08:10.868317+0000","last_active":"2024-09-12T01:08:10.868317+0000","last_peered":"2024-09-12T01:08:10.868317+0000","last_clean":"2024-09-12T01:08:10.868317+0000","last_became_active":"2024-09-12T00:21:52.558203+0000","last_became_peered":"2024-09-12T00:21:52.558203+0000","last_unstale":"2024-09-12T01:08:10.868317+0000","last_undegraded":"2024-09-12T01:08:10.868317+0000","last_fullsized":"2024-09-12T01:08:10.868317+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-12T01:08:10.868084+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-12T01:08:10.868084+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.868084+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:14.720878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1145,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":410,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'196","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.367538+0000","last_change":"2024-09-12T01:07:50.367538+0000","last_active":"2024-09-12T01:07:50.367538+0000","last_peered":"2024-09-12T01:07:50.367538+0000","last_clean":"2024-09-12T01:07:50.367538+0000","last_became_active":"2024-09-12T00:21:44.497510+0000","last_became_peered":"2024-09-12T00:21:44.497510+0000","last_unstale":"2024-09-12T01:07:50.367538+0000","last_undegraded":"2024-09-12T01:07:50.367538+0000","last_fullsized":"2024-09-12T01:07:50.367538+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T01:07:50.367359+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T01:07:50.367359+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.367359+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:59.657265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":719,"num_write":306,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'327","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.363959+0000","last_change":"2024-09-12T01:07:36.363959+0000","last_active":"2024-09-12T01:07:36.363959+0000","last_peered":"2024-09-12T01:07:36.363959+0000","last_clean":"2024-09-12T01:07:36.363959+0000","last_became_active":"2024-09-12T00:21:42.529084+0000","last_became_peered":"2024-09-12T00:21:42.529084+0000","last_unstale":"2024-09-12T01:07:36.363959+0000","last_undegraded":"2024-09-12T01:07:36.363959+0000","last_fullsized":"2024-09-12T01:07:36.363959+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:36.363681+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:36.363681+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.363681+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:32.434284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":3172,"num_write":1083,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.918656+0000","last_change":"2024-09-12T01:07:37.918656+0000","last_active":"2024-09-12T01:07:37.918656+0000","last_peered":"2024-09-12T01:07:37.918656+0000","last_clean":"2024-09-12T01:07:37.918656+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T01:07:37.918656+0000","last_undegraded":"2024-09-12T01:07:37.918656+0000","last_fullsized":"2024-09-12T01:07:37.918656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:37.918454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:37.918454+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.918454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:38.398571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.053317+0000","last_change":"2024-09-12T01:07:45.053317+0000","last_active":"2024-09-12T01:07:45.053317+0000","last_peered":"2024-09-12T01:07:45.053317+0000","last_clean":"2024-09-12T01:07:45.053317+0000","last_became_active":"2024-09-12T00:21:46.507150+0000","last_became_peered":"2024-09-12T00:21:46.507150+0000","last_unstale":"2024-09-12T01:07:45.053317+0000","last_undegraded":"2024-09-12T01:07:45.053317+0000","last_fullsized":"2024-09-12T01:07:45.053317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:45.053133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:45.053133+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.053133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:32.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'174","reported_seq":747,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.322185+0000","last_change":"2024-09-12T01:07:56.322185+0000","last_active":"2024-09-12T01:07:56.322185+0000","last_peered":"2024-09-12T01:07:56.322185+0000","last_clean":"2024-09-12T01:07:56.322185+0000","last_became_active":"2024-09-12T00:21:48.545244+0000","last_became_peered":"2024-09-12T00:21:48.545244+0000","last_unstale":"2024-09-12T01:07:56.322185+0000","last_undegraded":"2024-09-12T01:07:56.322185+0000","last_fullsized":"2024-09-12T01:07:56.322185+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-12T01:07:56.322006+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-12T01:07:56.322006+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.322006+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.237932+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'771","reported_seq":2810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.556909+0000","last_change":"2024-09-12T01:07:53.556779+0000","last_active":"2024-09-12T01:07:53.556909+0000","last_peered":"2024-09-12T01:07:53.556909+0000","last_clean":"2024-09-12T01:07:53.556909+0000","last_became_active":"2024-09-12T00:21:50.565930+0000","last_became_peered":"2024-09-12T00:21:50.565930+0000","last_unstale":"2024-09-12T01:07:53.556909+0000","last_undegraded":"2024-09-12T01:07:53.556909+0000","last_fullsized":"2024-09-12T01:07:53.556909+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-09-12T01:07:53.556571+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-09-12T01:07:53.556571+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.556571+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:43.011606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'141","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.428366+0000","last_change":"2024-09-12T01:08:00.428366+0000","last_active":"2024-09-12T01:08:00.428366+0000","last_peered":"2024-09-12T01:08:00.428366+0000","last_clean":"2024-09-12T01:08:00.428366+0000","last_became_active":"2024-09-12T00:21:52.562765+0000","last_became_peered":"2024-09-12T00:21:52.562765+0000","last_unstale":"2024-09-12T01:08:00.428366+0000","last_undegraded":"2024-09-12T01:08:00.428366+0000","last_fullsized":"2024-09-12T01:08:00.428366+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T01:08:00.428135+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T01:08:00.428135+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.428135+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:03.503379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":136,"num_write":336,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'107","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.465315+0000","last_change":"2024-09-12T01:07:43.465139+0000","last_active":"2024-09-12T01:07:43.465315+0000","last_peered":"2024-09-12T01:07:43.465315+0000","last_clean":"2024-09-12T01:07:43.465315+0000","last_became_active":"2024-09-12T00:21:44.492443+0000","last_became_peered":"2024-09-12T00:21:44.492443+0000","last_unstale":"2024-09-12T01:07:43.465315+0000","last_undegraded":"2024-09-12T01:07:43.465315+0000","last_fullsized":"2024-09-12T01:07:43.465315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-12T01:07:43.464916+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-12T01:07:43.464916+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.464916+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:25.554086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":379,"num_write":156,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'324","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.352910+0000","last_change":"2024-09-12T01:07:35.352910+0000","last_active":"2024-09-12T01:07:35.352910+0000","last_peered":"2024-09-12T01:07:35.352910+0000","last_clean":"2024-09-12T01:07:35.352910+0000","last_became_active":"2024-09-12T00:21:42.505355+0000","last_became_peered":"2024-09-12T00:21:42.505355+0000","last_unstale":"2024-09-12T01:07:35.352910+0000","last_undegraded":"2024-09-12T01:07:35.352910+0000","last_fullsized":"2024-09-12T01:07:35.352910+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-12T01:07:35.352717+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-12T01:07:35.352717+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.352717+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:26.053174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":8879,"num_write":1116,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.499649+0000","last_change":"2024-09-12T01:07:40.499649+0000","last_active":"2024-09-12T01:07:40.499649+0000","last_peered":"2024-09-12T01:07:40.499649+0000","last_clean":"2024-09-12T01:07:40.499649+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T01:07:40.499649+0000","last_undegraded":"2024-09-12T01:07:40.499649+0000","last_fullsized":"2024-09-12T01:07:40.499649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:40.499465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:40.499465+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.499465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:44.908987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.950731+0000","last_change":"2024-09-12T01:07:57.950731+0000","last_active":"2024-09-12T01:07:57.950731+0000","last_peered":"2024-09-12T01:07:57.950731+0000","last_clean":"2024-09-12T01:07:57.950731+0000","last_became_active":"2024-09-12T00:21:46.506416+0000","last_became_peered":"2024-09-12T00:21:46.506416+0000","last_unstale":"2024-09-12T01:07:57.950731+0000","last_undegraded":"2024-09-12T01:07:57.950731+0000","last_fullsized":"2024-09-12T01:07:57.950731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.950526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.950526+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.950526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:00.170740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'118","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.101180+0000","last_change":"2024-09-12T01:08:05.101180+0000","last_active":"2024-09-12T01:08:05.101180+0000","last_peered":"2024-09-12T01:08:05.101180+0000","last_clean":"2024-09-12T01:08:05.101180+0000","last_became_active":"2024-09-12T00:21:48.541051+0000","last_became_peered":"2024-09-12T00:21:48.541051+0000","last_unstale":"2024-09-12T01:08:05.101180+0000","last_undegraded":"2024-09-12T01:08:05.101180+0000","last_fullsized":"2024-09-12T01:08:05.101180+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:08:05.100985+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:08:05.100985+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.100985+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:34.203891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'782","reported_seq":2265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.971942+0000","last_change":"2024-09-12T01:08:01.971942+0000","last_active":"2024-09-12T01:08:01.971942+0000","last_peered":"2024-09-12T01:08:01.971942+0000","last_clean":"2024-09-12T01:08:01.971942+0000","last_became_active":"2024-09-12T00:21:50.564982+0000","last_became_peered":"2024-09-12T00:21:50.564982+0000","last_unstale":"2024-09-12T01:08:01.971942+0000","last_undegraded":"2024-09-12T01:08:01.971942+0000","last_fullsized":"2024-09-12T01:08:01.971942+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:08:01.971765+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:08:01.971765+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.971765+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:58.526551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'157","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.863907+0000","last_change":"2024-09-12T01:08:09.863907+0000","last_active":"2024-09-12T01:08:09.863907+0000","last_peered":"2024-09-12T01:08:09.863907+0000","last_clean":"2024-09-12T01:08:09.863907+0000","last_became_active":"2024-09-12T00:21:52.555909+0000","last_became_peered":"2024-09-12T00:21:52.555909+0000","last_unstale":"2024-09-12T01:08:09.863907+0000","last_undegraded":"2024-09-12T01:08:09.863907+0000","last_fullsized":"2024-09-12T01:08:09.863907+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T01:08:09.863717+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T01:08:09.863717+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.863717+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.515420+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":331,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'167","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.277506+0000","last_change":"2024-09-12T01:07:40.277506+0000","last_active":"2024-09-12T01:07:40.277506+0000","last_peered":"2024-09-12T01:07:40.277506+0000","last_clean":"2024-09-12T01:07:40.277506+0000","last_became_active":"2024-09-12T00:21:44.494215+0000","last_became_peered":"2024-09-12T00:21:44.494215+0000","last_unstale":"2024-09-12T01:07:40.277506+0000","last_undegraded":"2024-09-12T01:07:40.277506+0000","last_fullsized":"2024-09-12T01:07:40.277506+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T01:07:40.277272+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T01:07:40.277272+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.277272+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:51.529239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":568,"num_write":276,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'381","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.449381+0000","last_change":"2024-09-12T01:07:38.449381+0000","last_active":"2024-09-12T01:07:38.449381+0000","last_peered":"2024-09-12T01:07:38.449381+0000","last_clean":"2024-09-12T01:07:38.449381+0000","last_became_active":"2024-09-12T00:21:42.494486+0000","last_became_peered":"2024-09-12T00:21:42.494486+0000","last_unstale":"2024-09-12T01:07:38.449381+0000","last_undegraded":"2024-09-12T01:07:38.449381+0000","last_fullsized":"2024-09-12T01:07:38.449381+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-09-12T01:07:38.449164+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-09-12T01:07:38.449164+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.449164+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:59.455133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":23252,"num_write":1238,"num_write_kb":41943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.889902+0000","last_change":"2024-09-12T01:07:39.889902+0000","last_active":"2024-09-12T01:07:39.889902+0000","last_peered":"2024-09-12T01:07:39.889902+0000","last_clean":"2024-09-12T01:07:39.889902+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T01:07:39.889902+0000","last_undegraded":"2024-09-12T01:07:39.889902+0000","last_fullsized":"2024-09-12T01:07:39.889902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:39.889727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:39.889727+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.889727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:24.646676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.349435+0000","last_change":"2024-09-12T01:07:50.349312+0000","last_active":"2024-09-12T01:07:50.349435+0000","last_peered":"2024-09-12T01:07:50.349435+0000","last_clean":"2024-09-12T01:07:50.349435+0000","last_became_active":"2024-09-12T00:21:46.490398+0000","last_became_peered":"2024-09-12T00:21:46.490398+0000","last_unstale":"2024-09-12T01:07:50.349435+0000","last_undegraded":"2024-09-12T01:07:50.349435+0000","last_fullsized":"2024-09-12T01:07:50.349435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:50.349131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:50.349131+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.349131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:36.059419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'722","reported_seq":1458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.063819+0000","last_change":"2024-09-12T01:07:51.063819+0000","last_active":"2024-09-12T01:07:51.063819+0000","last_peered":"2024-09-12T01:07:51.063819+0000","last_clean":"2024-09-12T01:07:51.063819+0000","last_became_active":"2024-09-12T00:21:48.543101+0000","last_became_peered":"2024-09-12T00:21:48.543101+0000","last_unstale":"2024-09-12T01:07:51.063819+0000","last_undegraded":"2024-09-12T01:07:51.063819+0000","last_fullsized":"2024-09-12T01:07:51.063819+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'722","last_scrub_stamp":"2024-09-12T01:07:51.063535+0000","last_deep_scrub":"267'722","last_deep_scrub_stamp":"2024-09-12T01:07:51.063535+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.063535+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:28.632717+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1291,"num_read_kb":3081,"num_write":1048,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.352431+0000","last_change":"2024-09-12T01:08:04.352431+0000","last_active":"2024-09-12T01:08:04.352431+0000","last_peered":"2024-09-12T01:08:04.352431+0000","last_clean":"2024-09-12T01:08:04.352431+0000","last_became_active":"2024-09-12T00:21:50.549692+0000","last_became_peered":"2024-09-12T00:21:50.549692+0000","last_unstale":"2024-09-12T01:08:04.352431+0000","last_undegraded":"2024-09-12T01:08:04.352431+0000","last_fullsized":"2024-09-12T01:08:04.352431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:04.352249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:04.352249+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.352249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:46.516170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'109","reported_seq":611,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.222826+0000","last_change":"2024-09-12T01:07:58.222826+0000","last_active":"2024-09-12T01:07:58.222826+0000","last_peered":"2024-09-12T01:07:58.222826+0000","last_clean":"2024-09-12T01:07:58.222826+0000","last_became_active":"2024-09-12T00:21:52.556038+0000","last_became_peered":"2024-09-12T00:21:52.556038+0000","last_unstale":"2024-09-12T01:07:58.222826+0000","last_undegraded":"2024-09-12T01:07:58.222826+0000","last_fullsized":"2024-09-12T01:07:58.222826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'109","last_scrub_stamp":"2024-09-12T01:07:58.222645+0000","last_deep_scrub":"267'109","last_deep_scrub_stamp":"2024-09-12T01:07:58.222645+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.222645+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:57.127050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":258,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'118","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.494571+0000","last_change":"2024-09-12T01:08:10.494571+0000","last_active":"2024-09-12T01:08:10.494571+0000","last_peered":"2024-09-12T01:08:10.494571+0000","last_clean":"2024-09-12T01:08:10.494571+0000","last_became_active":"2024-09-12T00:21:52.537464+0000","last_became_peered":"2024-09-12T00:21:52.537464+0000","last_unstale":"2024-09-12T01:08:10.494571+0000","last_undegraded":"2024-09-12T01:08:10.494571+0000","last_fullsized":"2024-09-12T01:08:10.494571+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:08:10.494381+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:08:10.494381+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.494381+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:39.188930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":226,"num_write":297,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'147","reported_seq":785,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.217289+0000","last_change":"2024-09-12T01:07:45.217289+0000","last_active":"2024-09-12T01:07:45.217289+0000","last_peered":"2024-09-12T01:07:45.217289+0000","last_clean":"2024-09-12T01:07:45.217289+0000","last_became_active":"2024-09-12T00:21:44.494375+0000","last_became_peered":"2024-09-12T00:21:44.494375+0000","last_unstale":"2024-09-12T01:07:45.217289+0000","last_undegraded":"2024-09-12T01:07:45.217289+0000","last_fullsized":"2024-09-12T01:07:45.217289+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-12T01:07:45.217105+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-12T01:07:45.217105+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.217105+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:38.718060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":613,"num_write":235,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'406","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.925561+0000","last_change":"2024-09-12T01:07:40.925561+0000","last_active":"2024-09-12T01:07:40.925561+0000","last_peered":"2024-09-12T01:07:40.925561+0000","last_clean":"2024-09-12T01:07:40.925561+0000","last_became_active":"2024-09-12T00:21:42.495160+0000","last_became_peered":"2024-09-12T00:21:42.495160+0000","last_unstale":"2024-09-12T01:07:40.925561+0000","last_undegraded":"2024-09-12T01:07:40.925561+0000","last_fullsized":"2024-09-12T01:07:40.925561+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'406","last_scrub_stamp":"2024-09-12T01:07:40.925325+0000","last_deep_scrub":"267'406","last_deep_scrub_stamp":"2024-09-12T01:07:40.925325+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.925325+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:38.062084+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":36670,"num_write":1291,"num_write_kb":30706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.354604+0000","last_change":"2024-09-12T01:07:53.354604+0000","last_active":"2024-09-12T01:07:53.354604+0000","last_peered":"2024-09-12T01:07:53.354604+0000","last_clean":"2024-09-12T01:07:53.354604+0000","last_became_active":"2024-09-12T00:21:46.503594+0000","last_became_peered":"2024-09-12T00:21:46.503594+0000","last_unstale":"2024-09-12T01:07:53.354604+0000","last_undegraded":"2024-09-12T01:07:53.354604+0000","last_fullsized":"2024-09-12T01:07:53.354604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.354423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.354423+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.354423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:33.541746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'278","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.317999+0000","last_change":"2024-09-12T01:07:57.317999+0000","last_active":"2024-09-12T01:07:57.317999+0000","last_peered":"2024-09-12T01:07:57.317999+0000","last_clean":"2024-09-12T01:07:57.317999+0000","last_became_active":"2024-09-12T00:21:48.546213+0000","last_became_peered":"2024-09-12T00:21:48.546213+0000","last_unstale":"2024-09-12T01:07:57.317999+0000","last_undegraded":"2024-09-12T01:07:57.317999+0000","last_fullsized":"2024-09-12T01:07:57.317999+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'278","last_scrub_stamp":"2024-09-12T01:07:57.317804+0000","last_deep_scrub":"267'278","last_deep_scrub_stamp":"2024-09-12T01:07:57.317804+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.317804+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.448976+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44075,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":436,"num_read_kb":989,"num_write":348,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.258390+0000","last_change":"2024-09-12T01:07:53.258390+0000","last_active":"2024-09-12T01:07:53.258390+0000","last_peered":"2024-09-12T01:07:53.258390+0000","last_clean":"2024-09-12T01:07:53.258390+0000","last_became_active":"2024-09-12T00:21:50.549135+0000","last_became_peered":"2024-09-12T00:21:50.549135+0000","last_unstale":"2024-09-12T01:07:53.258390+0000","last_undegraded":"2024-09-12T01:07:53.258390+0000","last_fullsized":"2024-09-12T01:07:53.258390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.258184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.258184+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.258184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:36.236772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'127","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.387689+0000","last_change":"2024-09-12T01:07:59.387544+0000","last_active":"2024-09-12T01:07:59.387689+0000","last_peered":"2024-09-12T01:07:59.387689+0000","last_clean":"2024-09-12T01:07:59.387689+0000","last_became_active":"2024-09-12T00:21:52.563303+0000","last_became_peered":"2024-09-12T00:21:52.563303+0000","last_unstale":"2024-09-12T01:07:59.387689+0000","last_undegraded":"2024-09-12T01:07:59.387689+0000","last_fullsized":"2024-09-12T01:07:59.387689+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'127","last_scrub_stamp":"2024-09-12T01:07:59.387345+0000","last_deep_scrub":"267'127","last_deep_scrub_stamp":"2024-09-12T01:07:59.387345+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.387345+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:10.153540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":144,"num_write":323,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'152","reported_seq":751,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.418480+0000","last_change":"2024-09-12T01:07:44.418480+0000","last_active":"2024-09-12T01:07:44.418480+0000","last_peered":"2024-09-12T01:07:44.418480+0000","last_clean":"2024-09-12T01:07:44.418480+0000","last_became_active":"2024-09-12T00:21:44.495299+0000","last_became_peered":"2024-09-12T00:21:44.495299+0000","last_unstale":"2024-09-12T01:07:44.418480+0000","last_undegraded":"2024-09-12T01:07:44.418480+0000","last_fullsized":"2024-09-12T01:07:44.418480+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:07:44.418260+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:07:44.418260+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.418260+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:51.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":653,"num_read_kb":535,"num_write":221,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'287","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.010747+0000","last_change":"2024-09-12T01:07:35.010674+0000","last_active":"2024-09-12T01:07:35.010747+0000","last_peered":"2024-09-12T01:07:35.010747+0000","last_clean":"2024-09-12T01:07:35.010747+0000","last_became_active":"2024-09-12T00:21:42.510774+0000","last_became_peered":"2024-09-12T00:21:42.510774+0000","last_unstale":"2024-09-12T01:07:35.010747+0000","last_undegraded":"2024-09-12T01:07:35.010747+0000","last_fullsized":"2024-09-12T01:07:35.010747+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'287","last_scrub_stamp":"2024-09-12T01:07:35.010519+0000","last_deep_scrub":"267'287","last_deep_scrub_stamp":"2024-09-12T01:07:35.010519+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.010519+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:26.256328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254443,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":10210,"num_write":929,"num_write_kb":22659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.338763+0000","last_change":"2024-09-12T01:07:53.338763+0000","last_active":"2024-09-12T01:07:53.338763+0000","last_peered":"2024-09-12T01:07:53.338763+0000","last_clean":"2024-09-12T01:07:53.338763+0000","last_became_active":"2024-09-12T00:21:46.498536+0000","last_became_peered":"2024-09-12T00:21:46.498536+0000","last_unstale":"2024-09-12T01:07:53.338763+0000","last_undegraded":"2024-09-12T01:07:53.338763+0000","last_fullsized":"2024-09-12T01:07:53.338763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.338543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.338543+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.338543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:08.882729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'45","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.345664+0000","last_change":"2024-09-12T01:07:59.345664+0000","last_active":"2024-09-12T01:07:59.345664+0000","last_peered":"2024-09-12T01:07:59.345664+0000","last_clean":"2024-09-12T01:07:59.345664+0000","last_became_active":"2024-09-12T00:21:48.528299+0000","last_became_peered":"2024-09-12T00:21:48.528299+0000","last_unstale":"2024-09-12T01:07:59.345664+0000","last_undegraded":"2024-09-12T01:07:59.345664+0000","last_fullsized":"2024-09-12T01:07:59.345664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'45","last_scrub_stamp":"2024-09-12T01:07:59.345465+0000","last_deep_scrub":"267'45","last_deep_scrub_stamp":"2024-09-12T01:07:59.345465+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.345465+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:44.745636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.203956+0000","last_change":"2024-09-12T01:07:57.203956+0000","last_active":"2024-09-12T01:07:57.203956+0000","last_peered":"2024-09-12T01:07:57.203956+0000","last_clean":"2024-09-12T01:07:57.203956+0000","last_became_active":"2024-09-12T00:21:50.553714+0000","last_became_peered":"2024-09-12T00:21:50.553714+0000","last_unstale":"2024-09-12T01:07:57.203956+0000","last_undegraded":"2024-09-12T01:07:57.203956+0000","last_fullsized":"2024-09-12T01:07:57.203956+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.203776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.203776+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.203776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:33.243320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'216","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.322496+0000","last_change":"2024-09-12T01:08:07.322496+0000","last_active":"2024-09-12T01:08:07.322496+0000","last_peered":"2024-09-12T01:08:07.322496+0000","last_clean":"2024-09-12T01:08:07.322496+0000","last_became_active":"2024-09-12T00:21:52.556407+0000","last_became_peered":"2024-09-12T00:21:52.556407+0000","last_unstale":"2024-09-12T01:08:07.322496+0000","last_undegraded":"2024-09-12T01:08:07.322496+0000","last_fullsized":"2024-09-12T01:08:07.322496+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'216","last_scrub_stamp":"2024-09-12T01:08:07.322297+0000","last_deep_scrub":"267'216","last_deep_scrub_stamp":"2024-09-12T01:08:07.322297+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.322297+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:05.369131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":286,"num_write":472,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'340","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.437472+0000","last_change":"2024-09-12T01:07:42.437472+0000","last_active":"2024-09-12T01:07:42.437472+0000","last_peered":"2024-09-12T01:07:42.437472+0000","last_clean":"2024-09-12T01:07:42.437472+0000","last_became_active":"2024-09-12T00:21:44.499891+0000","last_became_peered":"2024-09-12T00:21:44.499891+0000","last_unstale":"2024-09-12T01:07:42.437472+0000","last_undegraded":"2024-09-12T01:07:42.437472+0000","last_fullsized":"2024-09-12T01:07:42.437472+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T01:07:42.437296+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T01:07:42.437296+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.437296+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:04.391073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1519,"num_read_kb":1239,"num_write":521,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'307","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.260295+0000","last_change":"2024-09-12T01:07:36.260148+0000","last_active":"2024-09-12T01:07:36.260295+0000","last_peered":"2024-09-12T01:07:36.260295+0000","last_clean":"2024-09-12T01:07:36.260295+0000","last_became_active":"2024-09-12T00:21:42.534537+0000","last_became_peered":"2024-09-12T00:21:42.534537+0000","last_unstale":"2024-09-12T01:07:36.260295+0000","last_undegraded":"2024-09-12T01:07:36.260295+0000","last_fullsized":"2024-09-12T01:07:36.260295+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T01:07:36.259915+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T01:07:36.259915+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.259915+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:37.365491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194356,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":22569,"num_write":963,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.230337+0000","last_change":"2024-09-12T01:07:49.230337+0000","last_active":"2024-09-12T01:07:49.230337+0000","last_peered":"2024-09-12T01:07:49.230337+0000","last_clean":"2024-09-12T01:07:49.230337+0000","last_became_active":"2024-09-12T00:21:46.489054+0000","last_became_peered":"2024-09-12T00:21:46.489054+0000","last_unstale":"2024-09-12T01:07:49.230337+0000","last_undegraded":"2024-09-12T01:07:49.230337+0000","last_fullsized":"2024-09-12T01:07:49.230337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:49.230156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:49.230156+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.230156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.131892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'295","reported_seq":885,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.314143+0000","last_change":"2024-09-12T01:07:54.314143+0000","last_active":"2024-09-12T01:07:54.314143+0000","last_peered":"2024-09-12T01:07:54.314143+0000","last_clean":"2024-09-12T01:07:54.314143+0000","last_became_active":"2024-09-12T00:21:48.549368+0000","last_became_peered":"2024-09-12T00:21:48.549368+0000","last_unstale":"2024-09-12T01:07:54.314143+0000","last_undegraded":"2024-09-12T01:07:54.314143+0000","last_fullsized":"2024-09-12T01:07:54.314143+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-09-12T01:07:54.313950+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-09-12T01:07:54.313950+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.313950+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.040359+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56273,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1054,"num_write":388,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.602572+0000","last_change":"2024-09-12T01:07:57.602572+0000","last_active":"2024-09-12T01:07:57.602572+0000","last_peered":"2024-09-12T01:07:57.602572+0000","last_clean":"2024-09-12T01:07:57.602572+0000","last_became_active":"2024-09-12T00:21:50.565753+0000","last_became_peered":"2024-09-12T00:21:50.565753+0000","last_unstale":"2024-09-12T01:07:57.602572+0000","last_undegraded":"2024-09-12T01:07:57.602572+0000","last_fullsized":"2024-09-12T01:07:57.602572+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.602386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.602386+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.602386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:35.138425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.980755+0000","last_change":"2024-09-12T00:21:52.565618+0000","last_active":"2024-09-12T01:05:39.980755+0000","last_peered":"2024-09-12T01:05:39.980755+0000","last_clean":"2024-09-12T01:05:39.980755+0000","last_became_active":"2024-09-12T00:21:52.559213+0000","last_became_peered":"2024-09-12T00:21:52.559213+0000","last_unstale":"2024-09-12T01:05:39.980755+0000","last_undegraded":"2024-09-12T01:05:39.980755+0000","last_fullsized":"2024-09-12T01:05:39.980755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.549214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":329,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'146","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.111403+0000","last_change":"2024-09-12T01:07:38.111403+0000","last_active":"2024-09-12T01:07:38.111403+0000","last_peered":"2024-09-12T01:07:38.111403+0000","last_clean":"2024-09-12T01:07:38.111403+0000","last_became_active":"2024-09-12T00:21:44.507460+0000","last_became_peered":"2024-09-12T00:21:44.507460+0000","last_unstale":"2024-09-12T01:07:38.111403+0000","last_undegraded":"2024-09-12T01:07:38.111403+0000","last_fullsized":"2024-09-12T01:07:38.111403+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-12T01:07:38.111226+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-12T01:07:38.111226+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.111226+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:36.723181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":507,"num_write":216,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'342","reported_seq":977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.072519+0000","last_change":"2024-09-12T01:07:37.072371+0000","last_active":"2024-09-12T01:07:37.072519+0000","last_peered":"2024-09-12T01:07:37.072519+0000","last_clean":"2024-09-12T01:07:37.072519+0000","last_became_active":"2024-09-12T00:21:42.517333+0000","last_became_peered":"2024-09-12T00:21:42.517333+0000","last_unstale":"2024-09-12T01:07:37.072519+0000","last_undegraded":"2024-09-12T01:07:37.072519+0000","last_fullsized":"2024-09-12T01:07:37.072519+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-09-12T01:07:37.072146+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-09-12T01:07:37.072146+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.072146+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.002439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":50264,"num_write":1046,"num_write_kb":41560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.002747+0000","last_change":"2024-09-12T01:08:02.002747+0000","last_active":"2024-09-12T01:08:02.002747+0000","last_peered":"2024-09-12T01:08:02.002747+0000","last_clean":"2024-09-12T01:08:02.002747+0000","last_became_active":"2024-09-12T00:21:46.501673+0000","last_became_peered":"2024-09-12T00:21:46.501673+0000","last_unstale":"2024-09-12T01:08:02.002747+0000","last_undegraded":"2024-09-12T01:08:02.002747+0000","last_fullsized":"2024-09-12T01:08:02.002747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.002548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.002548+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.002548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:33.590646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'276","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.086938+0000","last_change":"2024-09-12T01:07:46.086938+0000","last_active":"2024-09-12T01:07:46.086938+0000","last_peered":"2024-09-12T01:07:46.086938+0000","last_clean":"2024-09-12T01:07:46.086938+0000","last_became_active":"2024-09-12T00:21:48.537864+0000","last_became_peered":"2024-09-12T00:21:48.537864+0000","last_unstale":"2024-09-12T01:07:46.086938+0000","last_undegraded":"2024-09-12T01:07:46.086938+0000","last_fullsized":"2024-09-12T01:07:46.086938+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'276","last_scrub_stamp":"2024-09-12T01:07:46.086739+0000","last_deep_scrub":"267'276","last_deep_scrub_stamp":"2024-09-12T01:07:46.086739+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.086739+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:32.656541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47500,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1067,"num_write":372,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.377401+0000","last_change":"2024-09-12T01:07:56.377401+0000","last_active":"2024-09-12T01:07:56.377401+0000","last_peered":"2024-09-12T01:07:56.377401+0000","last_clean":"2024-09-12T01:07:56.377401+0000","last_became_active":"2024-09-12T00:21:50.560805+0000","last_became_peered":"2024-09-12T00:21:50.560805+0000","last_unstale":"2024-09-12T01:07:56.377401+0000","last_undegraded":"2024-09-12T01:07:56.377401+0000","last_fullsized":"2024-09-12T01:07:56.377401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:56.377217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:56.377217+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.377217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.557232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'385","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.945989+0000","last_change":"2024-09-12T01:07:47.945989+0000","last_active":"2024-09-12T01:07:47.945989+0000","last_peered":"2024-09-12T01:07:47.945989+0000","last_clean":"2024-09-12T01:07:47.945989+0000","last_became_active":"2024-09-12T00:21:44.516321+0000","last_became_peered":"2024-09-12T00:21:44.516321+0000","last_unstale":"2024-09-12T01:07:47.945989+0000","last_undegraded":"2024-09-12T01:07:47.945989+0000","last_fullsized":"2024-09-12T01:07:47.945989+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-12T01:07:47.945804+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-12T01:07:47.945804+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.945804+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:05.496224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1787,"num_read_kb":1547,"num_write":658,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'343","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.099435+0000","last_change":"2024-09-12T01:07:38.099297+0000","last_active":"2024-09-12T01:07:38.099435+0000","last_peered":"2024-09-12T01:07:38.099435+0000","last_clean":"2024-09-12T01:07:38.099435+0000","last_became_active":"2024-09-12T00:22:13.519954+0000","last_became_peered":"2024-09-12T00:22:13.519954+0000","last_unstale":"2024-09-12T01:07:38.099435+0000","last_undegraded":"2024-09-12T01:07:38.099435+0000","last_fullsized":"2024-09-12T01:07:38.099435+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T01:07:38.099074+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T01:07:38.099074+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.099074+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:06.565768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":32939,"num_write":1107,"num_write_kb":17030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.347661+0000","last_change":"2024-09-12T01:07:54.347535+0000","last_active":"2024-09-12T01:07:54.347661+0000","last_peered":"2024-09-12T01:07:54.347661+0000","last_clean":"2024-09-12T01:07:54.347661+0000","last_became_active":"2024-09-12T00:21:46.503646+0000","last_became_peered":"2024-09-12T00:21:46.503646+0000","last_unstale":"2024-09-12T01:07:54.347661+0000","last_undegraded":"2024-09-12T01:07:54.347661+0000","last_fullsized":"2024-09-12T01:07:54.347661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.347353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.347353+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.347353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:41.432753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'529","reported_seq":1168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.339301+0000","last_change":"2024-09-12T01:07:59.339301+0000","last_active":"2024-09-12T01:07:59.339301+0000","last_peered":"2024-09-12T01:07:59.339301+0000","last_clean":"2024-09-12T01:07:59.339301+0000","last_became_active":"2024-09-12T00:21:48.547827+0000","last_became_peered":"2024-09-12T00:21:48.547827+0000","last_unstale":"2024-09-12T01:07:59.339301+0000","last_undegraded":"2024-09-12T01:07:59.339301+0000","last_fullsized":"2024-09-12T01:07:59.339301+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'529","last_scrub_stamp":"2024-09-12T01:07:59.339057+0000","last_deep_scrub":"267'529","last_deep_scrub_stamp":"2024-09-12T01:07:59.339057+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.339057+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.011858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106077,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":956,"num_read_kb":2347,"num_write":834,"num_write_kb":757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.185016+0000","last_change":"2024-09-12T01:07:55.185016+0000","last_active":"2024-09-12T01:07:55.185016+0000","last_peered":"2024-09-12T01:07:55.185016+0000","last_clean":"2024-09-12T01:07:55.185016+0000","last_became_active":"2024-09-12T00:21:50.554194+0000","last_became_peered":"2024-09-12T00:21:50.554194+0000","last_unstale":"2024-09-12T01:07:55.185016+0000","last_undegraded":"2024-09-12T01:07:55.185016+0000","last_fullsized":"2024-09-12T01:07:55.185016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.184730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.184730+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.184730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:12.121843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'160","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.874534+0000","last_change":"2024-09-12T01:08:11.874534+0000","last_active":"2024-09-12T01:08:11.874534+0000","last_peered":"2024-09-12T01:08:11.874534+0000","last_clean":"2024-09-12T01:08:11.874534+0000","last_became_active":"2024-09-12T00:21:52.558070+0000","last_became_peered":"2024-09-12T00:21:52.558070+0000","last_unstale":"2024-09-12T01:08:11.874534+0000","last_undegraded":"2024-09-12T01:08:11.874534+0000","last_fullsized":"2024-09-12T01:08:11.874534+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-12T01:08:11.874343+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-12T01:08:11.874343+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.874343+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:24.477496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":234,"num_write":361,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'83","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.370404+0000","last_change":"2024-09-12T01:07:46.370250+0000","last_active":"2024-09-12T01:07:46.370404+0000","last_peered":"2024-09-12T01:07:46.370404+0000","last_clean":"2024-09-12T01:07:46.370404+0000","last_became_active":"2024-09-12T00:21:44.501836+0000","last_became_peered":"2024-09-12T00:21:44.501836+0000","last_unstale":"2024-09-12T01:07:46.370404+0000","last_undegraded":"2024-09-12T01:07:46.370404+0000","last_fullsized":"2024-09-12T01:07:46.370404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'83","last_scrub_stamp":"2024-09-12T01:07:46.370079+0000","last_deep_scrub":"267'83","last_deep_scrub_stamp":"2024-09-12T01:07:46.370079+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.370079+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:28.842724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":399,"num_read_kb":345,"num_write":130,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'311","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.400773+0000","last_change":"2024-09-12T01:07:37.400631+0000","last_active":"2024-09-12T01:07:37.400773+0000","last_peered":"2024-09-12T01:07:37.400773+0000","last_clean":"2024-09-12T01:07:37.400773+0000","last_became_active":"2024-09-12T00:21:42.496837+0000","last_became_peered":"2024-09-12T00:21:42.496837+0000","last_unstale":"2024-09-12T01:07:37.400773+0000","last_undegraded":"2024-09-12T01:07:37.400773+0000","last_fullsized":"2024-09-12T01:07:37.400773+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:07:37.400384+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:07:37.400384+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.400384+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:35.621576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":560106,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":359,"num_read_kb":1485,"num_write":897,"num_write_kb":29678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.182093+0000","last_change":"2024-09-12T01:07:50.182093+0000","last_active":"2024-09-12T01:07:50.182093+0000","last_peered":"2024-09-12T01:07:50.182093+0000","last_clean":"2024-09-12T01:07:50.182093+0000","last_became_active":"2024-09-12T00:21:46.498517+0000","last_became_peered":"2024-09-12T00:21:46.498517+0000","last_unstale":"2024-09-12T01:07:50.182093+0000","last_undegraded":"2024-09-12T01:07:50.182093+0000","last_fullsized":"2024-09-12T01:07:50.182093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:50.181910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:50.181910+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.181910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:16.300016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'308","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.191292+0000","last_change":"2024-09-12T01:08:08.191292+0000","last_active":"2024-09-12T01:08:08.191292+0000","last_peered":"2024-09-12T01:08:08.191292+0000","last_clean":"2024-09-12T01:08:08.191292+0000","last_became_active":"2024-09-12T00:21:48.539419+0000","last_became_peered":"2024-09-12T00:21:48.539419+0000","last_unstale":"2024-09-12T01:08:08.191292+0000","last_undegraded":"2024-09-12T01:08:08.191292+0000","last_fullsized":"2024-09-12T01:08:08.191292+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-12T01:08:08.191085+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-12T01:08:08.191085+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.191085+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:36.401332+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":1160,"num_write":428,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.912149+0000","last_change":"2024-09-12T01:08:06.912149+0000","last_active":"2024-09-12T01:08:06.912149+0000","last_peered":"2024-09-12T01:08:06.912149+0000","last_clean":"2024-09-12T01:08:06.912149+0000","last_became_active":"2024-09-12T00:21:50.564610+0000","last_became_peered":"2024-09-12T00:21:50.564610+0000","last_unstale":"2024-09-12T01:08:06.912149+0000","last_undegraded":"2024-09-12T01:08:06.912149+0000","last_fullsized":"2024-09-12T01:08:06.912149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.911970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.911970+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.911970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:12.050463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'152","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.192650+0000","last_change":"2024-09-12T00:21:52.560731+0000","last_active":"2024-09-12T01:05:01.192650+0000","last_peered":"2024-09-12T01:05:01.192650+0000","last_clean":"2024-09-12T01:05:01.192650+0000","last_became_active":"2024-09-12T00:21:52.559989+0000","last_became_peered":"2024-09-12T00:21:52.559989+0000","last_unstale":"2024-09-12T01:05:01.192650+0000","last_undegraded":"2024-09-12T01:05:01.192650+0000","last_fullsized":"2024-09-12T01:05:01.192650+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.302197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":167,"num_write":448,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'181","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.087272+0000","last_change":"2024-09-12T01:07:42.087272+0000","last_active":"2024-09-12T01:07:42.087272+0000","last_peered":"2024-09-12T01:07:42.087272+0000","last_clean":"2024-09-12T01:07:42.087272+0000","last_became_active":"2024-09-12T00:21:44.515059+0000","last_became_peered":"2024-09-12T00:21:44.515059+0000","last_unstale":"2024-09-12T01:07:42.087272+0000","last_undegraded":"2024-09-12T01:07:42.087272+0000","last_fullsized":"2024-09-12T01:07:42.087272+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T01:07:42.087093+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T01:07:42.087093+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.087093+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:57.089560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":674,"num_write":306,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'322","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.658246+0000","last_change":"2024-09-12T01:07:35.658246+0000","last_active":"2024-09-12T01:07:35.658246+0000","last_peered":"2024-09-12T01:07:35.658246+0000","last_clean":"2024-09-12T01:07:35.658246+0000","last_became_active":"2024-09-12T00:21:42.527838+0000","last_became_peered":"2024-09-12T00:21:42.527838+0000","last_unstale":"2024-09-12T01:07:35.658246+0000","last_undegraded":"2024-09-12T01:07:35.658246+0000","last_fullsized":"2024-09-12T01:07:35.658246+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'322","last_scrub_stamp":"2024-09-12T01:07:35.657997+0000","last_deep_scrub":"267'322","last_deep_scrub_stamp":"2024-09-12T01:07:35.657997+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.657997+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.365955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373192,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":57949,"num_write":1020,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.190368+0000","last_change":"2024-09-12T01:07:48.190368+0000","last_active":"2024-09-12T01:07:48.190368+0000","last_peered":"2024-09-12T01:07:48.190368+0000","last_clean":"2024-09-12T01:07:48.190368+0000","last_became_active":"2024-09-12T00:21:46.486768+0000","last_became_peered":"2024-09-12T00:21:46.486768+0000","last_unstale":"2024-09-12T01:07:48.190368+0000","last_undegraded":"2024-09-12T01:07:48.190368+0000","last_fullsized":"2024-09-12T01:07:48.190368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.190178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.190178+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.190178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.612879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'297","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.307932+0000","last_change":"2024-09-12T01:08:00.307932+0000","last_active":"2024-09-12T01:08:00.307932+0000","last_peered":"2024-09-12T01:08:00.307932+0000","last_clean":"2024-09-12T01:08:00.307932+0000","last_became_active":"2024-09-12T00:21:48.545589+0000","last_became_peered":"2024-09-12T00:21:48.545589+0000","last_unstale":"2024-09-12T01:08:00.307932+0000","last_undegraded":"2024-09-12T01:08:00.307932+0000","last_fullsized":"2024-09-12T01:08:00.307932+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'297","last_scrub_stamp":"2024-09-12T01:08:00.307740+0000","last_deep_scrub":"267'297","last_deep_scrub_stamp":"2024-09-12T01:08:00.307740+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.307740+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:22.754366+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":1095,"num_write":398,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.342253+0000","last_change":"2024-09-12T01:07:55.342033+0000","last_active":"2024-09-12T01:07:55.342253+0000","last_peered":"2024-09-12T01:07:55.342253+0000","last_clean":"2024-09-12T01:07:55.342253+0000","last_became_active":"2024-09-12T00:21:50.556333+0000","last_became_peered":"2024-09-12T00:21:50.556333+0000","last_unstale":"2024-09-12T01:07:55.342253+0000","last_undegraded":"2024-09-12T01:07:55.342253+0000","last_fullsized":"2024-09-12T01:07:55.342253+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.341833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.341833+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.341833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:33.231708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'209","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.216663+0000","last_change":"2024-09-12T01:08:12.216663+0000","last_active":"2024-09-12T01:08:12.216663+0000","last_peered":"2024-09-12T01:08:12.216663+0000","last_clean":"2024-09-12T01:08:12.216663+0000","last_became_active":"2024-09-12T00:21:52.565109+0000","last_became_peered":"2024-09-12T00:21:52.565109+0000","last_unstale":"2024-09-12T01:08:12.216663+0000","last_undegraded":"2024-09-12T01:08:12.216663+0000","last_fullsized":"2024-09-12T01:08:12.216663+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'209","last_scrub_stamp":"2024-09-12T01:08:12.216444+0000","last_deep_scrub":"267'209","last_deep_scrub_stamp":"2024-09-12T01:08:12.216444+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.216444+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:09.495538+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'131","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.419785+0000","last_change":"2024-09-12T01:07:45.419785+0000","last_active":"2024-09-12T01:07:45.419785+0000","last_peered":"2024-09-12T01:07:45.419785+0000","last_clean":"2024-09-12T01:07:45.419785+0000","last_became_active":"2024-09-12T00:21:44.488546+0000","last_became_peered":"2024-09-12T00:21:44.488546+0000","last_unstale":"2024-09-12T01:07:45.419785+0000","last_undegraded":"2024-09-12T01:07:45.419785+0000","last_fullsized":"2024-09-12T01:07:45.419785+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:07:45.419606+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:07:45.419606+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.419606+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:27.301674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":436,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'359","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.479909+0000","last_change":"2024-09-12T01:07:39.479909+0000","last_active":"2024-09-12T01:07:39.479909+0000","last_peered":"2024-09-12T01:07:39.479909+0000","last_clean":"2024-09-12T01:07:39.479909+0000","last_became_active":"2024-09-12T00:21:42.513837+0000","last_became_peered":"2024-09-12T00:21:42.513837+0000","last_unstale":"2024-09-12T01:07:39.479909+0000","last_undegraded":"2024-09-12T01:07:39.479909+0000","last_fullsized":"2024-09-12T01:07:39.479909+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'359","last_scrub_stamp":"2024-09-12T01:07:39.479604+0000","last_deep_scrub":"267'359","last_deep_scrub_stamp":"2024-09-12T01:07:39.479604+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.479604+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:45.652858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":19207,"num_write":1040,"num_write_kb":45165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.320491+0000","last_change":"2024-09-12T01:08:00.320491+0000","last_active":"2024-09-12T01:08:00.320491+0000","last_peered":"2024-09-12T01:08:00.320491+0000","last_clean":"2024-09-12T01:08:00.320491+0000","last_became_active":"2024-09-12T00:21:46.492502+0000","last_became_peered":"2024-09-12T00:21:46.492502+0000","last_unstale":"2024-09-12T01:08:00.320491+0000","last_undegraded":"2024-09-12T01:08:00.320491+0000","last_fullsized":"2024-09-12T01:08:00.320491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.320300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.320300+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.320300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:45.924340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'96","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:07.334529+0000","last_change":"2024-09-12T00:21:48.548949+0000","last_active":"2024-09-12T01:06:07.334529+0000","last_peered":"2024-09-12T01:06:07.334529+0000","last_clean":"2024-09-12T01:06:07.334529+0000","last_became_active":"2024-09-12T00:21:48.544915+0000","last_became_peered":"2024-09-12T00:21:48.544915+0000","last_unstale":"2024-09-12T01:06:07.334529+0000","last_undegraded":"2024-09-12T01:06:07.334529+0000","last_fullsized":"2024-09-12T01:06:07.334529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:47.492929+0000","last_clean_scrub_stamp":"2024-09-12T00:21:47.492929+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":128,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'782","reported_seq":2233,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.970293+0000","last_change":"2024-09-12T01:07:54.970293+0000","last_active":"2024-09-12T01:07:54.970293+0000","last_peered":"2024-09-12T01:07:54.970293+0000","last_clean":"2024-09-12T01:07:54.970293+0000","last_became_active":"2024-09-12T00:21:50.549552+0000","last_became_peered":"2024-09-12T00:21:50.549552+0000","last_unstale":"2024-09-12T01:07:54.970293+0000","last_undegraded":"2024-09-12T01:07:54.970293+0000","last_fullsized":"2024-09-12T01:07:54.970293+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:07:54.970110+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:07:54.970110+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.970110+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:45.495935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'170","reported_seq":686,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.303926+0000","last_change":"2024-09-12T00:21:52.566510+0000","last_active":"2024-09-12T01:05:46.303926+0000","last_peered":"2024-09-12T01:05:46.303926+0000","last_clean":"2024-09-12T01:05:46.303926+0000","last_became_active":"2024-09-12T00:21:52.565872+0000","last_became_peered":"2024-09-12T00:21:52.565872+0000","last_unstale":"2024-09-12T01:05:46.303926+0000","last_undegraded":"2024-09-12T01:05:46.303926+0000","last_fullsized":"2024-09-12T01:05:46.303926+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:54.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":199,"num_write":407,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'4285","reported_seq":4948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.202447+0000","last_change":"2024-09-12T01:07:47.202447+0000","last_active":"2024-09-12T01:07:47.202447+0000","last_peered":"2024-09-12T01:07:47.202447+0000","last_clean":"2024-09-12T01:07:47.202447+0000","last_became_active":"2024-09-12T00:21:44.521310+0000","last_became_peered":"2024-09-12T00:21:44.521310+0000","last_unstale":"2024-09-12T01:07:47.202447+0000","last_undegraded":"2024-09-12T01:07:47.202447+0000","last_fullsized":"2024-09-12T01:07:47.202447+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4285","last_scrub_stamp":"2024-09-12T01:07:47.202270+0000","last_deep_scrub":"267'4285","last_deep_scrub_stamp":"2024-09-12T01:07:47.202270+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.202270+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:42.173767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17290,"num_read_kb":14479,"num_write":6455,"num_write_kb":3215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'412","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.695539+0000","last_change":"2024-09-12T01:07:37.695539+0000","last_active":"2024-09-12T01:07:37.695539+0000","last_peered":"2024-09-12T01:07:37.695539+0000","last_clean":"2024-09-12T01:07:37.695539+0000","last_became_active":"2024-09-12T00:21:42.507712+0000","last_became_peered":"2024-09-12T00:21:42.507712+0000","last_unstale":"2024-09-12T01:07:37.695539+0000","last_undegraded":"2024-09-12T01:07:37.695539+0000","last_fullsized":"2024-09-12T01:07:37.695539+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-09-12T01:07:37.695311+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-09-12T01:07:37.695311+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.695311+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:19.588168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992333,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":35222,"num_write":1344,"num_write_kb":36033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.578853+0000","last_change":"2024-09-12T01:07:52.578853+0000","last_active":"2024-09-12T01:07:52.578853+0000","last_peered":"2024-09-12T01:07:52.578853+0000","last_clean":"2024-09-12T01:07:52.578853+0000","last_became_active":"2024-09-12T00:21:46.514146+0000","last_became_peered":"2024-09-12T00:21:46.514146+0000","last_unstale":"2024-09-12T01:07:52.578853+0000","last_undegraded":"2024-09-12T01:07:52.578853+0000","last_fullsized":"2024-09-12T01:07:52.578853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.578598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.578598+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.578598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:11.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'341","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.052832+0000","last_change":"2024-09-12T01:07:52.052641+0000","last_active":"2024-09-12T01:07:52.052832+0000","last_peered":"2024-09-12T01:07:52.052832+0000","last_clean":"2024-09-12T01:07:52.052832+0000","last_became_active":"2024-09-12T00:21:48.543993+0000","last_became_peered":"2024-09-12T00:21:48.543993+0000","last_unstale":"2024-09-12T01:07:52.052832+0000","last_undegraded":"2024-09-12T01:07:52.052832+0000","last_fullsized":"2024-09-12T01:07:52.052832+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:52.052427+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:52.052427+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.052427+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:19.461377+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50118,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1190,"num_write":440,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.460820+0000","last_change":"2024-09-12T01:08:07.460820+0000","last_active":"2024-09-12T01:08:07.460820+0000","last_peered":"2024-09-12T01:08:07.460820+0000","last_clean":"2024-09-12T01:08:07.460820+0000","last_became_active":"2024-09-12T00:21:50.525885+0000","last_became_peered":"2024-09-12T00:21:50.525885+0000","last_unstale":"2024-09-12T01:08:07.460820+0000","last_undegraded":"2024-09-12T01:08:07.460820+0000","last_fullsized":"2024-09-12T01:08:07.460820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:07.460643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:07.460643+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.460643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:57.948172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'117","reported_seq":627,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.548906+0000","last_change":"2024-09-12T01:08:01.548906+0000","last_active":"2024-09-12T01:08:01.548906+0000","last_peered":"2024-09-12T01:08:01.548906+0000","last_clean":"2024-09-12T01:08:01.548906+0000","last_became_active":"2024-09-12T00:21:52.559361+0000","last_became_peered":"2024-09-12T00:21:52.559361+0000","last_unstale":"2024-09-12T01:08:01.548906+0000","last_undegraded":"2024-09-12T01:08:01.548906+0000","last_fullsized":"2024-09-12T01:08:01.548906+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:08:01.548731+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:08:01.548731+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.548731+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:50.829398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":266,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'251","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.238428+0000","last_change":"2024-09-12T01:07:44.238428+0000","last_active":"2024-09-12T01:07:44.238428+0000","last_peered":"2024-09-12T01:07:44.238428+0000","last_clean":"2024-09-12T01:07:44.238428+0000","last_became_active":"2024-09-12T00:21:44.486014+0000","last_became_peered":"2024-09-12T00:21:44.486014+0000","last_unstale":"2024-09-12T01:07:44.238428+0000","last_undegraded":"2024-09-12T01:07:44.238428+0000","last_fullsized":"2024-09-12T01:07:44.238428+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-12T01:07:44.238257+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-12T01:07:44.238257+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.238257+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:57.856443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1098,"num_read_kb":899,"num_write":369,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'313","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.889993+0000","last_change":"2024-09-12T01:07:43.889993+0000","last_active":"2024-09-12T01:07:43.889993+0000","last_peered":"2024-09-12T01:07:43.889993+0000","last_clean":"2024-09-12T01:07:43.889993+0000","last_became_active":"2024-09-12T00:21:42.491757+0000","last_became_peered":"2024-09-12T00:21:42.491757+0000","last_unstale":"2024-09-12T01:07:43.889993+0000","last_undegraded":"2024-09-12T01:07:43.889993+0000","last_fullsized":"2024-09-12T01:07:43.889993+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'313","last_scrub_stamp":"2024-09-12T01:07:43.889701+0000","last_deep_scrub":"267'313","last_deep_scrub_stamp":"2024-09-12T01:07:43.889701+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.889701+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:25.943315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":76220,"num_write":1035,"num_write_kb":46746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.158201+0000","last_change":"2024-09-12T01:07:51.158201+0000","last_active":"2024-09-12T01:07:51.158201+0000","last_peered":"2024-09-12T01:07:51.158201+0000","last_clean":"2024-09-12T01:07:51.158201+0000","last_became_active":"2024-09-12T00:21:46.503203+0000","last_became_peered":"2024-09-12T00:21:46.503203+0000","last_unstale":"2024-09-12T01:07:51.158201+0000","last_undegraded":"2024-09-12T01:07:51.158201+0000","last_fullsized":"2024-09-12T01:07:51.158201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:51.158024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:51.158024+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.158024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:20.104900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'289","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.376521+0000","last_change":"2024-09-12T01:08:03.376521+0000","last_active":"2024-09-12T01:08:03.376521+0000","last_peered":"2024-09-12T01:08:03.376521+0000","last_clean":"2024-09-12T01:08:03.376521+0000","last_became_active":"2024-09-12T00:21:48.536841+0000","last_became_peered":"2024-09-12T00:21:48.536841+0000","last_unstale":"2024-09-12T01:08:03.376521+0000","last_undegraded":"2024-09-12T01:08:03.376521+0000","last_fullsized":"2024-09-12T01:08:03.376521+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'289","last_scrub_stamp":"2024-09-12T01:08:03.376310+0000","last_deep_scrub":"267'289","last_deep_scrub_stamp":"2024-09-12T01:08:03.376310+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.376310+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:32.833802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48050,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1127,"num_write":390,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.646139+0000","last_change":"2024-09-12T00:21:50.541922+0000","last_active":"2024-09-12T01:05:34.646139+0000","last_peered":"2024-09-12T01:05:34.646139+0000","last_clean":"2024-09-12T01:05:34.646139+0000","last_became_active":"2024-09-12T00:21:50.538041+0000","last_became_peered":"2024-09-12T00:21:50.538041+0000","last_unstale":"2024-09-12T01:05:34.646139+0000","last_undegraded":"2024-09-12T01:05:34.646139+0000","last_fullsized":"2024-09-12T01:05:34.646139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:49.506968+0000","last_clean_scrub_stamp":"2024-09-12T00:21:49.506968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'126","reported_seq":647,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.817259+0000","last_change":"2024-09-12T01:08:13.817259+0000","last_active":"2024-09-12T01:08:13.817259+0000","last_peered":"2024-09-12T01:08:13.817259+0000","last_clean":"2024-09-12T01:08:13.817259+0000","last_became_active":"2024-09-12T00:21:52.560366+0000","last_became_peered":"2024-09-12T00:21:52.560366+0000","last_unstale":"2024-09-12T01:08:13.817259+0000","last_undegraded":"2024-09-12T01:08:13.817259+0000","last_fullsized":"2024-09-12T01:08:13.817259+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-09-12T01:08:13.817076+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-09-12T01:08:13.817076+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.817076+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:14.120841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":163,"num_read_kb":157,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'212","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.109280+0000","last_change":"2024-09-12T01:07:41.109151+0000","last_active":"2024-09-12T01:07:41.109280+0000","last_peered":"2024-09-12T01:07:41.109280+0000","last_clean":"2024-09-12T01:07:41.109280+0000","last_became_active":"2024-09-12T00:21:44.512917+0000","last_became_peered":"2024-09-12T00:21:44.512917+0000","last_unstale":"2024-09-12T01:07:41.109280+0000","last_undegraded":"2024-09-12T01:07:41.109280+0000","last_fullsized":"2024-09-12T01:07:41.109280+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-12T01:07:41.108966+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-12T01:07:41.108966+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.108966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:25.227949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":716,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'387","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.063601+0000","last_change":"2024-09-12T01:07:39.063458+0000","last_active":"2024-09-12T01:07:39.063601+0000","last_peered":"2024-09-12T01:07:39.063601+0000","last_clean":"2024-09-12T01:07:39.063601+0000","last_became_active":"2024-09-12T00:21:42.516419+0000","last_became_peered":"2024-09-12T00:21:42.516419+0000","last_unstale":"2024-09-12T01:07:39.063601+0000","last_undegraded":"2024-09-12T01:07:39.063601+0000","last_fullsized":"2024-09-12T01:07:39.063601+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-09-12T01:07:39.063230+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-09-12T01:07:39.063230+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.063230+0000","objects_scrubbed":10,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:19.966999+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1662646,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":630,"num_read_kb":12934,"num_write":1264,"num_write_kb":32784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.641054+0000","last_change":"2024-09-12T01:07:49.641054+0000","last_active":"2024-09-12T01:07:49.641054+0000","last_peered":"2024-09-12T01:07:49.641054+0000","last_clean":"2024-09-12T01:07:49.641054+0000","last_became_active":"2024-09-12T00:21:46.503747+0000","last_became_peered":"2024-09-12T00:21:46.503747+0000","last_unstale":"2024-09-12T01:07:49.641054+0000","last_undegraded":"2024-09-12T01:07:49.641054+0000","last_fullsized":"2024-09-12T01:07:49.641054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:49.640866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:49.640866+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.640866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:15.512638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'247","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.294797+0000","last_change":"2024-09-12T01:07:58.294797+0000","last_active":"2024-09-12T01:07:58.294797+0000","last_peered":"2024-09-12T01:07:58.294797+0000","last_clean":"2024-09-12T01:07:58.294797+0000","last_became_active":"2024-09-12T00:21:48.546392+0000","last_became_peered":"2024-09-12T00:21:48.546392+0000","last_unstale":"2024-09-12T01:07:58.294797+0000","last_undegraded":"2024-09-12T01:07:58.294797+0000","last_fullsized":"2024-09-12T01:07:58.294797+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-12T01:07:58.294616+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-12T01:07:58.294616+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.294616+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:51.609748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54260,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":387,"num_read_kb":921,"num_write":312,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.206312+0000","last_change":"2024-09-12T01:08:13.206312+0000","last_active":"2024-09-12T01:08:13.206312+0000","last_peered":"2024-09-12T01:08:13.206312+0000","last_clean":"2024-09-12T01:08:13.206312+0000","last_became_active":"2024-09-12T00:21:50.548527+0000","last_became_peered":"2024-09-12T00:21:50.548527+0000","last_unstale":"2024-09-12T01:08:13.206312+0000","last_undegraded":"2024-09-12T01:08:13.206312+0000","last_fullsized":"2024-09-12T01:08:13.206312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:13.206131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:13.206131+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.206131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:14.644789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'193","reported_seq":1702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:04.652386+0000","last_change":"2024-09-12T00:21:52.569731+0000","last_active":"2024-09-12T01:06:04.652386+0000","last_peered":"2024-09-12T01:06:04.652386+0000","last_clean":"2024-09-12T01:06:04.652386+0000","last_became_active":"2024-09-12T00:21:52.559360+0000","last_became_peered":"2024-09-12T00:21:52.559360+0000","last_unstale":"2024-09-12T01:06:04.652386+0000","last_undegraded":"2024-09-12T01:06:04.652386+0000","last_fullsized":"2024-09-12T01:06:04.652386+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:51.513418+0000","last_clean_scrub_stamp":"2024-09-12T00:21:51.513418+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1316,"num_write":423,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'81","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.269673+0000","last_change":"2024-09-12T01:07:43.269673+0000","last_active":"2024-09-12T01:07:43.269673+0000","last_peered":"2024-09-12T01:07:43.269673+0000","last_clean":"2024-09-12T01:07:43.269673+0000","last_became_active":"2024-09-12T00:21:44.485278+0000","last_became_peered":"2024-09-12T00:21:44.485278+0000","last_unstale":"2024-09-12T01:07:43.269673+0000","last_undegraded":"2024-09-12T01:07:43.269673+0000","last_fullsized":"2024-09-12T01:07:43.269673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-12T01:07:43.269425+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-12T01:07:43.269425+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.269425+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:25.610398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":295,"num_write":139,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'331","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.020797+0000","last_change":"2024-09-12T01:07:40.020797+0000","last_active":"2024-09-12T01:07:40.020797+0000","last_peered":"2024-09-12T01:07:40.020797+0000","last_clean":"2024-09-12T01:07:40.020797+0000","last_became_active":"2024-09-12T00:21:42.520276+0000","last_became_peered":"2024-09-12T00:21:42.520276+0000","last_unstale":"2024-09-12T01:07:40.020797+0000","last_undegraded":"2024-09-12T01:07:40.020797+0000","last_fullsized":"2024-09-12T01:07:40.020797+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-09-12T01:07:40.020532+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-09-12T01:07:40.020532+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.020532+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.026913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35265,"num_write":1034,"num_write_kb":28370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"267'6","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.391938+0000","last_change":"2024-09-12T01:07:56.391938+0000","last_active":"2024-09-12T01:07:56.391938+0000","last_peered":"2024-09-12T01:07:56.391938+0000","last_clean":"2024-09-12T01:07:56.391938+0000","last_became_active":"2024-09-12T00:21:46.495088+0000","last_became_peered":"2024-09-12T00:21:46.495088+0000","last_unstale":"2024-09-12T01:07:56.391938+0000","last_undegraded":"2024-09-12T01:07:56.391938+0000","last_fullsized":"2024-09-12T01:07:56.391938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:07:56.391742+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:07:56.391742+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.391742+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:37.803256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'333","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.207573+0000","last_change":"2024-09-12T01:08:09.207573+0000","last_active":"2024-09-12T01:08:09.207573+0000","last_peered":"2024-09-12T01:08:09.207573+0000","last_clean":"2024-09-12T01:08:09.207573+0000","last_became_active":"2024-09-12T00:21:48.550441+0000","last_became_peered":"2024-09-12T00:21:48.550441+0000","last_unstale":"2024-09-12T01:08:09.207573+0000","last_undegraded":"2024-09-12T01:08:09.207573+0000","last_fullsized":"2024-09-12T01:08:09.207573+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T01:08:09.207370+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T01:08:09.207370+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.207370+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:06.548406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54992,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1211,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.503170+0000","last_change":"2024-09-12T01:08:08.503170+0000","last_active":"2024-09-12T01:08:08.503170+0000","last_peered":"2024-09-12T01:08:08.503170+0000","last_clean":"2024-09-12T01:08:08.503170+0000","last_became_active":"2024-09-12T00:21:50.565955+0000","last_became_peered":"2024-09-12T00:21:50.565955+0000","last_unstale":"2024-09-12T01:08:08.503170+0000","last_undegraded":"2024-09-12T01:08:08.503170+0000","last_fullsized":"2024-09-12T01:08:08.503170+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:08.502979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:08.502979+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.502979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:12.378006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'135","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.028869+0000","last_change":"2024-09-12T01:07:57.028869+0000","last_active":"2024-09-12T01:07:57.028869+0000","last_peered":"2024-09-12T01:07:57.028869+0000","last_clean":"2024-09-12T01:07:57.028869+0000","last_became_active":"2024-09-12T00:21:52.549080+0000","last_became_peered":"2024-09-12T00:21:52.549080+0000","last_unstale":"2024-09-12T01:07:57.028869+0000","last_undegraded":"2024-09-12T01:07:57.028869+0000","last_fullsized":"2024-09-12T01:07:57.028869+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'135","last_scrub_stamp":"2024-09-12T01:07:57.028668+0000","last_deep_scrub":"267'135","last_deep_scrub_stamp":"2024-09-12T01:07:57.028668+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.028668+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:46.435166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'77","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.329440+0000","last_change":"2024-09-12T01:07:47.329440+0000","last_active":"2024-09-12T01:07:47.329440+0000","last_peered":"2024-09-12T01:07:47.329440+0000","last_clean":"2024-09-12T01:07:47.329440+0000","last_became_active":"2024-09-12T00:21:44.495122+0000","last_became_peered":"2024-09-12T00:21:44.495122+0000","last_unstale":"2024-09-12T01:07:47.329440+0000","last_undegraded":"2024-09-12T01:07:47.329440+0000","last_fullsized":"2024-09-12T01:07:47.329440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'77","last_scrub_stamp":"2024-09-12T01:07:47.329261+0000","last_deep_scrub":"267'77","last_deep_scrub_stamp":"2024-09-12T01:07:47.329261+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.329261+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:47.321608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":290,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'356","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.326370+0000","last_change":"2024-09-12T01:07:38.326370+0000","last_active":"2024-09-12T01:07:38.326370+0000","last_peered":"2024-09-12T01:07:38.326370+0000","last_clean":"2024-09-12T01:07:38.326370+0000","last_became_active":"2024-09-12T00:21:42.492358+0000","last_became_peered":"2024-09-12T00:21:42.492358+0000","last_unstale":"2024-09-12T01:07:38.326370+0000","last_undegraded":"2024-09-12T01:07:38.326370+0000","last_fullsized":"2024-09-12T01:07:38.326370+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'356","last_scrub_stamp":"2024-09-12T01:07:38.326089+0000","last_deep_scrub":"267'356","last_deep_scrub_stamp":"2024-09-12T01:07:38.326089+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.326089+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:59.129648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262257,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":28331,"num_write":1177,"num_write_kb":34411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'258","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.117862+0000","last_change":"2024-09-12T01:07:43.117862+0000","last_active":"2024-09-12T01:07:43.117862+0000","last_peered":"2024-09-12T01:07:43.117862+0000","last_clean":"2024-09-12T01:07:43.117862+0000","last_became_active":"2024-09-12T00:21:44.515839+0000","last_became_peered":"2024-09-12T00:21:44.515839+0000","last_unstale":"2024-09-12T01:07:43.117862+0000","last_undegraded":"2024-09-12T01:07:43.117862+0000","last_fullsized":"2024-09-12T01:07:43.117862+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:07:43.117677+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:07:43.117677+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.117677+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":1036,"num_write":423,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'449","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.076589+0000","last_change":"2024-09-12T01:07:39.076589+0000","last_active":"2024-09-12T01:07:39.076589+0000","last_peered":"2024-09-12T01:07:39.076589+0000","last_clean":"2024-09-12T01:07:39.076589+0000","last_became_active":"2024-09-12T00:21:42.502396+0000","last_became_peered":"2024-09-12T00:21:42.502396+0000","last_unstale":"2024-09-12T01:07:39.076589+0000","last_undegraded":"2024-09-12T01:07:39.076589+0000","last_fullsized":"2024-09-12T01:07:39.076589+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'449","last_scrub_stamp":"2024-09-12T01:07:39.076357+0000","last_deep_scrub":"267'449","last_deep_scrub_stamp":"2024-09-12T01:07:39.076357+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.076357+0000","objects_scrubbed":10,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:36.125871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607324,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":742,"num_read_kb":17888,"num_write":1520,"num_write_kb":31183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'183","reported_seq":757,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.932889+0000","last_change":"2024-09-12T01:07:56.932889+0000","last_active":"2024-09-12T01:07:56.932889+0000","last_peered":"2024-09-12T01:07:56.932889+0000","last_clean":"2024-09-12T01:07:56.932889+0000","last_became_active":"2024-09-12T00:21:44.499805+0000","last_became_peered":"2024-09-12T00:21:44.499805+0000","last_unstale":"2024-09-12T01:07:56.932889+0000","last_undegraded":"2024-09-12T01:07:56.932889+0000","last_fullsized":"2024-09-12T01:07:56.932889+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-12T01:07:56.932675+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-12T01:07:56.932675+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.932675+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:28.852641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":613,"num_write":283,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'459","reported_seq":1211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.936240+0000","last_change":"2024-09-12T01:07:46.936240+0000","last_active":"2024-09-12T01:07:46.936240+0000","last_peered":"2024-09-12T01:07:46.936240+0000","last_clean":"2024-09-12T01:07:46.936240+0000","last_became_active":"2024-09-12T00:21:42.518823+0000","last_became_peered":"2024-09-12T00:21:42.518823+0000","last_unstale":"2024-09-12T01:07:46.936240+0000","last_undegraded":"2024-09-12T01:07:46.936240+0000","last_fullsized":"2024-09-12T01:07:46.936240+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'459","last_scrub_stamp":"2024-09-12T01:07:46.935967+0000","last_deep_scrub":"267'459","last_deep_scrub_stamp":"2024-09-12T01:07:46.935967+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.935967+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:07.773715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194369,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":958,"num_read_kb":24368,"num_write":1486,"num_write_kb":48727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'184","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.018711+0000","last_change":"2024-09-12T01:07:54.018711+0000","last_active":"2024-09-12T01:07:54.018711+0000","last_peered":"2024-09-12T01:07:54.018711+0000","last_clean":"2024-09-12T01:07:54.018711+0000","last_became_active":"2024-09-12T00:21:44.510818+0000","last_became_peered":"2024-09-12T00:21:44.510818+0000","last_unstale":"2024-09-12T01:07:54.018711+0000","last_undegraded":"2024-09-12T01:07:54.018711+0000","last_fullsized":"2024-09-12T01:07:54.018711+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-12T01:07:54.018527+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-12T01:07:54.018527+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.018527+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:05.725799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":671,"num_write":265,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'350","reported_seq":1138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.997261+0000","last_change":"2024-09-12T01:07:40.997011+0000","last_active":"2024-09-12T01:07:40.997261+0000","last_peered":"2024-09-12T01:07:40.997261+0000","last_clean":"2024-09-12T01:07:40.997261+0000","last_became_active":"2024-09-12T00:21:42.525233+0000","last_became_peered":"2024-09-12T00:21:42.525233+0000","last_unstale":"2024-09-12T01:07:40.997261+0000","last_undegraded":"2024-09-12T01:07:40.997261+0000","last_fullsized":"2024-09-12T01:07:40.997261+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-12T01:07:40.996743+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-12T01:07:40.996743+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.996743+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:28.641437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":844,"num_read_kb":20388,"num_write":1063,"num_write_kb":42665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'183","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.022367+0000","last_change":"2024-09-12T01:07:53.022367+0000","last_active":"2024-09-12T01:07:53.022367+0000","last_peered":"2024-09-12T01:07:53.022367+0000","last_clean":"2024-09-12T01:07:53.022367+0000","last_became_active":"2024-09-12T00:21:44.523632+0000","last_became_peered":"2024-09-12T00:21:44.523632+0000","last_unstale":"2024-09-12T01:07:53.022367+0000","last_undegraded":"2024-09-12T01:07:53.022367+0000","last_fullsized":"2024-09-12T01:07:53.022367+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-12T01:07:53.022187+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-12T01:07:53.022187+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.022187+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.672407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":821,"num_read_kb":680,"num_write":294,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'392","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.353558+0000","last_change":"2024-09-12T01:07:38.353558+0000","last_active":"2024-09-12T01:07:38.353558+0000","last_peered":"2024-09-12T01:07:38.353558+0000","last_clean":"2024-09-12T01:07:38.353558+0000","last_became_active":"2024-09-12T00:21:42.501690+0000","last_became_peered":"2024-09-12T00:21:42.501690+0000","last_unstale":"2024-09-12T01:07:38.353558+0000","last_undegraded":"2024-09-12T01:07:38.353558+0000","last_fullsized":"2024-09-12T01:07:38.353558+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T01:07:38.353347+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T01:07:38.353347+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.353347+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.350580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":15193,"num_write":1332,"num_write_kb":28087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'132","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.987108+0000","last_change":"2024-09-12T01:07:39.987108+0000","last_active":"2024-09-12T01:07:39.987108+0000","last_peered":"2024-09-12T01:07:39.987108+0000","last_clean":"2024-09-12T01:07:39.987108+0000","last_became_active":"2024-09-12T00:21:44.505235+0000","last_became_peered":"2024-09-12T00:21:44.505235+0000","last_unstale":"2024-09-12T01:07:39.987108+0000","last_undegraded":"2024-09-12T01:07:39.987108+0000","last_fullsized":"2024-09-12T01:07:39.987108+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-12T01:07:39.986839+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-12T01:07:39.986839+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.986839+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:55.921394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":497,"num_write":201,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'335","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.339544+0000","last_change":"2024-09-12T01:07:41.339544+0000","last_active":"2024-09-12T01:07:41.339544+0000","last_peered":"2024-09-12T01:07:41.339544+0000","last_clean":"2024-09-12T01:07:41.339544+0000","last_became_active":"2024-09-12T00:21:42.508673+0000","last_became_peered":"2024-09-12T00:21:42.508673+0000","last_unstale":"2024-09-12T01:07:41.339544+0000","last_undegraded":"2024-09-12T01:07:41.339544+0000","last_fullsized":"2024-09-12T01:07:41.339544+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-12T01:07:41.339325+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-12T01:07:41.339325+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.339325+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:53.386446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":604,"num_read_kb":49155,"num_write":1190,"num_write_kb":40891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'142","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.352041+0000","last_change":"2024-09-12T01:07:48.352041+0000","last_active":"2024-09-12T01:07:48.352041+0000","last_peered":"2024-09-12T01:07:48.352041+0000","last_clean":"2024-09-12T01:07:48.352041+0000","last_became_active":"2024-09-12T00:21:44.515206+0000","last_became_peered":"2024-09-12T00:21:44.515206+0000","last_unstale":"2024-09-12T01:07:48.352041+0000","last_undegraded":"2024-09-12T01:07:48.352041+0000","last_fullsized":"2024-09-12T01:07:48.352041+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-12T01:07:48.351764+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-12T01:07:48.351764+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.351764+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:43.602157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":613,"num_write":237,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'349","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.216592+0000","last_change":"2024-09-12T01:07:35.216592+0000","last_active":"2024-09-12T01:07:35.216592+0000","last_peered":"2024-09-12T01:07:35.216592+0000","last_clean":"2024-09-12T01:07:35.216592+0000","last_became_active":"2024-09-12T00:21:42.486829+0000","last_became_peered":"2024-09-12T00:21:42.486829+0000","last_unstale":"2024-09-12T01:07:35.216592+0000","last_undegraded":"2024-09-12T01:07:35.216592+0000","last_fullsized":"2024-09-12T01:07:35.216592+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:35.216329+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:35.216329+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.216329+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:13.259415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":546,"num_read_kb":26644,"num_write":1053,"num_write_kb":13447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'172","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.681254+0000","last_change":"2024-09-12T01:07:39.681254+0000","last_active":"2024-09-12T01:07:39.681254+0000","last_peered":"2024-09-12T01:07:39.681254+0000","last_clean":"2024-09-12T01:07:39.681254+0000","last_became_active":"2024-09-12T00:21:44.501384+0000","last_became_peered":"2024-09-12T00:21:44.501384+0000","last_unstale":"2024-09-12T01:07:39.681254+0000","last_undegraded":"2024-09-12T01:07:39.681254+0000","last_fullsized":"2024-09-12T01:07:39.681254+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'172","last_scrub_stamp":"2024-09-12T01:07:39.681065+0000","last_deep_scrub":"267'172","last_deep_scrub_stamp":"2024-09-12T01:07:39.681065+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.681065+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:09.758134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":594,"num_write":251,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'349","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.976693+0000","last_change":"2024-09-12T01:07:41.976693+0000","last_active":"2024-09-12T01:07:41.976693+0000","last_peered":"2024-09-12T01:07:41.976693+0000","last_clean":"2024-09-12T01:07:41.976693+0000","last_became_active":"2024-09-12T00:21:42.533216+0000","last_became_peered":"2024-09-12T00:21:42.533216+0000","last_unstale":"2024-09-12T01:07:41.976693+0000","last_undegraded":"2024-09-12T01:07:41.976693+0000","last_fullsized":"2024-09-12T01:07:41.976693+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:41.976497+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:41.976497+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.976497+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.595660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":42167,"num_write":1187,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'107","reported_seq":648,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.168220+0000","last_change":"2024-09-12T01:07:45.168220+0000","last_active":"2024-09-12T01:07:45.168220+0000","last_peered":"2024-09-12T01:07:45.168220+0000","last_clean":"2024-09-12T01:07:45.168220+0000","last_became_active":"2024-09-12T00:21:44.514909+0000","last_became_peered":"2024-09-12T00:21:44.514909+0000","last_unstale":"2024-09-12T01:07:45.168220+0000","last_undegraded":"2024-09-12T01:07:45.168220+0000","last_fullsized":"2024-09-12T01:07:45.168220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-12T01:07:45.168048+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-12T01:07:45.168048+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.168048+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:49.895766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":354,"num_write":152,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'370","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.936009+0000","last_change":"2024-09-12T01:07:41.936009+0000","last_active":"2024-09-12T01:07:41.936009+0000","last_peered":"2024-09-12T01:07:41.936009+0000","last_clean":"2024-09-12T01:07:41.936009+0000","last_became_active":"2024-09-12T00:21:42.528929+0000","last_became_peered":"2024-09-12T00:21:42.528929+0000","last_unstale":"2024-09-12T01:07:41.936009+0000","last_undegraded":"2024-09-12T01:07:41.936009+0000","last_fullsized":"2024-09-12T01:07:41.936009+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-12T01:07:41.935688+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-12T01:07:41.935688+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.935688+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:34.868286+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739017,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":14743,"num_write":1076,"num_write_kb":22917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'148","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.021040+0000","last_change":"2024-09-12T01:07:44.021040+0000","last_active":"2024-09-12T01:07:44.021040+0000","last_peered":"2024-09-12T01:07:44.021040+0000","last_clean":"2024-09-12T01:07:44.021040+0000","last_became_active":"2024-09-12T00:21:44.507579+0000","last_became_peered":"2024-09-12T00:21:44.507579+0000","last_unstale":"2024-09-12T01:07:44.021040+0000","last_undegraded":"2024-09-12T01:07:44.021040+0000","last_fullsized":"2024-09-12T01:07:44.021040+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'148","last_scrub_stamp":"2024-09-12T01:07:44.020852+0000","last_deep_scrub":"267'148","last_deep_scrub_stamp":"2024-09-12T01:07:44.020852+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.020852+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.933243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":566,"num_write":233,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'388","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.012237+0000","last_change":"2024-09-12T01:07:43.012237+0000","last_active":"2024-09-12T01:07:43.012237+0000","last_peered":"2024-09-12T01:07:43.012237+0000","last_clean":"2024-09-12T01:07:43.012237+0000","last_became_active":"2024-09-12T00:21:42.511703+0000","last_became_peered":"2024-09-12T00:21:42.511703+0000","last_unstale":"2024-09-12T01:07:43.012237+0000","last_undegraded":"2024-09-12T01:07:43.012237+0000","last_fullsized":"2024-09-12T01:07:43.012237+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'388","last_scrub_stamp":"2024-09-12T01:07:43.011885+0000","last_deep_scrub":"267'388","last_deep_scrub_stamp":"2024-09-12T01:07:43.011885+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.011885+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:55.733392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":16290,"num_write":1225,"num_write_kb":34029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'32","reported_seq":582,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.977961+0000","last_change":"2024-09-12T01:07:54.977961+0000","last_active":"2024-09-12T01:07:54.977961+0000","last_peered":"2024-09-12T01:07:54.977961+0000","last_clean":"2024-09-12T01:07:54.977961+0000","last_became_active":"2024-09-12T00:21:44.509834+0000","last_became_peered":"2024-09-12T00:21:44.509834+0000","last_unstale":"2024-09-12T01:07:54.977961+0000","last_undegraded":"2024-09-12T01:07:54.977961+0000","last_fullsized":"2024-09-12T01:07:54.977961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'32","last_scrub_stamp":"2024-09-12T01:07:54.977690+0000","last_deep_scrub":"267'32","last_deep_scrub_stamp":"2024-09-12T01:07:54.977690+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.977690+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:06.019506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'345","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.645905+0000","last_change":"2024-09-12T01:07:40.645905+0000","last_active":"2024-09-12T01:07:40.645905+0000","last_peered":"2024-09-12T01:07:40.645905+0000","last_clean":"2024-09-12T01:07:40.645905+0000","last_became_active":"2024-09-12T00:21:42.484073+0000","last_became_peered":"2024-09-12T00:21:42.484073+0000","last_unstale":"2024-09-12T01:07:40.645905+0000","last_undegraded":"2024-09-12T01:07:40.645905+0000","last_fullsized":"2024-09-12T01:07:40.645905+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T01:07:40.645425+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T01:07:40.645425+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.645425+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.525871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992329,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":37312,"num_write":1168,"num_write_kb":47723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'220","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.580102+0000","last_change":"2024-09-12T01:07:42.580102+0000","last_active":"2024-09-12T01:07:42.580102+0000","last_peered":"2024-09-12T01:07:42.580102+0000","last_clean":"2024-09-12T01:07:42.580102+0000","last_became_active":"2024-09-12T00:21:44.499043+0000","last_became_peered":"2024-09-12T00:21:44.499043+0000","last_unstale":"2024-09-12T01:07:42.580102+0000","last_undegraded":"2024-09-12T01:07:42.580102+0000","last_fullsized":"2024-09-12T01:07:42.580102+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-12T01:07:42.579921+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-12T01:07:42.579921+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.579921+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:04.824993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":734,"num_write":347,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'399","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.486946+0000","last_change":"2024-09-12T01:07:41.486946+0000","last_active":"2024-09-12T01:07:41.486946+0000","last_peered":"2024-09-12T01:07:41.486946+0000","last_clean":"2024-09-12T01:07:41.486946+0000","last_became_active":"2024-09-12T00:21:42.482971+0000","last_became_peered":"2024-09-12T00:21:42.482971+0000","last_unstale":"2024-09-12T01:07:41.486946+0000","last_undegraded":"2024-09-12T01:07:41.486946+0000","last_fullsized":"2024-09-12T01:07:41.486946+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-12T01:07:41.486689+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-12T01:07:41.486689+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.486689+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:42.636122+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5391930,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":31089,"num_write":1168,"num_write_kb":20487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'219","reported_seq":892,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.623877+0000","last_change":"2024-09-12T01:07:41.623877+0000","last_active":"2024-09-12T01:07:41.623877+0000","last_peered":"2024-09-12T01:07:41.623877+0000","last_clean":"2024-09-12T01:07:41.623877+0000","last_became_active":"2024-09-12T00:21:44.526086+0000","last_became_peered":"2024-09-12T00:21:44.526086+0000","last_unstale":"2024-09-12T01:07:41.623877+0000","last_undegraded":"2024-09-12T01:07:41.623877+0000","last_fullsized":"2024-09-12T01:07:41.623877+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T01:07:41.623704+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T01:07:41.623704+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.623704+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:51.380240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1006,"num_read_kb":865,"num_write":343,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3377,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'363","reported_seq":1106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.022461+0000","last_change":"2024-09-12T01:07:46.022461+0000","last_active":"2024-09-12T01:07:46.022461+0000","last_peered":"2024-09-12T01:07:46.022461+0000","last_clean":"2024-09-12T01:07:46.022461+0000","last_became_active":"2024-09-12T00:22:12.609837+0000","last_became_peered":"2024-09-12T00:22:12.609837+0000","last_unstale":"2024-09-12T01:07:46.022461+0000","last_undegraded":"2024-09-12T01:07:46.022461+0000","last_fullsized":"2024-09-12T01:07:46.022461+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'363","last_scrub_stamp":"2024-09-12T01:07:46.022232+0000","last_deep_scrub":"267'363","last_deep_scrub_stamp":"2024-09-12T01:07:46.022232+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.022232+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:19.433845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48804,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":34651,"num_write":1163,"num_write_kb":39913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2a","version":"267'442","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.138669+0000","last_change":"2024-09-12T01:07:44.138669+0000","last_active":"2024-09-12T01:07:44.138669+0000","last_peered":"2024-09-12T01:07:44.138669+0000","last_clean":"2024-09-12T01:07:44.138669+0000","last_became_active":"2024-09-12T00:21:44.511294+0000","last_became_peered":"2024-09-12T00:21:44.511294+0000","last_unstale":"2024-09-12T01:07:44.138669+0000","last_undegraded":"2024-09-12T01:07:44.138669+0000","last_fullsized":"2024-09-12T01:07:44.138669+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-09-12T01:07:44.138494+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-09-12T01:07:44.138494+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.138494+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.489890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2157,"num_read_kb":1820,"num_write":750,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'349","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.924944+0000","last_change":"2024-09-12T01:07:48.924944+0000","last_active":"2024-09-12T01:07:48.924944+0000","last_peered":"2024-09-12T01:07:48.924944+0000","last_clean":"2024-09-12T01:07:48.924944+0000","last_became_active":"2024-09-12T00:21:42.528942+0000","last_became_peered":"2024-09-12T00:21:42.528942+0000","last_unstale":"2024-09-12T01:07:48.924944+0000","last_undegraded":"2024-09-12T01:07:48.924944+0000","last_fullsized":"2024-09-12T01:07:48.924944+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:48.924728+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:48.924728+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.924728+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:56.808821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":48912,"num_write":1189,"num_write_kb":34098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'117","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.317201+0000","last_change":"2024-09-12T01:07:48.317201+0000","last_active":"2024-09-12T01:07:48.317201+0000","last_peered":"2024-09-12T01:07:48.317201+0000","last_clean":"2024-09-12T01:07:48.317201+0000","last_became_active":"2024-09-12T00:21:44.525685+0000","last_became_peered":"2024-09-12T00:21:44.525685+0000","last_unstale":"2024-09-12T01:07:48.317201+0000","last_undegraded":"2024-09-12T01:07:48.317201+0000","last_fullsized":"2024-09-12T01:07:48.317201+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:07:48.316987+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:07:48.316987+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.316987+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:57.147053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":457,"num_write":189,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'328","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.128313+0000","last_change":"2024-09-12T01:07:37.128313+0000","last_active":"2024-09-12T01:07:37.128313+0000","last_peered":"2024-09-12T01:07:37.128313+0000","last_clean":"2024-09-12T01:07:37.128313+0000","last_became_active":"2024-09-12T00:21:42.499294+0000","last_became_peered":"2024-09-12T00:21:42.499294+0000","last_unstale":"2024-09-12T01:07:37.128313+0000","last_undegraded":"2024-09-12T01:07:37.128313+0000","last_fullsized":"2024-09-12T01:07:37.128313+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:37.127984+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:37.127984+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.127984+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:09.845259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":11483,"num_write":1078,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'192","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.681453+0000","last_change":"2024-09-12T01:07:38.681453+0000","last_active":"2024-09-12T01:07:38.681453+0000","last_peered":"2024-09-12T01:07:38.681453+0000","last_clean":"2024-09-12T01:07:38.681453+0000","last_became_active":"2024-09-12T00:21:44.511085+0000","last_became_peered":"2024-09-12T00:21:44.511085+0000","last_unstale":"2024-09-12T01:07:38.681453+0000","last_undegraded":"2024-09-12T01:07:38.681453+0000","last_fullsized":"2024-09-12T01:07:38.681453+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-12T01:07:38.681238+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-12T01:07:38.681238+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.681238+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:47.137512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":698,"num_write":312,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'380","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.889331+0000","last_change":"2024-09-12T01:07:42.889331+0000","last_active":"2024-09-12T01:07:42.889331+0000","last_peered":"2024-09-12T01:07:42.889331+0000","last_clean":"2024-09-12T01:07:42.889331+0000","last_became_active":"2024-09-12T00:21:42.518768+0000","last_became_peered":"2024-09-12T00:21:42.518768+0000","last_unstale":"2024-09-12T01:07:42.889331+0000","last_undegraded":"2024-09-12T01:07:42.889331+0000","last_fullsized":"2024-09-12T01:07:42.889331+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-12T01:07:42.889092+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-12T01:07:42.889092+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.889092+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:00.397455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984139,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":53651,"num_write":1104,"num_write_kb":23347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'311","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.916905+0000","last_change":"2024-09-12T01:07:45.916905+0000","last_active":"2024-09-12T01:07:45.916905+0000","last_peered":"2024-09-12T01:07:45.916905+0000","last_clean":"2024-09-12T01:07:45.916905+0000","last_became_active":"2024-09-12T00:21:42.495480+0000","last_became_peered":"2024-09-12T00:21:42.495480+0000","last_unstale":"2024-09-12T01:07:45.916905+0000","last_undegraded":"2024-09-12T01:07:45.916905+0000","last_fullsized":"2024-09-12T01:07:45.916905+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:07:45.916689+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:07:45.916689+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.916689+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:26.278518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":25580,"num_write":940,"num_write_kb":28169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'195","reported_seq":853,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.322966+0000","last_change":"2024-09-12T01:07:51.322966+0000","last_active":"2024-09-12T01:07:51.322966+0000","last_peered":"2024-09-12T01:07:51.322966+0000","last_clean":"2024-09-12T01:07:51.322966+0000","last_became_active":"2024-09-12T00:21:44.526907+0000","last_became_peered":"2024-09-12T00:21:44.526907+0000","last_unstale":"2024-09-12T01:07:51.322966+0000","last_undegraded":"2024-09-12T01:07:51.322966+0000","last_fullsized":"2024-09-12T01:07:51.322966+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'195","last_scrub_stamp":"2024-09-12T01:07:51.322766+0000","last_deep_scrub":"267'195","last_deep_scrub_stamp":"2024-09-12T01:07:51.322766+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.322766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:48.700283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":917,"num_read_kb":786,"num_write":315,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'317","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.060525+0000","last_change":"2024-09-12T01:07:45.060525+0000","last_active":"2024-09-12T01:07:45.060525+0000","last_peered":"2024-09-12T01:07:45.060525+0000","last_clean":"2024-09-12T01:07:45.060525+0000","last_became_active":"2024-09-12T00:21:42.516614+0000","last_became_peered":"2024-09-12T00:21:42.516614+0000","last_unstale":"2024-09-12T01:07:45.060525+0000","last_undegraded":"2024-09-12T01:07:45.060525+0000","last_fullsized":"2024-09-12T01:07:45.060525+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T01:07:45.060335+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T01:07:45.060335+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.060335+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:33.065278+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":551234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":30838,"num_write":927,"num_write_kb":38454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'102","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.511593+0000","last_change":"2024-09-12T01:07:46.511593+0000","last_active":"2024-09-12T01:07:46.511593+0000","last_peered":"2024-09-12T01:07:46.511593+0000","last_clean":"2024-09-12T01:07:46.511593+0000","last_became_active":"2024-09-12T00:21:44.496138+0000","last_became_peered":"2024-09-12T00:21:44.496138+0000","last_unstale":"2024-09-12T01:07:46.511593+0000","last_undegraded":"2024-09-12T01:07:46.511593+0000","last_fullsized":"2024-09-12T01:07:46.511593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:46.511410+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:46.511410+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.511410+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:58.055004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5839,"num_read_kb":4146,"num_write":1942,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3514,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1114,"ondisk_log_size":1114,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14973,"num_read_kb":14645,"num_write":16791,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1637,"ondisk_log_size":1637,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":604,"ondisk_log_size":604,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1609364,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17687,"num_read_kb":36971,"num_write":14775,"num_write_kb":11603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":666088,"num_omap_keys":1522,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1954,"ondisk_log_size":1954,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":101832,"num_read_kb":85065,"num_write":36894,"num_write_kb":18565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44327,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3800,"ondisk_log_size":3800,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":81179371,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36143,"num_read_kb":1795948,"num_write":71818,"num_write_kb":2042491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123875328,"data_stored":123875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3430,"ondisk_log_size":3430,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":206538,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":195226,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510006,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110064,"kb_used_data":20640,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94261776,"statfs":{"total":96636764160,"available":96524058624,"internally_reserved":0,"allocated":21135360,"data_stored":19116983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510007,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273492,"kb_used_data":21636,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098348,"statfs":{"total":96636764160,"available":96356708352,"internally_reserved":0,"allocated":22155264,"data_stored":20133475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510009,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200892,"kb_used_data":21228,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94170948,"statfs":{"total":96636764160,"available":96431050752,"internally_reserved":0,"allocated":21737472,"data_stored":19736193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510007,"num_pgs":123,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257480,"kb_used_data":19448,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94114360,"statfs":{"total":96636764160,"available":96373104640,"internally_reserved":0,"allocated":19914752,"data_stored":17899204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":243726792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510010,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145376,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94226464,"statfs":{"total":96636764160,"available":96487899136,"internally_reserved":0,"allocated":24526848,"data_stored":22535733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510007,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286592,"kb_used_data":12464,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94085248,"statfs":{"total":96636764160,"available":96343293952,"internally_reserved":0,"allocated":12763136,"data_stored":10743931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510006,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146944,"kb_used_data":17264,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94224896,"statfs":{"total":96636764160,"available":96486293504,"internally_reserved":0,"allocated":17678336,"data_stored":15657318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542712,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226236,"kb_used_data":18796,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94145604,"statfs":{"total":96636764160,"available":96405098496,"internally_reserved":0,"allocated":19247104,"data_stored":17260105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13402112,"data_stored":13402112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7901184,"data_stored":7901184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20283392,"data_stored":20283392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17481728,"data_stored":17481728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17289216,"data_stored":17289216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16863232,"data_stored":16863232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15007744,"data_stored":15007744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:08:16.305 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.305 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.305 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.305 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.305 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.306 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.306 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.306 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.306 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.306 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.306 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.306 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.306 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.307 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.307 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.307 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.307 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.307 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.307 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.307 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.308 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.309 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.309 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.309 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.309 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.309 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.309 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.309 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.309 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.310 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.310 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.310 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.310 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.310 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.310 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.310 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.311 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.311 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.311 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.311 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.311 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.311 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.311 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.311 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.312 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.312 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.312 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.312 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.312 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.312 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.312 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.312 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:38:06.594371+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.313 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:36:36.187021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=36, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.313 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.313 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.314 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.315 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.315 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.316 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:21:47.492929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.316 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.316 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:21:49.506968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.316 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:21:51.513418+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:16.317 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:08:36.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:08:36.689 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:08:36.701 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T01:08:36.714 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1678,"stamp":"2024-09-12T01:08:35.174717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83396560,"num_objects":733,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":179311,"num_read_kb":2341483,"num_write":142743,"num_write_kb":2353740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":739525,"num_omap_keys":1791,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12931,"ondisk_log_size":12931,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1647076,"kb_used_data":155428,"kb_used_omap":12,"kb_used_meta":1491507,"kb_avail":753327644,"statfs":{"total":773094113280,"available":771407507456,"internally_reserved":0,"allocated":159158272,"data_stored":143082942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1527303729},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3848,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008165"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.054822+0000","last_change":"2024-09-12T01:08:10.054822+0000","last_active":"2024-09-12T01:08:10.054822+0000","last_peered":"2024-09-12T01:08:10.054822+0000","last_clean":"2024-09-12T01:08:10.054822+0000","last_became_active":"2024-09-12T00:49:10.623491+0000","last_became_peered":"2024-09-12T00:49:10.623491+0000","last_unstale":"2024-09-12T01:08:10.054822+0000","last_undegraded":"2024-09-12T01:08:10.054822+0000","last_fullsized":"2024-09-12T01:08:10.054822+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.054640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.054640+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.054640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:35.071276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"267'7","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.606226+0000","last_change":"2024-09-12T01:08:08.606069+0000","last_active":"2024-09-12T01:08:08.606226+0000","last_peered":"2024-09-12T01:08:08.606226+0000","last_clean":"2024-09-12T01:08:08.606226+0000","last_became_active":"2024-09-12T00:38:10.687911+0000","last_became_peered":"2024-09-12T00:38:10.687911+0000","last_unstale":"2024-09-12T01:08:08.606226+0000","last_undegraded":"2024-09-12T01:08:08.606226+0000","last_fullsized":"2024-09-12T01:08:08.606226+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:08.605857+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:08.605857+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.605857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:58.041544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.347173+0000","last_change":"2024-09-12T01:08:12.347173+0000","last_active":"2024-09-12T01:08:12.347173+0000","last_peered":"2024-09-12T01:08:12.347173+0000","last_clean":"2024-09-12T01:08:12.347173+0000","last_became_active":"2024-09-12T00:38:07.664779+0000","last_became_peered":"2024-09-12T00:38:07.664779+0000","last_unstale":"2024-09-12T01:08:12.347173+0000","last_undegraded":"2024-09-12T01:08:12.347173+0000","last_fullsized":"2024-09-12T01:08:12.347173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:12.346976+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:12.346976+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.346976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:41.632394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'50","reported_seq":191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.613557+0000","last_change":"2024-09-12T01:08:15.613557+0000","last_active":"2024-09-12T01:08:15.613557+0000","last_peered":"2024-09-12T01:08:15.613557+0000","last_clean":"2024-09-12T01:08:15.613557+0000","last_became_active":"2024-09-12T00:36:37.223686+0000","last_became_peered":"2024-09-12T00:36:37.223686+0000","last_unstale":"2024-09-12T01:08:15.613557+0000","last_undegraded":"2024-09-12T01:08:15.613557+0000","last_fullsized":"2024-09-12T01:08:15.613557+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'50","last_scrub_stamp":"2024-09-12T01:08:15.613270+0000","last_deep_scrub":"267'50","last_deep_scrub_stamp":"2024-09-12T01:08:15.613270+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.613270+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:57.806634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":201,"num_write":87,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.297208+0000","last_change":"2024-09-12T01:08:18.297208+0000","last_active":"2024-09-12T01:08:18.297208+0000","last_peered":"2024-09-12T01:08:18.297208+0000","last_clean":"2024-09-12T01:08:18.297208+0000","last_became_active":"2024-09-12T00:49:10.624700+0000","last_became_peered":"2024-09-12T00:49:10.624700+0000","last_unstale":"2024-09-12T01:08:18.297208+0000","last_undegraded":"2024-09-12T01:08:18.297208+0000","last_fullsized":"2024-09-12T01:08:18.297208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:18.297026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:18.297026+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.297026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.384805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"267'8","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.272062+0000","last_change":"2024-09-12T01:08:13.271925+0000","last_active":"2024-09-12T01:08:13.272062+0000","last_peered":"2024-09-12T01:08:13.272062+0000","last_clean":"2024-09-12T01:08:13.272062+0000","last_became_active":"2024-09-12T00:38:10.691195+0000","last_became_peered":"2024-09-12T00:38:10.691195+0000","last_unstale":"2024-09-12T01:08:13.272062+0000","last_undegraded":"2024-09-12T01:08:13.272062+0000","last_fullsized":"2024-09-12T01:08:13.272062+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.271714+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.271714+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.271714+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:08.269903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"267'8","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.828187+0000","last_change":"2024-09-12T01:08:19.828187+0000","last_active":"2024-09-12T01:08:19.828187+0000","last_peered":"2024-09-12T01:08:19.828187+0000","last_clean":"2024-09-12T01:08:19.828187+0000","last_became_active":"2024-09-12T00:38:07.664663+0000","last_became_peered":"2024-09-12T00:38:07.664663+0000","last_unstale":"2024-09-12T01:08:19.828187+0000","last_undegraded":"2024-09-12T01:08:19.828187+0000","last_fullsized":"2024-09-12T01:08:19.828187+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:19.828003+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:19.828003+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.828003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:34.062200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.575204+0000","last_change":"2024-09-12T01:08:14.575204+0000","last_active":"2024-09-12T01:08:14.575204+0000","last_peered":"2024-09-12T01:08:14.575204+0000","last_clean":"2024-09-12T01:08:14.575204+0000","last_became_active":"2024-09-12T00:36:37.239199+0000","last_became_peered":"2024-09-12T00:36:37.239199+0000","last_unstale":"2024-09-12T01:08:14.575204+0000","last_undegraded":"2024-09-12T01:08:14.575204+0000","last_fullsized":"2024-09-12T01:08:14.575204+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:14.575015+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:14.575015+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.575015+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:49.586544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.592345+0000","last_change":"2024-09-12T01:08:12.592098+0000","last_active":"2024-09-12T01:08:12.592345+0000","last_peered":"2024-09-12T01:08:12.592345+0000","last_clean":"2024-09-12T01:08:12.592345+0000","last_became_active":"2024-09-12T00:49:10.611715+0000","last_became_peered":"2024-09-12T00:49:10.611715+0000","last_unstale":"2024-09-12T01:08:12.592345+0000","last_undegraded":"2024-09-12T01:08:12.592345+0000","last_fullsized":"2024-09-12T01:08:12.592345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:12.591892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:12.591892+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.591892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:16.236185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"267'13","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:26.812671+0000","last_change":"2024-09-12T01:08:26.812671+0000","last_active":"2024-09-12T01:08:26.812671+0000","last_peered":"2024-09-12T01:08:26.812671+0000","last_clean":"2024-09-12T01:08:26.812671+0000","last_became_active":"2024-09-12T00:38:10.702832+0000","last_became_peered":"2024-09-12T00:38:10.702832+0000","last_unstale":"2024-09-12T01:08:26.812671+0000","last_undegraded":"2024-09-12T01:08:26.812671+0000","last_fullsized":"2024-09-12T01:08:26.812671+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-12T01:08:26.812478+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-12T01:08:26.812478+0000","last_clean_scrub_stamp":"2024-09-12T01:08:26.812478+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:50.220090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26653,"num_write":18,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.315658+0000","last_change":"2024-09-12T01:08:13.315534+0000","last_active":"2024-09-12T01:08:13.315658+0000","last_peered":"2024-09-12T01:08:13.315658+0000","last_clean":"2024-09-12T01:08:13.315658+0000","last_became_active":"2024-09-12T00:38:07.654162+0000","last_became_peered":"2024-09-12T00:38:07.654162+0000","last_unstale":"2024-09-12T01:08:13.315658+0000","last_undegraded":"2024-09-12T01:08:13.315658+0000","last_fullsized":"2024-09-12T01:08:13.315658+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:13.315358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:13.315358+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.315358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:31.740346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'61","reported_seq":223,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.285338+0000","last_change":"2024-09-12T01:08:11.285338+0000","last_active":"2024-09-12T01:08:11.285338+0000","last_peered":"2024-09-12T01:08:11.285338+0000","last_clean":"2024-09-12T01:08:11.285338+0000","last_became_active":"2024-09-12T00:36:37.243951+0000","last_became_peered":"2024-09-12T00:36:37.243951+0000","last_unstale":"2024-09-12T01:08:11.285338+0000","last_undegraded":"2024-09-12T01:08:11.285338+0000","last_fullsized":"2024-09-12T01:08:11.285338+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'61","last_scrub_stamp":"2024-09-12T01:08:11.285152+0000","last_deep_scrub":"267'61","last_deep_scrub_stamp":"2024-09-12T01:08:11.285152+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.285152+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:38.177940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":228,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.782410+0000","last_change":"2024-09-12T01:08:33.782410+0000","last_active":"2024-09-12T01:08:33.782410+0000","last_peered":"2024-09-12T01:08:33.782410+0000","last_clean":"2024-09-12T01:08:33.782410+0000","last_became_active":"2024-09-12T00:49:10.613525+0000","last_became_peered":"2024-09-12T00:49:10.613525+0000","last_unstale":"2024-09-12T01:08:33.782410+0000","last_undegraded":"2024-09-12T01:08:33.782410+0000","last_fullsized":"2024-09-12T01:08:33.782410+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:33.782234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:33.782234+0000","last_clean_scrub_stamp":"2024-09-12T01:08:33.782234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:34.886447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'12","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.831058+0000","last_change":"2024-09-12T01:08:25.831058+0000","last_active":"2024-09-12T01:08:25.831058+0000","last_peered":"2024-09-12T01:08:25.831058+0000","last_clean":"2024-09-12T01:08:25.831058+0000","last_became_active":"2024-09-12T00:38:10.701406+0000","last_became_peered":"2024-09-12T00:38:10.701406+0000","last_unstale":"2024-09-12T01:08:25.831058+0000","last_undegraded":"2024-09-12T01:08:25.831058+0000","last_fullsized":"2024-09-12T01:08:25.831058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:25.830842+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:25.830842+0000","last_clean_scrub_stamp":"2024-09-12T01:08:25.830842+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:49.764299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'4","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.599017+0000","last_change":"2024-09-12T01:08:07.599017+0000","last_active":"2024-09-12T01:08:07.599017+0000","last_peered":"2024-09-12T01:08:07.599017+0000","last_clean":"2024-09-12T01:08:07.599017+0000","last_became_active":"2024-09-12T00:38:07.639897+0000","last_became_peered":"2024-09-12T00:38:07.639897+0000","last_unstale":"2024-09-12T01:08:07.599017+0000","last_undegraded":"2024-09-12T01:08:07.599017+0000","last_fullsized":"2024-09-12T01:08:07.599017+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:08:07.598817+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:08:07.598817+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.598817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:19.008558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4625,"num_write":4,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'49","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.265543+0000","last_change":"2024-09-12T01:08:10.265543+0000","last_active":"2024-09-12T01:08:10.265543+0000","last_peered":"2024-09-12T01:08:10.265543+0000","last_clean":"2024-09-12T01:08:10.265543+0000","last_became_active":"2024-09-12T00:36:37.235921+0000","last_became_peered":"2024-09-12T00:36:37.235921+0000","last_unstale":"2024-09-12T01:08:10.265543+0000","last_undegraded":"2024-09-12T01:08:10.265543+0000","last_fullsized":"2024-09-12T01:08:10.265543+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'49","last_scrub_stamp":"2024-09-12T01:08:10.265370+0000","last_deep_scrub":"267'49","last_deep_scrub_stamp":"2024-09-12T01:08:10.265370+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.265370+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:23.396702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":160,"num_write":94,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.256965+0000","last_change":"2024-09-12T01:08:23.256965+0000","last_active":"2024-09-12T01:08:23.256965+0000","last_peered":"2024-09-12T01:08:23.256965+0000","last_clean":"2024-09-12T01:08:23.256965+0000","last_became_active":"2024-09-12T00:49:10.640187+0000","last_became_peered":"2024-09-12T00:49:10.640187+0000","last_unstale":"2024-09-12T01:08:23.256965+0000","last_undegraded":"2024-09-12T01:08:23.256965+0000","last_fullsized":"2024-09-12T01:08:23.256965+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:23.256791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:23.256791+0000","last_clean_scrub_stamp":"2024-09-12T01:08:23.256791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:24.513113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.067106+0000","last_change":"2024-09-12T01:08:02.067106+0000","last_active":"2024-09-12T01:08:02.067106+0000","last_peered":"2024-09-12T01:08:02.067106+0000","last_clean":"2024-09-12T01:08:02.067106+0000","last_became_active":"2024-09-12T00:38:10.702113+0000","last_became_peered":"2024-09-12T00:38:10.702113+0000","last_unstale":"2024-09-12T01:08:02.067106+0000","last_undegraded":"2024-09-12T01:08:02.067106+0000","last_fullsized":"2024-09-12T01:08:02.067106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:02.066913+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:02.066913+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.066913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:16.587948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.836963+0000","last_change":"2024-09-12T01:08:17.836963+0000","last_active":"2024-09-12T01:08:17.836963+0000","last_peered":"2024-09-12T01:08:17.836963+0000","last_clean":"2024-09-12T01:08:17.836963+0000","last_became_active":"2024-09-12T00:38:07.660159+0000","last_became_peered":"2024-09-12T00:38:07.660159+0000","last_unstale":"2024-09-12T01:08:17.836963+0000","last_undegraded":"2024-09-12T01:08:17.836963+0000","last_fullsized":"2024-09-12T01:08:17.836963+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:17.836778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:17.836778+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.836778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:03.576279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'28","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.296991+0000","last_change":"2024-09-12T01:08:09.296991+0000","last_active":"2024-09-12T01:08:09.296991+0000","last_peered":"2024-09-12T01:08:09.296991+0000","last_clean":"2024-09-12T01:08:09.296991+0000","last_became_active":"2024-09-12T00:36:37.248920+0000","last_became_peered":"2024-09-12T00:36:37.248920+0000","last_unstale":"2024-09-12T01:08:09.296991+0000","last_undegraded":"2024-09-12T01:08:09.296991+0000","last_fullsized":"2024-09-12T01:08:09.296991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T01:08:09.296777+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T01:08:09.296777+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.296777+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:14.544546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.643824+0000","last_change":"2024-09-12T01:08:19.643824+0000","last_active":"2024-09-12T01:08:19.643824+0000","last_peered":"2024-09-12T01:08:19.643824+0000","last_clean":"2024-09-12T01:08:19.643824+0000","last_became_active":"2024-09-12T00:49:10.638196+0000","last_became_peered":"2024-09-12T00:49:10.638196+0000","last_unstale":"2024-09-12T01:08:19.643824+0000","last_undegraded":"2024-09-12T01:08:19.643824+0000","last_fullsized":"2024-09-12T01:08:19.643824+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:19.643634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:19.643634+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.643634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:12.169874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.634261+0000","last_change":"2024-09-12T00:38:10.715254+0000","last_active":"2024-09-12T01:04:49.634261+0000","last_peered":"2024-09-12T01:04:49.634261+0000","last_clean":"2024-09-12T01:04:49.634261+0000","last_became_active":"2024-09-12T00:38:10.714503+0000","last_became_peered":"2024-09-12T00:38:10.714503+0000","last_unstale":"2024-09-12T01:04:49.634261+0000","last_undegraded":"2024-09-12T01:04:49.634261+0000","last_fullsized":"2024-09-12T01:04:49.634261+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.076577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"267'5","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.320373+0000","last_change":"2024-09-12T01:08:32.320373+0000","last_active":"2024-09-12T01:08:32.320373+0000","last_peered":"2024-09-12T01:08:32.320373+0000","last_clean":"2024-09-12T01:08:32.320373+0000","last_became_active":"2024-09-12T00:38:07.656570+0000","last_became_peered":"2024-09-12T00:38:07.656570+0000","last_unstale":"2024-09-12T01:08:32.320373+0000","last_undegraded":"2024-09-12T01:08:32.320373+0000","last_fullsized":"2024-09-12T01:08:32.320373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:32.320179+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:32.320179+0000","last_clean_scrub_stamp":"2024-09-12T01:08:32.320179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:04.322456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'40","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.069684+0000","last_change":"2024-09-12T01:08:05.069684+0000","last_active":"2024-09-12T01:08:05.069684+0000","last_peered":"2024-09-12T01:08:05.069684+0000","last_clean":"2024-09-12T01:08:05.069684+0000","last_became_active":"2024-09-12T00:36:37.239055+0000","last_became_peered":"2024-09-12T00:36:37.239055+0000","last_unstale":"2024-09-12T01:08:05.069684+0000","last_undegraded":"2024-09-12T01:08:05.069684+0000","last_fullsized":"2024-09-12T01:08:05.069684+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:05.069464+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:05.069464+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.069464+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:25.091455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":128,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.342187+0000","last_change":"2024-09-12T01:08:16.342187+0000","last_active":"2024-09-12T01:08:16.342187+0000","last_peered":"2024-09-12T01:08:16.342187+0000","last_clean":"2024-09-12T01:08:16.342187+0000","last_became_active":"2024-09-12T00:49:10.624542+0000","last_became_peered":"2024-09-12T00:49:10.624542+0000","last_unstale":"2024-09-12T01:08:16.342187+0000","last_undegraded":"2024-09-12T01:08:16.342187+0000","last_fullsized":"2024-09-12T01:08:16.342187+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:16.342112+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:16.342112+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.342112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:58.391694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.188462+0000","last_change":"2024-09-12T01:08:11.188325+0000","last_active":"2024-09-12T01:08:11.188462+0000","last_peered":"2024-09-12T01:08:11.188462+0000","last_clean":"2024-09-12T01:08:11.188462+0000","last_became_active":"2024-09-12T00:38:10.698076+0000","last_became_peered":"2024-09-12T00:38:10.698076+0000","last_unstale":"2024-09-12T01:08:11.188462+0000","last_undegraded":"2024-09-12T01:08:11.188462+0000","last_fullsized":"2024-09-12T01:08:11.188462+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.188141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.188141+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.188141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:59.829689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.018764+0000","last_change":"2024-09-12T01:08:01.018642+0000","last_active":"2024-09-12T01:08:01.018764+0000","last_peered":"2024-09-12T01:08:01.018764+0000","last_clean":"2024-09-12T01:08:01.018764+0000","last_became_active":"2024-09-12T00:38:07.626956+0000","last_became_peered":"2024-09-12T00:38:07.626956+0000","last_unstale":"2024-09-12T01:08:01.018764+0000","last_undegraded":"2024-09-12T01:08:01.018764+0000","last_fullsized":"2024-09-12T01:08:01.018764+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:01.018436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:01.018436+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.018436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:14.899789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'29","reported_seq":133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.366021+0000","last_change":"2024-09-12T01:08:06.365759+0000","last_active":"2024-09-12T01:08:06.366021+0000","last_peered":"2024-09-12T01:08:06.366021+0000","last_clean":"2024-09-12T01:08:06.366021+0000","last_became_active":"2024-09-12T00:36:37.239412+0000","last_became_peered":"2024-09-12T00:36:37.239412+0000","last_unstale":"2024-09-12T01:08:06.366021+0000","last_undegraded":"2024-09-12T01:08:06.366021+0000","last_fullsized":"2024-09-12T01:08:06.366021+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T01:08:06.365544+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T01:08:06.365544+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.365544+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.997295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":107,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.086539+0000","last_change":"2024-09-12T01:08:09.086539+0000","last_active":"2024-09-12T01:08:09.086539+0000","last_peered":"2024-09-12T01:08:09.086539+0000","last_clean":"2024-09-12T01:08:09.086539+0000","last_became_active":"2024-09-12T00:49:10.623930+0000","last_became_peered":"2024-09-12T00:49:10.623930+0000","last_unstale":"2024-09-12T01:08:09.086539+0000","last_undegraded":"2024-09-12T01:08:09.086539+0000","last_fullsized":"2024-09-12T01:08:09.086539+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.086352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.086352+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.086352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:30.887710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.220416+0000","last_change":"2024-09-12T01:08:20.220416+0000","last_active":"2024-09-12T01:08:20.220416+0000","last_peered":"2024-09-12T01:08:20.220416+0000","last_clean":"2024-09-12T01:08:20.220416+0000","last_became_active":"2024-09-12T00:38:10.709065+0000","last_became_peered":"2024-09-12T00:38:10.709065+0000","last_unstale":"2024-09-12T01:08:20.220416+0000","last_undegraded":"2024-09-12T01:08:20.220416+0000","last_fullsized":"2024-09-12T01:08:20.220416+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:20.220237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:20.220237+0000","last_clean_scrub_stamp":"2024-09-12T01:08:20.220237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:06.219031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"267'4","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.300089+0000","last_change":"2024-09-12T01:08:14.300089+0000","last_active":"2024-09-12T01:08:14.300089+0000","last_peered":"2024-09-12T01:08:14.300089+0000","last_clean":"2024-09-12T01:08:14.300089+0000","last_became_active":"2024-09-12T00:38:07.658039+0000","last_became_peered":"2024-09-12T00:38:07.658039+0000","last_unstale":"2024-09-12T01:08:14.300089+0000","last_undegraded":"2024-09-12T01:08:14.300089+0000","last_fullsized":"2024-09-12T01:08:14.300089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:14.299865+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:14.299865+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.299865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:52.543724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'24","reported_seq":109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.307701+0000","last_change":"2024-09-12T01:08:08.307701+0000","last_active":"2024-09-12T01:08:08.307701+0000","last_peered":"2024-09-12T01:08:08.307701+0000","last_clean":"2024-09-12T01:08:08.307701+0000","last_became_active":"2024-09-12T00:36:37.238156+0000","last_became_peered":"2024-09-12T00:36:37.238156+0000","last_unstale":"2024-09-12T01:08:08.307701+0000","last_undegraded":"2024-09-12T01:08:08.307701+0000","last_fullsized":"2024-09-12T01:08:08.307701+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'24","last_scrub_stamp":"2024-09-12T01:08:08.307532+0000","last_deep_scrub":"267'24","last_deep_scrub_stamp":"2024-09-12T01:08:08.307532+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.307532+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.600072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":66,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:31.766760+0000","last_change":"2024-09-12T01:08:31.766760+0000","last_active":"2024-09-12T01:08:31.766760+0000","last_peered":"2024-09-12T01:08:31.766760+0000","last_clean":"2024-09-12T01:08:31.766760+0000","last_became_active":"2024-09-12T00:49:10.614006+0000","last_became_peered":"2024-09-12T00:49:10.614006+0000","last_unstale":"2024-09-12T01:08:31.766760+0000","last_undegraded":"2024-09-12T01:08:31.766760+0000","last_fullsized":"2024-09-12T01:08:31.766760+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:31.766538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:31.766538+0000","last_clean_scrub_stamp":"2024-09-12T01:08:31.766538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:49.677901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.233576+0000","last_change":"2024-09-12T01:08:18.233576+0000","last_active":"2024-09-12T01:08:18.233576+0000","last_peered":"2024-09-12T01:08:18.233576+0000","last_clean":"2024-09-12T01:08:18.233576+0000","last_became_active":"2024-09-12T00:38:10.691887+0000","last_became_peered":"2024-09-12T00:38:10.691887+0000","last_unstale":"2024-09-12T01:08:18.233576+0000","last_undegraded":"2024-09-12T01:08:18.233576+0000","last_fullsized":"2024-09-12T01:08:18.233576+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:18.233304+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:18.233304+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.233304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:20.304367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'8","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:31.307866+0000","last_change":"2024-09-12T01:08:31.307866+0000","last_active":"2024-09-12T01:08:31.307866+0000","last_peered":"2024-09-12T01:08:31.307866+0000","last_clean":"2024-09-12T01:08:31.307866+0000","last_became_active":"2024-09-12T00:38:07.653685+0000","last_became_peered":"2024-09-12T00:38:07.653685+0000","last_unstale":"2024-09-12T01:08:31.307866+0000","last_undegraded":"2024-09-12T01:08:31.307866+0000","last_fullsized":"2024-09-12T01:08:31.307866+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:31.307675+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:31.307675+0000","last_clean_scrub_stamp":"2024-09-12T01:08:31.307675+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:59.490732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.551191+0000","last_change":"2024-09-12T01:08:13.551191+0000","last_active":"2024-09-12T01:08:13.551191+0000","last_peered":"2024-09-12T01:08:13.551191+0000","last_clean":"2024-09-12T01:08:13.551191+0000","last_became_active":"2024-09-12T00:36:37.223860+0000","last_became_peered":"2024-09-12T00:36:37.223860+0000","last_unstale":"2024-09-12T01:08:13.551191+0000","last_undegraded":"2024-09-12T01:08:13.551191+0000","last_fullsized":"2024-09-12T01:08:13.551191+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.550870+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.550870+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.550870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:17.887059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.284481+0000","last_change":"2024-09-12T01:08:16.284481+0000","last_active":"2024-09-12T01:08:16.284481+0000","last_peered":"2024-09-12T01:08:16.284481+0000","last_clean":"2024-09-12T01:08:16.284481+0000","last_became_active":"2024-09-12T00:49:10.622347+0000","last_became_peered":"2024-09-12T00:49:10.622347+0000","last_unstale":"2024-09-12T01:08:16.284481+0000","last_undegraded":"2024-09-12T01:08:16.284481+0000","last_fullsized":"2024-09-12T01:08:16.284481+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:16.284295+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:16.284295+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.284295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:56.546582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:24.875300+0000","last_change":"2024-09-12T01:08:24.875300+0000","last_active":"2024-09-12T01:08:24.875300+0000","last_peered":"2024-09-12T01:08:24.875300+0000","last_clean":"2024-09-12T01:08:24.875300+0000","last_became_active":"2024-09-12T00:38:10.717358+0000","last_became_peered":"2024-09-12T00:38:10.717358+0000","last_unstale":"2024-09-12T01:08:24.875300+0000","last_undegraded":"2024-09-12T01:08:24.875300+0000","last_fullsized":"2024-09-12T01:08:24.875300+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:24.875110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:24.875110+0000","last_clean_scrub_stamp":"2024-09-12T01:08:24.875110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.635922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'3","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.010467+0000","last_change":"2024-09-12T01:07:56.010467+0000","last_active":"2024-09-12T01:07:56.010467+0000","last_peered":"2024-09-12T01:07:56.010467+0000","last_clean":"2024-09-12T01:07:56.010467+0000","last_became_active":"2024-09-12T00:38:07.638712+0000","last_became_peered":"2024-09-12T00:38:07.638712+0000","last_unstale":"2024-09-12T01:07:56.010467+0000","last_undegraded":"2024-09-12T01:07:56.010467+0000","last_fullsized":"2024-09-12T01:07:56.010467+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:07:56.010283+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:07:56.010283+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.010283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:12.789520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'20","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.549580+0000","last_change":"2024-09-12T01:08:12.549580+0000","last_active":"2024-09-12T01:08:12.549580+0000","last_peered":"2024-09-12T01:08:12.549580+0000","last_clean":"2024-09-12T01:08:12.549580+0000","last_became_active":"2024-09-12T00:36:37.223487+0000","last_became_peered":"2024-09-12T00:36:37.223487+0000","last_unstale":"2024-09-12T01:08:12.549580+0000","last_undegraded":"2024-09-12T01:08:12.549580+0000","last_fullsized":"2024-09-12T01:08:12.549580+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:08:12.549398+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:08:12.549398+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.549398+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:47.373141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":70,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.375609+0000","last_change":"2024-09-12T01:08:17.375609+0000","last_active":"2024-09-12T01:08:17.375609+0000","last_peered":"2024-09-12T01:08:17.375609+0000","last_clean":"2024-09-12T01:08:17.375609+0000","last_became_active":"2024-09-12T00:49:10.611251+0000","last_became_peered":"2024-09-12T00:49:10.611251+0000","last_unstale":"2024-09-12T01:08:17.375609+0000","last_undegraded":"2024-09-12T01:08:17.375609+0000","last_fullsized":"2024-09-12T01:08:17.375609+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:17.375407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:17.375407+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.375407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:09.598313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.265893+0000","last_change":"2024-09-12T01:08:19.265893+0000","last_active":"2024-09-12T01:08:19.265893+0000","last_peered":"2024-09-12T01:08:19.265893+0000","last_clean":"2024-09-12T01:08:19.265893+0000","last_became_active":"2024-09-12T00:38:10.706726+0000","last_became_peered":"2024-09-12T00:38:10.706726+0000","last_unstale":"2024-09-12T01:08:19.265893+0000","last_undegraded":"2024-09-12T01:08:19.265893+0000","last_fullsized":"2024-09-12T01:08:19.265893+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:19.265721+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:19.265721+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.265721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:40.746607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'4","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.310827+0000","last_change":"2024-09-12T01:08:10.310827+0000","last_active":"2024-09-12T01:08:10.310827+0000","last_peered":"2024-09-12T01:08:10.310827+0000","last_clean":"2024-09-12T01:08:10.310827+0000","last_became_active":"2024-09-12T00:38:07.667724+0000","last_became_peered":"2024-09-12T00:38:07.667724+0000","last_unstale":"2024-09-12T01:08:10.310827+0000","last_undegraded":"2024-09-12T01:08:10.310827+0000","last_fullsized":"2024-09-12T01:08:10.310827+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:10.310639+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:10.310639+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.310639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:33.973549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'49","reported_seq":187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.330682+0000","last_change":"2024-09-12T01:08:07.330682+0000","last_active":"2024-09-12T01:08:07.330682+0000","last_peered":"2024-09-12T01:08:07.330682+0000","last_clean":"2024-09-12T01:08:07.330682+0000","last_became_active":"2024-09-12T00:36:37.244259+0000","last_became_peered":"2024-09-12T00:36:37.244259+0000","last_unstale":"2024-09-12T01:08:07.330682+0000","last_undegraded":"2024-09-12T01:08:07.330682+0000","last_fullsized":"2024-09-12T01:08:07.330682+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'49","last_scrub_stamp":"2024-09-12T01:08:07.330420+0000","last_deep_scrub":"267'49","last_deep_scrub_stamp":"2024-09-12T01:08:07.330420+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.330420+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:12.111873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":182,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.058375+0000","last_change":"2024-09-12T01:08:08.058375+0000","last_active":"2024-09-12T01:08:08.058375+0000","last_peered":"2024-09-12T01:08:08.058375+0000","last_clean":"2024-09-12T01:08:08.058375+0000","last_became_active":"2024-09-12T00:49:10.629746+0000","last_became_peered":"2024-09-12T00:49:10.629746+0000","last_unstale":"2024-09-12T01:08:08.058375+0000","last_undegraded":"2024-09-12T01:08:08.058375+0000","last_fullsized":"2024-09-12T01:08:08.058375+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:08.058153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:08.058153+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.058153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:21.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.113806+0000","last_change":"2024-09-12T01:08:04.113806+0000","last_active":"2024-09-12T01:08:04.113806+0000","last_peered":"2024-09-12T01:08:04.113806+0000","last_clean":"2024-09-12T01:08:04.113806+0000","last_became_active":"2024-09-12T00:38:10.695688+0000","last_became_peered":"2024-09-12T00:38:10.695688+0000","last_unstale":"2024-09-12T01:08:04.113806+0000","last_undegraded":"2024-09-12T01:08:04.113806+0000","last_fullsized":"2024-09-12T01:08:04.113806+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:04.113621+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:04.113621+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.113621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:20.002680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.828851+0000","last_change":"2024-09-12T01:08:16.828851+0000","last_active":"2024-09-12T01:08:16.828851+0000","last_peered":"2024-09-12T01:08:16.828851+0000","last_clean":"2024-09-12T01:08:16.828851+0000","last_became_active":"2024-09-12T00:38:07.645284+0000","last_became_peered":"2024-09-12T00:38:07.645284+0000","last_unstale":"2024-09-12T01:08:16.828851+0000","last_undegraded":"2024-09-12T01:08:16.828851+0000","last_fullsized":"2024-09-12T01:08:16.828851+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:08:16.828659+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:08:16.828659+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.828659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:48.898582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'28","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:26.348237+0000","last_change":"2024-09-12T01:08:26.348237+0000","last_active":"2024-09-12T01:08:26.348237+0000","last_peered":"2024-09-12T01:08:26.348237+0000","last_clean":"2024-09-12T01:08:26.348237+0000","last_became_active":"2024-09-12T00:36:37.220195+0000","last_became_peered":"2024-09-12T00:36:37.220195+0000","last_unstale":"2024-09-12T01:08:26.348237+0000","last_undegraded":"2024-09-12T01:08:26.348237+0000","last_fullsized":"2024-09-12T01:08:26.348237+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T01:08:26.348022+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T01:08:26.348022+0000","last_clean_scrub_stamp":"2024-09-12T01:08:26.348022+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:32.153124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":108,"num_write":45,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.746075+0000","last_change":"2024-09-12T01:08:32.745861+0000","last_active":"2024-09-12T01:08:32.746075+0000","last_peered":"2024-09-12T01:08:32.746075+0000","last_clean":"2024-09-12T01:08:32.746075+0000","last_became_active":"2024-09-12T00:49:10.614661+0000","last_became_peered":"2024-09-12T00:49:10.614661+0000","last_unstale":"2024-09-12T01:08:32.746075+0000","last_undegraded":"2024-09-12T01:08:32.746075+0000","last_fullsized":"2024-09-12T01:08:32.746075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:32.745611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:32.745611+0000","last_clean_scrub_stamp":"2024-09-12T01:08:32.745611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:33.966846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'3","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.817683+0000","last_change":"2024-09-12T01:08:21.817532+0000","last_active":"2024-09-12T01:08:21.817683+0000","last_peered":"2024-09-12T01:08:21.817683+0000","last_clean":"2024-09-12T01:08:21.817683+0000","last_became_active":"2024-09-12T00:38:10.702260+0000","last_became_peered":"2024-09-12T00:38:10.702260+0000","last_unstale":"2024-09-12T01:08:21.817683+0000","last_undegraded":"2024-09-12T01:08:21.817683+0000","last_fullsized":"2024-09-12T01:08:21.817683+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:08:21.817351+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:08:21.817351+0000","last_clean_scrub_stamp":"2024-09-12T01:08:21.817351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:49.957008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'4","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.623838+0000","last_change":"2024-09-12T01:08:05.623671+0000","last_active":"2024-09-12T01:08:05.623838+0000","last_peered":"2024-09-12T01:08:05.623838+0000","last_clean":"2024-09-12T01:08:05.623838+0000","last_became_active":"2024-09-12T00:38:07.639687+0000","last_became_peered":"2024-09-12T00:38:07.639687+0000","last_unstale":"2024-09-12T01:08:05.623838+0000","last_undegraded":"2024-09-12T01:08:05.623838+0000","last_fullsized":"2024-09-12T01:08:05.623838+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:08:05.623473+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:08:05.623473+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.623473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:53.792955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'52","reported_seq":191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.375570+0000","last_change":"2024-09-12T01:08:25.375570+0000","last_active":"2024-09-12T01:08:25.375570+0000","last_peered":"2024-09-12T01:08:25.375570+0000","last_clean":"2024-09-12T01:08:25.375570+0000","last_became_active":"2024-09-12T00:36:37.239844+0000","last_became_peered":"2024-09-12T00:36:37.239844+0000","last_unstale":"2024-09-12T01:08:25.375570+0000","last_undegraded":"2024-09-12T01:08:25.375570+0000","last_fullsized":"2024-09-12T01:08:25.375570+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:08:25.375376+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:08:25.375376+0000","last_clean_scrub_stamp":"2024-09-12T01:08:25.375376+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:04.389145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":188,"num_write":97,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.261665+0000","last_change":"2024-09-12T01:08:19.261529+0000","last_active":"2024-09-12T01:08:19.261665+0000","last_peered":"2024-09-12T01:08:19.261665+0000","last_clean":"2024-09-12T01:08:19.261665+0000","last_became_active":"2024-09-12T00:49:10.632241+0000","last_became_peered":"2024-09-12T00:49:10.632241+0000","last_unstale":"2024-09-12T01:08:19.261665+0000","last_undegraded":"2024-09-12T01:08:19.261665+0000","last_fullsized":"2024-09-12T01:08:19.261665+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:19.261344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:19.261344+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.261344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.106696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"267'5","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.826973+0000","last_change":"2024-09-12T01:08:20.826792+0000","last_active":"2024-09-12T01:08:20.826973+0000","last_peered":"2024-09-12T01:08:20.826973+0000","last_clean":"2024-09-12T01:08:20.826973+0000","last_became_active":"2024-09-12T00:38:10.713890+0000","last_became_peered":"2024-09-12T00:38:10.713890+0000","last_unstale":"2024-09-12T01:08:20.826973+0000","last_undegraded":"2024-09-12T01:08:20.826973+0000","last_fullsized":"2024-09-12T01:08:20.826973+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:20.826603+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:20.826603+0000","last_clean_scrub_stamp":"2024-09-12T01:08:20.826603+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:35.486730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.830166+0000","last_change":"2024-09-12T01:08:15.830004+0000","last_active":"2024-09-12T01:08:15.830166+0000","last_peered":"2024-09-12T01:08:15.830166+0000","last_clean":"2024-09-12T01:08:15.830166+0000","last_became_active":"2024-09-12T00:38:07.667180+0000","last_became_peered":"2024-09-12T00:38:07.667180+0000","last_unstale":"2024-09-12T01:08:15.830166+0000","last_undegraded":"2024-09-12T01:08:15.830166+0000","last_fullsized":"2024-09-12T01:08:15.830166+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:08:15.829820+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:08:15.829820+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.829820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:05.011162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'23","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.339206+0000","last_change":"2024-09-12T01:08:04.339206+0000","last_active":"2024-09-12T01:08:04.339206+0000","last_peered":"2024-09-12T01:08:04.339206+0000","last_clean":"2024-09-12T01:08:04.339206+0000","last_became_active":"2024-09-12T00:36:37.248733+0000","last_became_peered":"2024-09-12T00:36:37.248733+0000","last_unstale":"2024-09-12T01:08:04.339206+0000","last_undegraded":"2024-09-12T01:08:04.339206+0000","last_fullsized":"2024-09-12T01:08:04.339206+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-12T01:08:04.339027+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-12T01:08:04.339027+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.339027+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.309511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.662121+0000","last_change":"2024-09-12T01:08:20.662121+0000","last_active":"2024-09-12T01:08:20.662121+0000","last_peered":"2024-09-12T01:08:20.662121+0000","last_clean":"2024-09-12T01:08:20.662121+0000","last_became_active":"2024-09-12T00:49:10.638628+0000","last_became_peered":"2024-09-12T00:49:10.638628+0000","last_unstale":"2024-09-12T01:08:20.662121+0000","last_undegraded":"2024-09-12T01:08:20.662121+0000","last_fullsized":"2024-09-12T01:08:20.662121+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:20.661885+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:20.661885+0000","last_clean_scrub_stamp":"2024-09-12T01:08:20.661885+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:56.860462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.251813+0000","last_change":"2024-09-12T01:08:17.251660+0000","last_active":"2024-09-12T01:08:17.251813+0000","last_peered":"2024-09-12T01:08:17.251813+0000","last_clean":"2024-09-12T01:08:17.251813+0000","last_became_active":"2024-09-12T00:38:10.691129+0000","last_became_peered":"2024-09-12T00:38:10.691129+0000","last_unstale":"2024-09-12T01:08:17.251813+0000","last_undegraded":"2024-09-12T01:08:17.251813+0000","last_fullsized":"2024-09-12T01:08:17.251813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:17.251475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:17.251475+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.251475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:26.577527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.610552+0000","last_change":"2024-09-12T01:08:10.610422+0000","last_active":"2024-09-12T01:08:10.610552+0000","last_peered":"2024-09-12T01:08:10.610552+0000","last_clean":"2024-09-12T01:08:10.610552+0000","last_became_active":"2024-09-12T00:38:07.641719+0000","last_became_peered":"2024-09-12T00:38:07.641719+0000","last_unstale":"2024-09-12T01:08:10.610552+0000","last_undegraded":"2024-09-12T01:08:10.610552+0000","last_fullsized":"2024-09-12T01:08:10.610552+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.610239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.610239+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.610239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:01.189388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'60","reported_seq":212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.108244+0000","last_change":"2024-09-12T01:08:04.108244+0000","last_active":"2024-09-12T01:08:04.108244+0000","last_peered":"2024-09-12T01:08:04.108244+0000","last_clean":"2024-09-12T01:08:04.108244+0000","last_became_active":"2024-09-12T00:36:37.223432+0000","last_became_peered":"2024-09-12T00:36:37.223432+0000","last_unstale":"2024-09-12T01:08:04.108244+0000","last_undegraded":"2024-09-12T01:08:04.108244+0000","last_fullsized":"2024-09-12T01:08:04.108244+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'60","last_scrub_stamp":"2024-09-12T01:08:04.107973+0000","last_deep_scrub":"267'60","last_deep_scrub_stamp":"2024-09-12T01:08:04.107973+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.107973+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:41.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":212,"num_write":101,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.273237+0000","last_change":"2024-09-12T01:08:17.273070+0000","last_active":"2024-09-12T01:08:17.273237+0000","last_peered":"2024-09-12T01:08:17.273237+0000","last_clean":"2024-09-12T01:08:17.273237+0000","last_became_active":"2024-09-12T00:49:10.634783+0000","last_became_peered":"2024-09-12T00:49:10.634783+0000","last_unstale":"2024-09-12T01:08:17.273237+0000","last_undegraded":"2024-09-12T01:08:17.273237+0000","last_fullsized":"2024-09-12T01:08:17.273237+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:17.272892+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:17.272892+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.272892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:31.183462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:06:14.655337+0000","last_change":"2024-09-12T00:38:10.709528+0000","last_active":"2024-09-12T01:06:14.655337+0000","last_peered":"2024-09-12T01:06:14.655337+0000","last_clean":"2024-09-12T01:06:14.655337+0000","last_became_active":"2024-09-12T00:38:10.708687+0000","last_became_peered":"2024-09-12T00:38:10.708687+0000","last_unstale":"2024-09-12T01:06:14.655337+0000","last_undegraded":"2024-09-12T01:06:14.655337+0000","last_fullsized":"2024-09-12T01:06:14.655337+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.605027+0000","last_change":"2024-09-12T01:08:06.604898+0000","last_active":"2024-09-12T01:08:06.605027+0000","last_peered":"2024-09-12T01:08:06.605027+0000","last_clean":"2024-09-12T01:08:06.605027+0000","last_became_active":"2024-09-12T00:38:07.636298+0000","last_became_peered":"2024-09-12T00:38:07.636298+0000","last_unstale":"2024-09-12T01:08:06.605027+0000","last_undegraded":"2024-09-12T01:08:06.605027+0000","last_fullsized":"2024-09-12T01:08:06.605027+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.604708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.604708+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.604708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:16.801689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.370709+0000","last_change":"2024-09-12T01:08:02.370709+0000","last_active":"2024-09-12T01:08:02.370709+0000","last_peered":"2024-09-12T01:08:02.370709+0000","last_clean":"2024-09-12T01:08:02.370709+0000","last_became_active":"2024-09-12T00:36:37.248770+0000","last_became_peered":"2024-09-12T00:36:37.248770+0000","last_unstale":"2024-09-12T01:08:02.370709+0000","last_undegraded":"2024-09-12T01:08:02.370709+0000","last_fullsized":"2024-09-12T01:08:02.370709+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-12T01:08:02.370499+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-12T01:08:02.370499+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.370499+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:07.319315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":141,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:29.807174+0000","last_change":"2024-09-12T01:08:29.807174+0000","last_active":"2024-09-12T01:08:29.807174+0000","last_peered":"2024-09-12T01:08:29.807174+0000","last_clean":"2024-09-12T01:08:29.807174+0000","last_became_active":"2024-09-12T00:49:10.596695+0000","last_became_peered":"2024-09-12T00:49:10.596695+0000","last_unstale":"2024-09-12T01:08:29.807174+0000","last_undegraded":"2024-09-12T01:08:29.807174+0000","last_fullsized":"2024-09-12T01:08:29.807174+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:29.806987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:29.806987+0000","last_clean_scrub_stamp":"2024-09-12T01:08:29.806987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:07.573407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.274812+0000","last_change":"2024-09-12T01:08:14.274812+0000","last_active":"2024-09-12T01:08:14.274812+0000","last_peered":"2024-09-12T01:08:14.274812+0000","last_clean":"2024-09-12T01:08:14.274812+0000","last_became_active":"2024-09-12T00:38:10.683024+0000","last_became_peered":"2024-09-12T00:38:10.683024+0000","last_unstale":"2024-09-12T01:08:14.274812+0000","last_undegraded":"2024-09-12T01:08:14.274812+0000","last_fullsized":"2024-09-12T01:08:14.274812+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:14.274607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:14.274607+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.274607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:26.296110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.303906+0000","last_change":"2024-09-12T01:08:14.303906+0000","last_active":"2024-09-12T01:08:14.303906+0000","last_peered":"2024-09-12T01:08:14.303906+0000","last_clean":"2024-09-12T01:08:14.303906+0000","last_became_active":"2024-09-12T00:38:07.663265+0000","last_became_peered":"2024-09-12T00:38:07.663265+0000","last_unstale":"2024-09-12T01:08:14.303906+0000","last_undegraded":"2024-09-12T01:08:14.303906+0000","last_fullsized":"2024-09-12T01:08:14.303906+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:14.303710+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:14.303710+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.303710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:35.415473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'15","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.417051+0000","last_change":"2024-09-12T01:08:01.416913+0000","last_active":"2024-09-12T01:08:01.417051+0000","last_peered":"2024-09-12T01:08:01.417051+0000","last_clean":"2024-09-12T01:08:01.417051+0000","last_became_active":"2024-09-12T00:36:37.247409+0000","last_became_peered":"2024-09-12T00:36:37.247409+0000","last_unstale":"2024-09-12T01:08:01.417051+0000","last_undegraded":"2024-09-12T01:08:01.417051+0000","last_fullsized":"2024-09-12T01:08:01.417051+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T01:08:01.416734+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T01:08:01.416734+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.416734+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:53.049074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":52,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.591961+0000","last_change":"2024-09-12T01:08:11.591961+0000","last_active":"2024-09-12T01:08:11.591961+0000","last_peered":"2024-09-12T01:08:11.591961+0000","last_clean":"2024-09-12T01:08:11.591961+0000","last_became_active":"2024-09-12T00:49:10.593471+0000","last_became_peered":"2024-09-12T00:49:10.593471+0000","last_unstale":"2024-09-12T01:08:11.591961+0000","last_undegraded":"2024-09-12T01:08:11.591961+0000","last_fullsized":"2024-09-12T01:08:11.591961+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.591737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.591737+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.591737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:19.864450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"267'4","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.245530+0000","last_change":"2024-09-12T01:08:15.245530+0000","last_active":"2024-09-12T01:08:15.245530+0000","last_peered":"2024-09-12T01:08:15.245530+0000","last_clean":"2024-09-12T01:08:15.245530+0000","last_became_active":"2024-09-12T00:38:10.708936+0000","last_became_peered":"2024-09-12T00:38:10.708936+0000","last_unstale":"2024-09-12T01:08:15.245530+0000","last_undegraded":"2024-09-12T01:08:15.245530+0000","last_fullsized":"2024-09-12T01:08:15.245530+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:15.245305+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:15.245305+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.245305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:59.730371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'8","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.280620+0000","last_change":"2024-09-12T01:08:13.280620+0000","last_active":"2024-09-12T01:08:13.280620+0000","last_peered":"2024-09-12T01:08:13.280620+0000","last_clean":"2024-09-12T01:08:13.280620+0000","last_became_active":"2024-09-12T00:38:07.650419+0000","last_became_peered":"2024-09-12T00:38:07.650419+0000","last_unstale":"2024-09-12T01:08:13.280620+0000","last_undegraded":"2024-09-12T01:08:13.280620+0000","last_fullsized":"2024-09-12T01:08:13.280620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.280450+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.280450+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.280450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:22.910988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'99","reported_seq":362,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:24.395923+0000","last_change":"2024-09-12T01:08:24.395923+0000","last_active":"2024-09-12T01:08:24.395923+0000","last_peered":"2024-09-12T01:08:24.395923+0000","last_clean":"2024-09-12T01:08:24.395923+0000","last_became_active":"2024-09-12T00:36:37.225615+0000","last_became_peered":"2024-09-12T00:36:37.225615+0000","last_unstale":"2024-09-12T01:08:24.395923+0000","last_undegraded":"2024-09-12T01:08:24.395923+0000","last_fullsized":"2024-09-12T01:08:24.395923+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'99","last_scrub_stamp":"2024-09-12T01:08:24.395698+0000","last_deep_scrub":"267'99","last_deep_scrub_stamp":"2024-09-12T01:08:24.395698+0000","last_clean_scrub_stamp":"2024-09-12T01:08:24.395698+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:35.962824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":608,"num_read_kb":444,"num_write":119,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3472,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:04:19.626251+0000","last_change":"2024-09-12T00:49:10.620839+0000","last_active":"2024-09-12T01:04:19.626251+0000","last_peered":"2024-09-12T01:04:19.626251+0000","last_clean":"2024-09-12T01:04:19.626251+0000","last_became_active":"2024-09-12T00:49:10.620169+0000","last_became_peered":"2024-09-12T00:49:10.620169+0000","last_unstale":"2024-09-12T01:04:19.626251+0000","last_undegraded":"2024-09-12T01:04:19.626251+0000","last_fullsized":"2024-09-12T01:04:19.626251+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.688639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.291688+0000","last_change":"2024-09-12T01:08:16.291688+0000","last_active":"2024-09-12T01:08:16.291688+0000","last_peered":"2024-09-12T01:08:16.291688+0000","last_clean":"2024-09-12T01:08:16.291688+0000","last_became_active":"2024-09-12T00:38:10.686216+0000","last_became_peered":"2024-09-12T00:38:10.686216+0000","last_unstale":"2024-09-12T01:08:16.291688+0000","last_undegraded":"2024-09-12T01:08:16.291688+0000","last_fullsized":"2024-09-12T01:08:16.291688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:08:16.291455+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:08:16.291455+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.291455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:28.941951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"267'4","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.326125+0000","last_change":"2024-09-12T01:08:09.326125+0000","last_active":"2024-09-12T01:08:09.326125+0000","last_peered":"2024-09-12T01:08:09.326125+0000","last_clean":"2024-09-12T01:08:09.326125+0000","last_became_active":"2024-09-12T00:38:07.661932+0000","last_became_peered":"2024-09-12T00:38:07.661932+0000","last_unstale":"2024-09-12T01:08:09.326125+0000","last_undegraded":"2024-09-12T01:08:09.326125+0000","last_fullsized":"2024-09-12T01:08:09.326125+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:09.325954+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:09.325954+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.325954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:53.038590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'12","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.612359+0000","last_change":"2024-09-12T01:08:03.612143+0000","last_active":"2024-09-12T01:08:03.612359+0000","last_peered":"2024-09-12T01:08:03.612359+0000","last_clean":"2024-09-12T01:08:03.612359+0000","last_became_active":"2024-09-12T00:36:37.226992+0000","last_became_peered":"2024-09-12T00:36:37.226992+0000","last_unstale":"2024-09-12T01:08:03.612359+0000","last_undegraded":"2024-09-12T01:08:03.612359+0000","last_fullsized":"2024-09-12T01:08:03.612359+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:03.611953+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:03.611953+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.611953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:17.131804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.578158+0000","last_change":"2024-09-12T01:08:09.578158+0000","last_active":"2024-09-12T01:08:09.578158+0000","last_peered":"2024-09-12T01:08:09.578158+0000","last_clean":"2024-09-12T01:08:09.578158+0000","last_became_active":"2024-09-12T00:49:10.597349+0000","last_became_peered":"2024-09-12T00:49:10.597349+0000","last_unstale":"2024-09-12T01:08:09.578158+0000","last_undegraded":"2024-09-12T01:08:09.578158+0000","last_fullsized":"2024-09-12T01:08:09.578158+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.577973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.577973+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.577973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:36.223547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"267'11","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.866269+0000","last_change":"2024-09-12T01:08:23.866269+0000","last_active":"2024-09-12T01:08:23.866269+0000","last_peered":"2024-09-12T01:08:23.866269+0000","last_clean":"2024-09-12T01:08:23.866269+0000","last_became_active":"2024-09-12T00:38:10.700892+0000","last_became_peered":"2024-09-12T00:38:10.700892+0000","last_unstale":"2024-09-12T01:08:23.866269+0000","last_undegraded":"2024-09-12T01:08:23.866269+0000","last_fullsized":"2024-09-12T01:08:23.866269+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-12T01:08:23.866078+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-12T01:08:23.866078+0000","last_clean_scrub_stamp":"2024-09-12T01:08:23.866078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:27.768157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":16,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.324475+0000","last_change":"2024-09-12T01:08:11.324475+0000","last_active":"2024-09-12T01:08:11.324475+0000","last_peered":"2024-09-12T01:08:11.324475+0000","last_clean":"2024-09-12T01:08:11.324475+0000","last_became_active":"2024-09-12T00:38:07.642924+0000","last_became_peered":"2024-09-12T00:38:07.642924+0000","last_unstale":"2024-09-12T01:08:11.324475+0000","last_undegraded":"2024-09-12T01:08:11.324475+0000","last_fullsized":"2024-09-12T01:08:11.324475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.324299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.324299+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.324299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:47.427053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'31","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.317274+0000","last_change":"2024-09-12T01:08:06.317033+0000","last_active":"2024-09-12T01:08:06.317274+0000","last_peered":"2024-09-12T01:08:06.317274+0000","last_clean":"2024-09-12T01:08:06.317274+0000","last_became_active":"2024-09-12T00:36:37.238481+0000","last_became_peered":"2024-09-12T00:36:37.238481+0000","last_unstale":"2024-09-12T01:08:06.317274+0000","last_undegraded":"2024-09-12T01:08:06.317274+0000","last_fullsized":"2024-09-12T01:08:06.317274+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'31","last_scrub_stamp":"2024-09-12T01:08:06.316765+0000","last_deep_scrub":"267'31","last_deep_scrub_stamp":"2024-09-12T01:08:06.316765+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.316765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:48.687142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":121,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.767774+0000","last_change":"2024-09-12T01:08:30.767774+0000","last_active":"2024-09-12T01:08:30.767774+0000","last_peered":"2024-09-12T01:08:30.767774+0000","last_clean":"2024-09-12T01:08:30.767774+0000","last_became_active":"2024-09-12T00:49:10.613613+0000","last_became_peered":"2024-09-12T00:49:10.613613+0000","last_unstale":"2024-09-12T01:08:30.767774+0000","last_undegraded":"2024-09-12T01:08:30.767774+0000","last_fullsized":"2024-09-12T01:08:30.767774+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:30.767592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:30.767592+0000","last_clean_scrub_stamp":"2024-09-12T01:08:30.767592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:43.060113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:26.996780+0000","last_change":"2024-09-12T00:38:10.695438+0000","last_active":"2024-09-12T01:07:26.996780+0000","last_peered":"2024-09-12T01:07:26.996780+0000","last_clean":"2024-09-12T01:07:26.996780+0000","last_became_active":"2024-09-12T00:38:10.694714+0000","last_became_peered":"2024-09-12T00:38:10.694714+0000","last_unstale":"2024-09-12T01:07:26.996780+0000","last_undegraded":"2024-09-12T01:07:26.996780+0000","last_fullsized":"2024-09-12T01:07:26.996780+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:09.644882+0000","last_clean_scrub_stamp":"2024-09-12T00:38:09.644882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.363934+0000","last_change":"2024-09-12T01:08:05.363751+0000","last_active":"2024-09-12T01:08:05.363934+0000","last_peered":"2024-09-12T01:08:05.363934+0000","last_clean":"2024-09-12T01:08:05.363934+0000","last_became_active":"2024-09-12T00:38:07.647225+0000","last_became_peered":"2024-09-12T00:38:07.647225+0000","last_unstale":"2024-09-12T01:08:05.363934+0000","last_undegraded":"2024-09-12T01:08:05.363934+0000","last_fullsized":"2024-09-12T01:08:05.363934+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:05.363578+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:05.363578+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.363578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:18.312235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.267524+0000","last_change":"2024-09-12T01:08:05.267395+0000","last_active":"2024-09-12T01:08:05.267524+0000","last_peered":"2024-09-12T01:08:05.267524+0000","last_clean":"2024-09-12T01:08:05.267524+0000","last_became_active":"2024-09-12T00:36:37.246075+0000","last_became_peered":"2024-09-12T00:36:37.246075+0000","last_unstale":"2024-09-12T01:08:05.267524+0000","last_undegraded":"2024-09-12T01:08:05.267524+0000","last_fullsized":"2024-09-12T01:08:05.267524+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:05.267221+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:05.267221+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.267221+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:18.024035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.319904+0000","last_change":"2024-09-12T01:08:15.319904+0000","last_active":"2024-09-12T01:08:15.319904+0000","last_peered":"2024-09-12T01:08:15.319904+0000","last_clean":"2024-09-12T01:08:15.319904+0000","last_became_active":"2024-09-12T00:49:10.597773+0000","last_became_peered":"2024-09-12T00:49:10.597773+0000","last_unstale":"2024-09-12T01:08:15.319904+0000","last_undegraded":"2024-09-12T01:08:15.319904+0000","last_fullsized":"2024-09-12T01:08:15.319904+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:15.319718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:15.319718+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.319718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:00.720579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.225378+0000","last_change":"2024-09-12T01:08:12.225131+0000","last_active":"2024-09-12T01:08:12.225378+0000","last_peered":"2024-09-12T01:08:12.225378+0000","last_clean":"2024-09-12T01:08:12.225378+0000","last_became_active":"2024-09-12T00:38:10.697403+0000","last_became_peered":"2024-09-12T00:38:10.697403+0000","last_unstale":"2024-09-12T01:08:12.225378+0000","last_undegraded":"2024-09-12T01:08:12.225378+0000","last_fullsized":"2024-09-12T01:08:12.225378+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:12.224908+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:12.224908+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.224908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:50.759178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.797700+0000","last_change":"2024-09-12T01:08:14.797433+0000","last_active":"2024-09-12T01:08:14.797700+0000","last_peered":"2024-09-12T01:08:14.797700+0000","last_clean":"2024-09-12T01:08:14.797700+0000","last_became_active":"2024-09-12T00:38:07.667447+0000","last_became_peered":"2024-09-12T00:38:07.667447+0000","last_unstale":"2024-09-12T01:08:14.797700+0000","last_undegraded":"2024-09-12T01:08:14.797700+0000","last_fullsized":"2024-09-12T01:08:14.797700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:14.797197+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:14.797197+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.797197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:24.172057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'28","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.094804+0000","last_change":"2024-09-12T01:08:03.094804+0000","last_active":"2024-09-12T01:08:03.094804+0000","last_peered":"2024-09-12T01:08:03.094804+0000","last_clean":"2024-09-12T01:08:03.094804+0000","last_became_active":"2024-09-12T00:36:37.239946+0000","last_became_peered":"2024-09-12T00:36:37.239946+0000","last_unstale":"2024-09-12T01:08:03.094804+0000","last_undegraded":"2024-09-12T01:08:03.094804+0000","last_fullsized":"2024-09-12T01:08:03.094804+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T01:08:03.094601+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T01:08:03.094601+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.094601+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:09.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.042174+0000","last_change":"2024-09-12T01:08:06.042174+0000","last_active":"2024-09-12T01:08:06.042174+0000","last_peered":"2024-09-12T01:08:06.042174+0000","last_clean":"2024-09-12T01:08:06.042174+0000","last_became_active":"2024-09-12T00:49:10.629903+0000","last_became_peered":"2024-09-12T00:49:10.629903+0000","last_unstale":"2024-09-12T01:08:06.042174+0000","last_undegraded":"2024-09-12T01:08:06.042174+0000","last_fullsized":"2024-09-12T01:08:06.042174+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:06.041988+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:06.041988+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.041988+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.998494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'2","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.327487+0000","last_change":"2024-09-12T01:08:15.327487+0000","last_active":"2024-09-12T01:08:15.327487+0000","last_peered":"2024-09-12T01:08:15.327487+0000","last_clean":"2024-09-12T01:08:15.327487+0000","last_became_active":"2024-09-12T00:38:10.708820+0000","last_became_peered":"2024-09-12T00:38:10.708820+0000","last_unstale":"2024-09-12T01:08:15.327487+0000","last_undegraded":"2024-09-12T01:08:15.327487+0000","last_fullsized":"2024-09-12T01:08:15.327487+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:15.327303+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:15.327303+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.327303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:52.502152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.291167+0000","last_change":"2024-09-12T01:08:08.291167+0000","last_active":"2024-09-12T01:08:08.291167+0000","last_peered":"2024-09-12T01:08:08.291167+0000","last_clean":"2024-09-12T01:08:08.291167+0000","last_became_active":"2024-09-12T00:38:07.644752+0000","last_became_peered":"2024-09-12T00:38:07.644752+0000","last_unstale":"2024-09-12T01:08:08.291167+0000","last_undegraded":"2024-09-12T01:08:08.291167+0000","last_fullsized":"2024-09-12T01:08:08.291167+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:08.290956+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:08.290956+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.290956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:17.143413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"267'56","reported_seq":210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.846557+0000","last_change":"2024-09-12T01:08:12.846557+0000","last_active":"2024-09-12T01:08:12.846557+0000","last_peered":"2024-09-12T01:08:12.846557+0000","last_clean":"2024-09-12T01:08:12.846557+0000","last_became_active":"2024-09-12T00:36:37.246402+0000","last_became_peered":"2024-09-12T00:36:37.246402+0000","last_unstale":"2024-09-12T01:08:12.846557+0000","last_undegraded":"2024-09-12T01:08:12.846557+0000","last_fullsized":"2024-09-12T01:08:12.846557+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'56","last_scrub_stamp":"2024-09-12T01:08:12.846373+0000","last_deep_scrub":"267'56","last_deep_scrub_stamp":"2024-09-12T01:08:12.846373+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.846373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:19.960581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":211,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.198545+0000","last_change":"2024-09-12T01:08:21.198545+0000","last_active":"2024-09-12T01:08:21.198545+0000","last_peered":"2024-09-12T01:08:21.198545+0000","last_clean":"2024-09-12T01:08:21.198545+0000","last_became_active":"2024-09-12T00:49:10.626918+0000","last_became_peered":"2024-09-12T00:49:10.626918+0000","last_unstale":"2024-09-12T01:08:21.198545+0000","last_undegraded":"2024-09-12T01:08:21.198545+0000","last_fullsized":"2024-09-12T01:08:21.198545+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:21.198353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:21.198353+0000","last_clean_scrub_stamp":"2024-09-12T01:08:21.198353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:47.837715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"267'7","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.080034+0000","last_change":"2024-09-12T01:08:03.080034+0000","last_active":"2024-09-12T01:08:03.080034+0000","last_peered":"2024-09-12T01:08:03.080034+0000","last_clean":"2024-09-12T01:08:03.080034+0000","last_became_active":"2024-09-12T00:38:10.705817+0000","last_became_peered":"2024-09-12T00:38:10.705817+0000","last_unstale":"2024-09-12T01:08:03.080034+0000","last_undegraded":"2024-09-12T01:08:03.080034+0000","last_fullsized":"2024-09-12T01:08:03.080034+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:03.079826+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:03.079826+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.079826+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:27.973354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.271411+0000","last_change":"2024-09-12T01:08:30.271411+0000","last_active":"2024-09-12T01:08:30.271411+0000","last_peered":"2024-09-12T01:08:30.271411+0000","last_clean":"2024-09-12T01:08:30.271411+0000","last_became_active":"2024-09-12T00:38:07.654306+0000","last_became_peered":"2024-09-12T00:38:07.654306+0000","last_unstale":"2024-09-12T01:08:30.271411+0000","last_undegraded":"2024-09-12T01:08:30.271411+0000","last_fullsized":"2024-09-12T01:08:30.271411+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:30.271194+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:30.271194+0000","last_clean_scrub_stamp":"2024-09-12T01:08:30.271194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:51.280793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"267'61","reported_seq":258,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.035695+0000","last_change":"2024-09-12T01:08:00.035695+0000","last_active":"2024-09-12T01:08:00.035695+0000","last_peered":"2024-09-12T01:08:00.035695+0000","last_clean":"2024-09-12T01:08:00.035695+0000","last_became_active":"2024-09-12T00:36:37.226845+0000","last_became_peered":"2024-09-12T00:36:37.226845+0000","last_unstale":"2024-09-12T01:08:00.035695+0000","last_undegraded":"2024-09-12T01:08:00.035695+0000","last_fullsized":"2024-09-12T01:08:00.035695+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'61","last_scrub_stamp":"2024-09-12T01:08:00.035462+0000","last_deep_scrub":"267'61","last_deep_scrub_stamp":"2024-09-12T01:08:00.035462+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.035462+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:09.421929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":408,"num_read_kb":294,"num_write":66,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3514,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.076548+0000","last_change":"2024-09-12T01:08:05.076548+0000","last_active":"2024-09-12T01:08:05.076548+0000","last_peered":"2024-09-12T01:08:05.076548+0000","last_clean":"2024-09-12T01:08:05.076548+0000","last_became_active":"2024-09-12T00:49:10.615566+0000","last_became_peered":"2024-09-12T00:49:10.615566+0000","last_unstale":"2024-09-12T01:08:05.076548+0000","last_undegraded":"2024-09-12T01:08:05.076548+0000","last_fullsized":"2024-09-12T01:08:05.076548+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:05.076371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:05.076371+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.076371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:05.804297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'7","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.817802+0000","last_change":"2024-09-12T01:08:22.817802+0000","last_active":"2024-09-12T01:08:22.817802+0000","last_peered":"2024-09-12T01:08:22.817802+0000","last_clean":"2024-09-12T01:08:22.817802+0000","last_became_active":"2024-09-12T00:38:10.705207+0000","last_became_peered":"2024-09-12T00:38:10.705207+0000","last_unstale":"2024-09-12T01:08:22.817802+0000","last_undegraded":"2024-09-12T01:08:22.817802+0000","last_fullsized":"2024-09-12T01:08:22.817802+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:22.817620+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:22.817620+0000","last_clean_scrub_stamp":"2024-09-12T01:08:22.817620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:35.109448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'11","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.311629+0000","last_change":"2024-09-12T01:08:27.311629+0000","last_active":"2024-09-12T01:08:27.311629+0000","last_peered":"2024-09-12T01:08:27.311629+0000","last_clean":"2024-09-12T01:08:27.311629+0000","last_became_active":"2024-09-12T00:38:07.663031+0000","last_became_peered":"2024-09-12T00:38:07.663031+0000","last_unstale":"2024-09-12T01:08:27.311629+0000","last_undegraded":"2024-09-12T01:08:27.311629+0000","last_fullsized":"2024-09-12T01:08:27.311629+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-12T01:08:27.311376+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-12T01:08:27.311376+0000","last_clean_scrub_stamp":"2024-09-12T01:08:27.311376+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:33.969449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24578,"num_write":26,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'40","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.500368+0000","last_change":"2024-09-12T01:08:11.500368+0000","last_active":"2024-09-12T01:08:11.500368+0000","last_peered":"2024-09-12T01:08:11.500368+0000","last_clean":"2024-09-12T01:08:11.500368+0000","last_became_active":"2024-09-12T00:36:37.250649+0000","last_became_peered":"2024-09-12T00:36:37.250649+0000","last_unstale":"2024-09-12T01:08:11.500368+0000","last_undegraded":"2024-09-12T01:08:11.500368+0000","last_fullsized":"2024-09-12T01:08:11.500368+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:11.500148+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:11.500148+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.500148+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:48.043569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":70,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.064333+0000","last_change":"2024-09-12T01:08:07.064333+0000","last_active":"2024-09-12T01:08:07.064333+0000","last_peered":"2024-09-12T01:08:07.064333+0000","last_clean":"2024-09-12T01:08:07.064333+0000","last_became_active":"2024-09-12T00:49:10.634433+0000","last_became_peered":"2024-09-12T00:49:10.634433+0000","last_unstale":"2024-09-12T01:08:07.064333+0000","last_undegraded":"2024-09-12T01:08:07.064333+0000","last_fullsized":"2024-09-12T01:08:07.064333+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:07.064155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:07.064155+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.064155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.708114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.789378+0000","last_change":"2024-09-12T01:08:18.789378+0000","last_active":"2024-09-12T01:08:18.789378+0000","last_peered":"2024-09-12T01:08:18.789378+0000","last_clean":"2024-09-12T01:08:18.789378+0000","last_became_active":"2024-09-12T00:38:10.717307+0000","last_became_peered":"2024-09-12T00:38:10.717307+0000","last_unstale":"2024-09-12T01:08:18.789378+0000","last_undegraded":"2024-09-12T01:08:18.789378+0000","last_fullsized":"2024-09-12T01:08:18.789378+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:08:18.789203+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:08:18.789203+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.789203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:30.848964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'10","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.602352+0000","last_change":"2024-09-12T01:08:16.602352+0000","last_active":"2024-09-12T01:08:16.602352+0000","last_peered":"2024-09-12T01:08:16.602352+0000","last_clean":"2024-09-12T01:08:16.602352+0000","last_became_active":"2024-09-12T00:38:07.659692+0000","last_became_peered":"2024-09-12T00:38:07.659692+0000","last_unstale":"2024-09-12T01:08:16.602352+0000","last_undegraded":"2024-09-12T01:08:16.602352+0000","last_fullsized":"2024-09-12T01:08:16.602352+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T01:08:16.602022+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T01:08:16.602022+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.602022+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:02.350594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'22","reported_seq":108,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.362883+0000","last_change":"2024-09-12T01:08:23.362883+0000","last_active":"2024-09-12T01:08:23.362883+0000","last_peered":"2024-09-12T01:08:23.362883+0000","last_clean":"2024-09-12T01:08:23.362883+0000","last_became_active":"2024-09-12T00:36:37.226892+0000","last_became_peered":"2024-09-12T00:36:37.226892+0000","last_unstale":"2024-09-12T01:08:23.362883+0000","last_undegraded":"2024-09-12T01:08:23.362883+0000","last_fullsized":"2024-09-12T01:08:23.362883+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-12T01:08:23.362693+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-12T01:08:23.362693+0000","last_clean_scrub_stamp":"2024-09-12T01:08:23.362693+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:41.341127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.835177+0000","last_change":"2024-09-12T01:08:27.835177+0000","last_active":"2024-09-12T01:08:27.835177+0000","last_peered":"2024-09-12T01:08:27.835177+0000","last_clean":"2024-09-12T01:08:27.835177+0000","last_became_active":"2024-09-12T00:49:10.631961+0000","last_became_peered":"2024-09-12T00:49:10.631961+0000","last_unstale":"2024-09-12T01:08:27.835177+0000","last_undegraded":"2024-09-12T01:08:27.835177+0000","last_fullsized":"2024-09-12T01:08:27.835177+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:27.834987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:27.834987+0000","last_clean_scrub_stamp":"2024-09-12T01:08:27.834987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:01.551634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'2","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.023244+0000","last_change":"2024-09-12T01:07:59.023173+0000","last_active":"2024-09-12T01:07:59.023244+0000","last_peered":"2024-09-12T01:07:59.023244+0000","last_clean":"2024-09-12T01:07:59.023244+0000","last_became_active":"2024-09-12T00:38:10.719337+0000","last_became_peered":"2024-09-12T00:38:10.719337+0000","last_unstale":"2024-09-12T01:07:59.023244+0000","last_undegraded":"2024-09-12T01:07:59.023244+0000","last_fullsized":"2024-09-12T01:07:59.023244+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:59.023072+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:59.023072+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.023072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:23.472503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"267'7","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.145798+0000","last_change":"2024-09-12T01:08:07.145572+0000","last_active":"2024-09-12T01:08:07.145798+0000","last_peered":"2024-09-12T01:08:07.145798+0000","last_clean":"2024-09-12T01:08:07.145798+0000","last_became_active":"2024-09-12T00:38:07.639751+0000","last_became_peered":"2024-09-12T00:38:07.639751+0000","last_unstale":"2024-09-12T01:08:07.145798+0000","last_undegraded":"2024-09-12T01:08:07.145798+0000","last_fullsized":"2024-09-12T01:08:07.145798+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:07.145408+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:07.145408+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.145408+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:59.224526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'40","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.098655+0000","last_change":"2024-09-12T01:08:06.098655+0000","last_active":"2024-09-12T01:08:06.098655+0000","last_peered":"2024-09-12T01:08:06.098655+0000","last_clean":"2024-09-12T01:08:06.098655+0000","last_became_active":"2024-09-12T00:36:37.248176+0000","last_became_peered":"2024-09-12T00:36:37.248176+0000","last_unstale":"2024-09-12T01:08:06.098655+0000","last_undegraded":"2024-09-12T01:08:06.098655+0000","last_fullsized":"2024-09-12T01:08:06.098655+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:06.098449+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:06.098449+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.098449+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:34.464246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.649578+0000","last_change":"2024-09-12T00:49:10.635581+0000","last_active":"2024-09-12T01:05:49.649578+0000","last_peered":"2024-09-12T01:05:49.649578+0000","last_clean":"2024-09-12T01:05:49.649578+0000","last_became_active":"2024-09-12T00:49:10.634965+0000","last_became_peered":"2024-09-12T00:49:10.634965+0000","last_unstale":"2024-09-12T01:05:49.649578+0000","last_undegraded":"2024-09-12T01:05:49.649578+0000","last_fullsized":"2024-09-12T01:05:49.649578+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:34.392279+0000","last_change":"2024-09-12T01:08:34.391970+0000","last_active":"2024-09-12T01:08:34.392279+0000","last_peered":"2024-09-12T01:08:34.392279+0000","last_clean":"2024-09-12T01:08:34.392279+0000","last_became_active":"2024-09-12T00:38:10.694812+0000","last_became_peered":"2024-09-12T00:38:10.694812+0000","last_unstale":"2024-09-12T01:08:34.392279+0000","last_undegraded":"2024-09-12T01:08:34.392279+0000","last_fullsized":"2024-09-12T01:08:34.392279+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:34.391746+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:34.391746+0000","last_clean_scrub_stamp":"2024-09-12T01:08:34.391746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:35.499750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'6","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:29.296070+0000","last_change":"2024-09-12T01:08:29.295932+0000","last_active":"2024-09-12T01:08:29.296070+0000","last_peered":"2024-09-12T01:08:29.296070+0000","last_clean":"2024-09-12T01:08:29.296070+0000","last_became_active":"2024-09-12T00:38:07.648061+0000","last_became_peered":"2024-09-12T00:38:07.648061+0000","last_unstale":"2024-09-12T01:08:29.296070+0000","last_undegraded":"2024-09-12T01:08:29.296070+0000","last_fullsized":"2024-09-12T01:08:29.296070+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:29.295749+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:29.295749+0000","last_clean_scrub_stamp":"2024-09-12T01:08:29.295749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:26.117594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'35","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.335923+0000","last_change":"2024-09-12T01:08:03.335923+0000","last_active":"2024-09-12T01:08:03.335923+0000","last_peered":"2024-09-12T01:08:03.335923+0000","last_clean":"2024-09-12T01:08:03.335923+0000","last_became_active":"2024-09-12T00:36:37.244096+0000","last_became_peered":"2024-09-12T00:36:37.244096+0000","last_unstale":"2024-09-12T01:08:03.335923+0000","last_undegraded":"2024-09-12T01:08:03.335923+0000","last_fullsized":"2024-09-12T01:08:03.335923+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'35","last_scrub_stamp":"2024-09-12T01:08:03.335738+0000","last_deep_scrub":"267'35","last_deep_scrub_stamp":"2024-09-12T01:08:03.335738+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.335738+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:24.722385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":53,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.217320+0000","last_change":"2024-09-12T01:08:22.217320+0000","last_active":"2024-09-12T01:08:22.217320+0000","last_peered":"2024-09-12T01:08:22.217320+0000","last_clean":"2024-09-12T01:08:22.217320+0000","last_became_active":"2024-09-12T00:49:10.621968+0000","last_became_peered":"2024-09-12T00:49:10.621968+0000","last_unstale":"2024-09-12T01:08:22.217320+0000","last_undegraded":"2024-09-12T01:08:22.217320+0000","last_fullsized":"2024-09-12T01:08:22.217320+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:22.217119+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:22.217119+0000","last_clean_scrub_stamp":"2024-09-12T01:08:22.217119+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:55.399438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.576025+0000","last_change":"2024-09-12T01:08:17.576025+0000","last_active":"2024-09-12T01:08:17.576025+0000","last_peered":"2024-09-12T01:08:17.576025+0000","last_clean":"2024-09-12T01:08:17.576025+0000","last_became_active":"2024-09-12T00:38:10.717877+0000","last_became_peered":"2024-09-12T00:38:10.717877+0000","last_unstale":"2024-09-12T01:08:17.576025+0000","last_undegraded":"2024-09-12T01:08:17.576025+0000","last_fullsized":"2024-09-12T01:08:17.576025+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:17.575808+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:17.575808+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.575808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:29.432969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"267'5","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.185626+0000","last_change":"2024-09-12T01:08:08.185367+0000","last_active":"2024-09-12T01:08:08.185626+0000","last_peered":"2024-09-12T01:08:08.185626+0000","last_clean":"2024-09-12T01:08:08.185626+0000","last_became_active":"2024-09-12T00:38:07.648786+0000","last_became_peered":"2024-09-12T00:38:07.648786+0000","last_unstale":"2024-09-12T01:08:08.185626+0000","last_undegraded":"2024-09-12T01:08:08.185626+0000","last_fullsized":"2024-09-12T01:08:08.185626+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:08.185073+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:08.185073+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.185073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.827185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.142583+0000","last_change":"2024-09-12T01:08:02.142583+0000","last_active":"2024-09-12T01:08:02.142583+0000","last_peered":"2024-09-12T01:08:02.142583+0000","last_clean":"2024-09-12T01:08:02.142583+0000","last_became_active":"2024-09-12T00:36:37.237365+0000","last_became_peered":"2024-09-12T00:36:37.237365+0000","last_unstale":"2024-09-12T01:08:02.142583+0000","last_undegraded":"2024-09-12T01:08:02.142583+0000","last_fullsized":"2024-09-12T01:08:02.142583+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:08:02.142397+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:08:02.142397+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.142397+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:21.499061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":152,"num_write":73,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.602706+0000","last_change":"2024-09-12T01:08:18.602706+0000","last_active":"2024-09-12T01:08:18.602706+0000","last_peered":"2024-09-12T01:08:18.602706+0000","last_clean":"2024-09-12T01:08:18.602706+0000","last_became_active":"2024-09-12T00:49:10.628111+0000","last_became_peered":"2024-09-12T00:49:10.628111+0000","last_unstale":"2024-09-12T01:08:18.602706+0000","last_undegraded":"2024-09-12T01:08:18.602706+0000","last_fullsized":"2024-09-12T01:08:18.602706+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:18.602501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:18.602501+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.602501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:48.858373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'6","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.345291+0000","last_change":"2024-09-12T01:08:33.345291+0000","last_active":"2024-09-12T01:08:33.345291+0000","last_peered":"2024-09-12T01:08:33.345291+0000","last_clean":"2024-09-12T01:08:33.345291+0000","last_became_active":"2024-09-12T00:38:10.696553+0000","last_became_peered":"2024-09-12T00:38:10.696553+0000","last_unstale":"2024-09-12T01:08:33.345291+0000","last_undegraded":"2024-09-12T01:08:33.345291+0000","last_fullsized":"2024-09-12T01:08:33.345291+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:33.345098+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:33.345098+0000","last_clean_scrub_stamp":"2024-09-12T01:08:33.345098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:57.508560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3168,"num_write":6,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'4","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.292631+0000","last_change":"2024-09-12T01:08:28.292631+0000","last_active":"2024-09-12T01:08:28.292631+0000","last_peered":"2024-09-12T01:08:28.292631+0000","last_clean":"2024-09-12T01:08:28.292631+0000","last_became_active":"2024-09-12T00:38:07.669959+0000","last_became_peered":"2024-09-12T00:38:07.669959+0000","last_unstale":"2024-09-12T01:08:28.292631+0000","last_undegraded":"2024-09-12T01:08:28.292631+0000","last_fullsized":"2024-09-12T01:08:28.292631+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:28.292443+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:28.292443+0000","last_clean_scrub_stamp":"2024-09-12T01:08:28.292443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:56.211509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.378248+0000","last_change":"2024-09-12T01:08:22.378248+0000","last_active":"2024-09-12T01:08:22.378248+0000","last_peered":"2024-09-12T01:08:22.378248+0000","last_clean":"2024-09-12T01:08:22.378248+0000","last_became_active":"2024-09-12T00:36:37.228954+0000","last_became_peered":"2024-09-12T00:36:37.228954+0000","last_unstale":"2024-09-12T01:08:22.378248+0000","last_undegraded":"2024-09-12T01:08:22.378248+0000","last_fullsized":"2024-09-12T01:08:22.378248+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:08:22.378066+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:08:22.378066+0000","last_clean_scrub_stamp":"2024-09-12T01:08:22.378066+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:20.109800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.788884+0000","last_change":"2024-09-12T01:08:28.788884+0000","last_active":"2024-09-12T01:08:28.788884+0000","last_peered":"2024-09-12T01:08:28.788884+0000","last_clean":"2024-09-12T01:08:28.788884+0000","last_became_active":"2024-09-12T00:49:10.592753+0000","last_became_peered":"2024-09-12T00:49:10.592753+0000","last_unstale":"2024-09-12T01:08:28.788884+0000","last_undegraded":"2024-09-12T01:08:28.788884+0000","last_fullsized":"2024-09-12T01:08:28.788884+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:28.788703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:28.788703+0000","last_clean_scrub_stamp":"2024-09-12T01:08:28.788703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:54.195605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.161156+0000","last_change":"2024-09-12T01:08:10.161156+0000","last_active":"2024-09-12T01:08:10.161156+0000","last_peered":"2024-09-12T01:08:10.161156+0000","last_clean":"2024-09-12T01:08:10.161156+0000","last_became_active":"2024-09-12T00:38:10.702958+0000","last_became_peered":"2024-09-12T00:38:10.702958+0000","last_unstale":"2024-09-12T01:08:10.161156+0000","last_undegraded":"2024-09-12T01:08:10.161156+0000","last_fullsized":"2024-09-12T01:08:10.161156+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:10.160971+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:10.160971+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.160971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:00.071414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.262437+0000","last_change":"2024-09-12T01:08:12.262437+0000","last_active":"2024-09-12T01:08:12.262437+0000","last_peered":"2024-09-12T01:08:12.262437+0000","last_clean":"2024-09-12T01:08:12.262437+0000","last_became_active":"2024-09-12T00:38:07.650035+0000","last_became_peered":"2024-09-12T00:38:07.650035+0000","last_unstale":"2024-09-12T01:08:12.262437+0000","last_undegraded":"2024-09-12T01:08:12.262437+0000","last_fullsized":"2024-09-12T01:08:12.262437+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:12.262216+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:12.262216+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.262216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:23.548955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"258'11","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.254471+0000","last_change":"2024-09-12T01:08:14.254471+0000","last_active":"2024-09-12T01:08:14.254471+0000","last_peered":"2024-09-12T01:08:14.254471+0000","last_clean":"2024-09-12T01:08:14.254471+0000","last_became_active":"2024-09-12T00:36:37.222545+0000","last_became_peered":"2024-09-12T00:36:37.222545+0000","last_unstale":"2024-09-12T01:08:14.254471+0000","last_undegraded":"2024-09-12T01:08:14.254471+0000","last_fullsized":"2024-09-12T01:08:14.254471+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'11","last_scrub_stamp":"2024-09-12T01:08:14.254273+0000","last_deep_scrub":"258'11","last_deep_scrub_stamp":"2024-09-12T01:08:14.254273+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.254273+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:01.432581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:05:54.650621+0000","last_change":"2024-09-12T00:49:10.613325+0000","last_active":"2024-09-12T01:05:54.650621+0000","last_peered":"2024-09-12T01:05:54.650621+0000","last_clean":"2024-09-12T01:05:54.650621+0000","last_became_active":"2024-09-12T00:49:10.612680+0000","last_became_peered":"2024-09-12T00:49:10.612680+0000","last_unstale":"2024-09-12T01:05:54.650621+0000","last_undegraded":"2024-09-12T01:05:54.650621+0000","last_fullsized":"2024-09-12T01:05:54.650621+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:49:09.567784+0000","last_clean_scrub_stamp":"2024-09-12T00:49:09.567784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.196800+0000","last_change":"2024-09-12T01:08:09.196800+0000","last_active":"2024-09-12T01:08:09.196800+0000","last_peered":"2024-09-12T01:08:09.196800+0000","last_clean":"2024-09-12T01:08:09.196800+0000","last_became_active":"2024-09-12T00:38:10.691107+0000","last_became_peered":"2024-09-12T00:38:10.691107+0000","last_unstale":"2024-09-12T01:08:09.196800+0000","last_undegraded":"2024-09-12T01:08:09.196800+0000","last_fullsized":"2024-09-12T01:08:09.196800+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.196531+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:20.537195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"267'6","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.625085+0000","last_change":"2024-09-12T01:08:04.625085+0000","last_active":"2024-09-12T01:08:04.625085+0000","last_peered":"2024-09-12T01:08:04.625085+0000","last_clean":"2024-09-12T01:08:04.625085+0000","last_became_active":"2024-09-12T00:38:07.657155+0000","last_became_peered":"2024-09-12T00:38:07.657155+0000","last_unstale":"2024-09-12T01:08:04.625085+0000","last_undegraded":"2024-09-12T01:08:04.625085+0000","last_fullsized":"2024-09-12T01:08:04.625085+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:04.624891+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:04.624891+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:59.672369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"267'20","reported_seq":109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.165704+0000","last_change":"2024-09-12T01:08:01.165704+0000","last_active":"2024-09-12T01:08:01.165704+0000","last_peered":"2024-09-12T01:08:01.165704+0000","last_clean":"2024-09-12T01:08:01.165704+0000","last_became_active":"2024-09-12T00:36:37.221980+0000","last_became_peered":"2024-09-12T00:36:37.221980+0000","last_unstale":"2024-09-12T01:08:01.165704+0000","last_undegraded":"2024-09-12T01:08:01.165704+0000","last_fullsized":"2024-09-12T01:08:01.165704+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:08:01.165485+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:08:01.165485+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.165485+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:34.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'360","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.018639+0000","last_change":"2024-09-12T01:07:43.018639+0000","last_active":"2024-09-12T01:07:43.018639+0000","last_peered":"2024-09-12T01:07:43.018639+0000","last_clean":"2024-09-12T01:07:43.018639+0000","last_became_active":"2024-09-12T00:21:42.528236+0000","last_became_peered":"2024-09-12T00:21:42.528236+0000","last_unstale":"2024-09-12T01:07:43.018639+0000","last_undegraded":"2024-09-12T01:07:43.018639+0000","last_fullsized":"2024-09-12T01:07:43.018639+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'360","last_scrub_stamp":"2024-09-12T01:07:43.018341+0000","last_deep_scrub":"267'360","last_deep_scrub_stamp":"2024-09-12T01:07:43.018341+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.018341+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:20.272306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812630,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":8804,"num_write":1192,"num_write_kb":22191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'52","reported_seq":612,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.538350+0000","last_change":"2024-09-12T01:07:45.538350+0000","last_active":"2024-09-12T01:07:45.538350+0000","last_peered":"2024-09-12T01:07:45.538350+0000","last_clean":"2024-09-12T01:07:45.538350+0000","last_became_active":"2024-09-12T00:21:44.499494+0000","last_became_peered":"2024-09-12T00:21:44.499494+0000","last_unstale":"2024-09-12T01:07:45.538350+0000","last_undegraded":"2024-09-12T01:07:45.538350+0000","last_fullsized":"2024-09-12T01:07:45.538350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:07:45.538159+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:07:45.538159+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.538159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:29.457414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":187,"num_write":87,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'464","reported_seq":1151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.037595+0000","last_change":"2024-09-12T01:07:48.037595+0000","last_active":"2024-09-12T01:07:48.037595+0000","last_peered":"2024-09-12T01:07:48.037595+0000","last_clean":"2024-09-12T01:07:48.037595+0000","last_became_active":"2024-09-12T00:21:42.511901+0000","last_became_peered":"2024-09-12T00:21:42.511901+0000","last_unstale":"2024-09-12T01:07:48.037595+0000","last_undegraded":"2024-09-12T01:07:48.037595+0000","last_fullsized":"2024-09-12T01:07:48.037595+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'464","last_scrub_stamp":"2024-09-12T01:07:48.037389+0000","last_deep_scrub":"267'464","last_deep_scrub_stamp":"2024-09-12T01:07:48.037389+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.037389+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:29.223858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759316,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":14453,"num_write":1384,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'102","reported_seq":669,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.917935+0000","last_change":"2024-09-12T01:07:51.917935+0000","last_active":"2024-09-12T01:07:51.917935+0000","last_peered":"2024-09-12T01:07:51.917935+0000","last_clean":"2024-09-12T01:07:51.917935+0000","last_became_active":"2024-09-12T00:21:44.498503+0000","last_became_peered":"2024-09-12T00:21:44.498503+0000","last_unstale":"2024-09-12T01:07:51.917935+0000","last_undegraded":"2024-09-12T01:07:51.917935+0000","last_fullsized":"2024-09-12T01:07:51.917935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:51.917714+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:51.917714+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.917714+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:34.326748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":343,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'310","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.047030+0000","last_change":"2024-09-12T01:07:47.047030+0000","last_active":"2024-09-12T01:07:47.047030+0000","last_peered":"2024-09-12T01:07:47.047030+0000","last_clean":"2024-09-12T01:07:47.047030+0000","last_became_active":"2024-09-12T00:21:42.535071+0000","last_became_peered":"2024-09-12T00:21:42.535071+0000","last_unstale":"2024-09-12T01:07:47.047030+0000","last_undegraded":"2024-09-12T01:07:47.047030+0000","last_fullsized":"2024-09-12T01:07:47.047030+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'310","last_scrub_stamp":"2024-09-12T01:07:47.046642+0000","last_deep_scrub":"267'310","last_deep_scrub_stamp":"2024-09-12T01:07:47.046642+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.046642+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.764157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328055,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":751,"num_read_kb":29454,"num_write":966,"num_write_kb":25069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'218","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.984124+0000","last_change":"2024-09-12T01:07:58.984124+0000","last_active":"2024-09-12T01:07:58.984124+0000","last_peered":"2024-09-12T01:07:58.984124+0000","last_clean":"2024-09-12T01:07:58.984124+0000","last_became_active":"2024-09-12T00:21:44.497569+0000","last_became_peered":"2024-09-12T00:21:44.497569+0000","last_unstale":"2024-09-12T01:07:58.984124+0000","last_undegraded":"2024-09-12T01:07:58.984124+0000","last_fullsized":"2024-09-12T01:07:58.984124+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:07:58.983934+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:07:58.983934+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.983934+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:06.787825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":917,"num_read_kb":735,"num_write":338,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8079,"num_omap_keys":32,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.334560+0000","last_change":"2024-09-12T01:07:39.334379+0000","last_active":"2024-09-12T01:07:39.334560+0000","last_peered":"2024-09-12T01:07:39.334560+0000","last_clean":"2024-09-12T01:07:39.334560+0000","last_became_active":"2024-09-12T00:21:42.528057+0000","last_became_peered":"2024-09-12T00:21:42.528057+0000","last_unstale":"2024-09-12T01:07:39.334560+0000","last_undegraded":"2024-09-12T01:07:39.334560+0000","last_fullsized":"2024-09-12T01:07:39.334560+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-09-12T01:07:39.334128+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-09-12T01:07:39.334128+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.334128+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.207806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2018898,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":607,"num_read_kb":8621,"num_write":1230,"num_write_kb":31712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'138","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.346916+0000","last_change":"2024-09-12T01:07:49.346916+0000","last_active":"2024-09-12T01:07:49.346916+0000","last_peered":"2024-09-12T01:07:49.346916+0000","last_clean":"2024-09-12T01:07:49.346916+0000","last_became_active":"2024-09-12T00:21:44.479037+0000","last_became_peered":"2024-09-12T00:21:44.479037+0000","last_unstale":"2024-09-12T01:07:49.346916+0000","last_undegraded":"2024-09-12T01:07:49.346916+0000","last_fullsized":"2024-09-12T01:07:49.346916+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T01:07:49.346723+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T01:07:49.346723+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.346723+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:01.160030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":200,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'373","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.034540+0000","last_change":"2024-09-12T01:07:39.034540+0000","last_active":"2024-09-12T01:07:39.034540+0000","last_peered":"2024-09-12T01:07:39.034540+0000","last_clean":"2024-09-12T01:07:39.034540+0000","last_became_active":"2024-09-12T00:21:42.515464+0000","last_became_peered":"2024-09-12T00:21:42.515464+0000","last_unstale":"2024-09-12T01:07:39.034540+0000","last_undegraded":"2024-09-12T01:07:39.034540+0000","last_fullsized":"2024-09-12T01:07:39.034540+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-09-12T01:07:39.034299+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-09-12T01:07:39.034299+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.034299+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:13.031612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":28078,"num_write":1274,"num_write_kb":29332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'4286","reported_seq":4965,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.054554+0000","last_change":"2024-09-12T01:07:48.054390+0000","last_active":"2024-09-12T01:07:48.054554+0000","last_peered":"2024-09-12T01:07:48.054554+0000","last_clean":"2024-09-12T01:07:48.054554+0000","last_became_active":"2024-09-12T00:21:44.495734+0000","last_became_peered":"2024-09-12T00:21:44.495734+0000","last_unstale":"2024-09-12T01:07:48.054554+0000","last_undegraded":"2024-09-12T01:07:48.054554+0000","last_fullsized":"2024-09-12T01:07:48.054554+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4286","last_scrub_stamp":"2024-09-12T01:07:48.054213+0000","last_deep_scrub":"267'4286","last_deep_scrub_stamp":"2024-09-12T01:07:48.054213+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.054213+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":3000,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:38.885788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17226,"num_read_kb":14426,"num_write":6464,"num_write_kb":3218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'375","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.278173+0000","last_change":"2024-09-12T01:07:37.278173+0000","last_active":"2024-09-12T01:07:37.278173+0000","last_peered":"2024-09-12T01:07:37.278173+0000","last_clean":"2024-09-12T01:07:37.278173+0000","last_became_active":"2024-09-12T00:21:42.534582+0000","last_became_peered":"2024-09-12T00:21:42.534582+0000","last_unstale":"2024-09-12T01:07:37.278173+0000","last_undegraded":"2024-09-12T01:07:37.278173+0000","last_fullsized":"2024-09-12T01:07:37.278173+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T01:07:37.277868+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T01:07:37.277868+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.277868+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:05.857538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":25303,"num_write":1128,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'161","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.097307+0000","last_change":"2024-09-12T01:07:47.097307+0000","last_active":"2024-09-12T01:07:47.097307+0000","last_peered":"2024-09-12T01:07:47.097307+0000","last_clean":"2024-09-12T01:07:47.097307+0000","last_became_active":"2024-09-12T00:21:44.510410+0000","last_became_peered":"2024-09-12T00:21:44.510410+0000","last_unstale":"2024-09-12T01:07:47.097307+0000","last_undegraded":"2024-09-12T01:07:47.097307+0000","last_fullsized":"2024-09-12T01:07:47.097307+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:07:47.097118+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:07:47.097118+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.097118+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.442505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":577,"num_write":213,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1239,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.025855+0000","last_change":"2024-09-12T01:07:36.025855+0000","last_active":"2024-09-12T01:07:36.025855+0000","last_peered":"2024-09-12T01:07:36.025855+0000","last_clean":"2024-09-12T01:07:36.025855+0000","last_became_active":"2024-09-12T00:21:42.530155+0000","last_became_peered":"2024-09-12T00:21:42.530155+0000","last_unstale":"2024-09-12T01:07:36.025855+0000","last_undegraded":"2024-09-12T01:07:36.025855+0000","last_fullsized":"2024-09-12T01:07:36.025855+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T01:07:36.025559+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T01:07:36.025559+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.025559+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:05.061004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1030,"num_read_kb":26574,"num_write":1137,"num_write_kb":18888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'161","reported_seq":780,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.227104+0000","last_change":"2024-09-12T01:07:46.227104+0000","last_active":"2024-09-12T01:07:46.227104+0000","last_peered":"2024-09-12T01:07:46.227104+0000","last_clean":"2024-09-12T01:07:46.227104+0000","last_became_active":"2024-09-12T00:21:44.483825+0000","last_became_peered":"2024-09-12T00:21:44.483825+0000","last_unstale":"2024-09-12T01:07:46.227104+0000","last_undegraded":"2024-09-12T01:07:46.227104+0000","last_fullsized":"2024-09-12T01:07:46.227104+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:07:46.226919+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:07:46.226919+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.226919+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:25.645752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":577,"num_write":242,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'407","reported_seq":1081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.012599+0000","last_change":"2024-09-12T01:07:44.012599+0000","last_active":"2024-09-12T01:07:44.012599+0000","last_peered":"2024-09-12T01:07:44.012599+0000","last_clean":"2024-09-12T01:07:44.012599+0000","last_became_active":"2024-09-12T00:22:12.620753+0000","last_became_peered":"2024-09-12T00:22:12.620753+0000","last_unstale":"2024-09-12T01:07:44.012599+0000","last_undegraded":"2024-09-12T01:07:44.012599+0000","last_fullsized":"2024-09-12T01:07:44.012599+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T01:07:44.012256+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T01:07:44.012256+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.012256+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:21.935270+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":588,"num_read_kb":16569,"num_write":1344,"num_write_kb":33151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'179","reported_seq":772,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.983715+0000","last_change":"2024-09-12T01:07:57.983715+0000","last_active":"2024-09-12T01:07:57.983715+0000","last_peered":"2024-09-12T01:07:57.983715+0000","last_clean":"2024-09-12T01:07:57.983715+0000","last_became_active":"2024-09-12T00:21:44.528311+0000","last_became_peered":"2024-09-12T00:21:44.528311+0000","last_unstale":"2024-09-12T01:07:57.983715+0000","last_undegraded":"2024-09-12T01:07:57.983715+0000","last_fullsized":"2024-09-12T01:07:57.983715+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'179","last_scrub_stamp":"2024-09-12T01:07:57.983537+0000","last_deep_scrub":"267'179","last_deep_scrub_stamp":"2024-09-12T01:07:57.983537+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.983537+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:37.042891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":638,"num_write":310,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'108","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.876720+0000","last_change":"2024-09-12T01:07:54.876584+0000","last_active":"2024-09-12T01:07:54.876720+0000","last_peered":"2024-09-12T01:07:54.876720+0000","last_clean":"2024-09-12T01:07:54.876720+0000","last_became_active":"2024-09-12T00:21:44.493767+0000","last_became_peered":"2024-09-12T00:21:44.493767+0000","last_unstale":"2024-09-12T01:07:54.876720+0000","last_undegraded":"2024-09-12T01:07:54.876720+0000","last_fullsized":"2024-09-12T01:07:54.876720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'108","last_scrub_stamp":"2024-09-12T01:07:54.876374+0000","last_deep_scrub":"267'108","last_deep_scrub_stamp":"2024-09-12T01:07:54.876374+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.876374+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:11.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":357,"num_write":148,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'315","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.652696+0000","last_change":"2024-09-12T01:07:34.652629+0000","last_active":"2024-09-12T01:07:34.652696+0000","last_peered":"2024-09-12T01:07:34.652696+0000","last_clean":"2024-09-12T01:07:34.652696+0000","last_became_active":"2024-09-12T00:21:42.514489+0000","last_became_peered":"2024-09-12T00:21:42.514489+0000","last_unstale":"2024-09-12T01:07:34.652696+0000","last_undegraded":"2024-09-12T01:07:34.652696+0000","last_fullsized":"2024-09-12T01:07:34.652696+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'315","last_scrub_stamp":"2024-09-12T01:07:34.652525+0000","last_deep_scrub":"267'315","last_deep_scrub_stamp":"2024-09-12T01:07:34.652525+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.652525+0000","objects_scrubbed":8,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:00.027136+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480914,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":6553,"num_write":1087,"num_write_kb":16882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'52","reported_seq":614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.053661+0000","last_change":"2024-09-12T01:07:42.053490+0000","last_active":"2024-09-12T01:07:42.053661+0000","last_peered":"2024-09-12T01:07:42.053661+0000","last_clean":"2024-09-12T01:07:42.053661+0000","last_became_active":"2024-09-12T00:21:44.509895+0000","last_became_peered":"2024-09-12T00:21:44.509895+0000","last_unstale":"2024-09-12T01:07:42.053661+0000","last_undegraded":"2024-09-12T01:07:42.053661+0000","last_fullsized":"2024-09-12T01:07:42.053661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:07:42.053309+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:07:42.053309+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.053309+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:52.856138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":198,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'260","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.988730+0000","last_change":"2024-09-12T01:07:36.988584+0000","last_active":"2024-09-12T01:07:36.988730+0000","last_peered":"2024-09-12T01:07:36.988730+0000","last_clean":"2024-09-12T01:07:36.988730+0000","last_became_active":"2024-09-12T00:21:42.490660+0000","last_became_peered":"2024-09-12T00:21:42.490660+0000","last_unstale":"2024-09-12T01:07:36.988730+0000","last_undegraded":"2024-09-12T01:07:36.988730+0000","last_fullsized":"2024-09-12T01:07:36.988730+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'260","last_scrub_stamp":"2024-09-12T01:07:36.988372+0000","last_deep_scrub":"267'260","last_deep_scrub_stamp":"2024-09-12T01:07:36.988372+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.988372+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:05.939444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":4406,"num_write":788,"num_write_kb":22345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'258","reported_seq":903,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.543047+0000","last_change":"2024-09-12T01:07:44.542895+0000","last_active":"2024-09-12T01:07:44.543047+0000","last_peered":"2024-09-12T01:07:44.543047+0000","last_clean":"2024-09-12T01:07:44.543047+0000","last_became_active":"2024-09-12T00:21:44.514893+0000","last_became_peered":"2024-09-12T00:21:44.514893+0000","last_unstale":"2024-09-12T01:07:44.543047+0000","last_undegraded":"2024-09-12T01:07:44.543047+0000","last_fullsized":"2024-09-12T01:07:44.543047+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:07:44.542721+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:07:44.542721+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.542721+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:09.993567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1166,"num_read_kb":956,"num_write":431,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'341","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.402382+0000","last_change":"2024-09-12T01:07:44.402230+0000","last_active":"2024-09-12T01:07:44.402382+0000","last_peered":"2024-09-12T01:07:44.402382+0000","last_clean":"2024-09-12T01:07:44.402382+0000","last_became_active":"2024-09-12T00:22:13.552126+0000","last_became_peered":"2024-09-12T00:22:13.552126+0000","last_unstale":"2024-09-12T01:07:44.402382+0000","last_undegraded":"2024-09-12T01:07:44.402382+0000","last_fullsized":"2024-09-12T01:07:44.402382+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:44.401991+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:44.401991+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.401991+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:52.498973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194436,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":9788,"num_write":1143,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'125","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.334204+0000","last_change":"2024-09-12T01:07:49.334204+0000","last_active":"2024-09-12T01:07:49.334204+0000","last_peered":"2024-09-12T01:07:49.334204+0000","last_clean":"2024-09-12T01:07:49.334204+0000","last_became_active":"2024-09-12T00:21:44.520441+0000","last_became_peered":"2024-09-12T00:21:44.520441+0000","last_unstale":"2024-09-12T01:07:49.334204+0000","last_undegraded":"2024-09-12T01:07:49.334204+0000","last_fullsized":"2024-09-12T01:07:49.334204+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'125","last_scrub_stamp":"2024-09-12T01:07:49.333960+0000","last_deep_scrub":"267'125","last_deep_scrub_stamp":"2024-09-12T01:07:49.333960+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.333960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:29.920627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":459,"num_write":198,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'341","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.001918+0000","last_change":"2024-09-12T01:07:38.001684+0000","last_active":"2024-09-12T01:07:38.001918+0000","last_peered":"2024-09-12T01:07:38.001918+0000","last_clean":"2024-09-12T01:07:38.001918+0000","last_became_active":"2024-09-12T00:21:42.505754+0000","last_became_peered":"2024-09-12T00:21:42.505754+0000","last_unstale":"2024-09-12T01:07:38.001918+0000","last_undegraded":"2024-09-12T01:07:38.001918+0000","last_fullsized":"2024-09-12T01:07:38.001918+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:38.001353+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:38.001353+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.001353+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:05.323675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524521,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":484,"num_read_kb":23994,"num_write":1133,"num_write_kb":44987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'533","reported_seq":1303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.016723+0000","last_change":"2024-09-12T01:07:56.016723+0000","last_active":"2024-09-12T01:07:56.016723+0000","last_peered":"2024-09-12T01:07:56.016723+0000","last_clean":"2024-09-12T01:07:56.016723+0000","last_became_active":"2024-09-12T00:21:44.509840+0000","last_became_peered":"2024-09-12T00:21:44.509840+0000","last_unstale":"2024-09-12T01:07:56.016723+0000","last_undegraded":"2024-09-12T01:07:56.016723+0000","last_fullsized":"2024-09-12T01:07:56.016723+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'533","last_scrub_stamp":"2024-09-12T01:07:56.016549+0000","last_deep_scrub":"267'533","last_deep_scrub_stamp":"2024-09-12T01:07:56.016549+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.016549+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:38.339396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2527,"num_read_kb":2144,"num_write":948,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'354","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.349736+0000","last_change":"2024-09-12T01:07:40.349736+0000","last_active":"2024-09-12T01:07:40.349736+0000","last_peered":"2024-09-12T01:07:40.349736+0000","last_clean":"2024-09-12T01:07:40.349736+0000","last_became_active":"2024-09-12T00:21:42.529312+0000","last_became_peered":"2024-09-12T00:21:42.529312+0000","last_unstale":"2024-09-12T01:07:40.349736+0000","last_undegraded":"2024-09-12T01:07:40.349736+0000","last_fullsized":"2024-09-12T01:07:40.349736+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T01:07:40.349528+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T01:07:40.349528+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.349528+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:32.841636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":660,"num_write":1093,"num_write_kb":45878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'102","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.560572+0000","last_change":"2024-09-12T01:07:43.560572+0000","last_active":"2024-09-12T01:07:43.560572+0000","last_peered":"2024-09-12T01:07:43.560572+0000","last_clean":"2024-09-12T01:07:43.560572+0000","last_became_active":"2024-09-12T00:21:44.499173+0000","last_became_peered":"2024-09-12T00:21:44.499173+0000","last_unstale":"2024-09-12T01:07:43.560572+0000","last_undegraded":"2024-09-12T01:07:43.560572+0000","last_fullsized":"2024-09-12T01:07:43.560572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:43.560396+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:43.560396+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.560396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:27.157753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":398,"num_write":158,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'370","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.319443+0000","last_change":"2024-09-12T01:07:42.319443+0000","last_active":"2024-09-12T01:07:42.319443+0000","last_peered":"2024-09-12T01:07:42.319443+0000","last_clean":"2024-09-12T01:07:42.319443+0000","last_became_active":"2024-09-12T00:21:42.529873+0000","last_became_peered":"2024-09-12T00:21:42.529873+0000","last_unstale":"2024-09-12T01:07:42.319443+0000","last_undegraded":"2024-09-12T01:07:42.319443+0000","last_fullsized":"2024-09-12T01:07:42.319443+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-12T01:07:42.319216+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-12T01:07:42.319216+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.319216+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:35.891445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730168,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":35149,"num_write":1229,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'139","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.043273+0000","last_change":"2024-09-12T01:07:58.043273+0000","last_active":"2024-09-12T01:07:58.043273+0000","last_peered":"2024-09-12T01:07:58.043273+0000","last_clean":"2024-09-12T01:07:58.043273+0000","last_became_active":"2024-09-12T00:21:52.545571+0000","last_became_peered":"2024-09-12T00:21:52.545571+0000","last_unstale":"2024-09-12T01:07:58.043273+0000","last_undegraded":"2024-09-12T01:07:58.043273+0000","last_fullsized":"2024-09-12T01:07:58.043273+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'139","last_scrub_stamp":"2024-09-12T01:07:58.042992+0000","last_deep_scrub":"267'139","last_deep_scrub_stamp":"2024-09-12T01:07:58.042992+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.042992+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:35.015561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'88","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.344902+0000","last_change":"2024-09-12T01:07:46.344902+0000","last_active":"2024-09-12T01:07:46.344902+0000","last_peered":"2024-09-12T01:07:46.344902+0000","last_clean":"2024-09-12T01:07:46.344902+0000","last_became_active":"2024-09-12T00:21:44.484514+0000","last_became_peered":"2024-09-12T00:21:44.484514+0000","last_unstale":"2024-09-12T01:07:46.344902+0000","last_undegraded":"2024-09-12T01:07:46.344902+0000","last_fullsized":"2024-09-12T01:07:46.344902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'88","last_scrub_stamp":"2024-09-12T01:07:46.344724+0000","last_deep_scrub":"267'88","last_deep_scrub_stamp":"2024-09-12T01:07:46.344724+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.344724+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:38.020778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":321,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'347","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.938286+0000","last_change":"2024-09-12T01:07:44.938138+0000","last_active":"2024-09-12T01:07:44.938286+0000","last_peered":"2024-09-12T01:07:44.938286+0000","last_clean":"2024-09-12T01:07:44.938286+0000","last_became_active":"2024-09-12T00:21:42.495808+0000","last_became_peered":"2024-09-12T00:21:42.495808+0000","last_unstale":"2024-09-12T01:07:44.938286+0000","last_undegraded":"2024-09-12T01:07:44.938286+0000","last_fullsized":"2024-09-12T01:07:44.938286+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T01:07:44.937896+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T01:07:44.937896+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.937896+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.094251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432703,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":20340,"num_write":1070,"num_write_kb":31693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.024754+0000","last_change":"2024-09-12T01:08:03.024754+0000","last_active":"2024-09-12T01:08:03.024754+0000","last_peered":"2024-09-12T01:08:03.024754+0000","last_clean":"2024-09-12T01:08:03.024754+0000","last_became_active":"2024-09-12T00:21:46.515363+0000","last_became_peered":"2024-09-12T00:21:46.515363+0000","last_unstale":"2024-09-12T01:08:03.024754+0000","last_undegraded":"2024-09-12T01:08:03.024754+0000","last_fullsized":"2024-09-12T01:08:03.024754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:03.024572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:03.024572+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.024572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:19.093277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'336","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.370157+0000","last_change":"2024-09-12T01:08:01.370157+0000","last_active":"2024-09-12T01:08:01.370157+0000","last_peered":"2024-09-12T01:08:01.370157+0000","last_clean":"2024-09-12T01:08:01.370157+0000","last_became_active":"2024-09-12T00:21:48.524091+0000","last_became_peered":"2024-09-12T00:21:48.524091+0000","last_unstale":"2024-09-12T01:08:01.370157+0000","last_undegraded":"2024-09-12T01:08:01.370157+0000","last_fullsized":"2024-09-12T01:08:01.370157+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T01:08:01.369944+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T01:08:01.369944+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.369944+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:54.638067+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48797,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1088,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.514313+0000","last_change":"2024-09-12T01:07:59.514313+0000","last_active":"2024-09-12T01:07:59.514313+0000","last_peered":"2024-09-12T01:07:59.514313+0000","last_clean":"2024-09-12T01:07:59.514313+0000","last_became_active":"2024-09-12T00:21:50.551742+0000","last_became_peered":"2024-09-12T00:21:50.551742+0000","last_unstale":"2024-09-12T01:07:59.514313+0000","last_undegraded":"2024-09-12T01:07:59.514313+0000","last_fullsized":"2024-09-12T01:07:59.514313+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:59.514104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:59.514104+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.514104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:24.793889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'176","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.582167+0000","last_change":"2024-09-12T01:08:02.582167+0000","last_active":"2024-09-12T01:08:02.582167+0000","last_peered":"2024-09-12T01:08:02.582167+0000","last_clean":"2024-09-12T01:08:02.582167+0000","last_became_active":"2024-09-12T00:21:52.544469+0000","last_became_peered":"2024-09-12T00:21:52.544469+0000","last_unstale":"2024-09-12T01:08:02.582167+0000","last_undegraded":"2024-09-12T01:08:02.582167+0000","last_fullsized":"2024-09-12T01:08:02.582167+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'176","last_scrub_stamp":"2024-09-12T01:08:02.581978+0000","last_deep_scrub":"267'176","last_deep_scrub_stamp":"2024-09-12T01:08:02.581978+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.581978+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.917282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":251,"num_write":350,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'4223","reported_seq":4863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.886750+0000","last_change":"2024-09-12T01:07:55.886750+0000","last_active":"2024-09-12T01:07:55.886750+0000","last_peered":"2024-09-12T01:07:55.886750+0000","last_clean":"2024-09-12T01:07:55.886750+0000","last_became_active":"2024-09-12T00:21:44.500367+0000","last_became_peered":"2024-09-12T00:21:44.500367+0000","last_unstale":"2024-09-12T01:07:55.886750+0000","last_undegraded":"2024-09-12T01:07:55.886750+0000","last_fullsized":"2024-09-12T01:07:55.886750+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4223","last_scrub_stamp":"2024-09-12T01:07:55.886652+0000","last_deep_scrub":"267'4223","last_deep_scrub_stamp":"2024-09-12T01:07:55.886652+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.886652+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:31.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17010,"num_read_kb":14247,"num_write":6340,"num_write_kb":3163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'379","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.372627+0000","last_change":"2024-09-12T01:07:39.372378+0000","last_active":"2024-09-12T01:07:39.372627+0000","last_peered":"2024-09-12T01:07:39.372627+0000","last_clean":"2024-09-12T01:07:39.372627+0000","last_became_active":"2024-09-12T00:21:42.492572+0000","last_became_peered":"2024-09-12T00:21:42.492572+0000","last_unstale":"2024-09-12T01:07:39.372627+0000","last_undegraded":"2024-09-12T01:07:39.372627+0000","last_fullsized":"2024-09-12T01:07:39.372627+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:39.372054+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:39.372054+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.372054+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:10.885705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":145927,"num_write":1169,"num_write_kb":64533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.367076+0000","last_change":"2024-09-12T01:07:54.367076+0000","last_active":"2024-09-12T01:07:54.367076+0000","last_peered":"2024-09-12T01:07:54.367076+0000","last_clean":"2024-09-12T01:07:54.367076+0000","last_became_active":"2024-09-12T00:21:46.490985+0000","last_became_peered":"2024-09-12T00:21:46.490985+0000","last_unstale":"2024-09-12T01:07:54.367076+0000","last_undegraded":"2024-09-12T01:07:54.367076+0000","last_fullsized":"2024-09-12T01:07:54.367076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.366884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.366884+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.366884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:54.269774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'88","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.609595+0000","last_change":"2024-09-12T01:07:55.609595+0000","last_active":"2024-09-12T01:07:55.609595+0000","last_peered":"2024-09-12T01:07:55.609595+0000","last_clean":"2024-09-12T01:07:55.609595+0000","last_became_active":"2024-09-12T00:21:48.535190+0000","last_became_peered":"2024-09-12T00:21:48.535190+0000","last_unstale":"2024-09-12T01:07:55.609595+0000","last_undegraded":"2024-09-12T01:07:55.609595+0000","last_fullsized":"2024-09-12T01:07:55.609595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'88","last_scrub_stamp":"2024-09-12T01:07:55.609509+0000","last_deep_scrub":"267'88","last_deep_scrub_stamp":"2024-09-12T01:07:55.609509+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.609509+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:29.653534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.578105+0000","last_change":"2024-09-12T01:07:56.578105+0000","last_active":"2024-09-12T01:07:56.578105+0000","last_peered":"2024-09-12T01:07:56.578105+0000","last_clean":"2024-09-12T01:07:56.578105+0000","last_became_active":"2024-09-12T00:21:50.550214+0000","last_became_peered":"2024-09-12T00:21:50.550214+0000","last_unstale":"2024-09-12T01:07:56.578105+0000","last_undegraded":"2024-09-12T01:07:56.578105+0000","last_fullsized":"2024-09-12T01:07:56.578105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:56.577932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:56.577932+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.577932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:42.970087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'129","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.314305+0000","last_change":"2024-09-12T01:08:04.314305+0000","last_active":"2024-09-12T01:08:04.314305+0000","last_peered":"2024-09-12T01:08:04.314305+0000","last_clean":"2024-09-12T01:08:04.314305+0000","last_became_active":"2024-09-12T00:21:52.545166+0000","last_became_peered":"2024-09-12T00:21:52.545166+0000","last_unstale":"2024-09-12T01:08:04.314305+0000","last_undegraded":"2024-09-12T01:08:04.314305+0000","last_fullsized":"2024-09-12T01:08:04.314305+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:08:04.314110+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:08:04.314110+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.314110+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:16.820858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":292,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'288","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.016647+0000","last_change":"2024-09-12T01:07:51.016647+0000","last_active":"2024-09-12T01:07:51.016647+0000","last_peered":"2024-09-12T01:07:51.016647+0000","last_clean":"2024-09-12T01:07:51.016647+0000","last_became_active":"2024-09-12T00:21:44.520057+0000","last_became_peered":"2024-09-12T00:21:44.520057+0000","last_unstale":"2024-09-12T01:07:51.016647+0000","last_undegraded":"2024-09-12T01:07:51.016647+0000","last_fullsized":"2024-09-12T01:07:51.016647+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'288","last_scrub_stamp":"2024-09-12T01:07:51.016419+0000","last_deep_scrub":"267'288","last_deep_scrub_stamp":"2024-09-12T01:07:51.016419+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.016419+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:13.071098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1259,"num_read_kb":1089,"num_write":465,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'321","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.918965+0000","last_change":"2024-09-12T01:07:36.918798+0000","last_active":"2024-09-12T01:07:36.918965+0000","last_peered":"2024-09-12T01:07:36.918965+0000","last_clean":"2024-09-12T01:07:36.918965+0000","last_became_active":"2024-09-12T00:21:42.496059+0000","last_became_peered":"2024-09-12T00:21:42.496059+0000","last_unstale":"2024-09-12T01:07:36.918965+0000","last_undegraded":"2024-09-12T01:07:36.918965+0000","last_fullsized":"2024-09-12T01:07:36.918965+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'321","last_scrub_stamp":"2024-09-12T01:07:36.918576+0000","last_deep_scrub":"267'321","last_deep_scrub_stamp":"2024-09-12T01:07:36.918576+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.918576+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:39.909942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":8629,"num_write":994,"num_write_kb":21953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.365480+0000","last_change":"2024-09-12T01:07:55.365480+0000","last_active":"2024-09-12T01:07:55.365480+0000","last_peered":"2024-09-12T01:07:55.365480+0000","last_clean":"2024-09-12T01:07:55.365480+0000","last_became_active":"2024-09-12T00:21:46.501407+0000","last_became_peered":"2024-09-12T00:21:46.501407+0000","last_unstale":"2024-09-12T01:07:55.365480+0000","last_undegraded":"2024-09-12T01:07:55.365480+0000","last_fullsized":"2024-09-12T01:07:55.365480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.365302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.365302+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.365302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:38.230753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'129","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.376443+0000","last_change":"2024-09-12T01:08:02.376443+0000","last_active":"2024-09-12T01:08:02.376443+0000","last_peered":"2024-09-12T01:08:02.376443+0000","last_clean":"2024-09-12T01:08:02.376443+0000","last_became_active":"2024-09-12T00:21:48.541231+0000","last_became_peered":"2024-09-12T00:21:48.541231+0000","last_unstale":"2024-09-12T01:08:02.376443+0000","last_undegraded":"2024-09-12T01:08:02.376443+0000","last_fullsized":"2024-09-12T01:08:02.376443+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:08:02.376158+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:08:02.376158+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.376158+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:58.427365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'789","reported_seq":2524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.283028+0000","last_change":"2024-09-12T01:08:15.283028+0000","last_active":"2024-09-12T01:08:15.283028+0000","last_peered":"2024-09-12T01:08:15.283028+0000","last_clean":"2024-09-12T01:08:15.283028+0000","last_became_active":"2024-09-12T00:21:50.568825+0000","last_became_peered":"2024-09-12T00:21:50.568825+0000","last_unstale":"2024-09-12T01:08:15.283028+0000","last_undegraded":"2024-09-12T01:08:15.283028+0000","last_fullsized":"2024-09-12T01:08:15.283028+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'789","last_scrub_stamp":"2024-09-12T01:08:15.282850+0000","last_deep_scrub":"267'789","last_deep_scrub_stamp":"2024-09-12T01:08:15.282850+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.282850+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:31.281703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'225","reported_seq":1078,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.199574+0000","last_change":"2024-09-12T01:08:00.199574+0000","last_active":"2024-09-12T01:08:00.199574+0000","last_peered":"2024-09-12T01:08:00.199574+0000","last_clean":"2024-09-12T01:08:00.199574+0000","last_became_active":"2024-09-12T00:21:52.554865+0000","last_became_peered":"2024-09-12T00:21:52.554865+0000","last_unstale":"2024-09-12T01:08:00.199574+0000","last_undegraded":"2024-09-12T01:08:00.199574+0000","last_fullsized":"2024-09-12T01:08:00.199574+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-12T01:08:00.199341+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-12T01:08:00.199341+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.199341+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:05.338489+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":708,"num_read_kb":679,"num_write":497,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'136","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.992340+0000","last_change":"2024-09-12T01:07:51.992340+0000","last_active":"2024-09-12T01:07:51.992340+0000","last_peered":"2024-09-12T01:07:51.992340+0000","last_clean":"2024-09-12T01:07:51.992340+0000","last_became_active":"2024-09-12T00:21:44.522830+0000","last_became_peered":"2024-09-12T00:21:44.522830+0000","last_unstale":"2024-09-12T01:07:51.992340+0000","last_undegraded":"2024-09-12T01:07:51.992340+0000","last_fullsized":"2024-09-12T01:07:51.992340+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'136","last_scrub_stamp":"2024-09-12T01:07:51.992145+0000","last_deep_scrub":"267'136","last_deep_scrub_stamp":"2024-09-12T01:07:51.992145+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.992145+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:19.587323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":469,"num_write":207,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'328","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.611495+0000","last_change":"2024-09-12T01:07:33.611420+0000","last_active":"2024-09-12T01:07:33.611495+0000","last_peered":"2024-09-12T01:07:33.611495+0000","last_clean":"2024-09-12T01:07:33.611495+0000","last_became_active":"2024-09-12T00:21:42.516625+0000","last_became_peered":"2024-09-12T00:21:42.516625+0000","last_unstale":"2024-09-12T01:07:33.611495+0000","last_undegraded":"2024-09-12T01:07:33.611495+0000","last_fullsized":"2024-09-12T01:07:33.611495+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.611301+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:46.786030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":2651,"num_write":1122,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.070311+0000","last_change":"2024-09-12T01:08:04.070311+0000","last_active":"2024-09-12T01:08:04.070311+0000","last_peered":"2024-09-12T01:08:04.070311+0000","last_clean":"2024-09-12T01:08:04.070311+0000","last_became_active":"2024-09-12T00:21:46.503686+0000","last_became_peered":"2024-09-12T00:21:46.503686+0000","last_unstale":"2024-09-12T01:08:04.070311+0000","last_undegraded":"2024-09-12T01:08:04.070311+0000","last_fullsized":"2024-09-12T01:08:04.070311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:04.070128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:04.070128+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.070128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:47.551310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'288","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.199449+0000","last_change":"2024-09-12T01:07:52.199449+0000","last_active":"2024-09-12T01:07:52.199449+0000","last_peered":"2024-09-12T01:07:52.199449+0000","last_clean":"2024-09-12T01:07:52.199449+0000","last_became_active":"2024-09-12T00:21:48.539522+0000","last_became_peered":"2024-09-12T00:21:48.539522+0000","last_unstale":"2024-09-12T01:07:52.199449+0000","last_undegraded":"2024-09-12T01:07:52.199449+0000","last_fullsized":"2024-09-12T01:07:52.199449+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'288","last_scrub_stamp":"2024-09-12T01:07:52.199255+0000","last_deep_scrub":"267'288","last_deep_scrub_stamp":"2024-09-12T01:07:52.199255+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.199255+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:02.995276+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47885,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1089,"num_write":388,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'781","reported_seq":2475,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.918460+0000","last_change":"2024-09-12T01:08:05.918460+0000","last_active":"2024-09-12T01:08:05.918460+0000","last_peered":"2024-09-12T01:08:05.918460+0000","last_clean":"2024-09-12T01:08:05.918460+0000","last_became_active":"2024-09-12T00:21:50.564483+0000","last_became_peered":"2024-09-12T00:21:50.564483+0000","last_unstale":"2024-09-12T01:08:05.918460+0000","last_undegraded":"2024-09-12T01:08:05.918460+0000","last_fullsized":"2024-09-12T01:08:05.918460+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-12T01:08:05.918233+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-12T01:08:05.918233+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.918233+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:41.622332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'576","reported_seq":1373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.904435+0000","last_change":"2024-09-12T01:07:50.904435+0000","last_active":"2024-09-12T01:07:50.904435+0000","last_peered":"2024-09-12T01:07:50.904435+0000","last_clean":"2024-09-12T01:07:50.904435+0000","last_became_active":"2024-09-12T00:21:44.497754+0000","last_became_peered":"2024-09-12T00:21:44.497754+0000","last_unstale":"2024-09-12T01:07:50.904435+0000","last_undegraded":"2024-09-12T01:07:50.904435+0000","last_fullsized":"2024-09-12T01:07:50.904435+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'576","last_scrub_stamp":"2024-09-12T01:07:50.904242+0000","last_deep_scrub":"267'576","last_deep_scrub_stamp":"2024-09-12T01:07:50.904242+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.904242+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:34.973282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2710,"num_read_kb":2241,"num_write":1007,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'379","reported_seq":1096,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:31.968974+0000","last_change":"2024-09-12T01:07:31.968974+0000","last_active":"2024-09-12T01:07:31.968974+0000","last_peered":"2024-09-12T01:07:31.968974+0000","last_clean":"2024-09-12T01:07:31.968974+0000","last_became_active":"2024-09-12T00:21:42.528138+0000","last_became_peered":"2024-09-12T00:21:42.528138+0000","last_unstale":"2024-09-12T01:07:31.968974+0000","last_undegraded":"2024-09-12T01:07:31.968974+0000","last_fullsized":"2024-09-12T01:07:31.968974+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_clean_scrub_stamp":"2024-09-12T01:07:31.968881+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:08.369394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":24539,"num_write":1088,"num_write_kb":22675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.602402+0000","last_change":"2024-09-12T01:07:48.602402+0000","last_active":"2024-09-12T01:07:48.602402+0000","last_peered":"2024-09-12T01:07:48.602402+0000","last_clean":"2024-09-12T01:07:48.602402+0000","last_became_active":"2024-09-12T00:21:46.503041+0000","last_became_peered":"2024-09-12T00:21:46.503041+0000","last_unstale":"2024-09-12T01:07:48.602402+0000","last_undegraded":"2024-09-12T01:07:48.602402+0000","last_fullsized":"2024-09-12T01:07:48.602402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.602219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.602219+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.602219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:00.262764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'375","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045785+0000","last_change":"2024-09-12T01:07:50.045785+0000","last_active":"2024-09-12T01:07:50.045785+0000","last_peered":"2024-09-12T01:07:50.045785+0000","last_clean":"2024-09-12T01:07:50.045785+0000","last_became_active":"2024-09-12T00:21:48.538727+0000","last_became_peered":"2024-09-12T00:21:48.538727+0000","last_unstale":"2024-09-12T01:07:50.045785+0000","last_undegraded":"2024-09-12T01:07:50.045785+0000","last_fullsized":"2024-09-12T01:07:50.045785+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T01:07:50.045578+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T01:07:50.045578+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.045578+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:24.408858+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48773,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":589,"num_read_kb":1209,"num_write":464,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.339748+0000","last_change":"2024-09-12T01:08:02.339748+0000","last_active":"2024-09-12T01:08:02.339748+0000","last_peered":"2024-09-12T01:08:02.339748+0000","last_clean":"2024-09-12T01:08:02.339748+0000","last_became_active":"2024-09-12T00:21:50.544432+0000","last_became_peered":"2024-09-12T00:21:50.544432+0000","last_unstale":"2024-09-12T01:08:02.339748+0000","last_undegraded":"2024-09-12T01:08:02.339748+0000","last_fullsized":"2024-09-12T01:08:02.339748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.339562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.339562+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.339562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:22.365617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'553","reported_seq":1373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.241100+0000","last_change":"2024-09-12T01:07:56.241100+0000","last_active":"2024-09-12T01:07:56.241100+0000","last_peered":"2024-09-12T01:07:56.241100+0000","last_clean":"2024-09-12T01:07:56.241100+0000","last_became_active":"2024-09-12T00:21:52.563086+0000","last_became_peered":"2024-09-12T00:21:52.563086+0000","last_unstale":"2024-09-12T01:07:56.241100+0000","last_undegraded":"2024-09-12T01:07:56.241100+0000","last_fullsized":"2024-09-12T01:07:56.241100+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'553","last_scrub_stamp":"2024-09-12T01:07:56.240896+0000","last_deep_scrub":"267'553","last_deep_scrub_stamp":"2024-09-12T01:07:56.240896+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.240896+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:00.278881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1274,"num_read_kb":1271,"num_write":1130,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'526","reported_seq":1314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.643971+0000","last_change":"2024-09-12T01:07:36.643971+0000","last_active":"2024-09-12T01:07:36.643971+0000","last_peered":"2024-09-12T01:07:36.643971+0000","last_clean":"2024-09-12T01:07:36.643971+0000","last_became_active":"2024-09-12T00:21:44.510918+0000","last_became_peered":"2024-09-12T00:21:44.510918+0000","last_unstale":"2024-09-12T01:07:36.643971+0000","last_undegraded":"2024-09-12T01:07:36.643971+0000","last_fullsized":"2024-09-12T01:07:36.643971+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'526","last_scrub_stamp":"2024-09-12T01:07:36.643792+0000","last_deep_scrub":"267'526","last_deep_scrub_stamp":"2024-09-12T01:07:36.643792+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.643792+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.857231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2468,"num_read_kb":2089,"num_write":789,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29756,"num_omap_keys":119,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'326","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.222218+0000","last_change":"2024-09-12T01:07:33.222218+0000","last_active":"2024-09-12T01:07:33.222218+0000","last_peered":"2024-09-12T01:07:33.222218+0000","last_clean":"2024-09-12T01:07:33.222218+0000","last_became_active":"2024-09-12T00:21:42.513031+0000","last_became_peered":"2024-09-12T00:21:42.513031+0000","last_unstale":"2024-09-12T01:07:33.222218+0000","last_undegraded":"2024-09-12T01:07:33.222218+0000","last_fullsized":"2024-09-12T01:07:33.222218+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.222064+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:44.352540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730153,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":476,"num_read_kb":44893,"num_write":1011,"num_write_kb":33699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.362478+0000","last_change":"2024-09-12T01:07:51.362478+0000","last_active":"2024-09-12T01:07:51.362478+0000","last_peered":"2024-09-12T01:07:51.362478+0000","last_clean":"2024-09-12T01:07:51.362478+0000","last_became_active":"2024-09-12T00:21:46.517981+0000","last_became_peered":"2024-09-12T00:21:46.517981+0000","last_unstale":"2024-09-12T01:07:51.362478+0000","last_undegraded":"2024-09-12T01:07:51.362478+0000","last_fullsized":"2024-09-12T01:07:51.362478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:51.362295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:51.362295+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.362295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:14.300895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'279","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.368682+0000","last_change":"2024-09-12T01:07:57.368682+0000","last_active":"2024-09-12T01:07:57.368682+0000","last_peered":"2024-09-12T01:07:57.368682+0000","last_clean":"2024-09-12T01:07:57.368682+0000","last_became_active":"2024-09-12T00:21:48.522920+0000","last_became_peered":"2024-09-12T00:21:48.522920+0000","last_unstale":"2024-09-12T01:07:57.368682+0000","last_undegraded":"2024-09-12T01:07:57.368682+0000","last_fullsized":"2024-09-12T01:07:57.368682+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'279","last_scrub_stamp":"2024-09-12T01:07:57.368482+0000","last_deep_scrub":"267'279","last_deep_scrub_stamp":"2024-09-12T01:07:57.368482+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.368482+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:44.666804+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1024,"num_write":366,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.414890+0000","last_change":"2024-09-12T01:08:06.414890+0000","last_active":"2024-09-12T01:08:06.414890+0000","last_peered":"2024-09-12T01:08:06.414890+0000","last_clean":"2024-09-12T01:08:06.414890+0000","last_became_active":"2024-09-12T00:21:50.543639+0000","last_became_peered":"2024-09-12T00:21:50.543639+0000","last_unstale":"2024-09-12T01:08:06.414890+0000","last_undegraded":"2024-09-12T01:08:06.414890+0000","last_fullsized":"2024-09-12T01:08:06.414890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.414613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.414613+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.414613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:57.975178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2374","reported_seq":4224,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.568799+0000","last_change":"2024-09-12T01:07:58.568799+0000","last_active":"2024-09-12T01:07:58.568799+0000","last_peered":"2024-09-12T01:07:58.568799+0000","last_clean":"2024-09-12T01:07:58.568799+0000","last_became_active":"2024-09-12T00:21:52.537701+0000","last_became_peered":"2024-09-12T00:21:52.537701+0000","last_unstale":"2024-09-12T01:07:58.568799+0000","last_undegraded":"2024-09-12T01:07:58.568799+0000","last_fullsized":"2024-09-12T01:07:58.568799+0000","mapping_epoch":36,"log_start":"267'2300","ondisk_log_start":"267'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2374","last_scrub_stamp":"2024-09-12T01:07:58.568601+0000","last_deep_scrub":"267'2374","last_deep_scrub_stamp":"2024-09-12T01:07:58.568601+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.568601+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":2300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:41.122451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5977,"num_write":4771,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'112","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.271862+0000","last_change":"2024-09-12T01:07:41.271862+0000","last_active":"2024-09-12T01:07:41.271862+0000","last_peered":"2024-09-12T01:07:41.271862+0000","last_clean":"2024-09-12T01:07:41.271862+0000","last_became_active":"2024-09-12T00:21:44.494313+0000","last_became_peered":"2024-09-12T00:21:44.494313+0000","last_unstale":"2024-09-12T01:07:41.271862+0000","last_undegraded":"2024-09-12T01:07:41.271862+0000","last_fullsized":"2024-09-12T01:07:41.271862+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'112","last_scrub_stamp":"2024-09-12T01:07:41.271428+0000","last_deep_scrub":"267'112","last_deep_scrub_stamp":"2024-09-12T01:07:41.271428+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.271428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:21.911085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":397,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'345","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.915359+0000","last_change":"2024-09-12T01:07:49.915359+0000","last_active":"2024-09-12T01:07:49.915359+0000","last_peered":"2024-09-12T01:07:49.915359+0000","last_clean":"2024-09-12T01:07:49.915359+0000","last_became_active":"2024-09-12T00:21:42.529372+0000","last_became_peered":"2024-09-12T00:21:42.529372+0000","last_unstale":"2024-09-12T01:07:49.915359+0000","last_undegraded":"2024-09-12T01:07:49.915359+0000","last_fullsized":"2024-09-12T01:07:49.915359+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T01:07:49.915120+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T01:07:49.915120+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.915120+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:20.870747+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12055,"num_write":1241,"num_write_kb":31958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.018618+0000","last_change":"2024-09-12T01:07:57.018618+0000","last_active":"2024-09-12T01:07:57.018618+0000","last_peered":"2024-09-12T01:07:57.018618+0000","last_clean":"2024-09-12T01:07:57.018618+0000","last_became_active":"2024-09-12T00:21:46.511704+0000","last_became_peered":"2024-09-12T00:21:46.511704+0000","last_unstale":"2024-09-12T01:07:57.018618+0000","last_undegraded":"2024-09-12T01:07:57.018618+0000","last_fullsized":"2024-09-12T01:07:57.018618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.018450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.018450+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.018450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:09.211088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'293","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.148340+0000","last_change":"2024-09-12T01:08:07.148340+0000","last_active":"2024-09-12T01:08:07.148340+0000","last_peered":"2024-09-12T01:08:07.148340+0000","last_clean":"2024-09-12T01:08:07.148340+0000","last_became_active":"2024-09-12T00:21:48.551752+0000","last_became_peered":"2024-09-12T00:21:48.551752+0000","last_unstale":"2024-09-12T01:08:07.148340+0000","last_undegraded":"2024-09-12T01:08:07.148340+0000","last_fullsized":"2024-09-12T01:08:07.148340+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'293","last_scrub_stamp":"2024-09-12T01:08:07.148130+0000","last_deep_scrub":"267'293","last_deep_scrub_stamp":"2024-09-12T01:08:07.148130+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.148130+0000","objects_scrubbed":9,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:20.946763+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42024,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":467,"num_read_kb":1006,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'782","reported_seq":4668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.907857+0000","last_change":"2024-09-12T01:08:04.907857+0000","last_active":"2024-09-12T01:08:04.907857+0000","last_peered":"2024-09-12T01:08:04.907857+0000","last_clean":"2024-09-12T01:08:04.907857+0000","last_became_active":"2024-09-12T00:21:50.561680+0000","last_became_peered":"2024-09-12T00:21:50.561680+0000","last_unstale":"2024-09-12T01:08:04.907857+0000","last_undegraded":"2024-09-12T01:08:04.907857+0000","last_fullsized":"2024-09-12T01:08:04.907857+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:08:04.907672+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:08:04.907672+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.907672+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":701,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:00.038489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'120","reported_seq":626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.318010+0000","last_change":"2024-09-12T01:08:03.318010+0000","last_active":"2024-09-12T01:08:03.318010+0000","last_peered":"2024-09-12T01:08:03.318010+0000","last_clean":"2024-09-12T01:08:03.318010+0000","last_became_active":"2024-09-12T00:21:52.546889+0000","last_became_peered":"2024-09-12T00:21:52.546889+0000","last_unstale":"2024-09-12T01:08:03.318010+0000","last_undegraded":"2024-09-12T01:08:03.318010+0000","last_fullsized":"2024-09-12T01:08:03.318010+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-12T01:08:03.317820+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-12T01:08:03.317820+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.317820+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.621333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":121,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'188","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.987877+0000","last_change":"2024-09-12T01:07:49.987877+0000","last_active":"2024-09-12T01:07:49.987877+0000","last_peered":"2024-09-12T01:07:49.987877+0000","last_clean":"2024-09-12T01:07:49.987877+0000","last_became_active":"2024-09-12T00:21:44.518595+0000","last_became_peered":"2024-09-12T00:21:44.518595+0000","last_unstale":"2024-09-12T01:07:49.987877+0000","last_undegraded":"2024-09-12T01:07:49.987877+0000","last_fullsized":"2024-09-12T01:07:49.987877+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'188","last_scrub_stamp":"2024-09-12T01:07:49.987691+0000","last_deep_scrub":"267'188","last_deep_scrub_stamp":"2024-09-12T01:07:49.987691+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.987691+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:57.684878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":656,"num_write":281,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'267","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.002912+0000","last_change":"2024-09-12T01:07:33.002912+0000","last_active":"2024-09-12T01:07:33.002912+0000","last_peered":"2024-09-12T01:07:33.002912+0000","last_clean":"2024-09-12T01:07:33.002912+0000","last_became_active":"2024-09-12T00:21:42.497992+0000","last_became_peered":"2024-09-12T00:21:42.497992+0000","last_unstale":"2024-09-12T01:07:33.002912+0000","last_undegraded":"2024-09-12T01:07:33.002912+0000","last_fullsized":"2024-09-12T01:07:33.002912+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'267","last_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_deep_scrub":"267'267","last_deep_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.002601+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:20.061473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":82463,"num_write":854,"num_write_kb":27861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.333366+0000","last_change":"2024-09-12T01:07:52.333366+0000","last_active":"2024-09-12T01:07:52.333366+0000","last_peered":"2024-09-12T01:07:52.333366+0000","last_clean":"2024-09-12T01:07:52.333366+0000","last_became_active":"2024-09-12T00:21:46.511365+0000","last_became_peered":"2024-09-12T00:21:46.511365+0000","last_unstale":"2024-09-12T01:07:52.333366+0000","last_undegraded":"2024-09-12T01:07:52.333366+0000","last_fullsized":"2024-09-12T01:07:52.333366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.333162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.333162+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.333162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:19.202850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'480","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.330685+0000","last_change":"2024-09-12T01:07:58.330685+0000","last_active":"2024-09-12T01:07:58.330685+0000","last_peered":"2024-09-12T01:07:58.330685+0000","last_clean":"2024-09-12T01:07:58.330685+0000","last_became_active":"2024-09-12T00:21:48.524173+0000","last_became_peered":"2024-09-12T00:21:48.524173+0000","last_unstale":"2024-09-12T01:07:58.330685+0000","last_undegraded":"2024-09-12T01:07:58.330685+0000","last_fullsized":"2024-09-12T01:07:58.330685+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'480","last_scrub_stamp":"2024-09-12T01:07:58.330481+0000","last_deep_scrub":"267'480","last_deep_scrub_stamp":"2024-09-12T01:07:58.330481+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.330481+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.060816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1944,"num_write":668,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.942552+0000","last_change":"2024-09-12T01:08:03.942552+0000","last_active":"2024-09-12T01:08:03.942552+0000","last_peered":"2024-09-12T01:08:03.942552+0000","last_clean":"2024-09-12T01:08:03.942552+0000","last_became_active":"2024-09-12T00:21:50.561720+0000","last_became_peered":"2024-09-12T00:21:50.561720+0000","last_unstale":"2024-09-12T01:08:03.942552+0000","last_undegraded":"2024-09-12T01:08:03.942552+0000","last_fullsized":"2024-09-12T01:08:03.942552+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:03.942372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:03.942372+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.942372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:41.505555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'126","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.404868+0000","last_change":"2024-09-12T01:07:57.404868+0000","last_active":"2024-09-12T01:07:57.404868+0000","last_peered":"2024-09-12T01:07:57.404868+0000","last_clean":"2024-09-12T01:07:57.404868+0000","last_became_active":"2024-09-12T00:21:52.565276+0000","last_became_peered":"2024-09-12T00:21:52.565276+0000","last_unstale":"2024-09-12T01:07:57.404868+0000","last_undegraded":"2024-09-12T01:07:57.404868+0000","last_fullsized":"2024-09-12T01:07:57.404868+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-09-12T01:07:57.404662+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-09-12T01:07:57.404662+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.404662+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:42.679468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'92","reported_seq":695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.018654+0000","last_change":"2024-09-12T01:07:41.018654+0000","last_active":"2024-09-12T01:07:41.018654+0000","last_peered":"2024-09-12T01:07:41.018654+0000","last_clean":"2024-09-12T01:07:41.018654+0000","last_became_active":"2024-09-12T00:21:44.504866+0000","last_became_peered":"2024-09-12T00:21:44.504866+0000","last_unstale":"2024-09-12T01:07:41.018654+0000","last_undegraded":"2024-09-12T01:07:41.018654+0000","last_fullsized":"2024-09-12T01:07:41.018654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'92","last_scrub_stamp":"2024-09-12T01:07:41.018456+0000","last_deep_scrub":"267'92","last_deep_scrub_stamp":"2024-09-12T01:07:41.018456+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.018456+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:57.826698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":364,"num_write":125,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'360","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.122169+0000","last_change":"2024-09-12T01:07:35.122169+0000","last_active":"2024-09-12T01:07:35.122169+0000","last_peered":"2024-09-12T01:07:35.122169+0000","last_clean":"2024-09-12T01:07:35.122169+0000","last_became_active":"2024-09-12T00:21:42.511762+0000","last_became_peered":"2024-09-12T00:21:42.511762+0000","last_unstale":"2024-09-12T01:07:35.122169+0000","last_undegraded":"2024-09-12T01:07:35.122169+0000","last_fullsized":"2024-09-12T01:07:35.122169+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'360","last_scrub_stamp":"2024-09-12T01:07:35.121973+0000","last_deep_scrub":"267'360","last_deep_scrub_stamp":"2024-09-12T01:07:35.121973+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.121973+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:10.214969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":36352,"num_write":1101,"num_write_kb":41720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.241978+0000","last_change":"2024-09-12T01:07:48.241978+0000","last_active":"2024-09-12T01:07:48.241978+0000","last_peered":"2024-09-12T01:07:48.241978+0000","last_clean":"2024-09-12T01:07:48.241978+0000","last_became_active":"2024-09-12T00:21:46.514486+0000","last_became_peered":"2024-09-12T00:21:46.514486+0000","last_unstale":"2024-09-12T01:07:48.241978+0000","last_undegraded":"2024-09-12T01:07:48.241978+0000","last_fullsized":"2024-09-12T01:07:48.241978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.241783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.241783+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.241783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.010975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'324","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.612716+0000","last_change":"2024-09-12T01:07:51.612716+0000","last_active":"2024-09-12T01:07:51.612716+0000","last_peered":"2024-09-12T01:07:51.612716+0000","last_clean":"2024-09-12T01:07:51.612716+0000","last_became_active":"2024-09-12T00:21:48.547356+0000","last_became_peered":"2024-09-12T00:21:48.547356+0000","last_unstale":"2024-09-12T01:07:51.612716+0000","last_undegraded":"2024-09-12T01:07:51.612716+0000","last_fullsized":"2024-09-12T01:07:51.612716+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-12T01:07:51.612333+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-12T01:07:51.612333+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.612333+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.550390+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55196,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":458,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.258274+0000","last_change":"2024-09-12T01:07:52.258274+0000","last_active":"2024-09-12T01:07:52.258274+0000","last_peered":"2024-09-12T01:07:52.258274+0000","last_clean":"2024-09-12T01:07:52.258274+0000","last_became_active":"2024-09-12T00:21:50.556220+0000","last_became_peered":"2024-09-12T00:21:50.556220+0000","last_unstale":"2024-09-12T01:07:52.258274+0000","last_undegraded":"2024-09-12T01:07:52.258274+0000","last_fullsized":"2024-09-12T01:07:52.258274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.258094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.258094+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.258094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.161738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'130","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.875681+0000","last_change":"2024-09-12T01:08:07.875681+0000","last_active":"2024-09-12T01:08:07.875681+0000","last_peered":"2024-09-12T01:08:07.875681+0000","last_clean":"2024-09-12T01:08:07.875681+0000","last_became_active":"2024-09-12T00:21:52.567273+0000","last_became_peered":"2024-09-12T00:21:52.567273+0000","last_unstale":"2024-09-12T01:08:07.875681+0000","last_undegraded":"2024-09-12T01:08:07.875681+0000","last_fullsized":"2024-09-12T01:08:07.875681+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'130","last_scrub_stamp":"2024-09-12T01:08:07.875498+0000","last_deep_scrub":"267'130","last_deep_scrub_stamp":"2024-09-12T01:08:07.875498+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.875498+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:35.875359+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'124","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.917629+0000","last_change":"2024-09-12T01:07:53.917629+0000","last_active":"2024-09-12T01:07:53.917629+0000","last_peered":"2024-09-12T01:07:53.917629+0000","last_clean":"2024-09-12T01:07:53.917629+0000","last_became_active":"2024-09-12T00:21:44.502965+0000","last_became_peered":"2024-09-12T00:21:44.502965+0000","last_unstale":"2024-09-12T01:07:53.917629+0000","last_undegraded":"2024-09-12T01:07:53.917629+0000","last_fullsized":"2024-09-12T01:07:53.917629+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'124","last_scrub_stamp":"2024-09-12T01:07:53.917407+0000","last_deep_scrub":"267'124","last_deep_scrub_stamp":"2024-09-12T01:07:53.917407+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.917407+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:24.103740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":435,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'354","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.387251+0000","last_change":"2024-09-12T01:07:37.386999+0000","last_active":"2024-09-12T01:07:37.387251+0000","last_peered":"2024-09-12T01:07:37.387251+0000","last_clean":"2024-09-12T01:07:37.387251+0000","last_became_active":"2024-09-12T00:22:13.520026+0000","last_became_peered":"2024-09-12T00:22:13.520026+0000","last_unstale":"2024-09-12T01:07:37.387251+0000","last_undegraded":"2024-09-12T01:07:37.387251+0000","last_fullsized":"2024-09-12T01:07:37.387251+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T01:07:37.386628+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T01:07:37.386628+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.386628+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:48.359725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254518,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":616,"num_read_kb":38314,"num_write":1135,"num_write_kb":31045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.002454+0000","last_change":"2024-09-12T01:08:00.002454+0000","last_active":"2024-09-12T01:08:00.002454+0000","last_peered":"2024-09-12T01:08:00.002454+0000","last_clean":"2024-09-12T01:08:00.002454+0000","last_became_active":"2024-09-12T00:21:46.507456+0000","last_became_peered":"2024-09-12T00:21:46.507456+0000","last_unstale":"2024-09-12T01:08:00.002454+0000","last_undegraded":"2024-09-12T01:08:00.002454+0000","last_fullsized":"2024-09-12T01:08:00.002454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.002274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.002274+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.002274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:36.717809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'317","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.994766+0000","last_change":"2024-09-12T01:08:00.994766+0000","last_active":"2024-09-12T01:08:00.994766+0000","last_peered":"2024-09-12T01:08:00.994766+0000","last_clean":"2024-09-12T01:08:00.994766+0000","last_became_active":"2024-09-12T00:21:48.535782+0000","last_became_peered":"2024-09-12T00:21:48.535782+0000","last_unstale":"2024-09-12T01:08:00.994766+0000","last_undegraded":"2024-09-12T01:08:00.994766+0000","last_fullsized":"2024-09-12T01:08:00.994766+0000","mapping_epoch":32,"log_start":"267'301","ondisk_log_start":"267'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T01:08:00.994518+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T01:08:00.994518+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.994518+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:25.545285+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1134,"num_write":412,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'751","reported_seq":2254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.277045+0000","last_change":"2024-09-12T01:07:50.277045+0000","last_active":"2024-09-12T01:07:50.277045+0000","last_peered":"2024-09-12T01:07:50.277045+0000","last_clean":"2024-09-12T01:07:50.277045+0000","last_became_active":"2024-09-12T00:21:50.557158+0000","last_became_peered":"2024-09-12T00:21:50.557158+0000","last_unstale":"2024-09-12T01:07:50.277045+0000","last_undegraded":"2024-09-12T01:07:50.277045+0000","last_fullsized":"2024-09-12T01:07:50.277045+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-12T01:07:50.276867+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-12T01:07:50.276867+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.276867+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:14.558606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'137","reported_seq":650,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.322253+0000","last_change":"2024-09-12T01:08:01.322253+0000","last_active":"2024-09-12T01:08:01.322253+0000","last_peered":"2024-09-12T01:08:01.322253+0000","last_clean":"2024-09-12T01:08:01.322253+0000","last_became_active":"2024-09-12T00:21:52.545876+0000","last_became_peered":"2024-09-12T00:21:52.545876+0000","last_unstale":"2024-09-12T01:08:01.322253+0000","last_undegraded":"2024-09-12T01:08:01.322253+0000","last_fullsized":"2024-09-12T01:08:01.322253+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-12T01:08:01.322059+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-12T01:08:01.322059+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.322059+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:03.008393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":172,"num_write":354,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'141","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.298300+0000","last_change":"2024-09-12T01:07:42.298300+0000","last_active":"2024-09-12T01:07:42.298300+0000","last_peered":"2024-09-12T01:07:42.298300+0000","last_clean":"2024-09-12T01:07:42.298300+0000","last_became_active":"2024-09-12T00:21:44.494386+0000","last_became_peered":"2024-09-12T00:21:44.494386+0000","last_unstale":"2024-09-12T01:07:42.298300+0000","last_undegraded":"2024-09-12T01:07:42.298300+0000","last_fullsized":"2024-09-12T01:07:42.298300+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T01:07:42.298107+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T01:07:42.298107+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.298107+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:49.298297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":627,"num_read_kb":527,"num_write":195,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'416","reported_seq":1113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.903721+0000","last_change":"2024-09-12T01:07:34.903721+0000","last_active":"2024-09-12T01:07:34.903721+0000","last_peered":"2024-09-12T01:07:34.903721+0000","last_clean":"2024-09-12T01:07:34.903721+0000","last_became_active":"2024-09-12T00:21:42.528782+0000","last_became_peered":"2024-09-12T00:21:42.528782+0000","last_unstale":"2024-09-12T01:07:34.903721+0000","last_undegraded":"2024-09-12T01:07:34.903721+0000","last_fullsized":"2024-09-12T01:07:34.903721+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-12T01:07:34.903475+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-12T01:07:34.903475+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.903475+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.315924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170245,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":31515,"num_write":1240,"num_write_kb":36332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"267'10","reported_seq":1955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.565753+0000","last_change":"2024-09-12T01:07:47.565753+0000","last_active":"2024-09-12T01:07:47.565753+0000","last_peered":"2024-09-12T01:07:47.565753+0000","last_clean":"2024-09-12T01:07:47.565753+0000","last_became_active":"2024-09-12T00:21:46.503412+0000","last_became_peered":"2024-09-12T00:21:46.503412+0000","last_unstale":"2024-09-12T01:07:47.565753+0000","last_undegraded":"2024-09-12T01:07:47.565753+0000","last_fullsized":"2024-09-12T01:07:47.565753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T01:07:47.565529+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T01:07:47.565529+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.565529+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:17.675182+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1686,"num_read_kb":2152,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'78","reported_seq":601,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.356185+0000","last_change":"2024-09-12T01:07:55.356185+0000","last_active":"2024-09-12T01:07:55.356185+0000","last_peered":"2024-09-12T01:07:55.356185+0000","last_clean":"2024-09-12T01:07:55.356185+0000","last_became_active":"2024-09-12T00:21:48.545388+0000","last_became_peered":"2024-09-12T00:21:48.545388+0000","last_unstale":"2024-09-12T01:07:55.356185+0000","last_undegraded":"2024-09-12T01:07:55.356185+0000","last_fullsized":"2024-09-12T01:07:55.356185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'78","last_scrub_stamp":"2024-09-12T01:07:55.355975+0000","last_deep_scrub":"267'78","last_deep_scrub_stamp":"2024-09-12T01:07:55.355975+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.355975+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:43.494932+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":4019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.572399+0000","last_change":"2024-09-12T01:07:54.572399+0000","last_active":"2024-09-12T01:07:54.572399+0000","last_peered":"2024-09-12T01:07:54.572399+0000","last_clean":"2024-09-12T01:07:54.572399+0000","last_became_active":"2024-09-12T00:21:50.536672+0000","last_became_peered":"2024-09-12T00:21:50.536672+0000","last_unstale":"2024-09-12T01:07:54.572399+0000","last_undegraded":"2024-09-12T01:07:54.572399+0000","last_fullsized":"2024-09-12T01:07:54.572399+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-12T01:07:54.572215+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-12T01:07:54.572215+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.572215+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:58.399564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'123","reported_seq":644,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.191191+0000","last_change":"2024-09-12T01:07:59.191191+0000","last_active":"2024-09-12T01:07:59.191191+0000","last_peered":"2024-09-12T01:07:59.191191+0000","last_clean":"2024-09-12T01:07:59.191191+0000","last_became_active":"2024-09-12T00:21:52.556523+0000","last_became_peered":"2024-09-12T00:21:52.556523+0000","last_unstale":"2024-09-12T01:07:59.191191+0000","last_undegraded":"2024-09-12T01:07:59.191191+0000","last_fullsized":"2024-09-12T01:07:59.191191+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T01:07:59.191010+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T01:07:59.191010+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.191010+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:19.235147+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":161,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'217","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.091763+0000","last_change":"2024-09-12T01:07:40.091763+0000","last_active":"2024-09-12T01:07:40.091763+0000","last_peered":"2024-09-12T01:07:40.091763+0000","last_clean":"2024-09-12T01:07:40.091763+0000","last_became_active":"2024-09-12T00:21:44.514085+0000","last_became_peered":"2024-09-12T00:21:44.514085+0000","last_unstale":"2024-09-12T01:07:40.091763+0000","last_undegraded":"2024-09-12T01:07:40.091763+0000","last_fullsized":"2024-09-12T01:07:40.091763+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'217","last_scrub_stamp":"2024-09-12T01:07:40.091578+0000","last_deep_scrub":"267'217","last_deep_scrub_stamp":"2024-09-12T01:07:40.091578+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.091578+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:49.279255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":987,"num_read_kb":820,"num_write":332,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'341","reported_seq":965,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.355510+0000","last_change":"2024-09-12T01:07:36.355510+0000","last_active":"2024-09-12T01:07:36.355510+0000","last_peered":"2024-09-12T01:07:36.355510+0000","last_clean":"2024-09-12T01:07:36.355510+0000","last_became_active":"2024-09-12T00:21:42.484728+0000","last_became_peered":"2024-09-12T00:21:42.484728+0000","last_unstale":"2024-09-12T01:07:36.355510+0000","last_undegraded":"2024-09-12T01:07:36.355510+0000","last_fullsized":"2024-09-12T01:07:36.355510+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:36.355185+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:36.355185+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.355185+0000","objects_scrubbed":9,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:41.361142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":1781,"num_write":1014,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.017730+0000","last_change":"2024-09-12T01:08:01.017730+0000","last_active":"2024-09-12T01:08:01.017730+0000","last_peered":"2024-09-12T01:08:01.017730+0000","last_clean":"2024-09-12T01:08:01.017730+0000","last_became_active":"2024-09-12T00:21:46.515469+0000","last_became_peered":"2024-09-12T00:21:46.515469+0000","last_unstale":"2024-09-12T01:08:01.017730+0000","last_undegraded":"2024-09-12T01:08:01.017730+0000","last_fullsized":"2024-09-12T01:08:01.017730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:01.017496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:01.017496+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.017496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:43.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'349","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.611743+0000","last_change":"2024-09-12T01:07:50.611743+0000","last_active":"2024-09-12T01:07:50.611743+0000","last_peered":"2024-09-12T01:07:50.611743+0000","last_clean":"2024-09-12T01:07:50.611743+0000","last_became_active":"2024-09-12T00:21:48.523392+0000","last_became_peered":"2024-09-12T00:21:48.523392+0000","last_unstale":"2024-09-12T01:07:50.611743+0000","last_undegraded":"2024-09-12T01:07:50.611743+0000","last_fullsized":"2024-09-12T01:07:50.611743+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:50.611343+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:50.611343+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.611343+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:19.848968+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50746,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1171,"num_write":440,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.158670+0000","last_change":"2024-09-12T01:07:53.158670+0000","last_active":"2024-09-12T01:07:53.158670+0000","last_peered":"2024-09-12T01:07:53.158670+0000","last_clean":"2024-09-12T01:07:53.158670+0000","last_became_active":"2024-09-12T00:21:50.566831+0000","last_became_peered":"2024-09-12T00:21:50.566831+0000","last_unstale":"2024-09-12T01:07:53.158670+0000","last_undegraded":"2024-09-12T01:07:53.158670+0000","last_fullsized":"2024-09-12T01:07:53.158670+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.158455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.158455+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.158455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.192498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'160","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.400800+0000","last_change":"2024-09-12T01:07:58.400800+0000","last_active":"2024-09-12T01:07:58.400800+0000","last_peered":"2024-09-12T01:07:58.400800+0000","last_clean":"2024-09-12T01:07:58.400800+0000","last_became_active":"2024-09-12T00:21:52.562716+0000","last_became_peered":"2024-09-12T00:21:52.562716+0000","last_unstale":"2024-09-12T01:07:58.400800+0000","last_undegraded":"2024-09-12T01:07:58.400800+0000","last_fullsized":"2024-09-12T01:07:58.400800+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-12T01:07:58.400599+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-12T01:07:58.400599+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.400599+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:15.165779+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":186,"num_write":388,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'137","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.915375+0000","last_change":"2024-09-12T01:07:52.915375+0000","last_active":"2024-09-12T01:07:52.915375+0000","last_peered":"2024-09-12T01:07:52.915375+0000","last_clean":"2024-09-12T01:07:52.915375+0000","last_became_active":"2024-09-12T00:21:44.502832+0000","last_became_peered":"2024-09-12T00:21:44.502832+0000","last_unstale":"2024-09-12T01:07:52.915375+0000","last_undegraded":"2024-09-12T01:07:52.915375+0000","last_fullsized":"2024-09-12T01:07:52.915375+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-12T01:07:52.915187+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-12T01:07:52.915187+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.915187+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:13.701531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":521,"num_write":201,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.580210+0000","last_change":"2024-09-12T01:07:32.580034+0000","last_active":"2024-09-12T01:07:32.580210+0000","last_peered":"2024-09-12T01:07:32.580210+0000","last_clean":"2024-09-12T01:07:32.580210+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T01:07:32.580210+0000","last_undegraded":"2024-09-12T01:07:32.580210+0000","last_fullsized":"2024-09-12T01:07:32.580210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_clean_scrub_stamp":"2024-09-12T01:07:32.579842+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:04.507720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.906029+0000","last_change":"2024-09-12T01:07:35.906029+0000","last_active":"2024-09-12T01:07:35.906029+0000","last_peered":"2024-09-12T01:07:35.906029+0000","last_clean":"2024-09-12T01:07:35.906029+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T01:07:35.906029+0000","last_undegraded":"2024-09-12T01:07:35.906029+0000","last_fullsized":"2024-09-12T01:07:35.906029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:35.905826+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:35.905826+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.905826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:16.286458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'330","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.395101+0000","last_change":"2024-09-12T01:07:34.394877+0000","last_active":"2024-09-12T01:07:34.395101+0000","last_peered":"2024-09-12T01:07:34.395101+0000","last_clean":"2024-09-12T01:07:34.395101+0000","last_became_active":"2024-09-12T00:21:42.513672+0000","last_became_peered":"2024-09-12T00:21:42.513672+0000","last_unstale":"2024-09-12T01:07:34.395101+0000","last_undegraded":"2024-09-12T01:07:34.395101+0000","last_fullsized":"2024-09-12T01:07:34.395101+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.394679+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:03.112904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":4546,"num_write":1074,"num_write_kb":26678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.033296+0000","last_change":"2024-09-12T01:07:53.033296+0000","last_active":"2024-09-12T01:07:53.033296+0000","last_peered":"2024-09-12T01:07:53.033296+0000","last_clean":"2024-09-12T01:07:53.033296+0000","last_became_active":"2024-09-12T00:21:46.506196+0000","last_became_peered":"2024-09-12T00:21:46.506196+0000","last_unstale":"2024-09-12T01:07:53.033296+0000","last_undegraded":"2024-09-12T01:07:53.033296+0000","last_fullsized":"2024-09-12T01:07:53.033296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.033120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.033120+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.033120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:50.956403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'739","reported_seq":1458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.125113+0000","last_change":"2024-09-12T01:08:06.125113+0000","last_active":"2024-09-12T01:08:06.125113+0000","last_peered":"2024-09-12T01:08:06.125113+0000","last_clean":"2024-09-12T01:08:06.125113+0000","last_became_active":"2024-09-12T00:21:48.544327+0000","last_became_peered":"2024-09-12T00:21:48.544327+0000","last_unstale":"2024-09-12T01:08:06.125113+0000","last_undegraded":"2024-09-12T01:08:06.125113+0000","last_fullsized":"2024-09-12T01:08:06.125113+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'739","last_scrub_stamp":"2024-09-12T01:08:06.124915+0000","last_deep_scrub":"267'739","last_deep_scrub_stamp":"2024-09-12T01:08:06.124915+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.124915+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:14.274030+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135809,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1416,"num_read_kb":3269,"num_write":1306,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89362,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.920070+0000","last_change":"2024-09-12T01:08:02.920070+0000","last_active":"2024-09-12T01:08:02.920070+0000","last_peered":"2024-09-12T01:08:02.920070+0000","last_clean":"2024-09-12T01:08:02.920070+0000","last_became_active":"2024-09-12T00:21:50.564442+0000","last_became_peered":"2024-09-12T00:21:50.564442+0000","last_unstale":"2024-09-12T01:08:02.920070+0000","last_undegraded":"2024-09-12T01:08:02.920070+0000","last_fullsized":"2024-09-12T01:08:02.920070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.919883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.919883+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.919883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:43.295107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'208","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.998487+0000","last_change":"2024-09-12T01:07:53.998487+0000","last_active":"2024-09-12T01:07:53.998487+0000","last_peered":"2024-09-12T01:07:53.998487+0000","last_clean":"2024-09-12T01:07:53.998487+0000","last_became_active":"2024-09-12T00:21:52.550903+0000","last_became_peered":"2024-09-12T00:21:52.550903+0000","last_unstale":"2024-09-12T01:07:53.998487+0000","last_undegraded":"2024-09-12T01:07:53.998487+0000","last_fullsized":"2024-09-12T01:07:53.998487+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-12T01:07:53.998298+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-12T01:07:53.998298+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.998298+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:09.883248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":429,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'100","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.989390+0000","last_change":"2024-09-12T01:07:48.989390+0000","last_active":"2024-09-12T01:07:48.989390+0000","last_peered":"2024-09-12T01:07:48.989390+0000","last_clean":"2024-09-12T01:07:48.989390+0000","last_became_active":"2024-09-12T00:21:44.518873+0000","last_became_peered":"2024-09-12T00:21:44.518873+0000","last_unstale":"2024-09-12T01:07:48.989390+0000","last_undegraded":"2024-09-12T01:07:48.989390+0000","last_fullsized":"2024-09-12T01:07:48.989390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-09-12T01:07:48.989211+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-09-12T01:07:48.989211+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.989211+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:37.038222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":399,"num_write":140,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.899210+0000","last_change":"2024-09-12T01:07:33.899120+0000","last_active":"2024-09-12T01:07:33.899210+0000","last_peered":"2024-09-12T01:07:33.899210+0000","last_clean":"2024-09-12T01:07:33.899210+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T01:07:33.899210+0000","last_undegraded":"2024-09-12T01:07:33.899210+0000","last_fullsized":"2024-09-12T01:07:33.899210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.899012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:18.503999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'343","reported_seq":1176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.346185+0000","last_change":"2024-09-12T01:07:35.346185+0000","last_active":"2024-09-12T01:07:35.346185+0000","last_peered":"2024-09-12T01:07:35.346185+0000","last_clean":"2024-09-12T01:07:35.346185+0000","last_became_active":"2024-09-12T00:21:42.530049+0000","last_became_peered":"2024-09-12T00:21:42.530049+0000","last_unstale":"2024-09-12T01:07:35.346185+0000","last_undegraded":"2024-09-12T01:07:35.346185+0000","last_fullsized":"2024-09-12T01:07:35.346185+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T01:07:35.345949+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T01:07:35.345949+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.345949+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.411177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":794,"num_read_kb":7845,"num_write":1116,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.018870+0000","last_change":"2024-09-12T01:08:00.018870+0000","last_active":"2024-09-12T01:08:00.018870+0000","last_peered":"2024-09-12T01:08:00.018870+0000","last_clean":"2024-09-12T01:08:00.018870+0000","last_became_active":"2024-09-12T00:21:46.506303+0000","last_became_peered":"2024-09-12T00:21:46.506303+0000","last_unstale":"2024-09-12T01:08:00.018870+0000","last_undegraded":"2024-09-12T01:08:00.018870+0000","last_fullsized":"2024-09-12T01:08:00.018870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.018690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.018690+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.018690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:02.431074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1273","reported_seq":2766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.281768+0000","last_change":"2024-09-12T01:07:51.281768+0000","last_active":"2024-09-12T01:07:51.281768+0000","last_peered":"2024-09-12T01:07:51.281768+0000","last_clean":"2024-09-12T01:07:51.281768+0000","last_became_active":"2024-09-12T00:21:48.538447+0000","last_became_peered":"2024-09-12T00:21:48.538447+0000","last_unstale":"2024-09-12T01:07:51.281768+0000","last_undegraded":"2024-09-12T01:07:51.281768+0000","last_fullsized":"2024-09-12T01:07:51.281768+0000","mapping_epoch":32,"log_start":"267'1200","ondisk_log_start":"267'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1273","last_scrub_stamp":"2024-09-12T01:07:51.281563+0000","last_deep_scrub":"267'1273","last_deep_scrub_stamp":"2024-09-12T01:07:51.281563+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.281563+0000","objects_scrubbed":12,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.388345+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157796,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2036,"num_read_kb":3848,"num_write":1138,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.186607+0000","last_change":"2024-09-12T01:08:10.186607+0000","last_active":"2024-09-12T01:08:10.186607+0000","last_peered":"2024-09-12T01:08:10.186607+0000","last_clean":"2024-09-12T01:08:10.186607+0000","last_became_active":"2024-09-12T00:21:50.568353+0000","last_became_peered":"2024-09-12T00:21:50.568353+0000","last_unstale":"2024-09-12T01:08:10.186607+0000","last_undegraded":"2024-09-12T01:08:10.186607+0000","last_fullsized":"2024-09-12T01:08:10.186607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.186425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.186425+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.186425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:21.871936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'223","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.863911+0000","last_change":"2024-09-12T01:08:08.863911+0000","last_active":"2024-09-12T01:08:08.863911+0000","last_peered":"2024-09-12T01:08:08.863911+0000","last_clean":"2024-09-12T01:08:08.863911+0000","last_became_active":"2024-09-12T00:21:52.559325+0000","last_became_peered":"2024-09-12T00:21:52.559325+0000","last_unstale":"2024-09-12T01:08:08.863911+0000","last_undegraded":"2024-09-12T01:08:08.863911+0000","last_fullsized":"2024-09-12T01:08:08.863911+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-12T01:08:08.863610+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-12T01:08:08.863610+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.863610+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:28.930627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":373,"num_write":495,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'235","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.322614+0000","last_change":"2024-09-12T01:07:47.322614+0000","last_active":"2024-09-12T01:07:47.322614+0000","last_peered":"2024-09-12T01:07:47.322614+0000","last_clean":"2024-09-12T01:07:47.322614+0000","last_became_active":"2024-09-12T00:21:44.499405+0000","last_became_peered":"2024-09-12T00:21:44.499405+0000","last_unstale":"2024-09-12T01:07:47.322614+0000","last_undegraded":"2024-09-12T01:07:47.322614+0000","last_fullsized":"2024-09-12T01:07:47.322614+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'235","last_scrub_stamp":"2024-09-12T01:07:47.322434+0000","last_deep_scrub":"267'235","last_deep_scrub_stamp":"2024-09-12T01:07:47.322434+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.322434+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:14.108801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":847,"num_write":402,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.153871+0000","last_change":"2024-09-12T01:07:36.153871+0000","last_active":"2024-09-12T01:07:36.153871+0000","last_peered":"2024-09-12T01:07:36.153871+0000","last_clean":"2024-09-12T01:07:36.153871+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T01:07:36.153871+0000","last_undegraded":"2024-09-12T01:07:36.153871+0000","last_fullsized":"2024-09-12T01:07:36.153871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:36.153692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:36.153692+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.153692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:30.299331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'318","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.085677+0000","last_change":"2024-09-12T01:07:36.085507+0000","last_active":"2024-09-12T01:07:36.085677+0000","last_peered":"2024-09-12T01:07:36.085677+0000","last_clean":"2024-09-12T01:07:36.085677+0000","last_became_active":"2024-09-12T00:21:42.533356+0000","last_became_peered":"2024-09-12T00:21:42.533356+0000","last_unstale":"2024-09-12T01:07:36.085677+0000","last_undegraded":"2024-09-12T01:07:36.085677+0000","last_fullsized":"2024-09-12T01:07:36.085677+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'318","last_scrub_stamp":"2024-09-12T01:07:36.085311+0000","last_deep_scrub":"267'318","last_deep_scrub_stamp":"2024-09-12T01:07:36.085311+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.085311+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:29.914431+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":11281,"num_write":971,"num_write_kb":25420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.238554+0000","last_change":"2024-09-12T01:07:47.238554+0000","last_active":"2024-09-12T01:07:47.238554+0000","last_peered":"2024-09-12T01:07:47.238554+0000","last_clean":"2024-09-12T01:07:47.238554+0000","last_became_active":"2024-09-12T00:21:46.510230+0000","last_became_peered":"2024-09-12T00:21:46.510230+0000","last_unstale":"2024-09-12T01:07:47.238554+0000","last_undegraded":"2024-09-12T01:07:47.238554+0000","last_fullsized":"2024-09-12T01:07:47.238554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:47.238372+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:47.238372+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.238372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:41.000780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'245","reported_seq":1351,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.046686+0000","last_change":"2024-09-12T01:07:49.046525+0000","last_active":"2024-09-12T01:07:49.046686+0000","last_peered":"2024-09-12T01:07:49.046686+0000","last_clean":"2024-09-12T01:07:49.046686+0000","last_became_active":"2024-09-12T00:21:48.541987+0000","last_became_peered":"2024-09-12T00:21:48.541987+0000","last_unstale":"2024-09-12T01:07:49.046686+0000","last_undegraded":"2024-09-12T01:07:49.046686+0000","last_fullsized":"2024-09-12T01:07:49.046686+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-12T01:07:49.046303+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-12T01:07:49.046303+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.046303+0000","objects_scrubbed":9,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.771459+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.386867+0000","last_change":"2024-09-12T01:08:05.386867+0000","last_active":"2024-09-12T01:08:05.386867+0000","last_peered":"2024-09-12T01:08:05.386867+0000","last_clean":"2024-09-12T01:08:05.386867+0000","last_became_active":"2024-09-12T00:21:50.549468+0000","last_became_peered":"2024-09-12T00:21:50.549468+0000","last_unstale":"2024-09-12T01:08:05.386867+0000","last_undegraded":"2024-09-12T01:08:05.386867+0000","last_fullsized":"2024-09-12T01:08:05.386867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:05.386687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:05.386687+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.386687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:01.916299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'268","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.536357+0000","last_change":"2024-09-12T01:08:09.536357+0000","last_active":"2024-09-12T01:08:09.536357+0000","last_peered":"2024-09-12T01:08:09.536357+0000","last_clean":"2024-09-12T01:08:09.536357+0000","last_became_active":"2024-09-12T00:21:52.552571+0000","last_became_peered":"2024-09-12T00:21:52.552571+0000","last_unstale":"2024-09-12T01:08:09.536357+0000","last_undegraded":"2024-09-12T01:08:09.536357+0000","last_fullsized":"2024-09-12T01:08:09.536357+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'268","last_scrub_stamp":"2024-09-12T01:08:09.536163+0000","last_deep_scrub":"267'268","last_deep_scrub_stamp":"2024-09-12T01:08:09.536163+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.536163+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.788178+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":539,"num_write":598,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'152","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.362750+0000","last_change":"2024-09-12T01:07:45.362750+0000","last_active":"2024-09-12T01:07:45.362750+0000","last_peered":"2024-09-12T01:07:45.362750+0000","last_clean":"2024-09-12T01:07:45.362750+0000","last_became_active":"2024-09-12T00:21:44.493744+0000","last_became_peered":"2024-09-12T00:21:44.493744+0000","last_unstale":"2024-09-12T01:07:45.362750+0000","last_undegraded":"2024-09-12T01:07:45.362750+0000","last_fullsized":"2024-09-12T01:07:45.362750+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:07:45.362559+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:07:45.362559+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.362559+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:35.283238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":592,"num_write":229,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.900196+0000","last_change":"2024-09-12T01:07:38.900196+0000","last_active":"2024-09-12T01:07:38.900196+0000","last_peered":"2024-09-12T01:07:38.900196+0000","last_clean":"2024-09-12T01:07:38.900196+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T01:07:38.900196+0000","last_undegraded":"2024-09-12T01:07:38.900196+0000","last_fullsized":"2024-09-12T01:07:38.900196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:07:38.899976+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:07:38.899976+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.899976+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.986434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'327","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.015691+0000","last_change":"2024-09-12T01:07:34.015525+0000","last_active":"2024-09-12T01:07:34.015691+0000","last_peered":"2024-09-12T01:07:34.015691+0000","last_clean":"2024-09-12T01:07:34.015691+0000","last_became_active":"2024-09-12T00:21:42.528949+0000","last_became_peered":"2024-09-12T00:21:42.528949+0000","last_unstale":"2024-09-12T01:07:34.015691+0000","last_undegraded":"2024-09-12T01:07:34.015691+0000","last_fullsized":"2024-09-12T01:07:34.015691+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.015318+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.629212+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":67654,"num_write":1033,"num_write_kb":55160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.190802+0000","last_change":"2024-09-12T01:07:46.190671+0000","last_active":"2024-09-12T01:07:46.190802+0000","last_peered":"2024-09-12T01:07:46.190802+0000","last_clean":"2024-09-12T01:07:46.190802+0000","last_became_active":"2024-09-12T00:21:46.517381+0000","last_became_peered":"2024-09-12T00:21:46.517381+0000","last_unstale":"2024-09-12T01:07:46.190802+0000","last_undegraded":"2024-09-12T01:07:46.190802+0000","last_fullsized":"2024-09-12T01:07:46.190802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:46.190493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:46.190493+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.190493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:43.299136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'127","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.023133+0000","last_change":"2024-09-12T01:07:59.023133+0000","last_active":"2024-09-12T01:07:59.023133+0000","last_peered":"2024-09-12T01:07:59.023133+0000","last_clean":"2024-09-12T01:07:59.023133+0000","last_became_active":"2024-09-12T00:21:48.553129+0000","last_became_peered":"2024-09-12T00:21:48.553129+0000","last_unstale":"2024-09-12T01:07:59.023133+0000","last_undegraded":"2024-09-12T01:07:59.023133+0000","last_fullsized":"2024-09-12T01:07:59.023133+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'127","last_scrub_stamp":"2024-09-12T01:07:59.022824+0000","last_deep_scrub":"267'127","last_deep_scrub_stamp":"2024-09-12T01:07:59.022824+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.022824+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:07.237907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.189927+0000","last_change":"2024-09-12T01:08:11.189927+0000","last_active":"2024-09-12T01:08:11.189927+0000","last_peered":"2024-09-12T01:08:11.189927+0000","last_clean":"2024-09-12T01:08:11.189927+0000","last_became_active":"2024-09-12T00:21:50.545037+0000","last_became_peered":"2024-09-12T00:21:50.545037+0000","last_unstale":"2024-09-12T01:08:11.189927+0000","last_undegraded":"2024-09-12T01:08:11.189927+0000","last_fullsized":"2024-09-12T01:08:11.189927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.189752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.189752+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.189752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:17.097362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'99","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.546452+0000","last_change":"2024-09-12T01:08:00.546452+0000","last_active":"2024-09-12T01:08:00.546452+0000","last_peered":"2024-09-12T01:08:00.546452+0000","last_clean":"2024-09-12T01:08:00.546452+0000","last_became_active":"2024-09-12T00:21:52.540900+0000","last_became_peered":"2024-09-12T00:21:52.540900+0000","last_unstale":"2024-09-12T01:08:00.546452+0000","last_undegraded":"2024-09-12T01:08:00.546452+0000","last_fullsized":"2024-09-12T01:08:00.546452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'99","last_scrub_stamp":"2024-09-12T01:08:00.546265+0000","last_deep_scrub":"267'99","last_deep_scrub_stamp":"2024-09-12T01:08:00.546265+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.546265+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:57.513145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":212,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'221","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.354086+0000","last_change":"2024-09-12T01:07:43.354086+0000","last_active":"2024-09-12T01:07:43.354086+0000","last_peered":"2024-09-12T01:07:43.354086+0000","last_clean":"2024-09-12T01:07:43.354086+0000","last_became_active":"2024-09-12T00:21:44.497354+0000","last_became_peered":"2024-09-12T00:21:44.497354+0000","last_unstale":"2024-09-12T01:07:43.354086+0000","last_undegraded":"2024-09-12T01:07:43.354086+0000","last_fullsized":"2024-09-12T01:07:43.354086+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'221","last_scrub_stamp":"2024-09-12T01:07:43.353908+0000","last_deep_scrub":"267'221","last_deep_scrub_stamp":"2024-09-12T01:07:43.353908+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.353908+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.870435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":990,"num_read_kb":806,"num_write":357,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'303","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.246792+0000","last_change":"2024-09-12T01:07:34.246713+0000","last_active":"2024-09-12T01:07:34.246792+0000","last_peered":"2024-09-12T01:07:34.246792+0000","last_clean":"2024-09-12T01:07:34.246792+0000","last_became_active":"2024-09-12T00:21:42.521990+0000","last_became_peered":"2024-09-12T00:21:42.521990+0000","last_unstale":"2024-09-12T01:07:34.246792+0000","last_undegraded":"2024-09-12T01:07:34.246792+0000","last_fullsized":"2024-09-12T01:07:34.246792+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'303","last_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_deep_scrub":"267'303","last_deep_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.246523+0000","objects_scrubbed":10,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.373734+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829291,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":446,"num_read_kb":61837,"num_write":1004,"num_write_kb":29041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.063098+0000","last_change":"2024-09-12T01:07:35.063098+0000","last_active":"2024-09-12T01:07:35.063098+0000","last_peered":"2024-09-12T01:07:35.063098+0000","last_clean":"2024-09-12T01:07:35.063098+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T01:07:35.063098+0000","last_undegraded":"2024-09-12T01:07:35.063098+0000","last_fullsized":"2024-09-12T01:07:35.063098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:35.062821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:35.062821+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.062821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:09.059649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.293267+0000","last_change":"2024-09-12T01:07:52.293267+0000","last_active":"2024-09-12T01:07:52.293267+0000","last_peered":"2024-09-12T01:07:52.293267+0000","last_clean":"2024-09-12T01:07:52.293267+0000","last_became_active":"2024-09-12T00:21:46.498378+0000","last_became_peered":"2024-09-12T00:21:46.498378+0000","last_unstale":"2024-09-12T01:07:52.293267+0000","last_undegraded":"2024-09-12T01:07:52.293267+0000","last_fullsized":"2024-09-12T01:07:52.293267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.293052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.293052+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.293052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:39.789136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'587","reported_seq":1264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.285111+0000","last_change":"2024-09-12T01:07:49.284958+0000","last_active":"2024-09-12T01:07:49.285111+0000","last_peered":"2024-09-12T01:07:49.285111+0000","last_clean":"2024-09-12T01:07:49.285111+0000","last_became_active":"2024-09-12T00:21:48.534749+0000","last_became_peered":"2024-09-12T00:21:48.534749+0000","last_unstale":"2024-09-12T01:07:49.285111+0000","last_undegraded":"2024-09-12T01:07:49.285111+0000","last_fullsized":"2024-09-12T01:07:49.285111+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'587","last_scrub_stamp":"2024-09-12T01:07:49.284741+0000","last_deep_scrub":"267'587","last_deep_scrub_stamp":"2024-09-12T01:07:49.284741+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.284741+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:51.464003+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96095,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1602,"num_read_kb":2762,"num_write":2078,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508332,"num_omap_keys":1154,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.138849+0000","last_change":"2024-09-12T01:07:54.138849+0000","last_active":"2024-09-12T01:07:54.138849+0000","last_peered":"2024-09-12T01:07:54.138849+0000","last_clean":"2024-09-12T01:07:54.138849+0000","last_became_active":"2024-09-12T00:21:50.554728+0000","last_became_peered":"2024-09-12T00:21:50.554728+0000","last_unstale":"2024-09-12T01:07:54.138849+0000","last_undegraded":"2024-09-12T01:07:54.138849+0000","last_fullsized":"2024-09-12T01:07:54.138849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.138667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.138667+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.138667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:32.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'180","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.868317+0000","last_change":"2024-09-12T01:08:10.868317+0000","last_active":"2024-09-12T01:08:10.868317+0000","last_peered":"2024-09-12T01:08:10.868317+0000","last_clean":"2024-09-12T01:08:10.868317+0000","last_became_active":"2024-09-12T00:21:52.558203+0000","last_became_peered":"2024-09-12T00:21:52.558203+0000","last_unstale":"2024-09-12T01:08:10.868317+0000","last_undegraded":"2024-09-12T01:08:10.868317+0000","last_fullsized":"2024-09-12T01:08:10.868317+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-12T01:08:10.868084+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-12T01:08:10.868084+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.868084+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:14.720878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1145,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":410,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'196","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.367538+0000","last_change":"2024-09-12T01:07:50.367538+0000","last_active":"2024-09-12T01:07:50.367538+0000","last_peered":"2024-09-12T01:07:50.367538+0000","last_clean":"2024-09-12T01:07:50.367538+0000","last_became_active":"2024-09-12T00:21:44.497510+0000","last_became_peered":"2024-09-12T00:21:44.497510+0000","last_unstale":"2024-09-12T01:07:50.367538+0000","last_undegraded":"2024-09-12T01:07:50.367538+0000","last_fullsized":"2024-09-12T01:07:50.367538+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T01:07:50.367359+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T01:07:50.367359+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.367359+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:59.657265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":719,"num_write":306,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'327","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.363959+0000","last_change":"2024-09-12T01:07:36.363959+0000","last_active":"2024-09-12T01:07:36.363959+0000","last_peered":"2024-09-12T01:07:36.363959+0000","last_clean":"2024-09-12T01:07:36.363959+0000","last_became_active":"2024-09-12T00:21:42.529084+0000","last_became_peered":"2024-09-12T00:21:42.529084+0000","last_unstale":"2024-09-12T01:07:36.363959+0000","last_undegraded":"2024-09-12T01:07:36.363959+0000","last_fullsized":"2024-09-12T01:07:36.363959+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:36.363681+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:36.363681+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.363681+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:32.434284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":3172,"num_write":1083,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.918656+0000","last_change":"2024-09-12T01:07:37.918656+0000","last_active":"2024-09-12T01:07:37.918656+0000","last_peered":"2024-09-12T01:07:37.918656+0000","last_clean":"2024-09-12T01:07:37.918656+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T01:07:37.918656+0000","last_undegraded":"2024-09-12T01:07:37.918656+0000","last_fullsized":"2024-09-12T01:07:37.918656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:37.918454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:37.918454+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.918454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:38.398571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.053317+0000","last_change":"2024-09-12T01:07:45.053317+0000","last_active":"2024-09-12T01:07:45.053317+0000","last_peered":"2024-09-12T01:07:45.053317+0000","last_clean":"2024-09-12T01:07:45.053317+0000","last_became_active":"2024-09-12T00:21:46.507150+0000","last_became_peered":"2024-09-12T00:21:46.507150+0000","last_unstale":"2024-09-12T01:07:45.053317+0000","last_undegraded":"2024-09-12T01:07:45.053317+0000","last_fullsized":"2024-09-12T01:07:45.053317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:45.053133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:45.053133+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.053133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:32.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'174","reported_seq":747,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.322185+0000","last_change":"2024-09-12T01:07:56.322185+0000","last_active":"2024-09-12T01:07:56.322185+0000","last_peered":"2024-09-12T01:07:56.322185+0000","last_clean":"2024-09-12T01:07:56.322185+0000","last_became_active":"2024-09-12T00:21:48.545244+0000","last_became_peered":"2024-09-12T00:21:48.545244+0000","last_unstale":"2024-09-12T01:07:56.322185+0000","last_undegraded":"2024-09-12T01:07:56.322185+0000","last_fullsized":"2024-09-12T01:07:56.322185+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-12T01:07:56.322006+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-12T01:07:56.322006+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.322006+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.237932+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'771","reported_seq":2810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.556909+0000","last_change":"2024-09-12T01:07:53.556779+0000","last_active":"2024-09-12T01:07:53.556909+0000","last_peered":"2024-09-12T01:07:53.556909+0000","last_clean":"2024-09-12T01:07:53.556909+0000","last_became_active":"2024-09-12T00:21:50.565930+0000","last_became_peered":"2024-09-12T00:21:50.565930+0000","last_unstale":"2024-09-12T01:07:53.556909+0000","last_undegraded":"2024-09-12T01:07:53.556909+0000","last_fullsized":"2024-09-12T01:07:53.556909+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-09-12T01:07:53.556571+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-09-12T01:07:53.556571+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.556571+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:43.011606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'141","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.428366+0000","last_change":"2024-09-12T01:08:00.428366+0000","last_active":"2024-09-12T01:08:00.428366+0000","last_peered":"2024-09-12T01:08:00.428366+0000","last_clean":"2024-09-12T01:08:00.428366+0000","last_became_active":"2024-09-12T00:21:52.562765+0000","last_became_peered":"2024-09-12T00:21:52.562765+0000","last_unstale":"2024-09-12T01:08:00.428366+0000","last_undegraded":"2024-09-12T01:08:00.428366+0000","last_fullsized":"2024-09-12T01:08:00.428366+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T01:08:00.428135+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T01:08:00.428135+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.428135+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:03.503379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":136,"num_write":336,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'107","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.465315+0000","last_change":"2024-09-12T01:07:43.465139+0000","last_active":"2024-09-12T01:07:43.465315+0000","last_peered":"2024-09-12T01:07:43.465315+0000","last_clean":"2024-09-12T01:07:43.465315+0000","last_became_active":"2024-09-12T00:21:44.492443+0000","last_became_peered":"2024-09-12T00:21:44.492443+0000","last_unstale":"2024-09-12T01:07:43.465315+0000","last_undegraded":"2024-09-12T01:07:43.465315+0000","last_fullsized":"2024-09-12T01:07:43.465315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-12T01:07:43.464916+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-12T01:07:43.464916+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.464916+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:25.554086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":379,"num_write":156,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'324","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.352910+0000","last_change":"2024-09-12T01:07:35.352910+0000","last_active":"2024-09-12T01:07:35.352910+0000","last_peered":"2024-09-12T01:07:35.352910+0000","last_clean":"2024-09-12T01:07:35.352910+0000","last_became_active":"2024-09-12T00:21:42.505355+0000","last_became_peered":"2024-09-12T00:21:42.505355+0000","last_unstale":"2024-09-12T01:07:35.352910+0000","last_undegraded":"2024-09-12T01:07:35.352910+0000","last_fullsized":"2024-09-12T01:07:35.352910+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-12T01:07:35.352717+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-12T01:07:35.352717+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.352717+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:26.053174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":8879,"num_write":1116,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.499649+0000","last_change":"2024-09-12T01:07:40.499649+0000","last_active":"2024-09-12T01:07:40.499649+0000","last_peered":"2024-09-12T01:07:40.499649+0000","last_clean":"2024-09-12T01:07:40.499649+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T01:07:40.499649+0000","last_undegraded":"2024-09-12T01:07:40.499649+0000","last_fullsized":"2024-09-12T01:07:40.499649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:40.499465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:40.499465+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.499465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:44.908987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.950731+0000","last_change":"2024-09-12T01:07:57.950731+0000","last_active":"2024-09-12T01:07:57.950731+0000","last_peered":"2024-09-12T01:07:57.950731+0000","last_clean":"2024-09-12T01:07:57.950731+0000","last_became_active":"2024-09-12T00:21:46.506416+0000","last_became_peered":"2024-09-12T00:21:46.506416+0000","last_unstale":"2024-09-12T01:07:57.950731+0000","last_undegraded":"2024-09-12T01:07:57.950731+0000","last_fullsized":"2024-09-12T01:07:57.950731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.950526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.950526+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.950526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:00.170740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'118","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.101180+0000","last_change":"2024-09-12T01:08:05.101180+0000","last_active":"2024-09-12T01:08:05.101180+0000","last_peered":"2024-09-12T01:08:05.101180+0000","last_clean":"2024-09-12T01:08:05.101180+0000","last_became_active":"2024-09-12T00:21:48.541051+0000","last_became_peered":"2024-09-12T00:21:48.541051+0000","last_unstale":"2024-09-12T01:08:05.101180+0000","last_undegraded":"2024-09-12T01:08:05.101180+0000","last_fullsized":"2024-09-12T01:08:05.101180+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:08:05.100985+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:08:05.100985+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.100985+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:34.203891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'782","reported_seq":2265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.971942+0000","last_change":"2024-09-12T01:08:01.971942+0000","last_active":"2024-09-12T01:08:01.971942+0000","last_peered":"2024-09-12T01:08:01.971942+0000","last_clean":"2024-09-12T01:08:01.971942+0000","last_became_active":"2024-09-12T00:21:50.564982+0000","last_became_peered":"2024-09-12T00:21:50.564982+0000","last_unstale":"2024-09-12T01:08:01.971942+0000","last_undegraded":"2024-09-12T01:08:01.971942+0000","last_fullsized":"2024-09-12T01:08:01.971942+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:08:01.971765+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:08:01.971765+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.971765+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:58.526551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'157","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.863907+0000","last_change":"2024-09-12T01:08:09.863907+0000","last_active":"2024-09-12T01:08:09.863907+0000","last_peered":"2024-09-12T01:08:09.863907+0000","last_clean":"2024-09-12T01:08:09.863907+0000","last_became_active":"2024-09-12T00:21:52.555909+0000","last_became_peered":"2024-09-12T00:21:52.555909+0000","last_unstale":"2024-09-12T01:08:09.863907+0000","last_undegraded":"2024-09-12T01:08:09.863907+0000","last_fullsized":"2024-09-12T01:08:09.863907+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T01:08:09.863717+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T01:08:09.863717+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.863717+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.515420+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":331,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'167","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.277506+0000","last_change":"2024-09-12T01:07:40.277506+0000","last_active":"2024-09-12T01:07:40.277506+0000","last_peered":"2024-09-12T01:07:40.277506+0000","last_clean":"2024-09-12T01:07:40.277506+0000","last_became_active":"2024-09-12T00:21:44.494215+0000","last_became_peered":"2024-09-12T00:21:44.494215+0000","last_unstale":"2024-09-12T01:07:40.277506+0000","last_undegraded":"2024-09-12T01:07:40.277506+0000","last_fullsized":"2024-09-12T01:07:40.277506+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T01:07:40.277272+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T01:07:40.277272+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.277272+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:51.529239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":568,"num_write":276,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'381","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.449381+0000","last_change":"2024-09-12T01:07:38.449381+0000","last_active":"2024-09-12T01:07:38.449381+0000","last_peered":"2024-09-12T01:07:38.449381+0000","last_clean":"2024-09-12T01:07:38.449381+0000","last_became_active":"2024-09-12T00:21:42.494486+0000","last_became_peered":"2024-09-12T00:21:42.494486+0000","last_unstale":"2024-09-12T01:07:38.449381+0000","last_undegraded":"2024-09-12T01:07:38.449381+0000","last_fullsized":"2024-09-12T01:07:38.449381+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-09-12T01:07:38.449164+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-09-12T01:07:38.449164+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.449164+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:59.455133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":23252,"num_write":1238,"num_write_kb":41943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.889902+0000","last_change":"2024-09-12T01:07:39.889902+0000","last_active":"2024-09-12T01:07:39.889902+0000","last_peered":"2024-09-12T01:07:39.889902+0000","last_clean":"2024-09-12T01:07:39.889902+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T01:07:39.889902+0000","last_undegraded":"2024-09-12T01:07:39.889902+0000","last_fullsized":"2024-09-12T01:07:39.889902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:39.889727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:39.889727+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.889727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:24.646676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.349435+0000","last_change":"2024-09-12T01:07:50.349312+0000","last_active":"2024-09-12T01:07:50.349435+0000","last_peered":"2024-09-12T01:07:50.349435+0000","last_clean":"2024-09-12T01:07:50.349435+0000","last_became_active":"2024-09-12T00:21:46.490398+0000","last_became_peered":"2024-09-12T00:21:46.490398+0000","last_unstale":"2024-09-12T01:07:50.349435+0000","last_undegraded":"2024-09-12T01:07:50.349435+0000","last_fullsized":"2024-09-12T01:07:50.349435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:50.349131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:50.349131+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.349131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:36.059419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'722","reported_seq":1458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.063819+0000","last_change":"2024-09-12T01:07:51.063819+0000","last_active":"2024-09-12T01:07:51.063819+0000","last_peered":"2024-09-12T01:07:51.063819+0000","last_clean":"2024-09-12T01:07:51.063819+0000","last_became_active":"2024-09-12T00:21:48.543101+0000","last_became_peered":"2024-09-12T00:21:48.543101+0000","last_unstale":"2024-09-12T01:07:51.063819+0000","last_undegraded":"2024-09-12T01:07:51.063819+0000","last_fullsized":"2024-09-12T01:07:51.063819+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'722","last_scrub_stamp":"2024-09-12T01:07:51.063535+0000","last_deep_scrub":"267'722","last_deep_scrub_stamp":"2024-09-12T01:07:51.063535+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.063535+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:28.632717+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1291,"num_read_kb":3081,"num_write":1048,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.352431+0000","last_change":"2024-09-12T01:08:04.352431+0000","last_active":"2024-09-12T01:08:04.352431+0000","last_peered":"2024-09-12T01:08:04.352431+0000","last_clean":"2024-09-12T01:08:04.352431+0000","last_became_active":"2024-09-12T00:21:50.549692+0000","last_became_peered":"2024-09-12T00:21:50.549692+0000","last_unstale":"2024-09-12T01:08:04.352431+0000","last_undegraded":"2024-09-12T01:08:04.352431+0000","last_fullsized":"2024-09-12T01:08:04.352431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:04.352249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:04.352249+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.352249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:46.516170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'109","reported_seq":611,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.222826+0000","last_change":"2024-09-12T01:07:58.222826+0000","last_active":"2024-09-12T01:07:58.222826+0000","last_peered":"2024-09-12T01:07:58.222826+0000","last_clean":"2024-09-12T01:07:58.222826+0000","last_became_active":"2024-09-12T00:21:52.556038+0000","last_became_peered":"2024-09-12T00:21:52.556038+0000","last_unstale":"2024-09-12T01:07:58.222826+0000","last_undegraded":"2024-09-12T01:07:58.222826+0000","last_fullsized":"2024-09-12T01:07:58.222826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'109","last_scrub_stamp":"2024-09-12T01:07:58.222645+0000","last_deep_scrub":"267'109","last_deep_scrub_stamp":"2024-09-12T01:07:58.222645+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.222645+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:57.127050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":258,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'118","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.494571+0000","last_change":"2024-09-12T01:08:10.494571+0000","last_active":"2024-09-12T01:08:10.494571+0000","last_peered":"2024-09-12T01:08:10.494571+0000","last_clean":"2024-09-12T01:08:10.494571+0000","last_became_active":"2024-09-12T00:21:52.537464+0000","last_became_peered":"2024-09-12T00:21:52.537464+0000","last_unstale":"2024-09-12T01:08:10.494571+0000","last_undegraded":"2024-09-12T01:08:10.494571+0000","last_fullsized":"2024-09-12T01:08:10.494571+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:08:10.494381+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:08:10.494381+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.494381+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:39.188930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":226,"num_write":297,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'147","reported_seq":786,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.217437+0000","last_change":"2024-09-12T01:07:45.217289+0000","last_active":"2024-09-12T01:07:45.217437+0000","last_peered":"2024-09-12T01:07:45.217437+0000","last_clean":"2024-09-12T01:07:45.217437+0000","last_became_active":"2024-09-12T00:21:44.494375+0000","last_became_peered":"2024-09-12T00:21:44.494375+0000","last_unstale":"2024-09-12T01:07:45.217437+0000","last_undegraded":"2024-09-12T01:07:45.217437+0000","last_fullsized":"2024-09-12T01:07:45.217437+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-12T01:07:45.217105+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-12T01:07:45.217105+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.217105+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:38.718060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":613,"num_write":235,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'406","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.925561+0000","last_change":"2024-09-12T01:07:40.925561+0000","last_active":"2024-09-12T01:07:40.925561+0000","last_peered":"2024-09-12T01:07:40.925561+0000","last_clean":"2024-09-12T01:07:40.925561+0000","last_became_active":"2024-09-12T00:21:42.495160+0000","last_became_peered":"2024-09-12T00:21:42.495160+0000","last_unstale":"2024-09-12T01:07:40.925561+0000","last_undegraded":"2024-09-12T01:07:40.925561+0000","last_fullsized":"2024-09-12T01:07:40.925561+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'406","last_scrub_stamp":"2024-09-12T01:07:40.925325+0000","last_deep_scrub":"267'406","last_deep_scrub_stamp":"2024-09-12T01:07:40.925325+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.925325+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:38.062084+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":36670,"num_write":1291,"num_write_kb":30706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.354758+0000","last_change":"2024-09-12T01:07:53.354604+0000","last_active":"2024-09-12T01:07:53.354758+0000","last_peered":"2024-09-12T01:07:53.354758+0000","last_clean":"2024-09-12T01:07:53.354758+0000","last_became_active":"2024-09-12T00:21:46.503594+0000","last_became_peered":"2024-09-12T00:21:46.503594+0000","last_unstale":"2024-09-12T01:07:53.354758+0000","last_undegraded":"2024-09-12T01:07:53.354758+0000","last_fullsized":"2024-09-12T01:07:53.354758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.354423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.354423+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.354423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:33.541746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'278","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.318137+0000","last_change":"2024-09-12T01:07:57.317999+0000","last_active":"2024-09-12T01:07:57.318137+0000","last_peered":"2024-09-12T01:07:57.318137+0000","last_clean":"2024-09-12T01:07:57.318137+0000","last_became_active":"2024-09-12T00:21:48.546213+0000","last_became_peered":"2024-09-12T00:21:48.546213+0000","last_unstale":"2024-09-12T01:07:57.318137+0000","last_undegraded":"2024-09-12T01:07:57.318137+0000","last_fullsized":"2024-09-12T01:07:57.318137+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'278","last_scrub_stamp":"2024-09-12T01:07:57.317804+0000","last_deep_scrub":"267'278","last_deep_scrub_stamp":"2024-09-12T01:07:57.317804+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.317804+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.448976+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44075,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":436,"num_read_kb":989,"num_write":348,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.258645+0000","last_change":"2024-09-12T01:07:53.258390+0000","last_active":"2024-09-12T01:07:53.258645+0000","last_peered":"2024-09-12T01:07:53.258645+0000","last_clean":"2024-09-12T01:07:53.258645+0000","last_became_active":"2024-09-12T00:21:50.549135+0000","last_became_peered":"2024-09-12T00:21:50.549135+0000","last_unstale":"2024-09-12T01:07:53.258645+0000","last_undegraded":"2024-09-12T01:07:53.258645+0000","last_fullsized":"2024-09-12T01:07:53.258645+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.258184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.258184+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.258184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:36.236772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'127","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.387689+0000","last_change":"2024-09-12T01:07:59.387544+0000","last_active":"2024-09-12T01:07:59.387689+0000","last_peered":"2024-09-12T01:07:59.387689+0000","last_clean":"2024-09-12T01:07:59.387689+0000","last_became_active":"2024-09-12T00:21:52.563303+0000","last_became_peered":"2024-09-12T00:21:52.563303+0000","last_unstale":"2024-09-12T01:07:59.387689+0000","last_undegraded":"2024-09-12T01:07:59.387689+0000","last_fullsized":"2024-09-12T01:07:59.387689+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'127","last_scrub_stamp":"2024-09-12T01:07:59.387345+0000","last_deep_scrub":"267'127","last_deep_scrub_stamp":"2024-09-12T01:07:59.387345+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.387345+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:10.153540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":144,"num_write":323,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'152","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.418724+0000","last_change":"2024-09-12T01:07:44.418480+0000","last_active":"2024-09-12T01:07:44.418724+0000","last_peered":"2024-09-12T01:07:44.418724+0000","last_clean":"2024-09-12T01:07:44.418724+0000","last_became_active":"2024-09-12T00:21:44.495299+0000","last_became_peered":"2024-09-12T00:21:44.495299+0000","last_unstale":"2024-09-12T01:07:44.418724+0000","last_undegraded":"2024-09-12T01:07:44.418724+0000","last_fullsized":"2024-09-12T01:07:44.418724+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:07:44.418260+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:07:44.418260+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.418260+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:51.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":653,"num_read_kb":535,"num_write":221,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'287","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.010747+0000","last_change":"2024-09-12T01:07:35.010674+0000","last_active":"2024-09-12T01:07:35.010747+0000","last_peered":"2024-09-12T01:07:35.010747+0000","last_clean":"2024-09-12T01:07:35.010747+0000","last_became_active":"2024-09-12T00:21:42.510774+0000","last_became_peered":"2024-09-12T00:21:42.510774+0000","last_unstale":"2024-09-12T01:07:35.010747+0000","last_undegraded":"2024-09-12T01:07:35.010747+0000","last_fullsized":"2024-09-12T01:07:35.010747+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'287","last_scrub_stamp":"2024-09-12T01:07:35.010519+0000","last_deep_scrub":"267'287","last_deep_scrub_stamp":"2024-09-12T01:07:35.010519+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.010519+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:26.256328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254443,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":10210,"num_write":929,"num_write_kb":22659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.338946+0000","last_change":"2024-09-12T01:07:53.338763+0000","last_active":"2024-09-12T01:07:53.338946+0000","last_peered":"2024-09-12T01:07:53.338946+0000","last_clean":"2024-09-12T01:07:53.338946+0000","last_became_active":"2024-09-12T00:21:46.498536+0000","last_became_peered":"2024-09-12T00:21:46.498536+0000","last_unstale":"2024-09-12T01:07:53.338946+0000","last_undegraded":"2024-09-12T01:07:53.338946+0000","last_fullsized":"2024-09-12T01:07:53.338946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.338543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.338543+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.338543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:08.882729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'45","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.345803+0000","last_change":"2024-09-12T01:07:59.345664+0000","last_active":"2024-09-12T01:07:59.345803+0000","last_peered":"2024-09-12T01:07:59.345803+0000","last_clean":"2024-09-12T01:07:59.345803+0000","last_became_active":"2024-09-12T00:21:48.528299+0000","last_became_peered":"2024-09-12T00:21:48.528299+0000","last_unstale":"2024-09-12T01:07:59.345803+0000","last_undegraded":"2024-09-12T01:07:59.345803+0000","last_fullsized":"2024-09-12T01:07:59.345803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'45","last_scrub_stamp":"2024-09-12T01:07:59.345465+0000","last_deep_scrub":"267'45","last_deep_scrub_stamp":"2024-09-12T01:07:59.345465+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.345465+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:44.745636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.204073+0000","last_change":"2024-09-12T01:07:57.203956+0000","last_active":"2024-09-12T01:07:57.204073+0000","last_peered":"2024-09-12T01:07:57.204073+0000","last_clean":"2024-09-12T01:07:57.204073+0000","last_became_active":"2024-09-12T00:21:50.553714+0000","last_became_peered":"2024-09-12T00:21:50.553714+0000","last_unstale":"2024-09-12T01:07:57.204073+0000","last_undegraded":"2024-09-12T01:07:57.204073+0000","last_fullsized":"2024-09-12T01:07:57.204073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.203776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.203776+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.203776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:33.243320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'216","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.322496+0000","last_change":"2024-09-12T01:08:07.322496+0000","last_active":"2024-09-12T01:08:07.322496+0000","last_peered":"2024-09-12T01:08:07.322496+0000","last_clean":"2024-09-12T01:08:07.322496+0000","last_became_active":"2024-09-12T00:21:52.556407+0000","last_became_peered":"2024-09-12T00:21:52.556407+0000","last_unstale":"2024-09-12T01:08:07.322496+0000","last_undegraded":"2024-09-12T01:08:07.322496+0000","last_fullsized":"2024-09-12T01:08:07.322496+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'216","last_scrub_stamp":"2024-09-12T01:08:07.322297+0000","last_deep_scrub":"267'216","last_deep_scrub_stamp":"2024-09-12T01:08:07.322297+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.322297+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:05.369131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":286,"num_write":472,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'340","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.437660+0000","last_change":"2024-09-12T01:07:42.437472+0000","last_active":"2024-09-12T01:07:42.437660+0000","last_peered":"2024-09-12T01:07:42.437660+0000","last_clean":"2024-09-12T01:07:42.437660+0000","last_became_active":"2024-09-12T00:21:44.499891+0000","last_became_peered":"2024-09-12T00:21:44.499891+0000","last_unstale":"2024-09-12T01:07:42.437660+0000","last_undegraded":"2024-09-12T01:07:42.437660+0000","last_fullsized":"2024-09-12T01:07:42.437660+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T01:07:42.437296+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T01:07:42.437296+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.437296+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:04.391073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1519,"num_read_kb":1239,"num_write":521,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'307","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.260295+0000","last_change":"2024-09-12T01:07:36.260148+0000","last_active":"2024-09-12T01:07:36.260295+0000","last_peered":"2024-09-12T01:07:36.260295+0000","last_clean":"2024-09-12T01:07:36.260295+0000","last_became_active":"2024-09-12T00:21:42.534537+0000","last_became_peered":"2024-09-12T00:21:42.534537+0000","last_unstale":"2024-09-12T01:07:36.260295+0000","last_undegraded":"2024-09-12T01:07:36.260295+0000","last_fullsized":"2024-09-12T01:07:36.260295+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T01:07:36.259915+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T01:07:36.259915+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.259915+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:37.365491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194356,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":22569,"num_write":963,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.230465+0000","last_change":"2024-09-12T01:07:49.230337+0000","last_active":"2024-09-12T01:07:49.230465+0000","last_peered":"2024-09-12T01:07:49.230465+0000","last_clean":"2024-09-12T01:07:49.230465+0000","last_became_active":"2024-09-12T00:21:46.489054+0000","last_became_peered":"2024-09-12T00:21:46.489054+0000","last_unstale":"2024-09-12T01:07:49.230465+0000","last_undegraded":"2024-09-12T01:07:49.230465+0000","last_fullsized":"2024-09-12T01:07:49.230465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:49.230156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:49.230156+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.230156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.131892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'295","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.314287+0000","last_change":"2024-09-12T01:07:54.314143+0000","last_active":"2024-09-12T01:07:54.314287+0000","last_peered":"2024-09-12T01:07:54.314287+0000","last_clean":"2024-09-12T01:07:54.314287+0000","last_became_active":"2024-09-12T00:21:48.549368+0000","last_became_peered":"2024-09-12T00:21:48.549368+0000","last_unstale":"2024-09-12T01:07:54.314287+0000","last_undegraded":"2024-09-12T01:07:54.314287+0000","last_fullsized":"2024-09-12T01:07:54.314287+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-09-12T01:07:54.313950+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-09-12T01:07:54.313950+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.313950+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.040359+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56273,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1054,"num_write":388,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.602765+0000","last_change":"2024-09-12T01:07:57.602572+0000","last_active":"2024-09-12T01:07:57.602765+0000","last_peered":"2024-09-12T01:07:57.602765+0000","last_clean":"2024-09-12T01:07:57.602765+0000","last_became_active":"2024-09-12T00:21:50.565753+0000","last_became_peered":"2024-09-12T00:21:50.565753+0000","last_unstale":"2024-09-12T01:07:57.602765+0000","last_undegraded":"2024-09-12T01:07:57.602765+0000","last_fullsized":"2024-09-12T01:07:57.602765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.602386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.602386+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.602386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:35.138425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'138","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.239170+0000","last_change":"2024-09-12T01:08:18.239170+0000","last_active":"2024-09-12T01:08:18.239170+0000","last_peered":"2024-09-12T01:08:18.239170+0000","last_clean":"2024-09-12T01:08:18.239170+0000","last_became_active":"2024-09-12T00:21:52.559213+0000","last_became_peered":"2024-09-12T00:21:52.559213+0000","last_unstale":"2024-09-12T01:08:18.239170+0000","last_undegraded":"2024-09-12T01:08:18.239170+0000","last_fullsized":"2024-09-12T01:08:18.239170+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T01:08:18.238983+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T01:08:18.238983+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.238983+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:02.299524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":329,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'146","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.111586+0000","last_change":"2024-09-12T01:07:38.111403+0000","last_active":"2024-09-12T01:07:38.111586+0000","last_peered":"2024-09-12T01:07:38.111586+0000","last_clean":"2024-09-12T01:07:38.111586+0000","last_became_active":"2024-09-12T00:21:44.507460+0000","last_became_peered":"2024-09-12T00:21:44.507460+0000","last_unstale":"2024-09-12T01:07:38.111586+0000","last_undegraded":"2024-09-12T01:07:38.111586+0000","last_fullsized":"2024-09-12T01:07:38.111586+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-12T01:07:38.111226+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-12T01:07:38.111226+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.111226+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:36.723181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":507,"num_write":216,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'342","reported_seq":977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.072519+0000","last_change":"2024-09-12T01:07:37.072371+0000","last_active":"2024-09-12T01:07:37.072519+0000","last_peered":"2024-09-12T01:07:37.072519+0000","last_clean":"2024-09-12T01:07:37.072519+0000","last_became_active":"2024-09-12T00:21:42.517333+0000","last_became_peered":"2024-09-12T00:21:42.517333+0000","last_unstale":"2024-09-12T01:07:37.072519+0000","last_undegraded":"2024-09-12T01:07:37.072519+0000","last_fullsized":"2024-09-12T01:07:37.072519+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-09-12T01:07:37.072146+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-09-12T01:07:37.072146+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.072146+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.002439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":50264,"num_write":1046,"num_write_kb":41560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.002878+0000","last_change":"2024-09-12T01:08:02.002747+0000","last_active":"2024-09-12T01:08:02.002878+0000","last_peered":"2024-09-12T01:08:02.002878+0000","last_clean":"2024-09-12T01:08:02.002878+0000","last_became_active":"2024-09-12T00:21:46.501673+0000","last_became_peered":"2024-09-12T00:21:46.501673+0000","last_unstale":"2024-09-12T01:08:02.002878+0000","last_undegraded":"2024-09-12T01:08:02.002878+0000","last_fullsized":"2024-09-12T01:08:02.002878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.002548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.002548+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.002548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:33.590646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'276","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.087083+0000","last_change":"2024-09-12T01:07:46.086938+0000","last_active":"2024-09-12T01:07:46.087083+0000","last_peered":"2024-09-12T01:07:46.087083+0000","last_clean":"2024-09-12T01:07:46.087083+0000","last_became_active":"2024-09-12T00:21:48.537864+0000","last_became_peered":"2024-09-12T00:21:48.537864+0000","last_unstale":"2024-09-12T01:07:46.087083+0000","last_undegraded":"2024-09-12T01:07:46.087083+0000","last_fullsized":"2024-09-12T01:07:46.087083+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'276","last_scrub_stamp":"2024-09-12T01:07:46.086739+0000","last_deep_scrub":"267'276","last_deep_scrub_stamp":"2024-09-12T01:07:46.086739+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.086739+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:32.656541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47500,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1067,"num_write":372,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.377547+0000","last_change":"2024-09-12T01:07:56.377401+0000","last_active":"2024-09-12T01:07:56.377547+0000","last_peered":"2024-09-12T01:07:56.377547+0000","last_clean":"2024-09-12T01:07:56.377547+0000","last_became_active":"2024-09-12T00:21:50.560805+0000","last_became_peered":"2024-09-12T00:21:50.560805+0000","last_unstale":"2024-09-12T01:07:56.377547+0000","last_undegraded":"2024-09-12T01:07:56.377547+0000","last_fullsized":"2024-09-12T01:07:56.377547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:56.377217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:56.377217+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.377217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.557232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'385","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.945989+0000","last_change":"2024-09-12T01:07:47.945989+0000","last_active":"2024-09-12T01:07:47.945989+0000","last_peered":"2024-09-12T01:07:47.945989+0000","last_clean":"2024-09-12T01:07:47.945989+0000","last_became_active":"2024-09-12T00:21:44.516321+0000","last_became_peered":"2024-09-12T00:21:44.516321+0000","last_unstale":"2024-09-12T01:07:47.945989+0000","last_undegraded":"2024-09-12T01:07:47.945989+0000","last_fullsized":"2024-09-12T01:07:47.945989+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-12T01:07:47.945804+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-12T01:07:47.945804+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.945804+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:05.496224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1787,"num_read_kb":1547,"num_write":658,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'343","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.099435+0000","last_change":"2024-09-12T01:07:38.099297+0000","last_active":"2024-09-12T01:07:38.099435+0000","last_peered":"2024-09-12T01:07:38.099435+0000","last_clean":"2024-09-12T01:07:38.099435+0000","last_became_active":"2024-09-12T00:22:13.519954+0000","last_became_peered":"2024-09-12T00:22:13.519954+0000","last_unstale":"2024-09-12T01:07:38.099435+0000","last_undegraded":"2024-09-12T01:07:38.099435+0000","last_fullsized":"2024-09-12T01:07:38.099435+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T01:07:38.099074+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T01:07:38.099074+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.099074+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:06.565768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":32939,"num_write":1107,"num_write_kb":17030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.347661+0000","last_change":"2024-09-12T01:07:54.347535+0000","last_active":"2024-09-12T01:07:54.347661+0000","last_peered":"2024-09-12T01:07:54.347661+0000","last_clean":"2024-09-12T01:07:54.347661+0000","last_became_active":"2024-09-12T00:21:46.503646+0000","last_became_peered":"2024-09-12T00:21:46.503646+0000","last_unstale":"2024-09-12T01:07:54.347661+0000","last_undegraded":"2024-09-12T01:07:54.347661+0000","last_fullsized":"2024-09-12T01:07:54.347661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.347353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.347353+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.347353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:41.432753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'529","reported_seq":1168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.339301+0000","last_change":"2024-09-12T01:07:59.339301+0000","last_active":"2024-09-12T01:07:59.339301+0000","last_peered":"2024-09-12T01:07:59.339301+0000","last_clean":"2024-09-12T01:07:59.339301+0000","last_became_active":"2024-09-12T00:21:48.547827+0000","last_became_peered":"2024-09-12T00:21:48.547827+0000","last_unstale":"2024-09-12T01:07:59.339301+0000","last_undegraded":"2024-09-12T01:07:59.339301+0000","last_fullsized":"2024-09-12T01:07:59.339301+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'529","last_scrub_stamp":"2024-09-12T01:07:59.339057+0000","last_deep_scrub":"267'529","last_deep_scrub_stamp":"2024-09-12T01:07:59.339057+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.339057+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.011858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106077,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":956,"num_read_kb":2347,"num_write":834,"num_write_kb":757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.185016+0000","last_change":"2024-09-12T01:07:55.185016+0000","last_active":"2024-09-12T01:07:55.185016+0000","last_peered":"2024-09-12T01:07:55.185016+0000","last_clean":"2024-09-12T01:07:55.185016+0000","last_became_active":"2024-09-12T00:21:50.554194+0000","last_became_peered":"2024-09-12T00:21:50.554194+0000","last_unstale":"2024-09-12T01:07:55.185016+0000","last_undegraded":"2024-09-12T01:07:55.185016+0000","last_fullsized":"2024-09-12T01:07:55.185016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.184730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.184730+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.184730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:12.121843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'160","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.874685+0000","last_change":"2024-09-12T01:08:11.874534+0000","last_active":"2024-09-12T01:08:11.874685+0000","last_peered":"2024-09-12T01:08:11.874685+0000","last_clean":"2024-09-12T01:08:11.874685+0000","last_became_active":"2024-09-12T00:21:52.558070+0000","last_became_peered":"2024-09-12T00:21:52.558070+0000","last_unstale":"2024-09-12T01:08:11.874685+0000","last_undegraded":"2024-09-12T01:08:11.874685+0000","last_fullsized":"2024-09-12T01:08:11.874685+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-12T01:08:11.874343+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-12T01:08:11.874343+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.874343+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:24.477496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":234,"num_write":361,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'83","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.370404+0000","last_change":"2024-09-12T01:07:46.370250+0000","last_active":"2024-09-12T01:07:46.370404+0000","last_peered":"2024-09-12T01:07:46.370404+0000","last_clean":"2024-09-12T01:07:46.370404+0000","last_became_active":"2024-09-12T00:21:44.501836+0000","last_became_peered":"2024-09-12T00:21:44.501836+0000","last_unstale":"2024-09-12T01:07:46.370404+0000","last_undegraded":"2024-09-12T01:07:46.370404+0000","last_fullsized":"2024-09-12T01:07:46.370404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'83","last_scrub_stamp":"2024-09-12T01:07:46.370079+0000","last_deep_scrub":"267'83","last_deep_scrub_stamp":"2024-09-12T01:07:46.370079+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.370079+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:28.842724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":399,"num_read_kb":345,"num_write":130,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'311","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.400773+0000","last_change":"2024-09-12T01:07:37.400631+0000","last_active":"2024-09-12T01:07:37.400773+0000","last_peered":"2024-09-12T01:07:37.400773+0000","last_clean":"2024-09-12T01:07:37.400773+0000","last_became_active":"2024-09-12T00:21:42.496837+0000","last_became_peered":"2024-09-12T00:21:42.496837+0000","last_unstale":"2024-09-12T01:07:37.400773+0000","last_undegraded":"2024-09-12T01:07:37.400773+0000","last_fullsized":"2024-09-12T01:07:37.400773+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:07:37.400384+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:07:37.400384+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.400384+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:35.621576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":560106,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":359,"num_read_kb":1485,"num_write":897,"num_write_kb":29678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.182093+0000","last_change":"2024-09-12T01:07:50.182093+0000","last_active":"2024-09-12T01:07:50.182093+0000","last_peered":"2024-09-12T01:07:50.182093+0000","last_clean":"2024-09-12T01:07:50.182093+0000","last_became_active":"2024-09-12T00:21:46.498517+0000","last_became_peered":"2024-09-12T00:21:46.498517+0000","last_unstale":"2024-09-12T01:07:50.182093+0000","last_undegraded":"2024-09-12T01:07:50.182093+0000","last_fullsized":"2024-09-12T01:07:50.182093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:50.181910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:50.181910+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.181910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:16.300016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'308","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.191292+0000","last_change":"2024-09-12T01:08:08.191292+0000","last_active":"2024-09-12T01:08:08.191292+0000","last_peered":"2024-09-12T01:08:08.191292+0000","last_clean":"2024-09-12T01:08:08.191292+0000","last_became_active":"2024-09-12T00:21:48.539419+0000","last_became_peered":"2024-09-12T00:21:48.539419+0000","last_unstale":"2024-09-12T01:08:08.191292+0000","last_undegraded":"2024-09-12T01:08:08.191292+0000","last_fullsized":"2024-09-12T01:08:08.191292+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-12T01:08:08.191085+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-12T01:08:08.191085+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.191085+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:36.401332+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":1160,"num_write":428,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.912149+0000","last_change":"2024-09-12T01:08:06.912149+0000","last_active":"2024-09-12T01:08:06.912149+0000","last_peered":"2024-09-12T01:08:06.912149+0000","last_clean":"2024-09-12T01:08:06.912149+0000","last_became_active":"2024-09-12T00:21:50.564610+0000","last_became_peered":"2024-09-12T00:21:50.564610+0000","last_unstale":"2024-09-12T01:08:06.912149+0000","last_undegraded":"2024-09-12T01:08:06.912149+0000","last_fullsized":"2024-09-12T01:08:06.912149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.911970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.911970+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.911970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:12.050463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'158","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.273380+0000","last_change":"2024-09-12T01:08:19.273231+0000","last_active":"2024-09-12T01:08:19.273380+0000","last_peered":"2024-09-12T01:08:19.273380+0000","last_clean":"2024-09-12T01:08:19.273380+0000","last_became_active":"2024-09-12T00:21:52.559989+0000","last_became_peered":"2024-09-12T00:21:52.559989+0000","last_unstale":"2024-09-12T01:08:19.273380+0000","last_undegraded":"2024-09-12T01:08:19.273380+0000","last_fullsized":"2024-09-12T01:08:19.273380+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:08:19.273022+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:08:19.273022+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.273022+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:10.769252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":167,"num_write":448,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'181","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.087272+0000","last_change":"2024-09-12T01:07:42.087272+0000","last_active":"2024-09-12T01:07:42.087272+0000","last_peered":"2024-09-12T01:07:42.087272+0000","last_clean":"2024-09-12T01:07:42.087272+0000","last_became_active":"2024-09-12T00:21:44.515059+0000","last_became_peered":"2024-09-12T00:21:44.515059+0000","last_unstale":"2024-09-12T01:07:42.087272+0000","last_undegraded":"2024-09-12T01:07:42.087272+0000","last_fullsized":"2024-09-12T01:07:42.087272+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T01:07:42.087093+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T01:07:42.087093+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.087093+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:57.089560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":674,"num_write":306,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'322","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.658246+0000","last_change":"2024-09-12T01:07:35.658246+0000","last_active":"2024-09-12T01:07:35.658246+0000","last_peered":"2024-09-12T01:07:35.658246+0000","last_clean":"2024-09-12T01:07:35.658246+0000","last_became_active":"2024-09-12T00:21:42.527838+0000","last_became_peered":"2024-09-12T00:21:42.527838+0000","last_unstale":"2024-09-12T01:07:35.658246+0000","last_undegraded":"2024-09-12T01:07:35.658246+0000","last_fullsized":"2024-09-12T01:07:35.658246+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'322","last_scrub_stamp":"2024-09-12T01:07:35.657997+0000","last_deep_scrub":"267'322","last_deep_scrub_stamp":"2024-09-12T01:07:35.657997+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.657997+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.365955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373192,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":57949,"num_write":1020,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.190368+0000","last_change":"2024-09-12T01:07:48.190368+0000","last_active":"2024-09-12T01:07:48.190368+0000","last_peered":"2024-09-12T01:07:48.190368+0000","last_clean":"2024-09-12T01:07:48.190368+0000","last_became_active":"2024-09-12T00:21:46.486768+0000","last_became_peered":"2024-09-12T00:21:46.486768+0000","last_unstale":"2024-09-12T01:07:48.190368+0000","last_undegraded":"2024-09-12T01:07:48.190368+0000","last_fullsized":"2024-09-12T01:07:48.190368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.190178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.190178+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.190178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.612879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'297","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.307932+0000","last_change":"2024-09-12T01:08:00.307932+0000","last_active":"2024-09-12T01:08:00.307932+0000","last_peered":"2024-09-12T01:08:00.307932+0000","last_clean":"2024-09-12T01:08:00.307932+0000","last_became_active":"2024-09-12T00:21:48.545589+0000","last_became_peered":"2024-09-12T00:21:48.545589+0000","last_unstale":"2024-09-12T01:08:00.307932+0000","last_undegraded":"2024-09-12T01:08:00.307932+0000","last_fullsized":"2024-09-12T01:08:00.307932+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'297","last_scrub_stamp":"2024-09-12T01:08:00.307740+0000","last_deep_scrub":"267'297","last_deep_scrub_stamp":"2024-09-12T01:08:00.307740+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.307740+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:22.754366+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":1095,"num_write":398,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.342253+0000","last_change":"2024-09-12T01:07:55.342033+0000","last_active":"2024-09-12T01:07:55.342253+0000","last_peered":"2024-09-12T01:07:55.342253+0000","last_clean":"2024-09-12T01:07:55.342253+0000","last_became_active":"2024-09-12T00:21:50.556333+0000","last_became_peered":"2024-09-12T00:21:50.556333+0000","last_unstale":"2024-09-12T01:07:55.342253+0000","last_undegraded":"2024-09-12T01:07:55.342253+0000","last_fullsized":"2024-09-12T01:07:55.342253+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.341833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.341833+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.341833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:33.231708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'209","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.216828+0000","last_change":"2024-09-12T01:08:12.216663+0000","last_active":"2024-09-12T01:08:12.216828+0000","last_peered":"2024-09-12T01:08:12.216828+0000","last_clean":"2024-09-12T01:08:12.216828+0000","last_became_active":"2024-09-12T00:21:52.565109+0000","last_became_peered":"2024-09-12T00:21:52.565109+0000","last_unstale":"2024-09-12T01:08:12.216828+0000","last_undegraded":"2024-09-12T01:08:12.216828+0000","last_fullsized":"2024-09-12T01:08:12.216828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'209","last_scrub_stamp":"2024-09-12T01:08:12.216444+0000","last_deep_scrub":"267'209","last_deep_scrub_stamp":"2024-09-12T01:08:12.216444+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.216444+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:09.495538+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'131","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.419785+0000","last_change":"2024-09-12T01:07:45.419785+0000","last_active":"2024-09-12T01:07:45.419785+0000","last_peered":"2024-09-12T01:07:45.419785+0000","last_clean":"2024-09-12T01:07:45.419785+0000","last_became_active":"2024-09-12T00:21:44.488546+0000","last_became_peered":"2024-09-12T00:21:44.488546+0000","last_unstale":"2024-09-12T01:07:45.419785+0000","last_undegraded":"2024-09-12T01:07:45.419785+0000","last_fullsized":"2024-09-12T01:07:45.419785+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:07:45.419606+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:07:45.419606+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.419606+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:27.301674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":436,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'359","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.479909+0000","last_change":"2024-09-12T01:07:39.479909+0000","last_active":"2024-09-12T01:07:39.479909+0000","last_peered":"2024-09-12T01:07:39.479909+0000","last_clean":"2024-09-12T01:07:39.479909+0000","last_became_active":"2024-09-12T00:21:42.513837+0000","last_became_peered":"2024-09-12T00:21:42.513837+0000","last_unstale":"2024-09-12T01:07:39.479909+0000","last_undegraded":"2024-09-12T01:07:39.479909+0000","last_fullsized":"2024-09-12T01:07:39.479909+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'359","last_scrub_stamp":"2024-09-12T01:07:39.479604+0000","last_deep_scrub":"267'359","last_deep_scrub_stamp":"2024-09-12T01:07:39.479604+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.479604+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:45.652858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":19207,"num_write":1040,"num_write_kb":45165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.320491+0000","last_change":"2024-09-12T01:08:00.320491+0000","last_active":"2024-09-12T01:08:00.320491+0000","last_peered":"2024-09-12T01:08:00.320491+0000","last_clean":"2024-09-12T01:08:00.320491+0000","last_became_active":"2024-09-12T00:21:46.492502+0000","last_became_peered":"2024-09-12T00:21:46.492502+0000","last_unstale":"2024-09-12T01:08:00.320491+0000","last_undegraded":"2024-09-12T01:08:00.320491+0000","last_fullsized":"2024-09-12T01:08:00.320491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.320300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.320300+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.320300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:45.924340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'104","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.261328+0000","last_change":"2024-09-12T01:08:16.261328+0000","last_active":"2024-09-12T01:08:16.261328+0000","last_peered":"2024-09-12T01:08:16.261328+0000","last_clean":"2024-09-12T01:08:16.261328+0000","last_became_active":"2024-09-12T00:21:48.544915+0000","last_became_peered":"2024-09-12T00:21:48.544915+0000","last_unstale":"2024-09-12T01:08:16.261328+0000","last_undegraded":"2024-09-12T01:08:16.261328+0000","last_fullsized":"2024-09-12T01:08:16.261328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'104","last_scrub_stamp":"2024-09-12T01:08:16.261249+0000","last_deep_scrub":"267'104","last_deep_scrub_stamp":"2024-09-12T01:08:16.261249+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.261249+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:04.563746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":128,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'782","reported_seq":2233,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.970293+0000","last_change":"2024-09-12T01:07:54.970293+0000","last_active":"2024-09-12T01:07:54.970293+0000","last_peered":"2024-09-12T01:07:54.970293+0000","last_clean":"2024-09-12T01:07:54.970293+0000","last_became_active":"2024-09-12T00:21:50.549552+0000","last_became_peered":"2024-09-12T00:21:50.549552+0000","last_unstale":"2024-09-12T01:07:54.970293+0000","last_undegraded":"2024-09-12T01:07:54.970293+0000","last_fullsized":"2024-09-12T01:07:54.970293+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:07:54.970110+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:07:54.970110+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.970110+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:45.495935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'171","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.217142+0000","last_change":"2024-09-12T01:08:17.216965+0000","last_active":"2024-09-12T01:08:17.217142+0000","last_peered":"2024-09-12T01:08:17.217142+0000","last_clean":"2024-09-12T01:08:17.217142+0000","last_became_active":"2024-09-12T00:21:52.565872+0000","last_became_peered":"2024-09-12T00:21:52.565872+0000","last_unstale":"2024-09-12T01:08:17.217142+0000","last_undegraded":"2024-09-12T01:08:17.217142+0000","last_fullsized":"2024-09-12T01:08:17.217142+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-12T01:08:17.216781+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-12T01:08:17.216781+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.216781+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:34.553895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":199,"num_write":407,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'4285","reported_seq":4948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.202447+0000","last_change":"2024-09-12T01:07:47.202447+0000","last_active":"2024-09-12T01:07:47.202447+0000","last_peered":"2024-09-12T01:07:47.202447+0000","last_clean":"2024-09-12T01:07:47.202447+0000","last_became_active":"2024-09-12T00:21:44.521310+0000","last_became_peered":"2024-09-12T00:21:44.521310+0000","last_unstale":"2024-09-12T01:07:47.202447+0000","last_undegraded":"2024-09-12T01:07:47.202447+0000","last_fullsized":"2024-09-12T01:07:47.202447+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4285","last_scrub_stamp":"2024-09-12T01:07:47.202270+0000","last_deep_scrub":"267'4285","last_deep_scrub_stamp":"2024-09-12T01:07:47.202270+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.202270+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:42.173767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17290,"num_read_kb":14479,"num_write":6455,"num_write_kb":3215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'412","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.695539+0000","last_change":"2024-09-12T01:07:37.695539+0000","last_active":"2024-09-12T01:07:37.695539+0000","last_peered":"2024-09-12T01:07:37.695539+0000","last_clean":"2024-09-12T01:07:37.695539+0000","last_became_active":"2024-09-12T00:21:42.507712+0000","last_became_peered":"2024-09-12T00:21:42.507712+0000","last_unstale":"2024-09-12T01:07:37.695539+0000","last_undegraded":"2024-09-12T01:07:37.695539+0000","last_fullsized":"2024-09-12T01:07:37.695539+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-09-12T01:07:37.695311+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-09-12T01:07:37.695311+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.695311+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:19.588168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992333,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":35222,"num_write":1344,"num_write_kb":36033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.578853+0000","last_change":"2024-09-12T01:07:52.578853+0000","last_active":"2024-09-12T01:07:52.578853+0000","last_peered":"2024-09-12T01:07:52.578853+0000","last_clean":"2024-09-12T01:07:52.578853+0000","last_became_active":"2024-09-12T00:21:46.514146+0000","last_became_peered":"2024-09-12T00:21:46.514146+0000","last_unstale":"2024-09-12T01:07:52.578853+0000","last_undegraded":"2024-09-12T01:07:52.578853+0000","last_fullsized":"2024-09-12T01:07:52.578853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.578598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.578598+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.578598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:11.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'341","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.052832+0000","last_change":"2024-09-12T01:07:52.052641+0000","last_active":"2024-09-12T01:07:52.052832+0000","last_peered":"2024-09-12T01:07:52.052832+0000","last_clean":"2024-09-12T01:07:52.052832+0000","last_became_active":"2024-09-12T00:21:48.543993+0000","last_became_peered":"2024-09-12T00:21:48.543993+0000","last_unstale":"2024-09-12T01:07:52.052832+0000","last_undegraded":"2024-09-12T01:07:52.052832+0000","last_fullsized":"2024-09-12T01:07:52.052832+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:52.052427+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:52.052427+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.052427+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:19.461377+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50118,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1190,"num_write":440,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.460820+0000","last_change":"2024-09-12T01:08:07.460820+0000","last_active":"2024-09-12T01:08:07.460820+0000","last_peered":"2024-09-12T01:08:07.460820+0000","last_clean":"2024-09-12T01:08:07.460820+0000","last_became_active":"2024-09-12T00:21:50.525885+0000","last_became_peered":"2024-09-12T00:21:50.525885+0000","last_unstale":"2024-09-12T01:08:07.460820+0000","last_undegraded":"2024-09-12T01:08:07.460820+0000","last_fullsized":"2024-09-12T01:08:07.460820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:07.460643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:07.460643+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.460643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:57.948172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'117","reported_seq":627,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.548906+0000","last_change":"2024-09-12T01:08:01.548906+0000","last_active":"2024-09-12T01:08:01.548906+0000","last_peered":"2024-09-12T01:08:01.548906+0000","last_clean":"2024-09-12T01:08:01.548906+0000","last_became_active":"2024-09-12T00:21:52.559361+0000","last_became_peered":"2024-09-12T00:21:52.559361+0000","last_unstale":"2024-09-12T01:08:01.548906+0000","last_undegraded":"2024-09-12T01:08:01.548906+0000","last_fullsized":"2024-09-12T01:08:01.548906+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:08:01.548731+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:08:01.548731+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.548731+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:50.829398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":266,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'251","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.238428+0000","last_change":"2024-09-12T01:07:44.238428+0000","last_active":"2024-09-12T01:07:44.238428+0000","last_peered":"2024-09-12T01:07:44.238428+0000","last_clean":"2024-09-12T01:07:44.238428+0000","last_became_active":"2024-09-12T00:21:44.486014+0000","last_became_peered":"2024-09-12T00:21:44.486014+0000","last_unstale":"2024-09-12T01:07:44.238428+0000","last_undegraded":"2024-09-12T01:07:44.238428+0000","last_fullsized":"2024-09-12T01:07:44.238428+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-12T01:07:44.238257+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-12T01:07:44.238257+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.238257+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:57.856443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1098,"num_read_kb":899,"num_write":369,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'313","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.889993+0000","last_change":"2024-09-12T01:07:43.889993+0000","last_active":"2024-09-12T01:07:43.889993+0000","last_peered":"2024-09-12T01:07:43.889993+0000","last_clean":"2024-09-12T01:07:43.889993+0000","last_became_active":"2024-09-12T00:21:42.491757+0000","last_became_peered":"2024-09-12T00:21:42.491757+0000","last_unstale":"2024-09-12T01:07:43.889993+0000","last_undegraded":"2024-09-12T01:07:43.889993+0000","last_fullsized":"2024-09-12T01:07:43.889993+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'313","last_scrub_stamp":"2024-09-12T01:07:43.889701+0000","last_deep_scrub":"267'313","last_deep_scrub_stamp":"2024-09-12T01:07:43.889701+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.889701+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:25.943315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":76220,"num_write":1035,"num_write_kb":46746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.158201+0000","last_change":"2024-09-12T01:07:51.158201+0000","last_active":"2024-09-12T01:07:51.158201+0000","last_peered":"2024-09-12T01:07:51.158201+0000","last_clean":"2024-09-12T01:07:51.158201+0000","last_became_active":"2024-09-12T00:21:46.503203+0000","last_became_peered":"2024-09-12T00:21:46.503203+0000","last_unstale":"2024-09-12T01:07:51.158201+0000","last_undegraded":"2024-09-12T01:07:51.158201+0000","last_fullsized":"2024-09-12T01:07:51.158201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:51.158024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:51.158024+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.158024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:20.104900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'289","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.376521+0000","last_change":"2024-09-12T01:08:03.376521+0000","last_active":"2024-09-12T01:08:03.376521+0000","last_peered":"2024-09-12T01:08:03.376521+0000","last_clean":"2024-09-12T01:08:03.376521+0000","last_became_active":"2024-09-12T00:21:48.536841+0000","last_became_peered":"2024-09-12T00:21:48.536841+0000","last_unstale":"2024-09-12T01:08:03.376521+0000","last_undegraded":"2024-09-12T01:08:03.376521+0000","last_fullsized":"2024-09-12T01:08:03.376521+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'289","last_scrub_stamp":"2024-09-12T01:08:03.376310+0000","last_deep_scrub":"267'289","last_deep_scrub_stamp":"2024-09-12T01:08:03.376310+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.376310+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:32.833802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48050,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1127,"num_write":390,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.299075+0000","last_change":"2024-09-12T01:08:20.299075+0000","last_active":"2024-09-12T01:08:20.299075+0000","last_peered":"2024-09-12T01:08:20.299075+0000","last_clean":"2024-09-12T01:08:20.299075+0000","last_became_active":"2024-09-12T00:21:50.538041+0000","last_became_peered":"2024-09-12T00:21:50.538041+0000","last_unstale":"2024-09-12T01:08:20.299075+0000","last_undegraded":"2024-09-12T01:08:20.299075+0000","last_fullsized":"2024-09-12T01:08:20.299075+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:20.298872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:20.298872+0000","last_clean_scrub_stamp":"2024-09-12T01:08:20.298872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:38.240618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'126","reported_seq":647,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.817259+0000","last_change":"2024-09-12T01:08:13.817259+0000","last_active":"2024-09-12T01:08:13.817259+0000","last_peered":"2024-09-12T01:08:13.817259+0000","last_clean":"2024-09-12T01:08:13.817259+0000","last_became_active":"2024-09-12T00:21:52.560366+0000","last_became_peered":"2024-09-12T00:21:52.560366+0000","last_unstale":"2024-09-12T01:08:13.817259+0000","last_undegraded":"2024-09-12T01:08:13.817259+0000","last_fullsized":"2024-09-12T01:08:13.817259+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-09-12T01:08:13.817076+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-09-12T01:08:13.817076+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.817076+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:14.120841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":163,"num_read_kb":157,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'212","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.109280+0000","last_change":"2024-09-12T01:07:41.109151+0000","last_active":"2024-09-12T01:07:41.109280+0000","last_peered":"2024-09-12T01:07:41.109280+0000","last_clean":"2024-09-12T01:07:41.109280+0000","last_became_active":"2024-09-12T00:21:44.512917+0000","last_became_peered":"2024-09-12T00:21:44.512917+0000","last_unstale":"2024-09-12T01:07:41.109280+0000","last_undegraded":"2024-09-12T01:07:41.109280+0000","last_fullsized":"2024-09-12T01:07:41.109280+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-12T01:07:41.108966+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-12T01:07:41.108966+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.108966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:25.227949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":716,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'387","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.063601+0000","last_change":"2024-09-12T01:07:39.063458+0000","last_active":"2024-09-12T01:07:39.063601+0000","last_peered":"2024-09-12T01:07:39.063601+0000","last_clean":"2024-09-12T01:07:39.063601+0000","last_became_active":"2024-09-12T00:21:42.516419+0000","last_became_peered":"2024-09-12T00:21:42.516419+0000","last_unstale":"2024-09-12T01:07:39.063601+0000","last_undegraded":"2024-09-12T01:07:39.063601+0000","last_fullsized":"2024-09-12T01:07:39.063601+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-09-12T01:07:39.063230+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-09-12T01:07:39.063230+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.063230+0000","objects_scrubbed":10,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:19.966999+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1662646,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":630,"num_read_kb":12934,"num_write":1264,"num_write_kb":32784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.641054+0000","last_change":"2024-09-12T01:07:49.641054+0000","last_active":"2024-09-12T01:07:49.641054+0000","last_peered":"2024-09-12T01:07:49.641054+0000","last_clean":"2024-09-12T01:07:49.641054+0000","last_became_active":"2024-09-12T00:21:46.503747+0000","last_became_peered":"2024-09-12T00:21:46.503747+0000","last_unstale":"2024-09-12T01:07:49.641054+0000","last_undegraded":"2024-09-12T01:07:49.641054+0000","last_fullsized":"2024-09-12T01:07:49.641054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:49.640866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:49.640866+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.640866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:15.512638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'247","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.294797+0000","last_change":"2024-09-12T01:07:58.294797+0000","last_active":"2024-09-12T01:07:58.294797+0000","last_peered":"2024-09-12T01:07:58.294797+0000","last_clean":"2024-09-12T01:07:58.294797+0000","last_became_active":"2024-09-12T00:21:48.546392+0000","last_became_peered":"2024-09-12T00:21:48.546392+0000","last_unstale":"2024-09-12T01:07:58.294797+0000","last_undegraded":"2024-09-12T01:07:58.294797+0000","last_fullsized":"2024-09-12T01:07:58.294797+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-12T01:07:58.294616+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-12T01:07:58.294616+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.294616+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:51.609748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54260,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":387,"num_read_kb":921,"num_write":312,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.206312+0000","last_change":"2024-09-12T01:08:13.206312+0000","last_active":"2024-09-12T01:08:13.206312+0000","last_peered":"2024-09-12T01:08:13.206312+0000","last_clean":"2024-09-12T01:08:13.206312+0000","last_became_active":"2024-09-12T00:21:50.548527+0000","last_became_peered":"2024-09-12T00:21:50.548527+0000","last_unstale":"2024-09-12T01:08:13.206312+0000","last_undegraded":"2024-09-12T01:08:13.206312+0000","last_fullsized":"2024-09-12T01:08:13.206312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:13.206131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:13.206131+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.206131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:14.644789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'198","reported_seq":1715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.356021+0000","last_change":"2024-09-12T01:08:21.356021+0000","last_active":"2024-09-12T01:08:21.356021+0000","last_peered":"2024-09-12T01:08:21.356021+0000","last_clean":"2024-09-12T01:08:21.356021+0000","last_became_active":"2024-09-12T00:21:52.559360+0000","last_became_peered":"2024-09-12T00:21:52.559360+0000","last_unstale":"2024-09-12T01:08:21.356021+0000","last_undegraded":"2024-09-12T01:08:21.356021+0000","last_fullsized":"2024-09-12T01:08:21.356021+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:08:21.355801+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:08:21.355801+0000","last_clean_scrub_stamp":"2024-09-12T01:08:21.355801+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:28.037088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1316,"num_write":423,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'81","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.269673+0000","last_change":"2024-09-12T01:07:43.269673+0000","last_active":"2024-09-12T01:07:43.269673+0000","last_peered":"2024-09-12T01:07:43.269673+0000","last_clean":"2024-09-12T01:07:43.269673+0000","last_became_active":"2024-09-12T00:21:44.485278+0000","last_became_peered":"2024-09-12T00:21:44.485278+0000","last_unstale":"2024-09-12T01:07:43.269673+0000","last_undegraded":"2024-09-12T01:07:43.269673+0000","last_fullsized":"2024-09-12T01:07:43.269673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-12T01:07:43.269425+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-12T01:07:43.269425+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.269425+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:25.610398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":295,"num_write":139,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'331","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.020797+0000","last_change":"2024-09-12T01:07:40.020797+0000","last_active":"2024-09-12T01:07:40.020797+0000","last_peered":"2024-09-12T01:07:40.020797+0000","last_clean":"2024-09-12T01:07:40.020797+0000","last_became_active":"2024-09-12T00:21:42.520276+0000","last_became_peered":"2024-09-12T00:21:42.520276+0000","last_unstale":"2024-09-12T01:07:40.020797+0000","last_undegraded":"2024-09-12T01:07:40.020797+0000","last_fullsized":"2024-09-12T01:07:40.020797+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-09-12T01:07:40.020532+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-09-12T01:07:40.020532+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.020532+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.026913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35265,"num_write":1034,"num_write_kb":28370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"267'6","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.391938+0000","last_change":"2024-09-12T01:07:56.391938+0000","last_active":"2024-09-12T01:07:56.391938+0000","last_peered":"2024-09-12T01:07:56.391938+0000","last_clean":"2024-09-12T01:07:56.391938+0000","last_became_active":"2024-09-12T00:21:46.495088+0000","last_became_peered":"2024-09-12T00:21:46.495088+0000","last_unstale":"2024-09-12T01:07:56.391938+0000","last_undegraded":"2024-09-12T01:07:56.391938+0000","last_fullsized":"2024-09-12T01:07:56.391938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:07:56.391742+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:07:56.391742+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.391742+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:37.803256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'333","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.207573+0000","last_change":"2024-09-12T01:08:09.207573+0000","last_active":"2024-09-12T01:08:09.207573+0000","last_peered":"2024-09-12T01:08:09.207573+0000","last_clean":"2024-09-12T01:08:09.207573+0000","last_became_active":"2024-09-12T00:21:48.550441+0000","last_became_peered":"2024-09-12T00:21:48.550441+0000","last_unstale":"2024-09-12T01:08:09.207573+0000","last_undegraded":"2024-09-12T01:08:09.207573+0000","last_fullsized":"2024-09-12T01:08:09.207573+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T01:08:09.207370+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T01:08:09.207370+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.207370+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:06.548406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54992,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1211,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.503170+0000","last_change":"2024-09-12T01:08:08.503170+0000","last_active":"2024-09-12T01:08:08.503170+0000","last_peered":"2024-09-12T01:08:08.503170+0000","last_clean":"2024-09-12T01:08:08.503170+0000","last_became_active":"2024-09-12T00:21:50.565955+0000","last_became_peered":"2024-09-12T00:21:50.565955+0000","last_unstale":"2024-09-12T01:08:08.503170+0000","last_undegraded":"2024-09-12T01:08:08.503170+0000","last_fullsized":"2024-09-12T01:08:08.503170+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:08.502979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:08.502979+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.502979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:12.378006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'135","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.028869+0000","last_change":"2024-09-12T01:07:57.028869+0000","last_active":"2024-09-12T01:07:57.028869+0000","last_peered":"2024-09-12T01:07:57.028869+0000","last_clean":"2024-09-12T01:07:57.028869+0000","last_became_active":"2024-09-12T00:21:52.549080+0000","last_became_peered":"2024-09-12T00:21:52.549080+0000","last_unstale":"2024-09-12T01:07:57.028869+0000","last_undegraded":"2024-09-12T01:07:57.028869+0000","last_fullsized":"2024-09-12T01:07:57.028869+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'135","last_scrub_stamp":"2024-09-12T01:07:57.028668+0000","last_deep_scrub":"267'135","last_deep_scrub_stamp":"2024-09-12T01:07:57.028668+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.028668+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:46.435166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'77","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.329440+0000","last_change":"2024-09-12T01:07:47.329440+0000","last_active":"2024-09-12T01:07:47.329440+0000","last_peered":"2024-09-12T01:07:47.329440+0000","last_clean":"2024-09-12T01:07:47.329440+0000","last_became_active":"2024-09-12T00:21:44.495122+0000","last_became_peered":"2024-09-12T00:21:44.495122+0000","last_unstale":"2024-09-12T01:07:47.329440+0000","last_undegraded":"2024-09-12T01:07:47.329440+0000","last_fullsized":"2024-09-12T01:07:47.329440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'77","last_scrub_stamp":"2024-09-12T01:07:47.329261+0000","last_deep_scrub":"267'77","last_deep_scrub_stamp":"2024-09-12T01:07:47.329261+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.329261+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:47.321608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":290,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'356","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.326370+0000","last_change":"2024-09-12T01:07:38.326370+0000","last_active":"2024-09-12T01:07:38.326370+0000","last_peered":"2024-09-12T01:07:38.326370+0000","last_clean":"2024-09-12T01:07:38.326370+0000","last_became_active":"2024-09-12T00:21:42.492358+0000","last_became_peered":"2024-09-12T00:21:42.492358+0000","last_unstale":"2024-09-12T01:07:38.326370+0000","last_undegraded":"2024-09-12T01:07:38.326370+0000","last_fullsized":"2024-09-12T01:07:38.326370+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'356","last_scrub_stamp":"2024-09-12T01:07:38.326089+0000","last_deep_scrub":"267'356","last_deep_scrub_stamp":"2024-09-12T01:07:38.326089+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.326089+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:59.129648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262257,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":28331,"num_write":1177,"num_write_kb":34411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'258","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.117862+0000","last_change":"2024-09-12T01:07:43.117862+0000","last_active":"2024-09-12T01:07:43.117862+0000","last_peered":"2024-09-12T01:07:43.117862+0000","last_clean":"2024-09-12T01:07:43.117862+0000","last_became_active":"2024-09-12T00:21:44.515839+0000","last_became_peered":"2024-09-12T00:21:44.515839+0000","last_unstale":"2024-09-12T01:07:43.117862+0000","last_undegraded":"2024-09-12T01:07:43.117862+0000","last_fullsized":"2024-09-12T01:07:43.117862+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:07:43.117677+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:07:43.117677+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.117677+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":1036,"num_write":423,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'449","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.076589+0000","last_change":"2024-09-12T01:07:39.076589+0000","last_active":"2024-09-12T01:07:39.076589+0000","last_peered":"2024-09-12T01:07:39.076589+0000","last_clean":"2024-09-12T01:07:39.076589+0000","last_became_active":"2024-09-12T00:21:42.502396+0000","last_became_peered":"2024-09-12T00:21:42.502396+0000","last_unstale":"2024-09-12T01:07:39.076589+0000","last_undegraded":"2024-09-12T01:07:39.076589+0000","last_fullsized":"2024-09-12T01:07:39.076589+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'449","last_scrub_stamp":"2024-09-12T01:07:39.076357+0000","last_deep_scrub":"267'449","last_deep_scrub_stamp":"2024-09-12T01:07:39.076357+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.076357+0000","objects_scrubbed":10,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:36.125871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607324,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":742,"num_read_kb":17888,"num_write":1520,"num_write_kb":31183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'183","reported_seq":757,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.932889+0000","last_change":"2024-09-12T01:07:56.932889+0000","last_active":"2024-09-12T01:07:56.932889+0000","last_peered":"2024-09-12T01:07:56.932889+0000","last_clean":"2024-09-12T01:07:56.932889+0000","last_became_active":"2024-09-12T00:21:44.499805+0000","last_became_peered":"2024-09-12T00:21:44.499805+0000","last_unstale":"2024-09-12T01:07:56.932889+0000","last_undegraded":"2024-09-12T01:07:56.932889+0000","last_fullsized":"2024-09-12T01:07:56.932889+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-12T01:07:56.932675+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-12T01:07:56.932675+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.932675+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:28.852641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":613,"num_write":283,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'459","reported_seq":1211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.936240+0000","last_change":"2024-09-12T01:07:46.936240+0000","last_active":"2024-09-12T01:07:46.936240+0000","last_peered":"2024-09-12T01:07:46.936240+0000","last_clean":"2024-09-12T01:07:46.936240+0000","last_became_active":"2024-09-12T00:21:42.518823+0000","last_became_peered":"2024-09-12T00:21:42.518823+0000","last_unstale":"2024-09-12T01:07:46.936240+0000","last_undegraded":"2024-09-12T01:07:46.936240+0000","last_fullsized":"2024-09-12T01:07:46.936240+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'459","last_scrub_stamp":"2024-09-12T01:07:46.935967+0000","last_deep_scrub":"267'459","last_deep_scrub_stamp":"2024-09-12T01:07:46.935967+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.935967+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:07.773715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194369,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":958,"num_read_kb":24368,"num_write":1486,"num_write_kb":48727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'184","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.018711+0000","last_change":"2024-09-12T01:07:54.018711+0000","last_active":"2024-09-12T01:07:54.018711+0000","last_peered":"2024-09-12T01:07:54.018711+0000","last_clean":"2024-09-12T01:07:54.018711+0000","last_became_active":"2024-09-12T00:21:44.510818+0000","last_became_peered":"2024-09-12T00:21:44.510818+0000","last_unstale":"2024-09-12T01:07:54.018711+0000","last_undegraded":"2024-09-12T01:07:54.018711+0000","last_fullsized":"2024-09-12T01:07:54.018711+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-12T01:07:54.018527+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-12T01:07:54.018527+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.018527+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:05.725799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":671,"num_write":265,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'350","reported_seq":1138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.997261+0000","last_change":"2024-09-12T01:07:40.997011+0000","last_active":"2024-09-12T01:07:40.997261+0000","last_peered":"2024-09-12T01:07:40.997261+0000","last_clean":"2024-09-12T01:07:40.997261+0000","last_became_active":"2024-09-12T00:21:42.525233+0000","last_became_peered":"2024-09-12T00:21:42.525233+0000","last_unstale":"2024-09-12T01:07:40.997261+0000","last_undegraded":"2024-09-12T01:07:40.997261+0000","last_fullsized":"2024-09-12T01:07:40.997261+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-12T01:07:40.996743+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-12T01:07:40.996743+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.996743+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:28.641437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":844,"num_read_kb":20388,"num_write":1063,"num_write_kb":42665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'183","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.022367+0000","last_change":"2024-09-12T01:07:53.022367+0000","last_active":"2024-09-12T01:07:53.022367+0000","last_peered":"2024-09-12T01:07:53.022367+0000","last_clean":"2024-09-12T01:07:53.022367+0000","last_became_active":"2024-09-12T00:21:44.523632+0000","last_became_peered":"2024-09-12T00:21:44.523632+0000","last_unstale":"2024-09-12T01:07:53.022367+0000","last_undegraded":"2024-09-12T01:07:53.022367+0000","last_fullsized":"2024-09-12T01:07:53.022367+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-12T01:07:53.022187+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-12T01:07:53.022187+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.022187+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.672407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":821,"num_read_kb":680,"num_write":294,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'392","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.353558+0000","last_change":"2024-09-12T01:07:38.353558+0000","last_active":"2024-09-12T01:07:38.353558+0000","last_peered":"2024-09-12T01:07:38.353558+0000","last_clean":"2024-09-12T01:07:38.353558+0000","last_became_active":"2024-09-12T00:21:42.501690+0000","last_became_peered":"2024-09-12T00:21:42.501690+0000","last_unstale":"2024-09-12T01:07:38.353558+0000","last_undegraded":"2024-09-12T01:07:38.353558+0000","last_fullsized":"2024-09-12T01:07:38.353558+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T01:07:38.353347+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T01:07:38.353347+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.353347+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.350580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":15193,"num_write":1332,"num_write_kb":28087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'132","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.987108+0000","last_change":"2024-09-12T01:07:39.987108+0000","last_active":"2024-09-12T01:07:39.987108+0000","last_peered":"2024-09-12T01:07:39.987108+0000","last_clean":"2024-09-12T01:07:39.987108+0000","last_became_active":"2024-09-12T00:21:44.505235+0000","last_became_peered":"2024-09-12T00:21:44.505235+0000","last_unstale":"2024-09-12T01:07:39.987108+0000","last_undegraded":"2024-09-12T01:07:39.987108+0000","last_fullsized":"2024-09-12T01:07:39.987108+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-12T01:07:39.986839+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-12T01:07:39.986839+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.986839+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:55.921394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":497,"num_write":201,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'335","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.339544+0000","last_change":"2024-09-12T01:07:41.339544+0000","last_active":"2024-09-12T01:07:41.339544+0000","last_peered":"2024-09-12T01:07:41.339544+0000","last_clean":"2024-09-12T01:07:41.339544+0000","last_became_active":"2024-09-12T00:21:42.508673+0000","last_became_peered":"2024-09-12T00:21:42.508673+0000","last_unstale":"2024-09-12T01:07:41.339544+0000","last_undegraded":"2024-09-12T01:07:41.339544+0000","last_fullsized":"2024-09-12T01:07:41.339544+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-12T01:07:41.339325+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-12T01:07:41.339325+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.339325+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:53.386446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":604,"num_read_kb":49155,"num_write":1190,"num_write_kb":40891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'142","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.352041+0000","last_change":"2024-09-12T01:07:48.352041+0000","last_active":"2024-09-12T01:07:48.352041+0000","last_peered":"2024-09-12T01:07:48.352041+0000","last_clean":"2024-09-12T01:07:48.352041+0000","last_became_active":"2024-09-12T00:21:44.515206+0000","last_became_peered":"2024-09-12T00:21:44.515206+0000","last_unstale":"2024-09-12T01:07:48.352041+0000","last_undegraded":"2024-09-12T01:07:48.352041+0000","last_fullsized":"2024-09-12T01:07:48.352041+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-12T01:07:48.351764+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-12T01:07:48.351764+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.351764+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:43.602157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":613,"num_write":237,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'349","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.216592+0000","last_change":"2024-09-12T01:07:35.216592+0000","last_active":"2024-09-12T01:07:35.216592+0000","last_peered":"2024-09-12T01:07:35.216592+0000","last_clean":"2024-09-12T01:07:35.216592+0000","last_became_active":"2024-09-12T00:21:42.486829+0000","last_became_peered":"2024-09-12T00:21:42.486829+0000","last_unstale":"2024-09-12T01:07:35.216592+0000","last_undegraded":"2024-09-12T01:07:35.216592+0000","last_fullsized":"2024-09-12T01:07:35.216592+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:35.216329+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:35.216329+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.216329+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:13.259415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":546,"num_read_kb":26644,"num_write":1053,"num_write_kb":13447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'172","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.681254+0000","last_change":"2024-09-12T01:07:39.681254+0000","last_active":"2024-09-12T01:07:39.681254+0000","last_peered":"2024-09-12T01:07:39.681254+0000","last_clean":"2024-09-12T01:07:39.681254+0000","last_became_active":"2024-09-12T00:21:44.501384+0000","last_became_peered":"2024-09-12T00:21:44.501384+0000","last_unstale":"2024-09-12T01:07:39.681254+0000","last_undegraded":"2024-09-12T01:07:39.681254+0000","last_fullsized":"2024-09-12T01:07:39.681254+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'172","last_scrub_stamp":"2024-09-12T01:07:39.681065+0000","last_deep_scrub":"267'172","last_deep_scrub_stamp":"2024-09-12T01:07:39.681065+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.681065+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:09.758134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":594,"num_write":251,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'349","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.976693+0000","last_change":"2024-09-12T01:07:41.976693+0000","last_active":"2024-09-12T01:07:41.976693+0000","last_peered":"2024-09-12T01:07:41.976693+0000","last_clean":"2024-09-12T01:07:41.976693+0000","last_became_active":"2024-09-12T00:21:42.533216+0000","last_became_peered":"2024-09-12T00:21:42.533216+0000","last_unstale":"2024-09-12T01:07:41.976693+0000","last_undegraded":"2024-09-12T01:07:41.976693+0000","last_fullsized":"2024-09-12T01:07:41.976693+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:41.976497+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:41.976497+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.976497+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.595660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":42167,"num_write":1187,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'107","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.168385+0000","last_change":"2024-09-12T01:07:45.168220+0000","last_active":"2024-09-12T01:07:45.168385+0000","last_peered":"2024-09-12T01:07:45.168385+0000","last_clean":"2024-09-12T01:07:45.168385+0000","last_became_active":"2024-09-12T00:21:44.514909+0000","last_became_peered":"2024-09-12T00:21:44.514909+0000","last_unstale":"2024-09-12T01:07:45.168385+0000","last_undegraded":"2024-09-12T01:07:45.168385+0000","last_fullsized":"2024-09-12T01:07:45.168385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-12T01:07:45.168048+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-12T01:07:45.168048+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.168048+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:49.895766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":354,"num_write":152,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'370","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.936009+0000","last_change":"2024-09-12T01:07:41.936009+0000","last_active":"2024-09-12T01:07:41.936009+0000","last_peered":"2024-09-12T01:07:41.936009+0000","last_clean":"2024-09-12T01:07:41.936009+0000","last_became_active":"2024-09-12T00:21:42.528929+0000","last_became_peered":"2024-09-12T00:21:42.528929+0000","last_unstale":"2024-09-12T01:07:41.936009+0000","last_undegraded":"2024-09-12T01:07:41.936009+0000","last_fullsized":"2024-09-12T01:07:41.936009+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-12T01:07:41.935688+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-12T01:07:41.935688+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.935688+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:34.868286+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739017,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":14743,"num_write":1076,"num_write_kb":22917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'148","reported_seq":785,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.021178+0000","last_change":"2024-09-12T01:07:44.021040+0000","last_active":"2024-09-12T01:07:44.021178+0000","last_peered":"2024-09-12T01:07:44.021178+0000","last_clean":"2024-09-12T01:07:44.021178+0000","last_became_active":"2024-09-12T00:21:44.507579+0000","last_became_peered":"2024-09-12T00:21:44.507579+0000","last_unstale":"2024-09-12T01:07:44.021178+0000","last_undegraded":"2024-09-12T01:07:44.021178+0000","last_fullsized":"2024-09-12T01:07:44.021178+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'148","last_scrub_stamp":"2024-09-12T01:07:44.020852+0000","last_deep_scrub":"267'148","last_deep_scrub_stamp":"2024-09-12T01:07:44.020852+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.020852+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.933243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":566,"num_write":233,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'388","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.012237+0000","last_change":"2024-09-12T01:07:43.012237+0000","last_active":"2024-09-12T01:07:43.012237+0000","last_peered":"2024-09-12T01:07:43.012237+0000","last_clean":"2024-09-12T01:07:43.012237+0000","last_became_active":"2024-09-12T00:21:42.511703+0000","last_became_peered":"2024-09-12T00:21:42.511703+0000","last_unstale":"2024-09-12T01:07:43.012237+0000","last_undegraded":"2024-09-12T01:07:43.012237+0000","last_fullsized":"2024-09-12T01:07:43.012237+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'388","last_scrub_stamp":"2024-09-12T01:07:43.011885+0000","last_deep_scrub":"267'388","last_deep_scrub_stamp":"2024-09-12T01:07:43.011885+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.011885+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:55.733392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":16290,"num_write":1225,"num_write_kb":34029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'32","reported_seq":582,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.977961+0000","last_change":"2024-09-12T01:07:54.977961+0000","last_active":"2024-09-12T01:07:54.977961+0000","last_peered":"2024-09-12T01:07:54.977961+0000","last_clean":"2024-09-12T01:07:54.977961+0000","last_became_active":"2024-09-12T00:21:44.509834+0000","last_became_peered":"2024-09-12T00:21:44.509834+0000","last_unstale":"2024-09-12T01:07:54.977961+0000","last_undegraded":"2024-09-12T01:07:54.977961+0000","last_fullsized":"2024-09-12T01:07:54.977961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'32","last_scrub_stamp":"2024-09-12T01:07:54.977690+0000","last_deep_scrub":"267'32","last_deep_scrub_stamp":"2024-09-12T01:07:54.977690+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.977690+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:06.019506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'345","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.645905+0000","last_change":"2024-09-12T01:07:40.645905+0000","last_active":"2024-09-12T01:07:40.645905+0000","last_peered":"2024-09-12T01:07:40.645905+0000","last_clean":"2024-09-12T01:07:40.645905+0000","last_became_active":"2024-09-12T00:21:42.484073+0000","last_became_peered":"2024-09-12T00:21:42.484073+0000","last_unstale":"2024-09-12T01:07:40.645905+0000","last_undegraded":"2024-09-12T01:07:40.645905+0000","last_fullsized":"2024-09-12T01:07:40.645905+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T01:07:40.645425+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T01:07:40.645425+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.645425+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.525871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992329,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":37312,"num_write":1168,"num_write_kb":47723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'220","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.580102+0000","last_change":"2024-09-12T01:07:42.580102+0000","last_active":"2024-09-12T01:07:42.580102+0000","last_peered":"2024-09-12T01:07:42.580102+0000","last_clean":"2024-09-12T01:07:42.580102+0000","last_became_active":"2024-09-12T00:21:44.499043+0000","last_became_peered":"2024-09-12T00:21:44.499043+0000","last_unstale":"2024-09-12T01:07:42.580102+0000","last_undegraded":"2024-09-12T01:07:42.580102+0000","last_fullsized":"2024-09-12T01:07:42.580102+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-12T01:07:42.579921+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-12T01:07:42.579921+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.579921+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:04.824993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":734,"num_write":347,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'399","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.486946+0000","last_change":"2024-09-12T01:07:41.486946+0000","last_active":"2024-09-12T01:07:41.486946+0000","last_peered":"2024-09-12T01:07:41.486946+0000","last_clean":"2024-09-12T01:07:41.486946+0000","last_became_active":"2024-09-12T00:21:42.482971+0000","last_became_peered":"2024-09-12T00:21:42.482971+0000","last_unstale":"2024-09-12T01:07:41.486946+0000","last_undegraded":"2024-09-12T01:07:41.486946+0000","last_fullsized":"2024-09-12T01:07:41.486946+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-12T01:07:41.486689+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-12T01:07:41.486689+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.486689+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:42.636122+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5391930,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":31089,"num_write":1168,"num_write_kb":20487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'219","reported_seq":892,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.623877+0000","last_change":"2024-09-12T01:07:41.623877+0000","last_active":"2024-09-12T01:07:41.623877+0000","last_peered":"2024-09-12T01:07:41.623877+0000","last_clean":"2024-09-12T01:07:41.623877+0000","last_became_active":"2024-09-12T00:21:44.526086+0000","last_became_peered":"2024-09-12T00:21:44.526086+0000","last_unstale":"2024-09-12T01:07:41.623877+0000","last_undegraded":"2024-09-12T01:07:41.623877+0000","last_fullsized":"2024-09-12T01:07:41.623877+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T01:07:41.623704+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T01:07:41.623704+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.623704+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:51.380240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1006,"num_read_kb":865,"num_write":343,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3377,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'363","reported_seq":1106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.022461+0000","last_change":"2024-09-12T01:07:46.022461+0000","last_active":"2024-09-12T01:07:46.022461+0000","last_peered":"2024-09-12T01:07:46.022461+0000","last_clean":"2024-09-12T01:07:46.022461+0000","last_became_active":"2024-09-12T00:22:12.609837+0000","last_became_peered":"2024-09-12T00:22:12.609837+0000","last_unstale":"2024-09-12T01:07:46.022461+0000","last_undegraded":"2024-09-12T01:07:46.022461+0000","last_fullsized":"2024-09-12T01:07:46.022461+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'363","last_scrub_stamp":"2024-09-12T01:07:46.022232+0000","last_deep_scrub":"267'363","last_deep_scrub_stamp":"2024-09-12T01:07:46.022232+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.022232+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:19.433845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48804,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":34651,"num_write":1163,"num_write_kb":39913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2a","version":"267'442","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.138669+0000","last_change":"2024-09-12T01:07:44.138669+0000","last_active":"2024-09-12T01:07:44.138669+0000","last_peered":"2024-09-12T01:07:44.138669+0000","last_clean":"2024-09-12T01:07:44.138669+0000","last_became_active":"2024-09-12T00:21:44.511294+0000","last_became_peered":"2024-09-12T00:21:44.511294+0000","last_unstale":"2024-09-12T01:07:44.138669+0000","last_undegraded":"2024-09-12T01:07:44.138669+0000","last_fullsized":"2024-09-12T01:07:44.138669+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-09-12T01:07:44.138494+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-09-12T01:07:44.138494+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.138494+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.489890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2157,"num_read_kb":1820,"num_write":750,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'349","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.924944+0000","last_change":"2024-09-12T01:07:48.924944+0000","last_active":"2024-09-12T01:07:48.924944+0000","last_peered":"2024-09-12T01:07:48.924944+0000","last_clean":"2024-09-12T01:07:48.924944+0000","last_became_active":"2024-09-12T00:21:42.528942+0000","last_became_peered":"2024-09-12T00:21:42.528942+0000","last_unstale":"2024-09-12T01:07:48.924944+0000","last_undegraded":"2024-09-12T01:07:48.924944+0000","last_fullsized":"2024-09-12T01:07:48.924944+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:48.924728+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:48.924728+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.924728+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:56.808821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":48912,"num_write":1189,"num_write_kb":34098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'117","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.317201+0000","last_change":"2024-09-12T01:07:48.317201+0000","last_active":"2024-09-12T01:07:48.317201+0000","last_peered":"2024-09-12T01:07:48.317201+0000","last_clean":"2024-09-12T01:07:48.317201+0000","last_became_active":"2024-09-12T00:21:44.525685+0000","last_became_peered":"2024-09-12T00:21:44.525685+0000","last_unstale":"2024-09-12T01:07:48.317201+0000","last_undegraded":"2024-09-12T01:07:48.317201+0000","last_fullsized":"2024-09-12T01:07:48.317201+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:07:48.316987+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:07:48.316987+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.316987+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:57.147053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":457,"num_write":189,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'328","reported_seq":954,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.128557+0000","last_change":"2024-09-12T01:07:37.128313+0000","last_active":"2024-09-12T01:07:37.128557+0000","last_peered":"2024-09-12T01:07:37.128557+0000","last_clean":"2024-09-12T01:07:37.128557+0000","last_became_active":"2024-09-12T00:21:42.499294+0000","last_became_peered":"2024-09-12T00:21:42.499294+0000","last_unstale":"2024-09-12T01:07:37.128557+0000","last_undegraded":"2024-09-12T01:07:37.128557+0000","last_fullsized":"2024-09-12T01:07:37.128557+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:37.127984+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:37.127984+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.127984+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:09.845259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":11483,"num_write":1078,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'192","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.681453+0000","last_change":"2024-09-12T01:07:38.681453+0000","last_active":"2024-09-12T01:07:38.681453+0000","last_peered":"2024-09-12T01:07:38.681453+0000","last_clean":"2024-09-12T01:07:38.681453+0000","last_became_active":"2024-09-12T00:21:44.511085+0000","last_became_peered":"2024-09-12T00:21:44.511085+0000","last_unstale":"2024-09-12T01:07:38.681453+0000","last_undegraded":"2024-09-12T01:07:38.681453+0000","last_fullsized":"2024-09-12T01:07:38.681453+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-12T01:07:38.681238+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-12T01:07:38.681238+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.681238+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:47.137512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":698,"num_write":312,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'380","reported_seq":1058,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.889507+0000","last_change":"2024-09-12T01:07:42.889331+0000","last_active":"2024-09-12T01:07:42.889507+0000","last_peered":"2024-09-12T01:07:42.889507+0000","last_clean":"2024-09-12T01:07:42.889507+0000","last_became_active":"2024-09-12T00:21:42.518768+0000","last_became_peered":"2024-09-12T00:21:42.518768+0000","last_unstale":"2024-09-12T01:07:42.889507+0000","last_undegraded":"2024-09-12T01:07:42.889507+0000","last_fullsized":"2024-09-12T01:07:42.889507+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-12T01:07:42.889092+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-12T01:07:42.889092+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.889092+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:00.397455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984139,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":53651,"num_write":1104,"num_write_kb":23347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'311","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.917061+0000","last_change":"2024-09-12T01:07:45.916905+0000","last_active":"2024-09-12T01:07:45.917061+0000","last_peered":"2024-09-12T01:07:45.917061+0000","last_clean":"2024-09-12T01:07:45.917061+0000","last_became_active":"2024-09-12T00:21:42.495480+0000","last_became_peered":"2024-09-12T00:21:42.495480+0000","last_unstale":"2024-09-12T01:07:45.917061+0000","last_undegraded":"2024-09-12T01:07:45.917061+0000","last_fullsized":"2024-09-12T01:07:45.917061+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:07:45.916689+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:07:45.916689+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.916689+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:26.278518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":25580,"num_write":940,"num_write_kb":28169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'195","reported_seq":853,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.322966+0000","last_change":"2024-09-12T01:07:51.322966+0000","last_active":"2024-09-12T01:07:51.322966+0000","last_peered":"2024-09-12T01:07:51.322966+0000","last_clean":"2024-09-12T01:07:51.322966+0000","last_became_active":"2024-09-12T00:21:44.526907+0000","last_became_peered":"2024-09-12T00:21:44.526907+0000","last_unstale":"2024-09-12T01:07:51.322966+0000","last_undegraded":"2024-09-12T01:07:51.322966+0000","last_fullsized":"2024-09-12T01:07:51.322966+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'195","last_scrub_stamp":"2024-09-12T01:07:51.322766+0000","last_deep_scrub":"267'195","last_deep_scrub_stamp":"2024-09-12T01:07:51.322766+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.322766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:48.700283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":917,"num_read_kb":786,"num_write":315,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'317","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.060678+0000","last_change":"2024-09-12T01:07:45.060525+0000","last_active":"2024-09-12T01:07:45.060678+0000","last_peered":"2024-09-12T01:07:45.060678+0000","last_clean":"2024-09-12T01:07:45.060678+0000","last_became_active":"2024-09-12T00:21:42.516614+0000","last_became_peered":"2024-09-12T00:21:42.516614+0000","last_unstale":"2024-09-12T01:07:45.060678+0000","last_undegraded":"2024-09-12T01:07:45.060678+0000","last_fullsized":"2024-09-12T01:07:45.060678+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T01:07:45.060335+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T01:07:45.060335+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.060335+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:33.065278+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":551234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":30838,"num_write":927,"num_write_kb":38454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'102","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.511593+0000","last_change":"2024-09-12T01:07:46.511593+0000","last_active":"2024-09-12T01:07:46.511593+0000","last_peered":"2024-09-12T01:07:46.511593+0000","last_clean":"2024-09-12T01:07:46.511593+0000","last_became_active":"2024-09-12T00:21:44.496138+0000","last_became_peered":"2024-09-12T00:21:44.496138+0000","last_unstale":"2024-09-12T01:07:46.511593+0000","last_undegraded":"2024-09-12T01:07:46.511593+0000","last_fullsized":"2024-09-12T01:07:46.511593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:46.511410+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:46.511410+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.511410+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:58.055004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5839,"num_read_kb":4146,"num_write":1942,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6986,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1115,"ondisk_log_size":1115,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14973,"num_read_kb":14645,"num_write":16791,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1650,"ondisk_log_size":1650,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":605,"ondisk_log_size":605,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1609364,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17687,"num_read_kb":36971,"num_write":14775,"num_write_kb":11603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684328,"num_omap_keys":1568,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1962,"ondisk_log_size":1962,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":101832,"num_read_kb":85065,"num_write":36894,"num_write_kb":18565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44327,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3800,"ondisk_log_size":3800,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":81179371,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36143,"num_read_kb":1795948,"num_write":71818,"num_write_kb":2042491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123875328,"data_stored":123875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3430,"ondisk_log_size":3430,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":206538,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":195226,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510010,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110064,"kb_used_data":20640,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94261776,"statfs":{"total":96636764160,"available":96524058624,"internally_reserved":0,"allocated":21135360,"data_stored":19116983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510011,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273492,"kb_used_data":21636,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098348,"statfs":{"total":96636764160,"available":96356708352,"internally_reserved":0,"allocated":22155264,"data_stored":20133475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510013,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200892,"kb_used_data":21228,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94170948,"statfs":{"total":96636764160,"available":96431050752,"internally_reserved":0,"allocated":21737472,"data_stored":19736193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510011,"num_pgs":123,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257480,"kb_used_data":19448,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94114360,"statfs":{"total":96636764160,"available":96373104640,"internally_reserved":0,"allocated":19914752,"data_stored":17899204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":243726792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510014,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145376,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94226464,"statfs":{"total":96636764160,"available":96487899136,"internally_reserved":0,"allocated":24526848,"data_stored":22535733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510011,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286592,"kb_used_data":12464,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94085248,"statfs":{"total":96636764160,"available":96343293952,"internally_reserved":0,"allocated":12763136,"data_stored":10743931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510010,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146944,"kb_used_data":17264,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94224896,"statfs":{"total":96636764160,"available":96486293504,"internally_reserved":0,"allocated":17678336,"data_stored":15657318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542716,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226236,"kb_used_data":18796,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94145604,"statfs":{"total":96636764160,"available":96405098496,"internally_reserved":0,"allocated":19247104,"data_stored":17260105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13402112,"data_stored":13402112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7901184,"data_stored":7901184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20283392,"data_stored":20283392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17481728,"data_stored":17481728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17289216,"data_stored":17289216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16863232,"data_stored":16863232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15007744,"data_stored":15007744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:08:36.741 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:36.742 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:36.742 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:36.742 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:38:09.644882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:36.743 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:36.744 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:49:09.567784+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=49, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=7, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:08:36.749 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:08:56.751 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:08:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T01:08:57.113 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-12T01:08:57.118 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1688,"stamp":"2024-09-12T01:08:55.188897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83396560,"num_objects":733,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":179311,"num_read_kb":2341483,"num_write":142743,"num_write_kb":2353740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":739525,"num_omap_keys":1791,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12931,"ondisk_log_size":12931,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1647076,"kb_used_data":155428,"kb_used_omap":12,"kb_used_meta":1491507,"kb_avail":753327644,"statfs":{"total":773094113280,"available":771407507456,"internally_reserved":0,"allocated":159158272,"data_stored":143082942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1527303729},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007781"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.054822+0000","last_change":"2024-09-12T01:08:10.054822+0000","last_active":"2024-09-12T01:08:10.054822+0000","last_peered":"2024-09-12T01:08:10.054822+0000","last_clean":"2024-09-12T01:08:10.054822+0000","last_became_active":"2024-09-12T00:49:10.623491+0000","last_became_peered":"2024-09-12T00:49:10.623491+0000","last_unstale":"2024-09-12T01:08:10.054822+0000","last_undegraded":"2024-09-12T01:08:10.054822+0000","last_fullsized":"2024-09-12T01:08:10.054822+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.054640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.054640+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.054640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:35.071276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"267'7","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.606226+0000","last_change":"2024-09-12T01:08:08.606069+0000","last_active":"2024-09-12T01:08:08.606226+0000","last_peered":"2024-09-12T01:08:08.606226+0000","last_clean":"2024-09-12T01:08:08.606226+0000","last_became_active":"2024-09-12T00:38:10.687911+0000","last_became_peered":"2024-09-12T00:38:10.687911+0000","last_unstale":"2024-09-12T01:08:08.606226+0000","last_undegraded":"2024-09-12T01:08:08.606226+0000","last_fullsized":"2024-09-12T01:08:08.606226+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:08.605857+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:08.605857+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.605857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:58.041544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.347173+0000","last_change":"2024-09-12T01:08:12.347173+0000","last_active":"2024-09-12T01:08:12.347173+0000","last_peered":"2024-09-12T01:08:12.347173+0000","last_clean":"2024-09-12T01:08:12.347173+0000","last_became_active":"2024-09-12T00:38:07.664779+0000","last_became_peered":"2024-09-12T00:38:07.664779+0000","last_unstale":"2024-09-12T01:08:12.347173+0000","last_undegraded":"2024-09-12T01:08:12.347173+0000","last_fullsized":"2024-09-12T01:08:12.347173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:12.346976+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:12.346976+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.346976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:41.632394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'50","reported_seq":191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.613557+0000","last_change":"2024-09-12T01:08:15.613557+0000","last_active":"2024-09-12T01:08:15.613557+0000","last_peered":"2024-09-12T01:08:15.613557+0000","last_clean":"2024-09-12T01:08:15.613557+0000","last_became_active":"2024-09-12T00:36:37.223686+0000","last_became_peered":"2024-09-12T00:36:37.223686+0000","last_unstale":"2024-09-12T01:08:15.613557+0000","last_undegraded":"2024-09-12T01:08:15.613557+0000","last_fullsized":"2024-09-12T01:08:15.613557+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'50","last_scrub_stamp":"2024-09-12T01:08:15.613270+0000","last_deep_scrub":"267'50","last_deep_scrub_stamp":"2024-09-12T01:08:15.613270+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.613270+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:57.806634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":201,"num_write":87,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.297208+0000","last_change":"2024-09-12T01:08:18.297208+0000","last_active":"2024-09-12T01:08:18.297208+0000","last_peered":"2024-09-12T01:08:18.297208+0000","last_clean":"2024-09-12T01:08:18.297208+0000","last_became_active":"2024-09-12T00:49:10.624700+0000","last_became_peered":"2024-09-12T00:49:10.624700+0000","last_unstale":"2024-09-12T01:08:18.297208+0000","last_undegraded":"2024-09-12T01:08:18.297208+0000","last_fullsized":"2024-09-12T01:08:18.297208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:18.297026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:18.297026+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.297026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.384805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"267'8","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.272062+0000","last_change":"2024-09-12T01:08:13.271925+0000","last_active":"2024-09-12T01:08:13.272062+0000","last_peered":"2024-09-12T01:08:13.272062+0000","last_clean":"2024-09-12T01:08:13.272062+0000","last_became_active":"2024-09-12T00:38:10.691195+0000","last_became_peered":"2024-09-12T00:38:10.691195+0000","last_unstale":"2024-09-12T01:08:13.272062+0000","last_undegraded":"2024-09-12T01:08:13.272062+0000","last_fullsized":"2024-09-12T01:08:13.272062+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.271714+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.271714+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.271714+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:08.269903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"267'8","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.828187+0000","last_change":"2024-09-12T01:08:19.828187+0000","last_active":"2024-09-12T01:08:19.828187+0000","last_peered":"2024-09-12T01:08:19.828187+0000","last_clean":"2024-09-12T01:08:19.828187+0000","last_became_active":"2024-09-12T00:38:07.664663+0000","last_became_peered":"2024-09-12T00:38:07.664663+0000","last_unstale":"2024-09-12T01:08:19.828187+0000","last_undegraded":"2024-09-12T01:08:19.828187+0000","last_fullsized":"2024-09-12T01:08:19.828187+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:19.828003+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:19.828003+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.828003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:34.062200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'12","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.575351+0000","last_change":"2024-09-12T01:08:14.575204+0000","last_active":"2024-09-12T01:08:14.575351+0000","last_peered":"2024-09-12T01:08:14.575351+0000","last_clean":"2024-09-12T01:08:14.575351+0000","last_became_active":"2024-09-12T00:36:37.239199+0000","last_became_peered":"2024-09-12T00:36:37.239199+0000","last_unstale":"2024-09-12T01:08:14.575351+0000","last_undegraded":"2024-09-12T01:08:14.575351+0000","last_fullsized":"2024-09-12T01:08:14.575351+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:14.575015+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:14.575015+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.575015+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:49.586544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.592345+0000","last_change":"2024-09-12T01:08:12.592098+0000","last_active":"2024-09-12T01:08:12.592345+0000","last_peered":"2024-09-12T01:08:12.592345+0000","last_clean":"2024-09-12T01:08:12.592345+0000","last_became_active":"2024-09-12T00:49:10.611715+0000","last_became_peered":"2024-09-12T00:49:10.611715+0000","last_unstale":"2024-09-12T01:08:12.592345+0000","last_undegraded":"2024-09-12T01:08:12.592345+0000","last_fullsized":"2024-09-12T01:08:12.592345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:12.591892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:12.591892+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.591892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:16.236185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"267'13","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:26.812671+0000","last_change":"2024-09-12T01:08:26.812671+0000","last_active":"2024-09-12T01:08:26.812671+0000","last_peered":"2024-09-12T01:08:26.812671+0000","last_clean":"2024-09-12T01:08:26.812671+0000","last_became_active":"2024-09-12T00:38:10.702832+0000","last_became_peered":"2024-09-12T00:38:10.702832+0000","last_unstale":"2024-09-12T01:08:26.812671+0000","last_undegraded":"2024-09-12T01:08:26.812671+0000","last_fullsized":"2024-09-12T01:08:26.812671+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-12T01:08:26.812478+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-12T01:08:26.812478+0000","last_clean_scrub_stamp":"2024-09-12T01:08:26.812478+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:50.220090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26653,"num_write":18,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.315658+0000","last_change":"2024-09-12T01:08:13.315534+0000","last_active":"2024-09-12T01:08:13.315658+0000","last_peered":"2024-09-12T01:08:13.315658+0000","last_clean":"2024-09-12T01:08:13.315658+0000","last_became_active":"2024-09-12T00:38:07.654162+0000","last_became_peered":"2024-09-12T00:38:07.654162+0000","last_unstale":"2024-09-12T01:08:13.315658+0000","last_undegraded":"2024-09-12T01:08:13.315658+0000","last_fullsized":"2024-09-12T01:08:13.315658+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:13.315358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:13.315358+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.315358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:31.740346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'61","reported_seq":223,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.285338+0000","last_change":"2024-09-12T01:08:11.285338+0000","last_active":"2024-09-12T01:08:11.285338+0000","last_peered":"2024-09-12T01:08:11.285338+0000","last_clean":"2024-09-12T01:08:11.285338+0000","last_became_active":"2024-09-12T00:36:37.243951+0000","last_became_peered":"2024-09-12T00:36:37.243951+0000","last_unstale":"2024-09-12T01:08:11.285338+0000","last_undegraded":"2024-09-12T01:08:11.285338+0000","last_fullsized":"2024-09-12T01:08:11.285338+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'61","last_scrub_stamp":"2024-09-12T01:08:11.285152+0000","last_deep_scrub":"267'61","last_deep_scrub_stamp":"2024-09-12T01:08:11.285152+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.285152+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:38.177940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":228,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.782550+0000","last_change":"2024-09-12T01:08:33.782410+0000","last_active":"2024-09-12T01:08:33.782550+0000","last_peered":"2024-09-12T01:08:33.782550+0000","last_clean":"2024-09-12T01:08:33.782550+0000","last_became_active":"2024-09-12T00:49:10.613525+0000","last_became_peered":"2024-09-12T00:49:10.613525+0000","last_unstale":"2024-09-12T01:08:33.782550+0000","last_undegraded":"2024-09-12T01:08:33.782550+0000","last_fullsized":"2024-09-12T01:08:33.782550+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:33.782234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:33.782234+0000","last_clean_scrub_stamp":"2024-09-12T01:08:33.782234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:34.886447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'12","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.831058+0000","last_change":"2024-09-12T01:08:25.831058+0000","last_active":"2024-09-12T01:08:25.831058+0000","last_peered":"2024-09-12T01:08:25.831058+0000","last_clean":"2024-09-12T01:08:25.831058+0000","last_became_active":"2024-09-12T00:38:10.701406+0000","last_became_peered":"2024-09-12T00:38:10.701406+0000","last_unstale":"2024-09-12T01:08:25.831058+0000","last_undegraded":"2024-09-12T01:08:25.831058+0000","last_fullsized":"2024-09-12T01:08:25.831058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:25.830842+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:25.830842+0000","last_clean_scrub_stamp":"2024-09-12T01:08:25.830842+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:49.764299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'4","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.599017+0000","last_change":"2024-09-12T01:08:07.599017+0000","last_active":"2024-09-12T01:08:07.599017+0000","last_peered":"2024-09-12T01:08:07.599017+0000","last_clean":"2024-09-12T01:08:07.599017+0000","last_became_active":"2024-09-12T00:38:07.639897+0000","last_became_peered":"2024-09-12T00:38:07.639897+0000","last_unstale":"2024-09-12T01:08:07.599017+0000","last_undegraded":"2024-09-12T01:08:07.599017+0000","last_fullsized":"2024-09-12T01:08:07.599017+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:08:07.598817+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:08:07.598817+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.598817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:19.008558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4625,"num_write":4,"num_write_kb":4625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'49","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.265543+0000","last_change":"2024-09-12T01:08:10.265543+0000","last_active":"2024-09-12T01:08:10.265543+0000","last_peered":"2024-09-12T01:08:10.265543+0000","last_clean":"2024-09-12T01:08:10.265543+0000","last_became_active":"2024-09-12T00:36:37.235921+0000","last_became_peered":"2024-09-12T00:36:37.235921+0000","last_unstale":"2024-09-12T01:08:10.265543+0000","last_undegraded":"2024-09-12T01:08:10.265543+0000","last_fullsized":"2024-09-12T01:08:10.265543+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'49","last_scrub_stamp":"2024-09-12T01:08:10.265370+0000","last_deep_scrub":"267'49","last_deep_scrub_stamp":"2024-09-12T01:08:10.265370+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.265370+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:23.396702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":160,"num_write":94,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.256965+0000","last_change":"2024-09-12T01:08:23.256965+0000","last_active":"2024-09-12T01:08:23.256965+0000","last_peered":"2024-09-12T01:08:23.256965+0000","last_clean":"2024-09-12T01:08:23.256965+0000","last_became_active":"2024-09-12T00:49:10.640187+0000","last_became_peered":"2024-09-12T00:49:10.640187+0000","last_unstale":"2024-09-12T01:08:23.256965+0000","last_undegraded":"2024-09-12T01:08:23.256965+0000","last_fullsized":"2024-09-12T01:08:23.256965+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:23.256791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:23.256791+0000","last_clean_scrub_stamp":"2024-09-12T01:08:23.256791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:24.513113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"264'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.067106+0000","last_change":"2024-09-12T01:08:02.067106+0000","last_active":"2024-09-12T01:08:02.067106+0000","last_peered":"2024-09-12T01:08:02.067106+0000","last_clean":"2024-09-12T01:08:02.067106+0000","last_became_active":"2024-09-12T00:38:10.702113+0000","last_became_peered":"2024-09-12T00:38:10.702113+0000","last_unstale":"2024-09-12T01:08:02.067106+0000","last_undegraded":"2024-09-12T01:08:02.067106+0000","last_fullsized":"2024-09-12T01:08:02.067106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:02.066913+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:02.066913+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.066913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:16.587948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.836963+0000","last_change":"2024-09-12T01:08:17.836963+0000","last_active":"2024-09-12T01:08:17.836963+0000","last_peered":"2024-09-12T01:08:17.836963+0000","last_clean":"2024-09-12T01:08:17.836963+0000","last_became_active":"2024-09-12T00:38:07.660159+0000","last_became_peered":"2024-09-12T00:38:07.660159+0000","last_unstale":"2024-09-12T01:08:17.836963+0000","last_undegraded":"2024-09-12T01:08:17.836963+0000","last_fullsized":"2024-09-12T01:08:17.836963+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:17.836778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:17.836778+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.836778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:03.576279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'28","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.296991+0000","last_change":"2024-09-12T01:08:09.296991+0000","last_active":"2024-09-12T01:08:09.296991+0000","last_peered":"2024-09-12T01:08:09.296991+0000","last_clean":"2024-09-12T01:08:09.296991+0000","last_became_active":"2024-09-12T00:36:37.248920+0000","last_became_peered":"2024-09-12T00:36:37.248920+0000","last_unstale":"2024-09-12T01:08:09.296991+0000","last_undegraded":"2024-09-12T01:08:09.296991+0000","last_fullsized":"2024-09-12T01:08:09.296991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T01:08:09.296777+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T01:08:09.296777+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.296777+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:14.544546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.643824+0000","last_change":"2024-09-12T01:08:19.643824+0000","last_active":"2024-09-12T01:08:19.643824+0000","last_peered":"2024-09-12T01:08:19.643824+0000","last_clean":"2024-09-12T01:08:19.643824+0000","last_became_active":"2024-09-12T00:49:10.638196+0000","last_became_peered":"2024-09-12T00:49:10.638196+0000","last_unstale":"2024-09-12T01:08:19.643824+0000","last_undegraded":"2024-09-12T01:08:19.643824+0000","last_fullsized":"2024-09-12T01:08:19.643824+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:19.643634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:19.643634+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.643634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:12.169874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.440845+0000","last_change":"2024-09-12T01:08:36.440845+0000","last_active":"2024-09-12T01:08:36.440845+0000","last_peered":"2024-09-12T01:08:36.440845+0000","last_clean":"2024-09-12T01:08:36.440845+0000","last_became_active":"2024-09-12T00:38:10.714503+0000","last_became_peered":"2024-09-12T00:38:10.714503+0000","last_unstale":"2024-09-12T01:08:36.440845+0000","last_undegraded":"2024-09-12T01:08:36.440845+0000","last_fullsized":"2024-09-12T01:08:36.440845+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:08:36.440777+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:08:36.440777+0000","last_clean_scrub_stamp":"2024-09-12T01:08:36.440777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:06.218491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"267'5","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.320373+0000","last_change":"2024-09-12T01:08:32.320373+0000","last_active":"2024-09-12T01:08:32.320373+0000","last_peered":"2024-09-12T01:08:32.320373+0000","last_clean":"2024-09-12T01:08:32.320373+0000","last_became_active":"2024-09-12T00:38:07.656570+0000","last_became_peered":"2024-09-12T00:38:07.656570+0000","last_unstale":"2024-09-12T01:08:32.320373+0000","last_undegraded":"2024-09-12T01:08:32.320373+0000","last_fullsized":"2024-09-12T01:08:32.320373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:32.320179+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:32.320179+0000","last_clean_scrub_stamp":"2024-09-12T01:08:32.320179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:04.322456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'40","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.069684+0000","last_change":"2024-09-12T01:08:05.069684+0000","last_active":"2024-09-12T01:08:05.069684+0000","last_peered":"2024-09-12T01:08:05.069684+0000","last_clean":"2024-09-12T01:08:05.069684+0000","last_became_active":"2024-09-12T00:36:37.239055+0000","last_became_peered":"2024-09-12T00:36:37.239055+0000","last_unstale":"2024-09-12T01:08:05.069684+0000","last_undegraded":"2024-09-12T01:08:05.069684+0000","last_fullsized":"2024-09-12T01:08:05.069684+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:05.069464+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:05.069464+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.069464+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:25.091455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":128,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.342187+0000","last_change":"2024-09-12T01:08:16.342187+0000","last_active":"2024-09-12T01:08:16.342187+0000","last_peered":"2024-09-12T01:08:16.342187+0000","last_clean":"2024-09-12T01:08:16.342187+0000","last_became_active":"2024-09-12T00:49:10.624542+0000","last_became_peered":"2024-09-12T00:49:10.624542+0000","last_unstale":"2024-09-12T01:08:16.342187+0000","last_undegraded":"2024-09-12T01:08:16.342187+0000","last_fullsized":"2024-09-12T01:08:16.342187+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:16.342112+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:16.342112+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.342112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:58.391694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.188462+0000","last_change":"2024-09-12T01:08:11.188325+0000","last_active":"2024-09-12T01:08:11.188462+0000","last_peered":"2024-09-12T01:08:11.188462+0000","last_clean":"2024-09-12T01:08:11.188462+0000","last_became_active":"2024-09-12T00:38:10.698076+0000","last_became_peered":"2024-09-12T00:38:10.698076+0000","last_unstale":"2024-09-12T01:08:11.188462+0000","last_undegraded":"2024-09-12T01:08:11.188462+0000","last_fullsized":"2024-09-12T01:08:11.188462+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.188141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.188141+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.188141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:59.829689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.018764+0000","last_change":"2024-09-12T01:08:01.018642+0000","last_active":"2024-09-12T01:08:01.018764+0000","last_peered":"2024-09-12T01:08:01.018764+0000","last_clean":"2024-09-12T01:08:01.018764+0000","last_became_active":"2024-09-12T00:38:07.626956+0000","last_became_peered":"2024-09-12T00:38:07.626956+0000","last_unstale":"2024-09-12T01:08:01.018764+0000","last_undegraded":"2024-09-12T01:08:01.018764+0000","last_fullsized":"2024-09-12T01:08:01.018764+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:01.018436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:01.018436+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.018436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:14.899789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'29","reported_seq":133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.366021+0000","last_change":"2024-09-12T01:08:06.365759+0000","last_active":"2024-09-12T01:08:06.366021+0000","last_peered":"2024-09-12T01:08:06.366021+0000","last_clean":"2024-09-12T01:08:06.366021+0000","last_became_active":"2024-09-12T00:36:37.239412+0000","last_became_peered":"2024-09-12T00:36:37.239412+0000","last_unstale":"2024-09-12T01:08:06.366021+0000","last_undegraded":"2024-09-12T01:08:06.366021+0000","last_fullsized":"2024-09-12T01:08:06.366021+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T01:08:06.365544+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T01:08:06.365544+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.365544+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:09.997295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":107,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.086539+0000","last_change":"2024-09-12T01:08:09.086539+0000","last_active":"2024-09-12T01:08:09.086539+0000","last_peered":"2024-09-12T01:08:09.086539+0000","last_clean":"2024-09-12T01:08:09.086539+0000","last_became_active":"2024-09-12T00:49:10.623930+0000","last_became_peered":"2024-09-12T00:49:10.623930+0000","last_unstale":"2024-09-12T01:08:09.086539+0000","last_undegraded":"2024-09-12T01:08:09.086539+0000","last_fullsized":"2024-09-12T01:08:09.086539+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.086352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.086352+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.086352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:30.887710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.220416+0000","last_change":"2024-09-12T01:08:20.220416+0000","last_active":"2024-09-12T01:08:20.220416+0000","last_peered":"2024-09-12T01:08:20.220416+0000","last_clean":"2024-09-12T01:08:20.220416+0000","last_became_active":"2024-09-12T00:38:10.709065+0000","last_became_peered":"2024-09-12T00:38:10.709065+0000","last_unstale":"2024-09-12T01:08:20.220416+0000","last_undegraded":"2024-09-12T01:08:20.220416+0000","last_fullsized":"2024-09-12T01:08:20.220416+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:20.220237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:20.220237+0000","last_clean_scrub_stamp":"2024-09-12T01:08:20.220237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:06.219031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"267'4","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.300089+0000","last_change":"2024-09-12T01:08:14.300089+0000","last_active":"2024-09-12T01:08:14.300089+0000","last_peered":"2024-09-12T01:08:14.300089+0000","last_clean":"2024-09-12T01:08:14.300089+0000","last_became_active":"2024-09-12T00:38:07.658039+0000","last_became_peered":"2024-09-12T00:38:07.658039+0000","last_unstale":"2024-09-12T01:08:14.300089+0000","last_undegraded":"2024-09-12T01:08:14.300089+0000","last_fullsized":"2024-09-12T01:08:14.300089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:14.299865+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:14.299865+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.299865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:52.543724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'24","reported_seq":109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.307701+0000","last_change":"2024-09-12T01:08:08.307701+0000","last_active":"2024-09-12T01:08:08.307701+0000","last_peered":"2024-09-12T01:08:08.307701+0000","last_clean":"2024-09-12T01:08:08.307701+0000","last_became_active":"2024-09-12T00:36:37.238156+0000","last_became_peered":"2024-09-12T00:36:37.238156+0000","last_unstale":"2024-09-12T01:08:08.307701+0000","last_undegraded":"2024-09-12T01:08:08.307701+0000","last_fullsized":"2024-09-12T01:08:08.307701+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'24","last_scrub_stamp":"2024-09-12T01:08:08.307532+0000","last_deep_scrub":"267'24","last_deep_scrub_stamp":"2024-09-12T01:08:08.307532+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.307532+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.600072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":66,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:31.766760+0000","last_change":"2024-09-12T01:08:31.766760+0000","last_active":"2024-09-12T01:08:31.766760+0000","last_peered":"2024-09-12T01:08:31.766760+0000","last_clean":"2024-09-12T01:08:31.766760+0000","last_became_active":"2024-09-12T00:49:10.614006+0000","last_became_peered":"2024-09-12T00:49:10.614006+0000","last_unstale":"2024-09-12T01:08:31.766760+0000","last_undegraded":"2024-09-12T01:08:31.766760+0000","last_fullsized":"2024-09-12T01:08:31.766760+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:31.766538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:31.766538+0000","last_clean_scrub_stamp":"2024-09-12T01:08:31.766538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:49.677901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.233576+0000","last_change":"2024-09-12T01:08:18.233576+0000","last_active":"2024-09-12T01:08:18.233576+0000","last_peered":"2024-09-12T01:08:18.233576+0000","last_clean":"2024-09-12T01:08:18.233576+0000","last_became_active":"2024-09-12T00:38:10.691887+0000","last_became_peered":"2024-09-12T00:38:10.691887+0000","last_unstale":"2024-09-12T01:08:18.233576+0000","last_undegraded":"2024-09-12T01:08:18.233576+0000","last_fullsized":"2024-09-12T01:08:18.233576+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:18.233304+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:18.233304+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.233304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:20.304367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'8","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:31.308034+0000","last_change":"2024-09-12T01:08:31.307866+0000","last_active":"2024-09-12T01:08:31.308034+0000","last_peered":"2024-09-12T01:08:31.308034+0000","last_clean":"2024-09-12T01:08:31.308034+0000","last_became_active":"2024-09-12T00:38:07.653685+0000","last_became_peered":"2024-09-12T00:38:07.653685+0000","last_unstale":"2024-09-12T01:08:31.308034+0000","last_undegraded":"2024-09-12T01:08:31.308034+0000","last_fullsized":"2024-09-12T01:08:31.308034+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:31.307675+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:31.307675+0000","last_clean_scrub_stamp":"2024-09-12T01:08:31.307675+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:59.490732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.551191+0000","last_change":"2024-09-12T01:08:13.551191+0000","last_active":"2024-09-12T01:08:13.551191+0000","last_peered":"2024-09-12T01:08:13.551191+0000","last_clean":"2024-09-12T01:08:13.551191+0000","last_became_active":"2024-09-12T00:36:37.223860+0000","last_became_peered":"2024-09-12T00:36:37.223860+0000","last_unstale":"2024-09-12T01:08:13.551191+0000","last_undegraded":"2024-09-12T01:08:13.551191+0000","last_fullsized":"2024-09-12T01:08:13.551191+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.550870+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.550870+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.550870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:17.887059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":28,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.284481+0000","last_change":"2024-09-12T01:08:16.284481+0000","last_active":"2024-09-12T01:08:16.284481+0000","last_peered":"2024-09-12T01:08:16.284481+0000","last_clean":"2024-09-12T01:08:16.284481+0000","last_became_active":"2024-09-12T00:49:10.622347+0000","last_became_peered":"2024-09-12T00:49:10.622347+0000","last_unstale":"2024-09-12T01:08:16.284481+0000","last_undegraded":"2024-09-12T01:08:16.284481+0000","last_fullsized":"2024-09-12T01:08:16.284481+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:16.284295+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:16.284295+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.284295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:56.546582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:24.875442+0000","last_change":"2024-09-12T01:08:24.875300+0000","last_active":"2024-09-12T01:08:24.875442+0000","last_peered":"2024-09-12T01:08:24.875442+0000","last_clean":"2024-09-12T01:08:24.875442+0000","last_became_active":"2024-09-12T00:38:10.717358+0000","last_became_peered":"2024-09-12T00:38:10.717358+0000","last_unstale":"2024-09-12T01:08:24.875442+0000","last_undegraded":"2024-09-12T01:08:24.875442+0000","last_fullsized":"2024-09-12T01:08:24.875442+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:24.875110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:24.875110+0000","last_clean_scrub_stamp":"2024-09-12T01:08:24.875110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.635922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'3","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.010467+0000","last_change":"2024-09-12T01:07:56.010467+0000","last_active":"2024-09-12T01:07:56.010467+0000","last_peered":"2024-09-12T01:07:56.010467+0000","last_clean":"2024-09-12T01:07:56.010467+0000","last_became_active":"2024-09-12T00:38:07.638712+0000","last_became_peered":"2024-09-12T00:38:07.638712+0000","last_unstale":"2024-09-12T01:07:56.010467+0000","last_undegraded":"2024-09-12T01:07:56.010467+0000","last_fullsized":"2024-09-12T01:07:56.010467+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:07:56.010283+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:07:56.010283+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.010283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:12.789520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'20","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.549580+0000","last_change":"2024-09-12T01:08:12.549580+0000","last_active":"2024-09-12T01:08:12.549580+0000","last_peered":"2024-09-12T01:08:12.549580+0000","last_clean":"2024-09-12T01:08:12.549580+0000","last_became_active":"2024-09-12T00:36:37.223487+0000","last_became_peered":"2024-09-12T00:36:37.223487+0000","last_unstale":"2024-09-12T01:08:12.549580+0000","last_undegraded":"2024-09-12T01:08:12.549580+0000","last_fullsized":"2024-09-12T01:08:12.549580+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:08:12.549398+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:08:12.549398+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.549398+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:47.373141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":70,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.375609+0000","last_change":"2024-09-12T01:08:17.375609+0000","last_active":"2024-09-12T01:08:17.375609+0000","last_peered":"2024-09-12T01:08:17.375609+0000","last_clean":"2024-09-12T01:08:17.375609+0000","last_became_active":"2024-09-12T00:49:10.611251+0000","last_became_peered":"2024-09-12T00:49:10.611251+0000","last_unstale":"2024-09-12T01:08:17.375609+0000","last_undegraded":"2024-09-12T01:08:17.375609+0000","last_fullsized":"2024-09-12T01:08:17.375609+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:17.375407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:17.375407+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.375407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:09.598313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.265893+0000","last_change":"2024-09-12T01:08:19.265893+0000","last_active":"2024-09-12T01:08:19.265893+0000","last_peered":"2024-09-12T01:08:19.265893+0000","last_clean":"2024-09-12T01:08:19.265893+0000","last_became_active":"2024-09-12T00:38:10.706726+0000","last_became_peered":"2024-09-12T00:38:10.706726+0000","last_unstale":"2024-09-12T01:08:19.265893+0000","last_undegraded":"2024-09-12T01:08:19.265893+0000","last_fullsized":"2024-09-12T01:08:19.265893+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:19.265721+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:19.265721+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.265721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:40.746607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8240,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'4","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.310827+0000","last_change":"2024-09-12T01:08:10.310827+0000","last_active":"2024-09-12T01:08:10.310827+0000","last_peered":"2024-09-12T01:08:10.310827+0000","last_clean":"2024-09-12T01:08:10.310827+0000","last_became_active":"2024-09-12T00:38:07.667724+0000","last_became_peered":"2024-09-12T00:38:07.667724+0000","last_unstale":"2024-09-12T01:08:10.310827+0000","last_undegraded":"2024-09-12T01:08:10.310827+0000","last_fullsized":"2024-09-12T01:08:10.310827+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:10.310639+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:10.310639+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.310639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:33.973549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'49","reported_seq":187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.330682+0000","last_change":"2024-09-12T01:08:07.330682+0000","last_active":"2024-09-12T01:08:07.330682+0000","last_peered":"2024-09-12T01:08:07.330682+0000","last_clean":"2024-09-12T01:08:07.330682+0000","last_became_active":"2024-09-12T00:36:37.244259+0000","last_became_peered":"2024-09-12T00:36:37.244259+0000","last_unstale":"2024-09-12T01:08:07.330682+0000","last_undegraded":"2024-09-12T01:08:07.330682+0000","last_fullsized":"2024-09-12T01:08:07.330682+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'49","last_scrub_stamp":"2024-09-12T01:08:07.330420+0000","last_deep_scrub":"267'49","last_deep_scrub_stamp":"2024-09-12T01:08:07.330420+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.330420+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:12.111873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":182,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.058375+0000","last_change":"2024-09-12T01:08:08.058375+0000","last_active":"2024-09-12T01:08:08.058375+0000","last_peered":"2024-09-12T01:08:08.058375+0000","last_clean":"2024-09-12T01:08:08.058375+0000","last_became_active":"2024-09-12T00:49:10.629746+0000","last_became_peered":"2024-09-12T00:49:10.629746+0000","last_unstale":"2024-09-12T01:08:08.058375+0000","last_undegraded":"2024-09-12T01:08:08.058375+0000","last_fullsized":"2024-09-12T01:08:08.058375+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:08.058153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:08.058153+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.058153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:21.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.113806+0000","last_change":"2024-09-12T01:08:04.113806+0000","last_active":"2024-09-12T01:08:04.113806+0000","last_peered":"2024-09-12T01:08:04.113806+0000","last_clean":"2024-09-12T01:08:04.113806+0000","last_became_active":"2024-09-12T00:38:10.695688+0000","last_became_peered":"2024-09-12T00:38:10.695688+0000","last_unstale":"2024-09-12T01:08:04.113806+0000","last_undegraded":"2024-09-12T01:08:04.113806+0000","last_fullsized":"2024-09-12T01:08:04.113806+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:04.113621+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:04.113621+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.113621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:20.002680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.828851+0000","last_change":"2024-09-12T01:08:16.828851+0000","last_active":"2024-09-12T01:08:16.828851+0000","last_peered":"2024-09-12T01:08:16.828851+0000","last_clean":"2024-09-12T01:08:16.828851+0000","last_became_active":"2024-09-12T00:38:07.645284+0000","last_became_peered":"2024-09-12T00:38:07.645284+0000","last_unstale":"2024-09-12T01:08:16.828851+0000","last_undegraded":"2024-09-12T01:08:16.828851+0000","last_fullsized":"2024-09-12T01:08:16.828851+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:08:16.828659+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:08:16.828659+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.828659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:48.898582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'28","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:26.348237+0000","last_change":"2024-09-12T01:08:26.348237+0000","last_active":"2024-09-12T01:08:26.348237+0000","last_peered":"2024-09-12T01:08:26.348237+0000","last_clean":"2024-09-12T01:08:26.348237+0000","last_became_active":"2024-09-12T00:36:37.220195+0000","last_became_peered":"2024-09-12T00:36:37.220195+0000","last_unstale":"2024-09-12T01:08:26.348237+0000","last_undegraded":"2024-09-12T01:08:26.348237+0000","last_fullsized":"2024-09-12T01:08:26.348237+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T01:08:26.348022+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T01:08:26.348022+0000","last_clean_scrub_stamp":"2024-09-12T01:08:26.348022+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:32.153124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":108,"num_write":45,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.746075+0000","last_change":"2024-09-12T01:08:32.745861+0000","last_active":"2024-09-12T01:08:32.746075+0000","last_peered":"2024-09-12T01:08:32.746075+0000","last_clean":"2024-09-12T01:08:32.746075+0000","last_became_active":"2024-09-12T00:49:10.614661+0000","last_became_peered":"2024-09-12T00:49:10.614661+0000","last_unstale":"2024-09-12T01:08:32.746075+0000","last_undegraded":"2024-09-12T01:08:32.746075+0000","last_fullsized":"2024-09-12T01:08:32.746075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:32.745611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:32.745611+0000","last_clean_scrub_stamp":"2024-09-12T01:08:32.745611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:33.966846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'3","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.817683+0000","last_change":"2024-09-12T01:08:21.817532+0000","last_active":"2024-09-12T01:08:21.817683+0000","last_peered":"2024-09-12T01:08:21.817683+0000","last_clean":"2024-09-12T01:08:21.817683+0000","last_became_active":"2024-09-12T00:38:10.702260+0000","last_became_peered":"2024-09-12T00:38:10.702260+0000","last_unstale":"2024-09-12T01:08:21.817683+0000","last_undegraded":"2024-09-12T01:08:21.817683+0000","last_fullsized":"2024-09-12T01:08:21.817683+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:08:21.817351+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:08:21.817351+0000","last_clean_scrub_stamp":"2024-09-12T01:08:21.817351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:49.957008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'4","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.623838+0000","last_change":"2024-09-12T01:08:05.623671+0000","last_active":"2024-09-12T01:08:05.623838+0000","last_peered":"2024-09-12T01:08:05.623838+0000","last_clean":"2024-09-12T01:08:05.623838+0000","last_became_active":"2024-09-12T00:38:07.639687+0000","last_became_peered":"2024-09-12T00:38:07.639687+0000","last_unstale":"2024-09-12T01:08:05.623838+0000","last_undegraded":"2024-09-12T01:08:05.623838+0000","last_fullsized":"2024-09-12T01:08:05.623838+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:08:05.623473+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:08:05.623473+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.623473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:53.792955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'52","reported_seq":191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.375570+0000","last_change":"2024-09-12T01:08:25.375570+0000","last_active":"2024-09-12T01:08:25.375570+0000","last_peered":"2024-09-12T01:08:25.375570+0000","last_clean":"2024-09-12T01:08:25.375570+0000","last_became_active":"2024-09-12T00:36:37.239844+0000","last_became_peered":"2024-09-12T00:36:37.239844+0000","last_unstale":"2024-09-12T01:08:25.375570+0000","last_undegraded":"2024-09-12T01:08:25.375570+0000","last_fullsized":"2024-09-12T01:08:25.375570+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:08:25.375376+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:08:25.375376+0000","last_clean_scrub_stamp":"2024-09-12T01:08:25.375376+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:04.389145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":188,"num_write":97,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.261665+0000","last_change":"2024-09-12T01:08:19.261529+0000","last_active":"2024-09-12T01:08:19.261665+0000","last_peered":"2024-09-12T01:08:19.261665+0000","last_clean":"2024-09-12T01:08:19.261665+0000","last_became_active":"2024-09-12T00:49:10.632241+0000","last_became_peered":"2024-09-12T00:49:10.632241+0000","last_unstale":"2024-09-12T01:08:19.261665+0000","last_undegraded":"2024-09-12T01:08:19.261665+0000","last_fullsized":"2024-09-12T01:08:19.261665+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:19.261344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:19.261344+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.261344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.106696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"267'5","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.826973+0000","last_change":"2024-09-12T01:08:20.826792+0000","last_active":"2024-09-12T01:08:20.826973+0000","last_peered":"2024-09-12T01:08:20.826973+0000","last_clean":"2024-09-12T01:08:20.826973+0000","last_became_active":"2024-09-12T00:38:10.713890+0000","last_became_peered":"2024-09-12T00:38:10.713890+0000","last_unstale":"2024-09-12T01:08:20.826973+0000","last_undegraded":"2024-09-12T01:08:20.826973+0000","last_fullsized":"2024-09-12T01:08:20.826973+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:20.826603+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:20.826603+0000","last_clean_scrub_stamp":"2024-09-12T01:08:20.826603+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:35.486730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.830166+0000","last_change":"2024-09-12T01:08:15.830004+0000","last_active":"2024-09-12T01:08:15.830166+0000","last_peered":"2024-09-12T01:08:15.830166+0000","last_clean":"2024-09-12T01:08:15.830166+0000","last_became_active":"2024-09-12T00:38:07.667180+0000","last_became_peered":"2024-09-12T00:38:07.667180+0000","last_unstale":"2024-09-12T01:08:15.830166+0000","last_undegraded":"2024-09-12T01:08:15.830166+0000","last_fullsized":"2024-09-12T01:08:15.830166+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:08:15.829820+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:08:15.829820+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.829820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:05.011162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'23","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.339206+0000","last_change":"2024-09-12T01:08:04.339206+0000","last_active":"2024-09-12T01:08:04.339206+0000","last_peered":"2024-09-12T01:08:04.339206+0000","last_clean":"2024-09-12T01:08:04.339206+0000","last_became_active":"2024-09-12T00:36:37.248733+0000","last_became_peered":"2024-09-12T00:36:37.248733+0000","last_unstale":"2024-09-12T01:08:04.339206+0000","last_undegraded":"2024-09-12T01:08:04.339206+0000","last_fullsized":"2024-09-12T01:08:04.339206+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-12T01:08:04.339027+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-12T01:08:04.339027+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.339027+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.309511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.662121+0000","last_change":"2024-09-12T01:08:20.662121+0000","last_active":"2024-09-12T01:08:20.662121+0000","last_peered":"2024-09-12T01:08:20.662121+0000","last_clean":"2024-09-12T01:08:20.662121+0000","last_became_active":"2024-09-12T00:49:10.638628+0000","last_became_peered":"2024-09-12T00:49:10.638628+0000","last_unstale":"2024-09-12T01:08:20.662121+0000","last_undegraded":"2024-09-12T01:08:20.662121+0000","last_fullsized":"2024-09-12T01:08:20.662121+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:20.661885+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:20.661885+0000","last_clean_scrub_stamp":"2024-09-12T01:08:20.661885+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:56.860462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.251813+0000","last_change":"2024-09-12T01:08:17.251660+0000","last_active":"2024-09-12T01:08:17.251813+0000","last_peered":"2024-09-12T01:08:17.251813+0000","last_clean":"2024-09-12T01:08:17.251813+0000","last_became_active":"2024-09-12T00:38:10.691129+0000","last_became_peered":"2024-09-12T00:38:10.691129+0000","last_unstale":"2024-09-12T01:08:17.251813+0000","last_undegraded":"2024-09-12T01:08:17.251813+0000","last_fullsized":"2024-09-12T01:08:17.251813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:17.251475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:17.251475+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.251475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:26.577527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.610552+0000","last_change":"2024-09-12T01:08:10.610422+0000","last_active":"2024-09-12T01:08:10.610552+0000","last_peered":"2024-09-12T01:08:10.610552+0000","last_clean":"2024-09-12T01:08:10.610552+0000","last_became_active":"2024-09-12T00:38:07.641719+0000","last_became_peered":"2024-09-12T00:38:07.641719+0000","last_unstale":"2024-09-12T01:08:10.610552+0000","last_undegraded":"2024-09-12T01:08:10.610552+0000","last_fullsized":"2024-09-12T01:08:10.610552+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.610239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.610239+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.610239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:01.189388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'60","reported_seq":212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.108244+0000","last_change":"2024-09-12T01:08:04.108244+0000","last_active":"2024-09-12T01:08:04.108244+0000","last_peered":"2024-09-12T01:08:04.108244+0000","last_clean":"2024-09-12T01:08:04.108244+0000","last_became_active":"2024-09-12T00:36:37.223432+0000","last_became_peered":"2024-09-12T00:36:37.223432+0000","last_unstale":"2024-09-12T01:08:04.108244+0000","last_undegraded":"2024-09-12T01:08:04.108244+0000","last_fullsized":"2024-09-12T01:08:04.108244+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'60","last_scrub_stamp":"2024-09-12T01:08:04.107973+0000","last_deep_scrub":"267'60","last_deep_scrub_stamp":"2024-09-12T01:08:04.107973+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.107973+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:41.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":212,"num_write":101,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.273237+0000","last_change":"2024-09-12T01:08:17.273070+0000","last_active":"2024-09-12T01:08:17.273237+0000","last_peered":"2024-09-12T01:08:17.273237+0000","last_clean":"2024-09-12T01:08:17.273237+0000","last_became_active":"2024-09-12T00:49:10.634783+0000","last_became_peered":"2024-09-12T00:49:10.634783+0000","last_unstale":"2024-09-12T01:08:17.273237+0000","last_undegraded":"2024-09-12T01:08:17.273237+0000","last_fullsized":"2024-09-12T01:08:17.273237+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:17.272892+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:17.272892+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.272892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:31.183462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.405848+0000","last_change":"2024-09-12T01:08:35.405848+0000","last_active":"2024-09-12T01:08:35.405848+0000","last_peered":"2024-09-12T01:08:35.405848+0000","last_clean":"2024-09-12T01:08:35.405848+0000","last_became_active":"2024-09-12T00:38:10.708687+0000","last_became_peered":"2024-09-12T00:38:10.708687+0000","last_unstale":"2024-09-12T01:08:35.405848+0000","last_undegraded":"2024-09-12T01:08:35.405848+0000","last_fullsized":"2024-09-12T01:08:35.405848+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:35.405634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:35.405634+0000","last_clean_scrub_stamp":"2024-09-12T01:08:35.405634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:26.923744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.605027+0000","last_change":"2024-09-12T01:08:06.604898+0000","last_active":"2024-09-12T01:08:06.605027+0000","last_peered":"2024-09-12T01:08:06.605027+0000","last_clean":"2024-09-12T01:08:06.605027+0000","last_became_active":"2024-09-12T00:38:07.636298+0000","last_became_peered":"2024-09-12T00:38:07.636298+0000","last_unstale":"2024-09-12T01:08:06.605027+0000","last_undegraded":"2024-09-12T01:08:06.605027+0000","last_fullsized":"2024-09-12T01:08:06.605027+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.604708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.604708+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.604708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:16.801689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.370709+0000","last_change":"2024-09-12T01:08:02.370709+0000","last_active":"2024-09-12T01:08:02.370709+0000","last_peered":"2024-09-12T01:08:02.370709+0000","last_clean":"2024-09-12T01:08:02.370709+0000","last_became_active":"2024-09-12T00:36:37.248770+0000","last_became_peered":"2024-09-12T00:36:37.248770+0000","last_unstale":"2024-09-12T01:08:02.370709+0000","last_undegraded":"2024-09-12T01:08:02.370709+0000","last_fullsized":"2024-09-12T01:08:02.370709+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-12T01:08:02.370499+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-12T01:08:02.370499+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.370499+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:07.319315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":141,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:29.807310+0000","last_change":"2024-09-12T01:08:29.807174+0000","last_active":"2024-09-12T01:08:29.807310+0000","last_peered":"2024-09-12T01:08:29.807310+0000","last_clean":"2024-09-12T01:08:29.807310+0000","last_became_active":"2024-09-12T00:49:10.596695+0000","last_became_peered":"2024-09-12T00:49:10.596695+0000","last_unstale":"2024-09-12T01:08:29.807310+0000","last_undegraded":"2024-09-12T01:08:29.807310+0000","last_fullsized":"2024-09-12T01:08:29.807310+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:29.806987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:29.806987+0000","last_clean_scrub_stamp":"2024-09-12T01:08:29.806987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:07.573407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.274812+0000","last_change":"2024-09-12T01:08:14.274812+0000","last_active":"2024-09-12T01:08:14.274812+0000","last_peered":"2024-09-12T01:08:14.274812+0000","last_clean":"2024-09-12T01:08:14.274812+0000","last_became_active":"2024-09-12T00:38:10.683024+0000","last_became_peered":"2024-09-12T00:38:10.683024+0000","last_unstale":"2024-09-12T01:08:14.274812+0000","last_undegraded":"2024-09-12T01:08:14.274812+0000","last_fullsized":"2024-09-12T01:08:14.274812+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:14.274607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:14.274607+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.274607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:26.296110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.303906+0000","last_change":"2024-09-12T01:08:14.303906+0000","last_active":"2024-09-12T01:08:14.303906+0000","last_peered":"2024-09-12T01:08:14.303906+0000","last_clean":"2024-09-12T01:08:14.303906+0000","last_became_active":"2024-09-12T00:38:07.663265+0000","last_became_peered":"2024-09-12T00:38:07.663265+0000","last_unstale":"2024-09-12T01:08:14.303906+0000","last_undegraded":"2024-09-12T01:08:14.303906+0000","last_fullsized":"2024-09-12T01:08:14.303906+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:14.303710+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:14.303710+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.303710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:35.415473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'15","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.417051+0000","last_change":"2024-09-12T01:08:01.416913+0000","last_active":"2024-09-12T01:08:01.417051+0000","last_peered":"2024-09-12T01:08:01.417051+0000","last_clean":"2024-09-12T01:08:01.417051+0000","last_became_active":"2024-09-12T00:36:37.247409+0000","last_became_peered":"2024-09-12T00:36:37.247409+0000","last_unstale":"2024-09-12T01:08:01.417051+0000","last_undegraded":"2024-09-12T01:08:01.417051+0000","last_fullsized":"2024-09-12T01:08:01.417051+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T01:08:01.416734+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T01:08:01.416734+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.416734+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:53.049074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":52,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.591961+0000","last_change":"2024-09-12T01:08:11.591961+0000","last_active":"2024-09-12T01:08:11.591961+0000","last_peered":"2024-09-12T01:08:11.591961+0000","last_clean":"2024-09-12T01:08:11.591961+0000","last_became_active":"2024-09-12T00:49:10.593471+0000","last_became_peered":"2024-09-12T00:49:10.593471+0000","last_unstale":"2024-09-12T01:08:11.591961+0000","last_undegraded":"2024-09-12T01:08:11.591961+0000","last_fullsized":"2024-09-12T01:08:11.591961+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.591737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.591737+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.591737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:19.864450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"267'4","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.245530+0000","last_change":"2024-09-12T01:08:15.245530+0000","last_active":"2024-09-12T01:08:15.245530+0000","last_peered":"2024-09-12T01:08:15.245530+0000","last_clean":"2024-09-12T01:08:15.245530+0000","last_became_active":"2024-09-12T00:38:10.708936+0000","last_became_peered":"2024-09-12T00:38:10.708936+0000","last_unstale":"2024-09-12T01:08:15.245530+0000","last_undegraded":"2024-09-12T01:08:15.245530+0000","last_fullsized":"2024-09-12T01:08:15.245530+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:15.245305+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:15.245305+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.245305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:59.730371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'8","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.280620+0000","last_change":"2024-09-12T01:08:13.280620+0000","last_active":"2024-09-12T01:08:13.280620+0000","last_peered":"2024-09-12T01:08:13.280620+0000","last_clean":"2024-09-12T01:08:13.280620+0000","last_became_active":"2024-09-12T00:38:07.650419+0000","last_became_peered":"2024-09-12T00:38:07.650419+0000","last_unstale":"2024-09-12T01:08:13.280620+0000","last_undegraded":"2024-09-12T01:08:13.280620+0000","last_fullsized":"2024-09-12T01:08:13.280620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:08:13.280450+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:08:13.280450+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.280450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:22.910988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'99","reported_seq":362,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:24.395923+0000","last_change":"2024-09-12T01:08:24.395923+0000","last_active":"2024-09-12T01:08:24.395923+0000","last_peered":"2024-09-12T01:08:24.395923+0000","last_clean":"2024-09-12T01:08:24.395923+0000","last_became_active":"2024-09-12T00:36:37.225615+0000","last_became_peered":"2024-09-12T00:36:37.225615+0000","last_unstale":"2024-09-12T01:08:24.395923+0000","last_undegraded":"2024-09-12T01:08:24.395923+0000","last_fullsized":"2024-09-12T01:08:24.395923+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'99","last_scrub_stamp":"2024-09-12T01:08:24.395698+0000","last_deep_scrub":"267'99","last_deep_scrub_stamp":"2024-09-12T01:08:24.395698+0000","last_clean_scrub_stamp":"2024-09-12T01:08:24.395698+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:35.962824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":608,"num_read_kb":444,"num_write":119,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3472,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.375500+0000","last_change":"2024-09-12T01:08:39.375368+0000","last_active":"2024-09-12T01:08:39.375500+0000","last_peered":"2024-09-12T01:08:39.375500+0000","last_clean":"2024-09-12T01:08:39.375500+0000","last_became_active":"2024-09-12T00:49:10.620169+0000","last_became_peered":"2024-09-12T00:49:10.620169+0000","last_unstale":"2024-09-12T01:08:39.375500+0000","last_undegraded":"2024-09-12T01:08:39.375500+0000","last_fullsized":"2024-09-12T01:08:39.375500+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:39.375185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:39.375185+0000","last_clean_scrub_stamp":"2024-09-12T01:08:39.375185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:24.857649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.291688+0000","last_change":"2024-09-12T01:08:16.291688+0000","last_active":"2024-09-12T01:08:16.291688+0000","last_peered":"2024-09-12T01:08:16.291688+0000","last_clean":"2024-09-12T01:08:16.291688+0000","last_became_active":"2024-09-12T00:38:10.686216+0000","last_became_peered":"2024-09-12T00:38:10.686216+0000","last_unstale":"2024-09-12T01:08:16.291688+0000","last_undegraded":"2024-09-12T01:08:16.291688+0000","last_fullsized":"2024-09-12T01:08:16.291688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:08:16.291455+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:08:16.291455+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.291455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:28.941951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"267'4","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.326125+0000","last_change":"2024-09-12T01:08:09.326125+0000","last_active":"2024-09-12T01:08:09.326125+0000","last_peered":"2024-09-12T01:08:09.326125+0000","last_clean":"2024-09-12T01:08:09.326125+0000","last_became_active":"2024-09-12T00:38:07.661932+0000","last_became_peered":"2024-09-12T00:38:07.661932+0000","last_unstale":"2024-09-12T01:08:09.326125+0000","last_undegraded":"2024-09-12T01:08:09.326125+0000","last_fullsized":"2024-09-12T01:08:09.326125+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:09.325954+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:09.325954+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.325954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:53.038590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'12","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.612359+0000","last_change":"2024-09-12T01:08:03.612143+0000","last_active":"2024-09-12T01:08:03.612359+0000","last_peered":"2024-09-12T01:08:03.612359+0000","last_clean":"2024-09-12T01:08:03.612359+0000","last_became_active":"2024-09-12T00:36:37.226992+0000","last_became_peered":"2024-09-12T00:36:37.226992+0000","last_unstale":"2024-09-12T01:08:03.612359+0000","last_undegraded":"2024-09-12T01:08:03.612359+0000","last_fullsized":"2024-09-12T01:08:03.612359+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:03.611953+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:03.611953+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.611953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:17.131804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.578308+0000","last_change":"2024-09-12T01:08:09.578158+0000","last_active":"2024-09-12T01:08:09.578308+0000","last_peered":"2024-09-12T01:08:09.578308+0000","last_clean":"2024-09-12T01:08:09.578308+0000","last_became_active":"2024-09-12T00:49:10.597349+0000","last_became_peered":"2024-09-12T00:49:10.597349+0000","last_unstale":"2024-09-12T01:08:09.578308+0000","last_undegraded":"2024-09-12T01:08:09.578308+0000","last_fullsized":"2024-09-12T01:08:09.578308+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.577973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.577973+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.577973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:36.223547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"267'11","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.866269+0000","last_change":"2024-09-12T01:08:23.866269+0000","last_active":"2024-09-12T01:08:23.866269+0000","last_peered":"2024-09-12T01:08:23.866269+0000","last_clean":"2024-09-12T01:08:23.866269+0000","last_became_active":"2024-09-12T00:38:10.700892+0000","last_became_peered":"2024-09-12T00:38:10.700892+0000","last_unstale":"2024-09-12T01:08:23.866269+0000","last_undegraded":"2024-09-12T01:08:23.866269+0000","last_fullsized":"2024-09-12T01:08:23.866269+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-12T01:08:23.866078+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-12T01:08:23.866078+0000","last_clean_scrub_stamp":"2024-09-12T01:08:23.866078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:27.768157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":16,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.324475+0000","last_change":"2024-09-12T01:08:11.324475+0000","last_active":"2024-09-12T01:08:11.324475+0000","last_peered":"2024-09-12T01:08:11.324475+0000","last_clean":"2024-09-12T01:08:11.324475+0000","last_became_active":"2024-09-12T00:38:07.642924+0000","last_became_peered":"2024-09-12T00:38:07.642924+0000","last_unstale":"2024-09-12T01:08:11.324475+0000","last_undegraded":"2024-09-12T01:08:11.324475+0000","last_fullsized":"2024-09-12T01:08:11.324475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.324299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.324299+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.324299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:47.427053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'31","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.317274+0000","last_change":"2024-09-12T01:08:06.317033+0000","last_active":"2024-09-12T01:08:06.317274+0000","last_peered":"2024-09-12T01:08:06.317274+0000","last_clean":"2024-09-12T01:08:06.317274+0000","last_became_active":"2024-09-12T00:36:37.238481+0000","last_became_peered":"2024-09-12T00:36:37.238481+0000","last_unstale":"2024-09-12T01:08:06.317274+0000","last_undegraded":"2024-09-12T01:08:06.317274+0000","last_fullsized":"2024-09-12T01:08:06.317274+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'31","last_scrub_stamp":"2024-09-12T01:08:06.316765+0000","last_deep_scrub":"267'31","last_deep_scrub_stamp":"2024-09-12T01:08:06.316765+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.316765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:48.687142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":121,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.767774+0000","last_change":"2024-09-12T01:08:30.767774+0000","last_active":"2024-09-12T01:08:30.767774+0000","last_peered":"2024-09-12T01:08:30.767774+0000","last_clean":"2024-09-12T01:08:30.767774+0000","last_became_active":"2024-09-12T00:49:10.613613+0000","last_became_peered":"2024-09-12T00:49:10.613613+0000","last_unstale":"2024-09-12T01:08:30.767774+0000","last_undegraded":"2024-09-12T01:08:30.767774+0000","last_fullsized":"2024-09-12T01:08:30.767774+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:30.767592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:30.767592+0000","last_clean_scrub_stamp":"2024-09-12T01:08:30.767592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:43.060113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:37.414302+0000","last_change":"2024-09-12T01:08:37.414302+0000","last_active":"2024-09-12T01:08:37.414302+0000","last_peered":"2024-09-12T01:08:37.414302+0000","last_clean":"2024-09-12T01:08:37.414302+0000","last_became_active":"2024-09-12T00:38:10.694714+0000","last_became_peered":"2024-09-12T00:38:10.694714+0000","last_unstale":"2024-09-12T01:08:37.414302+0000","last_undegraded":"2024-09-12T01:08:37.414302+0000","last_fullsized":"2024-09-12T01:08:37.414302+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:37.414114+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:37.414114+0000","last_clean_scrub_stamp":"2024-09-12T01:08:37.414114+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:32.282182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.363934+0000","last_change":"2024-09-12T01:08:05.363751+0000","last_active":"2024-09-12T01:08:05.363934+0000","last_peered":"2024-09-12T01:08:05.363934+0000","last_clean":"2024-09-12T01:08:05.363934+0000","last_became_active":"2024-09-12T00:38:07.647225+0000","last_became_peered":"2024-09-12T00:38:07.647225+0000","last_unstale":"2024-09-12T01:08:05.363934+0000","last_undegraded":"2024-09-12T01:08:05.363934+0000","last_fullsized":"2024-09-12T01:08:05.363934+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:05.363578+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:05.363578+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.363578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:18.312235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.267524+0000","last_change":"2024-09-12T01:08:05.267395+0000","last_active":"2024-09-12T01:08:05.267524+0000","last_peered":"2024-09-12T01:08:05.267524+0000","last_clean":"2024-09-12T01:08:05.267524+0000","last_became_active":"2024-09-12T00:36:37.246075+0000","last_became_peered":"2024-09-12T00:36:37.246075+0000","last_unstale":"2024-09-12T01:08:05.267524+0000","last_undegraded":"2024-09-12T01:08:05.267524+0000","last_fullsized":"2024-09-12T01:08:05.267524+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:08:05.267221+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:08:05.267221+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.267221+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:18.024035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.319904+0000","last_change":"2024-09-12T01:08:15.319904+0000","last_active":"2024-09-12T01:08:15.319904+0000","last_peered":"2024-09-12T01:08:15.319904+0000","last_clean":"2024-09-12T01:08:15.319904+0000","last_became_active":"2024-09-12T00:49:10.597773+0000","last_became_peered":"2024-09-12T00:49:10.597773+0000","last_unstale":"2024-09-12T01:08:15.319904+0000","last_undegraded":"2024-09-12T01:08:15.319904+0000","last_fullsized":"2024-09-12T01:08:15.319904+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:15.319718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:15.319718+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.319718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:00.720579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.225378+0000","last_change":"2024-09-12T01:08:12.225131+0000","last_active":"2024-09-12T01:08:12.225378+0000","last_peered":"2024-09-12T01:08:12.225378+0000","last_clean":"2024-09-12T01:08:12.225378+0000","last_became_active":"2024-09-12T00:38:10.697403+0000","last_became_peered":"2024-09-12T00:38:10.697403+0000","last_unstale":"2024-09-12T01:08:12.225378+0000","last_undegraded":"2024-09-12T01:08:12.225378+0000","last_fullsized":"2024-09-12T01:08:12.225378+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:12.224908+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:12.224908+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.224908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:50.759178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.797700+0000","last_change":"2024-09-12T01:08:14.797433+0000","last_active":"2024-09-12T01:08:14.797700+0000","last_peered":"2024-09-12T01:08:14.797700+0000","last_clean":"2024-09-12T01:08:14.797700+0000","last_became_active":"2024-09-12T00:38:07.667447+0000","last_became_peered":"2024-09-12T00:38:07.667447+0000","last_unstale":"2024-09-12T01:08:14.797700+0000","last_undegraded":"2024-09-12T01:08:14.797700+0000","last_fullsized":"2024-09-12T01:08:14.797700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:14.797197+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:14.797197+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.797197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:24.172057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'28","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.094804+0000","last_change":"2024-09-12T01:08:03.094804+0000","last_active":"2024-09-12T01:08:03.094804+0000","last_peered":"2024-09-12T01:08:03.094804+0000","last_clean":"2024-09-12T01:08:03.094804+0000","last_became_active":"2024-09-12T00:36:37.239946+0000","last_became_peered":"2024-09-12T00:36:37.239946+0000","last_unstale":"2024-09-12T01:08:03.094804+0000","last_undegraded":"2024-09-12T01:08:03.094804+0000","last_fullsized":"2024-09-12T01:08:03.094804+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T01:08:03.094601+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T01:08:03.094601+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.094601+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:09.975343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.042174+0000","last_change":"2024-09-12T01:08:06.042174+0000","last_active":"2024-09-12T01:08:06.042174+0000","last_peered":"2024-09-12T01:08:06.042174+0000","last_clean":"2024-09-12T01:08:06.042174+0000","last_became_active":"2024-09-12T00:49:10.629903+0000","last_became_peered":"2024-09-12T00:49:10.629903+0000","last_unstale":"2024-09-12T01:08:06.042174+0000","last_undegraded":"2024-09-12T01:08:06.042174+0000","last_fullsized":"2024-09-12T01:08:06.042174+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:06.041988+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:06.041988+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.041988+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.998494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'2","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.327487+0000","last_change":"2024-09-12T01:08:15.327487+0000","last_active":"2024-09-12T01:08:15.327487+0000","last_peered":"2024-09-12T01:08:15.327487+0000","last_clean":"2024-09-12T01:08:15.327487+0000","last_became_active":"2024-09-12T00:38:10.708820+0000","last_became_peered":"2024-09-12T00:38:10.708820+0000","last_unstale":"2024-09-12T01:08:15.327487+0000","last_undegraded":"2024-09-12T01:08:15.327487+0000","last_fullsized":"2024-09-12T01:08:15.327487+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:15.327303+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:15.327303+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.327303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:52.502152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.291325+0000","last_change":"2024-09-12T01:08:08.291167+0000","last_active":"2024-09-12T01:08:08.291325+0000","last_peered":"2024-09-12T01:08:08.291325+0000","last_clean":"2024-09-12T01:08:08.291325+0000","last_became_active":"2024-09-12T00:38:07.644752+0000","last_became_peered":"2024-09-12T00:38:07.644752+0000","last_unstale":"2024-09-12T01:08:08.291325+0000","last_undegraded":"2024-09-12T01:08:08.291325+0000","last_fullsized":"2024-09-12T01:08:08.291325+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:08.290956+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:08.290956+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.290956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:17.143413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"267'56","reported_seq":210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.846557+0000","last_change":"2024-09-12T01:08:12.846557+0000","last_active":"2024-09-12T01:08:12.846557+0000","last_peered":"2024-09-12T01:08:12.846557+0000","last_clean":"2024-09-12T01:08:12.846557+0000","last_became_active":"2024-09-12T00:36:37.246402+0000","last_became_peered":"2024-09-12T00:36:37.246402+0000","last_unstale":"2024-09-12T01:08:12.846557+0000","last_undegraded":"2024-09-12T01:08:12.846557+0000","last_fullsized":"2024-09-12T01:08:12.846557+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'56","last_scrub_stamp":"2024-09-12T01:08:12.846373+0000","last_deep_scrub":"267'56","last_deep_scrub_stamp":"2024-09-12T01:08:12.846373+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.846373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:19.960581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":211,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.198545+0000","last_change":"2024-09-12T01:08:21.198545+0000","last_active":"2024-09-12T01:08:21.198545+0000","last_peered":"2024-09-12T01:08:21.198545+0000","last_clean":"2024-09-12T01:08:21.198545+0000","last_became_active":"2024-09-12T00:49:10.626918+0000","last_became_peered":"2024-09-12T00:49:10.626918+0000","last_unstale":"2024-09-12T01:08:21.198545+0000","last_undegraded":"2024-09-12T01:08:21.198545+0000","last_fullsized":"2024-09-12T01:08:21.198545+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:21.198353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:21.198353+0000","last_clean_scrub_stamp":"2024-09-12T01:08:21.198353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:47.837715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"267'7","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.080310+0000","last_change":"2024-09-12T01:08:03.080034+0000","last_active":"2024-09-12T01:08:03.080310+0000","last_peered":"2024-09-12T01:08:03.080310+0000","last_clean":"2024-09-12T01:08:03.080310+0000","last_became_active":"2024-09-12T00:38:10.705817+0000","last_became_peered":"2024-09-12T00:38:10.705817+0000","last_unstale":"2024-09-12T01:08:03.080310+0000","last_undegraded":"2024-09-12T01:08:03.080310+0000","last_fullsized":"2024-09-12T01:08:03.080310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:03.079826+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:03.079826+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.079826+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:27.973354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.271411+0000","last_change":"2024-09-12T01:08:30.271411+0000","last_active":"2024-09-12T01:08:30.271411+0000","last_peered":"2024-09-12T01:08:30.271411+0000","last_clean":"2024-09-12T01:08:30.271411+0000","last_became_active":"2024-09-12T00:38:07.654306+0000","last_became_peered":"2024-09-12T00:38:07.654306+0000","last_unstale":"2024-09-12T01:08:30.271411+0000","last_undegraded":"2024-09-12T01:08:30.271411+0000","last_fullsized":"2024-09-12T01:08:30.271411+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:30.271194+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:30.271194+0000","last_clean_scrub_stamp":"2024-09-12T01:08:30.271194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:51.280793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"267'61","reported_seq":258,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.035695+0000","last_change":"2024-09-12T01:08:00.035695+0000","last_active":"2024-09-12T01:08:00.035695+0000","last_peered":"2024-09-12T01:08:00.035695+0000","last_clean":"2024-09-12T01:08:00.035695+0000","last_became_active":"2024-09-12T00:36:37.226845+0000","last_became_peered":"2024-09-12T00:36:37.226845+0000","last_unstale":"2024-09-12T01:08:00.035695+0000","last_undegraded":"2024-09-12T01:08:00.035695+0000","last_fullsized":"2024-09-12T01:08:00.035695+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'61","last_scrub_stamp":"2024-09-12T01:08:00.035462+0000","last_deep_scrub":"267'61","last_deep_scrub_stamp":"2024-09-12T01:08:00.035462+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.035462+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:09.421929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":408,"num_read_kb":294,"num_write":66,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3514,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.076548+0000","last_change":"2024-09-12T01:08:05.076548+0000","last_active":"2024-09-12T01:08:05.076548+0000","last_peered":"2024-09-12T01:08:05.076548+0000","last_clean":"2024-09-12T01:08:05.076548+0000","last_became_active":"2024-09-12T00:49:10.615566+0000","last_became_peered":"2024-09-12T00:49:10.615566+0000","last_unstale":"2024-09-12T01:08:05.076548+0000","last_undegraded":"2024-09-12T01:08:05.076548+0000","last_fullsized":"2024-09-12T01:08:05.076548+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:05.076371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:05.076371+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.076371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:05.804297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'7","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.817802+0000","last_change":"2024-09-12T01:08:22.817802+0000","last_active":"2024-09-12T01:08:22.817802+0000","last_peered":"2024-09-12T01:08:22.817802+0000","last_clean":"2024-09-12T01:08:22.817802+0000","last_became_active":"2024-09-12T00:38:10.705207+0000","last_became_peered":"2024-09-12T00:38:10.705207+0000","last_unstale":"2024-09-12T01:08:22.817802+0000","last_undegraded":"2024-09-12T01:08:22.817802+0000","last_fullsized":"2024-09-12T01:08:22.817802+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:22.817620+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:22.817620+0000","last_clean_scrub_stamp":"2024-09-12T01:08:22.817620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:35.109448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'11","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.311629+0000","last_change":"2024-09-12T01:08:27.311629+0000","last_active":"2024-09-12T01:08:27.311629+0000","last_peered":"2024-09-12T01:08:27.311629+0000","last_clean":"2024-09-12T01:08:27.311629+0000","last_became_active":"2024-09-12T00:38:07.663031+0000","last_became_peered":"2024-09-12T00:38:07.663031+0000","last_unstale":"2024-09-12T01:08:27.311629+0000","last_undegraded":"2024-09-12T01:08:27.311629+0000","last_fullsized":"2024-09-12T01:08:27.311629+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-12T01:08:27.311376+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-12T01:08:27.311376+0000","last_clean_scrub_stamp":"2024-09-12T01:08:27.311376+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:33.969449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24578,"num_write":26,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'40","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.500368+0000","last_change":"2024-09-12T01:08:11.500368+0000","last_active":"2024-09-12T01:08:11.500368+0000","last_peered":"2024-09-12T01:08:11.500368+0000","last_clean":"2024-09-12T01:08:11.500368+0000","last_became_active":"2024-09-12T00:36:37.250649+0000","last_became_peered":"2024-09-12T00:36:37.250649+0000","last_unstale":"2024-09-12T01:08:11.500368+0000","last_undegraded":"2024-09-12T01:08:11.500368+0000","last_fullsized":"2024-09-12T01:08:11.500368+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:11.500148+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:11.500148+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.500148+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:48.043569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":70,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.064333+0000","last_change":"2024-09-12T01:08:07.064333+0000","last_active":"2024-09-12T01:08:07.064333+0000","last_peered":"2024-09-12T01:08:07.064333+0000","last_clean":"2024-09-12T01:08:07.064333+0000","last_became_active":"2024-09-12T00:49:10.634433+0000","last_became_peered":"2024-09-12T00:49:10.634433+0000","last_unstale":"2024-09-12T01:08:07.064333+0000","last_undegraded":"2024-09-12T01:08:07.064333+0000","last_fullsized":"2024-09-12T01:08:07.064333+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:07.064155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:07.064155+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.064155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.708114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.789378+0000","last_change":"2024-09-12T01:08:18.789378+0000","last_active":"2024-09-12T01:08:18.789378+0000","last_peered":"2024-09-12T01:08:18.789378+0000","last_clean":"2024-09-12T01:08:18.789378+0000","last_became_active":"2024-09-12T00:38:10.717307+0000","last_became_peered":"2024-09-12T00:38:10.717307+0000","last_unstale":"2024-09-12T01:08:18.789378+0000","last_undegraded":"2024-09-12T01:08:18.789378+0000","last_fullsized":"2024-09-12T01:08:18.789378+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:08:18.789203+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:08:18.789203+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.789203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:30.848964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'10","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.602352+0000","last_change":"2024-09-12T01:08:16.602352+0000","last_active":"2024-09-12T01:08:16.602352+0000","last_peered":"2024-09-12T01:08:16.602352+0000","last_clean":"2024-09-12T01:08:16.602352+0000","last_became_active":"2024-09-12T00:38:07.659692+0000","last_became_peered":"2024-09-12T00:38:07.659692+0000","last_unstale":"2024-09-12T01:08:16.602352+0000","last_undegraded":"2024-09-12T01:08:16.602352+0000","last_fullsized":"2024-09-12T01:08:16.602352+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T01:08:16.602022+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T01:08:16.602022+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.602022+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:02.350594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'22","reported_seq":108,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.362883+0000","last_change":"2024-09-12T01:08:23.362883+0000","last_active":"2024-09-12T01:08:23.362883+0000","last_peered":"2024-09-12T01:08:23.362883+0000","last_clean":"2024-09-12T01:08:23.362883+0000","last_became_active":"2024-09-12T00:36:37.226892+0000","last_became_peered":"2024-09-12T00:36:37.226892+0000","last_unstale":"2024-09-12T01:08:23.362883+0000","last_undegraded":"2024-09-12T01:08:23.362883+0000","last_fullsized":"2024-09-12T01:08:23.362883+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-12T01:08:23.362693+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-12T01:08:23.362693+0000","last_clean_scrub_stamp":"2024-09-12T01:08:23.362693+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:41.341127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64,"num_write":52,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.835177+0000","last_change":"2024-09-12T01:08:27.835177+0000","last_active":"2024-09-12T01:08:27.835177+0000","last_peered":"2024-09-12T01:08:27.835177+0000","last_clean":"2024-09-12T01:08:27.835177+0000","last_became_active":"2024-09-12T00:49:10.631961+0000","last_became_peered":"2024-09-12T00:49:10.631961+0000","last_unstale":"2024-09-12T01:08:27.835177+0000","last_undegraded":"2024-09-12T01:08:27.835177+0000","last_fullsized":"2024-09-12T01:08:27.835177+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:27.834987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:27.834987+0000","last_clean_scrub_stamp":"2024-09-12T01:08:27.834987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:01.551634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'2","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.023244+0000","last_change":"2024-09-12T01:07:59.023173+0000","last_active":"2024-09-12T01:07:59.023244+0000","last_peered":"2024-09-12T01:07:59.023244+0000","last_clean":"2024-09-12T01:07:59.023244+0000","last_became_active":"2024-09-12T00:38:10.719337+0000","last_became_peered":"2024-09-12T00:38:10.719337+0000","last_unstale":"2024-09-12T01:07:59.023244+0000","last_undegraded":"2024-09-12T01:07:59.023244+0000","last_fullsized":"2024-09-12T01:07:59.023244+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:59.023072+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:59.023072+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.023072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:23.472503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"267'7","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.145798+0000","last_change":"2024-09-12T01:08:07.145572+0000","last_active":"2024-09-12T01:08:07.145798+0000","last_peered":"2024-09-12T01:08:07.145798+0000","last_clean":"2024-09-12T01:08:07.145798+0000","last_became_active":"2024-09-12T00:38:07.639751+0000","last_became_peered":"2024-09-12T00:38:07.639751+0000","last_unstale":"2024-09-12T01:08:07.145798+0000","last_undegraded":"2024-09-12T01:08:07.145798+0000","last_fullsized":"2024-09-12T01:08:07.145798+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:08:07.145408+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:08:07.145408+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.145408+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:59.224526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'40","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.098655+0000","last_change":"2024-09-12T01:08:06.098655+0000","last_active":"2024-09-12T01:08:06.098655+0000","last_peered":"2024-09-12T01:08:06.098655+0000","last_clean":"2024-09-12T01:08:06.098655+0000","last_became_active":"2024-09-12T00:36:37.248176+0000","last_became_peered":"2024-09-12T00:36:37.248176+0000","last_unstale":"2024-09-12T01:08:06.098655+0000","last_undegraded":"2024-09-12T01:08:06.098655+0000","last_fullsized":"2024-09-12T01:08:06.098655+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-09-12T01:08:06.098449+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-09-12T01:08:06.098449+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.098449+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:34.464246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.419007+0000","last_change":"2024-09-12T01:08:40.419007+0000","last_active":"2024-09-12T01:08:40.419007+0000","last_peered":"2024-09-12T01:08:40.419007+0000","last_clean":"2024-09-12T01:08:40.419007+0000","last_became_active":"2024-09-12T00:49:10.634965+0000","last_became_peered":"2024-09-12T00:49:10.634965+0000","last_unstale":"2024-09-12T01:08:40.419007+0000","last_undegraded":"2024-09-12T01:08:40.419007+0000","last_fullsized":"2024-09-12T01:08:40.419007+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:40.418722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:40.418722+0000","last_clean_scrub_stamp":"2024-09-12T01:08:40.418722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:27.627827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:34.392279+0000","last_change":"2024-09-12T01:08:34.391970+0000","last_active":"2024-09-12T01:08:34.392279+0000","last_peered":"2024-09-12T01:08:34.392279+0000","last_clean":"2024-09-12T01:08:34.392279+0000","last_became_active":"2024-09-12T00:38:10.694812+0000","last_became_peered":"2024-09-12T00:38:10.694812+0000","last_unstale":"2024-09-12T01:08:34.392279+0000","last_undegraded":"2024-09-12T01:08:34.392279+0000","last_fullsized":"2024-09-12T01:08:34.392279+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:34.391746+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:34.391746+0000","last_clean_scrub_stamp":"2024-09-12T01:08:34.391746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:35.499750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'6","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:29.296070+0000","last_change":"2024-09-12T01:08:29.295932+0000","last_active":"2024-09-12T01:08:29.296070+0000","last_peered":"2024-09-12T01:08:29.296070+0000","last_clean":"2024-09-12T01:08:29.296070+0000","last_became_active":"2024-09-12T00:38:07.648061+0000","last_became_peered":"2024-09-12T00:38:07.648061+0000","last_unstale":"2024-09-12T01:08:29.296070+0000","last_undegraded":"2024-09-12T01:08:29.296070+0000","last_fullsized":"2024-09-12T01:08:29.296070+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:29.295749+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:29.295749+0000","last_clean_scrub_stamp":"2024-09-12T01:08:29.295749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:26.117594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'35","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.335923+0000","last_change":"2024-09-12T01:08:03.335923+0000","last_active":"2024-09-12T01:08:03.335923+0000","last_peered":"2024-09-12T01:08:03.335923+0000","last_clean":"2024-09-12T01:08:03.335923+0000","last_became_active":"2024-09-12T00:36:37.244096+0000","last_became_peered":"2024-09-12T00:36:37.244096+0000","last_unstale":"2024-09-12T01:08:03.335923+0000","last_undegraded":"2024-09-12T01:08:03.335923+0000","last_fullsized":"2024-09-12T01:08:03.335923+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'35","last_scrub_stamp":"2024-09-12T01:08:03.335738+0000","last_deep_scrub":"267'35","last_deep_scrub_stamp":"2024-09-12T01:08:03.335738+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.335738+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:24.722385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":53,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.217461+0000","last_change":"2024-09-12T01:08:22.217320+0000","last_active":"2024-09-12T01:08:22.217461+0000","last_peered":"2024-09-12T01:08:22.217461+0000","last_clean":"2024-09-12T01:08:22.217461+0000","last_became_active":"2024-09-12T00:49:10.621968+0000","last_became_peered":"2024-09-12T00:49:10.621968+0000","last_unstale":"2024-09-12T01:08:22.217461+0000","last_undegraded":"2024-09-12T01:08:22.217461+0000","last_fullsized":"2024-09-12T01:08:22.217461+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:08:22.217119+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:08:22.217119+0000","last_clean_scrub_stamp":"2024-09-12T01:08:22.217119+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:55.399438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.576025+0000","last_change":"2024-09-12T01:08:17.576025+0000","last_active":"2024-09-12T01:08:17.576025+0000","last_peered":"2024-09-12T01:08:17.576025+0000","last_clean":"2024-09-12T01:08:17.576025+0000","last_became_active":"2024-09-12T00:38:10.717877+0000","last_became_peered":"2024-09-12T00:38:10.717877+0000","last_unstale":"2024-09-12T01:08:17.576025+0000","last_undegraded":"2024-09-12T01:08:17.576025+0000","last_fullsized":"2024-09-12T01:08:17.576025+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:17.575808+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:17.575808+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.575808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:29.432969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"267'5","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.185626+0000","last_change":"2024-09-12T01:08:08.185367+0000","last_active":"2024-09-12T01:08:08.185626+0000","last_peered":"2024-09-12T01:08:08.185626+0000","last_clean":"2024-09-12T01:08:08.185626+0000","last_became_active":"2024-09-12T00:38:07.648786+0000","last_became_peered":"2024-09-12T00:38:07.648786+0000","last_unstale":"2024-09-12T01:08:08.185626+0000","last_undegraded":"2024-09-12T01:08:08.185626+0000","last_fullsized":"2024-09-12T01:08:08.185626+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:08:08.185073+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:08:08.185073+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.185073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.827185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.142583+0000","last_change":"2024-09-12T01:08:02.142583+0000","last_active":"2024-09-12T01:08:02.142583+0000","last_peered":"2024-09-12T01:08:02.142583+0000","last_clean":"2024-09-12T01:08:02.142583+0000","last_became_active":"2024-09-12T00:36:37.237365+0000","last_became_peered":"2024-09-12T00:36:37.237365+0000","last_unstale":"2024-09-12T01:08:02.142583+0000","last_undegraded":"2024-09-12T01:08:02.142583+0000","last_fullsized":"2024-09-12T01:08:02.142583+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:08:02.142397+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:08:02.142397+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.142397+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:21.499061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":152,"num_write":73,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.602850+0000","last_change":"2024-09-12T01:08:18.602706+0000","last_active":"2024-09-12T01:08:18.602850+0000","last_peered":"2024-09-12T01:08:18.602850+0000","last_clean":"2024-09-12T01:08:18.602850+0000","last_became_active":"2024-09-12T00:49:10.628111+0000","last_became_peered":"2024-09-12T00:49:10.628111+0000","last_unstale":"2024-09-12T01:08:18.602850+0000","last_undegraded":"2024-09-12T01:08:18.602850+0000","last_fullsized":"2024-09-12T01:08:18.602850+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:18.602501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:18.602501+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.602501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:48.858373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'6","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.345291+0000","last_change":"2024-09-12T01:08:33.345291+0000","last_active":"2024-09-12T01:08:33.345291+0000","last_peered":"2024-09-12T01:08:33.345291+0000","last_clean":"2024-09-12T01:08:33.345291+0000","last_became_active":"2024-09-12T00:38:10.696553+0000","last_became_peered":"2024-09-12T00:38:10.696553+0000","last_unstale":"2024-09-12T01:08:33.345291+0000","last_undegraded":"2024-09-12T01:08:33.345291+0000","last_fullsized":"2024-09-12T01:08:33.345291+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:33.345098+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:33.345098+0000","last_clean_scrub_stamp":"2024-09-12T01:08:33.345098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:57.508560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3168,"num_write":6,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'4","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.292631+0000","last_change":"2024-09-12T01:08:28.292631+0000","last_active":"2024-09-12T01:08:28.292631+0000","last_peered":"2024-09-12T01:08:28.292631+0000","last_clean":"2024-09-12T01:08:28.292631+0000","last_became_active":"2024-09-12T00:38:07.669959+0000","last_became_peered":"2024-09-12T00:38:07.669959+0000","last_unstale":"2024-09-12T01:08:28.292631+0000","last_undegraded":"2024-09-12T01:08:28.292631+0000","last_fullsized":"2024-09-12T01:08:28.292631+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:08:28.292443+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:08:28.292443+0000","last_clean_scrub_stamp":"2024-09-12T01:08:28.292443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:56.211509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.378248+0000","last_change":"2024-09-12T01:08:22.378248+0000","last_active":"2024-09-12T01:08:22.378248+0000","last_peered":"2024-09-12T01:08:22.378248+0000","last_clean":"2024-09-12T01:08:22.378248+0000","last_became_active":"2024-09-12T00:36:37.228954+0000","last_became_peered":"2024-09-12T00:36:37.228954+0000","last_unstale":"2024-09-12T01:08:22.378248+0000","last_undegraded":"2024-09-12T01:08:22.378248+0000","last_fullsized":"2024-09-12T01:08:22.378248+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:08:22.378066+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:08:22.378066+0000","last_clean_scrub_stamp":"2024-09-12T01:08:22.378066+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:20.109800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.788884+0000","last_change":"2024-09-12T01:08:28.788884+0000","last_active":"2024-09-12T01:08:28.788884+0000","last_peered":"2024-09-12T01:08:28.788884+0000","last_clean":"2024-09-12T01:08:28.788884+0000","last_became_active":"2024-09-12T00:49:10.592753+0000","last_became_peered":"2024-09-12T00:49:10.592753+0000","last_unstale":"2024-09-12T01:08:28.788884+0000","last_undegraded":"2024-09-12T01:08:28.788884+0000","last_fullsized":"2024-09-12T01:08:28.788884+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:28.788703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:28.788703+0000","last_clean_scrub_stamp":"2024-09-12T01:08:28.788703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:54.195605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.161156+0000","last_change":"2024-09-12T01:08:10.161156+0000","last_active":"2024-09-12T01:08:10.161156+0000","last_peered":"2024-09-12T01:08:10.161156+0000","last_clean":"2024-09-12T01:08:10.161156+0000","last_became_active":"2024-09-12T00:38:10.702958+0000","last_became_peered":"2024-09-12T00:38:10.702958+0000","last_unstale":"2024-09-12T01:08:10.161156+0000","last_undegraded":"2024-09-12T01:08:10.161156+0000","last_fullsized":"2024-09-12T01:08:10.161156+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:10.160971+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:10.160971+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.160971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:00.071414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"264'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.262437+0000","last_change":"2024-09-12T01:08:12.262437+0000","last_active":"2024-09-12T01:08:12.262437+0000","last_peered":"2024-09-12T01:08:12.262437+0000","last_clean":"2024-09-12T01:08:12.262437+0000","last_became_active":"2024-09-12T00:38:07.650035+0000","last_became_peered":"2024-09-12T00:38:07.650035+0000","last_unstale":"2024-09-12T01:08:12.262437+0000","last_undegraded":"2024-09-12T01:08:12.262437+0000","last_fullsized":"2024-09-12T01:08:12.262437+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:08:12.262216+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:08:12.262216+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.262216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:23.548955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"258'11","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.254471+0000","last_change":"2024-09-12T01:08:14.254471+0000","last_active":"2024-09-12T01:08:14.254471+0000","last_peered":"2024-09-12T01:08:14.254471+0000","last_clean":"2024-09-12T01:08:14.254471+0000","last_became_active":"2024-09-12T00:36:37.222545+0000","last_became_peered":"2024-09-12T00:36:37.222545+0000","last_unstale":"2024-09-12T01:08:14.254471+0000","last_undegraded":"2024-09-12T01:08:14.254471+0000","last_fullsized":"2024-09-12T01:08:14.254471+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'11","last_scrub_stamp":"2024-09-12T01:08:14.254273+0000","last_deep_scrub":"258'11","last_deep_scrub_stamp":"2024-09-12T01:08:14.254273+0000","last_clean_scrub_stamp":"2024-09-12T01:08:14.254273+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:01.432581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.421066+0000","last_change":"2024-09-12T01:08:38.421066+0000","last_active":"2024-09-12T01:08:38.421066+0000","last_peered":"2024-09-12T01:08:38.421066+0000","last_clean":"2024-09-12T01:08:38.421066+0000","last_became_active":"2024-09-12T00:49:10.612680+0000","last_became_peered":"2024-09-12T00:49:10.612680+0000","last_unstale":"2024-09-12T01:08:38.421066+0000","last_undegraded":"2024-09-12T01:08:38.421066+0000","last_fullsized":"2024-09-12T01:08:38.421066+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:38.420876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:38.420876+0000","last_clean_scrub_stamp":"2024-09-12T01:08:38.420876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:27.149401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.196800+0000","last_change":"2024-09-12T01:08:09.196800+0000","last_active":"2024-09-12T01:08:09.196800+0000","last_peered":"2024-09-12T01:08:09.196800+0000","last_clean":"2024-09-12T01:08:09.196800+0000","last_became_active":"2024-09-12T00:38:10.691107+0000","last_became_peered":"2024-09-12T00:38:10.691107+0000","last_unstale":"2024-09-12T01:08:09.196800+0000","last_undegraded":"2024-09-12T01:08:09.196800+0000","last_fullsized":"2024-09-12T01:08:09.196800+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:09.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:09.196531+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:20.537195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"267'6","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.625085+0000","last_change":"2024-09-12T01:08:04.625085+0000","last_active":"2024-09-12T01:08:04.625085+0000","last_peered":"2024-09-12T01:08:04.625085+0000","last_clean":"2024-09-12T01:08:04.625085+0000","last_became_active":"2024-09-12T00:38:07.657155+0000","last_became_peered":"2024-09-12T00:38:07.657155+0000","last_unstale":"2024-09-12T01:08:04.625085+0000","last_undegraded":"2024-09-12T01:08:04.625085+0000","last_fullsized":"2024-09-12T01:08:04.625085+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:08:04.624891+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:08:04.624891+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:59.672369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"267'20","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.165954+0000","last_change":"2024-09-12T01:08:01.165704+0000","last_active":"2024-09-12T01:08:01.165954+0000","last_peered":"2024-09-12T01:08:01.165954+0000","last_clean":"2024-09-12T01:08:01.165954+0000","last_became_active":"2024-09-12T00:36:37.221980+0000","last_became_peered":"2024-09-12T00:36:37.221980+0000","last_unstale":"2024-09-12T01:08:01.165954+0000","last_undegraded":"2024-09-12T01:08:01.165954+0000","last_fullsized":"2024-09-12T01:08:01.165954+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:08:01.165485+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:08:01.165485+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.165485+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:34.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'360","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.018639+0000","last_change":"2024-09-12T01:07:43.018639+0000","last_active":"2024-09-12T01:07:43.018639+0000","last_peered":"2024-09-12T01:07:43.018639+0000","last_clean":"2024-09-12T01:07:43.018639+0000","last_became_active":"2024-09-12T00:21:42.528236+0000","last_became_peered":"2024-09-12T00:21:42.528236+0000","last_unstale":"2024-09-12T01:07:43.018639+0000","last_undegraded":"2024-09-12T01:07:43.018639+0000","last_fullsized":"2024-09-12T01:07:43.018639+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'360","last_scrub_stamp":"2024-09-12T01:07:43.018341+0000","last_deep_scrub":"267'360","last_deep_scrub_stamp":"2024-09-12T01:07:43.018341+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.018341+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:20.272306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812630,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":8804,"num_write":1192,"num_write_kb":22191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'52","reported_seq":612,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.538350+0000","last_change":"2024-09-12T01:07:45.538350+0000","last_active":"2024-09-12T01:07:45.538350+0000","last_peered":"2024-09-12T01:07:45.538350+0000","last_clean":"2024-09-12T01:07:45.538350+0000","last_became_active":"2024-09-12T00:21:44.499494+0000","last_became_peered":"2024-09-12T00:21:44.499494+0000","last_unstale":"2024-09-12T01:07:45.538350+0000","last_undegraded":"2024-09-12T01:07:45.538350+0000","last_fullsized":"2024-09-12T01:07:45.538350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:07:45.538159+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:07:45.538159+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.538159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:29.457414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":187,"num_write":87,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'464","reported_seq":1151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.037595+0000","last_change":"2024-09-12T01:07:48.037595+0000","last_active":"2024-09-12T01:07:48.037595+0000","last_peered":"2024-09-12T01:07:48.037595+0000","last_clean":"2024-09-12T01:07:48.037595+0000","last_became_active":"2024-09-12T00:21:42.511901+0000","last_became_peered":"2024-09-12T00:21:42.511901+0000","last_unstale":"2024-09-12T01:07:48.037595+0000","last_undegraded":"2024-09-12T01:07:48.037595+0000","last_fullsized":"2024-09-12T01:07:48.037595+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'464","last_scrub_stamp":"2024-09-12T01:07:48.037389+0000","last_deep_scrub":"267'464","last_deep_scrub_stamp":"2024-09-12T01:07:48.037389+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.037389+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:29.223858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759316,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":14453,"num_write":1384,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'102","reported_seq":669,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.917935+0000","last_change":"2024-09-12T01:07:51.917935+0000","last_active":"2024-09-12T01:07:51.917935+0000","last_peered":"2024-09-12T01:07:51.917935+0000","last_clean":"2024-09-12T01:07:51.917935+0000","last_became_active":"2024-09-12T00:21:44.498503+0000","last_became_peered":"2024-09-12T00:21:44.498503+0000","last_unstale":"2024-09-12T01:07:51.917935+0000","last_undegraded":"2024-09-12T01:07:51.917935+0000","last_fullsized":"2024-09-12T01:07:51.917935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:51.917714+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:51.917714+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.917714+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:34.326748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":343,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'310","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.047030+0000","last_change":"2024-09-12T01:07:47.047030+0000","last_active":"2024-09-12T01:07:47.047030+0000","last_peered":"2024-09-12T01:07:47.047030+0000","last_clean":"2024-09-12T01:07:47.047030+0000","last_became_active":"2024-09-12T00:21:42.535071+0000","last_became_peered":"2024-09-12T00:21:42.535071+0000","last_unstale":"2024-09-12T01:07:47.047030+0000","last_undegraded":"2024-09-12T01:07:47.047030+0000","last_fullsized":"2024-09-12T01:07:47.047030+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'310","last_scrub_stamp":"2024-09-12T01:07:47.046642+0000","last_deep_scrub":"267'310","last_deep_scrub_stamp":"2024-09-12T01:07:47.046642+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.046642+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.764157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328055,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":751,"num_read_kb":29454,"num_write":966,"num_write_kb":25069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'218","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.984124+0000","last_change":"2024-09-12T01:07:58.984124+0000","last_active":"2024-09-12T01:07:58.984124+0000","last_peered":"2024-09-12T01:07:58.984124+0000","last_clean":"2024-09-12T01:07:58.984124+0000","last_became_active":"2024-09-12T00:21:44.497569+0000","last_became_peered":"2024-09-12T00:21:44.497569+0000","last_unstale":"2024-09-12T01:07:58.984124+0000","last_undegraded":"2024-09-12T01:07:58.984124+0000","last_fullsized":"2024-09-12T01:07:58.984124+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:07:58.983934+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:07:58.983934+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.983934+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:06.787825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":917,"num_read_kb":735,"num_write":338,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8079,"num_omap_keys":32,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.334560+0000","last_change":"2024-09-12T01:07:39.334379+0000","last_active":"2024-09-12T01:07:39.334560+0000","last_peered":"2024-09-12T01:07:39.334560+0000","last_clean":"2024-09-12T01:07:39.334560+0000","last_became_active":"2024-09-12T00:21:42.528057+0000","last_became_peered":"2024-09-12T00:21:42.528057+0000","last_unstale":"2024-09-12T01:07:39.334560+0000","last_undegraded":"2024-09-12T01:07:39.334560+0000","last_fullsized":"2024-09-12T01:07:39.334560+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-09-12T01:07:39.334128+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-09-12T01:07:39.334128+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.334128+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.207806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2018898,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":607,"num_read_kb":8621,"num_write":1230,"num_write_kb":31712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'138","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.346916+0000","last_change":"2024-09-12T01:07:49.346916+0000","last_active":"2024-09-12T01:07:49.346916+0000","last_peered":"2024-09-12T01:07:49.346916+0000","last_clean":"2024-09-12T01:07:49.346916+0000","last_became_active":"2024-09-12T00:21:44.479037+0000","last_became_peered":"2024-09-12T00:21:44.479037+0000","last_unstale":"2024-09-12T01:07:49.346916+0000","last_undegraded":"2024-09-12T01:07:49.346916+0000","last_fullsized":"2024-09-12T01:07:49.346916+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T01:07:49.346723+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T01:07:49.346723+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.346723+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:01.160030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":200,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'373","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.034540+0000","last_change":"2024-09-12T01:07:39.034540+0000","last_active":"2024-09-12T01:07:39.034540+0000","last_peered":"2024-09-12T01:07:39.034540+0000","last_clean":"2024-09-12T01:07:39.034540+0000","last_became_active":"2024-09-12T00:21:42.515464+0000","last_became_peered":"2024-09-12T00:21:42.515464+0000","last_unstale":"2024-09-12T01:07:39.034540+0000","last_undegraded":"2024-09-12T01:07:39.034540+0000","last_fullsized":"2024-09-12T01:07:39.034540+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-09-12T01:07:39.034299+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-09-12T01:07:39.034299+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.034299+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:13.031612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":537,"num_read_kb":28078,"num_write":1274,"num_write_kb":29332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'4286","reported_seq":4965,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.054554+0000","last_change":"2024-09-12T01:07:48.054390+0000","last_active":"2024-09-12T01:07:48.054554+0000","last_peered":"2024-09-12T01:07:48.054554+0000","last_clean":"2024-09-12T01:07:48.054554+0000","last_became_active":"2024-09-12T00:21:44.495734+0000","last_became_peered":"2024-09-12T00:21:44.495734+0000","last_unstale":"2024-09-12T01:07:48.054554+0000","last_undegraded":"2024-09-12T01:07:48.054554+0000","last_fullsized":"2024-09-12T01:07:48.054554+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4286","last_scrub_stamp":"2024-09-12T01:07:48.054213+0000","last_deep_scrub":"267'4286","last_deep_scrub_stamp":"2024-09-12T01:07:48.054213+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.054213+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":3000,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:38.885788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17226,"num_read_kb":14426,"num_write":6464,"num_write_kb":3218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'375","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.278173+0000","last_change":"2024-09-12T01:07:37.278173+0000","last_active":"2024-09-12T01:07:37.278173+0000","last_peered":"2024-09-12T01:07:37.278173+0000","last_clean":"2024-09-12T01:07:37.278173+0000","last_became_active":"2024-09-12T00:21:42.534582+0000","last_became_peered":"2024-09-12T00:21:42.534582+0000","last_unstale":"2024-09-12T01:07:37.278173+0000","last_undegraded":"2024-09-12T01:07:37.278173+0000","last_fullsized":"2024-09-12T01:07:37.278173+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T01:07:37.277868+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T01:07:37.277868+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.277868+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:05.857538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":491,"num_read_kb":25303,"num_write":1128,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'161","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.097307+0000","last_change":"2024-09-12T01:07:47.097307+0000","last_active":"2024-09-12T01:07:47.097307+0000","last_peered":"2024-09-12T01:07:47.097307+0000","last_clean":"2024-09-12T01:07:47.097307+0000","last_became_active":"2024-09-12T00:21:44.510410+0000","last_became_peered":"2024-09-12T00:21:44.510410+0000","last_unstale":"2024-09-12T01:07:47.097307+0000","last_undegraded":"2024-09-12T01:07:47.097307+0000","last_fullsized":"2024-09-12T01:07:47.097307+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:07:47.097118+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:07:47.097118+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.097118+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.442505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":577,"num_write":213,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1239,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.025855+0000","last_change":"2024-09-12T01:07:36.025855+0000","last_active":"2024-09-12T01:07:36.025855+0000","last_peered":"2024-09-12T01:07:36.025855+0000","last_clean":"2024-09-12T01:07:36.025855+0000","last_became_active":"2024-09-12T00:21:42.530155+0000","last_became_peered":"2024-09-12T00:21:42.530155+0000","last_unstale":"2024-09-12T01:07:36.025855+0000","last_undegraded":"2024-09-12T01:07:36.025855+0000","last_fullsized":"2024-09-12T01:07:36.025855+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T01:07:36.025559+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T01:07:36.025559+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.025559+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:05.061004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1030,"num_read_kb":26574,"num_write":1137,"num_write_kb":18888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'161","reported_seq":780,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.227104+0000","last_change":"2024-09-12T01:07:46.227104+0000","last_active":"2024-09-12T01:07:46.227104+0000","last_peered":"2024-09-12T01:07:46.227104+0000","last_clean":"2024-09-12T01:07:46.227104+0000","last_became_active":"2024-09-12T00:21:44.483825+0000","last_became_peered":"2024-09-12T00:21:44.483825+0000","last_unstale":"2024-09-12T01:07:46.227104+0000","last_undegraded":"2024-09-12T01:07:46.227104+0000","last_fullsized":"2024-09-12T01:07:46.227104+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:07:46.226919+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:07:46.226919+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.226919+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:25.645752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":577,"num_write":242,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'407","reported_seq":1081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.012599+0000","last_change":"2024-09-12T01:07:44.012599+0000","last_active":"2024-09-12T01:07:44.012599+0000","last_peered":"2024-09-12T01:07:44.012599+0000","last_clean":"2024-09-12T01:07:44.012599+0000","last_became_active":"2024-09-12T00:22:12.620753+0000","last_became_peered":"2024-09-12T00:22:12.620753+0000","last_unstale":"2024-09-12T01:07:44.012599+0000","last_undegraded":"2024-09-12T01:07:44.012599+0000","last_fullsized":"2024-09-12T01:07:44.012599+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T01:07:44.012256+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T01:07:44.012256+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.012256+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:21.935270+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":588,"num_read_kb":16569,"num_write":1344,"num_write_kb":33151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'179","reported_seq":772,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.983715+0000","last_change":"2024-09-12T01:07:57.983715+0000","last_active":"2024-09-12T01:07:57.983715+0000","last_peered":"2024-09-12T01:07:57.983715+0000","last_clean":"2024-09-12T01:07:57.983715+0000","last_became_active":"2024-09-12T00:21:44.528311+0000","last_became_peered":"2024-09-12T00:21:44.528311+0000","last_unstale":"2024-09-12T01:07:57.983715+0000","last_undegraded":"2024-09-12T01:07:57.983715+0000","last_fullsized":"2024-09-12T01:07:57.983715+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'179","last_scrub_stamp":"2024-09-12T01:07:57.983537+0000","last_deep_scrub":"267'179","last_deep_scrub_stamp":"2024-09-12T01:07:57.983537+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.983537+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:37.042891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":638,"num_write":310,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'108","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.876720+0000","last_change":"2024-09-12T01:07:54.876584+0000","last_active":"2024-09-12T01:07:54.876720+0000","last_peered":"2024-09-12T01:07:54.876720+0000","last_clean":"2024-09-12T01:07:54.876720+0000","last_became_active":"2024-09-12T00:21:44.493767+0000","last_became_peered":"2024-09-12T00:21:44.493767+0000","last_unstale":"2024-09-12T01:07:54.876720+0000","last_undegraded":"2024-09-12T01:07:54.876720+0000","last_fullsized":"2024-09-12T01:07:54.876720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'108","last_scrub_stamp":"2024-09-12T01:07:54.876374+0000","last_deep_scrub":"267'108","last_deep_scrub_stamp":"2024-09-12T01:07:54.876374+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.876374+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:11.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":357,"num_write":148,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'315","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.652696+0000","last_change":"2024-09-12T01:07:34.652629+0000","last_active":"2024-09-12T01:07:34.652696+0000","last_peered":"2024-09-12T01:07:34.652696+0000","last_clean":"2024-09-12T01:07:34.652696+0000","last_became_active":"2024-09-12T00:21:42.514489+0000","last_became_peered":"2024-09-12T00:21:42.514489+0000","last_unstale":"2024-09-12T01:07:34.652696+0000","last_undegraded":"2024-09-12T01:07:34.652696+0000","last_fullsized":"2024-09-12T01:07:34.652696+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'315","last_scrub_stamp":"2024-09-12T01:07:34.652525+0000","last_deep_scrub":"267'315","last_deep_scrub_stamp":"2024-09-12T01:07:34.652525+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.652525+0000","objects_scrubbed":8,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:00.027136+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480914,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":6553,"num_write":1087,"num_write_kb":16882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'52","reported_seq":614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.053661+0000","last_change":"2024-09-12T01:07:42.053490+0000","last_active":"2024-09-12T01:07:42.053661+0000","last_peered":"2024-09-12T01:07:42.053661+0000","last_clean":"2024-09-12T01:07:42.053661+0000","last_became_active":"2024-09-12T00:21:44.509895+0000","last_became_peered":"2024-09-12T00:21:44.509895+0000","last_unstale":"2024-09-12T01:07:42.053661+0000","last_undegraded":"2024-09-12T01:07:42.053661+0000","last_fullsized":"2024-09-12T01:07:42.053661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'52","last_scrub_stamp":"2024-09-12T01:07:42.053309+0000","last_deep_scrub":"267'52","last_deep_scrub_stamp":"2024-09-12T01:07:42.053309+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.053309+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:52.856138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":198,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'260","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.988730+0000","last_change":"2024-09-12T01:07:36.988584+0000","last_active":"2024-09-12T01:07:36.988730+0000","last_peered":"2024-09-12T01:07:36.988730+0000","last_clean":"2024-09-12T01:07:36.988730+0000","last_became_active":"2024-09-12T00:21:42.490660+0000","last_became_peered":"2024-09-12T00:21:42.490660+0000","last_unstale":"2024-09-12T01:07:36.988730+0000","last_undegraded":"2024-09-12T01:07:36.988730+0000","last_fullsized":"2024-09-12T01:07:36.988730+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'260","last_scrub_stamp":"2024-09-12T01:07:36.988372+0000","last_deep_scrub":"267'260","last_deep_scrub_stamp":"2024-09-12T01:07:36.988372+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.988372+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:05.939444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":4406,"num_write":788,"num_write_kb":22345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'258","reported_seq":903,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.543047+0000","last_change":"2024-09-12T01:07:44.542895+0000","last_active":"2024-09-12T01:07:44.543047+0000","last_peered":"2024-09-12T01:07:44.543047+0000","last_clean":"2024-09-12T01:07:44.543047+0000","last_became_active":"2024-09-12T00:21:44.514893+0000","last_became_peered":"2024-09-12T00:21:44.514893+0000","last_unstale":"2024-09-12T01:07:44.543047+0000","last_undegraded":"2024-09-12T01:07:44.543047+0000","last_fullsized":"2024-09-12T01:07:44.543047+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:07:44.542721+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:07:44.542721+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.542721+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:09.993567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1166,"num_read_kb":956,"num_write":431,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'341","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.402382+0000","last_change":"2024-09-12T01:07:44.402230+0000","last_active":"2024-09-12T01:07:44.402382+0000","last_peered":"2024-09-12T01:07:44.402382+0000","last_clean":"2024-09-12T01:07:44.402382+0000","last_became_active":"2024-09-12T00:22:13.552126+0000","last_became_peered":"2024-09-12T00:22:13.552126+0000","last_unstale":"2024-09-12T01:07:44.402382+0000","last_undegraded":"2024-09-12T01:07:44.402382+0000","last_fullsized":"2024-09-12T01:07:44.402382+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:44.401991+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:44.401991+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.401991+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:52.498973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194436,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":9788,"num_write":1143,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'125","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.334204+0000","last_change":"2024-09-12T01:07:49.334204+0000","last_active":"2024-09-12T01:07:49.334204+0000","last_peered":"2024-09-12T01:07:49.334204+0000","last_clean":"2024-09-12T01:07:49.334204+0000","last_became_active":"2024-09-12T00:21:44.520441+0000","last_became_peered":"2024-09-12T00:21:44.520441+0000","last_unstale":"2024-09-12T01:07:49.334204+0000","last_undegraded":"2024-09-12T01:07:49.334204+0000","last_fullsized":"2024-09-12T01:07:49.334204+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'125","last_scrub_stamp":"2024-09-12T01:07:49.333960+0000","last_deep_scrub":"267'125","last_deep_scrub_stamp":"2024-09-12T01:07:49.333960+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.333960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:29.920627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":562,"num_read_kb":459,"num_write":198,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'341","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.001918+0000","last_change":"2024-09-12T01:07:38.001684+0000","last_active":"2024-09-12T01:07:38.001918+0000","last_peered":"2024-09-12T01:07:38.001918+0000","last_clean":"2024-09-12T01:07:38.001918+0000","last_became_active":"2024-09-12T00:21:42.505754+0000","last_became_peered":"2024-09-12T00:21:42.505754+0000","last_unstale":"2024-09-12T01:07:38.001918+0000","last_undegraded":"2024-09-12T01:07:38.001918+0000","last_fullsized":"2024-09-12T01:07:38.001918+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:38.001353+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:38.001353+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.001353+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:05.323675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524521,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":484,"num_read_kb":23994,"num_write":1133,"num_write_kb":44987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'533","reported_seq":1303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.016723+0000","last_change":"2024-09-12T01:07:56.016723+0000","last_active":"2024-09-12T01:07:56.016723+0000","last_peered":"2024-09-12T01:07:56.016723+0000","last_clean":"2024-09-12T01:07:56.016723+0000","last_became_active":"2024-09-12T00:21:44.509840+0000","last_became_peered":"2024-09-12T00:21:44.509840+0000","last_unstale":"2024-09-12T01:07:56.016723+0000","last_undegraded":"2024-09-12T01:07:56.016723+0000","last_fullsized":"2024-09-12T01:07:56.016723+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'533","last_scrub_stamp":"2024-09-12T01:07:56.016549+0000","last_deep_scrub":"267'533","last_deep_scrub_stamp":"2024-09-12T01:07:56.016549+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.016549+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:38.339396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2527,"num_read_kb":2144,"num_write":948,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'354","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.349736+0000","last_change":"2024-09-12T01:07:40.349736+0000","last_active":"2024-09-12T01:07:40.349736+0000","last_peered":"2024-09-12T01:07:40.349736+0000","last_clean":"2024-09-12T01:07:40.349736+0000","last_became_active":"2024-09-12T00:21:42.529312+0000","last_became_peered":"2024-09-12T00:21:42.529312+0000","last_unstale":"2024-09-12T01:07:40.349736+0000","last_undegraded":"2024-09-12T01:07:40.349736+0000","last_fullsized":"2024-09-12T01:07:40.349736+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T01:07:40.349528+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T01:07:40.349528+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.349528+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:32.841636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":660,"num_write":1093,"num_write_kb":45878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'102","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.560572+0000","last_change":"2024-09-12T01:07:43.560572+0000","last_active":"2024-09-12T01:07:43.560572+0000","last_peered":"2024-09-12T01:07:43.560572+0000","last_clean":"2024-09-12T01:07:43.560572+0000","last_became_active":"2024-09-12T00:21:44.499173+0000","last_became_peered":"2024-09-12T00:21:44.499173+0000","last_unstale":"2024-09-12T01:07:43.560572+0000","last_undegraded":"2024-09-12T01:07:43.560572+0000","last_fullsized":"2024-09-12T01:07:43.560572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:43.560396+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:43.560396+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.560396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:27.157753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":398,"num_write":158,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'370","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.319609+0000","last_change":"2024-09-12T01:07:42.319443+0000","last_active":"2024-09-12T01:07:42.319609+0000","last_peered":"2024-09-12T01:07:42.319609+0000","last_clean":"2024-09-12T01:07:42.319609+0000","last_became_active":"2024-09-12T00:21:42.529873+0000","last_became_peered":"2024-09-12T00:21:42.529873+0000","last_unstale":"2024-09-12T01:07:42.319609+0000","last_undegraded":"2024-09-12T01:07:42.319609+0000","last_fullsized":"2024-09-12T01:07:42.319609+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-12T01:07:42.319216+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-12T01:07:42.319216+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.319216+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:35.891445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730168,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":35149,"num_write":1229,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'139","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.043273+0000","last_change":"2024-09-12T01:07:58.043273+0000","last_active":"2024-09-12T01:07:58.043273+0000","last_peered":"2024-09-12T01:07:58.043273+0000","last_clean":"2024-09-12T01:07:58.043273+0000","last_became_active":"2024-09-12T00:21:52.545571+0000","last_became_peered":"2024-09-12T00:21:52.545571+0000","last_unstale":"2024-09-12T01:07:58.043273+0000","last_undegraded":"2024-09-12T01:07:58.043273+0000","last_fullsized":"2024-09-12T01:07:58.043273+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'139","last_scrub_stamp":"2024-09-12T01:07:58.042992+0000","last_deep_scrub":"267'139","last_deep_scrub_stamp":"2024-09-12T01:07:58.042992+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.042992+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:35.015561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'88","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.345078+0000","last_change":"2024-09-12T01:07:46.344902+0000","last_active":"2024-09-12T01:07:46.345078+0000","last_peered":"2024-09-12T01:07:46.345078+0000","last_clean":"2024-09-12T01:07:46.345078+0000","last_became_active":"2024-09-12T00:21:44.484514+0000","last_became_peered":"2024-09-12T00:21:44.484514+0000","last_unstale":"2024-09-12T01:07:46.345078+0000","last_undegraded":"2024-09-12T01:07:46.345078+0000","last_fullsized":"2024-09-12T01:07:46.345078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'88","last_scrub_stamp":"2024-09-12T01:07:46.344724+0000","last_deep_scrub":"267'88","last_deep_scrub_stamp":"2024-09-12T01:07:46.344724+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.344724+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:38.020778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":321,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'347","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.938286+0000","last_change":"2024-09-12T01:07:44.938138+0000","last_active":"2024-09-12T01:07:44.938286+0000","last_peered":"2024-09-12T01:07:44.938286+0000","last_clean":"2024-09-12T01:07:44.938286+0000","last_became_active":"2024-09-12T00:21:42.495808+0000","last_became_peered":"2024-09-12T00:21:42.495808+0000","last_unstale":"2024-09-12T01:07:44.938286+0000","last_undegraded":"2024-09-12T01:07:44.938286+0000","last_fullsized":"2024-09-12T01:07:44.938286+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T01:07:44.937896+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T01:07:44.937896+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.937896+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.094251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432703,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":20340,"num_write":1070,"num_write_kb":31693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.024754+0000","last_change":"2024-09-12T01:08:03.024754+0000","last_active":"2024-09-12T01:08:03.024754+0000","last_peered":"2024-09-12T01:08:03.024754+0000","last_clean":"2024-09-12T01:08:03.024754+0000","last_became_active":"2024-09-12T00:21:46.515363+0000","last_became_peered":"2024-09-12T00:21:46.515363+0000","last_unstale":"2024-09-12T01:08:03.024754+0000","last_undegraded":"2024-09-12T01:08:03.024754+0000","last_fullsized":"2024-09-12T01:08:03.024754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:03.024572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:03.024572+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.024572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:19.093277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'336","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.370157+0000","last_change":"2024-09-12T01:08:01.370157+0000","last_active":"2024-09-12T01:08:01.370157+0000","last_peered":"2024-09-12T01:08:01.370157+0000","last_clean":"2024-09-12T01:08:01.370157+0000","last_became_active":"2024-09-12T00:21:48.524091+0000","last_became_peered":"2024-09-12T00:21:48.524091+0000","last_unstale":"2024-09-12T01:08:01.370157+0000","last_undegraded":"2024-09-12T01:08:01.370157+0000","last_fullsized":"2024-09-12T01:08:01.370157+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T01:08:01.369944+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T01:08:01.369944+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.369944+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:54.638067+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48797,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1088,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.514313+0000","last_change":"2024-09-12T01:07:59.514313+0000","last_active":"2024-09-12T01:07:59.514313+0000","last_peered":"2024-09-12T01:07:59.514313+0000","last_clean":"2024-09-12T01:07:59.514313+0000","last_became_active":"2024-09-12T00:21:50.551742+0000","last_became_peered":"2024-09-12T00:21:50.551742+0000","last_unstale":"2024-09-12T01:07:59.514313+0000","last_undegraded":"2024-09-12T01:07:59.514313+0000","last_fullsized":"2024-09-12T01:07:59.514313+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:59.514104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:59.514104+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.514104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:24.793889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'176","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.582167+0000","last_change":"2024-09-12T01:08:02.582167+0000","last_active":"2024-09-12T01:08:02.582167+0000","last_peered":"2024-09-12T01:08:02.582167+0000","last_clean":"2024-09-12T01:08:02.582167+0000","last_became_active":"2024-09-12T00:21:52.544469+0000","last_became_peered":"2024-09-12T00:21:52.544469+0000","last_unstale":"2024-09-12T01:08:02.582167+0000","last_undegraded":"2024-09-12T01:08:02.582167+0000","last_fullsized":"2024-09-12T01:08:02.582167+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'176","last_scrub_stamp":"2024-09-12T01:08:02.581978+0000","last_deep_scrub":"267'176","last_deep_scrub_stamp":"2024-09-12T01:08:02.581978+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.581978+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.917282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":251,"num_write":350,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'4223","reported_seq":4863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.886750+0000","last_change":"2024-09-12T01:07:55.886750+0000","last_active":"2024-09-12T01:07:55.886750+0000","last_peered":"2024-09-12T01:07:55.886750+0000","last_clean":"2024-09-12T01:07:55.886750+0000","last_became_active":"2024-09-12T00:21:44.500367+0000","last_became_peered":"2024-09-12T00:21:44.500367+0000","last_unstale":"2024-09-12T01:07:55.886750+0000","last_undegraded":"2024-09-12T01:07:55.886750+0000","last_fullsized":"2024-09-12T01:07:55.886750+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4223","last_scrub_stamp":"2024-09-12T01:07:55.886652+0000","last_deep_scrub":"267'4223","last_deep_scrub_stamp":"2024-09-12T01:07:55.886652+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.886652+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":3000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:31.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17010,"num_read_kb":14247,"num_write":6340,"num_write_kb":3163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'379","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.372627+0000","last_change":"2024-09-12T01:07:39.372378+0000","last_active":"2024-09-12T01:07:39.372627+0000","last_peered":"2024-09-12T01:07:39.372627+0000","last_clean":"2024-09-12T01:07:39.372627+0000","last_became_active":"2024-09-12T00:21:42.492572+0000","last_became_peered":"2024-09-12T00:21:42.492572+0000","last_unstale":"2024-09-12T01:07:39.372627+0000","last_undegraded":"2024-09-12T01:07:39.372627+0000","last_fullsized":"2024-09-12T01:07:39.372627+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:39.372054+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:39.372054+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.372054+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:10.885705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":586,"num_read_kb":145927,"num_write":1169,"num_write_kb":64533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.367215+0000","last_change":"2024-09-12T01:07:54.367076+0000","last_active":"2024-09-12T01:07:54.367215+0000","last_peered":"2024-09-12T01:07:54.367215+0000","last_clean":"2024-09-12T01:07:54.367215+0000","last_became_active":"2024-09-12T00:21:46.490985+0000","last_became_peered":"2024-09-12T00:21:46.490985+0000","last_unstale":"2024-09-12T01:07:54.367215+0000","last_undegraded":"2024-09-12T01:07:54.367215+0000","last_fullsized":"2024-09-12T01:07:54.367215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.366884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.366884+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.366884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:54.269774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'88","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.609595+0000","last_change":"2024-09-12T01:07:55.609595+0000","last_active":"2024-09-12T01:07:55.609595+0000","last_peered":"2024-09-12T01:07:55.609595+0000","last_clean":"2024-09-12T01:07:55.609595+0000","last_became_active":"2024-09-12T00:21:48.535190+0000","last_became_peered":"2024-09-12T00:21:48.535190+0000","last_unstale":"2024-09-12T01:07:55.609595+0000","last_undegraded":"2024-09-12T01:07:55.609595+0000","last_fullsized":"2024-09-12T01:07:55.609595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'88","last_scrub_stamp":"2024-09-12T01:07:55.609509+0000","last_deep_scrub":"267'88","last_deep_scrub_stamp":"2024-09-12T01:07:55.609509+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.609509+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:29.653534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.578105+0000","last_change":"2024-09-12T01:07:56.578105+0000","last_active":"2024-09-12T01:07:56.578105+0000","last_peered":"2024-09-12T01:07:56.578105+0000","last_clean":"2024-09-12T01:07:56.578105+0000","last_became_active":"2024-09-12T00:21:50.550214+0000","last_became_peered":"2024-09-12T00:21:50.550214+0000","last_unstale":"2024-09-12T01:07:56.578105+0000","last_undegraded":"2024-09-12T01:07:56.578105+0000","last_fullsized":"2024-09-12T01:07:56.578105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:56.577932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:56.577932+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.577932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:42.970087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'129","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.314305+0000","last_change":"2024-09-12T01:08:04.314305+0000","last_active":"2024-09-12T01:08:04.314305+0000","last_peered":"2024-09-12T01:08:04.314305+0000","last_clean":"2024-09-12T01:08:04.314305+0000","last_became_active":"2024-09-12T00:21:52.545166+0000","last_became_peered":"2024-09-12T00:21:52.545166+0000","last_unstale":"2024-09-12T01:08:04.314305+0000","last_undegraded":"2024-09-12T01:08:04.314305+0000","last_fullsized":"2024-09-12T01:08:04.314305+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:08:04.314110+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:08:04.314110+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.314110+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:16.820858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":292,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'288","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.016647+0000","last_change":"2024-09-12T01:07:51.016647+0000","last_active":"2024-09-12T01:07:51.016647+0000","last_peered":"2024-09-12T01:07:51.016647+0000","last_clean":"2024-09-12T01:07:51.016647+0000","last_became_active":"2024-09-12T00:21:44.520057+0000","last_became_peered":"2024-09-12T00:21:44.520057+0000","last_unstale":"2024-09-12T01:07:51.016647+0000","last_undegraded":"2024-09-12T01:07:51.016647+0000","last_fullsized":"2024-09-12T01:07:51.016647+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'288","last_scrub_stamp":"2024-09-12T01:07:51.016419+0000","last_deep_scrub":"267'288","last_deep_scrub_stamp":"2024-09-12T01:07:51.016419+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.016419+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:13.071098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1259,"num_read_kb":1089,"num_write":465,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'321","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.918965+0000","last_change":"2024-09-12T01:07:36.918798+0000","last_active":"2024-09-12T01:07:36.918965+0000","last_peered":"2024-09-12T01:07:36.918965+0000","last_clean":"2024-09-12T01:07:36.918965+0000","last_became_active":"2024-09-12T00:21:42.496059+0000","last_became_peered":"2024-09-12T00:21:42.496059+0000","last_unstale":"2024-09-12T01:07:36.918965+0000","last_undegraded":"2024-09-12T01:07:36.918965+0000","last_fullsized":"2024-09-12T01:07:36.918965+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'321","last_scrub_stamp":"2024-09-12T01:07:36.918576+0000","last_deep_scrub":"267'321","last_deep_scrub_stamp":"2024-09-12T01:07:36.918576+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.918576+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:39.909942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":8629,"num_write":994,"num_write_kb":21953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.365480+0000","last_change":"2024-09-12T01:07:55.365480+0000","last_active":"2024-09-12T01:07:55.365480+0000","last_peered":"2024-09-12T01:07:55.365480+0000","last_clean":"2024-09-12T01:07:55.365480+0000","last_became_active":"2024-09-12T00:21:46.501407+0000","last_became_peered":"2024-09-12T00:21:46.501407+0000","last_unstale":"2024-09-12T01:07:55.365480+0000","last_undegraded":"2024-09-12T01:07:55.365480+0000","last_fullsized":"2024-09-12T01:07:55.365480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.365302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.365302+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.365302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:38.230753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'129","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.376690+0000","last_change":"2024-09-12T01:08:02.376443+0000","last_active":"2024-09-12T01:08:02.376690+0000","last_peered":"2024-09-12T01:08:02.376690+0000","last_clean":"2024-09-12T01:08:02.376690+0000","last_became_active":"2024-09-12T00:21:48.541231+0000","last_became_peered":"2024-09-12T00:21:48.541231+0000","last_unstale":"2024-09-12T01:08:02.376690+0000","last_undegraded":"2024-09-12T01:08:02.376690+0000","last_fullsized":"2024-09-12T01:08:02.376690+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:08:02.376158+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:08:02.376158+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.376158+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:58.427365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'789","reported_seq":2524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.283028+0000","last_change":"2024-09-12T01:08:15.283028+0000","last_active":"2024-09-12T01:08:15.283028+0000","last_peered":"2024-09-12T01:08:15.283028+0000","last_clean":"2024-09-12T01:08:15.283028+0000","last_became_active":"2024-09-12T00:21:50.568825+0000","last_became_peered":"2024-09-12T00:21:50.568825+0000","last_unstale":"2024-09-12T01:08:15.283028+0000","last_undegraded":"2024-09-12T01:08:15.283028+0000","last_fullsized":"2024-09-12T01:08:15.283028+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'789","last_scrub_stamp":"2024-09-12T01:08:15.282850+0000","last_deep_scrub":"267'789","last_deep_scrub_stamp":"2024-09-12T01:08:15.282850+0000","last_clean_scrub_stamp":"2024-09-12T01:08:15.282850+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:31.281703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'225","reported_seq":1078,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.199574+0000","last_change":"2024-09-12T01:08:00.199574+0000","last_active":"2024-09-12T01:08:00.199574+0000","last_peered":"2024-09-12T01:08:00.199574+0000","last_clean":"2024-09-12T01:08:00.199574+0000","last_became_active":"2024-09-12T00:21:52.554865+0000","last_became_peered":"2024-09-12T00:21:52.554865+0000","last_unstale":"2024-09-12T01:08:00.199574+0000","last_undegraded":"2024-09-12T01:08:00.199574+0000","last_fullsized":"2024-09-12T01:08:00.199574+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-12T01:08:00.199341+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-12T01:08:00.199341+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.199341+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:05.338489+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":708,"num_read_kb":679,"num_write":497,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'136","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.992340+0000","last_change":"2024-09-12T01:07:51.992340+0000","last_active":"2024-09-12T01:07:51.992340+0000","last_peered":"2024-09-12T01:07:51.992340+0000","last_clean":"2024-09-12T01:07:51.992340+0000","last_became_active":"2024-09-12T00:21:44.522830+0000","last_became_peered":"2024-09-12T00:21:44.522830+0000","last_unstale":"2024-09-12T01:07:51.992340+0000","last_undegraded":"2024-09-12T01:07:51.992340+0000","last_fullsized":"2024-09-12T01:07:51.992340+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'136","last_scrub_stamp":"2024-09-12T01:07:51.992145+0000","last_deep_scrub":"267'136","last_deep_scrub_stamp":"2024-09-12T01:07:51.992145+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.992145+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:19.587323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":578,"num_read_kb":469,"num_write":207,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'328","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.611495+0000","last_change":"2024-09-12T01:07:33.611420+0000","last_active":"2024-09-12T01:07:33.611495+0000","last_peered":"2024-09-12T01:07:33.611495+0000","last_clean":"2024-09-12T01:07:33.611495+0000","last_became_active":"2024-09-12T00:21:42.516625+0000","last_became_peered":"2024-09-12T00:21:42.516625+0000","last_unstale":"2024-09-12T01:07:33.611495+0000","last_undegraded":"2024-09-12T01:07:33.611495+0000","last_fullsized":"2024-09-12T01:07:33.611495+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:33.611301+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.611301+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:46.786030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":2651,"num_write":1122,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.070311+0000","last_change":"2024-09-12T01:08:04.070311+0000","last_active":"2024-09-12T01:08:04.070311+0000","last_peered":"2024-09-12T01:08:04.070311+0000","last_clean":"2024-09-12T01:08:04.070311+0000","last_became_active":"2024-09-12T00:21:46.503686+0000","last_became_peered":"2024-09-12T00:21:46.503686+0000","last_unstale":"2024-09-12T01:08:04.070311+0000","last_undegraded":"2024-09-12T01:08:04.070311+0000","last_fullsized":"2024-09-12T01:08:04.070311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:04.070128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:04.070128+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.070128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:47.551310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'288","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.199449+0000","last_change":"2024-09-12T01:07:52.199449+0000","last_active":"2024-09-12T01:07:52.199449+0000","last_peered":"2024-09-12T01:07:52.199449+0000","last_clean":"2024-09-12T01:07:52.199449+0000","last_became_active":"2024-09-12T00:21:48.539522+0000","last_became_peered":"2024-09-12T00:21:48.539522+0000","last_unstale":"2024-09-12T01:07:52.199449+0000","last_undegraded":"2024-09-12T01:07:52.199449+0000","last_fullsized":"2024-09-12T01:07:52.199449+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'288","last_scrub_stamp":"2024-09-12T01:07:52.199255+0000","last_deep_scrub":"267'288","last_deep_scrub_stamp":"2024-09-12T01:07:52.199255+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.199255+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:02.995276+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47885,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1089,"num_write":388,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'781","reported_seq":2476,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.918695+0000","last_change":"2024-09-12T01:08:05.918460+0000","last_active":"2024-09-12T01:08:05.918695+0000","last_peered":"2024-09-12T01:08:05.918695+0000","last_clean":"2024-09-12T01:08:05.918695+0000","last_became_active":"2024-09-12T00:21:50.564483+0000","last_became_peered":"2024-09-12T00:21:50.564483+0000","last_unstale":"2024-09-12T01:08:05.918695+0000","last_undegraded":"2024-09-12T01:08:05.918695+0000","last_fullsized":"2024-09-12T01:08:05.918695+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-12T01:08:05.918233+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-12T01:08:05.918233+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.918233+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:41.622332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'576","reported_seq":1373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.904435+0000","last_change":"2024-09-12T01:07:50.904435+0000","last_active":"2024-09-12T01:07:50.904435+0000","last_peered":"2024-09-12T01:07:50.904435+0000","last_clean":"2024-09-12T01:07:50.904435+0000","last_became_active":"2024-09-12T00:21:44.497754+0000","last_became_peered":"2024-09-12T00:21:44.497754+0000","last_unstale":"2024-09-12T01:07:50.904435+0000","last_undegraded":"2024-09-12T01:07:50.904435+0000","last_fullsized":"2024-09-12T01:07:50.904435+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'576","last_scrub_stamp":"2024-09-12T01:07:50.904242+0000","last_deep_scrub":"267'576","last_deep_scrub_stamp":"2024-09-12T01:07:50.904242+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.904242+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:34.973282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2710,"num_read_kb":2241,"num_write":1007,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'379","reported_seq":1096,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:31.968974+0000","last_change":"2024-09-12T01:07:31.968974+0000","last_active":"2024-09-12T01:07:31.968974+0000","last_peered":"2024-09-12T01:07:31.968974+0000","last_clean":"2024-09-12T01:07:31.968974+0000","last_became_active":"2024-09-12T00:21:42.528138+0000","last_became_peered":"2024-09-12T00:21:42.528138+0000","last_unstale":"2024-09-12T01:07:31.968974+0000","last_undegraded":"2024-09-12T01:07:31.968974+0000","last_fullsized":"2024-09-12T01:07:31.968974+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-12T01:07:31.968881+0000","last_clean_scrub_stamp":"2024-09-12T01:07:31.968881+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:08.369394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":24539,"num_write":1088,"num_write_kb":22675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.602402+0000","last_change":"2024-09-12T01:07:48.602402+0000","last_active":"2024-09-12T01:07:48.602402+0000","last_peered":"2024-09-12T01:07:48.602402+0000","last_clean":"2024-09-12T01:07:48.602402+0000","last_became_active":"2024-09-12T00:21:46.503041+0000","last_became_peered":"2024-09-12T00:21:46.503041+0000","last_unstale":"2024-09-12T01:07:48.602402+0000","last_undegraded":"2024-09-12T01:07:48.602402+0000","last_fullsized":"2024-09-12T01:07:48.602402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.602219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.602219+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.602219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:00.262764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'375","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045785+0000","last_change":"2024-09-12T01:07:50.045785+0000","last_active":"2024-09-12T01:07:50.045785+0000","last_peered":"2024-09-12T01:07:50.045785+0000","last_clean":"2024-09-12T01:07:50.045785+0000","last_became_active":"2024-09-12T00:21:48.538727+0000","last_became_peered":"2024-09-12T00:21:48.538727+0000","last_unstale":"2024-09-12T01:07:50.045785+0000","last_undegraded":"2024-09-12T01:07:50.045785+0000","last_fullsized":"2024-09-12T01:07:50.045785+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T01:07:50.045578+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T01:07:50.045578+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.045578+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:24.408858+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48773,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":589,"num_read_kb":1209,"num_write":464,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.339748+0000","last_change":"2024-09-12T01:08:02.339748+0000","last_active":"2024-09-12T01:08:02.339748+0000","last_peered":"2024-09-12T01:08:02.339748+0000","last_clean":"2024-09-12T01:08:02.339748+0000","last_became_active":"2024-09-12T00:21:50.544432+0000","last_became_peered":"2024-09-12T00:21:50.544432+0000","last_unstale":"2024-09-12T01:08:02.339748+0000","last_undegraded":"2024-09-12T01:08:02.339748+0000","last_fullsized":"2024-09-12T01:08:02.339748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.339562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.339562+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.339562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:22.365617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'553","reported_seq":1373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.241100+0000","last_change":"2024-09-12T01:07:56.241100+0000","last_active":"2024-09-12T01:07:56.241100+0000","last_peered":"2024-09-12T01:07:56.241100+0000","last_clean":"2024-09-12T01:07:56.241100+0000","last_became_active":"2024-09-12T00:21:52.563086+0000","last_became_peered":"2024-09-12T00:21:52.563086+0000","last_unstale":"2024-09-12T01:07:56.241100+0000","last_undegraded":"2024-09-12T01:07:56.241100+0000","last_fullsized":"2024-09-12T01:07:56.241100+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'553","last_scrub_stamp":"2024-09-12T01:07:56.240896+0000","last_deep_scrub":"267'553","last_deep_scrub_stamp":"2024-09-12T01:07:56.240896+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.240896+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:00.278881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1274,"num_read_kb":1271,"num_write":1130,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'526","reported_seq":1314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.643971+0000","last_change":"2024-09-12T01:07:36.643971+0000","last_active":"2024-09-12T01:07:36.643971+0000","last_peered":"2024-09-12T01:07:36.643971+0000","last_clean":"2024-09-12T01:07:36.643971+0000","last_became_active":"2024-09-12T00:21:44.510918+0000","last_became_peered":"2024-09-12T00:21:44.510918+0000","last_unstale":"2024-09-12T01:07:36.643971+0000","last_undegraded":"2024-09-12T01:07:36.643971+0000","last_fullsized":"2024-09-12T01:07:36.643971+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'526","last_scrub_stamp":"2024-09-12T01:07:36.643792+0000","last_deep_scrub":"267'526","last_deep_scrub_stamp":"2024-09-12T01:07:36.643792+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.643792+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.857231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2468,"num_read_kb":2089,"num_write":789,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29756,"num_omap_keys":119,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'326","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.222218+0000","last_change":"2024-09-12T01:07:33.222218+0000","last_active":"2024-09-12T01:07:33.222218+0000","last_peered":"2024-09-12T01:07:33.222218+0000","last_clean":"2024-09-12T01:07:33.222218+0000","last_became_active":"2024-09-12T00:21:42.513031+0000","last_became_peered":"2024-09-12T00:21:42.513031+0000","last_unstale":"2024-09-12T01:07:33.222218+0000","last_undegraded":"2024-09-12T01:07:33.222218+0000","last_fullsized":"2024-09-12T01:07:33.222218+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T01:07:33.222064+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.222064+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:44.352540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730153,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":476,"num_read_kb":44893,"num_write":1011,"num_write_kb":33699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.362478+0000","last_change":"2024-09-12T01:07:51.362478+0000","last_active":"2024-09-12T01:07:51.362478+0000","last_peered":"2024-09-12T01:07:51.362478+0000","last_clean":"2024-09-12T01:07:51.362478+0000","last_became_active":"2024-09-12T00:21:46.517981+0000","last_became_peered":"2024-09-12T00:21:46.517981+0000","last_unstale":"2024-09-12T01:07:51.362478+0000","last_undegraded":"2024-09-12T01:07:51.362478+0000","last_fullsized":"2024-09-12T01:07:51.362478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:51.362295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:51.362295+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.362295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:14.300895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'279","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.368682+0000","last_change":"2024-09-12T01:07:57.368682+0000","last_active":"2024-09-12T01:07:57.368682+0000","last_peered":"2024-09-12T01:07:57.368682+0000","last_clean":"2024-09-12T01:07:57.368682+0000","last_became_active":"2024-09-12T00:21:48.522920+0000","last_became_peered":"2024-09-12T00:21:48.522920+0000","last_unstale":"2024-09-12T01:07:57.368682+0000","last_undegraded":"2024-09-12T01:07:57.368682+0000","last_fullsized":"2024-09-12T01:07:57.368682+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'279","last_scrub_stamp":"2024-09-12T01:07:57.368482+0000","last_deep_scrub":"267'279","last_deep_scrub_stamp":"2024-09-12T01:07:57.368482+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.368482+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:44.666804+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1024,"num_write":366,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.414890+0000","last_change":"2024-09-12T01:08:06.414890+0000","last_active":"2024-09-12T01:08:06.414890+0000","last_peered":"2024-09-12T01:08:06.414890+0000","last_clean":"2024-09-12T01:08:06.414890+0000","last_became_active":"2024-09-12T00:21:50.543639+0000","last_became_peered":"2024-09-12T00:21:50.543639+0000","last_unstale":"2024-09-12T01:08:06.414890+0000","last_undegraded":"2024-09-12T01:08:06.414890+0000","last_fullsized":"2024-09-12T01:08:06.414890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.414613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.414613+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.414613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:57.975178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2374","reported_seq":4224,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.568799+0000","last_change":"2024-09-12T01:07:58.568799+0000","last_active":"2024-09-12T01:07:58.568799+0000","last_peered":"2024-09-12T01:07:58.568799+0000","last_clean":"2024-09-12T01:07:58.568799+0000","last_became_active":"2024-09-12T00:21:52.537701+0000","last_became_peered":"2024-09-12T00:21:52.537701+0000","last_unstale":"2024-09-12T01:07:58.568799+0000","last_undegraded":"2024-09-12T01:07:58.568799+0000","last_fullsized":"2024-09-12T01:07:58.568799+0000","mapping_epoch":36,"log_start":"267'2300","ondisk_log_start":"267'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2374","last_scrub_stamp":"2024-09-12T01:07:58.568601+0000","last_deep_scrub":"267'2374","last_deep_scrub_stamp":"2024-09-12T01:07:58.568601+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.568601+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":2300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:41.122451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5977,"num_write":4771,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'112","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.271862+0000","last_change":"2024-09-12T01:07:41.271862+0000","last_active":"2024-09-12T01:07:41.271862+0000","last_peered":"2024-09-12T01:07:41.271862+0000","last_clean":"2024-09-12T01:07:41.271862+0000","last_became_active":"2024-09-12T00:21:44.494313+0000","last_became_peered":"2024-09-12T00:21:44.494313+0000","last_unstale":"2024-09-12T01:07:41.271862+0000","last_undegraded":"2024-09-12T01:07:41.271862+0000","last_fullsized":"2024-09-12T01:07:41.271862+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'112","last_scrub_stamp":"2024-09-12T01:07:41.271428+0000","last_deep_scrub":"267'112","last_deep_scrub_stamp":"2024-09-12T01:07:41.271428+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.271428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:21.911085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":397,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'345","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.915359+0000","last_change":"2024-09-12T01:07:49.915359+0000","last_active":"2024-09-12T01:07:49.915359+0000","last_peered":"2024-09-12T01:07:49.915359+0000","last_clean":"2024-09-12T01:07:49.915359+0000","last_became_active":"2024-09-12T00:21:42.529372+0000","last_became_peered":"2024-09-12T00:21:42.529372+0000","last_unstale":"2024-09-12T01:07:49.915359+0000","last_undegraded":"2024-09-12T01:07:49.915359+0000","last_fullsized":"2024-09-12T01:07:49.915359+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T01:07:49.915120+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T01:07:49.915120+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.915120+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:20.870747+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12055,"num_write":1241,"num_write_kb":31958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.018618+0000","last_change":"2024-09-12T01:07:57.018618+0000","last_active":"2024-09-12T01:07:57.018618+0000","last_peered":"2024-09-12T01:07:57.018618+0000","last_clean":"2024-09-12T01:07:57.018618+0000","last_became_active":"2024-09-12T00:21:46.511704+0000","last_became_peered":"2024-09-12T00:21:46.511704+0000","last_unstale":"2024-09-12T01:07:57.018618+0000","last_undegraded":"2024-09-12T01:07:57.018618+0000","last_fullsized":"2024-09-12T01:07:57.018618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.018450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.018450+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.018450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:09.211088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'293","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.148340+0000","last_change":"2024-09-12T01:08:07.148340+0000","last_active":"2024-09-12T01:08:07.148340+0000","last_peered":"2024-09-12T01:08:07.148340+0000","last_clean":"2024-09-12T01:08:07.148340+0000","last_became_active":"2024-09-12T00:21:48.551752+0000","last_became_peered":"2024-09-12T00:21:48.551752+0000","last_unstale":"2024-09-12T01:08:07.148340+0000","last_undegraded":"2024-09-12T01:08:07.148340+0000","last_fullsized":"2024-09-12T01:08:07.148340+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'293","last_scrub_stamp":"2024-09-12T01:08:07.148130+0000","last_deep_scrub":"267'293","last_deep_scrub_stamp":"2024-09-12T01:08:07.148130+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.148130+0000","objects_scrubbed":9,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:20.946763+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42024,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":467,"num_read_kb":1006,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'782","reported_seq":4668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.907857+0000","last_change":"2024-09-12T01:08:04.907857+0000","last_active":"2024-09-12T01:08:04.907857+0000","last_peered":"2024-09-12T01:08:04.907857+0000","last_clean":"2024-09-12T01:08:04.907857+0000","last_became_active":"2024-09-12T00:21:50.561680+0000","last_became_peered":"2024-09-12T00:21:50.561680+0000","last_unstale":"2024-09-12T01:08:04.907857+0000","last_undegraded":"2024-09-12T01:08:04.907857+0000","last_fullsized":"2024-09-12T01:08:04.907857+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:08:04.907672+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:08:04.907672+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.907672+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":701,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:00.038489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'120","reported_seq":626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.318010+0000","last_change":"2024-09-12T01:08:03.318010+0000","last_active":"2024-09-12T01:08:03.318010+0000","last_peered":"2024-09-12T01:08:03.318010+0000","last_clean":"2024-09-12T01:08:03.318010+0000","last_became_active":"2024-09-12T00:21:52.546889+0000","last_became_peered":"2024-09-12T00:21:52.546889+0000","last_unstale":"2024-09-12T01:08:03.318010+0000","last_undegraded":"2024-09-12T01:08:03.318010+0000","last_fullsized":"2024-09-12T01:08:03.318010+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-12T01:08:03.317820+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-12T01:08:03.317820+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.317820+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.621333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":121,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'188","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.987877+0000","last_change":"2024-09-12T01:07:49.987877+0000","last_active":"2024-09-12T01:07:49.987877+0000","last_peered":"2024-09-12T01:07:49.987877+0000","last_clean":"2024-09-12T01:07:49.987877+0000","last_became_active":"2024-09-12T00:21:44.518595+0000","last_became_peered":"2024-09-12T00:21:44.518595+0000","last_unstale":"2024-09-12T01:07:49.987877+0000","last_undegraded":"2024-09-12T01:07:49.987877+0000","last_fullsized":"2024-09-12T01:07:49.987877+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'188","last_scrub_stamp":"2024-09-12T01:07:49.987691+0000","last_deep_scrub":"267'188","last_deep_scrub_stamp":"2024-09-12T01:07:49.987691+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.987691+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:57.684878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":785,"num_read_kb":656,"num_write":281,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'267","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.002912+0000","last_change":"2024-09-12T01:07:33.002912+0000","last_active":"2024-09-12T01:07:33.002912+0000","last_peered":"2024-09-12T01:07:33.002912+0000","last_clean":"2024-09-12T01:07:33.002912+0000","last_became_active":"2024-09-12T00:21:42.497992+0000","last_became_peered":"2024-09-12T00:21:42.497992+0000","last_unstale":"2024-09-12T01:07:33.002912+0000","last_undegraded":"2024-09-12T01:07:33.002912+0000","last_fullsized":"2024-09-12T01:07:33.002912+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'267","last_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_deep_scrub":"267'267","last_deep_scrub_stamp":"2024-09-12T01:07:33.002601+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.002601+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:20.061473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":82463,"num_write":854,"num_write_kb":27861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.333366+0000","last_change":"2024-09-12T01:07:52.333366+0000","last_active":"2024-09-12T01:07:52.333366+0000","last_peered":"2024-09-12T01:07:52.333366+0000","last_clean":"2024-09-12T01:07:52.333366+0000","last_became_active":"2024-09-12T00:21:46.511365+0000","last_became_peered":"2024-09-12T00:21:46.511365+0000","last_unstale":"2024-09-12T01:07:52.333366+0000","last_undegraded":"2024-09-12T01:07:52.333366+0000","last_fullsized":"2024-09-12T01:07:52.333366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.333162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.333162+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.333162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:19.202850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'480","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.330685+0000","last_change":"2024-09-12T01:07:58.330685+0000","last_active":"2024-09-12T01:07:58.330685+0000","last_peered":"2024-09-12T01:07:58.330685+0000","last_clean":"2024-09-12T01:07:58.330685+0000","last_became_active":"2024-09-12T00:21:48.524173+0000","last_became_peered":"2024-09-12T00:21:48.524173+0000","last_unstale":"2024-09-12T01:07:58.330685+0000","last_undegraded":"2024-09-12T01:07:58.330685+0000","last_fullsized":"2024-09-12T01:07:58.330685+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'480","last_scrub_stamp":"2024-09-12T01:07:58.330481+0000","last_deep_scrub":"267'480","last_deep_scrub_stamp":"2024-09-12T01:07:58.330481+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.330481+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.060816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1944,"num_write":668,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.942552+0000","last_change":"2024-09-12T01:08:03.942552+0000","last_active":"2024-09-12T01:08:03.942552+0000","last_peered":"2024-09-12T01:08:03.942552+0000","last_clean":"2024-09-12T01:08:03.942552+0000","last_became_active":"2024-09-12T00:21:50.561720+0000","last_became_peered":"2024-09-12T00:21:50.561720+0000","last_unstale":"2024-09-12T01:08:03.942552+0000","last_undegraded":"2024-09-12T01:08:03.942552+0000","last_fullsized":"2024-09-12T01:08:03.942552+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:03.942372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:03.942372+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.942372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:41.505555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'126","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.404868+0000","last_change":"2024-09-12T01:07:57.404868+0000","last_active":"2024-09-12T01:07:57.404868+0000","last_peered":"2024-09-12T01:07:57.404868+0000","last_clean":"2024-09-12T01:07:57.404868+0000","last_became_active":"2024-09-12T00:21:52.565276+0000","last_became_peered":"2024-09-12T00:21:52.565276+0000","last_unstale":"2024-09-12T01:07:57.404868+0000","last_undegraded":"2024-09-12T01:07:57.404868+0000","last_fullsized":"2024-09-12T01:07:57.404868+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-09-12T01:07:57.404662+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-09-12T01:07:57.404662+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.404662+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:42.679468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'92","reported_seq":695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.018654+0000","last_change":"2024-09-12T01:07:41.018654+0000","last_active":"2024-09-12T01:07:41.018654+0000","last_peered":"2024-09-12T01:07:41.018654+0000","last_clean":"2024-09-12T01:07:41.018654+0000","last_became_active":"2024-09-12T00:21:44.504866+0000","last_became_peered":"2024-09-12T00:21:44.504866+0000","last_unstale":"2024-09-12T01:07:41.018654+0000","last_undegraded":"2024-09-12T01:07:41.018654+0000","last_fullsized":"2024-09-12T01:07:41.018654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'92","last_scrub_stamp":"2024-09-12T01:07:41.018456+0000","last_deep_scrub":"267'92","last_deep_scrub_stamp":"2024-09-12T01:07:41.018456+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.018456+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:57.826698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":364,"num_write":125,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'360","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.122169+0000","last_change":"2024-09-12T01:07:35.122169+0000","last_active":"2024-09-12T01:07:35.122169+0000","last_peered":"2024-09-12T01:07:35.122169+0000","last_clean":"2024-09-12T01:07:35.122169+0000","last_became_active":"2024-09-12T00:21:42.511762+0000","last_became_peered":"2024-09-12T00:21:42.511762+0000","last_unstale":"2024-09-12T01:07:35.122169+0000","last_undegraded":"2024-09-12T01:07:35.122169+0000","last_fullsized":"2024-09-12T01:07:35.122169+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'360","last_scrub_stamp":"2024-09-12T01:07:35.121973+0000","last_deep_scrub":"267'360","last_deep_scrub_stamp":"2024-09-12T01:07:35.121973+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.121973+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:10.214969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":36352,"num_write":1101,"num_write_kb":41720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.241978+0000","last_change":"2024-09-12T01:07:48.241978+0000","last_active":"2024-09-12T01:07:48.241978+0000","last_peered":"2024-09-12T01:07:48.241978+0000","last_clean":"2024-09-12T01:07:48.241978+0000","last_became_active":"2024-09-12T00:21:46.514486+0000","last_became_peered":"2024-09-12T00:21:46.514486+0000","last_unstale":"2024-09-12T01:07:48.241978+0000","last_undegraded":"2024-09-12T01:07:48.241978+0000","last_fullsized":"2024-09-12T01:07:48.241978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.241783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.241783+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.241783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.010975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'324","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.612716+0000","last_change":"2024-09-12T01:07:51.612716+0000","last_active":"2024-09-12T01:07:51.612716+0000","last_peered":"2024-09-12T01:07:51.612716+0000","last_clean":"2024-09-12T01:07:51.612716+0000","last_became_active":"2024-09-12T00:21:48.547356+0000","last_became_peered":"2024-09-12T00:21:48.547356+0000","last_unstale":"2024-09-12T01:07:51.612716+0000","last_undegraded":"2024-09-12T01:07:51.612716+0000","last_fullsized":"2024-09-12T01:07:51.612716+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-12T01:07:51.612333+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-12T01:07:51.612333+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.612333+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.550390+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55196,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":458,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.258274+0000","last_change":"2024-09-12T01:07:52.258274+0000","last_active":"2024-09-12T01:07:52.258274+0000","last_peered":"2024-09-12T01:07:52.258274+0000","last_clean":"2024-09-12T01:07:52.258274+0000","last_became_active":"2024-09-12T00:21:50.556220+0000","last_became_peered":"2024-09-12T00:21:50.556220+0000","last_unstale":"2024-09-12T01:07:52.258274+0000","last_undegraded":"2024-09-12T01:07:52.258274+0000","last_fullsized":"2024-09-12T01:07:52.258274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.258094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.258094+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.258094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.161738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'130","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.875681+0000","last_change":"2024-09-12T01:08:07.875681+0000","last_active":"2024-09-12T01:08:07.875681+0000","last_peered":"2024-09-12T01:08:07.875681+0000","last_clean":"2024-09-12T01:08:07.875681+0000","last_became_active":"2024-09-12T00:21:52.567273+0000","last_became_peered":"2024-09-12T00:21:52.567273+0000","last_unstale":"2024-09-12T01:08:07.875681+0000","last_undegraded":"2024-09-12T01:08:07.875681+0000","last_fullsized":"2024-09-12T01:08:07.875681+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'130","last_scrub_stamp":"2024-09-12T01:08:07.875498+0000","last_deep_scrub":"267'130","last_deep_scrub_stamp":"2024-09-12T01:08:07.875498+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.875498+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:35.875359+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'124","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.917629+0000","last_change":"2024-09-12T01:07:53.917629+0000","last_active":"2024-09-12T01:07:53.917629+0000","last_peered":"2024-09-12T01:07:53.917629+0000","last_clean":"2024-09-12T01:07:53.917629+0000","last_became_active":"2024-09-12T00:21:44.502965+0000","last_became_peered":"2024-09-12T00:21:44.502965+0000","last_unstale":"2024-09-12T01:07:53.917629+0000","last_undegraded":"2024-09-12T01:07:53.917629+0000","last_fullsized":"2024-09-12T01:07:53.917629+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'124","last_scrub_stamp":"2024-09-12T01:07:53.917407+0000","last_deep_scrub":"267'124","last_deep_scrub_stamp":"2024-09-12T01:07:53.917407+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.917407+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:24.103740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":435,"num_write":188,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'354","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.387251+0000","last_change":"2024-09-12T01:07:37.386999+0000","last_active":"2024-09-12T01:07:37.387251+0000","last_peered":"2024-09-12T01:07:37.387251+0000","last_clean":"2024-09-12T01:07:37.387251+0000","last_became_active":"2024-09-12T00:22:13.520026+0000","last_became_peered":"2024-09-12T00:22:13.520026+0000","last_unstale":"2024-09-12T01:07:37.387251+0000","last_undegraded":"2024-09-12T01:07:37.387251+0000","last_fullsized":"2024-09-12T01:07:37.387251+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T01:07:37.386628+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T01:07:37.386628+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.386628+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:48.359725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254518,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":616,"num_read_kb":38314,"num_write":1135,"num_write_kb":31045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.002454+0000","last_change":"2024-09-12T01:08:00.002454+0000","last_active":"2024-09-12T01:08:00.002454+0000","last_peered":"2024-09-12T01:08:00.002454+0000","last_clean":"2024-09-12T01:08:00.002454+0000","last_became_active":"2024-09-12T00:21:46.507456+0000","last_became_peered":"2024-09-12T00:21:46.507456+0000","last_unstale":"2024-09-12T01:08:00.002454+0000","last_undegraded":"2024-09-12T01:08:00.002454+0000","last_fullsized":"2024-09-12T01:08:00.002454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.002274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.002274+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.002274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:36.717809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'317","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.994766+0000","last_change":"2024-09-12T01:08:00.994766+0000","last_active":"2024-09-12T01:08:00.994766+0000","last_peered":"2024-09-12T01:08:00.994766+0000","last_clean":"2024-09-12T01:08:00.994766+0000","last_became_active":"2024-09-12T00:21:48.535782+0000","last_became_peered":"2024-09-12T00:21:48.535782+0000","last_unstale":"2024-09-12T01:08:00.994766+0000","last_undegraded":"2024-09-12T01:08:00.994766+0000","last_fullsized":"2024-09-12T01:08:00.994766+0000","mapping_epoch":32,"log_start":"267'301","ondisk_log_start":"267'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T01:08:00.994518+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T01:08:00.994518+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.994518+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:25.545285+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1134,"num_write":412,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'751","reported_seq":2254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.277045+0000","last_change":"2024-09-12T01:07:50.277045+0000","last_active":"2024-09-12T01:07:50.277045+0000","last_peered":"2024-09-12T01:07:50.277045+0000","last_clean":"2024-09-12T01:07:50.277045+0000","last_became_active":"2024-09-12T00:21:50.557158+0000","last_became_peered":"2024-09-12T00:21:50.557158+0000","last_unstale":"2024-09-12T01:07:50.277045+0000","last_undegraded":"2024-09-12T01:07:50.277045+0000","last_fullsized":"2024-09-12T01:07:50.277045+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-12T01:07:50.276867+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-12T01:07:50.276867+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.276867+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:14.558606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'137","reported_seq":650,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.322253+0000","last_change":"2024-09-12T01:08:01.322253+0000","last_active":"2024-09-12T01:08:01.322253+0000","last_peered":"2024-09-12T01:08:01.322253+0000","last_clean":"2024-09-12T01:08:01.322253+0000","last_became_active":"2024-09-12T00:21:52.545876+0000","last_became_peered":"2024-09-12T00:21:52.545876+0000","last_unstale":"2024-09-12T01:08:01.322253+0000","last_undegraded":"2024-09-12T01:08:01.322253+0000","last_fullsized":"2024-09-12T01:08:01.322253+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-12T01:08:01.322059+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-12T01:08:01.322059+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.322059+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:03.008393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":172,"num_write":354,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'141","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.298300+0000","last_change":"2024-09-12T01:07:42.298300+0000","last_active":"2024-09-12T01:07:42.298300+0000","last_peered":"2024-09-12T01:07:42.298300+0000","last_clean":"2024-09-12T01:07:42.298300+0000","last_became_active":"2024-09-12T00:21:44.494386+0000","last_became_peered":"2024-09-12T00:21:44.494386+0000","last_unstale":"2024-09-12T01:07:42.298300+0000","last_undegraded":"2024-09-12T01:07:42.298300+0000","last_fullsized":"2024-09-12T01:07:42.298300+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T01:07:42.298107+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T01:07:42.298107+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.298107+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:49.298297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":627,"num_read_kb":527,"num_write":195,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'416","reported_seq":1113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.903721+0000","last_change":"2024-09-12T01:07:34.903721+0000","last_active":"2024-09-12T01:07:34.903721+0000","last_peered":"2024-09-12T01:07:34.903721+0000","last_clean":"2024-09-12T01:07:34.903721+0000","last_became_active":"2024-09-12T00:21:42.528782+0000","last_became_peered":"2024-09-12T00:21:42.528782+0000","last_unstale":"2024-09-12T01:07:34.903721+0000","last_undegraded":"2024-09-12T01:07:34.903721+0000","last_fullsized":"2024-09-12T01:07:34.903721+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-12T01:07:34.903475+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-12T01:07:34.903475+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.903475+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.315924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170245,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":31515,"num_write":1240,"num_write_kb":36332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"267'10","reported_seq":1955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.565753+0000","last_change":"2024-09-12T01:07:47.565753+0000","last_active":"2024-09-12T01:07:47.565753+0000","last_peered":"2024-09-12T01:07:47.565753+0000","last_clean":"2024-09-12T01:07:47.565753+0000","last_became_active":"2024-09-12T00:21:46.503412+0000","last_became_peered":"2024-09-12T00:21:46.503412+0000","last_unstale":"2024-09-12T01:07:47.565753+0000","last_undegraded":"2024-09-12T01:07:47.565753+0000","last_fullsized":"2024-09-12T01:07:47.565753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T01:07:47.565529+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T01:07:47.565529+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.565529+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:17.675182+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1686,"num_read_kb":2152,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'78","reported_seq":601,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.356185+0000","last_change":"2024-09-12T01:07:55.356185+0000","last_active":"2024-09-12T01:07:55.356185+0000","last_peered":"2024-09-12T01:07:55.356185+0000","last_clean":"2024-09-12T01:07:55.356185+0000","last_became_active":"2024-09-12T00:21:48.545388+0000","last_became_peered":"2024-09-12T00:21:48.545388+0000","last_unstale":"2024-09-12T01:07:55.356185+0000","last_undegraded":"2024-09-12T01:07:55.356185+0000","last_fullsized":"2024-09-12T01:07:55.356185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'78","last_scrub_stamp":"2024-09-12T01:07:55.355975+0000","last_deep_scrub":"267'78","last_deep_scrub_stamp":"2024-09-12T01:07:55.355975+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.355975+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:43.494932+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":4019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.572399+0000","last_change":"2024-09-12T01:07:54.572399+0000","last_active":"2024-09-12T01:07:54.572399+0000","last_peered":"2024-09-12T01:07:54.572399+0000","last_clean":"2024-09-12T01:07:54.572399+0000","last_became_active":"2024-09-12T00:21:50.536672+0000","last_became_peered":"2024-09-12T00:21:50.536672+0000","last_unstale":"2024-09-12T01:07:54.572399+0000","last_undegraded":"2024-09-12T01:07:54.572399+0000","last_fullsized":"2024-09-12T01:07:54.572399+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-12T01:07:54.572215+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-12T01:07:54.572215+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.572215+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:58.399564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'123","reported_seq":644,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.191191+0000","last_change":"2024-09-12T01:07:59.191191+0000","last_active":"2024-09-12T01:07:59.191191+0000","last_peered":"2024-09-12T01:07:59.191191+0000","last_clean":"2024-09-12T01:07:59.191191+0000","last_became_active":"2024-09-12T00:21:52.556523+0000","last_became_peered":"2024-09-12T00:21:52.556523+0000","last_unstale":"2024-09-12T01:07:59.191191+0000","last_undegraded":"2024-09-12T01:07:59.191191+0000","last_fullsized":"2024-09-12T01:07:59.191191+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T01:07:59.191010+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T01:07:59.191010+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.191010+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:19.235147+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":161,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'217","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.091763+0000","last_change":"2024-09-12T01:07:40.091763+0000","last_active":"2024-09-12T01:07:40.091763+0000","last_peered":"2024-09-12T01:07:40.091763+0000","last_clean":"2024-09-12T01:07:40.091763+0000","last_became_active":"2024-09-12T00:21:44.514085+0000","last_became_peered":"2024-09-12T00:21:44.514085+0000","last_unstale":"2024-09-12T01:07:40.091763+0000","last_undegraded":"2024-09-12T01:07:40.091763+0000","last_fullsized":"2024-09-12T01:07:40.091763+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'217","last_scrub_stamp":"2024-09-12T01:07:40.091578+0000","last_deep_scrub":"267'217","last_deep_scrub_stamp":"2024-09-12T01:07:40.091578+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.091578+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:49.279255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":987,"num_read_kb":820,"num_write":332,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'341","reported_seq":965,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.355510+0000","last_change":"2024-09-12T01:07:36.355510+0000","last_active":"2024-09-12T01:07:36.355510+0000","last_peered":"2024-09-12T01:07:36.355510+0000","last_clean":"2024-09-12T01:07:36.355510+0000","last_became_active":"2024-09-12T00:21:42.484728+0000","last_became_peered":"2024-09-12T00:21:42.484728+0000","last_unstale":"2024-09-12T01:07:36.355510+0000","last_undegraded":"2024-09-12T01:07:36.355510+0000","last_fullsized":"2024-09-12T01:07:36.355510+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:36.355185+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:36.355185+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.355185+0000","objects_scrubbed":9,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:41.361142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":1781,"num_write":1014,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.017730+0000","last_change":"2024-09-12T01:08:01.017730+0000","last_active":"2024-09-12T01:08:01.017730+0000","last_peered":"2024-09-12T01:08:01.017730+0000","last_clean":"2024-09-12T01:08:01.017730+0000","last_became_active":"2024-09-12T00:21:46.515469+0000","last_became_peered":"2024-09-12T00:21:46.515469+0000","last_unstale":"2024-09-12T01:08:01.017730+0000","last_undegraded":"2024-09-12T01:08:01.017730+0000","last_fullsized":"2024-09-12T01:08:01.017730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:01.017496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:01.017496+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.017496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:43.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'349","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.611743+0000","last_change":"2024-09-12T01:07:50.611743+0000","last_active":"2024-09-12T01:07:50.611743+0000","last_peered":"2024-09-12T01:07:50.611743+0000","last_clean":"2024-09-12T01:07:50.611743+0000","last_became_active":"2024-09-12T00:21:48.523392+0000","last_became_peered":"2024-09-12T00:21:48.523392+0000","last_unstale":"2024-09-12T01:07:50.611743+0000","last_undegraded":"2024-09-12T01:07:50.611743+0000","last_fullsized":"2024-09-12T01:07:50.611743+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:50.611343+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:50.611343+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.611343+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:19.848968+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50746,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1171,"num_write":440,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.158670+0000","last_change":"2024-09-12T01:07:53.158670+0000","last_active":"2024-09-12T01:07:53.158670+0000","last_peered":"2024-09-12T01:07:53.158670+0000","last_clean":"2024-09-12T01:07:53.158670+0000","last_became_active":"2024-09-12T00:21:50.566831+0000","last_became_peered":"2024-09-12T00:21:50.566831+0000","last_unstale":"2024-09-12T01:07:53.158670+0000","last_undegraded":"2024-09-12T01:07:53.158670+0000","last_fullsized":"2024-09-12T01:07:53.158670+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.158455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.158455+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.158455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.192498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'160","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.400800+0000","last_change":"2024-09-12T01:07:58.400800+0000","last_active":"2024-09-12T01:07:58.400800+0000","last_peered":"2024-09-12T01:07:58.400800+0000","last_clean":"2024-09-12T01:07:58.400800+0000","last_became_active":"2024-09-12T00:21:52.562716+0000","last_became_peered":"2024-09-12T00:21:52.562716+0000","last_unstale":"2024-09-12T01:07:58.400800+0000","last_undegraded":"2024-09-12T01:07:58.400800+0000","last_fullsized":"2024-09-12T01:07:58.400800+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-12T01:07:58.400599+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-12T01:07:58.400599+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.400599+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:15.165779+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":186,"num_write":388,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'137","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.915375+0000","last_change":"2024-09-12T01:07:52.915375+0000","last_active":"2024-09-12T01:07:52.915375+0000","last_peered":"2024-09-12T01:07:52.915375+0000","last_clean":"2024-09-12T01:07:52.915375+0000","last_became_active":"2024-09-12T00:21:44.502832+0000","last_became_peered":"2024-09-12T00:21:44.502832+0000","last_unstale":"2024-09-12T01:07:52.915375+0000","last_undegraded":"2024-09-12T01:07:52.915375+0000","last_fullsized":"2024-09-12T01:07:52.915375+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-12T01:07:52.915187+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-12T01:07:52.915187+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.915187+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:13.701531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":521,"num_write":201,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.580210+0000","last_change":"2024-09-12T01:07:32.580034+0000","last_active":"2024-09-12T01:07:32.580210+0000","last_peered":"2024-09-12T01:07:32.580210+0000","last_clean":"2024-09-12T01:07:32.580210+0000","last_became_active":"2024-09-12T00:21:22.022295+0000","last_became_peered":"2024-09-12T00:21:22.022295+0000","last_unstale":"2024-09-12T01:07:32.580210+0000","last_undegraded":"2024-09-12T01:07:32.580210+0000","last_fullsized":"2024-09-12T01:07:32.580210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:07:32.579842+0000","last_clean_scrub_stamp":"2024-09-12T01:07:32.579842+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:04.507720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.906029+0000","last_change":"2024-09-12T01:07:35.906029+0000","last_active":"2024-09-12T01:07:35.906029+0000","last_peered":"2024-09-12T01:07:35.906029+0000","last_clean":"2024-09-12T01:07:35.906029+0000","last_became_active":"2024-09-12T00:21:26.359127+0000","last_became_peered":"2024-09-12T00:21:26.359127+0000","last_unstale":"2024-09-12T01:07:35.906029+0000","last_undegraded":"2024-09-12T01:07:35.906029+0000","last_fullsized":"2024-09-12T01:07:35.906029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:35.905826+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:35.905826+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.905826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:16.286458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013210260000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'330","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.395101+0000","last_change":"2024-09-12T01:07:34.394877+0000","last_active":"2024-09-12T01:07:34.395101+0000","last_peered":"2024-09-12T01:07:34.395101+0000","last_clean":"2024-09-12T01:07:34.395101+0000","last_became_active":"2024-09-12T00:21:42.513672+0000","last_became_peered":"2024-09-12T00:21:42.513672+0000","last_unstale":"2024-09-12T01:07:34.395101+0000","last_undegraded":"2024-09-12T01:07:34.395101+0000","last_fullsized":"2024-09-12T01:07:34.395101+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T01:07:34.394679+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.394679+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:03.112904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":4546,"num_write":1074,"num_write_kb":26678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.033296+0000","last_change":"2024-09-12T01:07:53.033296+0000","last_active":"2024-09-12T01:07:53.033296+0000","last_peered":"2024-09-12T01:07:53.033296+0000","last_clean":"2024-09-12T01:07:53.033296+0000","last_became_active":"2024-09-12T00:21:46.506196+0000","last_became_peered":"2024-09-12T00:21:46.506196+0000","last_unstale":"2024-09-12T01:07:53.033296+0000","last_undegraded":"2024-09-12T01:07:53.033296+0000","last_fullsized":"2024-09-12T01:07:53.033296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.033120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.033120+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.033120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:50.956403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'739","reported_seq":1458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.125113+0000","last_change":"2024-09-12T01:08:06.125113+0000","last_active":"2024-09-12T01:08:06.125113+0000","last_peered":"2024-09-12T01:08:06.125113+0000","last_clean":"2024-09-12T01:08:06.125113+0000","last_became_active":"2024-09-12T00:21:48.544327+0000","last_became_peered":"2024-09-12T00:21:48.544327+0000","last_unstale":"2024-09-12T01:08:06.125113+0000","last_undegraded":"2024-09-12T01:08:06.125113+0000","last_fullsized":"2024-09-12T01:08:06.125113+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'739","last_scrub_stamp":"2024-09-12T01:08:06.124915+0000","last_deep_scrub":"267'739","last_deep_scrub_stamp":"2024-09-12T01:08:06.124915+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.124915+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:14.274030+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135809,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1416,"num_read_kb":3269,"num_write":1306,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89362,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.920070+0000","last_change":"2024-09-12T01:08:02.920070+0000","last_active":"2024-09-12T01:08:02.920070+0000","last_peered":"2024-09-12T01:08:02.920070+0000","last_clean":"2024-09-12T01:08:02.920070+0000","last_became_active":"2024-09-12T00:21:50.564442+0000","last_became_peered":"2024-09-12T00:21:50.564442+0000","last_unstale":"2024-09-12T01:08:02.920070+0000","last_undegraded":"2024-09-12T01:08:02.920070+0000","last_fullsized":"2024-09-12T01:08:02.920070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.919883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.919883+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.919883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:43.295107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'208","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.998487+0000","last_change":"2024-09-12T01:07:53.998487+0000","last_active":"2024-09-12T01:07:53.998487+0000","last_peered":"2024-09-12T01:07:53.998487+0000","last_clean":"2024-09-12T01:07:53.998487+0000","last_became_active":"2024-09-12T00:21:52.550903+0000","last_became_peered":"2024-09-12T00:21:52.550903+0000","last_unstale":"2024-09-12T01:07:53.998487+0000","last_undegraded":"2024-09-12T01:07:53.998487+0000","last_fullsized":"2024-09-12T01:07:53.998487+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-12T01:07:53.998298+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-12T01:07:53.998298+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.998298+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:09.883248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":429,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'100","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.989390+0000","last_change":"2024-09-12T01:07:48.989390+0000","last_active":"2024-09-12T01:07:48.989390+0000","last_peered":"2024-09-12T01:07:48.989390+0000","last_clean":"2024-09-12T01:07:48.989390+0000","last_became_active":"2024-09-12T00:21:44.518873+0000","last_became_peered":"2024-09-12T00:21:44.518873+0000","last_unstale":"2024-09-12T01:07:48.989390+0000","last_undegraded":"2024-09-12T01:07:48.989390+0000","last_fullsized":"2024-09-12T01:07:48.989390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-09-12T01:07:48.989211+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-09-12T01:07:48.989211+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.989211+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:37.038222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":399,"num_write":140,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.899210+0000","last_change":"2024-09-12T01:07:33.899120+0000","last_active":"2024-09-12T01:07:33.899210+0000","last_peered":"2024-09-12T01:07:33.899210+0000","last_clean":"2024-09-12T01:07:33.899210+0000","last_became_active":"2024-09-12T00:21:26.240454+0000","last_became_peered":"2024-09-12T00:21:26.240454+0000","last_unstale":"2024-09-12T01:07:33.899210+0000","last_undegraded":"2024-09-12T01:07:33.899210+0000","last_fullsized":"2024-09-12T01:07:33.899210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:33.899012+0000","last_clean_scrub_stamp":"2024-09-12T01:07:33.899012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:18.503999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012721130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'343","reported_seq":1176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.346185+0000","last_change":"2024-09-12T01:07:35.346185+0000","last_active":"2024-09-12T01:07:35.346185+0000","last_peered":"2024-09-12T01:07:35.346185+0000","last_clean":"2024-09-12T01:07:35.346185+0000","last_became_active":"2024-09-12T00:21:42.530049+0000","last_became_peered":"2024-09-12T00:21:42.530049+0000","last_unstale":"2024-09-12T01:07:35.346185+0000","last_undegraded":"2024-09-12T01:07:35.346185+0000","last_fullsized":"2024-09-12T01:07:35.346185+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T01:07:35.345949+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T01:07:35.345949+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.345949+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.411177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":794,"num_read_kb":7845,"num_write":1116,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.018870+0000","last_change":"2024-09-12T01:08:00.018870+0000","last_active":"2024-09-12T01:08:00.018870+0000","last_peered":"2024-09-12T01:08:00.018870+0000","last_clean":"2024-09-12T01:08:00.018870+0000","last_became_active":"2024-09-12T00:21:46.506303+0000","last_became_peered":"2024-09-12T00:21:46.506303+0000","last_unstale":"2024-09-12T01:08:00.018870+0000","last_undegraded":"2024-09-12T01:08:00.018870+0000","last_fullsized":"2024-09-12T01:08:00.018870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.018690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.018690+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.018690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:02.431074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1273","reported_seq":2766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.281768+0000","last_change":"2024-09-12T01:07:51.281768+0000","last_active":"2024-09-12T01:07:51.281768+0000","last_peered":"2024-09-12T01:07:51.281768+0000","last_clean":"2024-09-12T01:07:51.281768+0000","last_became_active":"2024-09-12T00:21:48.538447+0000","last_became_peered":"2024-09-12T00:21:48.538447+0000","last_unstale":"2024-09-12T01:07:51.281768+0000","last_undegraded":"2024-09-12T01:07:51.281768+0000","last_fullsized":"2024-09-12T01:07:51.281768+0000","mapping_epoch":32,"log_start":"267'1200","ondisk_log_start":"267'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1273","last_scrub_stamp":"2024-09-12T01:07:51.281563+0000","last_deep_scrub":"267'1273","last_deep_scrub_stamp":"2024-09-12T01:07:51.281563+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.281563+0000","objects_scrubbed":12,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.388345+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157796,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2036,"num_read_kb":3848,"num_write":1138,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.186607+0000","last_change":"2024-09-12T01:08:10.186607+0000","last_active":"2024-09-12T01:08:10.186607+0000","last_peered":"2024-09-12T01:08:10.186607+0000","last_clean":"2024-09-12T01:08:10.186607+0000","last_became_active":"2024-09-12T00:21:50.568353+0000","last_became_peered":"2024-09-12T00:21:50.568353+0000","last_unstale":"2024-09-12T01:08:10.186607+0000","last_undegraded":"2024-09-12T01:08:10.186607+0000","last_fullsized":"2024-09-12T01:08:10.186607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:10.186425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:10.186425+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.186425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:21.871936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'223","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.863911+0000","last_change":"2024-09-12T01:08:08.863911+0000","last_active":"2024-09-12T01:08:08.863911+0000","last_peered":"2024-09-12T01:08:08.863911+0000","last_clean":"2024-09-12T01:08:08.863911+0000","last_became_active":"2024-09-12T00:21:52.559325+0000","last_became_peered":"2024-09-12T00:21:52.559325+0000","last_unstale":"2024-09-12T01:08:08.863911+0000","last_undegraded":"2024-09-12T01:08:08.863911+0000","last_fullsized":"2024-09-12T01:08:08.863911+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-12T01:08:08.863610+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-12T01:08:08.863610+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.863610+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:28.930627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":373,"num_write":495,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'235","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.322614+0000","last_change":"2024-09-12T01:07:47.322614+0000","last_active":"2024-09-12T01:07:47.322614+0000","last_peered":"2024-09-12T01:07:47.322614+0000","last_clean":"2024-09-12T01:07:47.322614+0000","last_became_active":"2024-09-12T00:21:44.499405+0000","last_became_peered":"2024-09-12T00:21:44.499405+0000","last_unstale":"2024-09-12T01:07:47.322614+0000","last_undegraded":"2024-09-12T01:07:47.322614+0000","last_fullsized":"2024-09-12T01:07:47.322614+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'235","last_scrub_stamp":"2024-09-12T01:07:47.322434+0000","last_deep_scrub":"267'235","last_deep_scrub_stamp":"2024-09-12T01:07:47.322434+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.322434+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:14.108801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":847,"num_write":402,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.153871+0000","last_change":"2024-09-12T01:07:36.153871+0000","last_active":"2024-09-12T01:07:36.153871+0000","last_peered":"2024-09-12T01:07:36.153871+0000","last_clean":"2024-09-12T01:07:36.153871+0000","last_became_active":"2024-09-12T00:21:26.234640+0000","last_became_peered":"2024-09-12T00:21:26.234640+0000","last_unstale":"2024-09-12T01:07:36.153871+0000","last_undegraded":"2024-09-12T01:07:36.153871+0000","last_fullsized":"2024-09-12T01:07:36.153871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:36.153692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:36.153692+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.153692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:30.299331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012698270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'318","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.085677+0000","last_change":"2024-09-12T01:07:36.085507+0000","last_active":"2024-09-12T01:07:36.085677+0000","last_peered":"2024-09-12T01:07:36.085677+0000","last_clean":"2024-09-12T01:07:36.085677+0000","last_became_active":"2024-09-12T00:21:42.533356+0000","last_became_peered":"2024-09-12T00:21:42.533356+0000","last_unstale":"2024-09-12T01:07:36.085677+0000","last_undegraded":"2024-09-12T01:07:36.085677+0000","last_fullsized":"2024-09-12T01:07:36.085677+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'318","last_scrub_stamp":"2024-09-12T01:07:36.085311+0000","last_deep_scrub":"267'318","last_deep_scrub_stamp":"2024-09-12T01:07:36.085311+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.085311+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:29.914431+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":11281,"num_write":971,"num_write_kb":25420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.238554+0000","last_change":"2024-09-12T01:07:47.238554+0000","last_active":"2024-09-12T01:07:47.238554+0000","last_peered":"2024-09-12T01:07:47.238554+0000","last_clean":"2024-09-12T01:07:47.238554+0000","last_became_active":"2024-09-12T00:21:46.510230+0000","last_became_peered":"2024-09-12T00:21:46.510230+0000","last_unstale":"2024-09-12T01:07:47.238554+0000","last_undegraded":"2024-09-12T01:07:47.238554+0000","last_fullsized":"2024-09-12T01:07:47.238554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:07:47.238372+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:07:47.238372+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.238372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:41.000780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'245","reported_seq":1351,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.046686+0000","last_change":"2024-09-12T01:07:49.046525+0000","last_active":"2024-09-12T01:07:49.046686+0000","last_peered":"2024-09-12T01:07:49.046686+0000","last_clean":"2024-09-12T01:07:49.046686+0000","last_became_active":"2024-09-12T00:21:48.541987+0000","last_became_peered":"2024-09-12T00:21:48.541987+0000","last_unstale":"2024-09-12T01:07:49.046686+0000","last_undegraded":"2024-09-12T01:07:49.046686+0000","last_fullsized":"2024-09-12T01:07:49.046686+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-12T01:07:49.046303+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-12T01:07:49.046303+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.046303+0000","objects_scrubbed":9,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.771459+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.386867+0000","last_change":"2024-09-12T01:08:05.386867+0000","last_active":"2024-09-12T01:08:05.386867+0000","last_peered":"2024-09-12T01:08:05.386867+0000","last_clean":"2024-09-12T01:08:05.386867+0000","last_became_active":"2024-09-12T00:21:50.549468+0000","last_became_peered":"2024-09-12T00:21:50.549468+0000","last_unstale":"2024-09-12T01:08:05.386867+0000","last_undegraded":"2024-09-12T01:08:05.386867+0000","last_fullsized":"2024-09-12T01:08:05.386867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:05.386687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:05.386687+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.386687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:01.916299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'268","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.536357+0000","last_change":"2024-09-12T01:08:09.536357+0000","last_active":"2024-09-12T01:08:09.536357+0000","last_peered":"2024-09-12T01:08:09.536357+0000","last_clean":"2024-09-12T01:08:09.536357+0000","last_became_active":"2024-09-12T00:21:52.552571+0000","last_became_peered":"2024-09-12T00:21:52.552571+0000","last_unstale":"2024-09-12T01:08:09.536357+0000","last_undegraded":"2024-09-12T01:08:09.536357+0000","last_fullsized":"2024-09-12T01:08:09.536357+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'268","last_scrub_stamp":"2024-09-12T01:08:09.536163+0000","last_deep_scrub":"267'268","last_deep_scrub_stamp":"2024-09-12T01:08:09.536163+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.536163+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.788178+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":539,"num_write":598,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'152","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.362750+0000","last_change":"2024-09-12T01:07:45.362750+0000","last_active":"2024-09-12T01:07:45.362750+0000","last_peered":"2024-09-12T01:07:45.362750+0000","last_clean":"2024-09-12T01:07:45.362750+0000","last_became_active":"2024-09-12T00:21:44.493744+0000","last_became_peered":"2024-09-12T00:21:44.493744+0000","last_unstale":"2024-09-12T01:07:45.362750+0000","last_undegraded":"2024-09-12T01:07:45.362750+0000","last_fullsized":"2024-09-12T01:07:45.362750+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:07:45.362559+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:07:45.362559+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.362559+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:35.283238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":592,"num_write":229,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.900196+0000","last_change":"2024-09-12T01:07:38.900196+0000","last_active":"2024-09-12T01:07:38.900196+0000","last_peered":"2024-09-12T01:07:38.900196+0000","last_clean":"2024-09-12T01:07:38.900196+0000","last_became_active":"2024-09-12T00:21:26.361031+0000","last_became_peered":"2024-09-12T00:21:26.361031+0000","last_unstale":"2024-09-12T01:07:38.900196+0000","last_undegraded":"2024-09-12T01:07:38.900196+0000","last_fullsized":"2024-09-12T01:07:38.900196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:07:38.899976+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:07:38.899976+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.899976+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.986434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020463840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'327","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.015691+0000","last_change":"2024-09-12T01:07:34.015525+0000","last_active":"2024-09-12T01:07:34.015691+0000","last_peered":"2024-09-12T01:07:34.015691+0000","last_clean":"2024-09-12T01:07:34.015691+0000","last_became_active":"2024-09-12T00:21:42.528949+0000","last_became_peered":"2024-09-12T00:21:42.528949+0000","last_unstale":"2024-09-12T01:07:34.015691+0000","last_undegraded":"2024-09-12T01:07:34.015691+0000","last_fullsized":"2024-09-12T01:07:34.015691+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:34.015318+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.015318+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.629212+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":67654,"num_write":1033,"num_write_kb":55160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.190802+0000","last_change":"2024-09-12T01:07:46.190671+0000","last_active":"2024-09-12T01:07:46.190802+0000","last_peered":"2024-09-12T01:07:46.190802+0000","last_clean":"2024-09-12T01:07:46.190802+0000","last_became_active":"2024-09-12T00:21:46.517381+0000","last_became_peered":"2024-09-12T00:21:46.517381+0000","last_unstale":"2024-09-12T01:07:46.190802+0000","last_undegraded":"2024-09-12T01:07:46.190802+0000","last_fullsized":"2024-09-12T01:07:46.190802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:46.190493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:46.190493+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.190493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:43.299136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'127","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.023133+0000","last_change":"2024-09-12T01:07:59.023133+0000","last_active":"2024-09-12T01:07:59.023133+0000","last_peered":"2024-09-12T01:07:59.023133+0000","last_clean":"2024-09-12T01:07:59.023133+0000","last_became_active":"2024-09-12T00:21:48.553129+0000","last_became_peered":"2024-09-12T00:21:48.553129+0000","last_unstale":"2024-09-12T01:07:59.023133+0000","last_undegraded":"2024-09-12T01:07:59.023133+0000","last_fullsized":"2024-09-12T01:07:59.023133+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'127","last_scrub_stamp":"2024-09-12T01:07:59.022824+0000","last_deep_scrub":"267'127","last_deep_scrub_stamp":"2024-09-12T01:07:59.022824+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.022824+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:07.237907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.189927+0000","last_change":"2024-09-12T01:08:11.189927+0000","last_active":"2024-09-12T01:08:11.189927+0000","last_peered":"2024-09-12T01:08:11.189927+0000","last_clean":"2024-09-12T01:08:11.189927+0000","last_became_active":"2024-09-12T00:21:50.545037+0000","last_became_peered":"2024-09-12T00:21:50.545037+0000","last_unstale":"2024-09-12T01:08:11.189927+0000","last_undegraded":"2024-09-12T01:08:11.189927+0000","last_fullsized":"2024-09-12T01:08:11.189927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:11.189752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:11.189752+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.189752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:17.097362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'99","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.546452+0000","last_change":"2024-09-12T01:08:00.546452+0000","last_active":"2024-09-12T01:08:00.546452+0000","last_peered":"2024-09-12T01:08:00.546452+0000","last_clean":"2024-09-12T01:08:00.546452+0000","last_became_active":"2024-09-12T00:21:52.540900+0000","last_became_peered":"2024-09-12T00:21:52.540900+0000","last_unstale":"2024-09-12T01:08:00.546452+0000","last_undegraded":"2024-09-12T01:08:00.546452+0000","last_fullsized":"2024-09-12T01:08:00.546452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'99","last_scrub_stamp":"2024-09-12T01:08:00.546265+0000","last_deep_scrub":"267'99","last_deep_scrub_stamp":"2024-09-12T01:08:00.546265+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.546265+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:57.513145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":212,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'221","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.354086+0000","last_change":"2024-09-12T01:07:43.354086+0000","last_active":"2024-09-12T01:07:43.354086+0000","last_peered":"2024-09-12T01:07:43.354086+0000","last_clean":"2024-09-12T01:07:43.354086+0000","last_became_active":"2024-09-12T00:21:44.497354+0000","last_became_peered":"2024-09-12T00:21:44.497354+0000","last_unstale":"2024-09-12T01:07:43.354086+0000","last_undegraded":"2024-09-12T01:07:43.354086+0000","last_fullsized":"2024-09-12T01:07:43.354086+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'221","last_scrub_stamp":"2024-09-12T01:07:43.353908+0000","last_deep_scrub":"267'221","last_deep_scrub_stamp":"2024-09-12T01:07:43.353908+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.353908+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.870435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":990,"num_read_kb":806,"num_write":357,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'303","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:34.246792+0000","last_change":"2024-09-12T01:07:34.246713+0000","last_active":"2024-09-12T01:07:34.246792+0000","last_peered":"2024-09-12T01:07:34.246792+0000","last_clean":"2024-09-12T01:07:34.246792+0000","last_became_active":"2024-09-12T00:21:42.521990+0000","last_became_peered":"2024-09-12T00:21:42.521990+0000","last_unstale":"2024-09-12T01:07:34.246792+0000","last_undegraded":"2024-09-12T01:07:34.246792+0000","last_fullsized":"2024-09-12T01:07:34.246792+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'303","last_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_deep_scrub":"267'303","last_deep_scrub_stamp":"2024-09-12T01:07:34.246523+0000","last_clean_scrub_stamp":"2024-09-12T01:07:34.246523+0000","objects_scrubbed":10,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:15.373734+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829291,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":446,"num_read_kb":61837,"num_write":1004,"num_write_kb":29041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.063098+0000","last_change":"2024-09-12T01:07:35.063098+0000","last_active":"2024-09-12T01:07:35.063098+0000","last_peered":"2024-09-12T01:07:35.063098+0000","last_clean":"2024-09-12T01:07:35.063098+0000","last_became_active":"2024-09-12T00:21:26.358717+0000","last_became_peered":"2024-09-12T00:21:26.358717+0000","last_unstale":"2024-09-12T01:07:35.063098+0000","last_undegraded":"2024-09-12T01:07:35.063098+0000","last_fullsized":"2024-09-12T01:07:35.063098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:35.062821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:35.062821+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.062821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:09.059649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098259600000000008,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.293267+0000","last_change":"2024-09-12T01:07:52.293267+0000","last_active":"2024-09-12T01:07:52.293267+0000","last_peered":"2024-09-12T01:07:52.293267+0000","last_clean":"2024-09-12T01:07:52.293267+0000","last_became_active":"2024-09-12T00:21:46.498378+0000","last_became_peered":"2024-09-12T00:21:46.498378+0000","last_unstale":"2024-09-12T01:07:52.293267+0000","last_undegraded":"2024-09-12T01:07:52.293267+0000","last_fullsized":"2024-09-12T01:07:52.293267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.293052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.293052+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.293052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:39.789136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'587","reported_seq":1264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.285111+0000","last_change":"2024-09-12T01:07:49.284958+0000","last_active":"2024-09-12T01:07:49.285111+0000","last_peered":"2024-09-12T01:07:49.285111+0000","last_clean":"2024-09-12T01:07:49.285111+0000","last_became_active":"2024-09-12T00:21:48.534749+0000","last_became_peered":"2024-09-12T00:21:48.534749+0000","last_unstale":"2024-09-12T01:07:49.285111+0000","last_undegraded":"2024-09-12T01:07:49.285111+0000","last_fullsized":"2024-09-12T01:07:49.285111+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'587","last_scrub_stamp":"2024-09-12T01:07:49.284741+0000","last_deep_scrub":"267'587","last_deep_scrub_stamp":"2024-09-12T01:07:49.284741+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.284741+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:51.464003+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96095,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1602,"num_read_kb":2762,"num_write":2078,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508332,"num_omap_keys":1154,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.138849+0000","last_change":"2024-09-12T01:07:54.138849+0000","last_active":"2024-09-12T01:07:54.138849+0000","last_peered":"2024-09-12T01:07:54.138849+0000","last_clean":"2024-09-12T01:07:54.138849+0000","last_became_active":"2024-09-12T00:21:50.554728+0000","last_became_peered":"2024-09-12T00:21:50.554728+0000","last_unstale":"2024-09-12T01:07:54.138849+0000","last_undegraded":"2024-09-12T01:07:54.138849+0000","last_fullsized":"2024-09-12T01:07:54.138849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.138667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.138667+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.138667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:32.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'180","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.868317+0000","last_change":"2024-09-12T01:08:10.868317+0000","last_active":"2024-09-12T01:08:10.868317+0000","last_peered":"2024-09-12T01:08:10.868317+0000","last_clean":"2024-09-12T01:08:10.868317+0000","last_became_active":"2024-09-12T00:21:52.558203+0000","last_became_peered":"2024-09-12T00:21:52.558203+0000","last_unstale":"2024-09-12T01:08:10.868317+0000","last_undegraded":"2024-09-12T01:08:10.868317+0000","last_fullsized":"2024-09-12T01:08:10.868317+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-12T01:08:10.868084+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-12T01:08:10.868084+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.868084+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:14.720878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1145,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":410,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'196","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.367538+0000","last_change":"2024-09-12T01:07:50.367538+0000","last_active":"2024-09-12T01:07:50.367538+0000","last_peered":"2024-09-12T01:07:50.367538+0000","last_clean":"2024-09-12T01:07:50.367538+0000","last_became_active":"2024-09-12T00:21:44.497510+0000","last_became_peered":"2024-09-12T00:21:44.497510+0000","last_unstale":"2024-09-12T01:07:50.367538+0000","last_undegraded":"2024-09-12T01:07:50.367538+0000","last_fullsized":"2024-09-12T01:07:50.367538+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T01:07:50.367359+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T01:07:50.367359+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.367359+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:59.657265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":719,"num_write":306,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'327","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.363959+0000","last_change":"2024-09-12T01:07:36.363959+0000","last_active":"2024-09-12T01:07:36.363959+0000","last_peered":"2024-09-12T01:07:36.363959+0000","last_clean":"2024-09-12T01:07:36.363959+0000","last_became_active":"2024-09-12T00:21:42.529084+0000","last_became_peered":"2024-09-12T00:21:42.529084+0000","last_unstale":"2024-09-12T01:07:36.363959+0000","last_undegraded":"2024-09-12T01:07:36.363959+0000","last_fullsized":"2024-09-12T01:07:36.363959+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T01:07:36.363681+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T01:07:36.363681+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.363681+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:32.434284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":3172,"num_write":1083,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.918656+0000","last_change":"2024-09-12T01:07:37.918656+0000","last_active":"2024-09-12T01:07:37.918656+0000","last_peered":"2024-09-12T01:07:37.918656+0000","last_clean":"2024-09-12T01:07:37.918656+0000","last_became_active":"2024-09-12T00:21:26.237571+0000","last_became_peered":"2024-09-12T00:21:26.237571+0000","last_unstale":"2024-09-12T01:07:37.918656+0000","last_undegraded":"2024-09-12T01:07:37.918656+0000","last_fullsized":"2024-09-12T01:07:37.918656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:37.918454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:37.918454+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.918454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:38.398571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024118910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.053317+0000","last_change":"2024-09-12T01:07:45.053317+0000","last_active":"2024-09-12T01:07:45.053317+0000","last_peered":"2024-09-12T01:07:45.053317+0000","last_clean":"2024-09-12T01:07:45.053317+0000","last_became_active":"2024-09-12T00:21:46.507150+0000","last_became_peered":"2024-09-12T00:21:46.507150+0000","last_unstale":"2024-09-12T01:07:45.053317+0000","last_undegraded":"2024-09-12T01:07:45.053317+0000","last_fullsized":"2024-09-12T01:07:45.053317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:45.053133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:45.053133+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.053133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:32.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'174","reported_seq":747,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.322185+0000","last_change":"2024-09-12T01:07:56.322185+0000","last_active":"2024-09-12T01:07:56.322185+0000","last_peered":"2024-09-12T01:07:56.322185+0000","last_clean":"2024-09-12T01:07:56.322185+0000","last_became_active":"2024-09-12T00:21:48.545244+0000","last_became_peered":"2024-09-12T00:21:48.545244+0000","last_unstale":"2024-09-12T01:07:56.322185+0000","last_undegraded":"2024-09-12T01:07:56.322185+0000","last_fullsized":"2024-09-12T01:07:56.322185+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-12T01:07:56.322006+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-12T01:07:56.322006+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.322006+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.237932+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'771","reported_seq":2810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.556909+0000","last_change":"2024-09-12T01:07:53.556779+0000","last_active":"2024-09-12T01:07:53.556909+0000","last_peered":"2024-09-12T01:07:53.556909+0000","last_clean":"2024-09-12T01:07:53.556909+0000","last_became_active":"2024-09-12T00:21:50.565930+0000","last_became_peered":"2024-09-12T00:21:50.565930+0000","last_unstale":"2024-09-12T01:07:53.556909+0000","last_undegraded":"2024-09-12T01:07:53.556909+0000","last_fullsized":"2024-09-12T01:07:53.556909+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-09-12T01:07:53.556571+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-09-12T01:07:53.556571+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.556571+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:43.011606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'141","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.428366+0000","last_change":"2024-09-12T01:08:00.428366+0000","last_active":"2024-09-12T01:08:00.428366+0000","last_peered":"2024-09-12T01:08:00.428366+0000","last_clean":"2024-09-12T01:08:00.428366+0000","last_became_active":"2024-09-12T00:21:52.562765+0000","last_became_peered":"2024-09-12T00:21:52.562765+0000","last_unstale":"2024-09-12T01:08:00.428366+0000","last_undegraded":"2024-09-12T01:08:00.428366+0000","last_fullsized":"2024-09-12T01:08:00.428366+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T01:08:00.428135+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T01:08:00.428135+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.428135+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:03.503379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":136,"num_write":336,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'107","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.465315+0000","last_change":"2024-09-12T01:07:43.465139+0000","last_active":"2024-09-12T01:07:43.465315+0000","last_peered":"2024-09-12T01:07:43.465315+0000","last_clean":"2024-09-12T01:07:43.465315+0000","last_became_active":"2024-09-12T00:21:44.492443+0000","last_became_peered":"2024-09-12T00:21:44.492443+0000","last_unstale":"2024-09-12T01:07:43.465315+0000","last_undegraded":"2024-09-12T01:07:43.465315+0000","last_fullsized":"2024-09-12T01:07:43.465315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-12T01:07:43.464916+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-12T01:07:43.464916+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.464916+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:25.554086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":379,"num_write":156,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'324","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.352910+0000","last_change":"2024-09-12T01:07:35.352910+0000","last_active":"2024-09-12T01:07:35.352910+0000","last_peered":"2024-09-12T01:07:35.352910+0000","last_clean":"2024-09-12T01:07:35.352910+0000","last_became_active":"2024-09-12T00:21:42.505355+0000","last_became_peered":"2024-09-12T00:21:42.505355+0000","last_unstale":"2024-09-12T01:07:35.352910+0000","last_undegraded":"2024-09-12T01:07:35.352910+0000","last_fullsized":"2024-09-12T01:07:35.352910+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-12T01:07:35.352717+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-12T01:07:35.352717+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.352717+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:26.053174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":8879,"num_write":1116,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.499649+0000","last_change":"2024-09-12T01:07:40.499649+0000","last_active":"2024-09-12T01:07:40.499649+0000","last_peered":"2024-09-12T01:07:40.499649+0000","last_clean":"2024-09-12T01:07:40.499649+0000","last_became_active":"2024-09-12T00:21:26.230496+0000","last_became_peered":"2024-09-12T00:21:26.230496+0000","last_unstale":"2024-09-12T01:07:40.499649+0000","last_undegraded":"2024-09-12T01:07:40.499649+0000","last_fullsized":"2024-09-12T01:07:40.499649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:40.499465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:40.499465+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.499465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:44.908987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010335190000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.950731+0000","last_change":"2024-09-12T01:07:57.950731+0000","last_active":"2024-09-12T01:07:57.950731+0000","last_peered":"2024-09-12T01:07:57.950731+0000","last_clean":"2024-09-12T01:07:57.950731+0000","last_became_active":"2024-09-12T00:21:46.506416+0000","last_became_peered":"2024-09-12T00:21:46.506416+0000","last_unstale":"2024-09-12T01:07:57.950731+0000","last_undegraded":"2024-09-12T01:07:57.950731+0000","last_fullsized":"2024-09-12T01:07:57.950731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.950526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.950526+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.950526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:00.170740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'118","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.101180+0000","last_change":"2024-09-12T01:08:05.101180+0000","last_active":"2024-09-12T01:08:05.101180+0000","last_peered":"2024-09-12T01:08:05.101180+0000","last_clean":"2024-09-12T01:08:05.101180+0000","last_became_active":"2024-09-12T00:21:48.541051+0000","last_became_peered":"2024-09-12T00:21:48.541051+0000","last_unstale":"2024-09-12T01:08:05.101180+0000","last_undegraded":"2024-09-12T01:08:05.101180+0000","last_fullsized":"2024-09-12T01:08:05.101180+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:08:05.100985+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:08:05.100985+0000","last_clean_scrub_stamp":"2024-09-12T01:08:05.100985+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:34.203891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'782","reported_seq":2265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.971942+0000","last_change":"2024-09-12T01:08:01.971942+0000","last_active":"2024-09-12T01:08:01.971942+0000","last_peered":"2024-09-12T01:08:01.971942+0000","last_clean":"2024-09-12T01:08:01.971942+0000","last_became_active":"2024-09-12T00:21:50.564982+0000","last_became_peered":"2024-09-12T00:21:50.564982+0000","last_unstale":"2024-09-12T01:08:01.971942+0000","last_undegraded":"2024-09-12T01:08:01.971942+0000","last_fullsized":"2024-09-12T01:08:01.971942+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:08:01.971765+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:08:01.971765+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.971765+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:58.526551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'157","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.863907+0000","last_change":"2024-09-12T01:08:09.863907+0000","last_active":"2024-09-12T01:08:09.863907+0000","last_peered":"2024-09-12T01:08:09.863907+0000","last_clean":"2024-09-12T01:08:09.863907+0000","last_became_active":"2024-09-12T00:21:52.555909+0000","last_became_peered":"2024-09-12T00:21:52.555909+0000","last_unstale":"2024-09-12T01:08:09.863907+0000","last_undegraded":"2024-09-12T01:08:09.863907+0000","last_fullsized":"2024-09-12T01:08:09.863907+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T01:08:09.863717+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T01:08:09.863717+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.863717+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.515420+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":331,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'167","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.277506+0000","last_change":"2024-09-12T01:07:40.277506+0000","last_active":"2024-09-12T01:07:40.277506+0000","last_peered":"2024-09-12T01:07:40.277506+0000","last_clean":"2024-09-12T01:07:40.277506+0000","last_became_active":"2024-09-12T00:21:44.494215+0000","last_became_peered":"2024-09-12T00:21:44.494215+0000","last_unstale":"2024-09-12T01:07:40.277506+0000","last_undegraded":"2024-09-12T01:07:40.277506+0000","last_fullsized":"2024-09-12T01:07:40.277506+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T01:07:40.277272+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T01:07:40.277272+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.277272+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:51.529239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":568,"num_write":276,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'381","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.449381+0000","last_change":"2024-09-12T01:07:38.449381+0000","last_active":"2024-09-12T01:07:38.449381+0000","last_peered":"2024-09-12T01:07:38.449381+0000","last_clean":"2024-09-12T01:07:38.449381+0000","last_became_active":"2024-09-12T00:21:42.494486+0000","last_became_peered":"2024-09-12T00:21:42.494486+0000","last_unstale":"2024-09-12T01:07:38.449381+0000","last_undegraded":"2024-09-12T01:07:38.449381+0000","last_fullsized":"2024-09-12T01:07:38.449381+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-09-12T01:07:38.449164+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-09-12T01:07:38.449164+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.449164+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:59.455133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":23252,"num_write":1238,"num_write_kb":41943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.889902+0000","last_change":"2024-09-12T01:07:39.889902+0000","last_active":"2024-09-12T01:07:39.889902+0000","last_peered":"2024-09-12T01:07:39.889902+0000","last_clean":"2024-09-12T01:07:39.889902+0000","last_became_active":"2024-09-12T00:21:26.238739+0000","last_became_peered":"2024-09-12T00:21:26.238739+0000","last_unstale":"2024-09-12T01:07:39.889902+0000","last_undegraded":"2024-09-12T01:07:39.889902+0000","last_fullsized":"2024-09-12T01:07:39.889902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:39.889727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:39.889727+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.889727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:24.646676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019165580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.349435+0000","last_change":"2024-09-12T01:07:50.349312+0000","last_active":"2024-09-12T01:07:50.349435+0000","last_peered":"2024-09-12T01:07:50.349435+0000","last_clean":"2024-09-12T01:07:50.349435+0000","last_became_active":"2024-09-12T00:21:46.490398+0000","last_became_peered":"2024-09-12T00:21:46.490398+0000","last_unstale":"2024-09-12T01:07:50.349435+0000","last_undegraded":"2024-09-12T01:07:50.349435+0000","last_fullsized":"2024-09-12T01:07:50.349435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:50.349131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:50.349131+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.349131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:36.059419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'722","reported_seq":1458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.063819+0000","last_change":"2024-09-12T01:07:51.063819+0000","last_active":"2024-09-12T01:07:51.063819+0000","last_peered":"2024-09-12T01:07:51.063819+0000","last_clean":"2024-09-12T01:07:51.063819+0000","last_became_active":"2024-09-12T00:21:48.543101+0000","last_became_peered":"2024-09-12T00:21:48.543101+0000","last_unstale":"2024-09-12T01:07:51.063819+0000","last_undegraded":"2024-09-12T01:07:51.063819+0000","last_fullsized":"2024-09-12T01:07:51.063819+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'722","last_scrub_stamp":"2024-09-12T01:07:51.063535+0000","last_deep_scrub":"267'722","last_deep_scrub_stamp":"2024-09-12T01:07:51.063535+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.063535+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:28.632717+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1291,"num_read_kb":3081,"num_write":1048,"num_write_kb":885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:04.352431+0000","last_change":"2024-09-12T01:08:04.352431+0000","last_active":"2024-09-12T01:08:04.352431+0000","last_peered":"2024-09-12T01:08:04.352431+0000","last_clean":"2024-09-12T01:08:04.352431+0000","last_became_active":"2024-09-12T00:21:50.549692+0000","last_became_peered":"2024-09-12T00:21:50.549692+0000","last_unstale":"2024-09-12T01:08:04.352431+0000","last_undegraded":"2024-09-12T01:08:04.352431+0000","last_fullsized":"2024-09-12T01:08:04.352431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:04.352249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:04.352249+0000","last_clean_scrub_stamp":"2024-09-12T01:08:04.352249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:46.516170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'109","reported_seq":611,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.222826+0000","last_change":"2024-09-12T01:07:58.222826+0000","last_active":"2024-09-12T01:07:58.222826+0000","last_peered":"2024-09-12T01:07:58.222826+0000","last_clean":"2024-09-12T01:07:58.222826+0000","last_became_active":"2024-09-12T00:21:52.556038+0000","last_became_peered":"2024-09-12T00:21:52.556038+0000","last_unstale":"2024-09-12T01:07:58.222826+0000","last_undegraded":"2024-09-12T01:07:58.222826+0000","last_fullsized":"2024-09-12T01:07:58.222826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'109","last_scrub_stamp":"2024-09-12T01:07:58.222645+0000","last_deep_scrub":"267'109","last_deep_scrub_stamp":"2024-09-12T01:07:58.222645+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.222645+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:57.127050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":258,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'118","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.494571+0000","last_change":"2024-09-12T01:08:10.494571+0000","last_active":"2024-09-12T01:08:10.494571+0000","last_peered":"2024-09-12T01:08:10.494571+0000","last_clean":"2024-09-12T01:08:10.494571+0000","last_became_active":"2024-09-12T00:21:52.537464+0000","last_became_peered":"2024-09-12T00:21:52.537464+0000","last_unstale":"2024-09-12T01:08:10.494571+0000","last_undegraded":"2024-09-12T01:08:10.494571+0000","last_fullsized":"2024-09-12T01:08:10.494571+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:08:10.494381+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:08:10.494381+0000","last_clean_scrub_stamp":"2024-09-12T01:08:10.494381+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:39.188930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":226,"num_write":297,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'147","reported_seq":786,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.217437+0000","last_change":"2024-09-12T01:07:45.217289+0000","last_active":"2024-09-12T01:07:45.217437+0000","last_peered":"2024-09-12T01:07:45.217437+0000","last_clean":"2024-09-12T01:07:45.217437+0000","last_became_active":"2024-09-12T00:21:44.494375+0000","last_became_peered":"2024-09-12T00:21:44.494375+0000","last_unstale":"2024-09-12T01:07:45.217437+0000","last_undegraded":"2024-09-12T01:07:45.217437+0000","last_fullsized":"2024-09-12T01:07:45.217437+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-12T01:07:45.217105+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-12T01:07:45.217105+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.217105+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:38.718060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":613,"num_write":235,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'406","reported_seq":1117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.925707+0000","last_change":"2024-09-12T01:07:40.925561+0000","last_active":"2024-09-12T01:07:40.925707+0000","last_peered":"2024-09-12T01:07:40.925707+0000","last_clean":"2024-09-12T01:07:40.925707+0000","last_became_active":"2024-09-12T00:21:42.495160+0000","last_became_peered":"2024-09-12T00:21:42.495160+0000","last_unstale":"2024-09-12T01:07:40.925707+0000","last_undegraded":"2024-09-12T01:07:40.925707+0000","last_fullsized":"2024-09-12T01:07:40.925707+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'406","last_scrub_stamp":"2024-09-12T01:07:40.925325+0000","last_deep_scrub":"267'406","last_deep_scrub_stamp":"2024-09-12T01:07:40.925325+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.925325+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:38.062084+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":36670,"num_write":1291,"num_write_kb":30706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.354758+0000","last_change":"2024-09-12T01:07:53.354604+0000","last_active":"2024-09-12T01:07:53.354758+0000","last_peered":"2024-09-12T01:07:53.354758+0000","last_clean":"2024-09-12T01:07:53.354758+0000","last_became_active":"2024-09-12T00:21:46.503594+0000","last_became_peered":"2024-09-12T00:21:46.503594+0000","last_unstale":"2024-09-12T01:07:53.354758+0000","last_undegraded":"2024-09-12T01:07:53.354758+0000","last_fullsized":"2024-09-12T01:07:53.354758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.354423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.354423+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.354423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:33.541746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'278","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.318137+0000","last_change":"2024-09-12T01:07:57.317999+0000","last_active":"2024-09-12T01:07:57.318137+0000","last_peered":"2024-09-12T01:07:57.318137+0000","last_clean":"2024-09-12T01:07:57.318137+0000","last_became_active":"2024-09-12T00:21:48.546213+0000","last_became_peered":"2024-09-12T00:21:48.546213+0000","last_unstale":"2024-09-12T01:07:57.318137+0000","last_undegraded":"2024-09-12T01:07:57.318137+0000","last_fullsized":"2024-09-12T01:07:57.318137+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'278","last_scrub_stamp":"2024-09-12T01:07:57.317804+0000","last_deep_scrub":"267'278","last_deep_scrub_stamp":"2024-09-12T01:07:57.317804+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.317804+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.448976+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44075,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":436,"num_read_kb":989,"num_write":348,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.258645+0000","last_change":"2024-09-12T01:07:53.258390+0000","last_active":"2024-09-12T01:07:53.258645+0000","last_peered":"2024-09-12T01:07:53.258645+0000","last_clean":"2024-09-12T01:07:53.258645+0000","last_became_active":"2024-09-12T00:21:50.549135+0000","last_became_peered":"2024-09-12T00:21:50.549135+0000","last_unstale":"2024-09-12T01:07:53.258645+0000","last_undegraded":"2024-09-12T01:07:53.258645+0000","last_fullsized":"2024-09-12T01:07:53.258645+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.258184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.258184+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.258184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:36.236772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'127","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.387689+0000","last_change":"2024-09-12T01:07:59.387544+0000","last_active":"2024-09-12T01:07:59.387689+0000","last_peered":"2024-09-12T01:07:59.387689+0000","last_clean":"2024-09-12T01:07:59.387689+0000","last_became_active":"2024-09-12T00:21:52.563303+0000","last_became_peered":"2024-09-12T00:21:52.563303+0000","last_unstale":"2024-09-12T01:07:59.387689+0000","last_undegraded":"2024-09-12T01:07:59.387689+0000","last_fullsized":"2024-09-12T01:07:59.387689+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'127","last_scrub_stamp":"2024-09-12T01:07:59.387345+0000","last_deep_scrub":"267'127","last_deep_scrub_stamp":"2024-09-12T01:07:59.387345+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.387345+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:10.153540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":144,"num_write":323,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'152","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.418724+0000","last_change":"2024-09-12T01:07:44.418480+0000","last_active":"2024-09-12T01:07:44.418724+0000","last_peered":"2024-09-12T01:07:44.418724+0000","last_clean":"2024-09-12T01:07:44.418724+0000","last_became_active":"2024-09-12T00:21:44.495299+0000","last_became_peered":"2024-09-12T00:21:44.495299+0000","last_unstale":"2024-09-12T01:07:44.418724+0000","last_undegraded":"2024-09-12T01:07:44.418724+0000","last_fullsized":"2024-09-12T01:07:44.418724+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:07:44.418260+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:07:44.418260+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.418260+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:51.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":653,"num_read_kb":535,"num_write":221,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'287","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.010747+0000","last_change":"2024-09-12T01:07:35.010674+0000","last_active":"2024-09-12T01:07:35.010747+0000","last_peered":"2024-09-12T01:07:35.010747+0000","last_clean":"2024-09-12T01:07:35.010747+0000","last_became_active":"2024-09-12T00:21:42.510774+0000","last_became_peered":"2024-09-12T00:21:42.510774+0000","last_unstale":"2024-09-12T01:07:35.010747+0000","last_undegraded":"2024-09-12T01:07:35.010747+0000","last_fullsized":"2024-09-12T01:07:35.010747+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'287","last_scrub_stamp":"2024-09-12T01:07:35.010519+0000","last_deep_scrub":"267'287","last_deep_scrub_stamp":"2024-09-12T01:07:35.010519+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.010519+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:26.256328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254443,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":10210,"num_write":929,"num_write_kb":22659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.338946+0000","last_change":"2024-09-12T01:07:53.338763+0000","last_active":"2024-09-12T01:07:53.338946+0000","last_peered":"2024-09-12T01:07:53.338946+0000","last_clean":"2024-09-12T01:07:53.338946+0000","last_became_active":"2024-09-12T00:21:46.498536+0000","last_became_peered":"2024-09-12T00:21:46.498536+0000","last_unstale":"2024-09-12T01:07:53.338946+0000","last_undegraded":"2024-09-12T01:07:53.338946+0000","last_fullsized":"2024-09-12T01:07:53.338946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:53.338543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:53.338543+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.338543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:08.882729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'45","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.345803+0000","last_change":"2024-09-12T01:07:59.345664+0000","last_active":"2024-09-12T01:07:59.345803+0000","last_peered":"2024-09-12T01:07:59.345803+0000","last_clean":"2024-09-12T01:07:59.345803+0000","last_became_active":"2024-09-12T00:21:48.528299+0000","last_became_peered":"2024-09-12T00:21:48.528299+0000","last_unstale":"2024-09-12T01:07:59.345803+0000","last_undegraded":"2024-09-12T01:07:59.345803+0000","last_fullsized":"2024-09-12T01:07:59.345803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'45","last_scrub_stamp":"2024-09-12T01:07:59.345465+0000","last_deep_scrub":"267'45","last_deep_scrub_stamp":"2024-09-12T01:07:59.345465+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.345465+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:44.745636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.204073+0000","last_change":"2024-09-12T01:07:57.203956+0000","last_active":"2024-09-12T01:07:57.204073+0000","last_peered":"2024-09-12T01:07:57.204073+0000","last_clean":"2024-09-12T01:07:57.204073+0000","last_became_active":"2024-09-12T00:21:50.553714+0000","last_became_peered":"2024-09-12T00:21:50.553714+0000","last_unstale":"2024-09-12T01:07:57.204073+0000","last_undegraded":"2024-09-12T01:07:57.204073+0000","last_fullsized":"2024-09-12T01:07:57.204073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.203776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.203776+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.203776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:33.243320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'216","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.322496+0000","last_change":"2024-09-12T01:08:07.322496+0000","last_active":"2024-09-12T01:08:07.322496+0000","last_peered":"2024-09-12T01:08:07.322496+0000","last_clean":"2024-09-12T01:08:07.322496+0000","last_became_active":"2024-09-12T00:21:52.556407+0000","last_became_peered":"2024-09-12T00:21:52.556407+0000","last_unstale":"2024-09-12T01:08:07.322496+0000","last_undegraded":"2024-09-12T01:08:07.322496+0000","last_fullsized":"2024-09-12T01:08:07.322496+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'216","last_scrub_stamp":"2024-09-12T01:08:07.322297+0000","last_deep_scrub":"267'216","last_deep_scrub_stamp":"2024-09-12T01:08:07.322297+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.322297+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:05.369131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":286,"num_write":472,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'340","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.437660+0000","last_change":"2024-09-12T01:07:42.437472+0000","last_active":"2024-09-12T01:07:42.437660+0000","last_peered":"2024-09-12T01:07:42.437660+0000","last_clean":"2024-09-12T01:07:42.437660+0000","last_became_active":"2024-09-12T00:21:44.499891+0000","last_became_peered":"2024-09-12T00:21:44.499891+0000","last_unstale":"2024-09-12T01:07:42.437660+0000","last_undegraded":"2024-09-12T01:07:42.437660+0000","last_fullsized":"2024-09-12T01:07:42.437660+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T01:07:42.437296+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T01:07:42.437296+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.437296+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:04.391073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1519,"num_read_kb":1239,"num_write":521,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'307","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.260295+0000","last_change":"2024-09-12T01:07:36.260148+0000","last_active":"2024-09-12T01:07:36.260295+0000","last_peered":"2024-09-12T01:07:36.260295+0000","last_clean":"2024-09-12T01:07:36.260295+0000","last_became_active":"2024-09-12T00:21:42.534537+0000","last_became_peered":"2024-09-12T00:21:42.534537+0000","last_unstale":"2024-09-12T01:07:36.260295+0000","last_undegraded":"2024-09-12T01:07:36.260295+0000","last_fullsized":"2024-09-12T01:07:36.260295+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T01:07:36.259915+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T01:07:36.259915+0000","last_clean_scrub_stamp":"2024-09-12T01:07:36.259915+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:37.365491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194356,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":22569,"num_write":963,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.230465+0000","last_change":"2024-09-12T01:07:49.230337+0000","last_active":"2024-09-12T01:07:49.230465+0000","last_peered":"2024-09-12T01:07:49.230465+0000","last_clean":"2024-09-12T01:07:49.230465+0000","last_became_active":"2024-09-12T00:21:46.489054+0000","last_became_peered":"2024-09-12T00:21:46.489054+0000","last_unstale":"2024-09-12T01:07:49.230465+0000","last_undegraded":"2024-09-12T01:07:49.230465+0000","last_fullsized":"2024-09-12T01:07:49.230465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:49.230156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:49.230156+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.230156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.131892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'295","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.314287+0000","last_change":"2024-09-12T01:07:54.314143+0000","last_active":"2024-09-12T01:07:54.314287+0000","last_peered":"2024-09-12T01:07:54.314287+0000","last_clean":"2024-09-12T01:07:54.314287+0000","last_became_active":"2024-09-12T00:21:48.549368+0000","last_became_peered":"2024-09-12T00:21:48.549368+0000","last_unstale":"2024-09-12T01:07:54.314287+0000","last_undegraded":"2024-09-12T01:07:54.314287+0000","last_fullsized":"2024-09-12T01:07:54.314287+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-09-12T01:07:54.313950+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-09-12T01:07:54.313950+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.313950+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.040359+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56273,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1054,"num_write":388,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.602765+0000","last_change":"2024-09-12T01:07:57.602572+0000","last_active":"2024-09-12T01:07:57.602765+0000","last_peered":"2024-09-12T01:07:57.602765+0000","last_clean":"2024-09-12T01:07:57.602765+0000","last_became_active":"2024-09-12T00:21:50.565753+0000","last_became_peered":"2024-09-12T00:21:50.565753+0000","last_unstale":"2024-09-12T01:07:57.602765+0000","last_undegraded":"2024-09-12T01:07:57.602765+0000","last_fullsized":"2024-09-12T01:07:57.602765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:57.602386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:57.602386+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.602386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:35.138425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'138","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.239170+0000","last_change":"2024-09-12T01:08:18.239170+0000","last_active":"2024-09-12T01:08:18.239170+0000","last_peered":"2024-09-12T01:08:18.239170+0000","last_clean":"2024-09-12T01:08:18.239170+0000","last_became_active":"2024-09-12T00:21:52.559213+0000","last_became_peered":"2024-09-12T00:21:52.559213+0000","last_unstale":"2024-09-12T01:08:18.239170+0000","last_undegraded":"2024-09-12T01:08:18.239170+0000","last_fullsized":"2024-09-12T01:08:18.239170+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T01:08:18.238983+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T01:08:18.238983+0000","last_clean_scrub_stamp":"2024-09-12T01:08:18.238983+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:02.299524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":329,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'146","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.111586+0000","last_change":"2024-09-12T01:07:38.111403+0000","last_active":"2024-09-12T01:07:38.111586+0000","last_peered":"2024-09-12T01:07:38.111586+0000","last_clean":"2024-09-12T01:07:38.111586+0000","last_became_active":"2024-09-12T00:21:44.507460+0000","last_became_peered":"2024-09-12T00:21:44.507460+0000","last_unstale":"2024-09-12T01:07:38.111586+0000","last_undegraded":"2024-09-12T01:07:38.111586+0000","last_fullsized":"2024-09-12T01:07:38.111586+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-12T01:07:38.111226+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-12T01:07:38.111226+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.111226+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:36.723181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":507,"num_write":216,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'342","reported_seq":977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.072519+0000","last_change":"2024-09-12T01:07:37.072371+0000","last_active":"2024-09-12T01:07:37.072519+0000","last_peered":"2024-09-12T01:07:37.072519+0000","last_clean":"2024-09-12T01:07:37.072519+0000","last_became_active":"2024-09-12T00:21:42.517333+0000","last_became_peered":"2024-09-12T00:21:42.517333+0000","last_unstale":"2024-09-12T01:07:37.072519+0000","last_undegraded":"2024-09-12T01:07:37.072519+0000","last_fullsized":"2024-09-12T01:07:37.072519+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-09-12T01:07:37.072146+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-09-12T01:07:37.072146+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.072146+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.002439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":50264,"num_write":1046,"num_write_kb":41560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.002878+0000","last_change":"2024-09-12T01:08:02.002747+0000","last_active":"2024-09-12T01:08:02.002878+0000","last_peered":"2024-09-12T01:08:02.002878+0000","last_clean":"2024-09-12T01:08:02.002878+0000","last_became_active":"2024-09-12T00:21:46.501673+0000","last_became_peered":"2024-09-12T00:21:46.501673+0000","last_unstale":"2024-09-12T01:08:02.002878+0000","last_undegraded":"2024-09-12T01:08:02.002878+0000","last_fullsized":"2024-09-12T01:08:02.002878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:02.002548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:02.002548+0000","last_clean_scrub_stamp":"2024-09-12T01:08:02.002548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:33.590646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'276","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.087083+0000","last_change":"2024-09-12T01:07:46.086938+0000","last_active":"2024-09-12T01:07:46.087083+0000","last_peered":"2024-09-12T01:07:46.087083+0000","last_clean":"2024-09-12T01:07:46.087083+0000","last_became_active":"2024-09-12T00:21:48.537864+0000","last_became_peered":"2024-09-12T00:21:48.537864+0000","last_unstale":"2024-09-12T01:07:46.087083+0000","last_undegraded":"2024-09-12T01:07:46.087083+0000","last_fullsized":"2024-09-12T01:07:46.087083+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'276","last_scrub_stamp":"2024-09-12T01:07:46.086739+0000","last_deep_scrub":"267'276","last_deep_scrub_stamp":"2024-09-12T01:07:46.086739+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.086739+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:32.656541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47500,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1067,"num_write":372,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.377547+0000","last_change":"2024-09-12T01:07:56.377401+0000","last_active":"2024-09-12T01:07:56.377547+0000","last_peered":"2024-09-12T01:07:56.377547+0000","last_clean":"2024-09-12T01:07:56.377547+0000","last_became_active":"2024-09-12T00:21:50.560805+0000","last_became_peered":"2024-09-12T00:21:50.560805+0000","last_unstale":"2024-09-12T01:07:56.377547+0000","last_undegraded":"2024-09-12T01:07:56.377547+0000","last_fullsized":"2024-09-12T01:07:56.377547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:56.377217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:56.377217+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.377217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.557232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'385","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.945989+0000","last_change":"2024-09-12T01:07:47.945989+0000","last_active":"2024-09-12T01:07:47.945989+0000","last_peered":"2024-09-12T01:07:47.945989+0000","last_clean":"2024-09-12T01:07:47.945989+0000","last_became_active":"2024-09-12T00:21:44.516321+0000","last_became_peered":"2024-09-12T00:21:44.516321+0000","last_unstale":"2024-09-12T01:07:47.945989+0000","last_undegraded":"2024-09-12T01:07:47.945989+0000","last_fullsized":"2024-09-12T01:07:47.945989+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-12T01:07:47.945804+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-12T01:07:47.945804+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.945804+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:05.496224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1787,"num_read_kb":1547,"num_write":658,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'343","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.099435+0000","last_change":"2024-09-12T01:07:38.099297+0000","last_active":"2024-09-12T01:07:38.099435+0000","last_peered":"2024-09-12T01:07:38.099435+0000","last_clean":"2024-09-12T01:07:38.099435+0000","last_became_active":"2024-09-12T00:22:13.519954+0000","last_became_peered":"2024-09-12T00:22:13.519954+0000","last_unstale":"2024-09-12T01:07:38.099435+0000","last_undegraded":"2024-09-12T01:07:38.099435+0000","last_fullsized":"2024-09-12T01:07:38.099435+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T01:07:38.099074+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T01:07:38.099074+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.099074+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:06.565768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":32939,"num_write":1107,"num_write_kb":17030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,7],"acting":[5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.347661+0000","last_change":"2024-09-12T01:07:54.347535+0000","last_active":"2024-09-12T01:07:54.347661+0000","last_peered":"2024-09-12T01:07:54.347661+0000","last_clean":"2024-09-12T01:07:54.347661+0000","last_became_active":"2024-09-12T00:21:46.503646+0000","last_became_peered":"2024-09-12T00:21:46.503646+0000","last_unstale":"2024-09-12T01:07:54.347661+0000","last_undegraded":"2024-09-12T01:07:54.347661+0000","last_fullsized":"2024-09-12T01:07:54.347661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:54.347353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:54.347353+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.347353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:41.432753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'529","reported_seq":1168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:59.339301+0000","last_change":"2024-09-12T01:07:59.339301+0000","last_active":"2024-09-12T01:07:59.339301+0000","last_peered":"2024-09-12T01:07:59.339301+0000","last_clean":"2024-09-12T01:07:59.339301+0000","last_became_active":"2024-09-12T00:21:48.547827+0000","last_became_peered":"2024-09-12T00:21:48.547827+0000","last_unstale":"2024-09-12T01:07:59.339301+0000","last_undegraded":"2024-09-12T01:07:59.339301+0000","last_fullsized":"2024-09-12T01:07:59.339301+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'529","last_scrub_stamp":"2024-09-12T01:07:59.339057+0000","last_deep_scrub":"267'529","last_deep_scrub_stamp":"2024-09-12T01:07:59.339057+0000","last_clean_scrub_stamp":"2024-09-12T01:07:59.339057+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.011858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106077,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":956,"num_read_kb":2347,"num_write":834,"num_write_kb":757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.185016+0000","last_change":"2024-09-12T01:07:55.185016+0000","last_active":"2024-09-12T01:07:55.185016+0000","last_peered":"2024-09-12T01:07:55.185016+0000","last_clean":"2024-09-12T01:07:55.185016+0000","last_became_active":"2024-09-12T00:21:50.554194+0000","last_became_peered":"2024-09-12T00:21:50.554194+0000","last_unstale":"2024-09-12T01:07:55.185016+0000","last_undegraded":"2024-09-12T01:07:55.185016+0000","last_fullsized":"2024-09-12T01:07:55.185016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.184730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.184730+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.184730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:12.121843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'160","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:11.874685+0000","last_change":"2024-09-12T01:08:11.874534+0000","last_active":"2024-09-12T01:08:11.874685+0000","last_peered":"2024-09-12T01:08:11.874685+0000","last_clean":"2024-09-12T01:08:11.874685+0000","last_became_active":"2024-09-12T00:21:52.558070+0000","last_became_peered":"2024-09-12T00:21:52.558070+0000","last_unstale":"2024-09-12T01:08:11.874685+0000","last_undegraded":"2024-09-12T01:08:11.874685+0000","last_fullsized":"2024-09-12T01:08:11.874685+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-12T01:08:11.874343+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-12T01:08:11.874343+0000","last_clean_scrub_stamp":"2024-09-12T01:08:11.874343+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:24.477496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":234,"num_write":361,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'83","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.370404+0000","last_change":"2024-09-12T01:07:46.370250+0000","last_active":"2024-09-12T01:07:46.370404+0000","last_peered":"2024-09-12T01:07:46.370404+0000","last_clean":"2024-09-12T01:07:46.370404+0000","last_became_active":"2024-09-12T00:21:44.501836+0000","last_became_peered":"2024-09-12T00:21:44.501836+0000","last_unstale":"2024-09-12T01:07:46.370404+0000","last_undegraded":"2024-09-12T01:07:46.370404+0000","last_fullsized":"2024-09-12T01:07:46.370404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'83","last_scrub_stamp":"2024-09-12T01:07:46.370079+0000","last_deep_scrub":"267'83","last_deep_scrub_stamp":"2024-09-12T01:07:46.370079+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.370079+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:28.842724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":399,"num_read_kb":345,"num_write":130,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'311","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.400773+0000","last_change":"2024-09-12T01:07:37.400631+0000","last_active":"2024-09-12T01:07:37.400773+0000","last_peered":"2024-09-12T01:07:37.400773+0000","last_clean":"2024-09-12T01:07:37.400773+0000","last_became_active":"2024-09-12T00:21:42.496837+0000","last_became_peered":"2024-09-12T00:21:42.496837+0000","last_unstale":"2024-09-12T01:07:37.400773+0000","last_undegraded":"2024-09-12T01:07:37.400773+0000","last_fullsized":"2024-09-12T01:07:37.400773+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:07:37.400384+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:07:37.400384+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.400384+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:35.621576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":560106,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":359,"num_read_kb":1485,"num_write":897,"num_write_kb":29678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.182093+0000","last_change":"2024-09-12T01:07:50.182093+0000","last_active":"2024-09-12T01:07:50.182093+0000","last_peered":"2024-09-12T01:07:50.182093+0000","last_clean":"2024-09-12T01:07:50.182093+0000","last_became_active":"2024-09-12T00:21:46.498517+0000","last_became_peered":"2024-09-12T00:21:46.498517+0000","last_unstale":"2024-09-12T01:07:50.182093+0000","last_undegraded":"2024-09-12T01:07:50.182093+0000","last_fullsized":"2024-09-12T01:07:50.182093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:50.181910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:50.181910+0000","last_clean_scrub_stamp":"2024-09-12T01:07:50.181910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:16.300016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'308","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.191292+0000","last_change":"2024-09-12T01:08:08.191292+0000","last_active":"2024-09-12T01:08:08.191292+0000","last_peered":"2024-09-12T01:08:08.191292+0000","last_clean":"2024-09-12T01:08:08.191292+0000","last_became_active":"2024-09-12T00:21:48.539419+0000","last_became_peered":"2024-09-12T00:21:48.539419+0000","last_unstale":"2024-09-12T01:08:08.191292+0000","last_undegraded":"2024-09-12T01:08:08.191292+0000","last_fullsized":"2024-09-12T01:08:08.191292+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-12T01:08:08.191085+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-12T01:08:08.191085+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.191085+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:36.401332+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":1160,"num_write":428,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:06.912149+0000","last_change":"2024-09-12T01:08:06.912149+0000","last_active":"2024-09-12T01:08:06.912149+0000","last_peered":"2024-09-12T01:08:06.912149+0000","last_clean":"2024-09-12T01:08:06.912149+0000","last_became_active":"2024-09-12T00:21:50.564610+0000","last_became_peered":"2024-09-12T00:21:50.564610+0000","last_unstale":"2024-09-12T01:08:06.912149+0000","last_undegraded":"2024-09-12T01:08:06.912149+0000","last_fullsized":"2024-09-12T01:08:06.912149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:06.911970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:06.911970+0000","last_clean_scrub_stamp":"2024-09-12T01:08:06.911970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:12.050463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'158","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.273380+0000","last_change":"2024-09-12T01:08:19.273231+0000","last_active":"2024-09-12T01:08:19.273380+0000","last_peered":"2024-09-12T01:08:19.273380+0000","last_clean":"2024-09-12T01:08:19.273380+0000","last_became_active":"2024-09-12T00:21:52.559989+0000","last_became_peered":"2024-09-12T00:21:52.559989+0000","last_unstale":"2024-09-12T01:08:19.273380+0000","last_undegraded":"2024-09-12T01:08:19.273380+0000","last_fullsized":"2024-09-12T01:08:19.273380+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:08:19.273022+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:08:19.273022+0000","last_clean_scrub_stamp":"2024-09-12T01:08:19.273022+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:10.769252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":167,"num_write":448,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'181","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.087272+0000","last_change":"2024-09-12T01:07:42.087272+0000","last_active":"2024-09-12T01:07:42.087272+0000","last_peered":"2024-09-12T01:07:42.087272+0000","last_clean":"2024-09-12T01:07:42.087272+0000","last_became_active":"2024-09-12T00:21:44.515059+0000","last_became_peered":"2024-09-12T00:21:44.515059+0000","last_unstale":"2024-09-12T01:07:42.087272+0000","last_undegraded":"2024-09-12T01:07:42.087272+0000","last_fullsized":"2024-09-12T01:07:42.087272+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T01:07:42.087093+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T01:07:42.087093+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.087093+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:57.089560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":674,"num_write":306,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'322","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.658246+0000","last_change":"2024-09-12T01:07:35.658246+0000","last_active":"2024-09-12T01:07:35.658246+0000","last_peered":"2024-09-12T01:07:35.658246+0000","last_clean":"2024-09-12T01:07:35.658246+0000","last_became_active":"2024-09-12T00:21:42.527838+0000","last_became_peered":"2024-09-12T00:21:42.527838+0000","last_unstale":"2024-09-12T01:07:35.658246+0000","last_undegraded":"2024-09-12T01:07:35.658246+0000","last_fullsized":"2024-09-12T01:07:35.658246+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'322","last_scrub_stamp":"2024-09-12T01:07:35.657997+0000","last_deep_scrub":"267'322","last_deep_scrub_stamp":"2024-09-12T01:07:35.657997+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.657997+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.365955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373192,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":57949,"num_write":1020,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.190368+0000","last_change":"2024-09-12T01:07:48.190368+0000","last_active":"2024-09-12T01:07:48.190368+0000","last_peered":"2024-09-12T01:07:48.190368+0000","last_clean":"2024-09-12T01:07:48.190368+0000","last_became_active":"2024-09-12T00:21:46.486768+0000","last_became_peered":"2024-09-12T00:21:46.486768+0000","last_unstale":"2024-09-12T01:07:48.190368+0000","last_undegraded":"2024-09-12T01:07:48.190368+0000","last_fullsized":"2024-09-12T01:07:48.190368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:48.190178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:48.190178+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.190178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.612879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'297","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.307932+0000","last_change":"2024-09-12T01:08:00.307932+0000","last_active":"2024-09-12T01:08:00.307932+0000","last_peered":"2024-09-12T01:08:00.307932+0000","last_clean":"2024-09-12T01:08:00.307932+0000","last_became_active":"2024-09-12T00:21:48.545589+0000","last_became_peered":"2024-09-12T00:21:48.545589+0000","last_unstale":"2024-09-12T01:08:00.307932+0000","last_undegraded":"2024-09-12T01:08:00.307932+0000","last_fullsized":"2024-09-12T01:08:00.307932+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'297","last_scrub_stamp":"2024-09-12T01:08:00.307740+0000","last_deep_scrub":"267'297","last_deep_scrub_stamp":"2024-09-12T01:08:00.307740+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.307740+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:22.754366+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":1095,"num_write":398,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.342253+0000","last_change":"2024-09-12T01:07:55.342033+0000","last_active":"2024-09-12T01:07:55.342253+0000","last_peered":"2024-09-12T01:07:55.342253+0000","last_clean":"2024-09-12T01:07:55.342253+0000","last_became_active":"2024-09-12T00:21:50.556333+0000","last_became_peered":"2024-09-12T00:21:50.556333+0000","last_unstale":"2024-09-12T01:07:55.342253+0000","last_undegraded":"2024-09-12T01:07:55.342253+0000","last_fullsized":"2024-09-12T01:07:55.342253+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:55.341833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:55.341833+0000","last_clean_scrub_stamp":"2024-09-12T01:07:55.341833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:33.231708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'209","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.216828+0000","last_change":"2024-09-12T01:08:12.216663+0000","last_active":"2024-09-12T01:08:12.216828+0000","last_peered":"2024-09-12T01:08:12.216828+0000","last_clean":"2024-09-12T01:08:12.216828+0000","last_became_active":"2024-09-12T00:21:52.565109+0000","last_became_peered":"2024-09-12T00:21:52.565109+0000","last_unstale":"2024-09-12T01:08:12.216828+0000","last_undegraded":"2024-09-12T01:08:12.216828+0000","last_fullsized":"2024-09-12T01:08:12.216828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'209","last_scrub_stamp":"2024-09-12T01:08:12.216444+0000","last_deep_scrub":"267'209","last_deep_scrub_stamp":"2024-09-12T01:08:12.216444+0000","last_clean_scrub_stamp":"2024-09-12T01:08:12.216444+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:09.495538+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'131","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.419785+0000","last_change":"2024-09-12T01:07:45.419785+0000","last_active":"2024-09-12T01:07:45.419785+0000","last_peered":"2024-09-12T01:07:45.419785+0000","last_clean":"2024-09-12T01:07:45.419785+0000","last_became_active":"2024-09-12T00:21:44.488546+0000","last_became_peered":"2024-09-12T00:21:44.488546+0000","last_unstale":"2024-09-12T01:07:45.419785+0000","last_undegraded":"2024-09-12T01:07:45.419785+0000","last_fullsized":"2024-09-12T01:07:45.419785+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:07:45.419606+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:07:45.419606+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.419606+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:27.301674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":436,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'359","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.479909+0000","last_change":"2024-09-12T01:07:39.479909+0000","last_active":"2024-09-12T01:07:39.479909+0000","last_peered":"2024-09-12T01:07:39.479909+0000","last_clean":"2024-09-12T01:07:39.479909+0000","last_became_active":"2024-09-12T00:21:42.513837+0000","last_became_peered":"2024-09-12T00:21:42.513837+0000","last_unstale":"2024-09-12T01:07:39.479909+0000","last_undegraded":"2024-09-12T01:07:39.479909+0000","last_fullsized":"2024-09-12T01:07:39.479909+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'359","last_scrub_stamp":"2024-09-12T01:07:39.479604+0000","last_deep_scrub":"267'359","last_deep_scrub_stamp":"2024-09-12T01:07:39.479604+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.479604+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:45.652858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":19207,"num_write":1040,"num_write_kb":45165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.320491+0000","last_change":"2024-09-12T01:08:00.320491+0000","last_active":"2024-09-12T01:08:00.320491+0000","last_peered":"2024-09-12T01:08:00.320491+0000","last_clean":"2024-09-12T01:08:00.320491+0000","last_became_active":"2024-09-12T00:21:46.492502+0000","last_became_peered":"2024-09-12T00:21:46.492502+0000","last_unstale":"2024-09-12T01:08:00.320491+0000","last_undegraded":"2024-09-12T01:08:00.320491+0000","last_fullsized":"2024-09-12T01:08:00.320491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:00.320300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:00.320300+0000","last_clean_scrub_stamp":"2024-09-12T01:08:00.320300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:45.924340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'104","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.261328+0000","last_change":"2024-09-12T01:08:16.261328+0000","last_active":"2024-09-12T01:08:16.261328+0000","last_peered":"2024-09-12T01:08:16.261328+0000","last_clean":"2024-09-12T01:08:16.261328+0000","last_became_active":"2024-09-12T00:21:48.544915+0000","last_became_peered":"2024-09-12T00:21:48.544915+0000","last_unstale":"2024-09-12T01:08:16.261328+0000","last_undegraded":"2024-09-12T01:08:16.261328+0000","last_fullsized":"2024-09-12T01:08:16.261328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'104","last_scrub_stamp":"2024-09-12T01:08:16.261249+0000","last_deep_scrub":"267'104","last_deep_scrub_stamp":"2024-09-12T01:08:16.261249+0000","last_clean_scrub_stamp":"2024-09-12T01:08:16.261249+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:04.563746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":128,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'782","reported_seq":2233,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.970293+0000","last_change":"2024-09-12T01:07:54.970293+0000","last_active":"2024-09-12T01:07:54.970293+0000","last_peered":"2024-09-12T01:07:54.970293+0000","last_clean":"2024-09-12T01:07:54.970293+0000","last_became_active":"2024-09-12T00:21:50.549552+0000","last_became_peered":"2024-09-12T00:21:50.549552+0000","last_unstale":"2024-09-12T01:07:54.970293+0000","last_undegraded":"2024-09-12T01:07:54.970293+0000","last_fullsized":"2024-09-12T01:07:54.970293+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'782","last_scrub_stamp":"2024-09-12T01:07:54.970110+0000","last_deep_scrub":"267'782","last_deep_scrub_stamp":"2024-09-12T01:07:54.970110+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.970110+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:45.495935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'171","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.217142+0000","last_change":"2024-09-12T01:08:17.216965+0000","last_active":"2024-09-12T01:08:17.217142+0000","last_peered":"2024-09-12T01:08:17.217142+0000","last_clean":"2024-09-12T01:08:17.217142+0000","last_became_active":"2024-09-12T00:21:52.565872+0000","last_became_peered":"2024-09-12T00:21:52.565872+0000","last_unstale":"2024-09-12T01:08:17.217142+0000","last_undegraded":"2024-09-12T01:08:17.217142+0000","last_fullsized":"2024-09-12T01:08:17.217142+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-12T01:08:17.216781+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-12T01:08:17.216781+0000","last_clean_scrub_stamp":"2024-09-12T01:08:17.216781+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:34.553895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":199,"num_write":407,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'4285","reported_seq":4948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.202447+0000","last_change":"2024-09-12T01:07:47.202447+0000","last_active":"2024-09-12T01:07:47.202447+0000","last_peered":"2024-09-12T01:07:47.202447+0000","last_clean":"2024-09-12T01:07:47.202447+0000","last_became_active":"2024-09-12T00:21:44.521310+0000","last_became_peered":"2024-09-12T00:21:44.521310+0000","last_unstale":"2024-09-12T01:07:47.202447+0000","last_undegraded":"2024-09-12T01:07:47.202447+0000","last_fullsized":"2024-09-12T01:07:47.202447+0000","mapping_epoch":28,"log_start":"267'4200","ondisk_log_start":"267'4200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4285","last_scrub_stamp":"2024-09-12T01:07:47.202270+0000","last_deep_scrub":"267'4285","last_deep_scrub_stamp":"2024-09-12T01:07:47.202270+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.202270+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:42.173767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17290,"num_read_kb":14479,"num_write":6455,"num_write_kb":3215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'412","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.695539+0000","last_change":"2024-09-12T01:07:37.695539+0000","last_active":"2024-09-12T01:07:37.695539+0000","last_peered":"2024-09-12T01:07:37.695539+0000","last_clean":"2024-09-12T01:07:37.695539+0000","last_became_active":"2024-09-12T00:21:42.507712+0000","last_became_peered":"2024-09-12T00:21:42.507712+0000","last_unstale":"2024-09-12T01:07:37.695539+0000","last_undegraded":"2024-09-12T01:07:37.695539+0000","last_fullsized":"2024-09-12T01:07:37.695539+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-09-12T01:07:37.695311+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-09-12T01:07:37.695311+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.695311+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:19.588168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992333,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":35222,"num_write":1344,"num_write_kb":36033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.578853+0000","last_change":"2024-09-12T01:07:52.578853+0000","last_active":"2024-09-12T01:07:52.578853+0000","last_peered":"2024-09-12T01:07:52.578853+0000","last_clean":"2024-09-12T01:07:52.578853+0000","last_became_active":"2024-09-12T00:21:46.514146+0000","last_became_peered":"2024-09-12T00:21:46.514146+0000","last_unstale":"2024-09-12T01:07:52.578853+0000","last_undegraded":"2024-09-12T01:07:52.578853+0000","last_fullsized":"2024-09-12T01:07:52.578853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:52.578598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:52.578598+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.578598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:11.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'341","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.052832+0000","last_change":"2024-09-12T01:07:52.052641+0000","last_active":"2024-09-12T01:07:52.052832+0000","last_peered":"2024-09-12T01:07:52.052832+0000","last_clean":"2024-09-12T01:07:52.052832+0000","last_became_active":"2024-09-12T00:21:48.543993+0000","last_became_peered":"2024-09-12T00:21:48.543993+0000","last_unstale":"2024-09-12T01:07:52.052832+0000","last_undegraded":"2024-09-12T01:07:52.052832+0000","last_fullsized":"2024-09-12T01:07:52.052832+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T01:07:52.052427+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T01:07:52.052427+0000","last_clean_scrub_stamp":"2024-09-12T01:07:52.052427+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:19.461377+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50118,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1190,"num_write":440,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.460820+0000","last_change":"2024-09-12T01:08:07.460820+0000","last_active":"2024-09-12T01:08:07.460820+0000","last_peered":"2024-09-12T01:08:07.460820+0000","last_clean":"2024-09-12T01:08:07.460820+0000","last_became_active":"2024-09-12T00:21:50.525885+0000","last_became_peered":"2024-09-12T00:21:50.525885+0000","last_unstale":"2024-09-12T01:08:07.460820+0000","last_undegraded":"2024-09-12T01:08:07.460820+0000","last_fullsized":"2024-09-12T01:08:07.460820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:07.460643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:07.460643+0000","last_clean_scrub_stamp":"2024-09-12T01:08:07.460643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:57.948172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'117","reported_seq":627,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.548906+0000","last_change":"2024-09-12T01:08:01.548906+0000","last_active":"2024-09-12T01:08:01.548906+0000","last_peered":"2024-09-12T01:08:01.548906+0000","last_clean":"2024-09-12T01:08:01.548906+0000","last_became_active":"2024-09-12T00:21:52.559361+0000","last_became_peered":"2024-09-12T00:21:52.559361+0000","last_unstale":"2024-09-12T01:08:01.548906+0000","last_undegraded":"2024-09-12T01:08:01.548906+0000","last_fullsized":"2024-09-12T01:08:01.548906+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:08:01.548731+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:08:01.548731+0000","last_clean_scrub_stamp":"2024-09-12T01:08:01.548731+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:50.829398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":266,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'251","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.238428+0000","last_change":"2024-09-12T01:07:44.238428+0000","last_active":"2024-09-12T01:07:44.238428+0000","last_peered":"2024-09-12T01:07:44.238428+0000","last_clean":"2024-09-12T01:07:44.238428+0000","last_became_active":"2024-09-12T00:21:44.486014+0000","last_became_peered":"2024-09-12T00:21:44.486014+0000","last_unstale":"2024-09-12T01:07:44.238428+0000","last_undegraded":"2024-09-12T01:07:44.238428+0000","last_fullsized":"2024-09-12T01:07:44.238428+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-12T01:07:44.238257+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-12T01:07:44.238257+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.238257+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:57.856443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1098,"num_read_kb":899,"num_write":369,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'313","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.889993+0000","last_change":"2024-09-12T01:07:43.889993+0000","last_active":"2024-09-12T01:07:43.889993+0000","last_peered":"2024-09-12T01:07:43.889993+0000","last_clean":"2024-09-12T01:07:43.889993+0000","last_became_active":"2024-09-12T00:21:42.491757+0000","last_became_peered":"2024-09-12T00:21:42.491757+0000","last_unstale":"2024-09-12T01:07:43.889993+0000","last_undegraded":"2024-09-12T01:07:43.889993+0000","last_fullsized":"2024-09-12T01:07:43.889993+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'313","last_scrub_stamp":"2024-09-12T01:07:43.889701+0000","last_deep_scrub":"267'313","last_deep_scrub_stamp":"2024-09-12T01:07:43.889701+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.889701+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:25.943315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":76220,"num_write":1035,"num_write_kb":46746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.158201+0000","last_change":"2024-09-12T01:07:51.158201+0000","last_active":"2024-09-12T01:07:51.158201+0000","last_peered":"2024-09-12T01:07:51.158201+0000","last_clean":"2024-09-12T01:07:51.158201+0000","last_became_active":"2024-09-12T00:21:46.503203+0000","last_became_peered":"2024-09-12T00:21:46.503203+0000","last_unstale":"2024-09-12T01:07:51.158201+0000","last_undegraded":"2024-09-12T01:07:51.158201+0000","last_fullsized":"2024-09-12T01:07:51.158201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:51.158024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:51.158024+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.158024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:20.104900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'289","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.376521+0000","last_change":"2024-09-12T01:08:03.376521+0000","last_active":"2024-09-12T01:08:03.376521+0000","last_peered":"2024-09-12T01:08:03.376521+0000","last_clean":"2024-09-12T01:08:03.376521+0000","last_became_active":"2024-09-12T00:21:48.536841+0000","last_became_peered":"2024-09-12T00:21:48.536841+0000","last_unstale":"2024-09-12T01:08:03.376521+0000","last_undegraded":"2024-09-12T01:08:03.376521+0000","last_fullsized":"2024-09-12T01:08:03.376521+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'289","last_scrub_stamp":"2024-09-12T01:08:03.376310+0000","last_deep_scrub":"267'289","last_deep_scrub_stamp":"2024-09-12T01:08:03.376310+0000","last_clean_scrub_stamp":"2024-09-12T01:08:03.376310+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:32.833802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48050,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1127,"num_write":390,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.299075+0000","last_change":"2024-09-12T01:08:20.299075+0000","last_active":"2024-09-12T01:08:20.299075+0000","last_peered":"2024-09-12T01:08:20.299075+0000","last_clean":"2024-09-12T01:08:20.299075+0000","last_became_active":"2024-09-12T00:21:50.538041+0000","last_became_peered":"2024-09-12T00:21:50.538041+0000","last_unstale":"2024-09-12T01:08:20.299075+0000","last_undegraded":"2024-09-12T01:08:20.299075+0000","last_fullsized":"2024-09-12T01:08:20.299075+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:20.298872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:20.298872+0000","last_clean_scrub_stamp":"2024-09-12T01:08:20.298872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:38.240618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'126","reported_seq":647,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.817259+0000","last_change":"2024-09-12T01:08:13.817259+0000","last_active":"2024-09-12T01:08:13.817259+0000","last_peered":"2024-09-12T01:08:13.817259+0000","last_clean":"2024-09-12T01:08:13.817259+0000","last_became_active":"2024-09-12T00:21:52.560366+0000","last_became_peered":"2024-09-12T00:21:52.560366+0000","last_unstale":"2024-09-12T01:08:13.817259+0000","last_undegraded":"2024-09-12T01:08:13.817259+0000","last_fullsized":"2024-09-12T01:08:13.817259+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-09-12T01:08:13.817076+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-09-12T01:08:13.817076+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.817076+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:14.120841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":163,"num_read_kb":157,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'212","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.109280+0000","last_change":"2024-09-12T01:07:41.109151+0000","last_active":"2024-09-12T01:07:41.109280+0000","last_peered":"2024-09-12T01:07:41.109280+0000","last_clean":"2024-09-12T01:07:41.109280+0000","last_became_active":"2024-09-12T00:21:44.512917+0000","last_became_peered":"2024-09-12T00:21:44.512917+0000","last_unstale":"2024-09-12T01:07:41.109280+0000","last_undegraded":"2024-09-12T01:07:41.109280+0000","last_fullsized":"2024-09-12T01:07:41.109280+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-12T01:07:41.108966+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-12T01:07:41.108966+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.108966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:25.227949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":716,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'387","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.063601+0000","last_change":"2024-09-12T01:07:39.063458+0000","last_active":"2024-09-12T01:07:39.063601+0000","last_peered":"2024-09-12T01:07:39.063601+0000","last_clean":"2024-09-12T01:07:39.063601+0000","last_became_active":"2024-09-12T00:21:42.516419+0000","last_became_peered":"2024-09-12T00:21:42.516419+0000","last_unstale":"2024-09-12T01:07:39.063601+0000","last_undegraded":"2024-09-12T01:07:39.063601+0000","last_fullsized":"2024-09-12T01:07:39.063601+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-09-12T01:07:39.063230+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-09-12T01:07:39.063230+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.063230+0000","objects_scrubbed":10,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:19.966999+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1662646,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":630,"num_read_kb":12934,"num_write":1264,"num_write_kb":32784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:49.641054+0000","last_change":"2024-09-12T01:07:49.641054+0000","last_active":"2024-09-12T01:07:49.641054+0000","last_peered":"2024-09-12T01:07:49.641054+0000","last_clean":"2024-09-12T01:07:49.641054+0000","last_became_active":"2024-09-12T00:21:46.503747+0000","last_became_peered":"2024-09-12T00:21:46.503747+0000","last_unstale":"2024-09-12T01:07:49.641054+0000","last_undegraded":"2024-09-12T01:07:49.641054+0000","last_fullsized":"2024-09-12T01:07:49.641054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:07:49.640866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:07:49.640866+0000","last_clean_scrub_stamp":"2024-09-12T01:07:49.640866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:15.512638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'247","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.294797+0000","last_change":"2024-09-12T01:07:58.294797+0000","last_active":"2024-09-12T01:07:58.294797+0000","last_peered":"2024-09-12T01:07:58.294797+0000","last_clean":"2024-09-12T01:07:58.294797+0000","last_became_active":"2024-09-12T00:21:48.546392+0000","last_became_peered":"2024-09-12T00:21:48.546392+0000","last_unstale":"2024-09-12T01:07:58.294797+0000","last_undegraded":"2024-09-12T01:07:58.294797+0000","last_fullsized":"2024-09-12T01:07:58.294797+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-12T01:07:58.294616+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-12T01:07:58.294616+0000","last_clean_scrub_stamp":"2024-09-12T01:07:58.294616+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:51.609748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54260,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":387,"num_read_kb":921,"num_write":312,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.206312+0000","last_change":"2024-09-12T01:08:13.206312+0000","last_active":"2024-09-12T01:08:13.206312+0000","last_peered":"2024-09-12T01:08:13.206312+0000","last_clean":"2024-09-12T01:08:13.206312+0000","last_became_active":"2024-09-12T00:21:50.548527+0000","last_became_peered":"2024-09-12T00:21:50.548527+0000","last_unstale":"2024-09-12T01:08:13.206312+0000","last_undegraded":"2024-09-12T01:08:13.206312+0000","last_fullsized":"2024-09-12T01:08:13.206312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:13.206131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:13.206131+0000","last_clean_scrub_stamp":"2024-09-12T01:08:13.206131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:14.644789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'198","reported_seq":1715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.356021+0000","last_change":"2024-09-12T01:08:21.356021+0000","last_active":"2024-09-12T01:08:21.356021+0000","last_peered":"2024-09-12T01:08:21.356021+0000","last_clean":"2024-09-12T01:08:21.356021+0000","last_became_active":"2024-09-12T00:21:52.559360+0000","last_became_peered":"2024-09-12T00:21:52.559360+0000","last_unstale":"2024-09-12T01:08:21.356021+0000","last_undegraded":"2024-09-12T01:08:21.356021+0000","last_fullsized":"2024-09-12T01:08:21.356021+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:08:21.355801+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:08:21.355801+0000","last_clean_scrub_stamp":"2024-09-12T01:08:21.355801+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:28.037088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1367,"num_read_kb":1316,"num_write":423,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'81","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.269673+0000","last_change":"2024-09-12T01:07:43.269673+0000","last_active":"2024-09-12T01:07:43.269673+0000","last_peered":"2024-09-12T01:07:43.269673+0000","last_clean":"2024-09-12T01:07:43.269673+0000","last_became_active":"2024-09-12T00:21:44.485278+0000","last_became_peered":"2024-09-12T00:21:44.485278+0000","last_unstale":"2024-09-12T01:07:43.269673+0000","last_undegraded":"2024-09-12T01:07:43.269673+0000","last_fullsized":"2024-09-12T01:07:43.269673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-12T01:07:43.269425+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-12T01:07:43.269425+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.269425+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:25.610398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":295,"num_write":139,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'331","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.020797+0000","last_change":"2024-09-12T01:07:40.020797+0000","last_active":"2024-09-12T01:07:40.020797+0000","last_peered":"2024-09-12T01:07:40.020797+0000","last_clean":"2024-09-12T01:07:40.020797+0000","last_became_active":"2024-09-12T00:21:42.520276+0000","last_became_peered":"2024-09-12T00:21:42.520276+0000","last_unstale":"2024-09-12T01:07:40.020797+0000","last_undegraded":"2024-09-12T01:07:40.020797+0000","last_fullsized":"2024-09-12T01:07:40.020797+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-09-12T01:07:40.020532+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-09-12T01:07:40.020532+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.020532+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.026913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35265,"num_write":1034,"num_write_kb":28370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"267'6","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.391938+0000","last_change":"2024-09-12T01:07:56.391938+0000","last_active":"2024-09-12T01:07:56.391938+0000","last_peered":"2024-09-12T01:07:56.391938+0000","last_clean":"2024-09-12T01:07:56.391938+0000","last_became_active":"2024-09-12T00:21:46.495088+0000","last_became_peered":"2024-09-12T00:21:46.495088+0000","last_unstale":"2024-09-12T01:07:56.391938+0000","last_undegraded":"2024-09-12T01:07:56.391938+0000","last_fullsized":"2024-09-12T01:07:56.391938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:07:56.391742+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:07:56.391742+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.391742+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:37.803256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'333","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.207573+0000","last_change":"2024-09-12T01:08:09.207573+0000","last_active":"2024-09-12T01:08:09.207573+0000","last_peered":"2024-09-12T01:08:09.207573+0000","last_clean":"2024-09-12T01:08:09.207573+0000","last_became_active":"2024-09-12T00:21:48.550441+0000","last_became_peered":"2024-09-12T00:21:48.550441+0000","last_unstale":"2024-09-12T01:08:09.207573+0000","last_undegraded":"2024-09-12T01:08:09.207573+0000","last_fullsized":"2024-09-12T01:08:09.207573+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T01:08:09.207370+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T01:08:09.207370+0000","last_clean_scrub_stamp":"2024-09-12T01:08:09.207370+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:06.548406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54992,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1211,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.503170+0000","last_change":"2024-09-12T01:08:08.503170+0000","last_active":"2024-09-12T01:08:08.503170+0000","last_peered":"2024-09-12T01:08:08.503170+0000","last_clean":"2024-09-12T01:08:08.503170+0000","last_became_active":"2024-09-12T00:21:50.565955+0000","last_became_peered":"2024-09-12T00:21:50.565955+0000","last_unstale":"2024-09-12T01:08:08.503170+0000","last_undegraded":"2024-09-12T01:08:08.503170+0000","last_fullsized":"2024-09-12T01:08:08.503170+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:08:08.502979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:08:08.502979+0000","last_clean_scrub_stamp":"2024-09-12T01:08:08.502979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:12.378006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'135","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.029020+0000","last_change":"2024-09-12T01:07:57.028869+0000","last_active":"2024-09-12T01:07:57.029020+0000","last_peered":"2024-09-12T01:07:57.029020+0000","last_clean":"2024-09-12T01:07:57.029020+0000","last_became_active":"2024-09-12T00:21:52.549080+0000","last_became_peered":"2024-09-12T00:21:52.549080+0000","last_unstale":"2024-09-12T01:07:57.029020+0000","last_undegraded":"2024-09-12T01:07:57.029020+0000","last_fullsized":"2024-09-12T01:07:57.029020+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'135","last_scrub_stamp":"2024-09-12T01:07:57.028668+0000","last_deep_scrub":"267'135","last_deep_scrub_stamp":"2024-09-12T01:07:57.028668+0000","last_clean_scrub_stamp":"2024-09-12T01:07:57.028668+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:46.435166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":312,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'77","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.329440+0000","last_change":"2024-09-12T01:07:47.329440+0000","last_active":"2024-09-12T01:07:47.329440+0000","last_peered":"2024-09-12T01:07:47.329440+0000","last_clean":"2024-09-12T01:07:47.329440+0000","last_became_active":"2024-09-12T00:21:44.495122+0000","last_became_peered":"2024-09-12T00:21:44.495122+0000","last_unstale":"2024-09-12T01:07:47.329440+0000","last_undegraded":"2024-09-12T01:07:47.329440+0000","last_fullsized":"2024-09-12T01:07:47.329440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'77","last_scrub_stamp":"2024-09-12T01:07:47.329261+0000","last_deep_scrub":"267'77","last_deep_scrub_stamp":"2024-09-12T01:07:47.329261+0000","last_clean_scrub_stamp":"2024-09-12T01:07:47.329261+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:47.321608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":290,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'356","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.326370+0000","last_change":"2024-09-12T01:07:38.326370+0000","last_active":"2024-09-12T01:07:38.326370+0000","last_peered":"2024-09-12T01:07:38.326370+0000","last_clean":"2024-09-12T01:07:38.326370+0000","last_became_active":"2024-09-12T00:21:42.492358+0000","last_became_peered":"2024-09-12T00:21:42.492358+0000","last_unstale":"2024-09-12T01:07:38.326370+0000","last_undegraded":"2024-09-12T01:07:38.326370+0000","last_fullsized":"2024-09-12T01:07:38.326370+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'356","last_scrub_stamp":"2024-09-12T01:07:38.326089+0000","last_deep_scrub":"267'356","last_deep_scrub_stamp":"2024-09-12T01:07:38.326089+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.326089+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:59.129648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262257,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":28331,"num_write":1177,"num_write_kb":34411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'258","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.117862+0000","last_change":"2024-09-12T01:07:43.117862+0000","last_active":"2024-09-12T01:07:43.117862+0000","last_peered":"2024-09-12T01:07:43.117862+0000","last_clean":"2024-09-12T01:07:43.117862+0000","last_became_active":"2024-09-12T00:21:44.515839+0000","last_became_peered":"2024-09-12T00:21:44.515839+0000","last_unstale":"2024-09-12T01:07:43.117862+0000","last_undegraded":"2024-09-12T01:07:43.117862+0000","last_fullsized":"2024-09-12T01:07:43.117862+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:07:43.117677+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:07:43.117677+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.117677+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":1036,"num_write":423,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'449","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.076589+0000","last_change":"2024-09-12T01:07:39.076589+0000","last_active":"2024-09-12T01:07:39.076589+0000","last_peered":"2024-09-12T01:07:39.076589+0000","last_clean":"2024-09-12T01:07:39.076589+0000","last_became_active":"2024-09-12T00:21:42.502396+0000","last_became_peered":"2024-09-12T00:21:42.502396+0000","last_unstale":"2024-09-12T01:07:39.076589+0000","last_undegraded":"2024-09-12T01:07:39.076589+0000","last_fullsized":"2024-09-12T01:07:39.076589+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'449","last_scrub_stamp":"2024-09-12T01:07:39.076357+0000","last_deep_scrub":"267'449","last_deep_scrub_stamp":"2024-09-12T01:07:39.076357+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.076357+0000","objects_scrubbed":10,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:36.125871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607324,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":742,"num_read_kb":17888,"num_write":1520,"num_write_kb":31183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'183","reported_seq":757,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.932889+0000","last_change":"2024-09-12T01:07:56.932889+0000","last_active":"2024-09-12T01:07:56.932889+0000","last_peered":"2024-09-12T01:07:56.932889+0000","last_clean":"2024-09-12T01:07:56.932889+0000","last_became_active":"2024-09-12T00:21:44.499805+0000","last_became_peered":"2024-09-12T00:21:44.499805+0000","last_unstale":"2024-09-12T01:07:56.932889+0000","last_undegraded":"2024-09-12T01:07:56.932889+0000","last_fullsized":"2024-09-12T01:07:56.932889+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-12T01:07:56.932675+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-12T01:07:56.932675+0000","last_clean_scrub_stamp":"2024-09-12T01:07:56.932675+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:28.852641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":613,"num_write":283,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'459","reported_seq":1211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.936240+0000","last_change":"2024-09-12T01:07:46.936240+0000","last_active":"2024-09-12T01:07:46.936240+0000","last_peered":"2024-09-12T01:07:46.936240+0000","last_clean":"2024-09-12T01:07:46.936240+0000","last_became_active":"2024-09-12T00:21:42.518823+0000","last_became_peered":"2024-09-12T00:21:42.518823+0000","last_unstale":"2024-09-12T01:07:46.936240+0000","last_undegraded":"2024-09-12T01:07:46.936240+0000","last_fullsized":"2024-09-12T01:07:46.936240+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'459","last_scrub_stamp":"2024-09-12T01:07:46.935967+0000","last_deep_scrub":"267'459","last_deep_scrub_stamp":"2024-09-12T01:07:46.935967+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.935967+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:07.773715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194369,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":958,"num_read_kb":24368,"num_write":1486,"num_write_kb":48727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'184","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.018711+0000","last_change":"2024-09-12T01:07:54.018711+0000","last_active":"2024-09-12T01:07:54.018711+0000","last_peered":"2024-09-12T01:07:54.018711+0000","last_clean":"2024-09-12T01:07:54.018711+0000","last_became_active":"2024-09-12T00:21:44.510818+0000","last_became_peered":"2024-09-12T00:21:44.510818+0000","last_unstale":"2024-09-12T01:07:54.018711+0000","last_undegraded":"2024-09-12T01:07:54.018711+0000","last_fullsized":"2024-09-12T01:07:54.018711+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-12T01:07:54.018527+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-12T01:07:54.018527+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.018527+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:05.725799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":814,"num_read_kb":671,"num_write":265,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'350","reported_seq":1138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.997261+0000","last_change":"2024-09-12T01:07:40.997011+0000","last_active":"2024-09-12T01:07:40.997261+0000","last_peered":"2024-09-12T01:07:40.997261+0000","last_clean":"2024-09-12T01:07:40.997261+0000","last_became_active":"2024-09-12T00:21:42.525233+0000","last_became_peered":"2024-09-12T00:21:42.525233+0000","last_unstale":"2024-09-12T01:07:40.997261+0000","last_undegraded":"2024-09-12T01:07:40.997261+0000","last_fullsized":"2024-09-12T01:07:40.997261+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-12T01:07:40.996743+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-12T01:07:40.996743+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.996743+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:28.641437+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":844,"num_read_kb":20388,"num_write":1063,"num_write_kb":42665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'183","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.022367+0000","last_change":"2024-09-12T01:07:53.022367+0000","last_active":"2024-09-12T01:07:53.022367+0000","last_peered":"2024-09-12T01:07:53.022367+0000","last_clean":"2024-09-12T01:07:53.022367+0000","last_became_active":"2024-09-12T00:21:44.523632+0000","last_became_peered":"2024-09-12T00:21:44.523632+0000","last_unstale":"2024-09-12T01:07:53.022367+0000","last_undegraded":"2024-09-12T01:07:53.022367+0000","last_fullsized":"2024-09-12T01:07:53.022367+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-12T01:07:53.022187+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-12T01:07:53.022187+0000","last_clean_scrub_stamp":"2024-09-12T01:07:53.022187+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.672407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":821,"num_read_kb":680,"num_write":294,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'392","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.353558+0000","last_change":"2024-09-12T01:07:38.353558+0000","last_active":"2024-09-12T01:07:38.353558+0000","last_peered":"2024-09-12T01:07:38.353558+0000","last_clean":"2024-09-12T01:07:38.353558+0000","last_became_active":"2024-09-12T00:21:42.501690+0000","last_became_peered":"2024-09-12T00:21:42.501690+0000","last_unstale":"2024-09-12T01:07:38.353558+0000","last_undegraded":"2024-09-12T01:07:38.353558+0000","last_fullsized":"2024-09-12T01:07:38.353558+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T01:07:38.353347+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T01:07:38.353347+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.353347+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.350580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":15193,"num_write":1332,"num_write_kb":28087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'132","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.987108+0000","last_change":"2024-09-12T01:07:39.987108+0000","last_active":"2024-09-12T01:07:39.987108+0000","last_peered":"2024-09-12T01:07:39.987108+0000","last_clean":"2024-09-12T01:07:39.987108+0000","last_became_active":"2024-09-12T00:21:44.505235+0000","last_became_peered":"2024-09-12T00:21:44.505235+0000","last_unstale":"2024-09-12T01:07:39.987108+0000","last_undegraded":"2024-09-12T01:07:39.987108+0000","last_fullsized":"2024-09-12T01:07:39.987108+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-12T01:07:39.986839+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-12T01:07:39.986839+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.986839+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:55.921394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":497,"num_write":201,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'335","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.339544+0000","last_change":"2024-09-12T01:07:41.339544+0000","last_active":"2024-09-12T01:07:41.339544+0000","last_peered":"2024-09-12T01:07:41.339544+0000","last_clean":"2024-09-12T01:07:41.339544+0000","last_became_active":"2024-09-12T00:21:42.508673+0000","last_became_peered":"2024-09-12T00:21:42.508673+0000","last_unstale":"2024-09-12T01:07:41.339544+0000","last_undegraded":"2024-09-12T01:07:41.339544+0000","last_fullsized":"2024-09-12T01:07:41.339544+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-12T01:07:41.339325+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-12T01:07:41.339325+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.339325+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:53.386446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":604,"num_read_kb":49155,"num_write":1190,"num_write_kb":40891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'142","reported_seq":764,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.352041+0000","last_change":"2024-09-12T01:07:48.352041+0000","last_active":"2024-09-12T01:07:48.352041+0000","last_peered":"2024-09-12T01:07:48.352041+0000","last_clean":"2024-09-12T01:07:48.352041+0000","last_became_active":"2024-09-12T00:21:44.515206+0000","last_became_peered":"2024-09-12T00:21:44.515206+0000","last_unstale":"2024-09-12T01:07:48.352041+0000","last_undegraded":"2024-09-12T01:07:48.352041+0000","last_fullsized":"2024-09-12T01:07:48.352041+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-12T01:07:48.351764+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-12T01:07:48.351764+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.351764+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:43.602157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":613,"num_write":237,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'349","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.216592+0000","last_change":"2024-09-12T01:07:35.216592+0000","last_active":"2024-09-12T01:07:35.216592+0000","last_peered":"2024-09-12T01:07:35.216592+0000","last_clean":"2024-09-12T01:07:35.216592+0000","last_became_active":"2024-09-12T00:21:42.486829+0000","last_became_peered":"2024-09-12T00:21:42.486829+0000","last_unstale":"2024-09-12T01:07:35.216592+0000","last_undegraded":"2024-09-12T01:07:35.216592+0000","last_fullsized":"2024-09-12T01:07:35.216592+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:35.216329+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:35.216329+0000","last_clean_scrub_stamp":"2024-09-12T01:07:35.216329+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:13.259415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":546,"num_read_kb":26644,"num_write":1053,"num_write_kb":13447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'172","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:39.681254+0000","last_change":"2024-09-12T01:07:39.681254+0000","last_active":"2024-09-12T01:07:39.681254+0000","last_peered":"2024-09-12T01:07:39.681254+0000","last_clean":"2024-09-12T01:07:39.681254+0000","last_became_active":"2024-09-12T00:21:44.501384+0000","last_became_peered":"2024-09-12T00:21:44.501384+0000","last_unstale":"2024-09-12T01:07:39.681254+0000","last_undegraded":"2024-09-12T01:07:39.681254+0000","last_fullsized":"2024-09-12T01:07:39.681254+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'172","last_scrub_stamp":"2024-09-12T01:07:39.681065+0000","last_deep_scrub":"267'172","last_deep_scrub_stamp":"2024-09-12T01:07:39.681065+0000","last_clean_scrub_stamp":"2024-09-12T01:07:39.681065+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:09.758134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":594,"num_write":251,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'349","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.976693+0000","last_change":"2024-09-12T01:07:41.976693+0000","last_active":"2024-09-12T01:07:41.976693+0000","last_peered":"2024-09-12T01:07:41.976693+0000","last_clean":"2024-09-12T01:07:41.976693+0000","last_became_active":"2024-09-12T00:21:42.533216+0000","last_became_peered":"2024-09-12T00:21:42.533216+0000","last_unstale":"2024-09-12T01:07:41.976693+0000","last_undegraded":"2024-09-12T01:07:41.976693+0000","last_fullsized":"2024-09-12T01:07:41.976693+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:41.976497+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:41.976497+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.976497+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.595660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":42167,"num_write":1187,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'107","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.168385+0000","last_change":"2024-09-12T01:07:45.168220+0000","last_active":"2024-09-12T01:07:45.168385+0000","last_peered":"2024-09-12T01:07:45.168385+0000","last_clean":"2024-09-12T01:07:45.168385+0000","last_became_active":"2024-09-12T00:21:44.514909+0000","last_became_peered":"2024-09-12T00:21:44.514909+0000","last_unstale":"2024-09-12T01:07:45.168385+0000","last_undegraded":"2024-09-12T01:07:45.168385+0000","last_fullsized":"2024-09-12T01:07:45.168385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-12T01:07:45.168048+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-12T01:07:45.168048+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.168048+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:49.895766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":354,"num_write":152,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'370","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.936009+0000","last_change":"2024-09-12T01:07:41.936009+0000","last_active":"2024-09-12T01:07:41.936009+0000","last_peered":"2024-09-12T01:07:41.936009+0000","last_clean":"2024-09-12T01:07:41.936009+0000","last_became_active":"2024-09-12T00:21:42.528929+0000","last_became_peered":"2024-09-12T00:21:42.528929+0000","last_unstale":"2024-09-12T01:07:41.936009+0000","last_undegraded":"2024-09-12T01:07:41.936009+0000","last_fullsized":"2024-09-12T01:07:41.936009+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-12T01:07:41.935688+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-12T01:07:41.935688+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.935688+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:34.868286+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739017,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":14743,"num_write":1076,"num_write_kb":22917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'148","reported_seq":785,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.021178+0000","last_change":"2024-09-12T01:07:44.021040+0000","last_active":"2024-09-12T01:07:44.021178+0000","last_peered":"2024-09-12T01:07:44.021178+0000","last_clean":"2024-09-12T01:07:44.021178+0000","last_became_active":"2024-09-12T00:21:44.507579+0000","last_became_peered":"2024-09-12T00:21:44.507579+0000","last_unstale":"2024-09-12T01:07:44.021178+0000","last_undegraded":"2024-09-12T01:07:44.021178+0000","last_fullsized":"2024-09-12T01:07:44.021178+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'148","last_scrub_stamp":"2024-09-12T01:07:44.020852+0000","last_deep_scrub":"267'148","last_deep_scrub_stamp":"2024-09-12T01:07:44.020852+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.020852+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.933243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":566,"num_write":233,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'388","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.012237+0000","last_change":"2024-09-12T01:07:43.012237+0000","last_active":"2024-09-12T01:07:43.012237+0000","last_peered":"2024-09-12T01:07:43.012237+0000","last_clean":"2024-09-12T01:07:43.012237+0000","last_became_active":"2024-09-12T00:21:42.511703+0000","last_became_peered":"2024-09-12T00:21:42.511703+0000","last_unstale":"2024-09-12T01:07:43.012237+0000","last_undegraded":"2024-09-12T01:07:43.012237+0000","last_fullsized":"2024-09-12T01:07:43.012237+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'388","last_scrub_stamp":"2024-09-12T01:07:43.011885+0000","last_deep_scrub":"267'388","last_deep_scrub_stamp":"2024-09-12T01:07:43.011885+0000","last_clean_scrub_stamp":"2024-09-12T01:07:43.011885+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:55.733392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":16290,"num_write":1225,"num_write_kb":34029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'32","reported_seq":582,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:54.977961+0000","last_change":"2024-09-12T01:07:54.977961+0000","last_active":"2024-09-12T01:07:54.977961+0000","last_peered":"2024-09-12T01:07:54.977961+0000","last_clean":"2024-09-12T01:07:54.977961+0000","last_became_active":"2024-09-12T00:21:44.509834+0000","last_became_peered":"2024-09-12T00:21:44.509834+0000","last_unstale":"2024-09-12T01:07:54.977961+0000","last_undegraded":"2024-09-12T01:07:54.977961+0000","last_fullsized":"2024-09-12T01:07:54.977961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'32","last_scrub_stamp":"2024-09-12T01:07:54.977690+0000","last_deep_scrub":"267'32","last_deep_scrub_stamp":"2024-09-12T01:07:54.977690+0000","last_clean_scrub_stamp":"2024-09-12T01:07:54.977690+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:06.019506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":126,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'345","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.645905+0000","last_change":"2024-09-12T01:07:40.645905+0000","last_active":"2024-09-12T01:07:40.645905+0000","last_peered":"2024-09-12T01:07:40.645905+0000","last_clean":"2024-09-12T01:07:40.645905+0000","last_became_active":"2024-09-12T00:21:42.484073+0000","last_became_peered":"2024-09-12T00:21:42.484073+0000","last_unstale":"2024-09-12T01:07:40.645905+0000","last_undegraded":"2024-09-12T01:07:40.645905+0000","last_fullsized":"2024-09-12T01:07:40.645905+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T01:07:40.645425+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T01:07:40.645425+0000","last_clean_scrub_stamp":"2024-09-12T01:07:40.645425+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.525871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992329,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":37312,"num_write":1168,"num_write_kb":47723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'220","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.580102+0000","last_change":"2024-09-12T01:07:42.580102+0000","last_active":"2024-09-12T01:07:42.580102+0000","last_peered":"2024-09-12T01:07:42.580102+0000","last_clean":"2024-09-12T01:07:42.580102+0000","last_became_active":"2024-09-12T00:21:44.499043+0000","last_became_peered":"2024-09-12T00:21:44.499043+0000","last_unstale":"2024-09-12T01:07:42.580102+0000","last_undegraded":"2024-09-12T01:07:42.580102+0000","last_fullsized":"2024-09-12T01:07:42.580102+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-12T01:07:42.579921+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-12T01:07:42.579921+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.579921+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:04.824993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":734,"num_write":347,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'399","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.486946+0000","last_change":"2024-09-12T01:07:41.486946+0000","last_active":"2024-09-12T01:07:41.486946+0000","last_peered":"2024-09-12T01:07:41.486946+0000","last_clean":"2024-09-12T01:07:41.486946+0000","last_became_active":"2024-09-12T00:21:42.482971+0000","last_became_peered":"2024-09-12T00:21:42.482971+0000","last_unstale":"2024-09-12T01:07:41.486946+0000","last_undegraded":"2024-09-12T01:07:41.486946+0000","last_fullsized":"2024-09-12T01:07:41.486946+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-12T01:07:41.486689+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-12T01:07:41.486689+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.486689+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:42.636122+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5391930,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":31089,"num_write":1168,"num_write_kb":20487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'219","reported_seq":892,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.623877+0000","last_change":"2024-09-12T01:07:41.623877+0000","last_active":"2024-09-12T01:07:41.623877+0000","last_peered":"2024-09-12T01:07:41.623877+0000","last_clean":"2024-09-12T01:07:41.623877+0000","last_became_active":"2024-09-12T00:21:44.526086+0000","last_became_peered":"2024-09-12T00:21:44.526086+0000","last_unstale":"2024-09-12T01:07:41.623877+0000","last_undegraded":"2024-09-12T01:07:41.623877+0000","last_fullsized":"2024-09-12T01:07:41.623877+0000","mapping_epoch":28,"log_start":"267'200","ondisk_log_start":"267'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T01:07:41.623704+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T01:07:41.623704+0000","last_clean_scrub_stamp":"2024-09-12T01:07:41.623704+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:51.380240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1006,"num_read_kb":865,"num_write":343,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3377,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'363","reported_seq":1106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.022461+0000","last_change":"2024-09-12T01:07:46.022461+0000","last_active":"2024-09-12T01:07:46.022461+0000","last_peered":"2024-09-12T01:07:46.022461+0000","last_clean":"2024-09-12T01:07:46.022461+0000","last_became_active":"2024-09-12T00:22:12.609837+0000","last_became_peered":"2024-09-12T00:22:12.609837+0000","last_unstale":"2024-09-12T01:07:46.022461+0000","last_undegraded":"2024-09-12T01:07:46.022461+0000","last_fullsized":"2024-09-12T01:07:46.022461+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'363","last_scrub_stamp":"2024-09-12T01:07:46.022232+0000","last_deep_scrub":"267'363","last_deep_scrub_stamp":"2024-09-12T01:07:46.022232+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.022232+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:19.433845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48804,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":34651,"num_write":1163,"num_write_kb":39913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2a","version":"267'442","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:44.138669+0000","last_change":"2024-09-12T01:07:44.138669+0000","last_active":"2024-09-12T01:07:44.138669+0000","last_peered":"2024-09-12T01:07:44.138669+0000","last_clean":"2024-09-12T01:07:44.138669+0000","last_became_active":"2024-09-12T00:21:44.511294+0000","last_became_peered":"2024-09-12T00:21:44.511294+0000","last_unstale":"2024-09-12T01:07:44.138669+0000","last_undegraded":"2024-09-12T01:07:44.138669+0000","last_fullsized":"2024-09-12T01:07:44.138669+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-09-12T01:07:44.138494+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-09-12T01:07:44.138494+0000","last_clean_scrub_stamp":"2024-09-12T01:07:44.138494+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.489890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2157,"num_read_kb":1820,"num_write":750,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'349","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.924944+0000","last_change":"2024-09-12T01:07:48.924944+0000","last_active":"2024-09-12T01:07:48.924944+0000","last_peered":"2024-09-12T01:07:48.924944+0000","last_clean":"2024-09-12T01:07:48.924944+0000","last_became_active":"2024-09-12T00:21:42.528942+0000","last_became_peered":"2024-09-12T00:21:42.528942+0000","last_unstale":"2024-09-12T01:07:48.924944+0000","last_undegraded":"2024-09-12T01:07:48.924944+0000","last_fullsized":"2024-09-12T01:07:48.924944+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T01:07:48.924728+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T01:07:48.924728+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.924728+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:56.808821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":48912,"num_write":1189,"num_write_kb":34098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'117","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.317201+0000","last_change":"2024-09-12T01:07:48.317201+0000","last_active":"2024-09-12T01:07:48.317201+0000","last_peered":"2024-09-12T01:07:48.317201+0000","last_clean":"2024-09-12T01:07:48.317201+0000","last_became_active":"2024-09-12T00:21:44.525685+0000","last_became_peered":"2024-09-12T00:21:44.525685+0000","last_unstale":"2024-09-12T01:07:48.317201+0000","last_undegraded":"2024-09-12T01:07:48.317201+0000","last_fullsized":"2024-09-12T01:07:48.317201+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:07:48.316987+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:07:48.316987+0000","last_clean_scrub_stamp":"2024-09-12T01:07:48.316987+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:57.147053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":457,"num_write":189,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'328","reported_seq":954,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.128557+0000","last_change":"2024-09-12T01:07:37.128313+0000","last_active":"2024-09-12T01:07:37.128557+0000","last_peered":"2024-09-12T01:07:37.128557+0000","last_clean":"2024-09-12T01:07:37.128557+0000","last_became_active":"2024-09-12T00:21:42.499294+0000","last_became_peered":"2024-09-12T00:21:42.499294+0000","last_unstale":"2024-09-12T01:07:37.128557+0000","last_undegraded":"2024-09-12T01:07:37.128557+0000","last_fullsized":"2024-09-12T01:07:37.128557+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-12T01:07:37.127984+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-12T01:07:37.127984+0000","last_clean_scrub_stamp":"2024-09-12T01:07:37.127984+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:09.845259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":11483,"num_write":1078,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'192","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.681453+0000","last_change":"2024-09-12T01:07:38.681453+0000","last_active":"2024-09-12T01:07:38.681453+0000","last_peered":"2024-09-12T01:07:38.681453+0000","last_clean":"2024-09-12T01:07:38.681453+0000","last_became_active":"2024-09-12T00:21:44.511085+0000","last_became_peered":"2024-09-12T00:21:44.511085+0000","last_unstale":"2024-09-12T01:07:38.681453+0000","last_undegraded":"2024-09-12T01:07:38.681453+0000","last_fullsized":"2024-09-12T01:07:38.681453+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-12T01:07:38.681238+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-12T01:07:38.681238+0000","last_clean_scrub_stamp":"2024-09-12T01:07:38.681238+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:47.137512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":698,"num_write":312,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'380","reported_seq":1058,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.889507+0000","last_change":"2024-09-12T01:07:42.889331+0000","last_active":"2024-09-12T01:07:42.889507+0000","last_peered":"2024-09-12T01:07:42.889507+0000","last_clean":"2024-09-12T01:07:42.889507+0000","last_became_active":"2024-09-12T00:21:42.518768+0000","last_became_peered":"2024-09-12T00:21:42.518768+0000","last_unstale":"2024-09-12T01:07:42.889507+0000","last_undegraded":"2024-09-12T01:07:42.889507+0000","last_fullsized":"2024-09-12T01:07:42.889507+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-12T01:07:42.889092+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-12T01:07:42.889092+0000","last_clean_scrub_stamp":"2024-09-12T01:07:42.889092+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:00.397455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984139,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":53651,"num_write":1104,"num_write_kb":23347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'311","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.917061+0000","last_change":"2024-09-12T01:07:45.916905+0000","last_active":"2024-09-12T01:07:45.917061+0000","last_peered":"2024-09-12T01:07:45.917061+0000","last_clean":"2024-09-12T01:07:45.917061+0000","last_became_active":"2024-09-12T00:21:42.495480+0000","last_became_peered":"2024-09-12T00:21:42.495480+0000","last_unstale":"2024-09-12T01:07:45.917061+0000","last_undegraded":"2024-09-12T01:07:45.917061+0000","last_fullsized":"2024-09-12T01:07:45.917061+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:07:45.916689+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:07:45.916689+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.916689+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:26.278518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":25580,"num_write":940,"num_write_kb":28169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'195","reported_seq":853,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.322966+0000","last_change":"2024-09-12T01:07:51.322966+0000","last_active":"2024-09-12T01:07:51.322966+0000","last_peered":"2024-09-12T01:07:51.322966+0000","last_clean":"2024-09-12T01:07:51.322966+0000","last_became_active":"2024-09-12T00:21:44.526907+0000","last_became_peered":"2024-09-12T00:21:44.526907+0000","last_unstale":"2024-09-12T01:07:51.322966+0000","last_undegraded":"2024-09-12T01:07:51.322966+0000","last_fullsized":"2024-09-12T01:07:51.322966+0000","mapping_epoch":28,"log_start":"267'100","ondisk_log_start":"267'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'195","last_scrub_stamp":"2024-09-12T01:07:51.322766+0000","last_deep_scrub":"267'195","last_deep_scrub_stamp":"2024-09-12T01:07:51.322766+0000","last_clean_scrub_stamp":"2024-09-12T01:07:51.322766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:48.700283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":917,"num_read_kb":786,"num_write":315,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'317","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.060678+0000","last_change":"2024-09-12T01:07:45.060525+0000","last_active":"2024-09-12T01:07:45.060678+0000","last_peered":"2024-09-12T01:07:45.060678+0000","last_clean":"2024-09-12T01:07:45.060678+0000","last_became_active":"2024-09-12T00:21:42.516614+0000","last_became_peered":"2024-09-12T00:21:42.516614+0000","last_unstale":"2024-09-12T01:07:45.060678+0000","last_undegraded":"2024-09-12T01:07:45.060678+0000","last_fullsized":"2024-09-12T01:07:45.060678+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T01:07:45.060335+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T01:07:45.060335+0000","last_clean_scrub_stamp":"2024-09-12T01:07:45.060335+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:33.065278+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":551234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":30838,"num_write":927,"num_write_kb":38454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'102","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.511593+0000","last_change":"2024-09-12T01:07:46.511593+0000","last_active":"2024-09-12T01:07:46.511593+0000","last_peered":"2024-09-12T01:07:46.511593+0000","last_clean":"2024-09-12T01:07:46.511593+0000","last_became_active":"2024-09-12T00:21:44.496138+0000","last_became_peered":"2024-09-12T00:21:44.496138+0000","last_unstale":"2024-09-12T01:07:46.511593+0000","last_undegraded":"2024-09-12T01:07:46.511593+0000","last_fullsized":"2024-09-12T01:07:46.511593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'102","last_scrub_stamp":"2024-09-12T01:07:46.511410+0000","last_deep_scrub":"267'102","last_deep_scrub_stamp":"2024-09-12T01:07:46.511410+0000","last_clean_scrub_stamp":"2024-09-12T01:07:46.511410+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:58.055004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5839,"num_read_kb":4146,"num_write":1942,"num_write_kb":840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6986,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1115,"ondisk_log_size":1115,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14973,"num_read_kb":14645,"num_write":16791,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1650,"ondisk_log_size":1650,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":605,"ondisk_log_size":605,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1609364,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17687,"num_read_kb":36971,"num_write":14775,"num_write_kb":11603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684328,"num_omap_keys":1568,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1962,"ondisk_log_size":1962,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":101832,"num_read_kb":85065,"num_write":36894,"num_write_kb":18565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44327,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3800,"ondisk_log_size":3800,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":81179371,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36143,"num_read_kb":1795948,"num_write":71818,"num_write_kb":2042491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123875328,"data_stored":123875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3430,"ondisk_log_size":3430,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":206538,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":195226,"num_write":190,"num_write_kb":136844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510014,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110064,"kb_used_data":20640,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94261776,"statfs":{"total":96636764160,"available":96524058624,"internally_reserved":0,"allocated":21135360,"data_stored":19116983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510015,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273492,"kb_used_data":21636,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098348,"statfs":{"total":96636764160,"available":96356708352,"internally_reserved":0,"allocated":22155264,"data_stored":20133475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510017,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200892,"kb_used_data":21228,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94170948,"statfs":{"total":96636764160,"available":96431050752,"internally_reserved":0,"allocated":21737472,"data_stored":19736193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510015,"num_pgs":123,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257480,"kb_used_data":19448,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94114360,"statfs":{"total":96636764160,"available":96373104640,"internally_reserved":0,"allocated":19914752,"data_stored":17899204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":243726792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510018,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145376,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94226464,"statfs":{"total":96636764160,"available":96487899136,"internally_reserved":0,"allocated":24526848,"data_stored":22535733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510015,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286592,"kb_used_data":12464,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94085248,"statfs":{"total":96636764160,"available":96343293952,"internally_reserved":0,"allocated":12763136,"data_stored":10743931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510014,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146944,"kb_used_data":17264,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94224896,"statfs":{"total":96636764160,"available":96486293504,"internally_reserved":0,"allocated":17678336,"data_stored":15657318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542720,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226236,"kb_used_data":18796,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94145604,"statfs":{"total":96636764160,"available":96405098496,"internally_reserved":0,"allocated":19247104,"data_stored":17260105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13402112,"data_stored":13402112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7901184,"data_stored":7901184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20283392,"data_stored":20283392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17481728,"data_stored":17481728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17289216,"data_stored":17289216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16863232,"data_stored":16863232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15007744,"data_stored":15007744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:08:57.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:08:57.498 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:08:57.499 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:08:57.499 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:08:57.499 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:08:57.583 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:08:57.584 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:08:57.584 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:08:57.678 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:08:57.678 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:08:57.678 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:00.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T01:09:03.779 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:09:03.780 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:09:03.780 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:03.864 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:09:03.865 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:09:03.865 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:03.945 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:09:03.946 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:09:03.946 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:06.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T01:09:06.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T01:09:10.048 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:09:10.048 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:09:10.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:10.127 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:09:10.127 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:09:10.127 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:12.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T01:09:12.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T01:09:16.229 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:09:16.229 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:09:16.230 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:09:16.230 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:16.261 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:09:16.261 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:09:16.261 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:16.291 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:09:16.291 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:09:16.291 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:09:16.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:16.325 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:09:16.325 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:09:16.325 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:16.389 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:09:16.389 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:09:16.390 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:09:16.411 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:09:16.411 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:09:16.412 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:09:16.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T01:09:16.449 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:09:16.765 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T01:09:16.765 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:09:17.001 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T01:09:17.001 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:09:17.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T01:09:17.176 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T01:09:17.176 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:09:17.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T01:09:17.349 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:09:17.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T01:09:17.838 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:09:18.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T01:09:18.057 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:09:18.245 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T01:09:18.245 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:09:18.404 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:09:18.405 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/data/mon.a.tgz 2024-09-12T01:09:18.405 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-12T01:09:18.411 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.NxQY6Lh1J9 2024-09-12T01:09:18.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NxQY6Lh1J9 2024-09-12T01:09:18.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.NxQY6Lh1J9 2024-09-12T01:09:18.651 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.NxQY6Lh1J9 is 512KB 2024-09-12T01:09:18.713 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.NxQY6Lh1J9 2024-09-12T01:09:18.719 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/data/mon.c.tgz 2024-09-12T01:09:18.719 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-12T01:09:18.767 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.PqR7cLdzSO 2024-09-12T01:09:18.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PqR7cLdzSO 2024-09-12T01:09:18.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.PqR7cLdzSO 2024-09-12T01:09:19.009 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.PqR7cLdzSO is 521KB 2024-09-12T01:09:19.074 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.PqR7cLdzSO 2024-09-12T01:09:19.081 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/data/mon.b.tgz 2024-09-12T01:09:19.081 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-12T01:09:19.087 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.Khpx5gPjhA 2024-09-12T01:09:19.087 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Khpx5gPjhA 2024-09-12T01:09:19.265 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.Khpx5gPjhA 2024-09-12T01:09:19.327 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.Khpx5gPjhA is 521KB 2024-09-12T01:09:19.389 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.Khpx5gPjhA 2024-09-12T01:09:19.395 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:09:19.395 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:09:19.397 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:09:19.457 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:09:19.499 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:09:19.500 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:09:19.502 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/remote/smithi137/crash 2024-09-12T01:09:19.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:09:19.516 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/remote/smithi150/crash 2024-09-12T01:09:19.517 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:09:19.556 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:09:19.556 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:09:19.560 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:09:19.588 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124303.log 2024-09-12T01:09:19.589 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106013.log 2024-09-12T01:09:19.589 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.124303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42599.log 2024-09-12T01:09:19.591 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.106013.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.124303.log.gz 2024-09-12T01:09:19.591 INFO:teuthology.orchestra.run.smithi137.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.106013.log.gz 2024-09-12T01:09:19.591 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176821.log 2024-09-12T01:09:19.591 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2024-09-12T01:09:19.592 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.176821.log: /var/log/ceph/ceph-client.admin.42599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167369.log 2024-09-12T01:09:19.592 INFO:teuthology.orchestra.run.smithi137.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.176821.log.gz 2024-09-12T01:09:19.592 INFO:teuthology.orchestra.run.smithi137.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.42599.log.gz 2024-09-12T01:09:19.592 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136693.log 2024-09-12T01:09:19.594 INFO:teuthology.orchestra.run.smithi137.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2024-09-12T01:09:19.594 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.167369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182023.log 2024-09-12T01:09:19.594 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.136693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116633.log 2024-09-12T01:09:19.594 INFO:teuthology.orchestra.run.smithi137.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.136693.log.gz 2024-09-12T01:09:19.594 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.182023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86542.log 2024-09-12T01:09:19.595 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.116633.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:09:19.595 INFO:teuthology.orchestra.run.smithi137.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.116633.log.gz 2024-09-12T01:09:19.595 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.86542.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.86542.log.gz 2024-09-12T01:09:19.595 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62180.log 2024-09-12T01:09:19.595 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183672.log 2024-09-12T01:09:19.595 INFO:teuthology.orchestra.run.smithi137.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.167369.log.gz 2024-09-12T01:09:19.595 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125483.log 2024-09-12T01:09:19.596 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120173.log 2024-09-12T01:09:19.597 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183672.log.gz 2024-09-12T01:09:19.597 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.125483.log: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:09:19.597 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.120173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33009.log 2024-09-12T01:09:19.597 INFO:teuthology.orchestra.run.smithi137.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125483.log.gz 2024-09-12T01:09:19.597 INFO:teuthology.orchestra.run.smithi137.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.120173.log.gz 2024-09-12T01:09:19.597 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150267.log 2024-09-12T01:09:19.597 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.33009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52189.log 2024-09-12T01:09:19.599 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33009.log.gz 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.150267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118403.log 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.150267.log.gz/var/log/ceph/ceph-client.admin.52189.log: 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41419.log 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.52189.log.gz 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.118403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98343.log 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.118403.log.gz 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89492.log 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.98343.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.41419.log.gz 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179453.log 2024-09-12T01:09:19.600 INFO:teuthology.orchestra.run.smithi137.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.98343.log.gz 2024-09-12T01:09:19.601 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.89492.log: gzip 82.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.89492.log.gz -- 2024-09-12T01:09:19.601 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.155009.log 2024-09-12T01:09:19.608 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.179453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51599.log 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.179453.log.gz 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.155009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111913.log 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.155009.log.gz 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51599.log: gzip -5 80.9% -- replaced with /var/log/ceph/ceph-client.admin.51599.log.gz 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.0.181427.log 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.111913.log: gzip -5 --verbose 82.4% -- /var/log/ceph/ceph-client.admin.148497.log 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111913.log.gz 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.181427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33402.log 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.181427.log.gz 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.148497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180830.log 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.148497.log.gz 2024-09-12T01:09:19.609 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.33402.log: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33402.log.gz 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.0.175051.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180830.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.180830.log.gz 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32788.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.0.175051.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58954.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32788.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.175051.log.gz 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32788.log.gz 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33198.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32997.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33198.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64763.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33198.log.gz 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32997.log.gz 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183594.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64763.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180043.log 2024-09-12T01:09:19.610 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183594.log.gz 2024-09-12T01:09:19.612 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180706.log 2024-09-12T01:09:19.613 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180043.log: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.180043.log.gz 2024-09-12T01:09:19.613 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156189.log 2024-09-12T01:09:19.613 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180706.log: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.180706.log.gz 2024-09-12T01:09:19.613 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79458.log 2024-09-12T01:09:19.613 INFO:teuthology.orchestra.run.smithi137.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.64763.log.gz 2024-09-12T01:09:19.613 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.156189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156189.log.gz 2024-09-12T01:09:19.613 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87722.log 2024-09-12T01:09:19.615 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96573.log 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.79458.log: /var/log/ceph/ceph-client.admin.87722.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.79458.log.gz 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.58954.log.gz 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.87722.log.gz 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156239.log 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56469.log 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.96573.log: /var/log/ceph/ceph-client.admin.156239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134333.log 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56469.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96573.log.gz 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.156239.log.gz 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122533.log 2024-09-12T01:09:19.616 INFO:teuthology.orchestra.run.smithi137.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.56469.log.gz 2024-09-12T01:09:19.618 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154419.log 2024-09-12T01:09:19.618 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.134333.log: /var/log/ceph/ceph-client.admin.122533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72378.log 2024-09-12T01:09:19.619 INFO:teuthology.orchestra.run.smithi137.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134333.log.gz 2024-09-12T01:09:19.619 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.154419.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122533.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114273.log 2024-09-12T01:09:19.619 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T01:09:19.619 INFO:teuthology.orchestra.run.smithi137.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.154419.log.gz 2024-09-12T01:09:19.619 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72378.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.72378.log.gz 2024-09-12T01:09:19.619 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85362.log 2024-09-12T01:09:19.619 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33447.log 2024-09-12T01:09:19.623 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.114273.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.114273.log.gz 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.85362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33197.log 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.62180.log.gz 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85362.log.gz 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80048.log 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33447.log.gz 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33002.log 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33197.log.gz 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49189.log 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.80048.log: /var/log/ceph/ceph-client.admin.33002.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119583.log 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33002.log.gz 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80048.log.gz 2024-09-12T01:09:19.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159239.log 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49189.log: /var/log/ceph/ceph-client.admin.119583.log: 82.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32801.log 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49189.log.gz 82.3% -- replaced with /var/log/ceph/ceph-client.admin.119583.log.gz 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183828.log 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.159239.log: /var/log/ceph/ceph-client.admin.32801.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.159239.log.gz 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32801.log.gz -5 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.158009.log 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163419.log 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183828.log.gz 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.158009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178001.log 2024-09-12T01:09:19.625 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158009.log.gz 2024-09-12T01:09:19.632 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.163419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127843.log 2024-09-12T01:09:19.632 INFO:teuthology.orchestra.run.smithi137.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.163419.log.gz 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.178001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48009.log 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.178001.log.gz 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.127843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32989.log 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.127843.log.gz 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156214.log 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32989.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.48009.log.gz 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32989.log.gz -5 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45009.log 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.156214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161319.log 2024-09-12T01:09:19.633 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156214.log.gz 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33610.log 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.45009.log.gz 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.161319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38320.log 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.161319.log.gz 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116043.log 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33610.log.gz 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146727.log 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.38320.log: 87.1% -- replaced with /var/log/ceph/ceph-client.0.182023.log.gz 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.38320.log.gz 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.116043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143183.log 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116043.log.gz 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.146727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133743.log 2024-09-12T01:09:19.634 INFO:teuthology.orchestra.run.smithi137.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.146727.log.gz 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165903.log 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.143183.log: /var/log/ceph/ceph-client.admin.133743.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.143183.log.gz 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33214.log 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133743.log.gz 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.165903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45599.log 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.165903.log.gzgzip 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33214.log.gz 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104833.log 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45599.log.gz 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153239.log 2024-09-12T01:09:19.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.104833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32803.log 2024-09-12T01:09:19.636 INFO:teuthology.orchestra.run.smithi137.stderr: 86.8%/var/log/ceph/ceph-client.admin.153239.log: -- replaced with /var/log/ceph/ceph-client.admin.104833.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46829.log 2024-09-12T01:09:19.636 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T01:09:19.636 INFO:teuthology.orchestra.run.smithi137.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.153239.log.gz 2024-09-12T01:09:19.636 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64118.log 2024-09-12T01:09:19.636 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32803.log.gz 2024-09-12T01:09:19.636 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32654.log 2024-09-12T01:09:19.636 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46829.log: /var/log/ceph/ceph-client.admin.64118.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.46829.log.gz 2024-09-12T01:09:19.636 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45649.log 2024-09-12T01:09:19.645 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26725.log 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26797.log 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26725.log.gz 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26845.log 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26797.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26773.log 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26797.log.gz 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26845.log.gz 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26821.log 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26749.log 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26773.log.gz 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26821.log.gz 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26869.log 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26749.log.gz 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26869.log.gz 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:09:19.647 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26701.log 2024-09-12T01:09:19.648 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:09:19.648 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26701.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:09:19.648 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26701.log.gz 2024-09-12T01:09:19.648 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:09:19.651 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:09:19.651 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:09:19.666 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87132.log 2024-09-12T01:09:19.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32654.log.gz 2024-09-12T01:09:19.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172691.log 2024-09-12T01:09:19.666 INFO:teuthology.orchestra.run.smithi137.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.45649.log.gz/var/log/ceph/ceph-client.admin.87132.log: 2024-09-12T01:09:19.666 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153829.log 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64118.log.gz 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr: 81.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43239.log 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87132.log.gz 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.172691.log: /var/log/ceph/ceph-client.admin.153829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78868.log 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr: 80.9%/var/log/ceph/ceph-client.admin.43239.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.153829.log.gz 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123713.log 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.0.172691.log.gz 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.43239.log.gz 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56161.log 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.78868.log.gz 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.123713.log: /var/log/ceph/ceph-client.admin.56161.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.123713.log.gz 2024-09-12T01:09:19.667 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90672.log 2024-09-12T01:09:19.668 INFO:teuthology.orchestra.run.smithi137.stderr: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.56161.log.gz 2024-09-12T01:09:19.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180779.log 2024-09-12T01:09:19.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.90672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117813.log 2024-09-12T01:09:19.668 INFO:teuthology.orchestra.run.smithi137.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.90672.log.gz 2024-09-12T01:09:19.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158059.log 2024-09-12T01:09:19.668 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180779.log.gz 2024-09-12T01:09:19.668 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84178.log 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.117813.log: /var/log/ceph/ceph-client.admin.158059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43829.log 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.117813.log.gz 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158059.log.gz 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.84178.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.84178.log.gz 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88312.log 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176231.log 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.43829.log.gz 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.88312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58309.log 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34767.log 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88312.log.gz 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.176231.log: /var/log/ceph/ceph-client.admin.58309.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.176231.log.gz 2024-09-12T01:09:19.669 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70533.log 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.58309.log.gz 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93623.log 0.0% 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34767.log.gz 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38904.log 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.93623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120763.log 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.70533.log: /var/log/ceph/ceph-client.0.38904.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93623.log.gz 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.38904.log.gz 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.70533.log.gz 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109553.log 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.120763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103653.log 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.109553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51549.log 2024-09-12T01:09:19.670 INFO:teuthology.orchestra.run.smithi137.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.109553.log.gz 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.103653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183568.log 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.103653.log.gz 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51549.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.120763.log.gz 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51549.log.gz 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91852.log 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113683.log 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183568.log.gz 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.91852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71123.log 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75918.log 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.113683.log: /var/log/ceph/ceph-client.0.71123.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.113683.log.gz 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.71123.log.gz 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61535.log 2024-09-12T01:09:19.671 INFO:teuthology.orchestra.run.smithi137.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.91852.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33014.log 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75918.log: /var/log/ceph/ceph-client.admin.61535.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.75918.log.gz 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171511.log 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105423.log 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33014.log.gz 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.171511.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.171511.log.gz 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175641.log 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61535.log.gz 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.105423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33419.log 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105423.log.gz 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33213.log 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.175641.log: /var/log/ceph/ceph-client.admin.33419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33419.log.gz 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.175641.log.gz 2024-09-12T01:09:19.672 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183933.log 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33213.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183412.log 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33213.log.gz 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57075.log 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183933.log.gz 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183412.log.gz 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32122.log 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32799.log 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43189.log 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.57075.log.gz 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32122.log.gz 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32799.log.gz 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56417.log 2024-09-12T01:09:19.673 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43189.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117223.log 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43189.log.gz 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152627.log 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.117223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83588.log 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.117223.log.gz 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.152627.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.152627.log.gz 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180116.log 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.83588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142003.log 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180116.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.180116.log.gz 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39488.log 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.142003.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.142003.log.gz 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83588.log.gz 2024-09-12T01:09:19.674 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97163.log 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.39488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183959.log 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.39488.log.gz 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.97163.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.97163.log.gz 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140233.log 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80638.log 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183959.log.gz 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.140233.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.140233.log.gz 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183698.log 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.80638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32998.log 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.80638.log.gz 2024-09-12T01:09:19.675 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183698.log.gz 2024-09-12T01:09:19.676 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94803.log 2024-09-12T01:09:19.676 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130793.log 2024-09-12T01:09:19.676 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32998.log.gz 2024-09-12T01:09:19.676 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.94803.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.94803.log.gz 2024-09-12T01:09:19.683 INFO:teuthology.orchestra.run.smithi150.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:09:19.685 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100703.log 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.130793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144363.log 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.130793.log.gz 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.100703.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.100703.log.gz 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169149.log 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.144363.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.144363.log.gz 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.169149.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.169149.log.gz 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183776.log 2024-09-12T01:09:19.686 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143773.log 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183776.log.gz 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183542.log 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.143773.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.143773.log.gz 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56417.log.gz 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78278.log 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93032.log 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183542.log.gz 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78278.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.78278.log.gz 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50959.log 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48599.log 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.93032.log: /var/log/ceph/ceph-client.admin.50959.log: 82.1% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93032.log.gz 2024-09-12T01:09:19.687 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50959.log.gz 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56444.log 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162241.log 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48599.log: /var/log/ceph/ceph-client.admin.56444.log: 52.6% -- replaced with /var/log/ceph/ceph-client.admin.56444.log.gz 82.0% -- replaced with /var/log/ceph/ceph-client.admin.48599.log.gz 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63470.log 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88902.log 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.162241.log: /var/log/ceph/ceph-client.admin.63470.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.162241.log.gz 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63470.log.gz 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98933.log 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81818.log 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.88902.log: /var/log/ceph/ceph-client.admin.98933.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.88902.log.gz 82.3% -- replaced with /var/log/ceph/ceph-client.admin.98933.log.gz 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T01:09:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81228.log 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107783.log 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.81228.log: /var/log/ceph/ceph-client.admin.81818.log: 82.5% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.81818.log.gz 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81228.log.gz 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32726.log 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112503.log 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.107783.log: /var/log/ceph/ceph-client.admin.32726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32726.log.gz 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.107783.log.gz 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180091.log 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32700.log 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.112503.log: /var/log/ceph/ceph-client.admin.180091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180091.log.gz 82.1% -- replaced with /var/log/ceph/ceph-client.admin.112503.log.gz 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T01:09:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158649.log 2024-09-12T01:09:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.160137.log 2024-09-12T01:09:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32700.log: /var/log/ceph/ceph-client.admin.158649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32700.log.gz 2024-09-12T01:09:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:09:19.691 INFO:teuthology.orchestra.run.smithi137.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.158649.log.gz 2024-09-12T01:09:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.160137.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.160137.log.gz 2024-09-12T01:09:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183620.log 2024-09-12T01:09:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56081.log 2024-09-12T01:09:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-client.admin.183620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183620.log.gz 2024-09-12T01:09:19.693 INFO:teuthology.orchestra.run.smithi137.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:09:19.693 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99523.log 2024-09-12T01:09:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:09:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56081.log: /var/log/ceph/ceph-client.admin.99523.log: 55.7% -- replaced with /var/log/ceph/ceph-client.admin.56081.log.gz 2024-09-12T01:09:19.695 INFO:teuthology.orchestra.run.smithi137.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.99523.log.gz 2024-09-12T01:09:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53369.log 2024-09-12T01:09:19.706 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33406.log 2024-09-12T01:09:19.707 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53369.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.53369.log.gz 2024-09-12T01:09:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97753.log 2024-09-12T01:09:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33406.log.gz 2024-09-12T01:09:19.709 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62825.log 2024-09-12T01:09:19.709 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.97753.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.97753.log.gz 2024-09-12T01:09:19.710 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170331.log 2024-09-12T01:09:19.713 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62825.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.62825.log.gz 2024-09-12T01:09:19.713 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55842.log 2024-09-12T01:09:19.714 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.170331.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.170331.log.gz 2024-09-12T01:09:19.714 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66856.log 2024-09-12T01:09:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55842.log: 58.9% -- replaced with /var/log/ceph/ceph-client.admin.55842.log.gz 2024-09-12T01:09:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2024-09-12T01:09:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66856.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.66856.log.gz 2024-09-12T01:09:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77098.log 2024-09-12T01:09:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2024-09-12T01:09:19.718 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102473.log 2024-09-12T01:09:19.718 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77098.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77098.log.gz 2024-09-12T01:09:19.719 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33210.log 2024-09-12T01:09:19.720 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.102473.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.102473.log.gz 2024-09-12T01:09:19.720 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53959.log 2024-09-12T01:09:19.721 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33210.log.gz 2024-09-12T01:09:19.721 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74738.log 2024-09-12T01:09:19.722 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53959.log.gz 2024-09-12T01:09:19.722 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180805.log 2024-09-12T01:09:19.723 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74738.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.74738.log.gz 2024-09-12T01:09:19.723 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33420.log 2024-09-12T01:09:19.724 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180805.log.gz 2024-09-12T01:09:19.724 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118993.log 2024-09-12T01:09:19.725 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33420.log.gz 2024-09-12T01:09:19.726 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73558.log 2024-09-12T01:09:19.726 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.118993.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118993.log.gz 2024-09-12T01:09:19.727 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85952.log 2024-09-12T01:09:19.728 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73558.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.73558.log.gz 2024-09-12T01:09:19.728 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74148.log 2024-09-12T01:09:19.729 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.85952.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.85952.log.gz 2024-09-12T01:09:19.729 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76508.log 2024-09-12T01:09:19.730 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74148.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74148.log.gz 2024-09-12T01:09:19.730 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180066.log 2024-09-12T01:09:19.731 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76508.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.76508.log.gz 2024-09-12T01:09:19.732 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127253.log 2024-09-12T01:09:19.732 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180066.log.gz 2024-09-12T01:09:19.733 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68038.log 2024-09-12T01:09:19.735 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.127253.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.127253.log.gz 2024-09-12T01:09:19.735 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123123.log 2024-09-12T01:09:19.736 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68038.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.68038.log.gz 2024-09-12T01:09:19.736 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54009.log 2024-09-12T01:09:19.737 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.123123.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.123123.log.gz 2024-09-12T01:09:19.738 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183386.log 2024-09-12T01:09:19.738 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54009.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.54009.log.gz 2024-09-12T01:09:19.739 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138463.log 2024-09-12T01:09:19.740 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183386.log.gz 2024-09-12T01:09:19.740 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82408.log 2024-09-12T01:09:19.741 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.138463.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.138463.log.gz 2024-09-12T01:09:19.741 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156829.log 2024-09-12T01:09:19.742 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.82408.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.82408.log.gz 2024-09-12T01:09:19.742 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90082.log 2024-09-12T01:09:19.743 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.156829.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.156829.log.gz 2024-09-12T01:09:19.744 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77688.log 2024-09-12T01:09:19.745 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.90082.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90082.log.gz 2024-09-12T01:09:19.745 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113093.log 2024-09-12T01:09:19.746 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77688.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.77688.log.gz 2024-09-12T01:09:19.746 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134923.log 2024-09-12T01:09:19.747 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.113093.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.113093.log.gz 2024-09-12T01:09:19.747 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152037.log 2024-09-12T01:09:19.748 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.134923.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.134923.log.gz 2024-09-12T01:09:19.749 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132563.log 2024-09-12T01:09:19.750 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.152037.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.152037.log.gz 2024-09-12T01:09:19.750 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155599.log 2024-09-12T01:09:19.751 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.132563.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.132563.log.gz 2024-09-12T01:09:19.751 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26934.log 2024-09-12T01:09:19.752 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.155599.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.155599.log.gz 2024-09-12T01:09:19.752 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111323.log 2024-09-12T01:09:19.753 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26934.log.gz 2024-09-12T01:09:19.754 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:09:19.754 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.111323.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111323.log.gz 2024-09-12T01:09:19.755 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70496.log 2024-09-12T01:09:19.766 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.log: 93.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67448.log 2024-09-12T01:09:19.767 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70496.log: 51.2% -- replaced with /var/log/ceph/ceph-client.admin.70496.log.gz 2024-09-12T01:09:19.767 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:09:19.768 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141413.log 2024-09-12T01:09:19.769 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67448.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67448.log.gz 2024-09-12T01:09:19.770 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33450.log 2024-09-12T01:09:19.770 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.141413.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.141413.log.gz 2024-09-12T01:09:19.771 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126663.log 2024-09-12T01:09:19.771 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33450.log.gz 2024-09-12T01:09:19.772 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34790.log 2024-09-12T01:09:19.773 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.126663.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.126663.log.gz 2024-09-12T01:09:19.773 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183490.log 2024-09-12T01:09:19.774 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.34790.log: 96.0% -- replaced with /var/log/ceph/ceph-client.0.34790.log.gz 2024-09-12T01:09:19.775 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183646.log 2024-09-12T01:09:19.776 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183490.log.gz 2024-09-12T01:09:19.776 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108963.log 2024-09-12T01:09:19.777 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183646.log.gz 2024-09-12T01:09:19.777 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47419.log 2024-09-12T01:09:19.778 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.108963.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.108963.log.gz 2024-09-12T01:09:19.778 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71788.log 2024-09-12T01:09:19.779 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47419.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.47419.log.gz 2024-09-12T01:09:19.779 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183907.log 2024-09-12T01:09:19.780 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71788.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.71788.log.gz 2024-09-12T01:09:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56350.log 2024-09-12T01:09:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183907.log.gz 2024-09-12T01:09:19.782 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183880.log 2024-09-12T01:09:19.783 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56350.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.56350.log.gz 2024-09-12T01:09:19.783 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142593.log 2024-09-12T01:09:19.784 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183880.log.gz 2024-09-12T01:09:19.784 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183750.log 2024-09-12T01:09:19.785 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.142593.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.142593.log.gz 2024-09-12T01:09:19.785 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2024-09-12T01:09:19.786 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183750.log.gz 2024-09-12T01:09:19.786 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32604.log 2024-09-12T01:09:19.787 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2024-09-12T01:09:19.787 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133153.log 2024-09-12T01:09:19.788 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32604.log.gz 2024-09-12T01:09:19.788 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84768.log 2024-09-12T01:09:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.133153.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.133153.log.gz 2024-09-12T01:09:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69220.log 2024-09-12T01:09:19.790 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.84768.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.84768.log.gz 2024-09-12T01:09:19.791 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115453.log 2024-09-12T01:09:19.791 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69220.log: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.69220.log.gz 2024-09-12T01:09:19.792 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169739.log 2024-09-12T01:09:19.792 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.115453.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.115453.log.gz 2024-09-12T01:09:19.793 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:09:19.794 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.169739.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.169739.log.gz 2024-09-12T01:09:19.794 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149087.log 2024-09-12T01:09:19.811 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33222.log 2024-09-12T01:09:19.812 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.149087.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.149087.log.gz 2024-09-12T01:09:19.831 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145546.log 2024-09-12T01:09:19.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33222.log.gz 2024-09-12T01:09:19.839 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37146.log 2024-09-12T01:09:19.841 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.145546.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.145546.log.gz 2024-09-12T01:09:19.847 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183802.log 2024-09-12T01:09:19.847 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.37146.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.37146.log.gz 2024-09-12T01:09:19.855 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34691.log 2024-09-12T01:09:19.855 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183802.log.gz 2024-09-12T01:09:19.863 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121353.log 2024-09-12T01:09:19.863 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34691.log.gz 2024-09-12T01:09:19.871 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40829.log 2024-09-12T01:09:19.871 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.121353.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.121353.log.gz 2024-09-12T01:09:19.879 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183854.log 2024-09-12T01:09:19.879 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40829.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.40829.log.gz 2024-09-12T01:09:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75328.log 2024-09-12T01:09:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183854.log.gz 2024-09-12T01:09:19.895 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37736.log 2024-09-12T01:09:19.895 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75328.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.75328.log.gz 2024-09-12T01:09:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135513.log 2024-09-12T01:09:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.37736.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.37736.log.gz 2024-09-12T01:09:19.911 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34667.log 2024-09-12T01:09:19.913 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.135513.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.135513.log.gz 2024-09-12T01:09:19.919 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56392.log 2024-09-12T01:09:19.919 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34667.log.gz 2024-09-12T01:09:19.927 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167958.log 2024-09-12T01:09:19.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56392.log.gz 2024-09-12T01:09:19.935 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137873.log 2024-09-12T01:09:19.935 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.167958.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.167958.log.gz 2024-09-12T01:09:19.943 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174461.log 2024-09-12T01:09:19.943 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.137873.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.137873.log.gz 2024-09-12T01:09:19.951 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68629.log 2024-09-12T01:09:19.951 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.174461.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.174461.log.gz 2024-09-12T01:09:19.959 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151447.log 2024-09-12T01:09:19.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68629.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.68629.log.gz 2024-09-12T01:09:19.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54599.log 2024-09-12T01:09:19.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.151447.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.151447.log.gz 2024-09-12T01:09:19.975 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173281.log 2024-09-12T01:09:19.975 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54599.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.54599.log.gz 2024-09-12T01:09:19.983 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110733.log 2024-09-12T01:09:19.983 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.173281.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.173281.log.gz 2024-09-12T01:09:19.991 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137283.log 2024-09-12T01:09:19.991 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.110733.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.110733.log.gz 2024-09-12T01:09:19.999 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:09:19.999 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.137283.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.137283.log.gz 2024-09-12T01:09:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91262.log 2024-09-12T01:09:20.019 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57664.log 2024-09-12T01:09:20.019 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.91262.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.91262.log.gz 2024-09-12T01:09:20.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101883.log 2024-09-12T01:09:20.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57664.log: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95983.log 2024-09-12T01:09:20.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.101883.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101883.log.gz 2024-09-12T01:09:20.067 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57664.log.gz 2024-09-12T01:09:20.067 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:09:20.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.95983.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.95983.log.gz 2024-09-12T01:09:20.099 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69268.log 2024-09-12T01:09:20.102 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.audit.log: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:09:20.111 INFO:teuthology.orchestra.run.smithi137.stderr: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51574.log 2024-09-12T01:09:20.112 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.69268.log: 84.8% -- replaced with /var/log/ceph/ceph-client.0.69268.log.gz 2024-09-12T01:09:20.112 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:09:20.123 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60890.log 2024-09-12T01:09:20.123 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51574.log.gz 2024-09-12T01:09:20.139 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183724.log 2024-09-12T01:09:20.141 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60890.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.60890.log.gz 2024-09-12T01:09:20.163 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59600.log 2024-09-12T01:09:20.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183724.log.gz 2024-09-12T01:09:20.175 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178863.log 2024-09-12T01:09:20.183 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59600.log: 93.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168559.log 2024-09-12T01:09:20.184 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.178863.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.178863.log.gz 2024-09-12T01:09:20.191 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104243.log 2024-09-12T01:09:20.191 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.168559.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.168559.log.gz 2024-09-12T01:09:20.195 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59600.log.gz 2024-09-12T01:09:20.196 INFO:teuthology.orchestra.run.smithi137.stderr: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:09:20.197 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139053.log 2024-09-12T01:09:20.197 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.104243.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.104243.log.gz 2024-09-12T01:09:20.198 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42009.log 2024-09-12T01:09:20.198 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.139053.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.139053.log.gz 2024-09-12T01:09:20.199 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52779.log 2024-09-12T01:09:20.199 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42009.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.42009.log.gz 2024-09-12T01:09:20.200 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55189.log 2024-09-12T01:09:20.200 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52779.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.52779.log.gz 2024-09-12T01:09:20.200 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57039.log 2024-09-12T01:09:20.202 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55189.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.55189.log.gz 2024-09-12T01:09:20.202 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53984.log 2024-09-12T01:09:20.202 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57039.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.57039.log.gz 2024-09-12T01:09:20.202 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26687.log 2024-09-12T01:09:20.204 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53984.log.gz 2024-09-12T01:09:20.204 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149677.log 2024-09-12T01:09:20.204 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26687.log.gz 2024-09-12T01:09:20.204 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101293.log 2024-09-12T01:09:20.205 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.149677.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.149677.log.gz 2024-09-12T01:09:20.205 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128433.log 2024-09-12T01:09:20.205 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.101293.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101293.log.gz 2024-09-12T01:09:20.206 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180729.log 2024-09-12T01:09:20.206 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.128433.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.128433.log.gz 2024-09-12T01:09:20.207 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107193.log 2024-09-12T01:09:20.207 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180729.log.gz 2024-09-12T01:09:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157419.log 2024-09-12T01:09:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.107193.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.107193.log.gz 2024-09-12T01:09:20.209 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50369.log 2024-09-12T01:09:20.209 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.157419.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.157419.log.gz 2024-09-12T01:09:20.209 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32999.log 2024-09-12T01:09:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50369.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.50369.log.gz 2024-09-12T01:09:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33221.log 2024-09-12T01:09:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32999.log.gz 2024-09-12T01:09:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33421.log 2024-09-12T01:09:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33221.log.gz 2024-09-12T01:09:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165314.log 2024-09-12T01:09:20.214 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33421.log.gz 2024-09-12T01:09:20.214 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129613.log 2024-09-12T01:09:20.214 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.165314.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165314.log.gz 2024-09-12T01:09:20.214 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35388.log 2024-09-12T01:09:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.129613.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.129613.log.gz 2024-09-12T01:09:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60245.log 2024-09-12T01:09:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.35388.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35388.log.gz 2024-09-12T01:09:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162830.log 2024-09-12T01:09:20.222 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60245.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.60245.log.gz 2024-09-12T01:09:20.222 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69858.log 2024-09-12T01:09:20.223 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.162830.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162830.log.gz 2024-09-12T01:09:20.223 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92442.log 2024-09-12T01:09:20.224 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.69858.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.69858.log.gz 2024-09-12T01:09:20.224 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66267.log 2024-09-12T01:09:20.225 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.92442.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.92442.log.gz 2024-09-12T01:09:20.226 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166492.log 2024-09-12T01:09:20.226 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66267.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.66267.log.gz 2024-09-12T01:09:20.227 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35972.log 2024-09-12T01:09:20.227 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.166492.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.166492.log.gz 2024-09-12T01:09:20.228 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34741.log 2024-09-12T01:09:20.229 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.35972.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.35972.log.gz 2024-09-12T01:09:20.229 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95393.log 2024-09-12T01:09:20.230 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34741.log.gz 2024-09-12T01:09:20.230 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164725.log 2024-09-12T01:09:20.231 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.95393.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.95393.log.gz 2024-09-12T01:09:20.231 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34717.log 2024-09-12T01:09:20.232 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.164725.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.164725.log.gz 2024-09-12T01:09:20.233 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183516.log 2024-09-12T01:09:20.233 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34717.log.gz 2024-09-12T01:09:20.234 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164008.log 2024-09-12T01:09:20.234 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183516.log.gz 2024-09-12T01:09:20.235 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131973.log 2024-09-12T01:09:20.235 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.164008.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164008.log.gz 2024-09-12T01:09:20.236 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158034.log 2024-09-12T01:09:20.237 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.131973.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131973.log.gz 2024-09-12T01:09:20.237 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183334.log 2024-09-12T01:09:20.238 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.158034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158034.log.gz 2024-09-12T01:09:20.238 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146136.log 2024-09-12T01:09:20.239 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183334.log.gz 2024-09-12T01:09:20.239 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106603.log 2024-09-12T01:09:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.146136.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.146136.log.gz 2024-09-12T01:09:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72968.log 2024-09-12T01:09:20.242 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.106603.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106603.log.gz 2024-09-12T01:09:20.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36562.log 2024-09-12T01:09:20.243 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72968.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.72968.log.gz 2024-09-12T01:09:20.244 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180754.log 2024-09-12T01:09:20.244 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.36562.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36562.log.gz 2024-09-12T01:09:20.245 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130203.log 2024-09-12T01:09:20.246 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.180754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180754.log.gz 2024-09-12T01:09:20.246 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32806.log 2024-09-12T01:09:20.246 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.130203.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.130203.log.gz 2024-09-12T01:09:20.247 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131383.log 2024-09-12T01:09:20.247 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32806.log.gz 2024-09-12T01:09:20.248 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110143.log 2024-09-12T01:09:20.249 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.131383.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.131383.log.gz 2024-09-12T01:09:20.249 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173871.log 2024-09-12T01:09:20.250 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.110143.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.110143.log.gz 2024-09-12T01:09:20.250 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33207.log 2024-09-12T01:09:20.251 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.173871.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.173871.log.gz 2024-09-12T01:09:20.251 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82998.log 2024-09-12T01:09:20.252 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33207.log.gz 2024-09-12T01:09:20.252 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183983.log 2024-09-12T01:09:20.253 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.82998.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.82998.log.gz 2024-09-12T01:09:20.253 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32804.log 2024-09-12T01:09:20.254 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183983.log.gz 2024-09-12T01:09:20.254 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103063.log 2024-09-12T01:09:20.255 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32804.log.gz 2024-09-12T01:09:20.255 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32629.log 2024-09-12T01:09:20.256 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.103063.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.103063.log.gz 2024-09-12T01:09:20.256 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150857.log 2024-09-12T01:09:20.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32629.log.gz 2024-09-12T01:09:20.258 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136103.log 2024-09-12T01:09:20.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.150857.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.150857.log.gz 2024-09-12T01:09:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126073.log 2024-09-12T01:09:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.136103.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136103.log.gz 2024-09-12T01:09:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100113.log 2024-09-12T01:09:20.261 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.126073.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126073.log.gz 2024-09-12T01:09:20.261 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139643.log 2024-09-12T01:09:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.100113.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.100113.log.gz 2024-09-12T01:09:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32752.log 2024-09-12T01:09:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.139643.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.139643.log.gz 2024-09-12T01:09:20.266 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43214.log 2024-09-12T01:09:20.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32752.log.gz 2024-09-12T01:09:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33010.log 2024-09-12T01:09:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43214.log.gz 2024-09-12T01:09:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44419.log 2024-09-12T01:09:20.269 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33010.log.gz 2024-09-12T01:09:20.269 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172101.log 2024-09-12T01:09:20.270 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44419.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.44419.log.gz 2024-09-12T01:09:20.270 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45624.log 2024-09-12T01:09:20.272 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.172101.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.172101.log.gz 2024-09-12T01:09:20.272 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33422.log 2024-09-12T01:09:20.272 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2024-09-12T01:09:20.272 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57012.log 2024-09-12T01:09:20.273 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33422.log.gz 2024-09-12T01:09:20.274 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147317.log 2024-09-12T01:09:20.274 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57012.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.57012.log.gz 2024-09-12T01:09:20.274 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170921.log 2024-09-12T01:09:20.276 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.147317.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.147317.log.gz 2024-09-12T01:09:20.276 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121943.log 2024-09-12T01:09:20.277 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.170921.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.170921.log.gz 2024-09-12T01:09:20.277 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140823.log 2024-09-12T01:09:20.278 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.121943.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.121943.log.gz 2024-09-12T01:09:20.278 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183360.log 2024-09-12T01:09:20.279 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.140823.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.140823.log.gz 2024-09-12T01:09:20.280 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33662.log 2024-09-12T01:09:20.281 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183360.log.gz 2024-09-12T01:09:20.281 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129023.log 2024-09-12T01:09:20.282 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33662.log.gz 2024-09-12T01:09:20.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21895.log 2024-09-12T01:09:20.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.129023.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129023.log.gz 2024-09-12T01:09:20.284 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65414.log 2024-09-12T01:09:20.284 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.tmp-client.admin.21895.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21895.log.gz 2024-09-12T01:09:20.285 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183438.log 2024-09-12T01:09:20.285 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65414.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.65414.log.gz 2024-09-12T01:09:20.286 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144953.log 2024-09-12T01:09:20.286 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183438.log.gz 2024-09-12T01:09:20.286 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160730.log 2024-09-12T01:09:20.287 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.144953.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.144953.log.gz 2024-09-12T01:09:20.287 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114863.log 2024-09-12T01:09:20.292 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.160730.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160730.log.gz 2024-09-12T01:09:20.292 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177411.log 2024-09-12T01:09:20.294 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.114863.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.114863.log.gz 2024-09-12T01:09:20.294 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108373.log 2024-09-12T01:09:20.295 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.177411.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.177411.log.gz 2024-09-12T01:09:20.295 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26834.log 2024-09-12T01:09:20.296 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.108373.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.108373.log.gz 2024-09-12T01:09:20.297 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183464.log 2024-09-12T01:09:20.298 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26834.log.gz 2024-09-12T01:09:20.298 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147907.log 2024-09-12T01:09:20.299 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.183464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183464.log.gz 2024-09-12T01:09:20.299 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32805.log 2024-09-12T01:09:20.300 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.147907.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.147907.log.gz 2024-09-12T01:09:20.301 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124893.log 2024-09-12T01:09:20.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32805.log.gz 2024-09-12T01:09:20.302 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153217.log 2024-09-12T01:09:20.302 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.124893.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.124893.log.gz 2024-09-12T01:09:20.303 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49779.log 2024-09-12T01:09:20.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.153217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153217.log.gz 2024-09-12T01:09:20.303 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94213.log 2024-09-12T01:09:20.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49779.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.49779.log.gz 2024-09-12T01:09:20.305 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.94213.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.94213.log.gz 2024-09-12T01:09:20.539 INFO:teuthology.orchestra.run.smithi150.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:09:20.841 INFO:teuthology.orchestra.run.smithi137.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:09:22.131 INFO:teuthology.orchestra.run.smithi137.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:09:23.487 INFO:teuthology.orchestra.run.smithi137.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:09:27.399 INFO:teuthology.orchestra.run.smithi150.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:09:27.562 INFO:teuthology.orchestra.run.smithi150.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:09:28.548 INFO:teuthology.orchestra.run.smithi137.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:09:29.796 INFO:teuthology.orchestra.run.smithi137.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:09:30.197 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:09:30.719 INFO:teuthology.orchestra.run.smithi150.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:09:36.576 INFO:teuthology.orchestra.run.smithi137.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:09:36.578 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T01:09:36.578 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m17.016s 2024-09-12T01:09:36.578 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m53.022s 2024-09-12T01:09:36.579 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m2.010s 2024-09-12T01:09:36.993 INFO:teuthology.orchestra.run.smithi150.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:09:36.995 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-12T01:09:36.995 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m17.390s 2024-09-12T01:09:36.995 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m43.589s 2024-09-12T01:09:36.995 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m1.504s 2024-09-12T01:09:36.995 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:09:36.996 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/remote/smithi137/log 2024-09-12T01:09:36.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:09:43.005 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/remote/smithi150/log 2024-09-12T01:09:43.005 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:09:48.052 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:09:48.063 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:09:48.063 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:09:48.066 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:09:48.163 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:09:48.174 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:09:48.174 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:09:48.177 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:09:48.186 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T01:09:48.186 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-09-12T01:09:48.186 INFO:teuthology.orchestra.run.smithi137.stdout:*hv01.front.sepi 67.205.162.81 3 u 14 64 377 0.097 -1.388 0.455 2024-09-12T01:09:48.186 INFO:teuthology.orchestra.run.smithi137.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 377 0.072 -0.790 0.398 2024-09-12T01:09:48.186 INFO:teuthology.orchestra.run.smithi137.stdout:+hv03.front.sepi 74.6.168.72 3 u 18 64 377 0.104 -3.312 0.217 2024-09-12T01:09:48.186 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T01:09:48.190 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T01:09:48.190 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2024-09-12T01:09:48.191 INFO:teuthology.orchestra.run.smithi150.stdout:*hv01.front.sepi 67.205.162.81 3 u 14 64 377 0.121 -2.020 0.695 2024-09-12T01:09:48.191 INFO:teuthology.orchestra.run.smithi150.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.076 -1.929 0.590 2024-09-12T01:09:48.191 INFO:teuthology.orchestra.run.smithi150.stdout:+hv03.front.sepi 74.6.168.72 3 u 1 64 377 0.086 -4.242 0.643 2024-09-12T01:09:48.191 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T01:09:48.192 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:09:48.203 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:09:48.203 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:09:48.213 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:09:48.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:09:48.236 INFO:teuthology.task.internal:Duration was 3553.229667 seconds 2024-09-12T01:09:48.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:09:48.247 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:09:48.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:09:48.249 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:09:48.286 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:09:48.286 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T01:09:48.287 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:09:48.336 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T01:09:48.336 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:09:48.346 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:09:48.347 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:09:48.384 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:09:48.413 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:09:48.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:09:48.452 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:09:48.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:09:48.522 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:09:48.523 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:09:48.535 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:09:48.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:09:48.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:09:48.581 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:09:48.589 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-09-12T01:09:48.600 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-09-12T01:09:48.623 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:09:48.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:09:48.647 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:09:48.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:09:48.671 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:09:48.683 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:09:48.684 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/remote/smithi137 2024-09-12T01:09:48.684 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:09:48.715 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901846/remote/smithi150 2024-09-12T01:09:48.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:09:48.735 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:09:48.735 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:09:48.753 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:09:48.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:09:48.797 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:09:48.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:09:48.807 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:09:48.808 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:09:48.810 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:09:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:09 /home/ubuntu/cephtest 2024-09-12T01:09:48.831 INFO:teuthology.orchestra.run.smithi150.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:09 /home/ubuntu/cephtest 2024-09-12T01:09:48.833 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:09:48.843 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:09:48.869 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3553.2296674251556 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:09:48.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:09:48.951 INFO:teuthology.run:pass